Idea Diversity / Coverage Gap Advisory Example

This example shows the two #257 advisory surfaces. Both are warnings for scholar attention, not blockers.

1. Socratic wording-pattern advisory

User draft:

I want to study "exploring the impact of AI feedback on student motivation."

Socratic mentor response excerpt:

[WORDING_PATTERN_ADVISORY]
Your phrasing "exploring the impact of AI feedback on student motivation" resembles a common AI-typical research-question shell: WP01 impact/effect frame. I am not judging the idea; I am only flagging the wording. What term, mechanism, site, or tension would a specialist in your field use instead?

What is the specific feedback situation you care about: automated scoring, formative comments, timing of feedback, or how students decide whether feedback is worth acting on?

Acceptable user choice:

• Keep the original phrasing because it matches a target journal's framing.
• Rephrase in domain-native terms, e.g. "How do first-year engineering students decide whether AI-generated formative comments are actionable during lab-report revision?"
• Ask the mentor to help stress-test scope without rewriting the RQ.

Boundary: the advisory does not say the idea is generic or bad. It flags only the wording shell.

2. Lit-review distributional skew advisory

Search context:

• RQ: "How do AI feedback systems shape student revision behavior in higher education?"
• Final included sources: 25
• Topic coverage: all major RQ subtopics covered
• Known venue/method metadata:
• 23/25 sources are post-2023 NLP or learning-analytics venues
• 21/24 known-method entries are quantitative log-data studies
• 18/20 known-geography entries are North America or Western Europe

Search Strategy Report excerpt:

### Coverage Distribution Advisory

DISTRIBUTIONAL_SKEW_ADVISORY:
- Dimension: time distribution
- Concentration: 2023-2026 = 23/25 (92%)
- Advisory: This is a coverage-distribution signal, not a defect. Consider whether the RQ warrants earlier foundational work on feedback uptake, revision behavior, or formative assessment.
- Search response: add backward citation chaining from foundational feedback-literacy and formative-assessment works.

DISTRIBUTIONAL_SKEW_ADVISORY:
- Dimension: methodological distribution
- Concentration: quantitative log-data studies = 21/24 (87.5%)
- Advisory: This is a coverage-distribution signal, not a defect. Consider whether the question warrants qualitative or mixed-method evidence about how students interpret feedback.
- Search response: add search string ("AI feedback" OR "automated feedback") AND ("student interpretation" OR "feedback literacy" OR interview OR qualitative).

DISTRIBUTIONAL_SKEW_ADVISORY:
- Dimension: geographic distribution
- Concentration: North America / Western Europe = 18/20 (90%)
- Advisory: This is a coverage-distribution signal, not a defect. Consider whether institutional context changes feedback uptake.
- Search response: add regional database search for Taiwan, East Asia, and bilingual higher-education studies.

Boundary: the bibliography is still valid. The advisory asks whether the corpus distribution matches the RQ; it does not reject the search or force expansion.