Checkpoint 2
Weight: 10% (plus 5% for your peer review of others’ checkpoints)
Assigned: Class 4, Friday 12 February 2027
Due: Sunday 28 February 2027, 23:59
Peer review due: Wednesday 3 March 2027, 23:59 (FeedbackFruits)
Used in: Class 9, Friday 5 March 2027 (peer review intensive)
Purpose
Transform your literature search into critical analysis. Move from discovering research to evaluating it: identifying patterns, contradictions, and real opportunities for contribution.
Important context: Checkpoint 2 is the basis for the course’s main peer review round. Two classmates review it in FeedbackFruits by Wednesday 3 March, and in Class 9 (Friday 5 March) we work through those reviews together. Your analysis becomes part of the draft proposal you share with peers, so this work feeds directly into collaborative feedback.
How to submit
You must write your checkpoint directly in Google Docs and share the link in BrightSpace with View access before the deadline. This is required so I can view the full version history, including when text was added, revised, moved, or deleted over time. This requirement exists because the assignment assesses how you develop and refine your research thinking, as well as the final product. Documents that show a single bulk insertion of text or minimal revision will not be accepted for full credit.
- ✅ Good signs: incremental writing over multiple sessions, visible deletion/revision, reorganization, gradual refinement
- ⚠️ Warning signs: single large text insertions at the level of sentences, minimal edits, perfectly formatted on first draft, no visible struggle
- 🚩 Red flags: entire sections pasted at once, no revision marks, suspiciously polished prose throughout
If you use AI tools, include a short AI usage statement as described in our class AI policy.
What to submit
Write Checkpoint 2 in one Google Doc and keep using it through to the proposal. Open it with your current RQ in one sentence, then add the sections below.
1. Critical analysis of key papers (800-1,200 words)
Analyze 6-8 key papers from your search using the MERC framework (introduced in Class 4; use the MERC worksheet in BrightSpace for your notes):
- Methodology: Are the research design and methods appropriate and rigorous for the question?
- Evidence: How strong is the empirical support? Are the claims backed by the data?
- Relevance: How does this work connect to your research question?
- Contribution: What does this actually add to the field?
Critical: Don’t analyze papers one by one. Organize thematically and look for patterns. For example:
- Group papers by methodology (experimental vs. corpus-based vs. computational modeling)
- Group by research focus (prosody vs. segmental features vs. speaker variation)
- Group by theoretical perspective (cognitive vs. computational vs. sociolinguistic)
Address these questions across your papers:
- What methodological patterns dominate? What are the shared strengths and limitations?
- Where do you see converging evidence? Where is evidence weaker?
- What theoretical frameworks organize this research?
- What have these papers actually contributed to the field?
What good analysis looks like:
“Three studies (Smith, 2020; Jones, 2021; Lee, 2022) used laboratory-recorded speech with 50-100 participants, enabling precise acoustic control. However, none examined spontaneous speech or code-switching contexts, limiting ecological validity. In contrast, corpus-based work (Brown, 2023) reveals patterns invisible in lab settings but sacrifices experimental control…”
What to avoid:
“Smith et al. (2020) studied ASR with 50 participants and found X. Jones (2021) also studied ASR with 100 participants and found Y. Lee (2022)…”
(The citations in these examples are invented for illustration.)
2. Synthesis across literature (300-400 words)
Step back and identify patterns, contradictions, and evolution in your research area.
- Convergent findings: Where do multiple studies agree? What cumulative knowledge exists?
- Contradictions: Where do papers conflict? What might explain the disagreements (different methods, populations, theoretical assumptions)?
- Evolution over time: How has research developed? What shifts in questions, methods, or theory do you see?
Example:
“Across seven studies (2015-2024), researchers consistently find that [X], despite different methodologies and populations. However, findings about [Y] remain contradictory: Author1 reports [A] while Author2 finds [B], likely due to Author1’s focus on [context A] versus Author2’s [context B]. Recent work (2022-2024) has shifted from [old approach] to [new approach], enabled by [technological advancement].”
The goal: show how papers relate to each other.
3. Research gap identification (200-300 words)
Identify 2-3 gaps where meaningful research could happen. Evaluate them using the TIPS framework (introduced in Class 5, Tuesday 16 February):
- Theoretical significance: Would this advance understanding?
- Impact potential: Who benefits from addressing this?
- Practical feasibility: Can you actually do this in a master’s thesis?
- Strategic positioning: Does this fit your interests and skills?
What good gap identification looks like:
“No studies have examined how code-switching affects ASR performance in bilingual spontaneous speech. Existing research focuses on monolingual contexts (Smith, 2020; Jones, 2021) or read speech (Lee, 2022), but bilingual users code-switch frequently in natural ASR interactions.”
What to avoid: “More research is needed on accents” (too vague); “Nobody has studied [incredibly obscure thing]” (probably not significant).
For your strongest gap, briefly apply TIPS:
- Why is it theoretically interesting?
- Who benefits from filling this gap?
- Why is it feasible for you? (Data access? Methods? Scope?)
- Why are you well positioned to address it?
Format options: write in paragraphs or create a visual (table, matrix, diagram) showing the gaps and your TIPS evaluation. Either works.
4. Search log (not in word count)
Link to your own copy of the search log template from Class 3, w/ every search logged and the PRISMA counts tab filled in. Someone reading it should be able to rerun your search in at least three databases and get roughly the same set. No prose needed.
5. Complete bibliography (not in word count)
All papers cited in your expanded document, APA format (7th edition):
- The 6-8 papers you analyzed
- Additional papers from the synthesis or gap identification
- Likely 20-30 references in total
Single alphabetized list. Every in-text citation must appear here; every entry must be cited in the text.
Rubric (10 points)
Each criterion is scored at three levels: full points when it is fully met, half when it is partly met or thin, zero when it is missing.
- Critical analysis quality (3 points): MERC framework applied systematically to 6-8 papers; papers organized by theme; real critical evaluation showing both strengths and limitations; specific examples from papers support analytical points; engagement with the literature goes beyond surface-level summary.
- Synthesis depth (2 points): clear integration across papers revealing patterns, contradictions, and evolution; demonstrates understanding of how the research area has developed; identifies both convergent findings and productive disagreements; shows how studies relate to each other.
- Gap identification quality (3 points): 2-3 specific, well-defined gaps clearly emerging from the literature analysis; TIPS framework applied thoughtfully; gaps are both meaningful (would advance the field) and feasible (achievable in master’s thesis scope); clear connection between the gaps and your critical analysis.
- Writing quality and organization (1 point): clear, well-organized prose with logical flow between sections; APA citations correct and consistent; meets word count targets (±10%); precise writing appropriate for an academic audience.
- Search documentation (1 point): the search log is complete: databases, exact strings, filters, hit counts and PRISMA counts, enough for someone else to rerun the search.