Peer review guidelines for research analysis
Peer review is central to research practice. This handout provides guidelines for giving and receiving constructive feedback on critical analysis and synthesis work, preparing you for collaborative activities in Class 4 and throughout your research career.
Effective peer review
Peer review improves research quality through expert feedback (Benos et al., 2007). Effective peer review balances critical evaluation with constructive support, focusing on helping the work reach its full potential.
1. Be constructive
Frame feedback as opportunities for improvement. “This analysis is weak” doesn’t help; “This analysis could be strengthened by addressing [specific issue]” does. Your goal is to help your peer produce better work.
2. Be specific and actionable
Vague feedback like “needs more depth” doesn’t guide revision. Specific feedback like “The methodology section would benefit from discussing how sample size affects generalizability” provides a clear direction for improvement. Always indicate what could be done differently and why.
3. Balance strengths and areas for improvement
Identify what works well before addressing problems. It helps your peer see which approaches work, so they can build on them. Start with real strengths, then address areas needing work.
4. Focus on major issues before minor ones
Address fundamental conceptual or methodological issues before commenting on formatting or minor details. If the overall analytical approach needs reconsideration, detailed grammar corrections are premature. Prioritize feedback that will have the most significant impact on quality.
5. Distinguish personal preference from actual problems
Not every difference in approach represents a weakness. Be clear when you’re suggesting an alternative approach (“Another way to frame this might be…”) versus identifying a real problem (“This conclusion doesn’t follow from the evidence presented”).
Guidelines for giving feedback
When reviewing a peer’s critical analysis or synthesis:
Understand the work before critiquing it
- Read/listen to the complete analysis before forming judgments
- Identify the analytical goals: What is the presenter trying to accomplish?
- Take notes on both strengths and concerns as you observe
Structure your feedback systematically
- Begin with what works well: Identify specific strengths in the analysis
- Address major conceptual issues: Are the core analytical claims sound?
- Discuss methodological rigor: Is the MERC framework applied systematically?
- Comment on synthesis quality: Does analysis integrate across studies effectively?
- Suggest specific improvements: Provide actionable recommendations
Use clear, professional language
- Address the work: write “This section…” and avoid “You…”
- Use tentative language for suggestions: “Consider” or “Might”, and avoid “Must”
- Frame criticism as questions: “How does this evidence support this claim?”
- Be direct but respectful: Clarity serves the work better than vagueness
Provide evidence for your feedback
- Point to specific examples: “In the methodology section…”
- Explain your reasoning: Why is this a concern or strength?
- Reference established criteria: How does this relate to MERC framework?
Guidelines for receiving feedback
Receiving feedback productively is as important as giving it. Skilled researchers actively seek critical input and use it to strengthen their work.
Listen actively without defensiveness
- Take notes during feedback: You’ll process better later than in the moment
- Resist the urge to explain or defend: Save responses for clarifying questions only
- Assume good intentions: Peers are trying to help
- Separate ego from work: Criticism of analysis isn’t criticism of you as a researcher
Ask clarifying questions
- If feedback is unclear: “Can you point to a specific example?”
- If you want more detail: “What would a stronger version look like?”
- If reasoning isn’t clear: “Can you explain why this is problematic?”
Evaluate feedback critically
- Not all feedback is equally valuable: Consider the source and reasoning
- Look for patterns: Multiple people noting the same issue suggests priority
- Distinguish preference from problems: Some feedback is only about style
- You’re not obligated to implement all suggestions: Use judgment
Create an action plan
- Categorize feedback by importance: Major vs. minor revisions
- Identify quick wins: What can be addressed easily?
- Plan substantial revisions: What requires deeper rethinking?
- Document your decisions: Note what you’ll change and what you’ll keep as-is
Guidance for class activities
During the literature analysis and synthesis activities, focus feedback on:
Application of MERC framework
- Is methodology evaluation specific enough to guide judgment?
- Does evidence assessment distinguish between strong and weak support?
- Is relevance clearly connected to the presenter’s research question?
- Are contribution claims evaluated critically, or only reported?
Quality of synthesis
- Does the presentation integrate insights, or present parallel summaries?
- Are methodological differences explored meaningfully?
- Does analysis identify real patterns or contradictions?
- Are theoretical implications drawn from comparative analysis?
Critical depth vs. description
- Does the analysis go beyond describing what papers say to evaluating it?
- Are both strengths and limitations identified systematically?
- Is there evidence of real engagement with methodological choices?
- Does the presenter demonstrate understanding of domain-specific considerations?
What peer review is not
- … an opportunity to demonstrate your own knowledge or superiority
- … permission to be harsh or dismissive under the guise of “honesty”
- … a competition to find the most problems
- … an exercise in telling someone how you would have done it
- … pointing out problems without suggesting paths forward
Note
Effective peer review creates a culture where rigorous critique and generous support coexist. You’re preparing to give good feedback in Class 4, and to take part in the scholarly community where peer review is central to advancing knowledge. The skills you develop here (critical evaluation, constructive feedback, and gracious reception of critique) will serve you throughout your research career.
References
Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., Kapoor, N., LaFrance, M., … & Zotov, A. (2007). The ups and downs of peer review. Advances in Physiology Education, 31(2), 145-152.
Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102-122.
Topping, K. J. (2009). Peer assessment. Theory Into Practice, 48(1), 20-27.