Research Design

Content › Frameworks

MERC: critical analysis of research papers

Critical appraisal is the systematic evaluation of research to judge trustworthiness, value, and relevance (Young & Solomon, 2009). The MERC framework, adapted from other critical appraisal methodologies (CASP, 2018), helps you evaluate research papers in speech tech. It asks four questions of each paper:

We introduce MERC in Class 4 (Friday 12 February), and you use it in Checkpoint 2, part 1. The MERC analysis worksheet, with space for your notes on each paper, is in BrightSpace. The questions on the worksheet are below.

Paper details

Methodology

Are the research methods appropriate and rigorous for addressing the research question?

Research design & appropriateness

Data collection & sampling

Speech technology-specific

Evidence

How strong is the evidence presented? Are claims supported by the data?

Statistical rigor

Claims vs. data

Generalizability

Relevance

How does this work connect to your research question?

Connection to your research

Transferable insights

Contribution

What does this study add to the field?

Nature of contribution

Impact & limitations

Synthesis & comparative analysis

After analyzing 2+ papers, compare methodological approaches and identify patterns:

References

CASP (Critical Appraisal Skills Programme). (2018). CASP checklists. Oxford: CASP UK. Retrieved from https://casp-uk.net/casp-tools-checklists/

Greenhalgh, T. (2019). How to read a paper: The basics of evidence-based medicine and healthcare (6th ed.). Hoboken, NJ: Wiley-Blackwell.

Young, J. M., & Solomon, M. J. (2009). How to critically appraise an article. Nature Clinical Practice Gastroenterology & Hepatology, 6(2), 82-91.

Prepared for Research Design (MSc Speech Technology), University of Groningen