Zubair Khalid

Virologist/Molecular Biologist | Veterinarian | Bioinformatician

Conventional & Molecular Virology • Vaccine Development • Computational Biology

Dr. Zubair Khalid is a veterinarian and virologist specializing in conventional and molecular virology, vaccine development, and computational biology. Dedicated to advancing animal health through innovative research and multi-omics approaches.

Dr. Zubair Khalid - Veterinarian, Virologist, and Vaccine Development Researcher specializing in Computational Biology, Multi-omics, Animal Health, and Infectious Disease Research

Category: Guides

Guidelines for Meta-Analysis: Reporting Standards and Best Practices

Meta-analysis is a statistical technique that combines results from multiple independent studies to produce a pooled estimate of effect. The value of any meta-analysis depends entirely on the quality and transparency of its reporting. Poorly reported meta-analyses cannot be properly evaluated, replicated, or applied by clinicians, policymakers, or other researchers. This article provides practical guidance on the key reporting standards for meta-analysis, with particular attention to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) family of guidelines, and offers a working checklist for researchers preparing manuscripts for publication.

At a Glance

The table below summarizes the primary reporting guidelines relevant to different types of systematic reviews and meta-analyses. Researchers should select the guideline that matches their review design and consult the EQUATOR Network for the most current versions.

Guideline Applies To Key Features When To Use
PRISMA 2020 Systematic reviews and meta-analyses of health interventions 27-item checklist, abstract checklist, revised flow diagrams Standard for most systematic reviews with or without meta-analysis
PRISMA-P 2015 Protocols for systematic reviews and meta-analyses 17 essential items for protocol reporting Before starting the review, for registration and publication of protocols
PRISMA-ScR Scoping reviews 20 essential items plus 2 optional items When mapping evidence on a topic instead of answering a focused clinical question
PRISMA-DTA Systematic reviews of diagnostic test accuracy 27-item checklist adapted for diagnostic studies When synthesizing studies of index test accuracy against a reference standard
MOOSE Meta-analyses of observational studies Reporting guidance for epidemiological meta-analyses When pooling data from cohort, case-control, or cross-sectional studies

The PRISMA 2020 statement replaces the 2009 version and includes updated guidance reflecting advances in methods for identifying, selecting, appraising, and synthesizing studies. The structure and presentation of items were modified to make implementation easier for authors. The PRISMA 2020 statement provides a 27-item checklist, an expanded checklist with detailed reporting recommendations for each item, an abstract checklist, and revised flow diagrams for both original and updated reviews.

Understanding the Purpose of Reporting Guidelines

Reporting guidelines exist because the clarity and transparency of systematic review reports directly affect their usefulness. Poor reporting diminishes the value of systematic reviews to clinicians, policymakers, and other users who depend on these documents for decision-making. The PRISMA statement was developed as an evolution of the original QUOROM guideline from 1999, responding to conceptual, methodological, and practical advances in the conduct and reporting of systematic reviews and meta-analyses.

The PRISMA statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. Each item in the explanation and elaboration document includes an example of good reporting and references to relevant empirical studies and methodological literature where available.

The EQUATOR Network serves as a central repository for reporting guidelines across health research. Researchers should consult this resource to identify the appropriate guideline for their study design and to access the latest versions of existing guidelines.

The PRISMA 2020 Statement

The PRISMA 2020 statement was designed to help systematic reviewers transparently report why the review was done, what the authors did, and what they found. Published in March 2021, it replaces the 2009 statement and incorporates advances in systematic review methodology and terminology that emerged over the preceding decade.

Key Changes in PRISMA 2020

The 2020 update includes new reporting guidance that reflects advances in methods to identify, select, appraise, and synthesize studies. The structure and presentation of the items have been modified to facilitate implementation. Authors should use the PRISMA 2020 checklist when preparing manuscripts for systematic reviews and meta-analyses, and editors and peer reviewers should use it when evaluating submissions.

The PRISMA 2020 statement includes three components:

  1. The 27-item checklist covering title, abstract, introduction, methods, results, discussion, and other information
  2. An expanded checklist that details reporting recommendations for each item
  3. Revised flow diagrams for original and updated reviews

The Four-Phase Flow Diagram

The PRISMA flow diagram documents the flow of information through the different phases of a systematic review. It maps out the number of records identified, screened, assessed for eligibility, and included in the review, with reasons for exclusions at each stage. The revised flow diagrams in PRISMA 2020 accommodate both original and updated reviews.

Protocol Reporting with PRISMA-P

Protocols of systematic reviews and meta-analyses serve multiple functions. They allow for planning and documentation of review methods, act as a guard against arbitrary decision-making during review conduct, enable readers to assess for the presence of selective reporting against completed reviews, and, when made publicly available, reduce duplication of efforts and potentially prompt collaboration.

Evidence documenting the existence of selective reporting and excessive duplication of reviews on the same or similar topics is accumulating. Several efforts have emerged to rectify these problems, including the development of an international register for prospective reviews (PROSPERO) and the launch of open access journals dedicated to the publication of systematic review products, including protocols.

The PRISMA-P 2015 checklist contains 17 items considered to be essential and minimum components of a systematic review or meta-analysis protocol. The accompanying explanation and elaboration paper provides readers with a full understanding of and evidence about the necessity of each item, along with a model example from an existing published protocol.

Practical Steps for Protocol Development

  1. Register the review protocol in PROSPERO or an equivalent registry before commencing the review
  2. Use the PRISMA-P checklist to ensure all 17 essential items are addressed
  3. Publish the protocol in a journal that accepts systematic review protocols
  4. Reference the protocol in the final manuscript and note any deviations from the planned methods

Reporting Standards for Scoping Reviews

Scoping reviews are a type of knowledge synthesis that follows a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews are being done, their methodological and reporting quality need improvement.

The PRISMA-ScR checklist was developed by a 24-member expert panel and 2 research leads following published guidance from the EQUATOR Network. The final checklist contains 20 essential reporting items and 2 optional items. The authors provide a rationale and an example of good reporting for each item.

The intent of PRISMA-ScR is to help readers, including researchers, publishers, commissioners, policymakers, healthcare providers, guideline developers, and patients or consumers, develop a greater understanding of relevant terminology, core concepts, and key items to report for scoping reviews.

Distinguishing Scoping Reviews from Systematic Reviews

Scoping reviews differ from systematic reviews in their purpose and output. Scoping reviews map the existing literature on a topic, identify gaps, and clarify key concepts. Systematic reviews answer a focused question by synthesizing evidence from studies that meet predefined eligibility criteria. The reporting requirements differ accordingly, and authors should select the appropriate guideline.

Reporting Standards for Diagnostic Test Accuracy Reviews

Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of one or more index tests against a reference standard. These reviews provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy.

The PRISMA-DTA guideline was developed as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Established standards from the EQUATOR Network were followed for the development of the guideline.

The development process involved a group of 24 multidisciplinary experts who used a systematic review of articles on existing reporting guidelines and methods, a three-round Delphi process, a consensus meeting, pilot testing, and iterative refinement. The final version of the PRISMA-DTA guideline checklist contains 27 items.

Methodological Quality Assessment

Reporting guidelines address the completeness and transparency of what authors write. Methodological quality assessment evaluates how well the review was conducted. These are related but distinct concepts. A review can be well conducted but poorly reported, or well reported but methodologically flawed.

AMSTAR-2 and Other Quality Assessment Tools

The umbrella review of antidepressants in patients with comorbid medical diseases used AMSTAR-2 and AMSTAR-Content for quality assessment. Data extraction and quality assessment were performed by pairs of independent reviewers following PRISMA guidelines. This example illustrates the standard practice of using both reporting guidelines and quality assessment tools in systematic review conduct.

What Works Clearinghouse Standards

The systematic review of Theory of Mind intervention programs for individuals with Autism Spectrum Disorder evaluated methodological quality using What Works Clearinghouse (WWC) standards. This review identified 20 studies meeting inclusion criteria, of which 15 were included in the meta-analysis. The results indicated a moderate positive effect, but findings were interpreted cautiously due to publication bias, small sample sizes, and the lack of IQ, language, or prerequisite skill assessments.

Practical Implementation of Reporting Standards

Implementing reporting standards requires a systematic approach throughout the review process, beyond at the manuscript preparation stage. The following workflow integrates reporting requirements into each phase of the review.

Step 1: Protocol Development and Registration

Develop a detailed protocol using the PRISMA-P checklist before starting the review. Register the protocol in PROSPERO or another appropriate registry. The protocol should specify the research question, search strategy, eligibility criteria, data extraction methods, risk of bias assessment, and planned synthesis methods.

Step 2: Search and Screening

Document the search strategy for each database searched, including the full search strings and any filters or limits applied. Record the number of records identified from each source. Screen titles and abstracts against predefined eligibility criteria, then screen full texts. Track the reasons for exclusion at each stage.

Step 3: Data Extraction and Quality Assessment

Use a standardized data extraction form to collect information from included studies. Conduct quality assessment using appropriate tools for the study designs included. Document the process for resolving disagreements between reviewers.

Step 4: Synthesis and Analysis

Describe the methods used for synthesis, including the effect size metric, the statistical model (fixed-effect or random-effects), and any subgroup or sensitivity analyses. Report heterogeneity using appropriate statistics and present results in forest plots where applicable.

Step 5: Manuscript Preparation

Use the PRISMA 2020 checklist to structure the manuscript. Complete the flow diagram to document the study selection process. Ensure that all items on the checklist are addressed, either in the main text or in supplementary materials.

Records and Measurements

Accurate record-keeping is essential for transparent reporting. The following records should be maintained throughout the review process:

Record Type Content Purpose
Search log Database, date, search string, number of results Reproducibility of the search
Screening log Records screened, excluded, and reasons Transparency of study selection
Data extraction forms Study characteristics, outcomes, effect sizes Verification of extracted data
Quality assessment records Risk of bias ratings for each study Transparency of quality assessment
Analysis files Data files, analysis scripts, output Reproducibility of the analysis

The Research Data Framework from the National Institute of Standards and Technology provides guidance on managing research data throughout its lifecycle. Researchers should consider data management planning as part of their systematic review methodology.

Common Failure Patterns in Meta-Analysis Reporting

Several recurring problems appear in meta-analysis manuscripts. Recognizing these patterns helps authors avoid them and helps readers evaluate published reviews critically.

Incomplete Search Reporting

Many manuscripts fail to report the full search strategy for each database, including the date of the search, the exact search strings, and any limits applied. This prevents replication and makes it impossible to assess whether the search was comprehensive.

Inadequate Risk of Bias Assessment

Some reviews omit risk of bias assessment entirely or use inappropriate tools. Others report the assessment but do not incorporate the results into the analysis or interpretation. Risk of bias should inform sensitivity analyses and the interpretation of findings.

Selective Outcome Reporting

Authors sometimes report only outcomes with statistically significant results or fail to report all outcomes specified in the protocol. This can lead to biased conclusions. Comparing the final manuscript against the registered protocol helps identify selective reporting.

Inappropriate Pooling

Meta-analysis is not appropriate for all bodies of evidence. Pooling studies with substantial clinical or methodological heterogeneity can produce misleading estimates. Authors should justify their decision to pool and explore sources of heterogeneity.

Overinterpretation of Results

Authors may overstate the certainty of evidence or generalize findings beyond the populations and settings represented in the included studies. The umbrella review of antidepressants noted that regulatory trials typically exclude comorbid medical diseases, making generalizability to clinical settings unclear where medical comorbidity is highly prevalent.

Quality of Reporting in Published Meta-Analyses

Studies evaluating the completeness of reporting in published systematic reviews have found that key information is often poorly reported. Evaluations of compliance with PRISMA guidelines in specialty journals have documented incomplete adherence to reporting standards.

A study evaluating compliance with PRISMA guidelines in three major periodontology journals examined the extent to which published systematic reviews followed the reporting requirements. Similarly, an assessment of radiological articles based on the PRISMA-DTA reporting guideline examined completeness of reporting for diagnostic test accuracy reviews.

These evaluations serve two purposes. They document the extent of the problem and provide evidence for the need for improved reporting. They also identify specific items that are most frequently missed, which can guide authors in prioritizing their reporting efforts.

Statistical Considerations in Meta-Analysis

Meta-analysis involves mathematical methods for combining effect sizes from individual studies. Understanding the underlying statistics helps researchers make informed decisions about analysis methods and interpret results appropriately.

Effect Size Calculation

Effect sizes can be calculated for different types of outcome variables. Continuous outcomes are typically summarized using standardized mean differences or weighted mean differences. Categorical outcomes are summarized using risk ratios, odds ratios, or risk differences. Correlation coefficients are used for studies examining relationships between variables.

Fixed-Effect and Random-Effects Models

A fixed-effect model assumes that all studies estimate the same underlying effect and that observed differences are due to sampling error alone. A random-effects model assumes that studies estimate different effects that vary around an overall average, incorporating both within-study and between-study variance.

The choice between fixed-effect and random-effects models depends on the assumptions about the underlying population of studies and the degree of heterogeneity. The random-effects model is generally more conservative and is often preferred when heterogeneity is expected.

Forest Plots

A forest plot is a graphical display that visualizes the effect size and confidence interval for each study along with the pooled estimate. Forest plots allow readers to see the individual study results, the degree of consistency across studies, and the overall pooled effect.

Reporting Meta-Analyses of Observational Studies

Meta-analyses of observational studies present unique reporting challenges. The MOOSE guideline was developed specifically for this purpose. Observational studies are subject to confounding and bias that must be addressed in the synthesis and interpretation.

When reporting meta-analyses of observational studies, authors should describe the study designs included, the methods used to assess risk of bias, and the approaches used to address confounding. Sensitivity analyses should explore the impact of study quality on the results.

The Role of Reporting Guidelines in Peer Review

Reporting guidelines serve as valuable tools for peer reviewers. Reviewers can use the PRISMA checklist to systematically evaluate whether manuscripts address all essential reporting items. Journals increasingly require authors to submit completed checklists with their manuscripts.

Editors and reviewers should distinguish between reporting quality and methodological quality. A manuscript can be beautifully reported but based on flawed methods. Conversely, a well-conducted review can be poorly reported, limiting its usefulness.

Limitations of Reporting Guidelines

Reporting guidelines have limitations that researchers should recognize. They address the completeness of reporting but do not guarantee methodological quality. A review can comply with all reporting items and still have serious methodological flaws.

Guidelines are also not static. The PRISMA statement has been updated as methods have evolved, and further updates are planned. The PRISMA extensions for network meta-analysis and scoping reviews were published in 2015 and 2018, but methodologies and innovations, including automation, have evolved since then. A scoping review protocol published in 2025 aims to develop a list of items for potential inclusion in updated PRISMA reporting guidelines for network meta-analysis, scoping reviews, and rapid reviews.

Researchers should check the EQUATOR Network for the most current versions of reporting guidelines before preparing their manuscripts.

Professional Escalation Criteria

Researchers should seek additional expertise or escalate concerns in the following situations:

  1. If the review question requires specialized statistical methods beyond the research team's expertise, consult a statistician with experience in meta-analysis
  2. If the body of evidence includes complex study designs or substantial heterogeneity, seek methodological advice before deciding on synthesis methods
  3. If the review addresses a topic with important policy or clinical implications, consider involving stakeholders in the interpretation of findings
  4. If the search identifies a large volume of potentially relevant studies, consider whether the review question needs refinement or whether additional resources are needed

Frequently Asked Questions

What is the difference between PRISMA 2020 and the earlier PRISMA 2009 statement?

PRISMA 2020 replaces the 2009 statement and includes new reporting guidance that reflects advances in methods to identify, select, appraise, and synthesize studies. The structure and presentation of the items have been modified to facilitate implementation. PRISMA 2020 includes a 27-item checklist, an expanded checklist with detailed reporting recommendations for each item, an abstract checklist, and revised flow diagrams for original and updated reviews.

When should I use PRISMA-ScR instead of PRISMA 2020?

PRISMA-ScR is designed for scoping reviews, which map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. PRISMA 2020 is designed for systematic reviews that answer focused questions by synthesizing evidence from studies meeting predefined eligibility criteria. If your review maps the literature instead of answering a focused clinical question, use PRISMA-ScR.

Do I need to register my systematic review protocol before starting the review?

Protocol registration is strongly recommended. Protocols allow for planning and documentation of review methods, act as a guard against arbitrary decision-making during review conduct, enable readers to assess for the presence of selective reporting against completed reviews, and, when made publicly available, reduce duplication of efforts and potentially prompt collaboration. PROSPERO is an international register for prospective reviews.

What is the difference between reporting quality and methodological quality?

Reporting quality refers to the completeness and transparency of what authors write in their manuscript. Methodological quality refers to how well the review was conducted. A review can be well conducted but poorly reported, or well reported but methodologically flawed. Reporting guidelines like PRISMA address reporting quality, while tools like AMSTAR-2 assess methodological quality.

How do I choose between a fixed-effect and a random-effects model?

A fixed-effect model assumes that all studies estimate the same underlying effect and that observed differences are due to sampling error alone. A random-effects model assumes that studies estimate different effects that vary around an overall average. The choice depends on the assumptions about the underlying population of studies and the degree of heterogeneity. Random-effects models are generally more conservative and are often preferred when heterogeneity is expected.

What should I do if my meta-analysis shows high heterogeneity?

High heterogeneity indicates that the included studies are not estimating a common effect. You should explore sources of heterogeneity through subgroup analyses or meta-regression, consider whether pooling is appropriate, and interpret the pooled estimate with caution. Sensitivity analyses can examine the impact of individual studies or study characteristics on the results.

Are reporting guidelines available in languages other than English?

Yes. For example, French translations of the PRISMA reporting guidelines have been published. Researchers should check the EQUATOR Network and the PRISMA website for translations and the most current versions of reporting guidelines.

How can I assess whether published meta-analyses comply with reporting standards?

You can use the PRISMA checklist to evaluate published systematic reviews and meta-analyses. Studies evaluating compliance with PRISMA guidelines in specialty journals have documented incomplete adherence to reporting standards. The PRISMA explanation and elaboration document provides examples of good reporting for each checklist item, which can serve as a reference for evaluation.

Related Articles

References and Further Reading

This article is educational and does not replace institutional policy, professional advice, or applicable safety and regulatory requirements.