How to Handle Amendments to Your Systematic Review Protocol

By Dr. Zubair Khalid, DVM, MS, PhD ·

How to Handle Amendments to Your Systematic Review Protocol

Quick Answer

  • Update your PROSPERO record promptly when your systematic review protocol changes, documenting the amendment date, rationale, and exact nature of each deviation.
  • Report all protocol amendments transparently in your final review manuscript, using reporting guidelines from the EQUATOR Network to structure your disclosure.
  • Remember that amendments are expected in rigorous research, but failing to document them can raise questions about review integrity and reproducibility.

Understanding Systematic Review Protocol Amendments

A systematic review protocol is a predetermined plan that outlines the research question, search strategy, inclusion and exclusion criteria, data extraction methods, and analysis approach before the review begins. Registering this protocol, typically through PROSPERO, creates a public record of your intended methods. This registration serves as a safeguard against selective reporting and helps readers distinguish between planned analyses and post hoc decisions.

When you register a protocol, you make a commitment to follow those methods. However, research is rarely linear. You may encounter unexpected challenges during the review process that require you to adjust your approach. These adjustments are not failures. They are normal parts of conducting rigorous research. The critical distinction lies not in whether you make changes, but in how transparently you document and report them.

Protocol amendments can range from minor clarifications to substantial methodological shifts. A minor amendment might involve refining the wording of an inclusion criterion to better match your research question. A substantial amendment could involve changing your primary outcome, adding a new database to your search strategy, or altering your risk of bias assessment tool. Each type of change carries different implications for how readers interpret your findings.

The Committee on Publication Ethics core practices emphasize transparency and integrity throughout the research process. These principles apply directly to protocol amendments. When you document changes clearly, you demonstrate that your review followed a thoughtful, defensible process. When you hide changes or present them as part of the original plan, you undermine the trust that readers place in your work.

When Protocol Amendments Are Necessary

Changes in Scope or Research Question

Your research question may evolve as you become more familiar with the existing literature. You might discover that your original question was too broad or too narrow. For example, you may find that your initial inclusion criteria capture studies with widely varying populations, making meaningful synthesis difficult. Refining your question to focus on a specific population subgroup is a legitimate reason to amend your protocol.

Similarly, you might encounter a body of literature that reveals an important outcome you did not originally consider. Adding this outcome to your review can strengthen its relevance. However, you must document this change clearly and explain why the new outcome matters for your research question.

Search Strategy Adjustments

Search strategies often require refinement after initial testing. You may discover that your search terms miss relevant studies or return excessive irrelevant results. Adjusting your Boolean operators, adding synonyms, or incorporating new subject headings are common amendments. You might also need to add databases or other sources that you did not originally plan to search.

The National Library of Medicine hosts authoritative research methods references that discuss search strategy development and testing. These resources emphasize that piloting your search is essential, but even well-piloted searches may need adjustment when applied across multiple databases with different indexing systems.

Methodological Updates

Methodological guidance evolves over time. A new risk of bias tool may become available after you register your protocol. Updated guidance on data synthesis may recommend different approaches than those you originally planned. Incorporating these advances into your review is appropriate, provided you document the change and explain your reasoning.

Practical Constraints

Sometimes practical realities force protocol changes. A database may become unavailable during your review period. Access to certain full-text articles may be restricted. Time or resource constraints may require you to narrow your scope. These situations are not ideal, but they happen. Transparent documentation of these constraints helps readers understand the context of your review.

How to Update Your PROSPERO Record

Accessing Your Registration

PROSPERO allows registered authors to update their records throughout the review process. You should log in to your account and locate your registration record. The system provides a mechanism for submitting amendments that become part of the public record.

Documenting the Amendment

When you submit an amendment, you need to provide specific information about what changed and why. The amendment should describe the original plan, the revised plan, and the rationale for the change. You should also note the date of the amendment. This documentation creates a clear timeline of your review's evolution.

Timing Considerations

You should submit amendments as soon as you decide to make a change. Waiting until the review is complete to document multiple changes can create confusion about when decisions were made. Prompt updates ensure that your public record accurately reflects your current methods throughout the review process.

What Cannot Be Changed

Some elements of your protocol cannot be amended after the review begins. You cannot change the fact that you registered a protocol. You cannot retroactively alter the original registration date. You also cannot amend the protocol to include analyses that you already conducted and then present them as planned. These limitations protect the integrity of the registration system.

Reporting Amendments in Your Final Review

Using Reporting Guidelines

The EQUATOR Network provides a comprehensive collection of reporting guidelines for health research. For systematic reviews, the PRISMA statement is the primary reporting guideline. PRISMA includes specific items related to protocol registration and amendments. You should consult the appropriate guideline for your review type and follow its recommendations for reporting deviations from your protocol.

Describing Deviations

Your final review manuscript should include a clear description of any deviations from your registered protocol. This description should appear in the methods section, typically near the end of the methods or in a dedicated subsection. You should state what you originally planned, what you actually did, and why the change was necessary.

Distinguishing Planned and Post Hoc Analyses

Readers need to know which analyses were planned before data collection and which were developed after seeing the data. Your reporting should clearly distinguish between these categories. Planned analyses carry more weight in terms of hypothesis testing. Post hoc analyses are exploratory and should be labeled as such.

Impact on Interpretation

Protocol amendments can affect how readers interpret your findings. A change to your primary outcome, for example, may raise questions about selective outcome reporting. Your explanation should address these concerns directly by providing a clear rationale for the change and demonstrating that the change was not driven by the results.

Practical Steps for Managing Protocol Amendments

Establish a Tracking System

Create a simple spreadsheet or document that tracks all protocol amendments. For each amendment, record the date, the original plan, the revised plan, and the rationale. This tracking system serves as your master record throughout the review process.

Review Amendments Regularly

Schedule regular checkpoints to review your protocol against your actual methods. These checkpoints might occur after search testing, after screening a sample of records, or after data extraction begins. Regular reviews help you identify needed amendments early instead of discovering them at the end of your project.

Communicate with Your Team

If you are working with a review team, ensure that all members know about protocol amendments. Team members who are not aware of changes may continue using outdated methods. Clear communication prevents inconsistencies in how the review is conducted.

Document Your Rationale

For each amendment, write a brief explanation of why the change is necessary. This rationale serves multiple purposes. It helps you remember your reasoning later. It provides material for your final report. It also demonstrates that your changes were thoughtful and methodologically sound.

At a Glance

Amendment TypeExampleDocumentation RequiredReporting Location
Search strategy refinementAdding synonyms or subject headings to improve recallUpdated search strategy with date of changeMethods section, search strategy description
Eligibility criteria adjustmentClarifying population definition or outcome measuresOriginal and revised criteria with rationaleMethods section, eligibility criteria
Analysis method changeSwitching from random-effects to fixed-effects modelOriginal and revised analysis plan with justificationMethods section, data synthesis
Outcome addition or removalAdding a secondary outcome based on literature findingsOriginal and revised outcome list with explanationMethods section, outcomes
Database or source changeAdding or removing a database from the searchUpdated database list with reason for changeMethods section, information sources

Common Failure Patterns in Protocol Amendment Handling

Failing to Document Changes

The most common failure is making changes without documenting them. Researchers may adjust their methods informally, reasoning that the change is minor or that they will remember it later. This approach creates problems when writing the final report because the timeline of decisions becomes unclear.

Retroactive Justification

Some researchers attempt to present post hoc decisions as planned analyses. This practice is a form of selective reporting and undermines the integrity of the review. Readers and editors may question whether other decisions were also made with knowledge of the results.

Incomplete Amendment Records

Even when researchers document amendments, they may provide incomplete information. A record that states "search strategy was updated" without specifying what changed or why is not useful. Your documentation should be detailed enough that another researcher could understand exactly what you did differently.

Delayed Updates to PROSPERO

Waiting until the end of the review to update PROSPERO creates a misleading public record. During the review period, readers who access your registration may see outdated methods. Prompt updates ensure that your public record reflects your actual methods.

Inconsistent Reporting Across Documents

Your PROSPERO record, your final manuscript, and any supplementary materials should tell a consistent story. If your PROSPERO record describes one set of methods and your manuscript describes another, readers will struggle to understand what you actually did.

Records and Measurements for Amendment Tracking

Amendment Log Structure

Your amendment log should include the following fields for each change:

  • Amendment number or identifier
  • Date of amendment
  • Protocol section affected
  • Original text or plan
  • Revised text or plan
  • Rationale for change
  • Person responsible for the change
  • Status (pending, submitted to PROSPERO, approved)

Version Control for Protocol Documents

Maintain version control for your protocol document itself. Each version should have a unique identifier, a date, and a summary of changes from the previous version. This practice ensures that you can always identify which version of the protocol was in effect at any point during your review.

Search Strategy Documentation

For search strategy changes, keep records of each version of your search strings. Note the database, the date the search was run, and the number of results retrieved. This documentation allows you to describe your search evolution accurately and helps with reproducibility.

Screening and Extraction Records

If eligibility criteria change during screening, document how the change affected your screening process. Did you rescreen records that were already excluded under the old criteria? Did you need to re-extract data from studies that were previously included? These operational details matter for transparency.

Quality Controls for Amendment Management

Independent Review of Amendments

If possible, have a second team member review each proposed amendment before it is finalized. This independent review can catch errors in documentation and ensure that the rationale is sound. It also provides a check against decisions that might be driven by knowledge of results.

Consistency Checks

Periodically compare your PROSPERO record, your amendment log, and your actual methods. These consistency checks help you identify discrepancies early, when they are easier to correct.

Peer Feedback

If you are working within a research group, consider presenting your amendment history to colleagues for feedback. An outside perspective can help you identify gaps in your documentation or weaknesses in your rationales.

Welfare and Safety Context for Amendment Handling

While protocol amendments are primarily a methodological concern, they also connect to broader issues of research integrity and participant welfare. When your review addresses questions about interventions or treatments, the accuracy and transparency of your methods directly affect how clinicians and policymakers use your findings. A review with poorly documented amendments may lead readers to question the reliability of its conclusions, potentially affecting decisions that impact patient care.

The National Institutes of Health emphasizes the importance of rigorous and transparent research practices throughout the grant lifecycle. Researchers who receive NIH funding are expected to conduct their work according to the highest standards of scientific integrity. Proper protocol amendment documentation is part of meeting these expectations.

Similarly, the NIH Data Management and Sharing Policy highlights the importance of transparency in research processes. While this policy focuses on data sharing, its underlying principles of openness and reproducibility apply equally to documenting methodological decisions.

Professional Escalation Criteria

When to Seek Guidance

You should seek guidance from a librarian, methodologist, or statistician when you are uncertain whether a proposed change requires a protocol amendment. These professionals can help you determine whether your change is substantive enough to warrant documentation.

When to Consult Your Funder

If your review is funded, check whether your funder has specific requirements for protocol amendments. Some funders may require notification of significant methodological changes. The NIH Grants and Funding resources provide information about grant management expectations that may apply to your situation.

When to Contact the Journal

If you are uncertain about how to report an amendment in your manuscript, contact the journal where you plan to submit. Journal editors can provide guidance on their expectations for reporting protocol deviations. This consultation can save you from revisions or rejection later.

When to Consider Withdrawal

In rare cases, a protocol amendment may be so substantial that the review no longer resembles the registered protocol. If your research question has changed fundamentally, you may need to consider whether the current review should be treated as a new review with a new registration instead of an amendment to the existing one.

Limitations of Protocol Amendment Documentation

PROSPERO Record Limitations

Your PROSPERO record is a public document, but it has limitations. The record captures the information you provide, but it does not capture the full context of your decision-making. Your amendment log and final manuscript should provide this context.

Reporting Guideline Limitations

Reporting guidelines help structure your disclosure, but they cannot capture every detail of your decision-making process. You may need to go beyond the minimum requirements of the guideline to provide a complete picture of your methods.

Time and Resource Constraints

Thorough amendment documentation takes time and effort. During a busy review process, it can be tempting to defer documentation tasks. However, the cost of poor documentation is much higher when you are writing your final report and trying to reconstruct decisions made months earlier.

Practical Workflow for Protocol Amendment Management

Step 1: Identify the Need for Change

Recognize when your actual methods diverge from your registered protocol. This recognition may come from testing your search, screening records, extracting data, or analyzing results. Any significant divergence should trigger the amendment process.

Step 2: Draft the Amendment

Write a clear description of the proposed change. Include the original plan, the revised plan, and the rationale. Be specific about what is changing and why.

Step 3: Review and Approve

If you are working with a team, circulate the draft amendment for review. Incorporate feedback and finalize the amendment. If you are working alone, take time to review your draft critically before proceeding.

Step 4: Update PROSPERO

Submit the amendment to PROSPERO through the update mechanism. Keep a record of the submission date and any confirmation you receive.

Step 5: Update Your Internal Documents

Revise your protocol document, amendment log, and any other tracking documents. Ensure that all team members have access to the updated versions.

Step 6: Implement the Change

Begin using the revised methods in your review process. If the change affects work already completed, determine whether any rework is needed.

Step 7: Report in Your Final Manuscript

When writing your final review, describe all amendments in the methods section. Use the appropriate reporting guideline to structure your disclosure.

Mermaid Flowchart for Amendment Decision Process

flowchart TD
    A[Identify divergence from protocol] --> B{Is the change substantive?}
    B -->|No| C[Continue without amendment]
    B -->|Yes| D[Draft amendment with rationale]
    D --> E[Review with team or advisor]
    E --> F[Submit update to PROSPERO]
    F --> G[Update internal tracking documents]
    G --> H[Implement revised methods]
    H --> I[Report amendment in final manuscript]

This flowchart illustrates the decision path for handling protocol amendments. The key decision point is determining whether a change is substantive enough to require formal documentation. When in doubt, err on the side of documenting the change.

Frequently Asked Questions

What counts as a substantive protocol amendment?

A substantive amendment is any change that could affect how readers interpret your review findings. This includes changes to your research question, eligibility criteria, search strategy, outcomes, data extraction methods, risk of bias assessment, or analysis approach. Minor wording clarifications that do not change your methods may not require formal amendment, but you should still note them in your final report.

How quickly should I update PROSPERO after deciding to amend my protocol?

You should update PROSPERO as soon as you finalize your decision to make a change. Prompt updates ensure that your public record accurately reflects your current methods. Delaying updates creates a period during which your registered protocol does not match your actual methods.

Can I amend my protocol after data extraction has begun?

Yes, you can amend your protocol at any point during the review process. However, amendments made after data collection begins require careful consideration. You need to document how the change affects data already collected and whether any rework is needed. Later amendments may also raise more questions from readers about the reasons for the change.

What if I need to change my primary outcome?

Changing your primary outcome is a significant amendment that requires thorough justification. You should explain why the original outcome is no longer appropriate and why the new outcome better addresses your research question. Be prepared for readers to question whether the change was influenced by the results you observed.

How do I report amendments in my final manuscript?

Describe all amendments in your methods section, typically in a subsection on protocol deviations. State what you originally planned, what you actually did, and why the change was necessary. Follow the recommendations of the appropriate reporting guideline from the EQUATOR Network for your review type.

Do I need to report amendments that were made before screening began?

Yes, you should report all amendments, regardless of when they occurred. Even changes made early in the process are part of your review's history. Readers need this information to understand how your methods developed.

What if my amendment is rejected by PROSPERO?

PROSPERO may reject amendments that are not adequately justified or that attempt to change fundamental aspects of the registration. If your amendment is rejected, you should still document the change in your internal records and report it in your final manuscript. The rejection does not prevent you from using your revised methods.

How does protocol amendment documentation relate to research integrity?

Transparent amendment documentation is a core component of research integrity. The Committee on Publication Ethics core practices emphasize honesty and transparency throughout the research process. By documenting your amendments clearly, you demonstrate that your review followed a defensible process and that your findings are trustworthy.

Using the Evidence

SourceBest use in this topicImportant limitation
Research Methods Resourcesofficial guidanceCheck the linked page for current local requirements
EQUATOR Networkofficial guidanceCheck the linked page for current local requirements
Core Practicesofficial guidanceCheck the linked page for current local requirements

Related Articles

References and Further Reading

This article is educational and does not replace institutional policy, professional advice, or applicable safety and regulatory requirements.