Full-Text Review in Systematic Reviews
By Dr. Zubair Khalid, DVM, MS, PhD ·

Quick Answer
- Full-text review is the eligibility confirmation stage where reviewers retrieve and read complete manuscripts to verify that each study meets predefined inclusion criteria before data extraction.
- Build a standardized screening form before retrieval, document every exclusion reason with a code, and track missing full texts through interlibrary loan or author contact.
- The process is time-intensive and error-prone without duplicate independent screening, so plan for disagreement resolution and record all decisions transparently.
Understanding Full-Text Review in Systematic Reviews
Systematic reviews depend on a transparent, reproducible process for identifying and selecting studies. The full-text review stage sits between title and abstract screening and data extraction. At this point, reviewers have already filtered a large set of records down to a smaller pool of potentially eligible studies based on titles and abstracts. The full-text review confirms whether each candidate study truly meets the inclusion criteria when examined in complete form.
The distinction matters because titles and abstracts often lack sufficient detail. A study may appear eligible from its abstract but fail on closer inspection. Conversely, an abstract may omit key details that only appear in the full manuscript. Full-text review exists to resolve these discrepancies systematically.
This stage also serves a documentation function. Reviewers record why each excluded study failed eligibility, creating an audit trail that supports the review's conclusions. Without this documentation, readers cannot assess whether the selection process was fair and unbiased.
Core Principles of Full-Text Screening
Eligibility Criteria as the Foundation
Every full-text review begins with clearly defined eligibility criteria developed during the protocol stage. These criteria specify the population, intervention, comparator, outcomes, and study design that qualify for inclusion. They also define exclusion conditions such as publication type, language, or date restrictions.
The criteria must be specific enough that two independent reviewers can apply them consistently. Vague criteria such as "relevant studies" or "adequate quality" invite subjective judgment and reduce reliability. Write criteria as testable statements. For example, specify "randomized controlled trials enrolling adults with type 2 diabetes comparing metformin to sulfonylureas with HbA1c measured at 12 weeks" instead of "studies on diabetes treatment."
Independent Duplicate Screening
Full-text screening should be performed by at least two reviewers working independently. Each reviewer applies the eligibility criteria to every retrieved full text and records a decision. This practice reduces the risk that one reviewer's bias or oversight determines a study's fate.
After independent screening, reviewers compare their decisions. Disagreements are resolved through discussion or by a third reviewer. The resolution process should be documented in the review methods. Some reviews use a consensus meeting where all disagreements are discussed until agreement is reached.
The Screening Form
A standardized screening form ensures consistency across reviewers and studies. The form lists each eligibility criterion as a question with yes, no, or unclear response options. Reviewers work through the form systematically, and a single "no" response triggers exclusion.
The form also includes fields for recording the exclusion reason using a predefined code list. Common codes include wrong population, wrong intervention, wrong comparator, wrong outcome, wrong study design, duplicate publication, and insufficient data. These codes map directly to the exclusion reasons reported in the PRISMA flow diagram.
At a Glance
| Stage | Primary Task | Key Output | Common Error |
|---|---|---|---|
| Preparation | Finalize eligibility criteria and screening form | Standardized decision tool | Ambiguous criteria leading to inconsistent decisions |
| Retrieval | Obtain full texts for all potentially eligible records | Complete manuscript set | Missing full texts not tracked or documented |
| Screening | Apply criteria to each full text independently | Eligibility decisions with reasons | Single reviewer screening without verification |
| Documentation | Record exclusions and resolve disagreements | Audit trail for PRISMA flow | Exclusion reasons not linked to specific criteria |
Preparing for Full-Text Review
Finalize the Screening Form
Before retrieval begins, finalize the screening form and pilot test it on a small sample of full texts. Pilot testing reveals unclear questions, missing response options, or criteria that cannot be applied as written. Adjust the form based on pilot results and document any changes.
The form should include the study ID, reviewer initials, screening date, and a decision field. Each eligibility criterion appears as a separate item. A comments field allows reviewers to note ambiguities or contextual information that informed their decision.
Establish the Retrieval Workflow
Plan how full texts will be obtained before screening starts. Most records come from bibliographic databases, but some will require additional steps. Establish procedures for:
- Downloading PDFs from publisher websites or institutional subscriptions
- Requesting articles through interlibrary loan
- Contacting authors for unpublished or inaccessible manuscripts
- Checking preprint servers or institutional repositories
- Handling non-English articles if language restrictions apply
Assign responsibility for retrieval to a specific team member. Track retrieval status for every record using a spreadsheet or reference management software. Records that cannot be retrieved after reasonable effort should be documented and reported as "full text not available" in the review flow diagram.
Set the Timeline
Full-text review takes longer than most reviewers expect. Each article requires reading time, form completion, and decision recording. Multiply the number of potentially eligible records by an estimated 30 to 60 minutes per article to approximate the workload. Add time for retrieval delays, interlibrary loan processing, and disagreement resolution.
The Full-Text Screening Workflow
Step 1: Retrieve and Organize Full Texts
Collect all full texts for records that passed title and abstract screening. Organize them in a shared folder structure with consistent file naming. Use the study ID as the primary identifier to avoid confusion between similar titles.
Record retrieval status for each record. Categories include retrieved, pending interlibrary loan, author contact initiated, and not available. Update this tracking system continuously throughout the review.
Step 2: Screen Each Full Text Independently
Each reviewer works through the full texts independently using the screening form. Read the full manuscript, beyond the abstract. Pay attention to methods sections where eligibility details are most often reported.
Apply each criterion in order. If any criterion fails, record the exclusion reason and stop. Do not continue evaluating additional criteria after an exclusion decision has been reached.
Record the decision on the screening form. Include the specific exclusion reason code and any comments that explain the decision. This documentation supports later reporting and helps resolve disagreements.
Step 3: Compare Decisions and Resolve Disagreements
After both reviewers complete screening, compare decisions for each record. Identify disagreements where reviewers reached different conclusions.
Resolve disagreements through discussion. Reviewers should reference the specific eligibility criteria and the evidence in the manuscript that supports their decision. If discussion does not resolve the disagreement, a third reviewer makes the final decision.
Document the resolution process. The review methods section should describe how disagreements were handled, including whether a third reviewer was used and how often consensus was required.
Step 4: Document Exclusions
Every excluded full text requires a documented reason. Use the predefined exclusion reason codes consistently. The reasons feed directly into the PRISMA flow diagram, which reports the number of full-text articles excluded and the reasons for exclusion.
Common exclusion reasons include:
- Wrong population
- Wrong intervention
- Wrong comparator
- Wrong outcome
- Wrong study design
- Duplicate publication
- Insufficient data
- Full text not available
Record exclusion reasons in the screening database with the study ID and reviewer initials. This creates a complete audit trail that supports the review's transparency.
Step 5: Confirm Final Inclusion
After all full texts have been screened and disagreements resolved, confirm the final included study list. This list moves forward to data extraction and risk of bias assessment.
Verify that the included studies match the eligibility criteria. Conduct a final check of the screening database to ensure no records are missing decisions or exclusion reasons. Resolve any incomplete records before proceeding.
Handling Missing Full Texts
Missing full texts are a common challenge in systematic reviews. Some records will not have accessible full texts despite reasonable retrieval efforts. The approach to missing full texts should be planned in advance and reported transparently.
Retrieval Options
Start with the most direct retrieval methods. Check institutional subscriptions and open access repositories first. If the article is not available, request it through interlibrary loan. Interlibrary loan requests typically take several days to process.
Contact the corresponding author directly for articles that cannot be obtained through library services. Author contact can also resolve questions about unpublished data or supplementary materials. Use the contact information provided in the abstract or database record.
Check preprint servers and institutional repositories for versions of the article that may be accessible. Some authors deposit accepted manuscripts in repositories even when the published version is paywalled.
Documentation Requirements
Document all retrieval attempts and their outcomes. Record the date of each attempt, the method used, and the result. This documentation supports the final report's statement about unavailable full texts.
When a full text cannot be obtained, record the record as "full text not available" with the retrieval attempts documented. These records are reported in the PRISMA flow diagram as excluded with the reason "full text not available."
Limitations of Missing Data
Missing full texts introduce potential bias. Studies that are inaccessible may differ systematically from those that are available. For example, studies with null or negative findings may be less likely to be published or deposited in accessible repositories.
Report the number of unavailable full texts and the reasons for unavailability. Discuss the potential impact on the review's conclusions in the limitations section. Sensitivity analyses comparing results with and without unavailable studies may be appropriate in some reviews.
Using a Screening Form Effectively
Form Design Principles
A well-designed screening form reduces errors and speeds the screening process. Design the form to match the eligibility criteria exactly. Each criterion becomes a question with clear response options.
Use yes, no, and unclear response options. The unclear option allows reviewers to flag records where the manuscript does not provide sufficient information. Unclear responses trigger discussion or author contact to resolve the ambiguity.
Include a decision field at the end of the form. The decision is include, exclude, or unclear. The exclusion reason code appears only when the decision is exclude.
Electronic Versus Paper Forms
Electronic forms offer advantages over paper forms. They can be built in spreadsheet software, reference management tools, or dedicated systematic review software. Electronic forms support data export, automated validation, and real time tracking of screening progress.
Paper forms work for small reviews but create data entry burdens and transcription error risks. If using paper forms, plan for double data entry or verification to catch errors.
Pilot Testing
Pilot test the screening form before full scale screening begins. Select a sample of 5 to 10 full texts that represent the range of studies expected in the review. Have all reviewers screen the same pilot sample and compare their results.
Pilot testing identifies unclear questions, missing response options, and criteria that cannot be applied consistently. Revise the form based on pilot results. Document the pilot testing process and any form changes in the review methods.
Recording and Managing Screening Data
Data Fields to Capture
The screening database should capture essential information for each record:
- Study ID
- Bibliographic information
- Reviewer initials
- Screening date
- Decision for each eligibility criterion
- Overall decision
- Exclusion reason code
- Comments
This data structure supports reporting, disagreement resolution, and audit. The screening database also provides the data needed to construct the PRISMA flow diagram.
Data Management Tools
Spreadsheet software works for small reviews with limited records. Dedicated systematic review software offers more robust features including duplicate detection, screening workflow management, and data export.
Reference management software can track retrieval status and organize PDFs. Some tools integrate with screening workflows, allowing reviewers to link decisions directly to reference records.
Quality Control Checks
Build quality control into the screening process. Check that all records have complete decisions and exclusion reasons. Verify that exclusion reason codes match the criteria that failed. Review a random sample of screening decisions to confirm accuracy.
Regular quality checks during screening catch problems early. Schedule checkpoints after every 20 to 30 screened records to review completeness and consistency.
Common Failure Patterns in Full-Text Review
Inconsistent Application of Criteria
Reviewers may apply eligibility criteria inconsistently, especially when criteria involve judgment. One reviewer may interpret "adult population" as age 18 and older while another uses age 21 and older. These inconsistencies produce different screening decisions.
Prevent this by writing criteria with explicit thresholds and definitions. Pilot testing and regular calibration meetings help reviewers align their interpretations. When disagreements occur, use them as opportunities to clarify criteria and improve consistency.
Incomplete Exclusion Documentation
Some reviewers record exclusion decisions without specifying the reason. This creates problems during reporting because the PRISMA flow diagram requires exclusion reasons for every excluded full text.
Require exclusion reason codes for every excluded record. Build this requirement into the screening form so that a decision of exclude cannot be recorded without a reason code.
Retrieval Delays
Full-text retrieval often takes longer than planned. Interlibrary loan requests, author contacts, and publisher responses introduce delays that extend the screening timeline.
Build buffer time into the project schedule. Start retrieval early and track pending requests actively. Follow up on outstanding requests at regular intervals.
Screening Fatigue
Reading and evaluating hundreds of full texts is mentally demanding. Reviewers may become less careful over time, leading to missed details or rushed decisions.
Schedule screening sessions in blocks with breaks. Rotate screening responsibilities among team members when possible. Regular quality checks help identify declining accuracy before it affects the review.
Reporting Full-Text Review Results
PRISMA Flow Diagram
The PRISMA flow diagram reports the number of records at each stage of the review process. The full-text review stage appears as a distinct step between abstract screening and data extraction.
The flow diagram reports the number of full texts retrieved, the number excluded, and the reasons for exclusion. This transparency allows readers to assess the selection process and its potential biases.
Methods Section Description
The methods section should describe the full-text review process in sufficient detail for replication. Include the number of reviewers, the screening form structure, the disagreement resolution process, and the retrieval methods used.
Describe how missing full texts were handled and how many records were affected. Report any deviations from the planned process and the reasons for those deviations.
Limitations Discussion
Discuss the limitations of the full-text review process in the review's limitations section. Address the potential impact of missing full texts, inconsistent criteria application, and reviewer judgment on the review's conclusions.
Transparent reporting of limitations supports the interpretation of the review's findings and informs future reviews.
Quality and Ethics Considerations
Transparency in Reporting
Transparent reporting is a core expectation for systematic reviews. The EQUATOR Network provides reporting guidelines that support transparent and complete reporting of research studies. Following these guidelines ensures that readers can assess the methods and results of the review.
The PRISMA statement is the primary reporting guideline for systematic reviews. It specifies the minimum items to report, including the full-text review process and exclusion documentation.
Research Integrity
Systematic reviews must adhere to research integrity standards. The Committee on Publication Ethics outlines core practices for ethical research conduct, including data management, authorship, and peer review. These practices apply to systematic reviews as they do to primary research.
Full-text review involves handling published research. Reviewers must respect copyright and licensing terms when retrieving and sharing full texts. Use institutional access and legal retrieval methods.
Data Management
Systematic reviews generate substantial data including screening decisions, exclusion reasons, and retrieval records. The NIH Data Management and Sharing Policy describes expectations for managing and sharing research data. While this policy applies to NIH funded research, the principles of organized data management apply broadly.
Plan for data management before screening begins. Define file naming conventions, folder structures, and backup procedures. Store screening data in formats that support long term access and sharing.
Author Identification
Accurate author identification supports the review process. The ORCID for Researchers resource describes how persistent researcher identifiers support accurate attribution and record maintenance. Using ORCID identifiers when contacting authors or reporting study authorship reduces ambiguity.
Practical Implementation Steps
Step 1: Assemble the Screening Team
Identify the reviewers who will perform full-text screening. At least two reviewers are needed for independent screening. A third reviewer should be available for disagreement resolution.
Ensure all reviewers understand the eligibility criteria and screening form. Conduct a training session that includes pilot screening and discussion of ambiguous cases.
Step 2: Finalize the Screening Form
Develop the screening form based on the eligibility criteria. Pilot test the form on a sample of full texts. Revise the form based on pilot results and document the changes.
Step 3: Begin Full-Text Retrieval
Start retrieving full texts for all records that passed abstract screening. Track retrieval status for every record. Follow up on pending requests at regular intervals.
Step 4: Conduct Independent Screening
Each reviewer screens all retrieved full texts independently. Record decisions and exclusion reasons on the screening form.
Step 5: Resolve Disagreements
Compare screening decisions and identify disagreements. Resolve through discussion or third reviewer adjudication. Document the resolution process.
Step 6: Document and Report
Record all exclusion reasons and retrieval outcomes. Construct the PRISMA flow diagram. Describe the full-text review process in the methods section.
Records and Measurements to Maintain
Maintain the following records throughout the full-text review process:
- Retrieval tracking log with dates and outcomes
- Screening forms for each record
- Disagreement resolution documentation
- Exclusion reason codes for each excluded record
- Author contact records for missing full texts
- Pilot testing documentation and form revisions
These records support the review's transparency and provide the data needed for reporting.
Professional Escalation Criteria
Escalate to a senior reviewer or methodologist when:
- Reviewers cannot resolve disagreements through discussion
- Eligibility criteria cannot be applied consistently despite clarification
- A large proportion of full texts cannot be retrieved
- Screening decisions reveal systematic bias or errors
- The screening process reveals that the eligibility criteria need substantial revision
Early escalation prevents small problems from becoming major threats to the review's validity.
Frequently Asked Questions
How many reviewers should screen full texts?
At least two reviewers should screen each full text independently. This reduces bias and allows disagreement resolution. A third reviewer may be needed when the two primary reviewers cannot reach consensus.
What should I do when a full text is not available?
Document all retrieval attempts and their outcomes. Try interlibrary loan, author contact, preprint servers, and institutional repositories. If the full text remains unavailable, record the record as excluded with the reason "full text not available" and report this in the PRISMA flow diagram.
How do I document exclusion reasons?
Use a predefined code list that maps to the eligibility criteria. Record the specific reason code for each excluded record. The codes feed directly into the PRISMA flow diagram and support transparent reporting.
Can I screen full texts without a screening form?
A screening form is strongly recommended. It ensures consistent application of eligibility criteria and provides documentation for every decision. Without a form, reviewers may apply criteria inconsistently and documentation becomes incomplete.
How long does full-text review take?
The time depends on the number of records and the complexity of the eligibility criteria. Estimate 30 to 60 minutes per full text for screening and documentation. Add time for retrieval, disagreement resolution, and quality checks.
What is the difference between abstract screening and full-text review?
Abstract screening filters records based on limited information available in titles and abstracts. Full-text review confirms eligibility by examining complete manuscripts. Full-text review is more accurate because it accesses the full methods and results.
How do I handle disagreements between reviewers?
Resolve disagreements through discussion where reviewers reference the eligibility criteria and manuscript evidence. If discussion fails, a third reviewer makes the final decision. Document the resolution process in the review methods.
What reporting guidelines apply to full-text review?
The PRISMA statement is the primary reporting guideline for systematic reviews. The EQUATOR Network provides access to PRISMA and other reporting guidelines. Follow the relevant guideline to ensure complete and transparent reporting.
Using the Evidence
| Source | Best use in this topic | Important limitation |
|---|---|---|
| Research Methods Resources | official guidance | Check the linked page for current local requirements |
| EQUATOR Network | official guidance | Check the linked page for current local requirements |
| Core Practices | official guidance | Check the linked page for current local requirements |
Related Articles
- Ethical Concerns in Research: Common Pitfalls and How to Avoid Them
- Ethical Issues in Informed Consent: Common Pitfalls and How to Avoid Them
- Avoiding Bias in Experiments: Common Pitfalls and How to Prevent Them
- Meta-Analysis vs Systematic Review: What's the Difference?
- Common Mistakes in Meta-Analysis and How to Avoid Them
References and Further Reading
- Research Methods Resources. National Library of Medicine.
- EQUATOR Network. EQUATOR Network.
- Core Practices. Committee on Publication Ethics.
- NIH Grants and Funding. National Institutes of Health.
- ORCID for Researchers. ORCID.
- Data Management and Sharing Policy. National Institutes of Health.
- NCBI Literature Resources. National Center for Biotechnology Information.
- PubMed. National Library of Medicine.
This article is educational and does not replace institutional policy, professional advice, or applicable safety and regulatory requirements.