# Integrative Review Frameworks: A Guide to Whittemore and Knafl's Methodology ## Quick Answer - The Whittemore and Knafl integrative review framework provides a structured five-stage method for combining empirical and theoretical literature in a single review. - Start by defining a clear review purpose and searching multiple databases, then move through data evaluation, analysis, and presentation with explicit quality checks. - The framework requires transparent reporting of search decisions and quality appraisal, but it does not replace discipline-specific reporting guidelines or institutional ethics requirements. ## Understanding the Integrative Review Framework An integrative review is a research method that summarizes past empirical and theoretical literature to provide a more comprehensive understanding of a particular phenomenon or healthcare problem. Unlike systematic reviews that typically focus on experimental studies, integrative reviews accommodate diverse methodologies, including experimental and non-experimental research, which makes them valuable for examining complex topics from multiple angles. The Whittemore and Knafl framework, first presented in 2005, addressed a critical gap in review methodology. Prior to this framework, integrative review methods lacked explicit guidance for data analysis and synthesis, particularly when handling studies with different designs. The framework provides a systematic approach that enhances rigor and reduces bias in reviews that combine varied evidence types. For researchers in animal farming and life sciences, this framework offers practical utility. A researcher investigating biosecurity practices across poultry operations might need to synthesize survey data, observational studies, and intervention trials. The integrative review framework accommodates this diversity while maintaining methodological transparency. The framework is especially relevant for topics where evidence spans multiple paradigms. For example, a review of antimicrobial stewardship in dairy production could include pharmacokinetic studies, farmer attitude surveys, and policy analyses. Each evidence type answers different questions, and the integrative approach allows meaningful synthesis across these distinct forms of inquiry. ## The Five Stages of the Framework The Whittemore and Knafl framework organizes the review process into five distinct stages. Each stage builds on the previous one, creating a logical progression from problem identification to final presentation. ### Stage One: Problem Identification The first stage requires the reviewer to clearly identify the problem and define the variables of interest. This stage establishes the purpose of the review and the questions it will answer. A well-defined problem statement guides all subsequent decisions about searching, sampling, and analysis. For practical implementation, the reviewer should specify the population, phenomenon of interest, and context. In an animal science context, this might mean defining the species, production system, and specific outcome of interest. The problem identification stage also involves considering the theoretical framework that will guide the review, which helps organize the synthesis. The reviewer must also consider whether the review question is appropriate for an integrative approach. Questions that require combining qualitative and quantitative evidence are well suited to this framework. Questions that focus exclusively on intervention effectiveness might be better served by a systematic review with meta-analysis. ### Stage Two: Literature Search The literature search stage involves a comprehensive search of multiple databases and sources. The framework emphasizes that the search strategy must be explicit and documented so that other researchers could replicate it. This transparency is a hallmark of rigorous review methodology. A practical search strategy includes identifying relevant databases, developing search terms, and applying inclusion and exclusion criteria. For animal science topics, relevant databases might include PubMed, Agricola, and Web of Science. The search should also consider grey literature, such as conference proceedings and government reports, which often contain valuable applied research. The reviewer should document the search process carefully, including the date of each search, the databases searched, and the search terms used. This documentation serves multiple purposes. It allows readers to assess the comprehensiveness of the search, and it enables updates to the review at a later date. ### Stage Three: Data Evaluation Data evaluation in the integrative review framework differs from quality appraisal in systematic reviews. The framework acknowledges that diverse study designs require different quality criteria. The reviewer must evaluate the quality of primary sources while considering the methodological strengths and limitations of each study design. For mixed-method reviews, the evaluation stage requires careful judgment. A qualitative study exploring farmer perceptions of disease prevention might be evaluated using criteria for qualitative research, while a randomized trial of a vaccine protocol would be evaluated using criteria for experimental designs. The framework does not prescribe a single quality instrument but requires that the reviewer justify the approach used. The outcome of the data evaluation stage is a decision about which studies to include in the final sample. Studies that fail to meet quality thresholds should be excluded, and the reasons for exclusion should be documented. This process enhances the credibility of the review findings. ### Stage Four: Data Analysis The data analysis stage is where the integrative review framework makes its most distinctive contribution. The framework adapts analytic methods from qualitative research to handle data from diverse study designs. The goal is to synthesize the evidence into coherent themes or categories that answer the review question. The analysis process involves data reduction, data display, data comparison, and conclusion drawing and verification. Data reduction involves extracting relevant information from each study and organizing it into a manageable format. Data display involves presenting the extracted data in matrices or tables that facilitate comparison across studies. Data comparison is the iterative process of examining the data for patterns, themes, and relationships. This process requires the reviewer to move back and forth between the data and emerging interpretations. Conclusion drawing and verification involves developing conclusions that are grounded in the data and checking those conclusions against the full body of evidence. ### Stage Five: Presentation The final stage involves presenting the synthesis in a way that clearly communicates the findings to the intended audience. The presentation should include a description of the search process, the characteristics of the included studies, and the synthesized findings. The presentation stage also requires attention to reporting standards. The EQUATOR Network provides access to reporting guidelines that help authors present their research transparently. For integrative reviews, authors should consider which reporting guideline applies to their specific review design and follow it consistently. The presentation should acknowledge the limitations of the review, including limitations of the primary studies and limitations of the review methodology itself. This transparency allows readers to interpret the findings appropriately and assess the applicability of the conclusions to their own contexts. ## At a Glance | Framework Stage | Primary Activity | Key Output | Common Pitfall | | --- | --- | --- | --- | | Problem Identification | Define review purpose and variables | Clear review question and scope | Vague problem statement that does not guide search | | Literature Search | Systematic search of multiple sources | Documented search strategy and study sample | Searching only one database or missing grey literature | | Data Evaluation | Quality appraisal of diverse study designs | Justified inclusion and exclusion decisions | Applying one quality instrument to all study designs | | Data Analysis | Reduction, display, comparison, and verification | Synthesized themes or categories | Premature conclusions without iterative comparison | | Presentation | Transparent reporting of methods and findings | Published review with stated limitations | Omitting search details or quality appraisal methods | ## Practical Implementation Steps Implementing the Whittemore and Knafl framework requires deliberate planning and consistent documentation. The following steps provide a practical pathway for researchers conducting an integrative review. ### Step One: Define the Review Scope Begin by writing a clear statement of the review purpose. This statement should identify the phenomenon of interest, the population, and the context. It should also specify the types of evidence that will be included. A written scope statement serves as a reference point throughout the review process. The scope statement should also identify the theoretical or conceptual framework guiding the review. This framework helps organize the synthesis and provides a structure for interpreting findings. In animal science research, relevant frameworks might include the One Health approach, the biosecurity risk assessment model, or the technology adoption model. ### Step Two: Develop the Search Protocol Create a written search protocol before beginning the actual search. The protocol should specify the databases to be searched, the search terms to be used, and the inclusion and exclusion criteria. Having a written protocol reduces the risk of ad hoc decisions that could introduce bias. The search protocol should also address how grey literature will be handled. Grey literature includes reports, theses, conference papers, and other materials not indexed in traditional databases. For applied topics in animal farming, grey literature often contains valuable data from extension services and industry organizations. ### Step Three: Execute and Document the Search Run the search according to the protocol and document the results. For each database, record the date of the search, the exact search string used, and the number of results returned. This documentation allows the search to be replicated and updated. After the initial search, screen the results against the inclusion criteria. This screening typically occurs in two phases. The first phase screens titles and abstracts to remove obviously irrelevant records. The second phase screens full texts to make final inclusion decisions. Document the number of records excluded at each phase and the reasons for exclusion. ### Step Four: Evaluate Study Quality Develop a quality appraisal approach that respects the diversity of study designs in the sample. For each study, assess methodological quality using criteria appropriate to its design. Document the appraisal process and the decisions made. The quality appraisal should consider both methodological rigor and relevance to the review question. A study might be methodologically sound but address a slightly different question than the review intends. The reviewer must judge whether such a study contributes meaningfully to the synthesis. ### Step Five: Conduct the Analysis Extract data from each included study and organize it into a matrix or table. The extraction should capture the study characteristics, methods, and findings relevant to the review question. This organized display facilitates comparison across studies. Work through the data iteratively, identifying patterns and themes. Move between the data display and the emerging interpretation, checking that conclusions are grounded in the evidence. This iterative process is central to the rigor of the integrative review method. ### Step Six: Prepare the Report Write the review report following the structure of the framework. Describe the problem identification, search process, data evaluation, analysis, and synthesis. Present the findings clearly and acknowledge the limitations of the review. Consult reporting guidelines to ensure the report meets transparency standards. The EQUATOR Network serves as a gateway to reporting guidelines for various study designs. Following an appropriate reporting guideline helps readers understand what was done and why. ## Records and Measurements Maintaining detailed records throughout the review process is essential for transparency and reproducibility. The following records should be kept for every integrative review. ### Search Documentation For each database searched, record the database name, the search interface, the date of the search, and the complete search strategy. Include the number of records retrieved and the number selected for screening. This documentation allows readers to assess the comprehensiveness of the search and to update the review in the future. ### Screening Log Maintain a log of all records screened and the decisions made. The log should record the number of records identified, the number excluded after title and abstract screening, and the number excluded after full-text review. Record the reasons for exclusion so that the screening process is transparent. ### Quality Appraisal Records Document the quality appraisal process, including the criteria used and the ratings assigned to each study. This documentation demonstrates that the review applied consistent standards and allows readers to evaluate the quality of the evidence base. ### Data Extraction Forms Use standardized data extraction forms to capture information from each included study. The forms should collect study characteristics, methods, and findings relevant to the review question. Standardized forms reduce the risk of missing important data and facilitate comparison across studies. ## Common Failure Patterns Researchers conducting integrative reviews often encounter predictable challenges. Recognizing these patterns can help reviewers avoid common pitfalls. ### Incomplete Literature Search A frequent failure is searching only one or two databases. This approach risks missing relevant studies and introduces bias into the review. The framework requires a comprehensive search across multiple sources, including grey literature. Another search-related failure is failing to document the search process. Without documentation, the search cannot be replicated or updated, and readers cannot assess its comprehensiveness. ### Inappropriate Quality Appraisal Applying a single quality instrument to all study designs is a common error. This approach penalizes qualitative studies for not meeting quantitative criteria and vice versa. The framework requires design-appropriate quality evaluation. A related failure is excluding studies based on quality without documenting the rationale. The review should explain why studies were excluded and how quality judgments were made. ### Superficial Analysis Some reviews present a summary of each study without true synthesis. This approach fails to meet the standard of an integrative review, which requires comparing and contrasting findings across studies to develop new insights. Another analytic failure is drawing conclusions prematurely without iterative comparison. The framework emphasizes moving back and forth between data and interpretation to ensure conclusions are grounded in the evidence. ### Poor Reporting Reviews that omit search details, quality appraisal methods, or limitations fail to meet transparency standards. Poor reporting prevents readers from assessing the validity of the findings and limits the usefulness of the review. ## Limitations and Considerations The integrative review framework has limitations that researchers should acknowledge. Understanding these limitations helps reviewers apply the framework appropriately and interpret findings cautiously. ### Methodological Complexity Integrative reviews are methodologically complex because they combine diverse study designs. This complexity requires reviewers to have skills in both qualitative and quantitative research methods. Reviewers without these skills may struggle with the analysis stage. The complexity also creates challenges for quality appraisal. Evaluating studies with different designs requires familiarity with multiple quality criteria and the judgment to apply them appropriately. ### Risk of Bias Like all review methods, integrative reviews are subject to bias. Publication bias, where studies with positive findings are more likely to be published, can affect the evidence base. The review should acknowledge this limitation and consider strategies to mitigate it. The reviewer's own perspectives can also introduce bias into the analysis. The framework requires transparency about the review process, which helps readers assess the potential for bias. ### Time and Resource Demands Conducting an integrative review is time-intensive. The comprehensive search, quality appraisal, and iterative analysis require substantial effort. Researchers should plan for the time commitment and secure appropriate resources before beginning. ### Reporting Challenges Reporting an integrative review presents challenges because no single reporting guideline covers all aspects of the method. Reviewers should consult the EQUATOR Network to identify relevant guidelines and follow them as closely as possible while acknowledging the unique features of the integrative review. ## Welfare and Safety Context For researchers conducting integrative reviews in animal farming and life sciences, several contextual considerations apply. ### Research Integrity The Committee on Publication Ethics Core Practices outline fundamental principles for research integrity, including authorship, peer review, and data handling. Researchers conducting integrative reviews should follow these principles throughout the review process. Authorship decisions should reflect actual contributions to the review. All authors should have made substantial contributions to the conception, conduct, or analysis of the review and should take responsibility for the content. Peer review of the review manuscript should be conducted fairly and confidentially. ### Data Management The NIH Data Management and Sharing Policy describes expectations for managing and sharing research data. While this policy applies to NIH-funded research, the principles of good data management apply broadly to all research, including integrative reviews. Reviewers should plan for data management from the beginning of the review. This planning includes deciding how search records, screening logs, and data extraction forms will be stored and preserved. Good data management supports transparency and allows the review to be verified or updated. ### Researcher Identity Maintaining an accurate researcher identity is important for the scholarly record. ORCID provides a persistent identifier that distinguishes researchers and connects them to their work. Researchers conducting integrative reviews should ensure their ORCID records are current and linked to their publications. ### Funding and Grants Researchers seeking funding for integrative reviews should consult the NIH Grants and Funding resources for information about application and review processes. Grant applications for review projects should clearly describe the review method, the team's qualifications, and the expected outcomes. ## Professional Escalation Criteria Researchers conducting integrative reviews should recognize when to seek additional expertise or escalate concerns. The following situations warrant consultation with colleagues, librarians, or methodologists. ### Search Challenges If the search is yielding very few relevant studies, consult a librarian or information specialist. They can help refine search strategies and identify additional databases or search terms. A search that returns no relevant studies may indicate that the review question needs refinement. ### Quality Appraisal Uncertainty If the review team disagrees about the quality of a study or is uncertain how to evaluate a particular design, consult a methodologist with relevant expertise. Quality appraisal decisions should be defensible and consistent across the review. ### Analysis Difficulties If the data do not cohere into clear themes or if the synthesis feels forced, step back and reconsider the analysis approach. Consultation with a qualitative research expert may help identify alternative analytic strategies. ### Ethical Concerns If the review raises ethical concerns, such as questions about data integrity or authorship disputes, consult institutional research integrity officers or follow the guidance of the Committee on Publication Ethics. Ethical concerns should be addressed promptly and transparently. ## Frequently Asked Questions ### What is the difference between an integrative review and a systematic review? An integrative review accommodates diverse study designs, including experimental and non-experimental research, while a systematic review typically focuses on experimental studies and often includes meta-analysis. The integrative review framework provides explicit methods for synthesizing mixed-method evidence, making it suitable for complex topics where evidence spans multiple paradigms. ### How many databases should I search for an integrative review? The framework requires a comprehensive search but does not specify a minimum number of databases. The appropriate number depends on the topic and the disciplines involved. For animal science topics, searching multiple databases such as PubMed, Agricola, and Web of Science, plus relevant grey literature sources, is generally appropriate. ### Can I include unpublished studies in an integrative review? The framework allows for the inclusion of grey literature, which includes unpublished or non-commercially published materials. The decision to include grey literature should be documented in the search protocol. Grey literature can provide valuable applied evidence, particularly for topics where industry and government reports contain relevant data. ### How do I evaluate the quality of studies with different designs? The framework requires design-appropriate quality evaluation. Use quality criteria that match each study design instead of applying a single instrument to all studies. Document the appraisal approach and the decisions made so that the process is transparent. ### What software can I use for data management in an integrative review? The framework does not prescribe specific software. Reference management software can organize citations, and spreadsheet or database software can manage data extraction and synthesis. The key requirement is that the data management approach supports transparency and allows the review to be replicated. ### How long does an integrative review take to complete? The time required varies based on the topic, the volume of literature, and the review team's experience. Integrative reviews are time-intensive because they require comprehensive searching, quality appraisal, and iterative analysis. Researchers should plan for a substantial time commitment and build in time for unexpected challenges. ### Do I need ethics approval for an integrative review? Integrative reviews analyze published literature and typically do not require ethics approval because they do not involve human or animal subjects. However, researchers should check their institutional requirements, as some institutions have specific policies about review research. ### How do I report an integrative review transparently? Consult the EQUATOR Network to identify relevant reporting guidelines and follow them as closely as possible. Report the search process, quality appraisal methods, analysis approach, and limitations clearly. Transparency in reporting allows readers to assess the validity and applicability of the review findings. ## Using the Evidence | Source | Best use in this topic | Important limitation | |---|---|---| | [Research Methods Resources](https://www.ncbi.nlm.nih.gov/books) | official guidance | Check the linked page for current local requirements | | [EQUATOR Network](https://www.equator-network.org/) | official guidance | Check the linked page for current local requirements | | [Core Practices](https://publicationethics.org/core-practices) | official guidance | Check the linked page for current local requirements | ## Related Articles - [What Does Statistical Mean? A Clear Explanation](/blog/guides/what-does-statistical-mean-a-clear-explanation) - [Scientific Literature Review Format: A Reproducible Structure for Researchers](/blog/careers/scientific-literature-review-format-a-reproducible-structure-for-researchers) - [Conducting Qualitative Interviews: A Guide for Life Science Researchers](/blog/guides/conducting-qualitative-interviews-a-guide-for-life-science-researchers) - [The Role of the Research Ethics Committee: What Researchers Need to Know](/blog/guides/the-role-of-the-research-ethics-committee-what-researchers-need-to-know) - [Conducting a Study: A Practical Checklist for Life Science Researchers](/blog/guides/conducting-a-study-a-practical-checklist-for-life-science-researchers) ## References and Further Reading - [Research Methods Resources](https://www.ncbi.nlm.nih.gov/books). National Library of Medicine. - [EQUATOR Network](https://www.equator-network.org/). EQUATOR Network. - [Core Practices](https://publicationethics.org/core-practices). Committee on Publication Ethics. - [NIH Grants and Funding](https://grants.nih.gov/). National Institutes of Health. - [ORCID for Researchers](https://info.orcid.org/researchers). ORCID. - [Data Management and Sharing Policy](https://sharing.nih.gov/data-management-and-sharing-policy). National Institutes of Health. - [NCBI Literature Resources](https://www.ncbi.nlm.nih.gov/). National Center for Biotechnology Information. - [PubMed](https://pubmed.ncbi.nlm.nih.gov/). National Library of Medicine. > This article is educational and does not replace institutional policy, professional advice, or applicable safety and regulatory requirements.