# How to Use Rayyan for Title and Abstract Screening

## Quick Answer

- Create a Rayyan project, import your references, and define inclusion and exclusion criteria before you begin screening to keep decisions consistent.
- Use the blind screening mode for independent reviewer decisions, then resolve conflicts through the built-in discussion and consensus tools.
- Rayyan AI suggestions can prioritize records, but they do not replace your manual eligibility decisions and require verification against your protocol.

## Understanding Rayyan and Its Role in Systematic Reviews

Rayyan is a web based application designed to support researchers during the title and abstract screening phase of a systematic review. It provides a centralized platform where review teams can import bibliographic records, screen them against predefined criteria, track decisions, and manage the flow of references through the review process. The tool is widely used in health research and other evidence synthesis fields because it reduces the logistical burden of managing large numbers of references across multiple reviewers.

The screening phase is a critical step in any systematic review. During this stage, reviewers examine the titles and abstracts of records retrieved from database searches and decide which ones should move forward to full text review. This process requires careful attention to the inclusion and exclusion criteria established in the review protocol. Rayyan supports this work by offering features for collaboration, conflict resolution, and progress tracking.

For researchers who are new to systematic reviews, understanding how to use Rayyan effectively can significantly improve the efficiency and reliability of the screening process. The tool is designed to be intuitive, but it has specific workflows and settings that are worth learning before you begin a large project. This article walks through the practical steps of setting up a Rayyan project, importing references, defining criteria, using the AI suggestions, and tracking progress.

## Setting Up Your Rayyan Account and Project

Before you can begin screening, you need to create an account and set up your project structure. Rayyan offers both free and premium accounts, with the free tier supporting a substantial number of active reviews. The account creation process requires an email address and a password, and you can also sign in using institutional credentials if your library or organization provides access.

Once your account is active, you create a new review project by selecting the option to start a new review. You will be prompted to provide basic information about your review, including its title and a brief description. This metadata helps you organize multiple projects and makes it easier for collaborators to understand the scope of the work.

The project setup screen also asks you to specify whether the review is for a systematic review, a meta analysis, or another type of evidence synthesis. This selection does not change the core functionality of the tool, but it helps Rayyan tailor certain features and reporting options to your needs. You can also indicate whether the review is part of a Cochrane or Campbell collaboration, which may affect how the system handles certain data fields.

After creating the project, you will land on the main dashboard. This is where you will manage your references, screen records, and monitor progress. The dashboard displays key metrics such as the total number of references, the number screened, and the number of conflicts. Understanding this interface is essential for efficient workflow management.

## Importing References into Rayyan

Importing references is the first substantive step in using Rayyan for screening. The tool supports multiple file formats, including RIS, PubMed, and EndNote XML files. Most database exports can be converted to one of these formats, so you should check the export options in your reference management software or database interface.

To import references, navigate to the references section of your project and select the import option. You will be prompted to upload your file, and Rayyan will process it and add the records to your project. During the import process, Rayyan attempts to identify and remove duplicate records. This deduplication feature is valuable because systematic reviews often involve searching multiple databases, which can produce overlapping results.

After the import is complete, you should review the records to ensure that the data has been captured correctly. Check that titles, abstracts, author names, and publication years are present and accurate. In some cases, records may be missing abstracts, which can complicate the screening process. You can still screen these records based on their titles, but you should note that the absence of an abstract may require you to retrieve additional information before making a final decision.

Rayyan also allows you to add references manually. This is useful when you need to include records that were identified through hand searching, citation chasing, or other non database methods. Manual entry requires you to fill in the bibliographic details yourself, which takes more time but ensures that all relevant records are included in your screening pool.

## Defining Inclusion and Exclusion Criteria

Clear inclusion and exclusion criteria are the foundation of a reliable screening process. These criteria should be established during the protocol development phase of your systematic review and documented in your review protocol. The criteria define which studies are eligible for your review based on characteristics such as population, intervention, comparator, outcome, and study design.

In Rayyan, you can record your criteria in the review settings. While the tool does not enforce these criteria automatically, having them documented within the project helps reviewers stay consistent. You can also use the criteria to guide your screening decisions and to communicate expectations to collaborators.

When defining your criteria, be specific about what you are looking for. For example, if your review focuses on a particular disease condition, specify the diagnostic criteria or the population characteristics that define eligibility. If you are interested in specific interventions, describe them in enough detail that reviewers can apply the criteria consistently.

It is also important to define exclusion criteria clearly. Common exclusions include studies that do not report original data, studies with inappropriate comparators, and studies that do not address your research question. By documenting these criteria in Rayyan, you create a reference point that reviewers can consult during the screening process.

## Understanding the Screening Interface

The Rayyan screening interface is designed to present one record at a time, allowing you to focus on the title and abstract without distraction. The interface displays the bibliographic information, including the title, authors, journal, and publication year. The abstract is shown below this information, and you can expand it if it is truncated.

At the top of the screening interface, you will find buttons for making your decision. The primary options are include, exclude, and maybe. You can also mark a record as a duplicate or flag it for discussion. These decisions are recorded in the system and used to track your progress.

The interface also includes a panel for viewing the inclusion and exclusion criteria. This panel can be toggled on and off, and it serves as a reminder of the criteria you established earlier. Having the criteria visible while you screen helps reduce the risk of drift, where reviewers become less consistent over time as they process large numbers of records.

Rayyan provides keyboard shortcuts for common actions, which can significantly speed up the screening process. For example, you can use the arrow keys to navigate between records and press specific keys to mark a record as included or excluded. Learning these shortcuts is worthwhile if you are screening a large number of references.

## Using Rayyan AI Suggestions

Rayyan includes an artificial intelligence feature that provides suggestions about the likely relevance of each record. The AI suggestions are based on patterns learned from your screening decisions and from the content of the records themselves. As you screen more records, the AI model becomes more tailored to your specific review.

The AI suggestions appear as a score or label on each record, indicating the system's prediction about whether the record is likely to be relevant. You can use these suggestions to prioritize your screening efforts, focusing first on records that the AI predicts are highly relevant. This can be particularly useful when you have a large number of references to screen and limited time.

However, it is essential to understand the limitations of AI suggestions. The AI is a prioritization tool, not a decision maker. You must still apply your inclusion and exclusion criteria to every record, regardless of the AI score. The suggestions are based on statistical patterns and may not capture the nuances of your specific research question.

You should also be aware that the AI suggestions improve with use. Early in the screening process, the suggestions may be less accurate because the model has limited data about your decisions. As you screen more records, the model learns from your choices and becomes more precise. This means that the value of the AI feature increases over the course of your project.

## Setting Up Blind Screening for Independent Decisions

Blind screening is a method used to reduce bias in the screening process. In blind screening, each reviewer makes their decisions without seeing the decisions of other reviewers. This ensures that each reviewer's judgment is independent and not influenced by the opinions of others.

Rayyan supports blind screening through its collaboration settings. When you invite collaborators to your project, you can choose whether they can see each other's decisions. In blind mode, reviewers cannot see the decisions made by other reviewers until the screening is complete or until a conflict resolution phase begins.

To set up blind screening, navigate to the collaboration settings in your project and select the blind screening option. You will then invite your reviewers by entering their email addresses. Each reviewer will receive an invitation to join the project, and they will need to create or log in to their Rayyan account to access the screening interface.

Blind screening is particularly important in systematic reviews because it helps prevent confirmation bias. When reviewers can see each other's decisions, they may be influenced to agree with the majority or to defer to a more experienced colleague. Blind screening ensures that each record is evaluated on its own merits.

## Managing Conflicts and Reaching Consensus

Conflicts occur when reviewers make different decisions about the same record. For example, one reviewer may include a record while another excludes it. Conflicts are a normal part of the screening process and do not indicate a problem with your review. Instead, they highlight records that require further discussion.

Rayyan identifies conflicts automatically and flags them in the screening interface. The system tracks which records have conflicting decisions and makes these records available for resolution. You can filter your view to show only conflicting records, which makes it easier to focus on the records that need attention.

The conflict resolution process typically involves discussion among the reviewers. Rayyan provides a discussion feature that allows reviewers to comment on specific records and share their reasoning. This can be done in real time or asynchronously, depending on the preferences of your team.

After discussing a conflicting record, the team must reach a consensus decision. This may involve one reviewer changing their decision, or the team may decide to include the record for full text review to gather more information. In some cases, a third reviewer or the review lead may make the final decision if the team cannot reach consensus.

## Tracking Screening Progress and Monitoring Performance

Monitoring your screening progress is essential for staying on schedule and identifying potential issues. Rayyan provides several tools for tracking progress, including the dashboard metrics and the ability to filter records by their screening status.

The dashboard displays the total number of references, the number screened, and the number remaining. It also shows the number of included and excluded records, as well as the number of conflicts. These metrics give you a quick overview of where you stand in the screening process.

You can also view progress by reviewer. This is useful for identifying reviewers who may be falling behind or who may be applying the criteria differently from their colleagues. If you notice significant discrepancies in the inclusion rates of different reviewers, it may be worth discussing the criteria to ensure everyone is applying them consistently.

Rayyan allows you to export your screening data at any point. This is useful for creating progress reports, documenting your methods, or analyzing the screening process. The export includes information about each record, the decisions made, and the timing of those decisions.

## Practical Steps for a Successful Screening Workflow

To get the most out of Rayyan, it helps to follow a structured workflow. The following steps outline a practical approach to using Rayyan for title and abstract screening.

First, finalize your inclusion and exclusion criteria before you begin screening. Write these criteria in your protocol and enter them into Rayyan so that all reviewers have access to them during the screening process.

Second, import all of your references into Rayyan and run the deduplication process. Review the deduplication results to ensure that legitimate duplicates are removed and that unique records are retained.

Third, pilot test your screening process. Select a small sample of records and have all reviewers screen them independently. Compare the results and discuss any discrepancies. This pilot phase helps ensure that all reviewers understand the criteria and apply them consistently.

Fourth, begin the full screening process. Use the blind screening mode to ensure independent decisions. Monitor your progress regularly and address any issues that arise.

Fifth, resolve conflicts through discussion and consensus. Document the reasons for your decisions, particularly for records that were difficult to classify.

Finally, export your screening data and document your methods. This documentation is important for the transparency of your review and for reporting purposes.

## Common Failure Patterns and How to Avoid Them

Several common problems can undermine the effectiveness of Rayyan screening. Being aware of these patterns can help you avoid them.

One common failure is inadequate pilot testing. When reviewers do not practice on a sample of records before the full screening begins, they may apply the criteria inconsistently. This leads to a higher number of conflicts and may require extensive re screening.

Another failure pattern is criterion drift. Over time, reviewers may become more lenient or more strict in their application of the criteria. This can happen when reviewers are fatigued or when they encounter many records that are similar. Regular check ins and reference to the documented criteria can help mitigate this issue.

A third failure is poor communication among reviewers. When reviewers do not discuss their decisions or share their reasoning, conflicts may go unresolved or be resolved arbitrarily. Using the discussion features in Rayyan and scheduling regular team meetings can improve communication.

Finally, some teams fail to document their screening decisions adequately. This can create problems during the reporting phase of the review, when you need to describe how many records were screened and why certain records were excluded. Keeping clear records in Rayyan and exporting the data regularly can prevent this issue.

## Limitations of Rayyan and When to Escalate

While Rayyan is a powerful tool, it has limitations that you should understand. The tool is designed for title and abstract screening, not for full text review. Once you have identified the records that pass the title and abstract screening, you will need to retrieve the full texts and assess them separately.

Rayyan also does not replace the need for a well developed protocol. The tool facilitates the screening process, but it does not make decisions about eligibility. You must still apply your judgment and your criteria to each record.

If you encounter technical issues with Rayyan, such as problems with importing files or accessing the platform, you should consult the Rayyan help documentation or contact their support team. For issues related to your review methodology, such as uncertainty about how to handle specific types of records, you should consult your review protocol or seek advice from a librarian or methodologist.

In some cases, you may need to escalate a decision to a senior member of your review team. This is appropriate when reviewers cannot reach consensus or when a record raises questions that go beyond the scope of the screening criteria. Documenting these escalations is important for the transparency of your review.

## Integrating Rayyan with Your Overall Review Process

Rayyan is one component of a larger systematic review workflow. Understanding how it fits into the broader process can help you use it more effectively.

Before you begin screening, you should have completed your systematic literature search. This involves searching multiple databases, such as PubMed, Embase, and Web of Science, using a search strategy that you have documented in your protocol. The results of these searches are exported and imported into Rayyan.

After screening, the included records move to the full text review phase. During this phase, you retrieve the full text of each included record and assess it against your eligibility criteria. This phase is typically managed outside of Rayyan, although you can use the tool to track which records have been assessed.

The next phases of the review involve data extraction, risk of bias assessment, and synthesis. These phases require specialized tools and expertise. Rayyan does not support these activities directly, but the decisions you make during screening will determine which studies advance to these later phases.

Throughout the review process, it is important to maintain transparency and documentation. The decisions you make in Rayyan should be recorded and reported in your final review. This includes the number of records screened, the number excluded, and the reasons for exclusion.

## Reporting and Transparency Considerations

Transparency is a core principle of systematic review methodology. Your screening process should be documented in enough detail that others can understand how you arrived at your final set of included studies.

When reporting your screening process, you should describe the number of records identified through database searching, the number of duplicates removed, and the number of records screened. You should also report the number of records excluded and the reasons for exclusion. This information is typically presented in a flow diagram, such as the PRISMA flow diagram.

The [EQUATOR Network](https://www.equator-network.org/) provides resources for identifying reporting guidelines that are relevant to your review. Using these guidelines helps ensure that your reporting is complete and transparent.

You should also consider the ethical aspects of your review. The [Committee on Publication Ethics](https://publicationethics.org/core-practices) outlines core practices for ethical research and publication, including issues related to authorship, data handling, and conflicts of interest. These practices apply to systematic reviews as well as to primary research.

## Data Management and Documentation

Proper data management is essential for a successful systematic review. This includes managing your screening data, your search records, and your protocol documents.

The [National Institutes of Health Data Management and Sharing Policy](https://sharing.nih.gov/data-management-and-sharing-policy) describes expectations for data management and sharing in NIH funded research. While this policy applies specifically to NIH funded projects, the principles of good data management are relevant to all research.

In the context of Rayyan, data management involves ensuring that your screening decisions are recorded accurately and that you have backups of your data. Rayyan stores your data in the cloud, but you should also export your data regularly to maintain a local copy.

You should also document your screening process in your review protocol. This includes describing how you used Rayyan, how you managed conflicts, and how you handled records that were difficult to classify. This documentation supports the transparency and reproducibility of your review.

## Professional Escalation Criteria

Knowing when to escalate an issue is important for maintaining the quality of your review. The following situations may warrant escalation to a supervisor, methodologist, or other authority.

If you encounter a technical problem with Rayyan that you cannot resolve, such as a bug that prevents you from accessing your data, you should escalate the issue to Rayyan support. You should also inform your review team so that they are aware of the problem.

If you are uncertain about how to apply your inclusion criteria to a specific record, you should discuss this with your review team. If the team cannot reach consensus, the issue may need to be escalated to the review lead or to a methodologist.

If you identify a potential ethical issue, such as a conflict of interest among reviewers or concerns about the integrity of the data, you should escalate this to the appropriate authority. The [Committee on Publication Ethics](https://publicationethics.org/core-practices) provides guidance on handling ethical issues in research.

If your review is funded by the NIH, you should be aware of the [NIH Grants and Funding](https://grants.nih.gov/) policies that apply to your project. This includes requirements related to data management, reporting, and compliance.

## Using ORCID to Maintain Your Researcher Identity

Maintaining an accurate researcher identity is important for documenting your contributions to systematic reviews. [ORCID](https://info.orcid.org/researchers) provides a persistent identifier that links your research activities to your name.

When you publish your systematic review, your ORCID identifier helps ensure that your work is correctly attributed to you. This is particularly important in fields where multiple researchers may share similar names.

ORCID also integrates with many research systems, including manuscript submission systems and grant application platforms. Maintaining your ORCID record ensures that your research outputs are accurately linked to your identity.

## At a Glance

| Feature | Purpose | Best Practice |
| --- | --- | --- |
| Project Setup | Organize your review and define its scope | Create a new project for each review and document your criteria in the project settings |
| Reference Import | Bring database results into the screening tool | Use RIS or PubMed format and review deduplication results after import |
| Blind Screening | Ensure independent reviewer decisions | Enable blind mode before inviting collaborators and pilot test the process |
| AI Suggestions | Prioritize records for screening | Use suggestions to order your work but apply manual criteria to every record |
| Conflict Resolution | Resolve disagreements between reviewers | Use the discussion feature and document the reasoning for final decisions |
| Progress Tracking | Monitor screening status and reviewer performance | Check dashboard metrics regularly and export data for reporting |

## Records and Measurements to Maintain

Maintaining accurate records is essential for the success of your systematic review. The following records should be maintained throughout the screening process.

First, keep a record of your search strategy. This includes the databases you searched, the date of each search, and the search terms you used. This information is necessary for the reproducibility of your review.

Second, maintain a record of your screening decisions. Rayyan records these decisions automatically, but you should also export the data regularly to maintain a local backup.

Third, document any changes to your protocol. If you modify your inclusion criteria or your screening process, you should record these changes and the reasons for them. This documentation supports the transparency of your review.

Fourth, keep a record of your team meetings and discussions. This includes decisions about how to handle specific records and any changes to your screening approach.

## Common Failure Patterns in Rayyan Screening

Understanding common failure patterns can help you avoid mistakes in your own screening process. The following patterns are frequently observed in systematic review projects.

One pattern is the failure to establish clear criteria before screening begins. Without clear criteria, reviewers may make inconsistent decisions, leading to a high number of conflicts and requiring extensive re screening.

Another pattern is the failure to pilot test the screening process. Pilot testing helps identify misunderstandings about the criteria and allows the team to calibrate their decisions before the full screening begins.

A third pattern is the failure to monitor progress regularly. Without regular monitoring, teams may fall behind schedule or fail to identify issues until they become significant problems.

A fourth pattern is the failure to document decisions adequately. This can create problems during the reporting phase and may undermine the credibility of the review.

## Safety and Quality Controls

Quality control is an essential part of the screening process. The following measures can help ensure the quality of your screening decisions.

First, use blind screening to ensure independent decisions. This reduces the risk of bias and helps ensure that each record is evaluated on its own merits.

Second, pilot test your screening process before the full screening begins. This helps identify misunderstandings and ensures that all reviewers are applying the criteria consistently.

Third, monitor reviewer performance throughout the screening process. If you notice significant discrepancies in inclusion rates, discuss the criteria with your team to ensure consistency.

Fourth, document your decisions and the reasoning behind them. This documentation supports the transparency of your review and provides a record that can be reviewed if questions arise.

## Frequently Asked Questions

### How do I create a new Rayyan project for my systematic review?

To create a new project, log in to your Rayyan account and select the option to start a new review. You will be prompted to enter basic information about your review, including its title and description. After creating the project, you can begin importing references and setting up your screening process.

### What file formats can I use to import references into Rayyan?

Rayyan supports several common file formats, including RIS, PubMed, and EndNote XML. Most database exports can be converted to one of these formats. Check the export options in your database or reference management software to determine the appropriate format.

### How does Rayyan handle duplicate references?

Rayyan automatically attempts to identify and remove duplicate references during the import process. After importing your references, you should review the deduplication results to ensure that legitimate duplicates are removed and that unique records are retained.

### What is blind screening and why is it important?

Blind screening is a method where each reviewer makes their decisions without seeing the decisions of other reviewers. This ensures independent judgment and reduces the risk of bias. Rayyan supports blind screening through its collaboration settings.

### How do I resolve conflicts between reviewers in Rayyan?

Rayyan identifies conflicting decisions and flags them for resolution. Reviewers can use the discussion feature to share their reasoning and work toward consensus. If the team cannot reach consensus, a senior reviewer or the review lead may make the final decision.

### Can I use Rayyan AI suggestions to make screening decisions?

Rayyan AI suggestions are designed to prioritize records for screening, not to make decisions. You must apply your inclusion and exclusion criteria to every record, regardless of the AI score. The AI suggestions improve as you screen more records.

### How do I track my screening progress in Rayyan?

The Rayyan dashboard displays key metrics, including the total number of references, the number screened, and the number of conflicts. You can also filter records by their screening status and view progress by reviewer.

### What should I do if I encounter technical

## Using the Evidence

| Source | Best use in this topic | Important limitation |
|---|---|---|
| [Research Methods Resources](https://www.ncbi.nlm.nih.gov/books) | official guidance | Check the linked page for current local requirements |
| [EQUATOR Network](https://www.equator-network.org/) | official guidance | Check the linked page for current local requirements |
| [Core Practices](https://publicationethics.org/core-practices) | official guidance | Check the linked page for current local requirements |

## Related Articles

- [What Is Data Management? A Primer for Life Science Researchers](/blog/guides/what-is-data-management-a-primer-for-life-science-researchers)
- [Conducting Qualitative Interviews: A Guide for Life Science Researchers](/blog/guides/conducting-qualitative-interviews-a-guide-for-life-science-researchers)
- [Conducting a Study: A Practical Checklist for Life Science Researchers](/blog/guides/conducting-a-study-a-practical-checklist-for-life-science-researchers)
- [Observational vs. Experimental Studies: A Decision Framework for Life Science Researchers](/blog/guides/observational-vs-experimental-studies-a-decision-framework-for-life-science-researchers)
- [Protein Synthesis Step By Step](/blog/guides/protein-synthesis-step-by-step)

## References and Further Reading

- [Research Methods Resources](https://www.ncbi.nlm.nih.gov/books). National Library of Medicine.
- [EQUATOR Network](https://www.equator-network.org/). EQUATOR Network.
- [Core Practices](https://publicationethics.org/core-practices). Committee on Publication Ethics.
- [NIH Grants and Funding](https://grants.nih.gov/). National Institutes of Health.
- [ORCID for Researchers](https://info.orcid.org/researchers). ORCID.
- [Data Management and Sharing Policy](https://sharing.nih.gov/data-management-and-sharing-policy). National Institutes of Health.
- [NCBI Literature Resources](https://www.ncbi.nlm.nih.gov/). National Center for Biotechnology Information.
- [PubMed](https://pubmed.ncbi.nlm.nih.gov/). National Library of Medicine.

> This article is educational and does not replace institutional policy, professional advice, or applicable safety and regulatory requirements.