The Role of Pilot Studies in Experimental Design

By Dr. Zubair Khalid, DVM, MS, PhD · 2026-08-21

Quick Answer

• Pilot studies test feasibility, safety, and protocol logistics before a full experiment, and they provide preliminary data that can inform sample size calculations for the main study.
• Design the pilot with clear success criteria for recruitment, retention, measurement reliability, and effect-size estimation, then document all protocol deviations to refine the main experiment.
• A pilot study cannot confirm treatment efficacy or provide definitive safety conclusions because sample sizes are small and confidence intervals are wide, so interpret pilot results as directional evidence only.

What Is a Pilot Study in Life Science Research

A pilot study is a small-scale version of a planned experiment that tests whether the research protocol can be executed as designed. In life science research, pilot studies serve three primary purposes: assessing feasibility, refining procedures, and generating preliminary estimates of effect size and variability that inform sample size calculations for the main study.

The distinction between a pilot study and a full study matters for interpretation. A pilot study is not designed to test hypotheses with statistical power. Instead, it answers operational questions such as whether recruitment targets are realistic, whether measurement instruments produce stable readings, whether laboratory assays work under the planned conditions, and whether participants or samples can be retained through the entire protocol.

Researchers often confuse pilot studies with preliminary studies or proof-of-concept experiments. A preliminary study may explore a biological mechanism without a defined protocol for a larger experiment. A pilot study, by contrast, is explicitly linked to a planned main study and produces data that directly inform the design of that larger investigation. The National Library of Medicine Research Methods Resources gateway provides access to biomedical research-method references that describe the distinctions among study types and the role of feasibility testing in experimental design.

The EQUATOR Network maintains reporting guidelines for health research, including guidance for pilot and feasibility studies. These guidelines help researchers report pilot work transparently so that readers can assess whether the pilot adequately addressed the feasibility questions it claimed to answer.

Why Pilot Studies Matter in Experimental Design

Reducing Waste of Resources

Research resources are finite. A full experiment that fails because of recruitment problems, unreliable assays, or unworkable procedures wastes funding, personnel time, and participant goodwill. A pilot study identifies these problems before the main experiment begins, allowing researchers to correct them at a fraction of the cost.

The National Institutes of Health Grants and Funding portal describes the expectations for rigorous experimental design in funded research. Grant reviewers increasingly expect evidence that feasibility questions have been addressed, and a well-designed pilot study provides that evidence. Including pilot data in a grant application demonstrates that the research team has tested the protocol and understands the practical challenges of implementation.

Informing Sample Size Calculations

Sample size calculations require estimates of the expected effect size and the variability of the primary outcome measure. These estimates can come from published literature, but published values often do not match the specific conditions of a new study. A pilot study provides empirical estimates from the actual population, setting, and measurement procedures that will be used in the main experiment.

The pilot data on variability, expressed as the standard deviation of the outcome measure, directly feeds into the sample size formula. Without this estimate, researchers must guess, and an incorrect guess leads to an underpowered study that cannot detect a real effect or an overpowered study that wastes resources.

Testing Protocol Feasibility

Protocols that look reasonable on paper often fail in practice. Equipment may malfunction, assays may produce inconsistent results, participants may not adhere to instructions, and data collection forms may be confusing. A pilot study runs the full protocol on a small scale and reveals these problems.

Feasibility testing covers several domains:

• Recruitment feasibility: Can the target number of participants or samples be obtained within the planned timeframe?
• Retention feasibility: Will participants or samples remain in the study through completion?
• Procedural feasibility: Can laboratory staff execute the protocol reliably?
• Measurement feasibility: Do the instruments and assays produce valid and reliable data?
• Resource feasibility: Are the personnel, equipment, and supplies adequate?

Refining Measurement Instruments

Measurement error reduces statistical power and can bias results. A pilot study allows researchers to assess the reliability and validity of their measurement procedures before committing to a full experiment. Repeated measurements on the same samples or participants reveal the magnitude of measurement error, and comparisons with established methods assess validity.

In the metabolic pilot study of obesity-associated insulin resistance, researchers used untargeted metabolomics on serum samples from 107 subjects to identify phospholipid metabolites that differed between obese insulin-sensitive and obese insulin-resistant individuals. The study authors described their work as pilot data that identified potential novel biomarkers and confirmed known metabolite associations, with further studies warranted to confirm the findings in prospective cohorts. This example illustrates how pilot data can generate hypotheses and identify promising measurement targets while remaining insufficient for definitive conclusions.

Core Principles of Pilot Study Design

Define the Purpose Before Starting

A pilot study must have clearly stated objectives. The objectives determine the sample size, the data collected, and the criteria for success. Common pilot objectives include:

• Estimating the standard deviation of the primary outcome
• Estimating the expected effect size
• Testing recruitment and retention procedures
• Validating measurement instruments
• Assessing protocol adherence
• Identifying safety concerns

Each objective requires different data and different success criteria. A pilot designed to estimate variability needs enough samples to produce a stable standard deviation estimate. A pilot designed to test recruitment feasibility needs to track recruitment rates and reasons for nonparticipation.

Set Explicit Success Criteria

Success criteria define what the pilot must achieve for the main study to proceed as planned. These criteria should be specified before the pilot begins and should be measurable. Examples include:

• Recruitment rate of at least 80 percent of the target within the planned period
• Retention rate of at least 90 percent through the full protocol
• Assay coefficient of variation below a specified threshold
• Protocol adherence rate above a specified percentage
• No serious adverse events attributable to the intervention

The Committee on Publication Ethics Core Practices emphasize the importance of transparent reporting and sound research practices. Specifying success criteria in advance and reporting whether they were met is part of this transparency.

Match the Pilot to the Main Study

The pilot should replicate the main study procedures as closely as possible. If the main study will use a specific assay, the pilot should use that same assay. If the main study will recruit from a specific population, the pilot should recruit from that same population. Deviations between the pilot and the main study reduce the usefulness of the pilot data.

Document Everything

Pilot studies generate valuable information about what works and what does not. This information is lost if it is not documented. Researchers should keep detailed records of:

• Protocol deviations and their reasons
• Equipment problems and their resolutions
• Recruitment challenges and strategies that worked
• Measurement issues and their corrections
• Unexpected observations

This documentation becomes the basis for protocol revisions and provides context for interpreting pilot results.

Sample Size for Pilot Studies

General Guidelines

The sample size for a pilot study depends on its purpose. For feasibility objectives, the sample size is determined by the need to observe the range of practical problems that might occur. For variability estimation, the sample size is determined by the precision needed for the standard deviation estimate.

A common guideline is that pilot studies should include approximately 10 percent of the sample size planned for the main study, but this rule of thumb has limitations. For small main studies, 10 percent may be too few to provide stable estimates. For large main studies, 10 percent may be more than needed.

The National Library of Medicine Research Methods Resources gateway provides access to methodological references that discuss sample size considerations for pilot and feasibility studies. These references emphasize that the precision of the standard deviation estimate depends on the number of observations, not on the proportion of the main study sample.

Precision of Variability Estimates

The standard deviation estimate from a pilot study has uncertainty that depends on the pilot sample size. With 10 observations, the confidence interval for the standard deviation is wide. With 30 observations, the estimate is considerably more precise. Researchers should consider the precision they need for their sample size calculation and choose the pilot sample size accordingly.

For the ergothioneine pilot study in mild cognitive impairment, researchers recruited 19 subjects aged 60 or above for a double-blinded, randomized, placebo-controlled study. Participants received either ergothioneine 25 mg per capsule or placebo three times per week for one year. The study measured blood profiles, renal and liver function markers, neurocognitive performance, plasma ergothioneine levels, and neurodegeneration biomarkers. The authors reported no toxicity and suggested potential benefits in learning ability and neurofilament light chain stabilization, while noting the need for larger confirmatory studies.

This example illustrates a common pattern in pilot research: a small sample that provides directional evidence and safety information but cannot establish efficacy. The 19-subject sample was sufficient to detect major safety problems and to generate preliminary estimates of cognitive outcomes, but the confidence intervals around the effect estimates were wide.

Balancing Precision and Cost

Larger pilot studies provide more precise estimates but cost more time and money. Researchers must balance the value of additional precision against the resources consumed. A pilot that consumes so many resources that it delays or threatens the main study has defeated its purpose.

One practical approach is to conduct the pilot in stages. An initial small pilot tests basic feasibility. If the procedures work, additional pilot data are collected to refine variability estimates. This staged approach allows early termination if fundamental problems emerge.

Data Collection in Pilot Studies

Types of Data to Collect

Pilot studies collect two categories of data: feasibility data and preliminary outcome data.

Feasibility data address operational questions:

• Number of eligible participants or samples identified
• Number enrolled or collected
• Time required for recruitment or collection
• Number of protocol deviations
• Number of missing measurements
• Equipment and supply problems
• Staff training needs

Preliminary outcome data address scientific questions:

• Mean and standard deviation of the primary outcome
• Estimated effect size
• Correlation between repeated measurements
• Relationship between secondary outcomes and the primary outcome

Both categories are essential. Feasibility data determine whether the main study can be conducted. Preliminary outcome data inform the sample size calculation and provide a check on whether the expected effect size is realistic.

Measurement Reliability

Reliability refers to the consistency of measurements. A reliable measurement produces similar results when repeated under the same conditions. Pilot studies can assess reliability by:

• Repeating measurements on the same samples or participants
• Having multiple technicians perform the same measurement
• Comparing results across different instruments or assay batches

The metabolic pilot study used the Metabolon platform for untargeted metabolomics of serum samples. The study identified phospholipid metabolites including choline, glycerophosphoethanolamine, and glycerophosphorylcholine as significantly altered between obese insulin-sensitive and obese insulin-resistant individuals. The authors also confirmed changes in metabolic markers of liver disease, vascular disease, and type 2 diabetes, including 3-hydroxymyristate, dimethylarginine, and 1,5-anhydroglucitol. This work demonstrates how pilot data can identify candidate biomarkers while acknowledging that confirmation requires larger prospective studies.

Data Management

Pilot data should be managed with the same rigor as main study data. This includes:

• Using standardized data collection forms
• Entering data into a secure database
• Performing double data entry or automated validation checks
• Documenting data cleaning procedures
• Storing data in a format that supports analysis

The NIH Data Management and Sharing Policy describes expectations for managing and sharing research data. Even pilot data should be managed according to these principles, as they may be shared or reused in subsequent analyses.

Integrating Pilot Findings into Main Experiment Design

Sample Size Refinement

The most direct use of pilot data is refining the sample size calculation for the main study. The pilot provides estimates of the standard deviation of the primary outcome and the expected effect size. These estimates replace the guesses that would otherwise be used in the sample size formula.

The sample size calculation also requires specification of the significance level, typically 0.05, and the desired power, typically 0.80 or 0.90. The pilot data provide the remaining inputs. Researchers should document the source of all inputs to the sample size calculation so that reviewers can assess the adequacy of the calculation.

Protocol Revision

Pilot findings often lead to protocol revisions. Common revisions include:

• Changing recruitment strategies to improve enrollment
• Modifying inclusion or exclusion criteria to target a more accessible population
• Simplifying data collection procedures to reduce burden
• Adding training for staff on problematic procedures
• Adjusting the frequency or timing of measurements
• Changing the primary outcome if the planned outcome proved difficult to measure

Each revision should be documented with the reason for the change. This documentation helps reviewers understand the evolution of the protocol and provides a record of the evidence supporting the final design.

Feasibility Assessment

The pilot provides direct evidence about whether the main study can be completed as planned. If the pilot reveals insurmountable feasibility problems, the research team may need to redesign the study or abandon it. This outcome, while disappointing, represents a successful pilot because it prevented the waste of resources on an unworkable main study.

The vagus nerve stimulation pilot study provides an example of feasibility assessment in a clinical context. This randomized, multisite, double-blinded, sham-controlled pilot study assessed the safety, feasibility, and potential effects of vagus nerve stimulation paired with rehabilitation for improving arm function after chronic stroke. All 17 participants completed the course of therapy. There were three serious adverse events related to surgery. The authors concluded that the therapy was acceptably safe and feasible and that a pivotal study was justified.

This example illustrates several key points about pilot studies. First, the pilot assessed safety and feasibility directly. Second, the pilot generated preliminary estimates of treatment effects, with the active group showing a 7.6-point improvement in FMA-UE scores at day 1 compared with 5.3 points in the control group. Third, the pilot results justified proceeding to a larger pivotal study despite the wide confidence intervals and nonsignificant differences on some outcomes.

Statistical Considerations

Pilot data should not be combined with main study data for the primary analysis without careful consideration. Combining data can introduce bias if the pilot led to protocol changes. If the protocol was substantially revised after the pilot, the pilot data may not be comparable to the main study data.

Some researchers use pilot data in the main analysis through a design that prespecifies this approach. This strategy requires that the pilot and main study use identical protocols and that the analysis plan accounts for the sequential nature of data collection. The EQUATOR Network provides reporting guidelines that address these design considerations.

At a Glance

Practical Implementation Steps

Step 1: Define the Pilot Objectives

Write a brief document that states the specific questions the pilot will answer. Each objective should be actionable and measurable. For example, instead of stating that the pilot will test the assay, state that the pilot will determine whether the assay achieves a coefficient of variation below 10 percent across three batches.

Step 2: Specify Success Criteria

For each objective, define what success looks like. These criteria become the standard against which pilot results are evaluated. Success criteria should be realistic and based on the requirements of the main study.

Step 3: Determine the Pilot Sample Size

Choose the pilot sample size based on the precision needed for the primary pilot objective. If the objective is variability estimation, consider the width of the confidence interval for the standard deviation. If the objective is feasibility testing, consider the number of observations needed to encounter common procedural problems.

Step 4: Write the Pilot Protocol

The pilot protocol should describe the procedures in enough detail that another researcher could replicate them. Include the recruitment plan, measurement procedures, data collection forms, and analysis plan. The protocol should specify how feasibility data will be recorded and how protocol deviations will be documented.

Step 5: Conduct the Pilot

Execute the pilot according to the protocol. Record all observations, including problems that arise. Document protocol deviations with their reasons. Track recruitment, retention, and measurement quality.

Step 6: Analyze Pilot Data

Analyze the pilot data to address each pilot objective. Calculate the standard deviation of the primary outcome. Estimate the effect size with confidence intervals. Assess recruitment and retention rates. Evaluate measurement reliability. Compare the results to the success criteria.

Step 7: Revise the Main Study Protocol

Use the pilot findings to revise the main study protocol. Update the sample size calculation with the pilot variability estimates. Modify procedures that proved problematic. Document all changes and the reasons for them.

Step 8: Report the Pilot Results

Report the pilot results transparently, including the limitations of the pilot design. The EQUATOR Network provides reporting guidelines that help researchers describe pilot studies completely and accurately. Transparent reporting allows readers to assess whether the pilot adequately addressed its objectives.

Records and Measurements

Essential Records for Pilot Studies

Maintain the following records throughout the pilot study:

• Recruitment log with dates, numbers screened, numbers eligible, and numbers enrolled
• Retention log tracking participants or samples through each protocol stage
• Protocol deviation log with descriptions and reasons
• Equipment maintenance and calibration records
• Assay batch records with quality control results
• Data collection forms with version dates
• Staff training records

These records serve multiple purposes. They document the feasibility of the main study procedures. They provide the data needed to calculate recruitment and retention rates. They create an audit trail that supports the integrity of the pilot results.

Key Measurements to Track

The specific measurements depend on the pilot objectives, but common measurements include:

• Recruitment rate: number enrolled divided by the recruitment period
• Retention rate: number completing the protocol divided by number enrolled
• Protocol adherence: proportion of protocol steps completed correctly
• Measurement reliability: coefficient of variation or intraclass correlation coefficient
• Outcome variability: standard deviation of the primary outcome
• Effect size estimate: difference between groups divided by the standard deviation

The NIH Data Management and Sharing Policy describes expectations for managing research data throughout the research lifecycle. Pilot data should be organized, documented, and stored in ways that support analysis, sharing, and reuse.

Example Record Table for Pilot Tracking

Common Failure Patterns in Pilot Studies

Overinterpreting Pilot Results

The most common failure in pilot studies is treating the results as if they came from a fully powered study. Pilot studies have small samples and wide confidence intervals. A nonsignificant difference in a pilot does not mean the intervention is ineffective. A significant difference in a pilot does not mean the intervention is effective. Pilot results are directional evidence that informs the design of the main study, not evidence of efficacy.

The vagus nerve stimulation pilot study illustrates this point. The difference in FMA-UE scores at day 1 was 2.3 points with a confidence interval from -1.8 to 6.4 and a P value of 0.20. At day 90, the difference was 5.7 points with a confidence interval from -1.4 to 11.5 and a P value of 0.055. Neither difference reached conventional statistical significance, yet the authors concluded that a pivotal study was justified based on the pattern of results and the feasibility data.

Using Pilot Data for Hypothesis Testing

Pilot studies are not designed to test hypotheses. The sample size is too small to provide adequate statistical power, and the primary purpose is feasibility assessment. Researchers who conduct formal hypothesis tests on pilot data risk drawing conclusions that the data cannot support.

Ignoring Feasibility Data

Some researchers focus exclusively on the outcome data from their pilot and ignore the feasibility data. This is a mistake. The feasibility data are often the most valuable product of the pilot because they determine whether the main study can be conducted. A pilot that produces promising outcome data but reveals serious feasibility problems has not achieved its purpose.

Making Major Protocol Changes Without Documentation

Protocol changes are expected after a pilot, but they must be documented. Undocumented changes create confusion about what was actually done and undermine the credibility of the main study. Each change should be recorded with its rationale and the date it was made.

Failing to Prespecify Success Criteria

Without prespecified success criteria, researchers can rationalize any pilot outcome as acceptable. Prespecified criteria provide an objective standard for deciding whether to proceed with the main study, modify the protocol, or abandon the study.

Underestimating the Time Required

Pilot studies take time, and researchers often underestimate how much. Recruitment, measurement, and data analysis all take longer than expected. Building extra time into the pilot schedule reduces the risk of delaying the main study.

Limitations of Pilot Studies

Small Sample Sizes

The fundamental limitation of pilot studies is the small sample size. Small samples produce imprecise estimates. The standard deviation estimate from a small pilot may differ substantially from the true standard deviation, leading to an inaccurate sample size calculation for the main study.

Publication Bias

Pilot studies with null or negative results are less likely to be published than pilots with promising results. This publication bias means that the available pilot literature may overrepresent positive findings. Researchers should be cautious when using published pilot results to inform their own study designs.

Context Specificity

Pilot results are specific to the population, setting, and procedures used. A pilot conducted in one laboratory or with one population may not generalize to another. Researchers should consider whether their pilot conditions match the conditions of the planned main study.

Inability to Detect Rare Events

Pilot studies cannot detect rare adverse events or rare procedural problems. If an event occurs in 1 percent of cases, a pilot with 20 participants has only an 18 percent chance of observing it. Safety monitoring must continue into the main study.

Ethical Considerations

Pilot studies involving human participants or animals raise ethical considerations. Participants in a pilot study may not receive direct benefit, so the risks must be justified by the potential knowledge gained. The Committee on Publication Ethics Core Practices address the ethical conduct of research, including the responsible reporting of research findings.

Safety and Regulatory Context

Biosafety Considerations

Pilot studies in life science research often involve biological samples, potentially hazardous reagents, or laboratory procedures that carry biosafety risks. The World Health Organization Laboratory Biosafety Manual provides guidance on safe handling of biological materials. Researchers should conduct a risk assessment before beginning pilot work and should follow institutional biosafety requirements.

Human Subjects Protection

Pilot studies involving human participants require ethical approval from an institutional review board. The pilot protocol must describe the procedures, risks, and benefits, and participants must provide informed consent. Even small pilot studies are subject to these requirements.

Data Management and Sharing

The NIH Data Management and Sharing Policy describes expectations for managing and sharing research data. Pilot data should be managed according to these expectations, including documentation of data collection procedures, data storage, and plans for sharing.

Researcher Identity and Record Keeping

The ORCID for Researchers resource describes how researchers can maintain a persistent identifier that links their publications, datasets, and other research outputs. Maintaining an accurate research record is part of responsible research conduct and supports transparency in reporting pilot studies.

Professional Escalation Criteria

When to Consult a Biostatistician

Consult a biostatistician when:

• The sample size calculation for the main study requires more sophisticated methods than a simple formula
• The pilot data suggest that the planned analysis approach may not be appropriate
• The outcome data have unusual distributions or missing data patterns
• The study design involves clustering, repeated measures, or multiple endpoints

A biostatistician can help interpret pilot variability estimates and ensure that the sample size calculation for the main study is appropriate.

When to Consult an Ethics Committee

Consult an ethics committee when:

• The pilot reveals unexpected risks to participants
• Protocol changes after the pilot substantially alter the risk-benefit profile
• The pilot involves vulnerable populations
• The pilot data suggest that the main study may not be feasible, raising questions about whether continued enrollment is justified

When to Consult Institutional Biosafety

Consult institutional biosafety personnel when:

• The pilot involves novel biological agents or genetic modifications
• Laboratory procedures change in ways that affect exposure risk
• The pilot reveals problems with existing safety protocols
• New equipment or reagents introduce unfamiliar hazards

When to Consider Stopping the Main Study

Consider stopping or redesigning the main study when:

• The pilot reveals recruitment rates that make the main study timeline unrealistic
• The pilot shows that the primary outcome cannot be measured reliably
• The pilot detects safety concerns that cannot be adequately addressed
• The pilot data suggest that the expected effect size is much smaller than assumed, requiring a sample size that exceeds available resources

Mermaid Flowchart: Pilot Study Decision Path

flowchart TD
    A[Define pilot objectives] --> B[Specify success criteria]
    B --> C[Determine pilot sample size]
    C --> D[Write pilot protocol]
    D --> E[Conduct pilot study]
    E --> F[Analyze feasibility and outcome data]
    F --> G{Success criteria met?}
    G -->|Yes| H[Proceed to main study with refined protocol]
    G -->|No| I{Problems correctable?}
    I -->|Yes| J[Revise protocol and consider additional pilot]
    J --> E
    I -->|No| K[Redesign or abandon main study]

This decision path shows the logical flow from pilot objectives through data collection to the decision point where success criteria determine whether the main study proceeds. The path includes a feedback loop for correctable problems and a terminal branch for problems that cannot be resolved.

Reporting Pilot Studies

Transparency in Reporting

The EQUATOR Network provides access to reporting guidelines that help researchers report pilot and feasibility studies transparently. Transparent reporting includes describing the pilot objectives, the sample size and how it was determined, the success criteria, the results for each objective, and the limitations of the pilot.

Reporting Feasibility Outcomes

Feasibility outcomes should be reported with the same detail as outcome data. Report recruitment rates, retention rates, protocol adherence, and measurement reliability. These data allow readers to assess whether the main study is likely to be feasible.

Reporting Outcome Estimates

Outcome estimates from pilot studies should be reported with confidence intervals to convey the uncertainty inherent in small samples. The National Library of Medicine Research Methods Resources gateway provides access to references on statistical reporting in biomedical research.

Publication Ethics

The Committee on Publication Ethics Core Practices describe expectations for authorship, peer review, data integrity, and conflict of interest disclosure. These practices apply to pilot studies as they do to full studies. Researchers should ensure that all contributors meet authorship criteria, that data are reported accurately, and that conflicts of interest are disclosed.

Reporting Standards for Pilot Data

The EQUATOR Network also provides guidance on selecting the appropriate reporting guideline for a given study type. For pilot and feasibility studies, specific reporting checklists help authors include all essential elements, such as how the sample size was determined, what feasibility outcomes were measured, and how the results will inform the main study. Using these checklists during manuscript preparation reduces the risk of omitting critical information that reviewers and readers need to evaluate the pilot.

Frequently Asked Questions

What is the difference between a pilot study and a feasibility study?

A pilot study is a small-scale version of the planned main study that tests the full protocol, including recruitment, measurement, and intervention procedures. A feasibility study asks whether the main study can be done at all, focusing on questions such as whether the target population exists, whether the necessary resources are available, and whether the procedures are acceptable. In practice, the terms overlap, and many small studies address both feasibility and pilot objectives. The EQUATOR Network provides reporting guidelines that clarify the distinction and help researchers report each type appropriately.

How many participants or samples should a pilot study include?

The sample size for a pilot study depends on its objectives. For feasibility objectives, the sample should be large enough to encounter common procedural problems, often 10 to 30 participants or samples. For variability estimation, the sample should be large enough to provide a reasonably precise standard deviation estimate, which may require 20 to 30 or more observations. The National Library of Medicine Research Methods Resources gateway provides access to methodological references that discuss sample size considerations for pilot studies in more detail.

Can pilot data be included in the main study analysis?

Pilot data can be included in the main study analysis only if the pilot and main study use identical protocols and the analysis plan prespecifies this approach. If the pilot led to protocol changes, the pilot data may not be comparable to the main study data, and combining them can introduce bias. Researchers should consult a biostatistician before deciding whether to include pilot data in the main analysis.

What should I do if the pilot study shows no effect?

A pilot study showing no effect does not mean the intervention is ineffective. The small sample size means the study has low power to detect a real effect. The pilot may have produced an imprecise estimate of the true effect, and the confidence interval likely includes clinically meaningful values. Use the pilot data to refine the sample size calculation for the main study, and consider whether the pilot procedures adequately tested the intervention.

How do I use pilot data to calculate sample size for the main study?

Use the pilot data to estimate the standard deviation of the primary outcome and the expected effect size. These estimates become inputs to the sample size formula along with the desired significance level and power. Because pilot estimates are imprecise, consider using the upper bound of the confidence interval for the standard deviation to ensure adequate power. A biostatistician can help with this calculation.

What are the most common mistakes in pilot study design?

The most common mistakes are treating pilot results as definitive evidence of efficacy, using the pilot for formal hypothesis testing, ignoring feasibility data, making protocol changes without documentation, and failing to prespecify success criteria. Avoiding these mistakes requires a clear understanding of the pilot purpose and disciplined execution of the pilot protocol.

Do pilot studies require ethical approval?

Pilot studies involving human participants require ethical approval from an institutional review board, just as full studies do. The pilot protocol must describe the procedures, risks, and benefits, and participants must provide informed consent. Pilot studies involving animals or biological materials may also require institutional approval depending on the nature of the work.

How should I report a pilot study?

Report the pilot study transparently, including the objectives, sample size and how it was determined, success criteria, results for each objective, and limitations. The EQUATOR Network provides reporting guidelines that help researchers describe pilot studies completely. Report feasibility outcomes such as recruitment and retention rates alongside outcome estimates with confidence intervals.

Related Diagnostic Guides

• RNA Sequencing Protocol: From Sample to Data
• Clinical Chemistry Interference Studies: Design and Interpretation
• Clinical Chemistry Case Studies: Applying Laboratory Data to Patient Care
• dNTPs in PCR: Role, Concentration, and Optimization
• Multiplex PCR: Design, Optimization, and Troubleshooting

References and Further Reading

• Research Methods Resources. National Library of Medicine.
• EQUATOR Network. EQUATOR Network.
• Core Practices. Committee on Publication Ethics.
• NIH Grants and Funding. National Institutes of Health.
• ORCID for Researchers. ORCID.
• Data Management and Sharing Policy. National Institutes of Health.
• Laboratory Biosafety Manual. World Health Organization.
• NCBI Literature Resources. National Center for Biotechnology Information.
• Vagus Nerve Stimulation Paired With Upper Limb Rehabilitation After Chronic Stroke.. Stroke, 2018.
• Metabolic signature of obesity-associated insulin resistance and type 2 diabetes.. Journal of translational medicine, 2019.
• Investigating the efficacy of ergothioneine to delay cognitive decline in mild cognitively impaired subjects: A pilot study.. Journal of Alzheimer's disease : JAD, 2024.

This article is educational and does not replace validated laboratory procedures, institutional biosafety review, manufacturer instructions, or professional interpretation.