Screening Designs in Life Science Research

By Dr. Zubair Khalid, DVM, MS, PhD ·

Screening Designs in Life Science Research

Quick Answer

  • Choose Plackett-Burman designs when screening more than five factors with limited runs and you accept that two-factor interactions will be aliased with main effects.
  • Choose fractional factorial designs when you need clearer confounding patterns and the ability to estimate specific two-factor interactions with a moderate increase in run count.
  • Both designs require confirmation experiments because screening results identify candidate factors, not validated biological mechanisms.

At a Glance

Decision PointPlackett-Burman DesignFractional Factorial Design
Typical run count for 7 factors12 runs minimum16 runs for a 2^(7-3) resolution IV design
Main effect confoundingMain effects partially aliased with two-factor interactionsMain effects clear of two-factor interactions in resolution IV designs
Interaction estimationNot designed for interaction estimationCan estimate specific two-factor interactions depending on resolution
Best use caseInitial screening with many factors and limited resourcesScreening when interaction structure matters or factors are expensive to change
Risk of misinterpretationHigh if you assume significant effects are purely main effectsLower if you select the correct resolution for your question
Follow-up requirementConfirmation runs or a second designConfirmation runs still recommended

Why Screening Design Choice Matters in Life Science Research

Life science experiments routinely involve many candidate factors. A cell culture protocol may depend on temperature, pH, seeding density, serum concentration, growth factor level, oxygen tension, and incubation time. A fermentation study may need to test media components, inoculum size, agitation rate, and inducer concentration. Testing each factor one at a time consumes reagents, time, and biological material while failing to reveal interactions between factors. Screening designs address this problem by allowing you to examine many factors in a relatively small number of experimental runs.

The choice between Plackett-Burman and fractional factorial designs is a practical decision that affects how much you can learn from your initial experiments. The two approaches differ in run efficiency, confounding patterns, and the ability to estimate interactions. These differences matter because the conclusions you draw from a screening experiment shape the follow-up experiments you design. A poorly chosen screening design can lead you to abandon a factor that is actually important or to chase an effect that is an artifact of confounding.

The National Library of Medicine provides access to authoritative biomedical research methods references that can help you understand the statistical foundations of experimental design. The Research Methods Resources gateway links to books and guides that cover design of experiments, statistical analysis, and reproducibility in biomedical research. These resources are useful when you need to verify the statistical assumptions behind a particular design choice.

Core Principles of Screening Designs

The Purpose of Screening

Screening designs serve a specific role in the experimental workflow. They are not intended to produce final answers about the magnitude of factor effects. They are intended to identify which factors among a larger set deserve further investigation. A screening experiment asks a simple question: which of these factors appears to influence the response?

This purpose shapes the design choices you make. Because screening is about identifying candidates, you can tolerate some uncertainty about the exact size of effects. You cannot tolerate uncertainty about which factors matter. The design must therefore be sensitive enough to detect effects of practical interest while being efficient enough to complete within your resource limits.

The Role of Randomization and Replication

Randomization is a core principle of experimental design. It ensures that the assignment of experimental units to treatment combinations is not systematically biased by uncontrolled variables. In a cell culture experiment, randomization might mean assigning wells to treatment combinations in a random order instead of processing them in a systematic sequence. This protects against time-dependent drift in your equipment or reagents.

Replication provides an estimate of experimental error. Without replication, you cannot distinguish real factor effects from random variation. The number of replicates you need depends on the variability of your system and the size of the effect you want to detect. Screening designs often use fewer replicates than confirmatory experiments because the goal is to identify candidates, not to precisely estimate effects.

The Concept of Confounding

Confounding occurs when the effect of one factor cannot be separated from the effect of another factor. In screening designs, confounding is a deliberate tradeoff. You accept that some effects will be mixed together so that you can test more factors in fewer runs.

The pattern of confounding is described by the resolution of the design. A resolution III design has main effects confounded with two-factor interactions. A resolution IV design has main effects clear of two-factor interactions but two-factor interactions confounded with each other. A resolution V design has main effects and two-factor interactions clear of each other.

The resolution of a design determines what you can and cannot learn from it. If you need to know whether a specific interaction exists, you need a design with sufficient resolution to estimate that interaction. If you only need to know which main effects are active, a lower resolution design may be acceptable.

Plackett-Burman Designs

Design Structure and Run Efficiency

Plackett-Burman designs are two-level fractional factorial designs that allow you to study up to N-1 factors in N runs, where N is a multiple of 4. The most common Plackett-Burman designs use 12, 20, 24, and 28 runs. A 12-run Plackett-Burman design can screen up to 11 factors. A 20-run design can screen up to 19 factors.

The run efficiency of Plackett-Burman designs is their main advantage. For example, a full factorial design with 7 factors at two levels requires 128 runs. A fractional factorial design might require 16 runs. A Plackett-Burman design can screen 7 factors in 12 runs. This efficiency makes Plackett-Burman designs attractive when you have many factors and limited resources.

Confounding Patterns in Plackett-Burman Designs

The confounding pattern in Plackett-Burman designs is more complex than in fractional factorial designs. In a Plackett-Burman design, main effects are partially confounded with two-factor interactions. This means that the estimate of a main effect includes contributions from some two-factor interactions.

The practical consequence is that you cannot be certain whether a large estimated effect for a factor is due to the factor itself or due to an interaction involving that factor. This is a serious limitation when you are studying factors that are likely to interact. In biological systems, interactions are common. A factor that has no main effect but participates in an interaction can appear to have a main effect in a Plackett-Burman design.

When to Use Plackett-Burman Designs

Plackett-Burman designs are appropriate when you have many factors, typically more than five, and you want to reduce the number of runs. They are also appropriate when you have no prior evidence that interactions are important. If you are screening a set of factors that you expect to act independently, the confounding of main effects with interactions is less of a concern.

Plackett-Burman designs are also useful when you need to screen factors in a preliminary stage before a more detailed experiment. The results of a Plackett-Burman screening can identify the factors that show the largest effects. You can then follow up with a design that is better suited to estimating interactions among the factors that matter.

Limitations of Plackett-Burman Designs

The main limitation of Plackett-Burman designs is the inability to estimate interactions. The partial confounding of main effects with two-factor interactions means that you cannot separate a main effect from an interaction. If you observe a large effect for a factor, you cannot know whether the effect is due to the factor alone or to an interaction with another factor.

Another limitation is that Plackett-Burman designs do not provide an estimate of pure experimental error unless you include center points or replicate runs. Without an estimate of error, you cannot perform formal significance tests. You must rely on the relative size of effects to identify important factors.

Fractional Factorial Designs

Design Characteristics and Run Efficiency

Fractional factorial designs are a systematic way to reduce the number of runs in a factorial experiment. A full factorial design with k factors at two levels requires 2^k runs. A fractional factorial design uses a fraction of these runs, typically 1/2, 1/4, 1/8, or a smaller fraction.

The notation for fractional factorial designs describes the fraction and the resolution. A 2^(7-4) design is a half-fraction of a 7-factor design, requiring 16 runs. A 2^(7-4) design is a 1/16 fraction, requiring 8 runs. The resolution of the design is indicated by a Roman numeral. A resolution IV design has main effects clear of two-factor interactions. A resolution V design has main effects and two-factor interactions clear of each other.

Confounding Patterns in Fractional Factorial Designs

The confounding pattern in fractional factorial designs is determined by the defining relation of the design. The defining relation specifies which interactions are confounded with the identity. The resolution of the design is the length of the shortest word in the defining relation.

In a resolution IV design, the main effects are not confounded with two-factor interactions. This is a significant advantage over Plackett-Burman designs. However, two-factor interactions are confounded with each other. This means you can estimate main effects cleanly, but you cannot estimate specific two-factor interactions.

In a resolution V design, the main effects and two-factor interactions are not confounded with each other. This allows you to estimate both main effects and two-factor interactions. The cost is a larger number of runs. A resolution V design for 7 factors requires 64 runs.

When to Use Fractional Factorial Designs

Fractional factorial designs are appropriate when you need to estimate main effects cleanly or when you need to estimate specific interactions. If you have prior knowledge that interactions are important, a fractional factorial design with sufficient resolution is a better choice than a Plackett-Burman design.

Fractional factorial designs are also appropriate when you want to use the results of the screening experiment to build a model. The clean estimation of main effects in a resolution IV design allows you to fit a main-effects model. The estimation of interactions in a resolution V design allows you to fit a model with interactions.

Limitations of Fractional Factorial Designs

The main limitation of fractional factorial designs is the run count. A resolution IV design for 7 factors requires 16 runs, compared to 12 runs for a Plackett-Burman design. A resolution V design requires 32 runs. This increase in run count can be significant when each run is expensive or time-consuming.

Another limitation is that the confounding pattern of a fractional factorial design is not always easy to understand. The design matrix must be constructed carefully to ensure the desired resolution. Errors in the design matrix can lead to unexpected confounding.

Comparing Plackett-Burman and Fractional Factorial Designs

Run Efficiency Comparison

The run efficiency of the two designs depends on the number of factors and the desired resolution. For a given number of factors, a Plackett-Burman design requires fewer runs than a fractional factorial design with resolution IV or higher. For example, for 7 factors, a Plackett-Burman design requires 12 runs, while a resolution IV fractional factorial design requires 16 runs.

The difference in run count becomes more significant as the number of factors increases. For 11 factors, a Plackett-Burman design requires 12 runs, while a resolution IV fractional factorial design requires 32 runs. The Plackett-Burman design is more efficient in terms of runs per factor.

Confounding Pattern Comparison

The confounding pattern is the most important difference between the two designs. In a Plackett-Burman design, main effects are partially confounded with two-factor interactions. In a resolution IV fractional factorial design, main effects are clear of two-factor interactions.

This difference has practical consequences. If you use a Plackett-Burman design and observe a large effect for a factor, you cannot know whether the effect is due to the factor itself or to an interaction. If you use a resolution IV fractional factorial design, you can be confident that the main effect is not due to a two-factor interaction.

Interaction Estimation Comparison

Plackett-Burman designs are not designed to estimate interactions. The confounding pattern does not allow you to separate individual two-factor interactions. Fractional factorial designs can estimate interactions if the resolution is sufficient. A resolution V design can estimate all two-factor interactions.

The ability to estimate interactions is important in biological systems where factors often interact. For example, the effect of a drug may depend on the concentration of a nutrient. The effect of a temperature may depend on the pH of the medium. If you suspect such interactions, you need a design that can estimate them.

Resource and Cost Considerations

The choice between the two designs also depends on the cost of each run. If each run is expensive, you may want to use a Plackett-Burman design to minimize the number of runs. If each run is inexpensive, you may want to use a fractional factorial design to get more information.

The cost of a run includes the cost of materials, the cost of labor, and the cost of time. In a cell culture experiment, each run may require a new batch of cells, a new set of plates, and several days of incubation. In a fermentation experiment, each run may require a new batch of medium and a new fermentation vessel.

Practical Workflow for Screening Design Selection

Step 1: Define the Factors and Response

The first step is to define the factors you want to screen and the response you want to measure. The factors should be the variables that you suspect may affect the response. The response should be a measurable quantity that reflects the outcome of interest.

For a cell culture experiment, the factors might include medium composition, serum concentration, seeding density, and incubation time. The response might be cell viability, cell count, or protein expression. For a fermentation experiment, the factors might include temperature, pH, nutrient concentration, and agitation rate. The response might be product yield, biomass, or substrate consumption.

Step 2: Determine the Number of Factors

The number of factors determines the minimum number of runs required for each design. For a Plackett-Burman design, the number of runs is the next multiple of 4 that is greater than the number of factors. For a fractional factorial design, the number of runs is a power of 2 that is sufficient for the desired resolution.

You should also consider the number of center points you want to include. Center points are runs at the midpoint of the factor ranges. They provide an estimate of experimental error and allow you to test for curvature in the response.

Step 3: Choose the Design Based on Your Prior Knowledge

Your prior knowledge about the factors and their interactions should guide your design choice. If you have no prior knowledge about interactions, a Plackett-Burman design may be sufficient. If you suspect that interactions are important, you should use a fractional factorial design with sufficient resolution.

The prior knowledge can come from the literature, from previous experiments, or from your understanding of the biological system. For example, if you know that a particular nutrient interacts with another nutrient, you should use a design that can estimate that interaction.

Step 4: Generate the Design Matrix

The design matrix specifies the settings of each factor for each run. You can generate the design matrix using statistical software or by hand. The design matrix must be generated carefully to ensure that the confounding pattern is correct.

For a Plackett-Burman design, the design matrix is generated from a specific pattern of plus and minus signs. For a fractional factorial design, the design matrix is generated from the defining relation. Errors in the design matrix can lead to incorrect confounding patterns.

Step 5: Conduct the Experiment

Conduct the experiment according to the design matrix. Randomize the order of the runs to reduce the effect of time-dependent variables. Replicate the runs if you need an estimate of experimental error.

During the experiment, record all observations and any deviations from the protocol. Deviations can affect the results and should be documented. The documentation is important for the interpretation of the results.

Step 6: Analyze the Results

Analyze the results using the appropriate statistical methods. For a Plackett-Burman design, you can estimate the main effects and rank them by magnitude. For a fractional factorial design, you can estimate the main effects and interactions and test their significance.

The analysis should include a check for the assumptions of the statistical model. The residuals should be normally distributed and have constant variance. If the assumptions are violated, you may need to transform the response or use a different analysis method.

Step 7: Interpret and Confirm

Interpret the results in the context of your biological question. The factors with the largest effects are candidates for further investigation. The factors with small effects can be set to a fixed level in future experiments.

The results of a screening experiment should be confirmed with follow-up experiments. The confirmation experiments should focus on the factors that appeared important in the screening. The confirmation experiments should be designed to estimate the effects more precisely and to test for interactions.

Records and Measurements in Screening Experiments

What to Record

The records from a screening experiment should include the design matrix, the observed responses, and any deviations from the design. The design matrix should be recorded in a format that allows the analysis to be reproduced. The observed responses should be recorded with the units of measurement.

The records should also include information about the experimental conditions. This includes the date and time of each run, the equipment used, the batch of reagents, and the operator. This information is important for identifying sources of variation.

How to Measure the Response

The response should be measured using a method that is reliable and reproducible. The measurement method should be validated before the experiment. The validation should include an assessment of the precision and accuracy of the measurement.

The measurement should be recorded with the appropriate number of significant figures. The precision of the measurement should be consistent with the precision of the design. If the measurement is imprecise, the design may not be able to detect the effects of interest.

How to Record Deviations

Deviations from the design should be recorded as they occur. A deviation is any change from the planned experimental conditions. Examples include a change in the incubation time, a change in the temperature, or a change in the reagent batch.

The deviation should be recorded with the time and the nature of the deviation. The deviation should be considered in the analysis. If the deviation is significant, the run may need to be repeated.

Common Failure Patterns in Screening Experiments

Failure to Define the Response Clearly

A common failure is to define the response in a way that is not measurable or not reproducible. For example, if the response is subjective, such as the appearance of a culture, the measurement may be inconsistent. The response should be defined in a way that can be measured objectively.

Failure to Include Center Points

The failure to include center points is a common problem in screening experiments. Center points provide an estimate of experimental error and allow you to test for curvature. Without center points, you cannot estimate the error and you cannot test for curvature.

Failure to Randomize the Runs

The failure to randomize the runs is a common problem. If the runs are not randomized, the results may be affected by time-dependent variables. For example, if the temperature increases over time, the runs at the end of the experiment may be different from the runs at the beginning.

Failure to Consider Interactions

The failure to consider interactions is a common problem in the interpretation of screening experiments. If you use a Plackett-Burman design, you cannot estimate interactions. If you observe a large effect for a factor, you may incorrectly attribute the effect to the factor alone when it is actually due to an interaction.

Failure to Confirm the Results

The failure to confirm the results is a common problem. Screening experiments are designed to identify candidate factors, not to prove the effects. The results should be confirmed with follow-up experiments. The follow-up experiments should be designed to estimate the true effects and to test for interactions.

Quality Controls and Reproducibility

The Role of Reporting Guidelines

Reporting guidelines help you report your experiments in a way that is transparent and reproducible. The EQUATOR Network provides a collection of reporting guidelines for different types of research. These guidelines help you report the methods and results of your experiments in a way that is complete and accurate.

The use of reporting guidelines is important for the reproducibility of your experiments. A well-reported experiment can be replicated by other researchers. A poorly reported experiment cannot be replicated, which limits the value of the results.

The Role of Data Management

Data management is important for the reproducibility of your experiments. The data from your screening experiment should be stored in a format that is accessible and understandable. The data should be documented with the metadata that describes the experimental conditions.

The NIH Data Management and Sharing Policy describes the expectations for data management and sharing in NIH-funded research. The policy requires that data be managed and shared in a way that is consistent with the principles of reproducibility. The policy also requires that data management plans be included in grant applications.

The Role of Researcher Identity

Researcher identity is important for the attribution of research results. The ORCID system provides a unique identifier for researchers. The identifier allows you to link your research outputs to your identity. This is important for the transparency of the research process.

The use of ORCID is important for the reproducibility of your experiments. The identifier allows other researchers to find your experiments and to understand the context of your results. The identifier also allows you to track your own research outputs.

Safety and Regulatory Context

Biosafety Considerations

Screening experiments in life science research may involve biological materials that require biosafety precautions. The precautions depend on the nature of the materials and the level of risk. The precautions should be described in the experimental protocol.

The biosafety precautions should be applied to the handling of the biological materials, the disposal of the waste, and the decontamination of the equipment. The precautions should be consistent with the institutional biosafety policies.

Ethical Considerations

The ethical considerations in screening experiments depend on the nature of the research. The research should be conducted in a way that is consistent with the ethical principles of the institution. The ethical considerations should be included in the experimental protocol.

The ethical considerations include the use of human or animal subjects, the use of hazardous materials, and the use of data. The ethical considerations should be reviewed by the appropriate institutional committee.

Professional Escalation Criteria

The professional escalation criteria are the conditions under which you should seek help from a more experienced researcher. The criteria include the following:

  • You are uncertain about the design of the experiment.
  • You are uncertain about the analysis of the results.
  • You observe unexpected results that you cannot explain.
  • You observe a safety issue that you cannot resolve.

The escalation should be done in a timely manner. The escalation should include a description of the problem and the context. The escalation should be done to the appropriate person.

A Practical Decision Framework for Screening Design Selection

The Screening Design Decision Matrix

Choosing between Plackett-Burman and fractional factorial designs requires a structured approach that goes beyond simple run counts. The decision framework below organizes the key considerations into a sequence of questions that map directly to your experimental constraints and scientific objectives.

The first question is the number of factors you need to screen. This sets the minimum run count for each design option. The second question is whether you have prior evidence that two-factor interactions exist among your candidate factors. The third question is the cost per experimental run. The fourth question is whether you need a formal significance test or whether ranking effects by magnitude is sufficient.

For a seven-factor experiment, the decision matrix works as follows. If you have no prior evidence of interactions and each run costs more than a threshold you define based on your budget, the Plackett-Burman design in 12 runs is the efficient choice. If you suspect that two or more factors may interact, the resolution IV fractional factorial design in 16 runs gives you clean main effects. If you need to estimate specific two-factor interactions, you need a resolution V design, which for seven factors requires 64 runs.

The decision matrix becomes more nuanced when the number of factors is not a power of two. For example, screening six factors with a fractional factorial design requires a 2^(6-2) design in 16 runs at resolution IV. A Plackett-Burman design for six factors also requires 12 runs. The run count difference is four runs, which may be acceptable if you need clean main effects.

For eleven factors, the difference is more pronounced. A Plackett-Burman design requires 12 runs. A resolution IV fractional factorial design requires 32 runs. The 20-run difference is substantial when each run involves cell culture preparation, incubation time, and assay costs. In this case, the Plackett-Burman design is the practical choice unless you have strong evidence that interactions are present.

The Interaction Risk Assessment

The interaction risk assessment is the most important step in the decision framework. You must evaluate the likelihood that two-factor interactions are present in your biological system before you choose a design. This assessment draws on your knowledge of the system, the published literature, and any preliminary data you have collected.

For cell culture experiments, common interaction risks include the interaction between serum concentration and seeding density. Higher serum levels may support higher cell densities, but the effect of serum may depend on how many cells you plate. Another common interaction is between temperature and pH, where the optimal temperature may shift with the pH of the medium. If you have any reason to suspect such interactions, the Plackett-Burman design will not allow you to detect them.

For fermentation experiments, the interaction between nutrient concentration and agitation rate is a common concern. Higher agitation increases oxygen transfer, which may change the effect of a carbon source. The interaction between inducer concentration and temperature can also be important in recombinant protein production. If these interactions are plausible, the resolution IV fractional factorial design is the safer choice because it keeps main effects clear of two-factor interactions.

The interaction risk assessment should be documented in your experimental records. The documentation should state which interactions you considered plausible and why. This documentation is useful when you interpret the results and when you design follow-up experiments. The National Library of Medicine provides access to research methods references that can help you understand the biological basis of interactions in your specific system. The Research Methods Resources gateway links to books that cover experimental design in biomedical research.

The Run Cost Threshold

The run cost threshold is the point at which the additional runs of a fractional factorial design become unacceptable. You should calculate the total cost of each design option before you choose. The total cost includes materials, labor, equipment time, and the opportunity cost of the time spent on the experiment.

For a cell culture experiment, the cost of a run includes the culture medium, the serum, the plates or flasks, the incubation time, and the assay reagents. For a fermentation experiment, the cost includes the medium, the inoculum, the fermentation vessel time, and the analytical measurements. You should estimate the cost per run and multiply by the number of runs for each design option.

The run cost analysis should also include the cost of a confirmation experiment. Both designs require confirmation runs. The confirmation experiment for a Plackett-Burman design may need to be larger because you need to resolve the confounding between main effects and interactions. The confirmation experiment for a resolution IV fractional factorial design can focus on the main effects that appeared important.

The run cost analysis should be recorded in a table that compares the total cost of each design option. The table should include the number of runs, the cost per run, the total cost, and the information gained. This table helps you make a transparent decision that you can justify to your collaborators or your funding agency.

The Significance Testing Requirement

The significance testing requirement is the fourth decision criterion. Plackett-Burman designs do not provide an estimate of pure experimental error unless you include center points or replicate runs. Without an estimate of error, you cannot perform formal significance tests. You must rely on the relative size of effects to identify important factors.

Fractional factorial designs can provide an estimate of error if you include center points or replicates. The estimate of error allows you to perform formal significance tests. This is important when you need to report p-values or confidence intervals for your effects.

If your research requires formal significance testing, the fractional factorial design is the better choice. If you only need to rank the factors by the size of their effects, the Plackett-Burman design is sufficient. The requirement for significance testing is often determined by the expectations of your field, your funding agency, or your publication target.

The NIH Grants and Funding website provides information about the expectations for experimental design and statistical analysis in NIH-funded research. The NIH Grants and Funding portal describes the review criteria for grant applications, which include the soundness of the experimental design. If your grant application describes a screening experiment, the reviewers will expect you to justify your design choice.

The Decision Framework in Practice

The decision framework can be applied in a structured sequence. First, list your factors and the response. Second, count the number of factors. Third, assess the interaction risk based on your knowledge of the system. Fourth, calculate the run cost for each design option. Fifth, determine whether you need formal significance testing.

The framework produces one of three recommendations. The first recommendation is a Plackett-Burman design when you have more than five factors, no prior evidence of interactions, high run cost, and no requirement for formal significance testing. The second recommendation is a resolution IV fractional factorial design when you have more than five factors, some risk of interactions, moderate run cost, and a requirement for clean main effects. The third recommendation is a resolution V fractional factorial design when you have fewer than six factors, strong evidence of interactions, and a need to estimate specific two-factor interactions.

The framework should be applied before you generate the design matrix. The decision should be recorded in your laboratory notebook or electronic records. The record should include the number of factors, the interaction risk assessment, the run cost analysis, and the chosen design. This record is useful when you write the methods section of your report and when you respond to reviewer comments.

The Confirmation Experiment Plan

The confirmation experiment plan is a distinct component of the decision framework. Both designs require confirmation experiments, but the confirmation plan differs depending on the design you chose. The confirmation plan should be written before you conduct the screening experiment, not after you see the results.

For a Plackett-Burman design, the confirmation experiment should be designed to resolve the interactions that may have contributed to the observed main effects. The confirmation experiment should focus on the factors that showed the largest effects in the screening. The confirmation experiment should use a design that can estimate the two-factor interactions among these factors.

For a fractional factorial design, the confirmation experiment should focus on the factors that showed significant main effects. The confirmation experiment should estimate the effects more precisely and test for curvature in the response. The confirmation experiment should also include the factors that were not significant in the screening to confirm that they are not important.

The confirmation plan should include the number of runs, the factors to be tested, the response to be measured, and the analysis methods. The plan should be reviewed by a colleague or a statistician before the screening experiment is conducted. The review helps to ensure that the confirmation plan is feasible and that the screening design is appropriate.

The Decision Record

The decision record is a written document that captures the decision framework and the outcome. The record should include the date, the factors, the interaction risk assessment, the run cost analysis, the significance testing requirement, and the chosen design. The record should also include the confirmation plan.

The decision record serves several purposes. It provides a transparent account of the design choice for your research records. It helps you justify the design choice in your report or grant application. It also helps you evaluate the success of the design after the experiment is complete.

The decision record should be stored with the experimental data. The NIH Data Management and Sharing Policy describes the expectations for data management and sharing in NIH-funded research. The NIH Data Management and Sharing Policy requires that data be managed and shared in a way that is consistent with the principles of reproducibility. The decision record is part of the metadata that makes the data reproducible.

The Escalation Criteria for Design Decisions

The decision framework includes criteria for when you should seek help from a more experienced researcher. You should escalate the design decision when you are uncertain about the interaction risk assessment, when the run cost analysis is complex, or when you are uncertain about the significance testing requirement.

You should also escalate when the number of factors is large, such as more than eleven, because the design options become more complex. You should escalate when you are considering a resolution V design because the run count is high and the design must be constructed carefully.

The escalation should be done before you generate the design matrix. The escalation should include a description of the factors, the interaction risk assessment, the run cost analysis, and the proposed design. The escalation should be done to a statistician or a researcher with experience in experimental design.

The Committee on Publication Ethics provides guidance on the responsible conduct of research, including the reporting of methods and results. The Core Practices describe the expectations for authorship, data, and peer review. The decision record and the escalation documentation are part of the responsible conduct of research because they provide a transparent account of the design choices.

The Decision Framework in the Context of Reporting

The decision framework also supports transparent reporting of your screening experiment. The EQUATOR Network provides a collection of reporting guidelines for different types of research. The EQUATOR Network helps you select the appropriate reporting guideline for your study type. The reporting guideline will require you to describe the design, the factors, the run count, and the confounding pattern.

The decision record provides the information you need to complete the reporting guideline. The record includes the number of factors, the design type, the run count, and the rationale for the design choice. The record also includes the interaction risk assessment and the confirmation plan.

The reporting guideline will also require you to describe the data analysis methods. The decision record includes the significance testing requirement, which determines the analysis method. The record also includes the confirmation plan, which describes the follow-up experiments.

The decision framework is a practical tool that connects the design choice to the reporting requirements. The framework ensures that you have the documentation needed to report your experiment transparently. The framework also ensures that you have a plan for the confirmation experiments that are required for both designs.

The Decision Framework as a Teaching Tool

The decision framework can also be used as a teaching tool for researchers who are new to screening designs. The framework provides a structured approach to design selection that is easier to learn than a purely theoretical treatment. The framework can be used in laboratory meetings, in training sessions, and in the design of student projects.

The framework teaches the key concepts of screening design: the number of factors, the interaction risk, the run cost, and the significance testing requirement. The framework also teaches the importance of the confirmation plan. The framework helps researchers understand why the design choice matters and how to make the choice in a systematic way.

The framework is consistent with the principles of transparent research. The framework requires documentation of the design decision and the rationale. The documentation supports the reproducibility of the experiment. The documentation also supports the reporting of the experiment in a way that is consistent with the reporting guidelines.

The decision framework is a practical tool that can be applied to any screening experiment in life science research. The framework is not a substitute for statistical expertise. The framework is a tool that helps you make a design decision in a structured way and to document the decision for your records and your reports.

Frequently Asked Questions

What is the main difference between Plackett-Burman and fractional factorial designs?

The main difference is the confounding pattern. Plackett-Burman designs have main effects partially confounded with two-factor interactions. Fractional factorial designs can have main effects clear of two-factor interactions if the resolution is IV or higher. This means that fractional factorial designs allow you to estimate main effects cleanly, while Plackett-Burman designs do not.

When should I use a Plackett-Burman design?

Use a Plackett-Burman design when you have many factors, typically more than five, and you want to minimize the number of runs. Use it when you have no prior knowledge that interactions are important. The design is efficient but does not allow you to estimate interactions.

When should I use a fractional factorial design?

Use a fractional factorial design when you need to estimate main effects cleanly or when you need to estimate specific interactions. The design requires more runs than a Plackett-Burman design but provides better information about the effects.

Can I estimate interactions with a Plackett-Burman design?

No, Plackett-Burman designs are not designed to estimate interactions. The confounding pattern does not allow you to separate individual two-factor interactions. If you need to estimate interactions, you should use a fractional factorial design with sufficient resolution.

What is the resolution of a fractional factorial design?

The resolution of a fractional factorial design describes the confounding pattern. A resolution IV design has main effects clear of two-factor interactions. A resolution V design has main effects and two-factor interactions clear of each other. The resolution determines what you can estimate from the design.

How many runs do I need for a screening experiment?

The number of runs depends on the number of factors and the design you choose. A Plackett-Burman design for 7 factors requires 12 runs. A fractional factorial design for 7 factors with resolution IV requires 16 runs. The number of runs also depends on the number of center points you include.

What is the role of center points in a screening experiment?

Center points are replicates at the midpoint of the factor ranges. They provide an estimate of experimental error and allow you to test for curvature in the response. Without center points, you cannot estimate the error or test for curvature.

How do I confirm the results of a screening experiment?

The results of a screening experiment should be confirmed with follow-up experiments. The follow-up experiments should be designed to estimate the effects of the factors that were important in the screening. The follow-up experiments should also test for interactions between the factors.

Using the Evidence

SourceBest use in this topicImportant limitation
Research Methods Resourcesofficial guidanceCheck the linked page for current local requirements
EQUATOR Networkofficial guidanceCheck the linked page for current local requirements
Core Practicesofficial guidanceCheck the linked page for current local requirements

Related Diagnostic Guides

References and Further Reading

This article is educational and does not replace validated laboratory procedures, institutional biosafety review, manufacturer instructions, or professional interpretation.