Method Verification vs. Full Validation

By Dr. Zubair Khalid, DVM, MS, PhD ·

Method Verification vs. Full Validation

Quick Answer

  • Verification confirms an established method performs as expected in your specific laboratory, while full validation establishes performance characteristics for a new or modified method.
  • Choose verification when using a published or manufacturer method without changes, choose full validation when developing, modifying, or applying a method outside its intended scope.
  • Neither process replaces ongoing quality control, and both require documented evidence that your laboratory can reproduce the method's stated performance.

At a Glance

Decision FactorVerificationFull Validation
Method statusPublished, established, or manufacturer-provided methodNewly developed, modified, or transferred method
Performance parametersConfirm key parameters such as sensitivity, specificity, and precisionEstablish all relevant parameters including accuracy, precision, sensitivity, specificity, linearity, and robustness
Regulatory scopeOften sufficient for adopting a standard method in a regulated laboratoryRequired for method development, major modifications, or when no standard method exists
Laboratory settingSame or equivalent instrumentation, reagents, and environment as the original methodNew laboratory, new instrument platform, or substantially different conditions
Documentation burdenFocused records confirming expected performanceExtensive records including development data, optimization, and full characterization
Time and costLower time and resource investmentHigher time and resource investment
Quality control linkageMust connect to ongoing quality control and proficiency testingMust establish baseline quality control and reference ranges

Understanding the Core Distinction

The terms verification and validation describe two different levels of evidence in laboratory method implementation. Verification asks whether a method that already has established performance characteristics works in your specific setting. Full validation asks whether a method itself produces reliable results across its intended measurement range and conditions.

Laboratory professionals often encounter these terms in regulatory documents, accreditation standards, and published method guidelines. The practical difference matters because the amount of work, the type of evidence, and the documentation requirements differ substantially between the two processes.

A verification study assumes the method has already been validated elsewhere. The original developer, a manufacturer, or a standards body has established the method's performance characteristics. Your task is to confirm that the method performs as expected when you run it with your equipment, your reagents, your staff, and your sample types.

A full validation study assumes no prior performance evidence exists. You must establish the method's performance characteristics from the ground up. This includes determining the method's sensitivity, specificity, accuracy, precision, linear range, and other parameters that define what the method can and cannot do.

The choice between verification and full validation depends on three factors. First, the status of the method itself. Second, the regulatory and accreditation requirements that apply to your laboratory. Third, the degree to which your laboratory setting differs from the setting where the method was originally established.

Method Status and Its Role in the Decision

The first question to ask is whether the method you plan to use has established performance characteristics. Published methods in peer-reviewed literature, standard methods from organizations such as the National Institute of Standards and Technology, and manufacturer-provided protocols all carry some level of prior performance data.

Published methods in the scientific literature typically include performance data from the developing laboratory. The National Library of Medicine hosts a range of molecular biology and laboratory method references that describe how methods are developed and characterized. When you adopt such a method, you are relying on the original developers' evidence that the method works.

Manufacturer-provided methods come with performance claims based on the manufacturer's own testing. These claims may include sensitivity, specificity, and precision data. Your verification confirms that the method performs as claimed in your hands.

Standard methods from organizations such as NIST carry the weight of formal standardization. The NIST Laboratory Programs describe how measurement science and standards are developed. Standard methods have undergone rigorous evaluation and are designed to produce consistent results across different laboratories.

The key question is whether you are using the method exactly as described. If you change the sample type, the instrument platform, the reagent formulation, or the testing conditions, you may move from verification into validation territory.

Regulatory Scope and Laboratory Setting

The regulatory environment in which your laboratory operates determines whether verification or validation is required. Clinical laboratories in the United States operate under federal regulations that distinguish between modified and unmodified methods. Research laboratories follow institutional oversight requirements that may differ from clinical requirements.

The NIH Guidelines for Recombinant or Synthetic Nucleic Acid Molecules provide an example of how oversight requirements shape laboratory practice. These guidelines apply to research involving recombinant or synthetic nucleic acids and require institutional oversight through an Institutional Biosafety Committee. The guidelines do not specify verification or validation requirements, but they establish the principle that laboratory work with certain materials requires documented oversight.

Accreditation bodies and regulatory agencies generally require that laboratories verify the performance of established methods before using them for patient testing or other regulated purposes. The verification must be documented and must demonstrate that the method performs as expected in the laboratory's own setting.

Full validation is required when the laboratory develops a new method, modifies an existing method, or applies a method to a new sample type or new clinical context. The validation must establish the method's performance characteristics in the laboratory's own setting.

The distinction matters because the consequences of using an unverified or unvalidated method can be serious. An unverified method may produce incorrect results that go undetected because the laboratory has not established the method's expected performance. An unvalidated method may have unknown limitations that produce incorrect results for certain sample types.

The Verification Process

Verification is a focused process that confirms a method performs as expected in your laboratory. The process involves running the method under your laboratory's conditions and comparing the results to the method's established performance characteristics.

Verification Planning

Before you begin verification, you need to define what you will verify. The verification plan should specify the performance parameters you will assess, the number of samples you will test, and the acceptance criteria you will use.

The performance parameters you verify depend on the method and its intended use. For a qualitative method, you might verify sensitivity and specificity. For a quantitative method, you might verify accuracy, precision, and the reportable range. The method's original validation data provides the reference point for your acceptance criteria.

Your verification plan should also specify the sample types you will test. If the method is intended for a specific sample type, such as blood or tissue, you should verify the method with that sample type. If the method will be used for multiple sample types, you should verify each sample type.

Verification Protocol

The verification protocol describes the steps you will take to assess the method's performance. The protocol should include the number of replicates, the number of runs, and the statistical analysis you will use.

For precision verification, you will typically run the method multiple times with the same samples to assess within-run and between-run variability. The number of replicates depends on the method and the level of precision you need to confirm.

For accuracy verification, you will typically test samples with known values and compare the measured values to the expected values. The samples may be reference materials, proficiency testing samples, or samples that have been tested with a reference method.

For sensitivity and specificity verification, you will test samples that are known to be positive or negative for the target analyte. The verification results are compared to the method's stated sensitivity and specificity.

Verification Records

The verification records document what you did and what you found. The records should include the verification plan, the raw data, the statistical analysis, and the conclusion about whether the method performed as expected.

The records should also include information about the conditions under which the verification was performed. This includes the instrument, the reagents, the operator, and the date. This information is important because it defines the conditions under which the method was verified.

The verification records become part of the laboratory's quality documentation. They provide evidence that the method was verified and that the laboratory can use the method for its intended purpose.

Full Validation Process

Full validation is a more extensive process that establishes the method's performance characteristics from the ground up. The process involves method development, optimization, and characterization.

Method Development and Optimization

Method development begins with defining the method's purpose and the performance characteristics it must achieve. The development process involves selecting the method's components, such as reagents, instruments, and protocols, and optimizing the method's conditions.

The MIQE Guidelines provide an example of how method development and reporting standards are structured for quantitative PCR. The guidelines emphasize the importance of transparency in reporting, including the use of controls, the reporting of performance characteristics, and the interpretation of results. The guidelines also describe the importance of standardizing the method's conditions to ensure reproducibility.

Method optimization involves testing different conditions and selecting the conditions that produce the best performance. The optimization process may involve testing different reagent concentrations, different temperatures, different incubation times, and different sample preparation methods.

The optimization process should be documented, including the conditions tested, the results obtained, and the rationale for the selected conditions. The documentation provides the basis for the validation study.

Validation Parameters

The validation study establishes the method's performance characteristics. The parameters that are validated depend on the method and its intended use.

For a quantitative method, the validation parameters include accuracy, precision, linearity, and the reportable range. Accuracy describes how close the measured values are to the true values. Precision describes how close the measured values are to each other. Linearity describes the method's ability to produce results that are proportional to the concentration of the target.

For a qualitative method, the validation parameters include sensitivity, specificity, and the limit of detection. Sensitivity is the method's ability to detect the target when it is present. Specificity is the method's ability to detect the target when it is present. The limit of detection is the lowest concentration of the target that the method can reliably detect.

The validation study also includes the method's robustness, which is the method's ability to produce consistent results under small changes in the method's conditions. The robustness testing involves varying the method's conditions and measuring the effect on the results.

Validation Study Design

The validation study design describes the samples, the replicates, the runs, and the statistical analysis that will be used to establish the method's performance characteristics.

The validation study uses a set of samples that cover the method's intended measurement range. The samples include known positive samples, known negative samples, and samples with known concentrations of the target.

The validation study includes multiple replicates and multiple runs to establish the method's precision. The statistical analysis includes the calculation of the mean, the standard deviation, the coefficient of variation, and the confidence intervals.

The validation study also includes the comparison of the method's results to a reference method or to known values. The comparison establishes the method's accuracy.

Validation Records

The validation records document the complete validation study. The records include the development plan, the optimization records, the validation study design, the raw data, the statistical analysis, and the conclusion about the method's performance.

The validation records also include the method's performance characteristics, such as the sensitivity, specificity, accuracy, precision, linearity, and the reportable range. These characteristics define the method's capabilities and limitations.

The validation records are the basis for the method's use in the laboratory. They provide the evidence that the method is fit for its intended purpose.

Practical Decision Workflow

The decision between verification and validation follows a structured workflow. The workflow begins with the method's status and ends with the documentation of the verification or validation study.

Step 1: Determine the Method Status

The first step is to determine whether the method has established performance characteristics. If the method is published in the literature, provided by a manufacturer, or standardized by a standards body, it has established performance characteristics. If the method is new, modified, or uncharacterized, it does not.

Step 2: Determine the Regulatory Scope

The second step is to determine the regulatory scope that applies to your laboratory. Clinical laboratories, research laboratories, and other laboratory settings have different requirements. The regulatory scope determines whether verification or validation is required.

Step 3: Determine the Laboratory Setting

The third step is to determine whether your laboratory setting differs from the setting where the method was established. If you are using the same instrument, the same reagents, and the same sample types, you may be able to verify the method. If you are using a different instrument, different reagents, or different sample types, you may need to validate the method.

Step 4: Determine the Method Modifications

The fourth step is to determine whether you have modified the method. If you have changed the method's protocol, the method's conditions, or the method's sample types, you may need to validate the method. If you are using the method exactly as described, you may be able to verify the method.

Step 5: Choose the Verification or Validation Path

The fifth step is to choose the verification or validation path based on the previous steps. If the method has established performance characteristics, the regulatory scope allows verification, and the laboratory setting matches the original setting, you can verify the method. If the method is new, the regulatory scope requires validation, or the laboratory setting differs, you need to validate the method.

Step 6: Document the Verification or Validation Study

The sixth step is to document the verification or validation study. The documentation includes the plan, the data, the analysis, and the conclusion. The documentation is the evidence that the method is fit for its purpose.

flowchart TD
    A[Method Status] --> B{Established Method?}
    B -->|Yes| C[Regulatory Scope]
    B -->|No| D[Full Validation Required]
    C --> E[Verification Allowed?]
    E -->|Yes| F[Laboratory Setting Matches?]
    E -->|No| D
    F -->|Yes| G[Method Modified?]
    F -->|No| D
    G -->|No| H[Verification Study]
    G -->|Yes| D

Practical Implementation Steps

The practical implementation of verification or validation follows a structured process. The process includes planning, preparation, execution, analysis, and documentation.

Planning the Study

The planning phase defines the study's scope, the parameters, the samples, and the acceptance criteria. The plan should be written and approved before the study begins.

The plan should include the method's description, the intended use, the performance parameters, the sample types, the number of replicates, the number of runs, and the statistical analysis. The plan should also include the acceptance criteria that define whether the method performs as expected.

Preparing the Laboratory

The preparation phase ensures that the laboratory is ready for the study. This includes the instrument, the reagents, the equipment, and the staff.

The instrument should be calibrated and maintained according to the manufacturer's instructions. The reagents should be prepared according to the method's protocol. The equipment should be clean and functional. The staff should be trained on the method and the study protocol.

The Biosafety in Microbiological and Biomedical Laboratories guidance describes the biosafety principles and containment practices that apply to laboratory work. The guidance covers risk assessment, containment, and institutional oversight. The preparation phase should include a review of the biosafety requirements that apply to the method and the samples.

Running the Study

The study is run according to the plan. The samples are tested, the data are collected, and the results are recorded.

The study should be run under the same conditions that will be used for the method's routine use. The instrument, the reagents, the equipment, and the environment should be the same.

The data should be recorded in a format that allows the statistical analysis. The records should include the sample identification, the run date, the operator, the instrument, and the results.

Analyzing the Data

The data are analyzed according to the plan. The statistical analysis includes the calculation of the mean, the standard deviation, the coefficient of variation, and the confidence intervals.

The results are compared to the acceptance criteria. If the results meet the acceptance criteria, the method is verified or validated. If the results do not meet the acceptance criteria, the method is not verified or validated, and the laboratory must investigate the cause.

Documenting the Study

The documentation includes the plan, the records, the analysis, and the conclusion. The documentation should be complete and organized so that it can be reviewed by the laboratory's quality management or by an external auditor.

The documentation should include the method's performance characteristics, the acceptance criteria, the results, and the conclusion. The documentation should also include the conditions under which the study was performed.

Records and Measurements

The records and measurements from the verification or validation study are the evidence that the method is fit for its purpose. The records should be complete, accurate, and traceable.

Records to Maintain

The records should include the method's protocol, the verification or validation plan, the raw data, the statistical analysis, and the conclusion. The records should also include the instrument records, the reagent records, and the operator records.

The instrument records should include the instrument identification, the calibration records, and the maintenance records. The reagent records should include the reagent identification, the lot number, and the expiration date. The operator records should include the operator's name, the training records, and the competency records.

Measurements to Record

The measurements should include the raw data from the study. The raw data include the instrument readings, the sample values, and the control values.

The measurements should also include the calculated values, such as the mean, the standard deviation, and the coefficient of variation. The calculated values should be recorded with the raw data so that the analysis can be reviewed.

Records Retention

The records should be retained according to the laboratory's records retention policy. The retention period should be defined in the policy and should be consistent with the regulatory requirements that apply to the laboratory.

The records should be stored in a way that protects them from damage, loss, or unauthorized access. The records should be available for review by the laboratory's quality management and by external auditors.

Common Failure Patterns

The verification and validation studies can fail for a variety of reasons. The common failure patterns include the following.

Incomplete Verification

The verification study may be incomplete because the laboratory did not verify all the performance parameters that are required. The laboratory may verify the method's sensitivity but not its specificity, or the laboratory may verify the method's precision but not its accuracy.

The incomplete verification can lead to the method being used without the evidence that it performs as expected. The laboratory should ensure that the verification plan includes all the performance parameters that are relevant to the method's intended use.

Inadequate Sample Size

The verification study may use too few samples to provide a reliable estimate of the method's performance. The sample size should be sufficient to detect the differences between the method's performance and the method's expected performance.

The sample size should be based on the statistical analysis that will be used. The laboratory should consult the statistical analysis and the method's performance characteristics to determine the appropriate sample size.

Uncontrolled Conditions

The verification study may be run under conditions that are not the same as the method's routine use. The laboratory may use a different instrument, different reagents, or different conditions than the method's protocol.

The uncontrolled conditions can produce results that do not reflect the method's performance under routine use. The laboratory should ensure that the verification study is run under the same conditions as the method's routine use.

Inadequate Documentation

The verification study may be documented inadequately. The laboratory may not record the raw data, the conditions, or the analysis. The inadequate documentation makes it impossible to review the study and to confirm that the method was verified.

The laboratory should ensure that the documentation is complete and organized. The documentation should include the plan, the records, the analysis, and the conclusion.

Misinterpretation of Results

The verification study may be misinterpreted. The laboratory may conclude that the method is verified when the results do not meet the acceptance criteria. The laboratory may also conclude that the method is not verified when the results meet the acceptance criteria.

The laboratory should ensure that the results are interpreted according to the acceptance criteria and the statistical analysis. The laboratory should also ensure that the interpretation is documented.

Quality Controls and Ongoing Monitoring

The verification or validation study is the initial evidence that the method is fit for its purpose. The ongoing quality control is the evidence that the method continues to perform as expected.

Quality Control Materials

The quality control materials are the samples that are used to monitor the method's performance. The quality control materials should be stable, and they should have known values for the target.

The quality control materials should be run with the method's routine use. The results should be recorded and compared to the expected values.

Quality Control Limits

The quality control limits define the acceptable range for the quality control results. The limits are based on the method's performance characteristics, which are established during the verification or validation study.

The quality control limits should be defined before the method's routine use. The limits should be reviewed periodically and updated if the method's performance changes.

Proficiency Testing

The proficiency testing is the external assessment of the method's performance. The proficiency testing involves the testing of samples that are provided by an external provider. The results are compared to the results of other laboratories.

The proficiency testing is an important component of the laboratory's quality management. The proficiency testing provides an external check on the method's performance and the laboratory's competence.

The NIST Laboratory Programs describe the measurement science and standards that support the quality of laboratory measurements. The programs include the development of reference materials, the calibration of instruments, and the assessment of measurement uncertainty. The laboratory's quality control and proficiency testing should be aligned with the measurement science and standards.

Biosafety and Institutional Oversight

The verification and validation of a method may involve the use of biological materials, including microorganisms, human samples, or recombinant nucleic acids. The laboratory must follow the biosafety principles and the institutional oversight requirements that apply to the work.

The Biosafety in Microbiological and Biomedical Laboratories guidelines describe the biosafety principles and the containment requirements for the laboratory. The guidelines include the risk assessment, the containment levels, and the institutional requirements.

The risk assessment should be performed before the verification or validation study begins. The risk assessment should consider the hazards of the samples, the method, and the laboratory setting. The risk assessment should determine the appropriate containment level and the appropriate practices.

The NIH Guidelines for Recombinant or Synthetic Nucleic Acid Molecules apply to the research involving recombinant or synthetic nucleic acids. The guidelines require the institutional oversight through the Institutional Biosafety Committee. The laboratory must comply with the guidelines when the method involves recombinant or synthetic nucleic acids.

The laboratory should also follow the standard laboratory safety practices, including the use of personal protective equipment, the handling of the samples, and the disposal of the waste. The laboratory should have the safety procedures in place and the staff should be trained on the procedures.

Limitations and Interpretation

The verification and validation study has limitations that should be considered when the method is used. The limitations include the following.

The Verification Study Does Not Establish the Method's Performance

The verification study confirms that the method performs as expected in your laboratory. The verification study does not establish the method's performance characteristics. The method's performance characteristics are established by the original developer.

The verification study is limited to the parameters that are included in the verification plan. The verification study does not cover the parameters that are not included in the plan.

The Validation Study Is Specific to the Study Conditions

The validation study establishes the method's performance characteristics under the conditions of the study. The validation study does not establish the method's performance under different conditions.

The validation study is specific to the samples, the instrument, the reagents, and the conditions that are used in the study. The method's performance may be different under different conditions.

The Performance Characteristics Are Estimates

The performance characteristics that are established during the verification or validation study are estimates. The estimates are based on the samples and the conditions of the study. The estimates have a degree of uncertainty.

The uncertainty should be considered when the method's results are interpreted. The uncertainty should be reported with the method's results.

The Method's Performance May Change Over Time

The method's performance may change over time. The changes may be due to the changes in the reagents, the instrument, the environment, or the staff. The ongoing quality control is designed to detect the changes in the method's performance.

The laboratory should monitor the method's performance over time. The laboratory should investigate the changes in the method's performance and take the corrective action when the changes are detected.

Professional Escalation Criteria

The laboratory should escalate the issues to the appropriate personnel when the verification or validation study fails or when the method's performance is not acceptable.

Escalation for Verification or Validation Failure

The laboratory should escalate the verification or validation failure to the laboratory director or the quality manager. The escalation should include the study plan, the results, and the analysis.

The laboratory director or the quality manager should investigate the failure. The investigation should determine the cause of the failure and the corrective action that is needed.

Escalation for Method Performance Issues

The laboratory should escalate the method performance issues to the laboratory director or the quality manager. The escalation should include the quality control results, the proficiency testing results, and the investigation of the issue.

The laboratory director or the quality manager should determine whether the method should be used, whether the method should be modified, or whether the method should be replaced.

Escalation for Safety Issues

The laboratory should escalate the safety issues to the laboratory safety officer or the institutional biosafety officer. The escalation should include the safety concern, the risk assessment, and the recommended action.

The safety officer or the biosafety officer should investigate the safety issue and determine the appropriate action. The action may include the containment, the training, or the modification of the method.

A Practical Decision Framework for Verification or Full Validation

The existing workflow in this article describes the general path for choosing between verification and full validation, but it does not provide a scoring system that helps laboratories weigh competing factors. In practice, the decision is rarely binary. A method may be published but applied to a new sample type, or a manufacturer method may be run on a different instrument platform. These situations require a structured approach that accounts for the degree of change and the regulatory consequences of a wrong decision.

The Verification-Versus-Validation Scoring Matrix

A practical decision framework uses a scoring matrix that assigns points based on the method's status, the regulatory scope, and the laboratory setting. The total score indicates whether verification is sufficient or whether full validation is required. This framework is not a substitute for regulatory requirements, but it provides a consistent way to document the reasoning behind the decision.

The scoring matrix uses four categories, each with a score of zero, one, or two points.

Method origin and prior performance data

  • Zero points: The method has no prior performance data, such as a method developed entirely in-house.
  • One point: The method has partial performance data, such as a published method that does not report all relevant parameters.
  • Two points: The method has complete performance data from a manufacturer, a standards body, or a peer-reviewed publication.

Regulatory scope

  • Zero points: The regulatory scope explicitly requires full validation for the method and its intended use.
  • One point: The regulatory scope is unclear or does not explicitly address the method.
  • Two points: The regulatory scope explicitly allows verification for the method.

Laboratory setting match

  • Zero points: The laboratory uses a different instrument platform, different reagent formulation, or substantially different environmental conditions.
  • One point: The laboratory uses the same instrument platform but different reagent lots or minor environmental differences.
  • Two points: The laboratory uses the same instrument, the same reagent formulation, and equivalent environmental conditions.

Method modifications

  • Zero points: The method has been modified in a way that affects its performance, such as a change in sample preparation, extraction, or detection.
  • One point: The method has minor modifications that do not affect the analytical principle, such as a change in sample volume.
  • Two points: The method is used exactly as described in the original protocol.

The total score ranges from zero to eight. A score of six or higher supports verification. A score of three or lower requires full validation. A score of four or five indicates a borderline situation that requires additional review by the laboratory director or quality manager.

Applying the Scoring Matrix

The scoring matrix is applied before the verification or validation study begins. The laboratory records the score for each category and the total score in the study plan. The score provides the documented rationale for the chosen path.

Consider a laboratory that adopts a manufacturer-provided quantitative PCR method. The method has complete performance data from the manufacturer, so the method origin score is two. The regulatory scope allows verification for the method, so the regulatory score is two. The laboratory uses the same instrument platform and the same reagent formulation, so the laboratory setting score is two. The laboratory uses the method exactly as described, so the method modification score is two. The total score is eight, which indicates verification.

Consider a laboratory that modifies the same method to use a different extraction kit. The method origin score remains two because the manufacturer's performance data still apply to the analytical method. The regulatory scope score remains two. The laboratory setting score remains two because the instrument and reagent are the same. The method modification score is zero because the extraction change affects the sample preparation. The total score is six, which still indicates verification. However, the laboratory should verify the method with the new extraction kit and document the comparison to the manufacturer's performance data.

Consider a laboratory that applies the method to a new sample type, such as a different tissue type. The method origin score is two, the regulatory scope score is two, and the laboratory setting score is two. The method modification score is zero because the sample type change affects the method's intended scope. The total score is six, which indicates verification. The laboratory should verify the method with the new sample type and document the results.

Consider a laboratory that develops a new method in-house. The method origin score is zero because no prior performance data exists. The regulatory scope score may be one or two depending on the laboratory's accreditation status. The laboratory setting score is two because the method is developed in the laboratory. The method modification score is two because the method is used as developed. The total score is five or six, which indicates a borderline situation. The laboratory director should review the situation and determine whether full validation is required.

The Decision Documentation Record

The scoring matrix produces a decision documentation record that becomes part of the laboratory's quality records. The record includes the method name, the method version, the date of the decision, the score for each factor, the total score, and the decision. The record also includes the name of the person who made the decision and the name of the person who approved the decision.

The decision record is reviewed by the laboratory director or the quality manager before the verification or validation study begins. The review confirms that the scoring is accurate and that the decision is appropriate. The review is documented in the record.

The decision record is also reviewed when the method is changed. If the laboratory changes the instrument, the reagent, the sample type, or the protocol, the laboratory re-applies the scoring matrix and determines whether the decision changes. The re-application is documented in the record.

The Escalation Path for Borderline Scores

A borderline score of four or five points requires escalation to the laboratory director or the quality manager. The escalation includes the scoring matrix, the rationale for each score, and the proposed decision. The laboratory director or the quality manager reviews the situation and makes the final decision.

The laboratory director or the quality manager may decide to require full validation even when the score indicates verification. This decision is appropriate when the method is used for a high-stakes application, such as a diagnostic test that affects patient care, or when the method is used for a new sample type that has not been characterized.

The laboratory director or the quality manager may also decide to require verification with additional parameters. This decision is appropriate when the method has a borderline score and the laboratory wants to confirm the method's performance with additional data.

The Scoring Matrix in Practice

The scoring matrix is a practical tool that helps laboratories make consistent decisions about verification and validation. The matrix is not a regulatory requirement, but it provides a documented rationale for the decision. The matrix is also a training tool that helps new laboratory staff understand the factors that influence the decision.

The matrix is used in conjunction with the regulatory requirements and the accreditation standards that apply to the laboratory. The matrix does not replace the regulatory requirements. The matrix provides a structured way to apply the requirements to the specific method and the specific laboratory setting.

The NIST Laboratory Programs describe the measurement science and standards that support the quality of laboratory measurements. The scoring matrix aligns with the NIST approach to measurement quality because it emphasizes the documentation of the decision and the evidence that supports the decision.

The MIQE Guidelines describe the reporting standards for quantitative PCR. The scoring matrix aligns with the MIQE approach because it emphasizes the transparency of the decision and the documentation of the rationale.

The Scoring Matrix and the Verification Plan

The scoring matrix is the first section of the verification plan. The verification plan includes the scoring matrix, the decision, and the verification protocol. The verification protocol describes the samples, the replicates, the runs, and the statistical analysis that will be used to verify the method.

The scoring matrix is also the first section of the validation plan. The validation plan includes the scoring matrix, the decision, and the validation protocol. The validation protocol describes the development, the optimization, and the characterization of the method.

The scoring matrix is a living document. The laboratory updates the scoring matrix when the method changes or when the regulatory requirements change. The updates are documented in the decision record.

The Scoring Matrix and the Professional Escalation Criteria

The scoring matrix is linked to the professional escalation criteria. A borderline score requires escalation to the laboratory director or the quality manager. A score that indicates verification but is followed by a failed verification study requires escalation to the laboratory director or the quality manager. A score that indicates full validation but the laboratory does not have the resources for full validation requires escalation to the laboratory director or the quality manager.

The escalation criteria are documented in the laboratory's quality manual. The escalation criteria are reviewed during the laboratory's internal audits and during the external accreditation audits.

The Scoring Matrix and the Common Failure Patterns

The scoring matrix addresses the common failure patterns that are described in this article. The incomplete verification is addressed by the scoring matrix because the matrix requires the laboratory to document the performance parameters that are relevant to the method's intended use. The inadequate sample size is addressed by the scoring matrix because the matrix requires the laboratory to document the sample size and the statistical analysis. The uncontrolled conditions are addressed by the scoring matrix because the matrix requires the laboratory to document the conditions of the study. The inadequate documentation is addressed by the scoring matrix because the matrix requires the laboratory to document the decision and the rationale. The misinterpretation of results is addressed by the scoring matrix because the matrix requires the laboratory to document the acceptance criteria and the interpretation.

The scoring matrix is a practical tool that helps laboratories avoid the common failure patterns and make consistent decisions about verification and validation. The matrix is a documented record that provides the evidence for the decision. The matrix is a training tool that helps new staff understand the method of the decision. The matrix is a quality tool that supports the laboratory's quality management.

Frequently Asked Questions

What is the difference between verification and validation?

Verification confirms that an established method performs as expected in your laboratory. Validation establishes the performance characteristics of a new or modified method. Verification is a focused process that compares your results to the method's established performance. Validation is a comprehensive process that defines the method's performance from the ground up.

When is verification sufficient?

Verification is sufficient when you are using an established method without modification. The method must have established performance characteristics from the original developer, the manufacturer, or a standards body. Your laboratory setting must be the same as the method's intended setting. The regulatory scope must allow verification.

When is full validation required?

Full validation is required when you are developing a new method, modifying an established method, or applying a method to a new sample type or new context. Full validation is also required when the regulatory scope requires validation. Full validation establishes the method's performance characteristics from the ground up.

What performance parameters are verified during verification?

The performance parameters that are verified depend on the method and its intended use. For a quantitative method, the verification includes accuracy, precision, and the reportable range. For a qualitative method, the verification includes sensitivity, specificity, and the limit of detection. The verification plan should include the parameters that are relevant to the method's intended use.

What performance parameters are validated during full validation?

The performance parameters that are validated during full validation include accuracy, precision, linearity, sensitivity, specificity, the limit of detection, the reportable range, and robustness. The validation study establishes the method's performance characteristics across the method's intended measurement range.

How many samples are needed for verification?

The number of samples needed for verification depends on the method, the performance parameters, and the statistical analysis. The sample size should be sufficient to provide a reliable estimate of the method's performance. The laboratory should calculate the sample size based on the statistical analysis and the method's expected performance.

What records should be maintained for verification and validation?

The records should include the method's protocol, the verification or validation plan, the sample data, the statistical analysis, and the conclusion. The records should also include the instrument records, the reagent records, and the operator records. The records should be complete, accurate, and organized.

What should the laboratory do when verification fails?

The laboratory should investigate the cause of the verification failure. The investigation should include the review of the study plan, the data, and the analysis. The laboratory should determine whether the failure is due to the method, the samples, the instrument, the reagents, or the operator. The laboratory should take the corrective action and repeat the verification study.

Using the Evidence

SourceBest use in this topicImportant limitation
Molecular Biology and Laboratory Methodsofficial guidanceCheck the linked page for current local requirements
Biosafety in Microbiological and Biomedical Laboratoriesofficial guidanceCheck the linked page for current local requirements
NIH Guidelines for Recombinant or Synthetic Nucleic Acid Moleculesofficial guidanceCheck the linked page for current local requirements

Related Diagnostic Guides

References and Further Reading

This article is educational and does not replace validated laboratory procedures, institutional biosafety review, manufacturer instructions, or professional interpretation.