How to Use LOCF, MMRM, and Multiple Imputation in Clinical Trials

Handling missing data in clinical trials is a critical challenge that can significantly affect the integrity and reliability of study results. Patient dropouts, missed visits, and unrecorded outcomes are common, and how we address these gaps can influence regulatory decisions. To ensure robustness and minimize bias, biostatisticians use various imputation methods to estimate missing values based on observed data patterns.

Among the most widely used methods are Last Observation Carried Forward (LOCF), Mixed Models for Repeated Measures (MMRM), and Multiple Imputation (MI). Each technique has strengths and limitations, and their selection must align with the type of missing data—whether it’s Missing Completely at Random (MCAR), Missing at Random (MAR), or Missing Not at Random (MNAR).

This article offers a practical guide for selecting and applying imputation strategies in clinical trial analysis. It also reflects regulatory expectations from the USFDA and EMA, ensuring compliance with ICH guidelines and audit-readiness of your results.

1. Last Observation Carried Forward (LOCF)

What It Is:

LOCF replaces missing values with the last available observed value for that subject. It is simple and has historically been popular, especially in longitudinal studies measuring repeated outcomes such as symptom scores.

How It Works:

Suppose a subject completed Week 4 but missed Week 6 and 8 visits. LOCF will use their Week 4 value to fill in the missing timepoints.

Advantages:

• Simple to implement in most software (R, SAS, SPSS)
• Maintains the original sample size
• Helpful in sensitivity analyses

Limitations:

• Assumes no change after last observation (often unrealistic)
• Can underestimate variability and bias treatment effects
• Discouraged by regulators as a primary analysis method

Despite limitations, LOCF can still be included in pharma SOPs as a supplementary method during sensitivity analysis.

2. Mixed Models for Repeated Measures (MMRM)

What It Is:

MMRM uses all available observed data points and models the outcome over time. It assumes missing data are MAR and incorporates time as a fixed effect and subjects as random effects. Unlike LOCF, it doesn’t impute values explicitly but estimates them via maximum likelihood.

How It Works:

Each subject’s data trajectory contributes to the overall likelihood function. MMRM adjusts for baseline covariates and can accommodate unequally spaced visits and dropout patterns.

Advantages:

• Preferred by regulators when MAR assumption holds
• Statistically efficient and unbiased under MAR
• Handles unbalanced data without needing imputation

Limitations:

• Complex to implement and interpret
• Assumes missingness depends only on observed data
• Inappropriate for MNAR data

MMRM is frequently used in pivotal trials involving longitudinal measurements, such as HbA1c in diabetes or depression scores in CNS studies. It is a key strategy outlined in GMP documentation and SAPs for confirmatory trials.

3. Multiple Imputation (MI)

What It Is:

MI fills in missing data by creating several plausible values based on observed data patterns. These multiple datasets are analyzed separately, and results are pooled using Rubin’s rules to account for imputation uncertainty.

How It Works:

1. Create multiple complete datasets using random draws from a predictive distribution
2. Analyze each dataset using the same statistical model
3. Combine estimates and standard errors across datasets

Advantages:

• Accounts for uncertainty and variability in imputed values
• Applicable under MAR, flexible with data types
• Recommended by EMA and FDA when LOCF or complete-case analysis is inappropriate

Limitations:

• Requires expert statistical knowledge to implement correctly
• Subject to model misspecification risks
• Computationally intensive for large datasets

MI is a robust method often included in primary or secondary analyses of stability studies and efficacy endpoints, especially when data collection spans long periods.

Comparison of Imputation Methods

Regulatory Perspective

Regulators like EMA and CDSCO expect sponsors to:

• Specify primary and sensitivity imputation methods in the Statistical Analysis Plan
• Justify the choice of method based on the assumed missing data mechanism
• Conduct multiple imputation when data is MAR and analyze different patterns
• Perform sensitivity analyses to assess robustness of results

Inadequate handling of missing data can jeopardize trial approval, particularly when survival or patient-reported outcomes are endpoints.

Best Practices for Implementing Imputation

1. Define your imputation strategy in the trial protocol and SAP
2. Use validated software (e.g., SAS PROC MI, R mice package, SPSS missing values module)
3. Avoid relying solely on LOCF for primary analyses
4. Run multiple imputation diagnostics (convergence, plausibility)
5. Include assumptions and imputation details in Clinical Study Reports

Conclusion

Effective handling of missing data through LOCF, MMRM, or Multiple Imputation is essential for unbiased, credible, and regulatory-compliant clinical trial results. While LOCF is simple, it carries assumptions that may not reflect real-world progression. MMRM offers model-based strength for longitudinal designs, and Multiple Imputation provides a statistically sound approach under MAR assumptions. Selection of the right method should be data-driven, pre-specified, and backed by best practices from the fields of pharma validation and biostatistics. In the ever-evolving landscape of drug development, a thoughtful imputation strategy can mean the difference between success and setback.

How to Handle Missing or Incomplete Chart Data in Retrospective Studies

Retrospective chart reviews serve as a valuable methodology in real-world evidence (RWE) research. However, one recurring challenge is dealing with missing or incomplete data within electronic health records (EHRs) or paper charts. Incomplete data can introduce bias, threaten the validity of results, and raise concerns with regulatory authorities. This tutorial walks clinical trial and pharma professionals through practical, compliant methods for managing missing chart data effectively in retrospective observational studies.

Why Missing Data Is a Critical Problem

Unlike prospective trials where data collection is planned and monitored, retrospective studies depend on existing records not designed for research. As a result, data may be:

• Incomplete (e.g., vital signs recorded sporadically)
• Missing entirely (e.g., no lab values)
• Illegible or inconsistent (e.g., handwritten notes)
• Discrepant across visits or providers

If not handled properly, missing data can cause:

• Loss of statistical power
• Non-representative results
• Skewed conclusions or increased variance
• Regulatory rejection or audit findings

To ensure quality and compliance, it’s essential to implement structured strategies that align with GMP documentation and real-world data standards.

Step 1: Identify Types and Patterns of Missing Data

Before taking action, understand the nature of the missing data. Classify it into:

1. Missing Completely at Random (MCAR): No pattern or link to patient characteristics.
2. Missing at Random (MAR): Missingness related to other observed data (e.g., labs missing more often in elderly).
3. Not Missing at Random (NMAR): Missingness is related to unobserved data (e.g., side effects omitted due to stigma).

Use summary statistics, cross-tabulations, or data visualization tools to explore patterns. Document findings in your validation master plan.

Step 2: Define Acceptable Missing Data Thresholds

Pre-specify acceptable levels of missingness in your study protocol. For example:

• No more than 10% of baseline lab data missing
• At least 75% of medication dosing records available
• Outcome variables must be complete in ≥90% of charts

These thresholds help assess study feasibility and ensure stability indicating methods are interpretable over time. Report compliance with these thresholds in the study results section.

Step 3: Develop SOPs for Handling Missing Data

Create standardized procedures to ensure consistency across data abstractors:

• Use “NA” or predefined codes to label missing fields
• Document reasons for missing data where possible
• Flag any values that require clinical interpretation or review
• Maintain an audit trail of all changes

Refer to Pharma SOP checklist templates to build compliant procedures that cover real-time annotations and backtracking.

Step 4: Attempt Data Retrieval from Alternate Sources

Before labeling data as missing, explore secondary data sources:

• Pharmacy logs for drug details
• Radiology or lab portals for missing reports
• Referral letters and discharge summaries
• Insurance claims data

If using EHRs, search both structured fields and physician notes. Always record the source of retrieved data for traceability as per pharma regulatory compliance.

Step 5: Use Imputation Techniques When Justified

In some cases, statistical imputation can restore dataset usability:

• Mean/Median Substitution: For continuous variables
• Hot Deck Imputation: Replace with value from similar patient
• Multiple Imputation: Generate multiple datasets and aggregate results
• Last Observation Carried Forward (LOCF): For longitudinal data

Imputation should only be used when MAR or MCAR is confirmed. Always describe imputation in your statistical analysis plan (SAP).

Step 6: Track and Report Missingness Transparently

Reporting standards such as STROBE and CONSORT recommend transparent handling of missing data:

• Include flowchart showing records screened, excluded, and analyzed
• List variables with missing data and proportions
• Provide rationale for exclusions and imputation
• Include sensitivity analysis to assess robustness

These practices ensure your study is acceptable to agencies like CDSCO or EMA.

Step 7: Train Abstractors to Minimize Data Loss

Abstractor-related errors can result in apparent missing data. Avoid this by:

• Training on form completion and source navigation
• Defining each variable and acceptable formats
• Running inter-rater reliability checks
• Using dummy charts for practice abstraction

Include missing data protocol in SOP training pharma sessions to reinforce accountability.

Step 8: Implement Quality Checks and Data Audits

Build quality checks into your data workflow:

• Run automated queries for blank or null fields
• Perform double-data entry for high-risk fields
• Flag inconsistencies across related variables
• Conduct regular chart audits for compliance

Record all findings in a deviation log and issue CAPAs as needed to preserve process validation integrity.

Best Practices to Maintain Data Integrity:

1. Never fabricate data — label as “missing” with justification
2. Document every step taken to retrieve or verify information
3. Use SOPs and guidelines to standardize processes
4. Consult biostatisticians when imputing data
5. Prepare a detailed data integrity report before final analysis

Conclusion:

Managing missing or incomplete data in retrospective chart reviews is a nuanced but critical process. By identifying data gaps, applying structured methods, retrieving alternate data, and maintaining transparency, pharma professionals can protect study integrity and uphold regulatory expectations. A disciplined approach not only ensures accurate findings but also enhances the credibility of real-world evidence used in product development, labeling, or safety monitoring.