Leveraging Natural History Data as External Controls in Rare Disease Trials

Introduction: Why External Controls Are Needed in Rare Disease Studies

In rare disease clinical trials, recruiting sufficient participants for both treatment and placebo/control groups is often infeasible. Due to small patient populations, ethical concerns, and urgent unmet medical needs, randomized controlled trials (RCTs) may not be possible. As a solution, regulators allow for the use of natural history data as external control arms.

Natural history data refers to information collected from observational studies on how a disease progresses without treatment. When curated carefully, such data can act as a comparator group, offering insights into disease progression and baseline variability. This methodology supports single-arm trials, helping establish the efficacy and safety of investigational therapies in rare diseases.

What Are External Control Arms?

External control arms, also called synthetic or historical controls, use existing patient data instead of enrolling participants into a concurrent control group. These data sources can include:

• Prospective natural history registries
• Retrospective observational databases
• Electronic Health Records (EHR)
• Claims data and disease-specific cohorts

The external control group must be well-matched to the interventional arm in terms of inclusion/exclusion criteria, disease severity, and endpoint assessments.

Regulatory Guidance on Use of External Controls

Regulatory authorities recognize the limitations of RCTs in rare conditions and support alternative trial designs using external controls:

• FDA: Provides detailed recommendations in its “Rare Diseases: Considerations for the Development of Drugs and Biologics” guidance
• EMA: Accepts historical controls when randomization is not ethical or feasible, particularly under PRIME and Conditional Approval
• PMDA (Japan): Encourages use of registry-based controls for ultra-rare disorders

Both agencies emphasize transparency in data selection, comparability of endpoints, and statistical justification for the methodology.

Design Considerations When Using Natural History Controls

Several design factors are critical to ensuring the validity of external control comparisons:

• Eligibility Alignment: Apply same inclusion/exclusion criteria across both groups
• Endpoint Consistency: Use harmonized definitions and measurement tools
• Temporal Matching: Ensure comparable observation windows and follow-up duration
• Bias Mitigation: Use blinded outcome adjudication where possible

It is also important to pre-specify the statistical methods for matching or adjustment, such as propensity score matching, Bayesian priors, or weighted analysis models.

Case Example: External Controls in Batten Disease Study

In the CLN2 Batten disease program, researchers used prospective natural history data from a longitudinal registry to serve as the control arm for a single-arm enzyme replacement trial. Key outcomes like motor and language scores were directly compared between treated patients and natural history controls.

The resulting data demonstrated significant treatment benefit over expected decline, leading to FDA Accelerated Approval. This approach exemplifies how external controls can be pivotal for approvals in ultra-rare settings.

Challenges in Using Natural History Controls

Despite regulatory support, several challenges remain when applying natural history data as external controls:

• Heterogeneity: Data collected under non-standardized conditions may lack uniformity
• Selection Bias: Historical datasets may include different disease stages or comorbidities
• Missing Data: Retrospective data often lack key outcome measures or consistent follow-up
• Limited Sample Size: Especially in ultra-rare populations, natural history data may be sparse

Mitigation strategies include statistical adjustments, sensitivity analyses, and strict inclusion filters during data curation.

“`html

Best Practices for Building and Validating Natural History Controls

To ensure credibility and scientific rigor, sponsors should follow these best practices:

• Early Engagement with Regulators: Discuss external control strategy during pre-IND or Scientific Advice meetings
• Data Source Transparency: Clearly define the origin, collection methodology, and inclusion criteria of the natural history dataset
• Endpoint Harmonization: Ensure consistency of functional and clinical outcomes between groups
• Statistical Rigor: Use appropriate matching techniques and clearly pre-specify the analysis plan in the protocol
• Sensitivity Analysis: Demonstrate robustness of conclusions under various model assumptions

Publishing the methodology and validation steps in peer-reviewed literature also increases regulatory confidence.

Use in Accelerated and Conditional Approvals

External controls derived from natural history data are increasingly used in expedited pathways:

• Accelerated Approval (FDA): Allows surrogate endpoints with confirmatory post-market studies
• Conditional Marketing Authorization (EMA): Grants early access for life-threatening rare diseases with comprehensive follow-up plans

These pathways are ideal for therapies where traditional RCTs are not feasible. For example, in spinal muscular atrophy (SMA) and enzyme deficiency disorders, many approved drugs leveraged external controls from registries or retrospective datasets.

Comparative Effectiveness Through External Controls

Natural history data can also help evaluate comparative effectiveness of multiple therapies when head-to-head trials are not feasible. For example:

• Synthetic control arms: Constructed using data from older patients or different genotypes
• Matched cohorts: Built from national rare disease registries
• Cross-trial comparisons: With rigorous bias mitigation and adjustment

These approaches support clinical and payer decision-making, especially in high-cost rare disease therapies.

Digital Innovation and AI in Natural History Comparators

Digital technologies are enabling better external control integration:

• Machine learning for phenotype matching and anomaly detection
• Natural language processing to extract data from clinical notes
• AI-based simulation modeling to test trial scenarios
• Cloud-based registries to streamline real-time comparator identification

For example, an AI-powered registry for rare cardiomyopathy patients successfully identified matched controls in real-time, reducing trial setup time by 40%.

Conclusion: Real-World Comparators for Real-World Constraints

In the complex landscape of rare disease drug development, natural history data as external controls offer a powerful solution when RCTs are impractical. With careful matching, statistical rigor, and regulatory engagement, they can enable accelerated development and regulatory success. As the volume and quality of natural history data improve, their role in trial design, approval, and post-market evaluation will continue to grow.

Explore other examples of trials using natural history comparators on the Japan Registry of Clinical Trials.

Guide to Selecting the Right Comparison Group in Prospective Cohort Studies

In real-world evidence (RWE) and observational studies, the validity of your results hinges on the quality of your comparison group. Unlike randomized controlled trials, where randomization ensures balanced groups, prospective cohort studies must carefully plan and select comparison groups to reduce bias and increase validity. This tutorial explains how to identify, evaluate, and implement suitable comparison groups in pharmaceutical cohort studies.

Why Comparison Groups Matter in Observational Studies:

A comparison group—also referred to as a control group or unexposed group—is essential for assessing the effect of an exposure (e.g., drug, intervention, or risk factor). It provides a reference to determine whether observed outcomes are associated with the exposure or occur independently. Without a properly matched comparison group, confounding variables may distort the results, weakening the conclusions.

In real-world studies, the choice of the comparison group must be deliberate. Regulatory bodies such as the USFDA expect well-justified comparator strategies in all RWE submissions. Hence, it’s vital to plan comparison group selection as early as the protocol design stage.

Types of Comparison Groups in Cohort Designs:

Several types of comparison groups can be used, depending on the study objectives:

1. Unexposed Group: Individuals who do not receive the exposure or treatment being studied
2. Active Comparator Group: Individuals receiving an alternative treatment or intervention
3. Historical Controls: Patients from previous time periods, prior to the introduction of the treatment
4. External Comparator Group: Data derived from a separate study or registry, used to compare with the exposed cohort
5. Self-Controlled Designs: Where the same individuals serve as their own control over time (less common in cohort setups)

Choosing between these depends on study feasibility, data availability, and regulatory expectations. For pharmaceutical settings, active comparators and concurrent unexposed groups are preferred due to higher internal validity.

Key Criteria for Selecting a Suitable Comparison Group:

A robust comparator group should meet the following criteria:

• Similarity: Individuals should be similar to the exposed group in demographics, disease severity, and clinical characteristics
• Eligibility Alignment: Same inclusion/exclusion criteria must apply to both groups
• Timing Consistency: Enrollment periods should be concurrent to avoid secular bias
• Data Source Consistency: Ideally, both groups should come from the same setting or database
• Outcome Susceptibility: Both groups should have an equal chance of developing the outcome of interest

These elements ensure that the effect estimates reflect real treatment differences rather than baseline group imbalances.

Using Propensity Scores to Balance Groups:

Even after careful selection, residual confounding can persist. Propensity score methods help in balancing groups by estimating the probability of treatment assignment based on observed covariates. Popular techniques include:

• Propensity Score Matching (PSM)
• Inverse Probability of Treatment Weighting (IPTW)
• Covariate Adjustment Using Propensity Scores

These methods are particularly useful in pharmacoepidemiologic studies where exact matching may be impractical. They enhance the validity of comparisons by reducing bias due to observed differences.

Data Source Considerations for Comparison Group Identification:

Comparison groups can be drawn from a variety of real-world data sources:

• Electronic Health Records (EHRs)
• Claims Databases
• Product Registries
• Healthcare Networks or Integrated Delivery Systems
• Stability testing databases (when relevant to drug formulations or shelf-life exposure)

Regardless of the source, ensure data completeness, accurate exposure classification, and uniformity in outcome definitions. Differences in data coding or structure can introduce systematic bias if not accounted for.

Challenges in Comparator Selection and How to Overcome Them:

Several challenges may arise during comparator selection:

• Lack of a clear unexposed population: In highly treated populations, finding untreated individuals is difficult. Use active comparators instead.
• Channeling bias: Patients are assigned to treatments based on prognostic factors. Use propensity scores or instrumental variables.
• Temporal bias: Historical controls may reflect outdated practices. Limit use unless justified.
• Unmeasured confounding: Use sensitivity analyses or external validation when possible.

Design mitigation strategies into your protocol and document these in your regulatory submission and publications.

Regulatory Expectations and Documentation:

Agencies such as the EMA and other pharma regulatory authorities require transparent justification for comparator selection. Your documentation should include:

• Comparator definition and rationale
• Eligibility criteria for both groups
• Baseline characteristic tables showing similarity or differences
• Adjustment techniques for observed confounders
• Sensitivity analyses and limitations

Ensure consistency with ICH E2E pharmacovigilance guidance and local Good Pharmacovigilance Practices (GVP) modules.

Best Practices for Comparator Selection in Pharma RWE Studies:

1. Align comparison strategy with study objectives early in protocol development
2. Use consistent inclusion/exclusion criteria
3. Implement statistical balancing methods
4. Validate comparator outcomes using standard definitions
5. Document all assumptions and justifications in the final report

Use Pharma SOPs to standardize comparator selection processes across studies within your organization.

Conclusion:

Choosing an appropriate comparison group in prospective cohort studies is one of the most critical design decisions in RWE research. A well-matched comparator group enhances the credibility, reproducibility, and regulatory acceptability of your findings. Use a structured approach—defining eligibility, aligning data sources, applying statistical methods, and thoroughly documenting choices—to ensure your pharma study delivers valid real-world insights.