no effect (e.g., HR ~1.0), futility may be triggered.

Safety triggers: If CIs include unacceptable risk levels, DMCs may recommend early stopping for safety.

Precision: Narrow CIs increase confidence in decisions, while wide CIs may delay action until more data accrue.

For example, a vaccine trial may stop early if the 95% CI for efficacy remains above 50%, as this meets both regulatory and public health requirements.

Regulatory Guidance on Confidence Interval Use

Regulators have published expectations for CI-based stopping decisions:

• FDA: Encourages CI presentation alongside p-values in interim analysis reports for transparency.
• EMA: Requires clear justification if stopping is based on CIs, with simulation studies to demonstrate Type I error control.
• ICH E9: Emphasizes the importance of estimation and precision in interim analyses, moving beyond sole reliance on p-values.
• MHRA: Inspects whether CI-based boundaries are consistently applied across DMC reviews.

For example, in oncology trials, EMA has requested both CI-based thresholds and alpha-spending rules to ensure robustness of interim conclusions.

Scenarios of Confidence Interval Overlap

Several overlap scenarios can occur in practice:

1. CI excludes null effect: Suggests strong evidence of efficacy, may trigger early success.
2. CI includes null but trends favorable: May indicate potential benefit but insufficient precision, suggesting continuation.
3. CI wide and straddling null: Reflects uncertainty, often leading to continuation until more data accrue.
4. CI includes harm threshold: Suggests unacceptable risk; DMC may recommend early stopping for safety.

Illustration: In a cardiovascular outcomes trial, if the HR = 0.85 with 95% CI (0.72–1.05), overlap with 1.0 indicates futility risk, but continuation may be justified if upcoming events can narrow the CI.

Case Studies of CI-Based Stopping Decisions

Case Study 1 – Oncology Trial: At interim, HR = 0.70 with 95% CI (0.55–0.88). Because the CI excluded 1.0 and crossed the pre-specified efficacy boundary, the DMC recommended early termination for benefit. Regulators approved accelerated submission.

Case Study 2 – Vaccine Program: Interim efficacy CI was (52%, 78%). As the entire CI exceeded the regulatory threshold of 50% efficacy, the trial stopped early, leading to emergency use authorization.

Case Study 3 – Cardiovascular Trial: HR = 0.95 with CI (0.82–1.10). The overlap with null suggested futility. The DMC recommended continuation for another 12 months, emphasizing the need for precision before making a termination decision.

Challenges in Using Confidence Intervals

Despite their appeal, CIs introduce challenges in interim monitoring:

• Multiplicity: Overlap scenarios must account for multiple endpoints and interim looks.
• Wide intervals: Small sample sizes may yield imprecise CIs, delaying decisions.
• Subjectivity: Interpretation of overlap may vary across statisticians and regulators.
• Global variability: Different agencies may require different CI thresholds for stopping.

For example, in a rare disease trial, CI overlap was interpreted differently by FDA and EMA reviewers, delaying harmonized regulatory action.

Best Practices for Sponsors

To use CI overlap effectively in interim analyses, sponsors should:

• Pre-specify CI-based boundaries in protocols and SAPs.
• Combine CI overlap rules with alpha-spending or Bayesian predictive probabilities for robustness.
• Use simulations to demonstrate how overlap rules preserve error rates.
• Train DMCs to interpret CI scenarios consistently.
• Document rationale for CI-based decisions in TMFs and DMC minutes.

For instance, one oncology sponsor used graphical presentations of CI boundaries in interim reports, helping DMC members interpret overlap scenarios more consistently.

Regulatory and Ethical Implications

Misinterpretation or poor application of CI overlap can cause:

• False positives: Declaring success prematurely based on narrow CIs from small datasets.
• False negatives: Continuing trials unnecessarily when CIs already demonstrate futility.
• Ethical risks: Participants may face harm if harmful boundaries within CIs are ignored.
• Regulatory delays: Agencies may demand additional evidence if CI-based rules are poorly justified.

Key Takeaways

Confidence interval overlap provides a powerful complement to p-values in interim monitoring. To ensure compliance and credibility:

• Pre-specify CI overlap rules in trial documents.
• Use overlap alongside p-value thresholds and conditional power methods.
• Communicate overlap interpretations transparently in DMC deliberations.
• Engage regulators early to align on acceptable CI strategies.

By integrating CI overlap scenarios into stopping rule frameworks, sponsors and DMCs can make more balanced, ethical, and scientifically robust interim decisions.