The Biostatistician’s Role in Justifying Sample Size to Regulatory Authorities

Sample size determination is not merely a statistical calculation—it’s a regulatory and ethical cornerstone of clinical trial planning. The biostatistician plays a vital role in developing and justifying the rationale behind sample size choices to ensure trials are both scientifically valid and compliant with global regulatory expectations.

This tutorial explores how biostatisticians bridge science, strategy, and regulation when justifying sample size to agencies like the USFDA and EMA. It outlines the expectations, common pitfalls, documentation practices, and communication strategies essential for regulatory approval.

Why Sample Size Justification Matters to Regulators

Regulatory agencies require that clinical trials:

• Are designed with enough power to detect clinically relevant differences
• Minimize subject exposure to unproven therapies
• Avoid unnecessary complexity or duration
• Are based on sound statistical assumptions and evidence

The pharma regulatory compliance process includes a thorough review of the sample size justification during protocol submission, especially in pivotal Phase II/III studies.

Key Responsibilities of the Biostatistician

1. Determine the appropriate method for sample size estimation (frequentist, Bayesian, simulation-based)
2. Define statistical parameters: power, effect size, alpha level, dropout rate, and variability
3. Justify each assumption with empirical evidence or references
4. Document all decisions in the statistical analysis plan (SAP)
5. Communicate clearly with regulatory agencies through briefing documents and responses

Elements of a Regulatory-Ready Sample Size Justification

1. Clear Hypotheses and Endpoints

Define the primary objective and endpoint (e.g., “to show superiority of Drug A over placebo in reducing HbA1c”).

2. Statistical Assumptions

• Effect size: Derived from prior studies, meta-analyses, or pilot trials
• Variance: Must reflect realistic and conservative estimates
• Type I error: Typically set at 0.05 (two-sided)
• Power: Commonly 80–90%
• Dropout rate: Consider 10–30% depending on population and duration

3. Method and Formula

Provide the mathematical formula or software output (e.g., nQuery, SAS PROC POWER) used for the calculation. Include versions and parameters.

4. Sensitivity Analysis

Show how the sample size changes with variations in effect size or dropout rates to demonstrate robustness.

5. References and Justification

Support all assumptions with published literature, historical controls, or feasibility study data.

6. Narrative in the Protocol and SAP

Include a concise narrative explanation in both documents, aligned with ICH E9 and GCP guidelines.

Example: Sample Size Justification in a Regulatory Submission

In a Phase III trial for a cardiovascular drug, the primary endpoint is a reduction in systolic blood pressure. Biostatisticians must:

• Justify the assumed mean difference (e.g., 5 mmHg) with Phase II data
• Estimate standard deviation (e.g., 10 mmHg) from historical controls
• Explain why 90% power is chosen (e.g., public health importance)
• Include dropout rate (e.g., 15%) and how it impacts the total sample size
• Run simulations under different assumptions to assess sensitivity
• Prepare slides and technical memos for USFDA pre-IND or End-of-Phase 2 meetings

Tools for Sample Size Justification

• nQuery Advisor, East, PASS (frequentist calculations)
• R (pwr, simstudy), SAS, WinBUGS for Bayesian or simulation models
• Pharma validation protocols to confirm software accuracy

Key Regulatory Documents Involving Sample Size

• Clinical Study Protocol: Includes a narrative description of the statistical rationale
• Statistical Analysis Plan (SAP): Contains detailed methods, formulas, and references
• Briefing Package: Used for interactions with agencies
• Module 2.7.2 of CTD: Clinical Summary for final submissions

Common Pitfalls and How to Avoid Them

• Unjustified effect size
  Base on prior trials, feasibility studies, or meta-analyses
• No sensitivity analysis
  Show robustness of assumptions using scenarios
• Poor documentation
  Use a pharma SOP checklist for protocol and SAP preparation
• Mismatch between text and code output
  Validate calculations and append software results
• Over-reliance on industry defaults
  Customize parameters for the specific indication and population

Communicating with Regulatory Authorities

Biostatisticians must be prepared to:

• Present assumptions and methods in pre-IND or Scientific Advice meetings
• Address reviewer questions or deficiencies
• Provide clarifying memos or sensitivity analyses upon request

Good communication ensures that statistical rationale is understood and accepted. This builds confidence in trial integrity and results.

Quality by Design (QbD) and Biostatistics

The QbD approach advocated by ICH E8 (R1) emphasizes early involvement of statisticians. Key contributions include:

• Defining critical study assumptions
• Mitigating risks through robust design
• Ensuring operational feasibility of sample size

Conclusion: Biostatisticians Are Guardians of Statistical Credibility

Justifying sample size is more than mathematics—it’s a critical scientific and regulatory exercise. Biostatisticians must ensure that every assumption is credible, every calculation is transparent, and every document is regulator-ready. Their role is central to safeguarding the scientific value, ethical balance, and regulatory acceptability of clinical trials.

Explore More:

• Shelf life prediction
• GMP compliance