Published on 21/12/2025
Regulatory Review of Sample Size Calculations in Clinical Trials
Sample size justification is a key aspect of any clinical trial design. It directly impacts statistical power, ethical integrity, and regulatory approval. Regulatory agencies such as the USFDA, EMA, and others rigorously evaluate sample size calculations as part of the protocol and statistical analysis plan (SAP) to ensure trials are appropriately powered and well justified.
This article provides guidance for biostatisticians and regulatory professionals on how regulatory bodies review sample size calculations, what documents must be prepared, and how to avoid common pitfalls in the submission process.
Why Sample Size Justification is Reviewed
Regulatory authorities assess whether a trial’s sample size:
- Ensures adequate statistical power for the primary endpoint
- Aligns with the trial objective (superiority, non-inferiority, equivalence)
- Is ethically sound—neither exposing too many nor too few subjects
- Is based on realistic and evidence-based assumptions
The review process ensures credibility of trial outcomes and optimizes risk–benefit balance.
Where Sample Size Details Appear in Regulatory Submissions
- Clinical Study Protocol (CSP): Summary explanation of sample size rationale
- Statistical Analysis Plan (SAP): Full technical detail, equations, assumptions, and references
- Common Technical Document (CTD): Module 2.7.2 (Clinical Summary), and Module 5 (full trial
Agencies expect consistency across these documents with traceable source data.
Regulatory Expectations for Sample Size Components
Agencies like the FDA and EMA scrutinize the following components during review:
1. Hypotheses and Endpoints
- Clearly defined null and alternative hypotheses
- Well-specified primary endpoint (clinical or surrogate)
2. Statistical Parameters
- Type I error (typically 0.05 two-sided)
- Statistical power (commonly 80–90%)
- Effect size (based on previous studies or clinical relevance)
- Standard deviation or variability (from historical data or pilot trials)
- Dropout rate (justified based on previous trial behavior)
3. Methodology
- Exact formulas or simulations used to calculate sample size
- Assumptions must be transparent and justified
- Software used (e.g., nQuery, SAS, R, East) should be validated
- Simulation code should be included if used in Bayesian or adaptive designs
Common Regulatory Questions During Review
- What is the basis for the assumed effect size?
- Why was a 15% dropout rate assumed—do you have data to support this?
- How sensitive is your sample size to variability in standard deviation?
- Was the same population used for variance estimation as the proposed trial?
- Do you plan to adjust sample size mid-trial (SSR)?
Biostatisticians must be prepared to justify each parameter, referencing published data or trial history.
Example: EMA Review Comment and Response
Comment: The assumed treatment difference of 0.6% in HbA1c appears optimistic. Please justify or adjust sample size accordingly.
Response: The assumed effect size was derived from the sponsor’s Phase II study (Study XYZ-201), where a 0.62% reduction was observed vs placebo in a similar population. A sensitivity analysis using 0.5% was performed, showing a required sample size of 420 vs original 368, which would be feasible within the current recruitment plan.
Best Practices for Regulatory Approval
- Pre-plan all assumptions: Reflect assumptions in both the protocol and SAP
- Use realistic data sources: Phase II trials, meta-analyses, or RWE
- Perform sensitivity analyses: Vary key parameters to show robustness
- Document clearly: Ensure all calculations are reproducible and auditable
- Prepare for follow-up questions: Use Pharma SOP templates to create internal memos and responses
Tools to Support Regulatory Sample Size Justification
- nQuery Advisor, PASS, East: Industry-standard tools for fixed and adaptive designs
- R and SAS: For custom simulation-based methods
- Pharma validation documents ensure statistical tool qualification
- Document control: Use versioning for SAPs and protocol updates
ICH Guidelines Supporting Sample Size Documentation
- ICH E9: Emphasizes pre-specification and justification of sample size
- ICH E8 (R1): Encourages Quality by Design (QbD), linking design to clinical objectives
- ICH E10: Context for placebo control and treatment effect estimation
Regulatory Strategies for Complex Designs
Bayesian or Adaptive Designs:
- Provide simulation reports and operating characteristics
- Justify priors and model assumptions
- Clarify conditions for sample size re-estimation (SSR)
Multiple Comparisons:
- Adjust Type I error for multiplicity
- Use Dunnett, Bonferroni, or FDR methods
- Explain the impact of adjustment on power and sample size
Ethical and Operational Implications
Regulators evaluate sample size for ethical reasons as well. An overpowered study exposes more patients than necessary, while an underpowered study may yield inconclusive results, wasting resources and risking false negatives.
Considerations must also address trial feasibility, timelines, and cost without compromising data integrity.
Conclusion: Transparency, Evidence, and Robustness Are Key
The regulatory review of sample size calculations is more than a checkbox. It is a deep-dive assessment of your trial’s credibility, feasibility, and scientific rigor. Biostatisticians must provide clear justifications, support assumptions with evidence, and anticipate questions. When done right, a well-documented sample size plan sets the foundation for successful trial execution and approval.