Evaluating Past Site Performance: A Key to Smarter Clinical Trial Feasibility

Introduction: Why Historical Site Performance Matters

In the competitive landscape of clinical trials, choosing the right sites can make or break a study. One of the most predictive indicators of future success is a site’s historical performance in prior trials. Regulators like the FDA and EMA expect sponsors and CROs to use past performance as part of risk-based site selection under ICH E6(R2) guidelines.

Evaluating site performance isn’t simply about how fast a site can enroll. It includes understanding past enrollment trends, protocol deviation rates, audit findings, data quality issues, and patient retention patterns. This article provides a detailed methodology for assessing historical site performance as part of a robust feasibility process, supported by real-world examples and performance dashboards.

Key Performance Indicators (KPIs) for Site History Evaluation

To evaluate a site’s past performance, sponsors should examine a mix of quantitative and qualitative KPIs. These include:

• Actual vs. projected enrollment rates
• Screen failure ratios and dropout rates
• Frequency and severity of protocol deviations
• Query resolution timelines and data quality metrics
• Audit findings (internal, sponsor, and regulatory)
• Inspection outcomes (e.g., FDA 483s, Warning Letters)
• Timeliness of regulatory and EC submissions
• Monitoring burden (e.g., number of follow-ups required)

These metrics should be reviewed for at least 3–5 previous trials, ideally within the same therapeutic area and trial phase.

Sources of Historical Site Performance Data

Collecting past performance data requires a blend of internal systems, external databases, and direct site engagement. Typical sources include:

• CTMS (Clinical Trial Management System): Site visit logs, enrollment data, deviation reports
• EDC Systems: Query logs, data entry timelines, SDV delays
• Monitoring Reports: CRA visit notes, risk indicators
• Trial Master File (TMF): Inspection reports, CAPAs, and audit summaries
• Regulatory Databases: Publicly available inspection databases like [FDA 483 Database](https://www.fda.gov/inspections-compliance-enforcement-and-criminal-investigations/inspection-technical-guides/fda-inspection-database)
• WHO ICTRP or [ClinicalTrials.gov](https://clinicaltrials.gov): Used to identify prior studies at the site or by the PI

Sample Performance Scorecard Template

A standardized scorecard helps quantify site performance for comparative analysis.

Such tools allow sponsors to adopt objective, data-driven site selection methodologies.

Case Study: Impact of Historical Performance on Site Choice

In a global oncology trial, Sponsor X was selecting 40 sites across Europe and Asia. Site X1 had responded quickly to feasibility and had solid infrastructure. However, their CTMS record showed:

• 8 major protocol deviations in the last study
• 2 instances of delayed AE reporting
• 5 subject dropouts within the first 4 weeks

Despite strong initial feasibility responses, these historical indicators led the sponsor to deselect the site. Another site with moderate infrastructure but better historical KPIs was chosen instead, reducing overall trial risk.

How to Score and Benchmark Sites

Organizations can develop internal scoring systems based on historical metrics. A basic example includes:

• Enrollment performance: 30 points
• Protocol compliance: 30 points
• Data quality: 20 points
• Inspection/audit history: 20 points

Sites scoring above 80 may be pre-qualified. Those under 60 should be considered only with additional oversight or justification.

Integrating Performance Data into Feasibility Systems

To make site history actionable, integration into planning systems is essential:

• Link CTMS and feasibility dashboards for real-time performance scoring
• Use machine learning to predict high-risk sites based on historical patterns
• Tag underperforming sites with audit flags or CAPA requirements
• Centralize all prior audit and deviation data into the site master profile

Organizations using integrated platforms report faster site selection, improved regulatory compliance, and better patient retention.

Regulatory Expectations for Documenting Site Selection

Per ICH E6(R2), sponsors must “select qualified investigators and sites” and provide documentation to justify their selection. Key expectations include:

• Documented rationale for site inclusion or exclusion
• Evidence of performance metrics and monitoring trends
• Identification and mitigation of prior compliance issues
• Storage of evaluations in the TMF for inspection purposes

EMA inspectors, for example, may request justification for selecting a site with prior inspection findings or underperformance, especially if not mitigated by CAPAs.

Best Practices for Historical Site Review

• Review minimum 3 prior trials within the last 5 years
• Include PI-specific metrics as well as site-wide data
• Engage QA to review audit and CAPA history
• Cross-check with public databases (e.g., FDA 483s, EU CTR)
• Use scorecards to support selection meetings and approvals
• Archive all scoring and rationale documents in the TMF

Conclusion

Evaluating a site’s past performance is a critical component of modern, risk-based clinical trial feasibility. It ensures that decisions are informed, justified, and aligned with regulatory expectations. Sponsors and CROs that adopt structured performance reviews—integrated with feasibility workflows and planning systems—can reduce trial risks, enhance subject safety, and accelerate startup timelines. As trials become more complex and globalized, historical data will remain a core strategic asset in clinical operations planning.

Enhancing Site Selection and Feasibility Using KRIs

Introduction: Why Site Selection Matters in RBM

One of the most pivotal decisions in any clinical trial is choosing the right investigational sites. A poor-performing site can lead to protocol deviations, data quality issues, delays in subject enrollment, and regulatory risks. Traditionally, site selection has been based on investigator reputation, self-reported metrics, and past relationships. However, Risk-Based Monitoring (RBM) introduces a data-driven layer to this process—Key Risk Indicators (KRIs).

KRIs bring objectivity by assessing historical performance across metrics like data entry lag, deviation frequency, protocol compliance, and query resolution rates. Leveraging KRIs during feasibility and site selection helps sponsors identify low-risk sites that align with trial complexity. As per ICH E6(R2) and FDA’s RBM guidance, integrating KRIs into feasibility ensures risk-proportionate oversight from the very beginning.

What KRIs Are Relevant for Site Selection?

During the feasibility phase, sponsors and CROs can evaluate a site’s past and predicted performance using the following KRIs:

• Data Entry Timeliness: Average delay in entering CRF data
• Query Resolution Rate: % of queries resolved within 7–14 days
• Protocol Deviation Rate: Per subject or per enrolled patient
• Audit/Inspection Findings: Frequency and severity of GCP issues
• Enrollment Forecast Accuracy: Difference between projected and actual recruitment
• Informed Consent Error Rate: History of ICF documentation issues

These KRIs are extracted from previous trials through CTMS, eTMF, or clinical data repositories. In adaptive trials or complex oncology studies, these indicators are especially critical.

Building a KRI-Based Site Scorecard

To streamline decision-making, sponsors often build a site feasibility scorecard integrating KRI data. An example is shown below:

This scorecard helps prioritize site qualification visits, additional feasibility questions, or exclusion if risk exceeds a threshold. For feasibility SOP templates, visit PharmaSOP.

Incorporating KRIs into Site Feasibility Questionnaires

To formalize the KRI evaluation, feasibility questionnaires can be expanded to ask site teams about their historical metrics. Sample additions include:

• Average time to complete eCRFs in past 3 studies
• Number of critical audit findings in past 2 years
• Deviation rate per trial phase
• Success rate in meeting enrollment targets

Responses can be validated using CTMS or sponsor-maintained dashboards. This shifts feasibility from subjective estimation to evidence-based selection.

Using KRIs to Match Protocol Complexity with Site Capability

Not every site is suited for every protocol. Complex protocols with adaptive randomization, narrow visit windows, or intensive data collection demand high-performing sites. Using KRIs, sponsors can match:

• Complex PK Sampling Trials: Require sites with low data lag and zero critical deviations
• Pediatric Trials: Need sites with ICF compliance history and trained staff
• Decentralized Trials: Favor sites with remote data handling capabilities and fast query closure

This matching reduces downstream protocol violations and improves patient safety. It also minimizes the need for corrective actions mid-study.

Regulatory Benefits and Risk Mitigation

Regulatory authorities increasingly expect that site selection is part of risk assessment. EMA’s Reflection Paper and ICH E6(R2) both encourage structured feasibility and site qualification based on past performance.

During inspections, regulators may ask for documentation of:

• Site evaluation criteria
• Performance benchmarks
• Reasons for site exclusion
• Action plans for high-risk sites that were included

Using KRIs as documented criteria demonstrates proactive quality risk management aligned with GCP expectations. Visit PharmaValidation to explore validation workflows for site feasibility tools.

Best Practices for Using KRIs in Feasibility

• Maintain a central repository of site-level KRIs across previous trials
• Involve CRA, QA, and Medical Monitors in scoring methodology
• Use predictive models to correlate KRI history with trial performance
• Balance KRI metrics with therapeutic area expertise and patient access
• Revalidate KRI thresholds periodically across therapeutic portfolios

Effective site selection is both an operational and scientific decision. KRIs provide the missing link to forecast site success accurately.

Conclusion

Integrating KRIs into site selection and feasibility ensures a proactive, data-driven approach to clinical trial success. It minimizes avoidable risks, aligns with regulatory expectations, and streamlines monitoring efforts downstream. In the RBM era, feasibility without KRIs is an incomplete strategy.

Further Reading

• FDA Risk-Based Monitoring Guidance
• EMA Reflection Paper on Risk-Based Quality Management
• ICH E6(R2) Guideline