Key Metrics to Evaluate Historical Performance of Clinical Trial Sites

Introduction: Why Performance Metrics Drive Feasibility Decisions

Historical performance evaluation is a cornerstone of modern site feasibility processes in clinical trials. It enables sponsors and CROs to identify high-performing sites, reduce startup risks, and meet regulatory expectations. ICH E6(R2) encourages risk-based oversight, and using objective, metric-driven evaluations of previous site activity supports this mandate.

But not all metrics carry the same weight. Some may reflect administrative efficiency, while others directly impact subject safety and data integrity. This article explores the most essential performance metrics used during historical site evaluations and explains how they inform evidence-based feasibility decisions.

1. Enrollment Rate and Projection Accuracy

Why it matters: Sites that consistently meet or exceed enrollment targets without overestimating feasibility are more reliable and less likely to delay trial timelines.

• Metric: Actual enrolled subjects / number of planned subjects
• Projection Accuracy: Ratio of projected vs. actual enrollment per month

For example, if a site predicted 10 patients per month but consistently enrolled 3, this discrepancy highlights poor feasibility planning or operational constraints.

2. Screen Failure and Dropout Rates

Why it matters: High screen failure and dropout rates often indicate poor patient selection, weak pre-screening processes, or suboptimal site support.

• Screen Failure Rate: Number of subjects screened but not randomized ÷ total screened
• Dropout Rate: Subjects who discontinued ÷ total randomized

Target thresholds vary by protocol, but a screen failure rate >40% or dropout rate >20% typically raises concerns during site evaluation.

3. Protocol Deviation Frequency and Severity

Why it matters: Frequent or major deviations can compromise data integrity and subject safety, triggering regulatory action.

• Total Deviations per 100 enrolled subjects
• Major vs. Minor Deviations: Categorized based on impact on eligibility, dosing, or safety

Sample Deviation Severity Table:

Sites with more than 5 major deviations per 100 subjects may require CAPAs before being considered for new trials.

4. Query Resolution Timeliness

Why it matters: Efficient query resolution reflects a site’s operational discipline and familiarity with EDC systems.

• Query Aging: Average number of days taken to resolve a query
• Open Queries >30 Days: Should be minimal or escalated

A best-in-class site maintains an average query resolution time under 5 working days across all studies.

5. Monitoring Findings and Frequency of Follow-Ups

Why it matters: Excessive findings during CRA visits or frequent follow-up visits suggest underlying operational weaknesses.

• Average number of findings per monitoring visit
• Repeat follow-up visits required to close open action items

Sites with strong oversight and training typically have fewer repeated findings and require fewer revisit cycles.

6. Audit and Inspection Outcomes

Why it matters: Sites with prior 483s, warning letters, or serious audit findings may require enhanced oversight or exclusion from high-risk trials.

• Number of audits passed without findings
• CAPA effectiveness from previous audits
• Regulatory inspection results (FDA, EMA, etc.)

Sponsors should track inspection outcomes using internal QA systems or external sources like [EU Clinical Trials Register](https://www.clinicaltrialsregister.eu).

7. Timeliness of Regulatory Submissions and Site Activation

Why it matters: A site’s efficiency in navigating regulatory and ethics submissions predicts startup delays.

• Average time from site selection to SIV (Site Initiation Visit)
• Document turnaround time (CVs, contracts, IRB submissions)

Delays in past studies should be verified with startup trackers and linked to root causes (e.g., internal approvals, IRB issues).

8. Subject Visit Adherence and Data Entry Timeliness

Why it matters: Timely visit execution and data entry contribute to trial compliance and data completeness.

• Visit windows missed per subject (% adherence)
• Average time from visit to EDC entry (in days)

Top-performing sites typically enter data within 48–72 hours of the subject visit and maintain >95% adherence to visit windows.

9. Site Communication and Responsiveness

Why it matters: Sites with responsive teams facilitate better issue resolution and protocol compliance.

• Email turnaround time (measured by CRA logs)
• Meeting attendance (PI and coordinator participation)
• Compliance with sponsor communications and system use

This qualitative metric should be captured through CRA feedback and feasibility interviews.

10. Composite Site Scoring Model

To prioritize and benchmark sites, sponsors may develop composite scores using weighted metrics. Example:

Sites scoring >8.0 may be categorized as high-performing and placed on pre-qualified lists.

Conclusion

Metrics are not just numbers—they are predictive tools for smarter clinical site selection. When used correctly, historical performance metrics allow sponsors to proactively identify high-performing sites, reduce trial risks, and meet global regulatory expectations for risk-based monitoring. By integrating these metrics into feasibility dashboards, CTMS, and TMF documentation, organizations can drive consistent, compliant, and data-driven decisions across the trial lifecycle.

How to Conduct On-Site Capability Audits for Clinical Trial Sites

Introduction: The Role of On-Site Capability Audits

Before initiating a clinical trial at an investigator site, sponsors and CROs must assess whether the site is operationally ready and compliant with GCP and regulatory expectations. While feasibility questionnaires and remote assessments are important, on-site capability audits—also known as pre-study visits (PSVs) or site qualification visits—provide a firsthand evaluation of infrastructure, documentation, staffing, SOPs, and past performance. These audits are critical to ensuring that selected sites can execute the protocol safely, efficiently, and in accordance with local and international regulations.

Conducting thorough on-site capability audits reduces the risk of protocol deviations, delays in startup, and inspection findings during the trial. This article provides a complete, step-by-step framework for conducting these audits, including audit scope, checklist items, documentation requirements, and post-audit follow-up.

1. Objectives of On-Site Capability Audits

The primary goals of a site capability audit include:

• Verifying information provided in feasibility questionnaires
• Assessing infrastructure, staff availability, and training
• Reviewing essential SOPs, equipment, and document control
• Evaluating regulatory preparedness and EC/IRB interaction history
• Determining readiness for sponsor systems (EDC, IRT, eTMF, etc.)
• Documenting findings to support site selection or exclusion

These audits also provide an opportunity to build early rapport with the site and identify training needs prior to site initiation.

2. Pre-Audit Planning and Logistics

Effective site audits begin with comprehensive planning. Sponsors and CROs should:

• Define the audit objectives (e.g., protocol-specific, general readiness)
• Send a formal visit notification to the site with agenda and documents required
• Assign qualified clinical research associates (CRAs) or site auditors
• Develop an audit plan and checklist tailored to the trial type
• Confirm availability of key personnel (PI, study coordinator, lab, pharmacy)

Sites should be instructed to prepare relevant documentation, equipment records, SOP binders, and training logs for review during the audit.

3. Key Audit Areas and Checklist Elements

During the visit, auditors should systematically review the following areas:

3.1. Investigator and Staff Qualifications

• Review of PI and sub-investigator CVs (signed and dated)
• GCP training certificates (within 2 years)
• Organizational chart and staff roles
• Delegation of Duties Log (DOL) – if available

3.2. Infrastructure and Facility Tour

• Dedicated clinical space for patient visits and informed consent
• Secure IP storage (restricted access, temperature monitoring)
• -20°C and -80°C freezer availability with backup power
• Exam room, ECG, phlebotomy, and lab capabilities
• Document archiving areas (fireproof cabinets, access control)

3.3. Equipment and Calibration Records

• Equipment inventory list
• Calibration certificates (within 12 months)
• Preventive maintenance logs
• Service contracts or vendor support details

3.4. SOPs and Quality Systems

• SOP binder with current version-controlled SOPs
• Procedures for IP handling, AE/SAE reporting, source documentation, deviations
• Training logs for SOPs and protocol-specific instructions
• Process for SOP revision and staff notification

3.5. Regulatory and Ethics Committee Documentation

• Past EC/IRB approval letters
• Average approval timelines and submission procedures
• Meeting schedules and submission calendars
• Site regulatory binder availability and completeness

3.6. Technology Readiness

• Internet connectivity and speed test
• Availability of computers with secure access to EDC/IRT
• eConsent capability, if applicable
• Remote monitoring or source upload options

Example Facility Readiness Table:

4. Conducting Interviews with Site Personnel

Auditors should engage with key site staff to assess preparedness, workload, and understanding of their roles. Interviews should include:

• Principal Investigator – oversight strategy, GCP familiarity, competing studies
• Study Coordinator – protocol knowledge, source documentation process
• Pharmacist – IP accountability, temperature excursion handling
• Lab Staff – sample processing, lab manual access, kit inventory management

Interview responses should be documented in the audit report and compared against SOPs and feasibility responses.

5. Documentation and Reporting

Upon completing the audit, the auditor must issue a formal Site Qualification Visit (SQV) report or Audit Report that includes:

• Visit date, location, protocol, and auditor name
• Summary of findings by audit section
• Photographic evidence (if permitted)
• Corrective actions or clarifications required
• Recommendation: Select / Do Not Select / Conditional Approval

The report should be reviewed and approved by sponsor QA or feasibility leads, and stored in the Trial Master File (TMF) under the site qualification section.

6. Post-Audit Follow-Up and Decision Making

If findings are noted, the site should be asked to provide responses or evidence of corrective action before final selection. For example:

• Missing calibration certificates → Submit within 10 business days
• Inadequate GCP training → Staff to complete training within 7 days
• Protocol deviations in prior trial → Submit CAPA plan

Once corrective actions are received and accepted, a final decision on site activation can be made. Conditional approvals should be documented with date-bound resolutions.

7. Regulatory and Inspection Considerations

Regulatory agencies may request audit reports or documentation justifying site selection. Inspectors often review:

• Audit plans and SOPs used for site qualification
• Site qualification reports and follow-up correspondence
• Feasibility data and verification during on-site audit
• Consistency between audit findings and TMF documentation

According to ICH E6(R2), sponsors are responsible for ensuring that sites are qualified and capable before starting any trial-related activities.

8. Best Practices for On-Site Capability Audits

• Use standardized audit checklists across all studies and regions
• Train auditors on protocol-specific risks and critical elements
• Document everything with dates, names, and source references
• Involve quality assurance for high-risk or rescue site audits
• Use digital audit tools (e.g., Veeva Vault, eQMS platforms) for traceability

Conclusion

On-site capability audits are vital to ensuring that clinical trial sites are prepared, qualified, and compliant with GCP and regulatory standards. They provide the most accurate insight into a site’s operational maturity and highlight risks that may not be visible through questionnaires alone. By implementing structured audit frameworks, using comprehensive checklists, and engaging with site teams directly, sponsors can make informed, inspection-ready decisions that support successful trial execution from the start.