Choosing Between Passive and Active Surveillance in Post-Marketing Vaccine Safety

Passive vs Active Surveillance—What They Are and When to Use Each

Passive surveillance collects Individual Case Safety Reports (ICSRs) from clinicians, patients, and manufacturers via national systems (e.g., VAERS/EudraVigilance analogs). It excels at early pattern recognition because it listens broadly: new Preferred Terms, atypical narratives, or demographic clustering can flag emerging issues quickly. Strengths include speed of intake, rich free-text, and relatively low cost. Limitations are well known: no direct denominators, susceptibility to under- or stimulated reporting, duplicate submissions during media spikes, and variable case quality. In passive streams, you will rely on disproportionality statistics (PRR, ROR, EBGM) to identify unusual vaccine–event reporting patterns that merit clinical review.

Active surveillance uses linked healthcare data (EHR/claims/registries, sometimes laboratory feeds) to construct cohorts with person-time denominators. It supports observed-versus-expected (O/E) checks, rapid cycle analysis (RCA) with MaxSPRT boundaries, and confirmatory designs such as self-controlled case series (SCCS) or matched cohorts. Strengths include stable denominators, control of confounding, and ability to estimate incidence rates and relative risks over calendar time. Limitations include access/agreements, data harmonization, lag, and the need for robust governance and validation packs (Part 11/Annex 11 controls, audit trails, and change control). In practice, sponsors rarely choose one or the other: passive detects, active quantifies, and targeted follow-up adjudicates. To align terminology and SOP structure with regulators, many teams adapt practical PV templates from PharmaRegulatory.in, and mirror public expectations summarized by the U.S. FDA.

Comparative Design Considerations: Data, Methods, and Compliance

Surveillance strategy is as much about design and documentation as it is about databases. Passive streams must prove clean inputs: MedDRA version control, explicit Preferred Term selection rules, ICSR de-duplication criteria (e.g., age/sex/onset/lot match), and translation QA for non-English narratives. Active streams must show traceable ETL pipelines, linkage logic, and privacy safeguards. Both must demonstrate ALCOA (attributable, legible, contemporaneous, original, accurate) and computerized system controls: role-based access, validated audit trails, and time synchronization. Pre-declare decision thresholds in your signal management SOP: what PRR/ROR/EBGM constitutes a “screen hit,” what O/E ratio prompts escalation, which risk windows apply by AESI, and when SCCS/cohort studies begin. Link these rules to your Risk Management Plan (RMP) and Statistical Analysis Plan (SAP) so clinical, safety, and biostatistics use the same vocabulary when evidence evolves.

Operationally, success comes from hand-offs. Write a responsibility matrix: safety scientists review screen hits weekly; epidemiology runs O/E; biostatistics maintains RCA/SCCS code; clinical adjudicates with Brighton criteria; QA reviews audit trails; regulatory owns labels and communications. Keep this map in the PSMF and TMF, with links to datasets and code hashes, so an inspector can trace the path from intake to decision without guesswork.

Analytics That Bridge Both: From PRR to O/E, SCCS, and RCA (with Numbers)

Pre-declare screens and thresholds to avoid hindsight bias. In passive data, a common rule is PRR ≥2 with χ² ≥4 and n≥3; ROR with 95% CI excluding 1; EBGM lower bound (e.g., EB05) >2. Combine these with clinical triage: age/sex clustering, time-to-onset after dose, and mechanistic plausibility. In active data, compute O/E using stratified background rates and biologically plausible windows. Example (dummy): Week W, 1,200,000 second doses to males 12–29; background myocarditis 2.1/100,000 person-years → expected in 7 days ≈ 1,200,000 × (7/365) × (2.1/100,000) ≈ 0.48. Observed 6 adjudicated cases → O/E ≈ 12.5 → escalate. Run RCA weekly with MaxSPRT; if the boundary is crossed, initiate SCCS. A typical SCCS result might show IRR 4.6 (95% CI 2.9–7.1) for Days 0–7, IRR 1.8 (1.1–3.0) for Days 8–21.

Where laboratory markers define cases, declare method capability so inclusion is transparent: high-sensitivity troponin I LOD 1.2 ng/L and LOQ 3.8 ng/L (illustrative) for myocarditis adjudication; platelet factor 4 (PF4) ELISA performance for thrombotic syndromes. Keep quality context close to safety: representative PDE 3 mg/day for a residual solvent and cleaning MACO 1.0–1.2 µg/25 cm² reassure reviewers that non-biological explanations (contamination, carryover) are unlikely. For a plain-language overview of signal expectations and pharmacovigilance vocabulary, the WHO library provides accessible references at who.int/publications.

Designing a Hybrid Surveillance Program: A Step-by-Step Playbook

Step 1 — Define AESIs and windows. Pre-register adverse events of special interest (AESIs) by platform (e.g., myocarditis for mRNA, TTS for vector vaccines) with Brighton definitions and risk windows (0–7, 8–21 days, etc.). Step 2 — Map data flows. Draw a single diagram linking ICSRs → coding/deduplication → screen queue; and registries/EHR/labs → ETL → O/E/RCA/SCCS pipelines. Step 3 — Write thresholds. Document PRR/ROR/EBGM cut-offs, O/E escalation rules, RCA boundary settings, and SCCS triggers. Step 4 — Validate systems. For passive, validate ICSR intake (E2B R3), MedDRA versioning, translation QA, and audit trails. For active, validate linkage logic, ETL checkpoints, time sync, and back-ups under Part 11/Annex 11; containerize analytics and lock code hashes. Step 5 — Staff governance. Run a weekly multi-disciplinary signal review (safety, clinical, epidemiology, biostatistics, quality, regulatory) with minutes, owners, and due dates. Step 6 — Pre-write communications. Draft label/FAQ templates so confirmed signals can be communicated with denominators and plain language quickly.

Keep a one-page crosswalk in the TMF: SOP → dataset → code → output → decision → label. If a screen hit escalates, an inspector should be able to start at the decision memo and walk back to the raw ICSR and the database cut that produced the O/E.

Case Study (Hypothetical): Turning Noisy Signals into Decisions

Week 1–2 (Passive): 20 myocarditis ICSRs in males 12–29 after dose 2; PRR 3.0 (χ² 9.2), EB05 2.2. Narratives cite chest pain and elevated troponin (above assay LOQ 3.8 ng/L). Week 3 (Active O/E): 1.2 M doses administered; background 2.1/100,000 person-years; expected 0.48; observed 6 adjudicated Brighton Level 1–2 → O/E 12.5. Week 4 (RCA): MaxSPRT boundary crossed in Days 0–7; geographies consistent. Week 5–6 (SCCS): IRR 4.6 (2.9–7.1) for Days 0–7; IRR 1.8 (1.1–3.0) for Days 8–21. Decision: add myocarditis to important identified risks; update label/HCP guidance with absolute risks (“~12 per million second doses in young males within 7 days”). Quality check: lots in shelf life; cold chain in range; representative PDE 3 mg/day and MACO 1.0–1.2 µg/25 cm² unchanged—reducing concern for non-biological drivers.

The full package—ICSRs, coding rules, O/E worksheets, RCA configs, SCCS code/outputs, adjudication minutes, and quality context—goes into the TMF and supports rapid, defensible labeling.

KPIs, Governance, and Inspection Readiness: Keeping the System Alive

Measure both surveillance performance and decision speed. Surveillance KPIs: % valid ICSRs triaged ≤24 h, screen hits reviewed per SOP cadence, median days from screen to O/E, RCA boundary checks on schedule, % adjudications completed within SLA. Quality KPIs: audit-trail review completion, ETL error rate, linkage success, reproducibility checks (code hash matches), and completeness scores for ICSRs. Decision KPIs: time to label update, time to DHPC release, and % of decisions backed by confirmatory analytics.

Inspection readiness is narrative clarity plus evidence. Keep a “read me first” note in the TMF that maps SOPs → data cuts → code → outputs → decisions. Store all public communications (FAQs, HCP letters) with the analytics that support them. For method calibration, run periodic negative-control screens so your system demonstrates specificity, not just sensitivity.

How to Run Phase IV Vaccine Safety Monitoring the Right Way

Phase IV Safety Monitoring: Purpose, Scope, and Regulatory Context

Phase IV (post-marketing) safety monitoring ensures that a licensed vaccine maintains a favorable benefit-risk profile in real-world use, across broader populations and longer timeframes than pre-licensure trials. The aims are to detect new risks (rare adverse events or AESIs), characterize known risks under routine conditions, and verify risk minimization effectiveness. This work sits within a formal pharmacovigilance (PV) system led by a Qualified Person Responsible for Pharmacovigilance (QPPV) and documented in a PV System Master File (PSMF). Core outputs include signal detection/evaluation records, expedited safety reports where applicable, and periodic aggregate reports—PSURs/PBRERs—summarizing global safety data and benefit-risk conclusions across each data lock point (DLP).

Because vaccines are administered to healthy individuals at scale, regulators expect robust case definitions (e.g., Brighton Collaboration), rapid case validation, and background rate comparisons to contextualize observed events. Post-authorization safety studies (PASS) may be mandated in the Risk Management Plan (RMP) to address uncertainties (e.g., use in pregnancy, rare neurologic events). Inspections assess whether data are ALCOA (attributable, legible, contemporaneous, original, accurate), whether safety databases are validated and access-controlled, and whether decisions are traceable to contemporaneous minutes and CAPA. A well-engineered Phase IV program integrates medical review, biostatistics, epidemiology, quality, and regulatory teams to ensure findings translate swiftly into communication, labeling updates, and if needed, risk minimization measures.

Building the Pharmacovigilance System: People, Processes, and Technology

A scalable PV system combines clear roles, controlled procedures, and validated tools. At minimum, define the QPPV and deputy, a safety physician for medical review, case processing teams, an epidemiologist/biostatistician for signal analytics, and quality/regulatory partners. Author and control SOPs for case intake, triage, duplicate management, coding (MedDRA), narratives, expedited reporting, aggregate reporting, and signal management. Your safety database must be validated for data migration, code lists, user roles, and audit trails; interface specifications should cover literature monitoring and EHR/registry feeds. Training records, role-based access, and change control are inspection focal points.

Case processing quality hinges on unambiguous intake forms and consistent medical coding. Build a reference library with AESI definitions, seriousness criteria, and causality frameworks. For practical templates—intake checklists, triage worksheets, and narrative shells—review resources such as PharmaSOP, adapting them to your QMS and PSMF. Technology should support near-real-time dashboards (weekly counts by preferred term/site/country), signal algorithms, and case reconciliation with partners or licensees. Finally, pre-agree governance: a cross-functional Safety Management Team meets at defined cadence (e.g., weekly during launch) and escalates to a senior Safety Review Board for labeling or RMP changes.

Data Sources: Passive vs Active Surveillance and Real-World Data Integration

Phase IV blends passive surveillance (spontaneous reports from HCPs, patients, and partners) with active surveillance that proactively measures incidence. Passive sources include national systems (e.g., VAERS, EudraVigilance) and manufacturer hotlines; strengths are broad coverage and early signal detection, while limitations include under-reporting and reporting bias. Active strategies—sentinel sites, cohort event monitoring, claims/EHR database analyses, and registry linkages—enable rate estimates, risk windows, and confounder adjustment. A test-negative design can support vaccine safety/effectiveness sub-studies when embedded in surveillance networks.

Pre-specify case capture windows (e.g., 0–42 days post-dose for neurologic AESI), matching rules, and validation steps. Ensure data-use agreements and privacy controls are in place and auditable. When laboratory confirmation is needed (e.g., platelet counts or cardiac enzymes), coordinate with validated labs and define thresholds—example analytical parameters: LOD 0.20 ng/mL and LLOQ 0.50 ng/mL for a biomarker assay, precision ≤15%—so downstream analyses are reproducible and defensible.