key: cord-0955365-ygsot5y7
authors: Abara, Winston E; Gee, Julianne; Delorey, Mark; Tun, Ye; Mu, Yi; Shay, David K; Shimabukuro, Tom
title: Expected Rates of Select Adverse Events following Immunization for COVID-19 Vaccine Safety Monitoring
date: 2021-12-27
journal: J Infect Dis
DOI: 10.1093/infdis/jiab628
sha: 5db455b094c1b7350616e8e0a4b9676a8b9f8dec
doc_id: 955365
cord_uid: ygsot5y7

Using meta-analytic methods, we calculated expected rates of 21 potential adverse events of special interest (AESI) that would occur following COVID-19 vaccination within 1-, 7-, and 42-day intervals without causal associations. Based on these expected rates, if 10,000,000 persons are vaccinated, 0.5, 3.7, and 22.5 Guillain-Barre syndrome cases; 0.3, 2.4, and 14.3 myopericarditis cases; and 236.5, 1655.5, and 9932.8 all-cause deaths would occur coincidentally within 1, 7, and 42 days post-vaccination, respectively. Expected rates of potential AESI can contextualize events associated temporally with immunization, aid in safety signal detection, guide COVID-19 vaccine health communications, and inform COVID-19 vaccine benefit-risk assessments.

As of August 2021, three vaccines are being used in the United States to prevent severe COVID-19 (1) . Since emergency use authorization of these vaccines, large-scale COVID-19 vaccination programs have been implemented in the United States. Given the unprecedented speed of COVID-19 vaccine development, the use of novel vaccine technologies, and rapid large-scale national COVID-19 vaccination, it is reasonable that people may have concerns about vaccine safety (2) .

Mild to moderate local or systematic reactions after COVID-19 vaccination are common;

reports of anaphylaxis and other serious adverse events such as myocarditis, thrombosis with thrombocytopenia syndrome (TTS), or Guillain-Barré syndrome (GBS) have been rare (3) . Although a close temporal association between vaccination and an adverse event does not establish that the vaccine caused the event, such temporally associated events may lead to greater concern than more remote events. Public concern about vaccine safety can contribute to vaccine hesitancy, result in vaccine misinformation, and adversely affect vaccine uptake (4) . The U.S. COVID-19 vaccine safety program comprehensively monitors the safety of all authorized COVID-19 vaccines to assess if potential adverse events are vaccine-related and exceed the expected background rate (i.e., incidence rate observed in a given population in the absence of vaccination). This monitoring is vital to ensuring safe vaccines and to promote vaccine confidence among the public.

Knowledge of the expected rates of medical conditions that would occur coincidentally (i.e., as a result of background incidence) in the U.S. population aids COVID-19 vaccine safety surveillance efforts by providing a baseline to determine if observed rates of adverse events following vaccination exceed expected rates regardless of vaccination. This information can also guide COVID-19 vaccine safety communication to the public and inform benefit-risk analyses of COVID-19 vaccines. We calculated background rates and estimated expected rates of 21 medical conditions considered potential adverse events of special interest (AESI) following COVID-19 vaccination and calculated the expected rates of each AESI that would coincidentally occur among vaccinated A c c e p t e d M a n u s c r i p t 4 persons in the general population within 1 day, 7 days, and 42 days after vaccination due to chance alone.

For this analysis, we used a list of medical conditions considered potential AESI following COVID-19 vaccination from Gubernot et al. (5) (Supplemental Table 1 ). This list was compiled by vaccine safety experts from the Centers for Disease Control and Prevention (CDC) and FDA; medical conditions considered as AESI were selected based on general or historical vaccine safety monitoring outcomes and theoretical concerns related to COVID-19 disease outcomes

We reviewed the articles considered by Gubernot et al. (5) . We restricted eligible studies for this analysis to those that were published in English, described a systematic process for case identification, used established and widely accepted case definitions, and included cases identified from a well-enumerated U.S. population, and reported a denominator (person-years) and numerator (number of events). If the denominator was not available in the article, we used the reported incidence rate and numerator to estimate a denominator. We excluded published articles that focused only on specific sub-populations (e.g. based on age, sex, and ethnicity), reported incidence rates from a non-U.S. population, were published prior to 1970, or where the denominator and numerator were missing.

General population rates and rates by age group and sex for all-cause mortality, and mortality attributed to heart disease and cerebrovascular disease were obtained from the National Vital Statistics System (NVSS) (6) . We obtained sudden cardiac death rates from the American Heart Association's Heart Diseases and Stroke Statistics 2020 update report (7) .

We used meta-analytic methods to estimate pooled rates of potential AESI using incidence rates obtained from eligible incidence studies for each medical condition considered as an AESI after A c c e p t e d M a n u s c r i p t 5 COVID-19 vaccination. We used the 'metarate' function in R package meta v. 4.15-1 to conduct a random effects model to estimate a pooled incidence rate and 95% confidence interval (95% CI) for each AESI. The pooled incidence rate and 95% CI was used as the background rate for each AESI. For medical conditions where only one article met the eligibility criteria, we used the reported incidence rate and 95% CI as the background rate. Because we obtained rates for all mortality events from one source, we used the reported mortality rate for each mortality event as the background rate.

Using the derived background rates, we calculated the number of expected AESI that would occur coincidentally (i.e., not vaccine-related but as a result of background incidence) in 10,000,000 vaccinated people in the general U.S. population within 1 day, 7 days, and 42 days after vaccination with a COVID-19 vaccine. These post-vaccination time intervals were selected because the initial symptoms of an AESI commonly occur within hours and up to 42 days after vaccination, although they could occur later as well. To calculate the number of expected coincident AESI we divided the background rate by 365.25 to obtain a daily rate and by 100,000 to obtain a daily incidence rate per person. Then, we calculated the product of the daily incidence rate per person for each AESI, the number of vaccinated people (10,000,000), and the associated post-vaccination time interval (1 day, 7 days, or 42 days). For example, an AESI with a background rate of 1.87/100,000 person-years would yield a daily incidence rate per person of 0.0000000512. The product of the daily incident AESI rate per person (0.0000000512), the number of vaccinated people (10,000,000), and the postvaccination time interval (7 days in this case) is 3.58. Thus, we would expect to observe 3.6 cases of the AESI to occur coincidentally in 10,000,000 vaccinated people in the general population within 7 days of receiving a COVID-19 vaccine, assuming a background rate of 1.87/100,000 person-years.

This analysis was exempt from Institutional Review Board review as it did not involve collection of original data from human subjects.

A c c e p t e d M a n u s c r i p t 6

We summarize the background rates and estimated expected rates for Guillain-Barre Syndrome, myopericarditis, all-cause deaths and deaths caused by diseases of the heart, cerebrovascular diseases, and sudden cardiac events below and in Table 1 . The background rates and expected rates for the remaining 14 AESI are summarized in the supplemental file and supplemental Table 2 .

We estimated a background rate of 2.0/100,000 person-years after a meta-analysis of six incidence studies of Guillain-Barre syndrome (8) (9) (10) (11) (12) (13) . Based on this background rate, we estimated that we would expect 0.5 coincident cases in 10,000,000 vaccinated persons within 1 day of vaccination; 3.7 coincident cases in 10,000,000 vaccinated persons within 7 days of vaccination; and 22.4 coincident cases in 10,000,000 vaccinated persons within 42 days of vaccination.

We used the incidence rate from one study (14) as the background rate for myopericarditis 

We used all-cause mortality rate from NVSS (6) as the background rate for all-cause deaths (863.8/100,000 persons). We estimated that we would expect 236.5 coincident all-cause deaths in 10,000,000 vaccinated people within 1 day of vaccination; 1,655.5 coincident all-cause deaths in 10,000,000 vaccinated people within 7 days of vaccination; and 9,932.8 coincident all-cause deaths in 10,000,000 vaccinated people within 42 days of vaccination. The expected rates increased progressively by age and was consistently higher in males than females.

A c c e p t e d M a n u s c r i p t 7

Using heart disease mortality rate from (6) as the background rate for deaths attributed to heart disease (198.8/100,000 persons) , we estimated that we would expect 54.4 coincident deaths attributed to heart disease among 10,000,000 vaccinated people within 1 day of vaccination; 381.0 coincident deaths attributed to heart disease among 10,000,000 vaccinated people within 7 days of vaccination; and 2,286.0 coincident deaths attributed to heart disease among 10,000,000 vaccinated people within 42 days of vaccination. The expected rates increased progressively by age and was consistently higher in males than females.

Using cerebrovascular disease mortality rate (6) as the background rate for deaths attributed to cerebrovascular disease (44.9/100,000 persons) , we estimated that we would expect 12.3 coincident cerebrovascular disease deaths among 10,000,000 vaccinated people within 1 day of vaccination; 86.1 coincident cerebrovascular deaths among 10,000,000 vaccinated people within 7 days of vaccination; and 516.3 coincident cerebrovascular deaths among 10,000,000 vaccinated people within 42 days of vaccination. The expected rates increased progressively by age and was higher in females than males.

We used the mortality rate attributed to sudden cardiac events (97.1/100,000 persons) (7) as the background rate. Based on this background rate, we estimated that we would observe 26.6 coincident sudden cardiac deaths in 10,000,000 vaccinated people within 1 day of vaccination; 186.1 sudden cardiac deaths in 10,000,000 vaccinated people within 7 days of vaccination; and 1,116.6 coincident sudden cardiac deaths in 10,000,000 vaccinated people within 42 days of vaccination. The expected rates increased progressively by age and was consistently higher in males than females.

We estimated rates of select medical conditions considered potential AESI expected to occur among vaccinated persons in the general U.S. population within 1 day, 7 days, and 42 days Expected rates of these medical outcomes in the general population can also inform public health safety communication about the COVID-19 vaccine (4, 5) . Spurious associations between vaccination and adverse health events can undermine vaccine acceptance and uptake and present challenges to achieving community immunity that is necessary for population-level protection (4).

Communicating COVID-19 vaccine safety information to the public that explains that the observed rate of potential AESI in the vaccinated population is not greater than what would be expected in the absence of vaccination may help the public better understand that these events are coincident occurrences, that are temporally but not causally associated with vaccination (4). Framing vaccine safety communication this way may assuage vaccine safety concerns. Knowledge of expected rates of a potential AESI can also be useful in benefit-risk assessments of specific COVID-19 vaccines (15) .

There are limitations to this analysis. We only calculated expected rates for a limited set of medical conditions considered as potential AESI based on the list developed by Gubernot and colleagues (5) . This list does not represent the full spectrum of potential vaccine safety outcomes of concern. Generalizability of the expected rates of some AESI to subpopulations (e.g., age, sex, and race/ethnicity) is limited because we lacked incidence rate by subpopulations. Changes in healthcare utilization during the COVID-19 pandemic may affect the background rates of some AESI and thus, the expected rates, limiting the generalizability of these findings. We calculated expected rates of potential AESI based on background rates obtained from incidence studies, consequently, there may be residual or confounding biases in the studies that we could not adequately control. The expected A c c e p t e d M a n u s c r i p t 9 rates of AESI presented here are based on U.S. studies and likely are not applicable to most non-U.S.

populations. At the time of this analysis, there were no published papers available that report U.S. incidence estimates for TTS and myocarditis, AESI that have been associated with COVID-19 vaccination. We were therefore unable to calculate their background or expected rates.

In conclusion, knowledge of expected rates of potential AESI in vaccinated persons in the general population is vital to COVID-19 vaccine safety monitoring, distinguishing vaccine-related events from coincident events that are temporally associated with but unrelated to vaccination, informing public health COVID-19 vaccine safety communication, promoting public confidence in the vaccine, and conducting specific COVID-19 vaccine benefit-risk assessments.

A c c e p t e d M a n u s c r i p t M a n u s c r i p t 12 

Interim estimates of vaccine effectiveness of BNT162b2 and mRNA-1273 COVID-19 vaccines in preventing SARS-CoV-2 infection among health care personnel, first responders, and other essential and frontline workers-eight US locations

Public trust and willingness to vaccinate against COVID-19 in the US from

First month of COVID-19 vaccine safety monitoring-United States

Importance of background rates of disease in assessment of vaccine safety during mass immunisation with pandemic H1N1 influenza vaccines

US Population-Based background incidence rates of medical conditions for use in safety assessment of COVID-19 vaccines

Vital statistics online data portal 2020

Heart disease and stroke statistics-2020 update: a report from the American Heart Association

Lack of association of Guillain-Barré syndrome with vaccinations

Guillain-Barré syndrome: clinicoepidemiologic features and effect of influenza vaccine

Guillain-Barré syndrome incidence in a large United States cohort

Guillain-Barré syndrome during the 2009-2010 H1N1 influenza vaccination campaign: population-based surveillance among 45 million Americans

Rates of autoimmune diseases in Kaiser Permanente for use in vaccine adverse event safety studies

Guillain-Barré syndrome: incidence and mortality rates in US hospitals

Myopericarditis and pericarditis in the deployed military member: a retrospective series

Use of COVID-19 vaccines after reports of adverse events among adult recipients of Janssen (Johnson & Johnson) and mRNA COVID-19 vaccines (Pfizer-BioNTech and Moderna): update from the Advisory Committee on Immunization Practices-United States