key: cord-0746557-cwekmw1a authors: Barda, Noam; Dagan, Noa; Ben-Shlomo, Yatir; Kepten, Eldad; Waxman, Jacob; Ohana, Reut; Hernán, Miguel A.; Lipsitch, Marc; Kohane, Isaac; Netzer, Doron; Reis, Ben Y.; Balicer, Ran D. title: Safety of the BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Setting date: 2021-08-25 journal: N Engl J Med DOI: 10.1056/nejmoa2110475 sha: 9a7163b89697a76602bab21a2168456ad64b0a0c doc_id: 746557 cord_uid: cwekmw1a BACKGROUND: Preapproval trials showed that messenger RNA (mRNA)–based vaccines against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) had a good safety profile, yet these trials were subject to size and patient-mix limitations. An evaluation of the safety of the BNT162b2 mRNA vaccine with respect to a broad range of potential adverse events is needed. METHODS: We used data from the largest health care organization in Israel to evaluate the safety of the BNT162b2 mRNA vaccine. For each potential adverse event, in a population of persons with no previous diagnosis of that event, we individually matched vaccinated persons to unvaccinated persons according to sociodemographic and clinical variables. Risk ratios and risk differences at 42 days after vaccination were derived with the use of the Kaplan–Meier estimator. To place these results in context, we performed a similar analysis involving SARS-CoV-2–infected persons matched to uninfected persons. The same adverse events were studied in the vaccination and SARS-CoV-2 infection analyses. RESULTS: In the vaccination analysis, the vaccinated and control groups each included a mean of 884,828 persons. Vaccination was most strongly associated with an elevated risk of myocarditis (risk ratio, 3.24; 95% confidence interval [CI], 1.55 to 12.44; risk difference, 2.7 events per 100,000 persons; 95% CI, 1.0 to 4.6), lymphadenopathy (risk ratio, 2.43; 95% CI, 2.05 to 2.78; risk difference, 78.4 events per 100,000 persons; 95% CI, 64.1 to 89.3), appendicitis (risk ratio, 1.40; 95% CI, 1.02 to 2.01; risk difference, 5.0 events per 100,000 persons; 95% CI, 0.3 to 9.9), and herpes zoster infection (risk ratio, 1.43; 95% CI, 1.20 to 1.73; risk difference, 15.8 events per 100,000 persons; 95% CI, 8.2 to 24.2). SARS-CoV-2 infection was associated with a substantially increased risk of myocarditis (risk ratio, 18.28; 95% CI, 3.95 to 25.12; risk difference, 11.0 events per 100,000 persons; 95% CI, 5.6 to 15.8) and of additional serious adverse events, including pericarditis, arrhythmia, deep-vein thrombosis, pulmonary embolism, myocardial infarction, intracranial hemorrhage, and thrombocytopenia. CONCLUSIONS: In this study in a nationwide mass vaccination setting, the BNT162b2 vaccine was not associated with an elevated risk of most of the adverse events examined. The vaccine was associated with an excess risk of myocarditis (1 to 5 events per 100,000 persons). The risk of this potentially serious adverse event and of many other serious adverse events was substantially increased after SARS-CoV-2 infection. (Funded by the Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard Medical School and Clalit Research Institute.) T h e ne w e ngl a nd jou r na l o f m e dicine M ore than 1 year into the pandemic of coronavirus disease 2019 , the disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), an unprecedented number of mass vaccination efforts are under way worldwide. Globally, nearly 3.4 billion doses of vaccine have been administered over the 6-month period since the first vaccines were approved. 1 Phase 3 clinical trials showed that several Covid-19 vaccines were efficacious and had an acceptable safety profile. [2] [3] [4] A number of potential adverse events were identified during these trials, including lymphadenopathy and idiopathic facial-nerve (Bell's) palsy. 2, 3 Trials of the BNT162b2 vaccine (Pfizer-BioNTech) also showed a mild imbalance between the vaccinated and placebo groups with respect to the number of cases of appendicitis, hypersensitivity reactions, acute myocardial infarction, and cerebrovascular accidents. 5 However, phase 3 trials may have inherent limitations in assessing vaccine safety because of a small number of participants and a healthier-thanaverage sample population. Hence, they are often underpowered to identify less common adverse events. Postmarketing surveillance is required to monitor the safety of new vaccines in real-world settings. Much effort is currently focused on characterizing the safety profiles of the recently approved Covid-19 vaccines. Passive surveillance systems such as the Vaccine Adverse Event Reporting System (VAERS) 6 collect information about adverse events that are potentially related to vaccination. This information is voluntarily reported by health care providers and the public. These systems are useful for quickly identifying potential safety signals, which, along with the findings of phase 3 trials, can be translated to lists of adverse events of interest for further exploration (such as that provided by the Safety Platform for Emergency Vaccines [SPEAC]). 7, 8 Active surveillance systems such as the Biologics Effectiveness and Safety (BEST) system (part of the Sentinel Initiative) 9 aim to compare the incidence of adverse events of interest in large electronic health record databases with the background historical incidence. Although active surveillance can help highlight suspicious trends, the lack of a rigorously constructed comparable control group limits the ability of such surveillance to identify causal effects of vaccination. The effectiveness of vaccines against SARS-CoV-2 has been confirmed in real-world studies, 10, 11 but high-quality real-world safety data on the messenger RNA (mRNA)-based Covid-19 vaccines remain relatively sparse in the literature. The results of a study based on data reported by more than 600,000 vaccinated persons were recently published 12 ; that study mainly assessed common and mild side effects. Two additional studies, which were based on surveys of vaccinated participants, involved small cohorts, 13, 14 and another study analyzed adverse events reported in the VAERS database. 15 All these studies lacked controls. One study that did incorporate a control group included 8533 long-term care facility residents who had received the first dose of vaccine. 16 The authors of this study concluded that the mRNA-based vaccines had an acceptable safety profile, and no notable adverse events were reported. As of May 24, 2021, nearly 5 million people in Israel, comprising more than 55% of the population, had received two doses of the BNT162b2 vaccine. 1 In this study, we used the integrated data repositories of the largest health care organization in Israel to evaluate the safety profile of the BNT162b2 vaccine. We compared the incidence of a broad set of potential short-and mediumterm adverse events among vaccinated persons with the incidence among matched unvaccinated persons. Potential adverse events related to medical interventions are best understood in the context of the risks associated with the disease that these interventions aim to prevent or treat, so we also estimated the effects of SARS-CoV-2 infection on this same set of adverse events. We analyzed observational data from Clalit Health Services (CHS) in order to emulate a target trial of the effects of the BNT162b2 vaccine on a broad range of potential adverse events in a population without SARS-CoV-2 infection. CHS is the largest of four integrated payer-provider health care organizations that offer mandatory health care coverage in Israel. CHS insures approximately 52% of the population of Israel (>4.7 million of 9.0 million persons), and the CHS-insured population is approximately representative of the Israeli population at large. 17 CHS directly provides out-BNT162b2 mRNA Vaccine in a Nationwide Setting patient care, and inpatient care is divided between CHS and out-of-network hospitals. CHS information systems are fully digitized and feed into a central data warehouse. Data regarding Covid-19, including the results of all SARS-CoV-2 polymerase-chain-reaction (PCR) tests, Covid-19 diagnoses and severity, and vaccinations, are collected centrally by the Israeli Ministry of Health and shared with each of the four national health care organizations daily. This study was approved by the CHS institutional review board. The study was exempt from the requirement for informed consent. Eligibility criteria included an age of 16 years or older, continuous membership in the health care organization for a full year, no previous SARS-CoV-2 infection, and no contact with the health care system in the previous 7 days (the latter criterion was included as an indicator of a health event not related to subsequent vaccination that could reduce the probability of receiving the vaccine). Because of difficulties in distinguishing the recoding of previous events from true new events, for each adverse event, persons with a previous diagnosis of that event were excluded. As in our previous study of the effectiveness of the BNT162b2 vaccine, 10 we also excluded persons from populations in which confounding could not be adequately addressed -long-term care facility residents, persons confined to their homes for medical reasons, health care workers, and persons for whom data on body-mass index or residential area were missing (missing data for these variables are rare in the CHS data). A complete definition of the study variables is included in Table S1 in the Supplementary Appendix, available with the full text of this article at NEJM.org. The target trial for this study would assign eligible persons to either vaccination or no vaccination. To emulate this trial, on each day from the beginning of the vaccination campaign in Israel (December 20, 2020) until the end of the study period (May 24, 2021), eligible persons who were vaccinated on that day were matched to eligible controls who had not been previously vaccinated. Since the matching process each day considered only information available on or before that day (and was thus unaffected by later vaccinations or SARS-CoV-2 infections), unvaccinated persons matched on a given day could be vaccinated on a future date, and on that future date they could become newly eligible for inclusion in the study as a vaccinated person. In an attempt to emulate randomized assignment, vaccinated persons and unvaccinated controls were exactly matched on a set of baseline variables that were deemed to be potential confounders according to domain expertisenamely, variables that were potentially related to vaccination and to a tendency toward the development of a broad set of adverse clinical conditions. These matching criteria included the sociodemographic variables of age (categorized into 2-year age groups), sex (male or female), place of residence (at city-or town-level granularity), socioeconomic status (divided into seven categories), and population sector (general Jewish, Arab, or ultra-Orthodox Jewish). In addition, the matching criteria included clinical factors to account for general clinical condition and disease load, including the number of preexisting chronic conditions (those considered to be risk factors for severe Covid-19 by the Centers for Disease Control and Prevention [CDC] as of December 20, 2020, 18 divided into four categories), the number of diagnoses documented in outpatient visits in the year before the index date (categorized into deciles within each age group), and pregnancy status. All the authors designed the study and critically reviewed the manuscript. The first three authors collected and analyzed the data. A subgroup of the authors wrote the manuscript. The last author vouches for the accuracy and completeness of the data and for the fidelity of the study to the protocol. There was no commercial funding for this study, and no confidentiality agreements were in place. The set of potential adverse events for the target trial was drawn from several relevant sources, including the VAERS, BEST, and SPEAC frameworks, information provided by the vaccine manufacturer, and relevant scientific publications. We cast a wide net to capture a broad range of clinically meaningful short-and medium-term potential adverse events that would be likely to be documented in the electronic health record. Accordingly, mild adverse events such as fever, BNT162b2 mRNA Vaccine in a Nationwide Setting malaise, and local injection-site reactions were not included in this study. The study included 42 days of follow-up, which provided 21 days of follow-up after each of the first and second vaccine doses. A total of 42 days was deemed to be sufficient for identifying medium-term adverse events, without being so long as to dilute the incidence of short-term adverse events. Similarly, adverse events that could not plausibly be diagnosed within 42 days (e.g., chronic autoimmune disease) were not included. Adverse events were defined according to diagnostic codes and short free-text phrases that accompany diagnoses in the CHS database. A complete list of the study outcomes (adverse events) and their definitions is provided in Table S2 . For each adverse event, persons were followed from the day of matching (time zero of follow-up) until the earliest of one of the following: documentation of the adverse event, 42 days, the end of the study calendar period, or death. We also ended the follow-up of a matched pair when the unvaccinated control received the first dose of vaccine or when either member of the matched pair received a diagnosis of SARS-CoV-2 infection. To place the magnitude of the adverse effects of the vaccine in context, we also estimated the effects of SARS-CoV-2 infection on these same adverse events during the 42 days after diagnosis. We used the same design as the one that we used to study the adverse effects of vaccination, except that the analysis period started at the beginning of the Covid-19 pandemic in Israel (March 1, 2020) and persons who had had recent contact with the health care system were not excluded (because such contact may be expected in the days before diagnosis). Each day in this SARS-CoV-2 analysis, persons with a new diagnosis of SARS-CoV-2 infection were matched to controls who were not previously infected. As in the vaccine safety analysis, persons could become infected with SARS-CoV-2 after they were already matched as controls on a previous day, in which case their data would be censored from the control group (along with their matched SARS-CoV-2-infected person) and they could then be included in the group of SARS-CoV-2-infected persons with a newly matched control. Follow-up of each matched pair started from the date of the positive PCR test result of the infected member and ended in an analogous manner to the main vaccination analysis, this time ending when the control member was infected or when either of the persons in the matched pair was vaccinated. The effects of vaccination and of SARS-CoV-2 infection were estimated with different cohorts. Thus, they should be treated as separate sets of results rather than directly compared. Because a large proportion of the unvaccinated controls were vaccinated during the follow-up period, we opted to estimate the observational analogue of the per-protocol effect if all unvaccinated persons had remained unvaccinated during the follow-up. To do so, we censored data on the matched pair if and when the control member was vaccinated. Persons who were first matched as unvaccinated controls and then became vaccinated during the study period could be included again as vaccinated persons with a new matched control. The same procedure was followed in the SARS-CoV-2 infection analysis (i.e., persons who were first matched as uninfected controls and then became infected during the study period could be included again as infected persons with a new matched control). We used the Kaplan-Meier estimator 19 to construct cumulative incidence curves and to estimate the risk of each adverse event after 42 days in each group. The risks were compared with ratios and differences (per 100,000 persons). In the vaccination analysis, so as not to attribute complications arising from SARS-CoV-2 infection to the vaccination (or lack thereof), we also censored data on the matched pair if and Absolute numbers and percentage changes are shown for each inclusion and exclusion criterion. The chart focuses on the vaccinated population. The derivation group includes the entire population, including unvaccinated persons. The shaded boxes indicate the two study groups. The same exclusion criteria were applied to the unvaccinated persons for each index date on which they were considered for matching. BMI denotes body-mass index, CHS Clalit Health Services, and PCR polymerase chain reaction. T h e ne w e ngl a nd jou r na l o f m e dicine We calculated confidence intervals using the nonparametric percentile bootstrap method with 500 repetitions. As is standard practice for studies of safety outcomes, no adjustment for multiple comparisons was performed. Analyses were performed with the use of R software, version 4.0.4. A total of 1,736,832 persons were eligible for inclusion in the vaccination cohort (Fig. 1) . The median age in the eligible cohort was 43 years (Table S3 ). The final size of the study population differed for each studied adverse event because of adverse event-specific exclusion of persons with a history of that event. On average, across the adverse event-specific cohorts, 72.4% of the eligible persons were successfully matched. Table 1 shows the baseline characteristics of the total study population, with the mean distribution of characteristics across the various adverse eventspecific cohorts. The characteristics of each adverse event-specific cohort are provided in Table S4 . The vaccination cohorts included a mean of 884,828 vaccinated persons, with a median age of 38 years (5 years younger than the median age of the eligible cohort). A total of 48% of the population was female. The effect of vaccination on the various potential adverse events included in this study is presented in Table 2 . The risk was substantially higher on either the multiplicative (risk ratio) or additive (risk difference) scales in the vaccinated group than in the unvaccinated group for myocarditis (risk ratio, 3 Figure S1 shows the cumulative incidence (risk) curves for each specific adverse event. Spikes in the incidence of lymphadenopathy were seen after both the first and second doses of vaccine, whereas the incidence of myocarditis spiked mainly after the second dose of vaccine. A total of 233,392 persons (median age, 36 years) were eligible to be included in the SARS-CoV-2 infection cohort (Fig. 2) . On average, across the adverse event-specific cohorts, 75.8% of the eli- * Statistics are based on means and distributions from a pool of all the adverse event-specific cohorts. Characteristics of the various study populations after application of all eligibility criteria and the matching process are listed. BMI denotes body-mass index (the weight in kilograms divided by the square of the height in meters), CDC Centers for Disease Control and Prevention, IQR interquartile range, RT-PCR reverse-transcriptase polymerase chain reaction, and SARS-CoV-2 severe acute respiratory syndrome coronavirus 2. Figure 3 shows estimated risk ratios in both the vaccination and SARS-CoV-2 infection analyses for adverse events in which vaccination or infection substantially increased the risk. Figure 4 shows the absolute risk associated with vaccination, alongside the absolute risk associated with SARS-CoV-2 infection, for the same adverse events. We used a data set involving more than 2.4 million vaccinated persons from an integrated health care organization to evaluate the safety profile of the BNT162b2 mRNA Covid-19 vaccine. The main potential adverse events identified included an excess risk of lymphadenopathy (78.4 events per 100,000 persons), herpes zoster infection (15.8 events), appendicitis (5.0 events), and myocarditis (2.7 events). To place these risks in context, we also examined data on more than 240,000 infected persons to estimate the effects of a documented SARS-CoV-2 infection on the incidence of the same adverse events. SARS-CoV-2 infection was not estimated to have a meaningful effect on the incidence of lymphadenopathy, herpes zoster infection, or appendicitis, but it was estimated to result in a substantial excess risk of myocarditis (11.0 events per 100,000 persons). SARS-CoV-2 infection was also estimated to substantially increase the risk of several adverse events for which vaccination was not found to increase the risk, including an estimated excess risk of arrhythmia (166.1 events per 100,000 persons), acute kidney injury (125.4 events), pulmonary embolism (61.7 events), deep-vein thrombosis (43.0 events), myocardial infarction (25.1 events), pericarditis (10.9 events), and intracranial hemorrhage (7.6 events). An association between Covid-19 vaccination and myocarditis has been previously reported. 20 Although no cases of myocarditis were reported in the BNT162b2 (Pfizer-BioNTech), 2 mRNA-1273 (Moderna), 3 or ChAdOx1 nCoV-19 (AstraZeneca) 4 phase 3 clinical trials, multiple cases of myocarditis after Covid-19 vaccination have recently been reported in the literature, [21] [22] [23] [24] [25] and both the Israeli Ministry of Health 26 and the CDC have investigated this association. 27 The risk appears to be highest among young men. 26, 27 We found that the risk of myocarditis increased by a factor of three after vaccination, which translated to approximately 3 excess events per 100,000 persons; the 95% confidence interval indicated that values between 1 and 5 excess events per 100,000 persons were compatible with our data. Among the 21 persons with myocarditis in the vaccinated group, the median age was 25 years (interquartile range, 20 to 34), and 90.9% were male. Another vaccine-related adverse event that has recently received attention in the medical literature is Bell's palsy. In a recent article based on publicly available data from the BNT162b2 and mRNA-1273 vaccine trials, Ozonoff et al. 28 suggested a possible association between these vaccines and Bell's palsy and estimated a rate ratio of approximately 7.0. This conclusion differed from the Food and Drug Administration briefing on these vaccines in December 2020; that briefing considered the incidence of Bell's palsy to be similar to the background incidence. 5 A small number of cases of Bell's palsy after Covid-19 vaccination have also been reported in the literature. 29, 30 In the current study, the effect estimate was consistent with a potentially mild increase in the risk of Bell's palsy after vaccination, with a risk ratio of 1.32 (95% CI, 0.92 to 1.86). The absolute effect was small, with up to 8 excess events per 100,000 persons being highly compatible with our data according to the 95% confidence interval. Herpes zoster infection, the incidence of which we found to be increased after vaccination, is one of the potential causes of facial-nerve palsy. 31 Another particularly notable class of adverse events that has been reported in the context of T h e ne w e ngl a nd jou r na l o f m e dicine Covid-19 vaccines is thromboembolic events. These adverse events, which primarily affect young women, have been linked with the ChAdOx1 nCoV-19 32 and Ad26.COV2.S (Johnson & Johnson-Janssen) Covid-19 vaccines, 33 both of which are adenoviral vector vaccines. However, we did not find an association between the BNT162b2 vaccine and various thromboembolic events in this study. BNT162b2 mRNA Vaccine in a Nationwide Setting Some initially unexpected effects were seen in the results of the current study. The BNT162b2 vaccine appears to be protective against certain conditions such as anemia and intracranial hemorrhage. These same adverse events are also iden-tified in this study as complications of SARS-CoV-2 infection, so it appears likely that the protective effect of the vaccine is mediated through its protection against undiagnosed SARS-CoV-2 infection, which may be undiagnosed either because of a lack of testing or because of false negative PCR results. This study has several limitations. First, persons in the study were not randomly assigned according to exposures (vaccinations and SARS-CoV-2 infections); this may have introduced confounding at baseline and selection bias at censoring, especially since a single set of confounders was used for adjustment in the assessment of many disparate adverse events. Second, the matching process that was necessary to attain exchangeability between the study groups resulted in a Absolute numbers and percentage changes are shown for each inclusion and exclusion criterion. The chart focuses on the SARS-CoV-2-infected population. The derivation group includes the entire population, including uninfected persons. The shaded boxes indicate the two study groups. The same exclusion criteria were applied to the uninfected persons for each index date on which they were considered for matching. Covid-19 denotes coronavirus disease 2019. T h e ne w e ngl a nd jou r na l o f m e dicine study population with a different composition than the eligible population (e.g., median age, 38 years rather than 43 years). Because this different composition changes the population over which the causal effect is being estimated, different estimates might be found for adverse events for which the incidence may differ substantially between subgroups (e.g., myocarditis). Also, we excluded certain populations (such as health care workers and persons residing in longterm care facilities) that could be at particularly high risk for certain adverse events. Both of these issues should be taken into account when considering the generalizability of the findings. Third, some diagnoses that were recorded in out-of-network hospitals, which were delayed in being reported to the insurer and were not entered by the person's general practitioner from the hospital discharge notes into the outpatient medical record, could have been missed. Fourth, it is possible that persons are more likely to increase their levels of clinical awareness, concern, or both after vaccination or SARS-CoV-2 infection, and thus they may be more likely to report or seek medical care for their symptoms, resulting in a spuriously increased incidence of the various adverse events in the vaccinated or infected groups. Similarly, among persons with SARS-CoV-2 infection, the spike in the incidence of certain adverse events in the first day of follow-up could indicate the initial clinical manifestation of the infection, but it could also be related to active testing for SARS-CoV-2. Fifth, all the effect measures that we presented are based only on a new incidence of the specific adverse event under study; thus, less light was shed on the potential additional risk among persons with a medical history of each of these adverse events. However, this choice was necessary to distinguish between true new diagnoses of a given adverse event and recoding of past diagnoses and to ensure the accuracy of the adverse-event labels. In this study, we sought to place the increased risk of adverse events caused by the BNT162b2 vaccine in context by contrasting this risk with that of the same adverse events after documented BNT162b2 mRNA Vaccine in a Nationwide Setting infection with SARS-CoV-2. We thought that this was necessary because vaccination and its potential risks do not occur in a void but rather in the context of an ongoing pandemic. Although the general risks of hospitalization, severe disease, and death from Covid-19 are widely recognized, secondary complications of infection are less well known. Therefore, in this analysis, we sought to estimate the effects of SARS-CoV-2 infection on the incidence of the same list of adverse events examined in the vaccination analysis. Because the cohorts that we used to study the vaccine and infection effects were different in composition, care should be taken when comparing the resulting risk estimates. In addition, knowledge of these risks alone is insufficient for a complete decision-theoretic analysis. When a person decides to become vaccinated, this choice results in a probability of 100% for the vaccination, whereas the alternative of contracting SARS-CoV-2 infection is an event with uncertain probability that depends on the person, place, and time. Moreover, infection with SARS-CoV-2 has many other adverse effects beyond those considered here, in-cluding the risk of transmission to family members and others. We estimated that the BNT162b2 vaccine resulted in an increased incidence of a few adverse events over a 42-day follow-up period. Although most of these events were mild, some of them, such as myocarditis, could be potentially serious. However, our results indicate that SARS-CoV-2 infection is itself a very strong risk factor for myocarditis, and it also substantially increases the risk of multiple other serious adverse events. These findings help to shed light on the short-and medium-term risks of the vaccine and place them in clinical context. Further studies will be needed to estimate the potential of long-term adverse events. Population sector -no. (%) General Jewish Chronic kidney disease Chronic obstructive pulmonary disease Obesity: BMI, 30 to 40 Severe obesity: BMI, ≥40 Type 2 diabetes mellitus Data. Coronavirus (CO-VID-19) vaccinations. Statistics and research Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK Food and Drug Administration. Vaccines and Related Biological Products Advisory Committee: December 10, 2020 meeting announcement Vaccine Adverse Event Reporting System Background paper on Covid-19 disease and vaccines: prepared by the Strategic Advisory Group of Experts (SAGE) on immunization working group on COVID-19 vaccines SPEAC -Safety Platform for Emergency vACcines D2.3 priority list of adverse events of special interest: COVID-19 Biologics Effectiveness and Safety (BEST) Initiative home page BNT162b2 mRNA Covid-19 vaccine in a nationwide mass vaccination setting COVID-19 vaccine coverage in health-care workers in England and effectiveness of BNT162b2 mRNA vaccine against infection (SIREN): a prospective, multicentre, cohort study Vaccine side-effects and SARS-CoV-2 infection after vaccination in users of the COVID Symptom Study app in the UK: a prospecobservational study Self-reported real-world safety and reactogenicity of COVID-19 vaccines: a vaccine recipient survey Early safety monitoring of COVID-19 vaccines in healthcare workers COVID-19 mRNA vaccines are generally safe in the short term: a vaccine vigilance real-world study says Adverse events following mRNA SARS-CoV-2 vaccination among U.S. nursing home residents National Insurance Institute of Israel Centers for Disease Control and Prevention. People with certain medical conditions Nonparametric estimation from incomplete observations COVID-19 and myocarditis: a systematic review and overview of current challenges Temporal relation between second dose BNT162b2 mRNA Covid-19 vaccine and cardiac involvement in a patient with previous SARS-COV-2 infection Myocarditis following COVID-19 mRNA vaccination Symptomatic acute myocarditis in seven adolescents following Pfizer-BioN-Tech COVID-19 vaccination Myocarditis following COV-ID-19 vaccination -03). 27. Centers for Disease Control and Prevention. Myocarditis and pericarditis following mRNA COVID-19 vaccination Bell's palsy and SARS-CoV-2 vaccines Bell's palsy after second dose of Pfizer COV-ID-19 vaccination in a patient with history of recurrent Bell's palsy Bell's palsy following COVID-19 vaccination Bell's palsy: the spontaneous course of 2,500 peripheral facial nerve palsies of different etiologies Centers for Disease Control and Prevention, Health Alert Network. Emergency preparedness and response: cases of cerebral venous sinus thrombosis with thrombocytopenia after receipt of the Johnson & Johnson COVID-19 vaccine Because of data privacy regulations, the raw data for this study cannot be shared.