key: cord-0762547-iqytd6p4 authors: Maity, Tuhin; von Schlegell, Ahmad; Longo, Christopher title: Is vaccine hesitancy justified? Benchmarking post-market vaccine risks with five commonly used medicinal products in Canada date: 2022-02-11 journal: Can J Public Health DOI: 10.17269/s41997-022-00609-9 sha: 89cd6a0f2f02a49f835e8b95df562e81361747b5 doc_id: 762547 cord_uid: iqytd6p4 OBJECTIVE: Although vaccines are one of the most cost-effective, low-risk healthcare approaches that save thousands of lives every year, paradoxical fear about vaccine safety is a major roadblock for achieving widespread vaccination coverage. The objective of this study is to change public perception of vaccine safety by presenting real-world incidence of adverse events following immunization (AEFIs). METHODS: In this study, we used Canadian post-market adverse events data to estimate the real-world risk of AEFI and benchmarked them against five commonly used drug types—ACE inhibitors, beta2 adrenergic receptors, penicillins, proton pump inhibitors, and HMG-CoA reductase inhibitors. RESULTS: Our analysis shows that post-market AEFIs are rare, and vaccination generally carries a significantly lower risk compared to some commonly used medicinal product types. CONCLUSION: Despite some limitations with using post-trial adverse events data, we believe that the evidence presented in this study, especially the comparative risk analysis between vaccines and medicinal products, when communicated through proper channels, can help vaccine-hesitant individuals overcome their perceived safety concerns with regard to vaccines. Objectifs Bien que les vaccins soient l'une des approches de soins de santé les plus rentables et à faible risque qui sauvent des milliers de vies chaque année, la peur paradoxale de la sécurité des vaccins est un obstacle majeur à la réalisation d'une couverture vaccinale généralisée. L'objectif de cette étude est de changer la perspective publique de la sécurité des vaccins en présentant l'incidence actuelle des événements indésirables post-commercialisation après la vaccination. Méthodes Dans cette étude, nous avons utilisé les données canadiennes sur les événements indésirables post-commercialisation pour estimer le risque réel d'événements indésirables après la vaccination et les avons comparés à cinq types de médicaments couramment utilisésinhibiteurs de l'ECA (enzyme de conversion de l'angiotensine), récepteur bêta-2-adrénergique, pénicillines, inhibiteurs de la pompe à protons et inhibiteurs de l'HMG-CoA réductase. Résultats Notre analyse montre que les événements indésirables post-commercialisation après la vaccination sont rares et que la vaccination comporte généralement un risque significativement plus faible par rapport à certains types de médicaments couramment utilisés. Conclusion Malgré certaines limites à l'utilisation des données sur les événements indésirables post-essai, nous pensons que les preuves présentées dans cette étude, en particulier l'analyse comparative des risques entre les vaccins et les médicaments, lorsqu'elle est communiquée par des canaux appropriés, peuvent aider les personnes hésitantes à surmonter leurs préoccupations perçues en matière d'innocuité des vaccins. After access to affordable nutrition, clean drinking water, and sanitation, vaccines are the single most cost-effective healthcare measure that can be taken to protect human health (Morrow et al., 2012) . All vaccines approved in Canada (and in most developed countries) undergo a thorough safety and efficacy evaluation based on the data from the clinical trials (Health Canada, 2020) . In fact, since vaccines are usually administered to healthy individuals, they are typically held to a higher standard of safety than the medicinal products used to treat ill patients (Destefano et al., 2018) . Nonetheless, despite the success of vaccines, they have never been free from the paradoxical concerns about their safety (Chen, 1999; Larson et al., 2011) . Although adverse events following immunization (AEFIs) are rare, a perceived risk of AEFIs plays a central role in instigating vaccine hesitancy among individuals, thereby acting as a barrier in achieving widespread vaccination coverage (Larson et al., 2016) . According to the World Health Organization, vaccine hesitancy is defined as delay in acceptance or refusal of vaccines despite availability of vaccine services (MacDonald, 2015) . Vaccine hesitancy is typically influenced by factors such as complacency, convenience, and confidence (MacDonald, 2015) . In a recent survey in Canada about COVID-19 vaccines, the top two reasons for vaccine hesitancy among individuals were found to be lack of confidence in the safety of vaccines (54.2%) and concerns about their risks and side effects (51.7%) (Frank & Arim, 2020) . About one third of Canadians (34.8%) who are unlikely to get vaccinated indicated that they would wait until enough data suggest that it is safe to get the vaccine (Frank & Arim, 2020) . Boosting public confidence in the benefits of vaccination by underscoring the rarity of AEFIs is a critically required component for achieving widespread vaccination coverage (Goldstein et al., 2015) . However, even large clinical trials are not necessarily always powered to detect rare AEFIs (Jacobson et al., 2001) . In addition, clinical trials generally confine attention to idealized standard patients and are conducted in idealized conditions to determine efficacy. Enhanced post-market surveillance offers real-world evidence for decision making by individuals, providers, policy makers, and society (Duclos, 2004) . The overarching objective of this study is to change public perception of vaccine safety by presenting real-world incidence of AEFIs. Reports from the Canada Vigilance Adverse Reactions (CVAR) database (Canada Vigilance Adverse Reaction Online Database, 2021) were used as the source of post-market adverse incidents of vaccines and medicinal products, and their outcomes. Using the reports from this database, this study presents an overview of AEFIs and their outcomes, and a side-by-side comparison of post-market adverse events (AEs) associated with vaccines and common medicinal products. The CVAR database contains information about suspected adverse reactions to health products, which include both vaccines and medicinal products (Canada Vigilance Adverse Reaction Online Database, 2021). The database includes data from 1965, although information about vaccines used for immunization has been included in the database since 2011. Health professionals submit AE reports to this database voluntarily. However, market authorization holders, i.e., manufacturers and distributors, are required to submit AE reports to this database according to the Food and Drug Regulations (Food and Drug Regulations (C.R.C., c. 870), 2021). Adverse event reports were extracted from the CVAR database for the period 2015-2019. A detailed description of data extraction and processing method can be found elsewhere (Maity & Longo, 2020; Maity & Longo, 2021) . This study refers to an AEFI or AE as serious based on Health Canada's definition. Health Canada defines an AE as 'serious' if it requires in-patient hospitalization or prolongation of existing hospitalization, causes congenital malformation, results in persistent or significant disability or incapacity, is life-threatening, or results in death (Health Canada, 2019). When an adverse reaction is determined as 'serious', a report to Health Canada must be submitted in an expedited fashion, such as within 15 days by the market authorization holder or within 30 calendar days by the hospital (Food and Drug Regulations (C.R.C., c. 870), 2021). For AEFI outcomes, death, life-threatening conditions, disability, and hospitalization required were considered in this study. Five vaccine types were chosen to further illustrate the AEFI incidence rates: seasonal influenza, meningococcus, MMR, pneumonia, and shingles (only Zostavax, see below). The selection of these five vaccine types was based on their higher occurrence in the CVAR database and the fact that their uptake is widespread among Canadians. Of note, in 2017, Shingrix vaccine received a market authorization in Canada for shingles and began replacing Zostavax. Since Zostavax is a live attenuated vaccine and Shingrix is a recombinant zoster vaccine, we did not combine the data for two different kinds of vaccines for the comparative purpose. Only AEFI data associated with Zostavax were used for shingles. The number of vaccine doses distributed for the five vaccine types was calculated from averaging the number of Ontario doses for 2015-2018 reported by Public Health Ontario (Annual Report on Vaccine Safety, 2021) after adjusting for the Canadian population using the population information from Statistics Canada (Population Estimates on July 1st, by Age and Sex, 2021). AEFI incidence rate per dose was calculated by dividing the annual average number of incidents-all AEs, serious AEs, and death-by the annual average of doses calculated as described above. Since, for most vaccines, it is just one dose per unique recipient in a given year, the risk per dose can be approximated as risk per recipient. For benchmarking the AEFI rate with medicinal products, five product classes were selected based on the number of users in Canada (Canadian Institute for Health Information, 2019). They were ACE inhibitors, beta2 adrenergic receptors, penicillins, proton pump inhibitors, and HMG-CoA reductase inhibitors. The use of the CVAR database as a source of AE reports for both vaccines and medicinal products helps reduce some reporting-related biases, such as the extent of underreporting, that may influence the benchmarking. The number of users for these five medicinal product types was obtained from annual prescribed drug spending reports published by the Canadian Institute for Health Information (CIHI) (Canadian Institute for Health Information, 2019). Note, the recipient numbers from 2017 to 2019 were used to calculate the average, since the data for 2015 and 2016 were not available in the same data series from CIHI. Raw data for AEFIs and AEs associated with the five vaccines and five medicinal product types, respectively, will be available upon request to the corresponding author. A total of 4083 AEFI reports were identified for vaccines in the CVAR database for the period 2015-2019. Table 1 presents an overview of the reports and their outcomes. On average, there were 817 reports per year, with 108 patient hospitalizations, 19 life-threatening conditions and 12 deaths from the suspected AEFIs (Table 1 ). The number of AEFI reports in the CVAR database more than doubled from 2015 to 2019. This increase was not a vaccine-specific phenomenon. As illustrated in Fig. 1 , the number of AE reports for other medicinal products excluding vaccines in the database also doubled from 2015 to 2019 (Fig. 1) . For vaccines, the proportion of serious AEFIs increased from 58% in 2015 to 74% in 2019 (Fig. 1A) . For medicinal products excluding vaccines, the proportion of serious AEs remained quite constant around 72%. Table 2 presents the top vaccine types that are associated with the 4083 AEFI reports. One or multiple vaccines may be associated with each AEFI report. When only one vaccine is associated, that vaccine is automatically considered as a suspect for causing the AEFI. When more than one vaccine is associated, at least one vaccine is named as suspect, and the others as concomitant. Importantly, a classification of suspect does not automatically establish a causal relationship between a vaccine and the adverse reactions. Nevertheless, a suspect/concomitant classification performed by trained health practitioners implies the degree of likelihood of a causal relationship. To portray the risk or rarity of AEFIs, we converted the AEFI incidents into events per number of recipients or doses and then benchmarked them against the AE rates observed for some commonly used medicinal products estimated from the same database. Table 3 presents the estimated all AE, serious AE, and attributed fatality rates associated with five vaccines and five medicinal product types. For four of the five vaccine types, fewer than 10 AEFIs and serious AEFIs were associated with every 100,000 doses. Attributed fatality from the AEFIs was extremely rare, typically in the order of 1 or 2 per million doses. The medicinal product types analyzed in this study exhibited a relatively higher rate of AEs, serious AEs, and AE-associated deaths compared to the five vaccine types (Table 3) . Among the drugs, penicillins appeared to exhibit the lowest rate of AEs per 100,000 users. Overall, our benchmarking analysis shows that post-market AEFIs are rare and vaccination generally carries a significantly lower risk even when compared with some commonly used medicinal product types. We observed that the total number of AEFIs gradually increased from 2015 to 2019 (Table 1 and Figure 1A ). This is unlikely due to an overall increase in the risk of AEFIs or the rate of vaccination. Pharmaceutical products excluding vaccines exhibited a very similar trend (Fig. 1B) . Over this period, the number of AE reports per million population changed substantially for all medicinal products (Maity & Longo, 2020) . This suggests that an increased rate of reporting is likely the primary driver for the observed increase in the number of AEFI reports in the database. An increased number of reports may also be due to increases in vaccine uptake due to increased eligibility or promotion of vaccines, as well as new vaccines (e.g., Zostavax), in addition to increased awareness about reporting to CVAR. For both medicinal products and vaccines, the majority of the AEs reported in the database are serious in nature ( Figure 1 ). Unlike in clinical trials, where AEs of all seriousness levels are documented, a post-market database containing spontaneously collected reports is likely to be biased towards serious events. Mild events that do not require medical intervention are more likely to be underreported. The association between a vaccine or medicinal product to an AE in the CVAR database does not imply causality. An assessment of causality requires consideration of other factors, such as temporal associations, the possible contribution of concomitant medication or therapies, and the underlying health condition of the patient. The assessment of suspect vs. concomitant classification in the CVAR database reflects the observation and opinion of the reporter (Table 2) . Though an investigation and assessment of causality is not formally carried out for reports in CVAR, when a vaccine or medicinal product is considered a suspect in an AE, it is more likely to reflect a causal connection compared to when it is considered concomitant. Among the vaccines in the benchmarking analysis, Zostavax exhibited a higher rate of AEFIs compared to the other vaccines. Zostavax is a live attenuated vaccine and the recipients are exclusively older adults. It is not totally unexpected to observe a relatively higher AEFI rate associated with a live vaccine. Nevertheless, the estimated rates of all AEs, serious AEs, and attributed fatalities associated with any of the five vaccines were lower than those of the five medicinal products investigated in this study. Note, these medicinal products are not representative of all medicinal products in terms of their safety. We speculate that they are likely perceived as safer prescribed medicines as they are routinely and widely used without much hesitancy (Hales & Kohen, 2019) . In a larger context, the question is whether this benchmarking data on its own is sufficient to create a shift in the vaccine-hesitant individual's mindset. Strong evidence of vaccine safety derived from real-world data such as that presented in this study may not automatically convert vaccine-hesitant individuals-whose hesitancy is caused by the fear associated with vaccines' unintended side effectsinto vaccine recipients. Vaccine-hesitant individuals are more likely to distrust experts (e.g., scientists, healthcare professionals) and authority (e.g., the state), and hold conspiratorial and paranoid beliefs (Murphy et al., 2021) . Vaccine-hesitant individuals are less likely to consume and trust information from traditional sources, such as news articles, radio, television, and government agencies (Murphy et al., 2021) . The comparative safety information presented in this study needs to be put into context and the delivery of this information must be tailored to overcome the barriers described above. We believe that disseminating vaccine safety information such as that presented in this paper, and effective communication through alternative and unconventional channels by individuals who the vaccine-hesitant population trust the most, are likely to reduce vaccine hesitancy. Analysis using spontaneously collected post-market reports has some limitations. First, underreporting is a known issue in post-market AE data, which leads to underestimation of the risk (Hazell & Shakir, 2006) . However, we mitigated this concern for the relative risk comparison by using the same database for AEs associated with vaccines and medicinal products. Second, we sourced the vaccine user information from Health Quality Ontario, which only included users in the publicly funded programs. Therefore, the actual numbers of recipients for the five vaccine types considered here are likely higher, leading to a systematic overestimation of the AEFI rates not seen in the medicinal product arm. Furthermore, while there could be inter-provincial variations, by extrapolating the vaccine uptake rate for Ontario to Canada, we have tacitly assumed that Ontario vaccine uptake is generally representative of the entire nation. This is not an unreasonable assumption. As of September 18, 2021, 75.25% of Ontarians received at least one dose of COVID-19 vaccine (COVID-19 Vaccination in Canada, 2021) . For the same time period, 75.26% Canadians have received at least one dose, a number that is almost identical to that of Ontario (COVID-19 Vaccination in Canada, 2021) . Third, while for most vaccines there is a 1:1 ratio between their number of doses and the number of unique recipients, the medicinal products included in benchmarking are typically prescribed to use in a continuous manner over a period or lifetime, and the number of doses administered is typically much higher than the number of users. Therefore, a question may arise as to whether our approach led to a fair benchmarking analysis. We argue that the AE rates estimated in this study practically reflect the number of events annually per 100,000 users. Furthermore, for medicinal products, the risk is ongoing due to their use in a continuous manner over a period of time. For vaccines, the risk is not ongoing for an individual, as the number of doses for most vaccines is typically limited by the number of doses in a specified time period, ranging from annually for influenza to longer intervals or even once in a lifetime for others. Nevertheless, we expect that some researchers may want to use a different approach for benchmarking. Fourth, an association between a vaccine or medicinal product and an AE does not automatically indicate causality. When multiple vaccines or medicinal products are involved, it is even harder to establish a causal connection. In addition, patient co-morbidities also play a significant role in AE outcomes. Since medicinal products are generally used by sick individuals, AEs associated with medicinal products may tend to be more frequent compared to the vaccines, which are generally administered to healthy individuals. Therefore, comparing AEFIs and AEs associated with medicinal products without controlling for co-morbidities may lead to a favourable bias towards vaccines, although it is highly unlikely this would account for a 100-fold difference in frequency. Perceived fear of AEFIs is a major hurdle for achieving widespread vaccination coverage, needed for herd immunity. In this study, we used the CVAR database, a repository of post-market AEs in Canada, to estimate the real-world rates of AEFIs. Our results show that AEFIs are rare and vaccination generally carries a significantly lower risk even when compared with some commonly used medicinal product types. We hope that the results of our study, when communicated through proper channels, will improve our understanding and perception of vaccine safety in the real world and improve vaccine uptake. What does this study add to existing knowledge? • This study benchmarks adverse event rates for vaccines and medicinal products using spontaneously collected Canadian post-market adverse events data. • This study shows that adverse events following immunization are rare, and vaccination generally carries a significantly lower risk compared to some commonly used medicinal product types. What are the key implications for public health interventions, practice or policy? • The evidence presented in this study, when communicated through proper channels, should help vaccine-hesitant individuals overcome their perceived safety concerns with regard to vaccines. Average Deaths/ 10,000 Vaccine Safety Surveillance Archive Canada Vigilance adverse reaction online database Prescribed Drug Spending in Canada, 2019: A Focus on Public Drug Programs Vaccine risks: Real, perceived and unknown COVID-19 vaccination in Canada Vaccine safety. Plotkin's Vaccines, 1584-1600.e10 A global perspective on vaccine safety Justice Laws Website Canadians' willingness to get a COVID-19 vaccine: Group differences and reasons for vaccine hesitancy Health communication and vaccine hesitancy Prescription drug use among adults aged 40-79 in the United States and Canada (No. 347 Under-reporting of adverse drug reactions Mandatory reporting of serious adverse drug reactions and medical device incidents by hospitals Regulating vaccines for human use in Canada Adverse events and vaccination-the lack of power and predictability of infrequent events in pre-licensure study Addressing the vaccine confidence gap The state of vaccine confidence 2016: Global insights through a 67-country survey Vaccine hesitancy: Definition, scope and determinants Adverse drug reactions in Canada Pragmatic pharmacoeconomic analyses by using post-market adverse drug reaction reports: An illustration using infliximab, adalimumab, and the Canada vigilance adverse reaction database Vaccinology: Principles and practice Psychological characteristics associated with COVID-19 vaccine hesitancy and resistance in Ireland and the United Kingdom Statistics Canada Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations All incidents Deaths Average All/ 10,000Average Serious/ 10,000