key: cord-0744935-am8ueyn5
authors: Lu, Jia; Wen, Xiaosa; Guo, Qi; Ji, Mengdi; Zhang, Felicia; Wagner, Abram L.; Lu, Yihan
title: Sensitivity to COVID-19 Vaccine Effectiveness and Safety in Shanghai, China
date: 2021-05-07
journal: Vaccines (Basel)
DOI: 10.3390/vaccines9050472
sha: dbeb2baa8092813c13a50576a384b730ebc96fc4
doc_id: 744935
cord_uid: am8ueyn5

Several COVID-19 vaccines have been on the market since early 2021 and may vary in their effectiveness and safety. This study characterizes hesitancy about accepting COVID-19 vaccines among parents in Shanghai, China, and identifies how sensitive they are to changes in vaccine safety and effectiveness profiles. Schools in each township of Minhang District, Shanghai, were sampled, and parents in the WeChat group of each school were asked to participate in this cross-sectional Internet-based survey. Parents responded to questions about hesitancy and were given information about five different COVID-19 vaccine candidates, the effectiveness of which varied between 50 and 95% and which had a risk of fever as a side effect between 5 and 20%. Overall, 3673 parents responded to the survey. Almost 90% would accept a vaccine for themselves (89.7%), for their child (87.5%) or for an elderly parent (88.5%) with the most ideal attributes (95% effectiveness with 5% risk of fever). But with the least ideal attributes (50% effectiveness and a 20% risk of fever) these numbers dropped to 33.5%, 31.3%, and 31.8%, respectively. Vaccine hesitancy, age at first child’s birth, and relative income were all significantly related to sensitivity to vaccine safety and effectiveness. Parents showed a substantial shift in attitudes towards a vaccine based on its safety and effectiveness profile. These findings indicate that COVID-19 vaccine acceptance may be heavily influenced by how effective the vaccine actually is and could be impeded or enhanced based on vaccines already on the market.

The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease [1] , has led to substantial morbidity and mortality worldwide and put considerable pressure on public health systems. Since the outbreak, the need for a vaccine, one of the most powerful and cost-effective tools for preventing disease in large populations, has never been more urgent [2] . Unlike previous vaccines, which required years or even decades of clinical trial research, vaccines against COVID-19 were developed at "warp speed" [3, 4] , much more quickly than previous vaccines [5] . More than 50 COVID-19 vaccine candidates are currently in trials, and several vaccines have already been approved and distributed. By 14 January 2021, more than 35 million doses in 49 countries had been administered [6] .

A vaccine is only useful if people are willing to receive it. Various countries started rolling out vaccines in late 2020, prioritizing healthcare and other essential workers and those with high-risk health conditions. However, members of the general population may be hesitant to receive a vaccine due to concerns over the speed of its development and concerns about safety and effectiveness. Vaccine hesitancy is already listed as one of Vaccines 2021, 9, 472 2 of 8 the top 10 global health threats, so hesitancy over these new drugs may exacerbate vaccine refusal [7] . According to a survey conducted in 19 countries, 71.5% of the respondents would consider taking a COVID-19 vaccine [8] . This hesitancy and refusal may intensify the pandemic and put more pressure on health systems.

A previous study showed that respondents from China showed the highest positive response (88.6%) and lowest negative response (0.7%) when asked if they would accept a "proven, safe and effective COVID-19 vaccine" [8] . However, sensitivity to different levels of effectiveness and safety within China was still unclear. It is also not clear what factors may have influenced their acceptance. It is crucial to consider the public's acceptance of vaccines that have different levels of safety and effectiveness and the factors related to them to adopt evidence-based interventions for varying vaccine levels to counter future outbreaks. This study characterizes vaccine hesitancy towards the COVID-19 vaccine among parents in Shanghai, China, and identifies how sensitive they are to changes in the vaccine safety and effectiveness profile.

In this study, a stratified cluster sampling method was used to conduct a questionnaire survey in each of the 13 townships in Minhang District, Shanghai. We wanted a sample size of 2345 to have a margin of error of at least 2% for our outcome: the proportion who would accept a given vaccine with alpha of 0.05. We obtained a larger sample given the ease at obtaining data within schools. Within each township, a convenience sample of one school was chosen. In each sampled school, a health instructor sent the questionnaire link to each class's WeChat group. Following this, the parents of the students filled out the questionnaire. In order to improve the controllability of the questionnaire's source, the fidelity of the sampling, and the participation of the parents, researchers answered any parents' questions live during the survey completion; questionnaires that were completed in less than 5 min (estimated time) were excluded from the data analysis. The questionnaire was developed by staff at the Minhang Centers for Disease Control and Prevention.

Vaccine hesitancy was assessed through a 10-item adult Vaccine Hesitancy Scale (aVHS) (Figure 1 ). This questionnaire had been validated by U.S. and Chinese samples [9] , and within this sample there was high internal reliability of this scale (Standardized Crohnbach's alpha = 0.82). Briefly, each item was based on a 5-point Likert scale: a score of 1 represented the lowest degree of vaccine hesitancy and 5 the highest). The results were summed for a possible range of 10 to 50. A score of 10 to 24 was categorized as "not hesitant", while 25 to 50 was considered "hesitant" [9] . concerns about safety and effectiveness. Vaccine hesitancy is already listed as one of the top 10 global health threats, so hesitancy over these new drugs may exacerbate vaccine refusal [7] . According to a survey conducted in 19 countries, 71.5% of the respondents would consider taking a COVID-19 vaccine [8] . This hesitancy and refusal may intensify the pandemic and put more pressure on health systems. A previous study showed that respondents from China showed the highest positive response (88.6%) and lowest negative response (0.7%) when asked if they would accept a "proven, safe and effective COVID-19 vaccine" [8] . However, sensitivity to different levels of effectiveness and safety within China was still unclear. It is also not clear what factors may have influenced their acceptance. It is crucial to consider the public's acceptance of vaccines that have different levels of safety and effectiveness and the factors related to them to adopt evidence-based interventions for varying vaccine levels to counter future outbreaks. This study characterizes vaccine hesitancy towards the COVID-19 vaccine among parents in Shanghai, China, and identifies how sensitive they are to changes in the vaccine safety and effectiveness profile.

In this study, a stratified cluster sampling method was used to conduct a questionnaire survey in each of the 13 townships in Minhang District, Shanghai. We wanted a sample size of 2345 to have a margin of error of at least 2% for our outcome: the proportion who would accept a given vaccine with alpha of 0.05. We obtained a larger sample given the ease at obtaining data within schools. Within each township, a convenience sample of one school was chosen. In each sampled school, a health instructor sent the questionnaire link to each class's WeChat group. Following this, the parents of the students filled out the questionnaire. In order to improve the controllability of the questionnaire's source, the fidelity of the sampling, and the participation of the parents, researchers answered any parents' questions live during the survey completion; questionnaires that were completed in less than 5 min (estimated time) were excluded from the data analysis. The questionnaire was developed by staff at the Minhang Centers for Disease Control and Prevention.

Vaccine hesitancy was assessed through a 10-item adult Vaccine Hesitancy Scale (aVHS) (Figure 1 ). This questionnaire had been validated by U.S. and Chinese samples [9] , and within this sample there was high internal reliability of this scale (Standardized Crohnbach's alpha = 0.82). Briefly, each item was based on a 5-point Likert scale: a score of 1 represented the lowest degree of vaccine hesitancy and 5 the highest). The results were summed for a possible range of 10 to 50. A score of 10 to 24 was categorized as "not hesitant", while 25 to 50 was considered "hesitant" [9] . We assessed acceptance of a vaccine first by providing participants with different profiles of effectiveness (95, 60 and 50%) and safety (5, 10, and 20% risk of fever). We then asked parents if they would accept a vaccine with a given profile for themselves, for their child, or for an elderly parent. From this information, we also if someone were sensitive to vaccine effectiveness (i.e., they would accept 95% but not 50% effectiveness) or safety (i.e., they would accept a 5% risk but not a 20% risk of fever). Across each characteristic (effectiveness and safety) individuals fell into one of three categories: they would not accept a vaccine under any circumstance; they were sensitive to the profile; or they would accept any vaccine.

Demographic characteristics of the parents, including their age, second child, and stated relative income in their peer group, were also collected.

After quantifying the proportion of individuals with sensitivity to vaccine effectiveness and safety, we created two multivariable models in which the outcomes were the three-level characteristics of sensitivity to effectiveness and safety. The primary independent variable was vaccine hesitancy, as measured by the aVHS. We also included mother vs father, age of parent, presence of second child, age of first child, sex of first child, and stated relative income as confounders in this analysis based on an a priori consideration of these variables with vaccine hesitancy and profile sensitivity. This model output odds ratios (ORs) and 95% confidence intervals (CIs). Data were analyzed in SAS version 9.5 (SAS Institute, Cary, NC, USA).

Overall, 3673 parents responded to the survey. Demographic characteristics of the parents are shown in Table 1 . Most respondents (69.1%) were mothers. A plurality (37.1%) had their first child at 25 to 29 years of age; most (67.2%) did not have a second child; and for less than half (45.3%), the first child was elementary aged (6-11 years old). Responses to vaccine hesitancy items are shown in Figure 1 . Individuals expressed a great deal of concern about serious adverse effects (40.1% agreed and 30.1% strongly agreed), believing that newer vaccines carried more risks than older vaccines (22.2% agreed and 25.2% strongly agreed), and that vaccines for diseases that were no longer common were not needed (23.1% agreed and 13.8% strongly agreed).

Overall, 29.5% (1083) were vaccine hesitant, as measured by the aVHS, with some trends by demographic group. Individuals who were older when they had their first child (32.1% of those aged 30-45 years) were more hesitant compared to of those who were 18-22 (19.4%) when they had their first child, (p < 0.0001). Additionally, those with a second child were less vaccine hesitant (24.9%), compared to those with only one child (31.4%), (p < 0.0001).

Acceptance of a COVID-19 vaccine varied according to its safety and effectiveness profile: the highest levels of acceptance were for 95% effectiveness and a 5% risk of fever; and the lowest were for 50% effectiveness and a 20% risk of fever (Table 2 ). Almost 90% would accept a vaccine for themselves (89.7%), for their child (87.5%) or for an elderly parent (88.5%) if it had the highest attributes. For vaccines with the lowest attributes, these numbers dropped to 33.5%, 31.3%, and 31.8%, respectively. Overall, about 10% of individuals would not accept a vaccine, regardless of its safety or effectiveness profile; almost half (48.6%) were not sensitive to vaccine effectiveness; and 31.3% would accept a 95% effective vaccine, but not a 50% effective one. There was less sensitivity to vaccine safety as measured by risk of fever. Almost two-thirds, 63.3%, would accept a vaccine regardless of the risk of fever, and about one-fourth, 26.8%, would accept a vaccine with a 5% risk of fever but not a 20% risk.

Sensitivity to vaccine safety and effectiveness was significantly related to vaccine hesitancy, age at first child's birth, and stated relative income (Table 3 ). Having a second child was significantly related to sensitivity to vaccine effectiveness (p = 0.0334), but not safety (p = 0.0998). For example, those who were vaccine hesitant were 10.47 times more likely not to accept a vaccine, and 2.60 times more likely to be sensitive to vaccine effectiveness, compared to those who were not vaccine hesitant (p < 0.0001). Vaccine hesitancy was associated with greater odds of not accepting any vaccine or being sensitive to the risk of fever (p < 0.0001). Those who were younger at their first child's birth had reduced odds of not accepting a vaccine or being sensitive to its effectiveness or safety profile (p < 0.0001 for effectiveness, p = 0.0055 for safety). Those whose income was less than average were less sensitive, both to the effectiveness profile (p = 0.0035) and to the safety profile (p = 0.0067). 

Safety and effectiveness are the two most important indicators for evaluating a new vaccine, and new vaccines undergo substantial tests of their safety and effectiveness before and after coming onto the market [10, 11] . Previous studies showed that most parents express concerns about side-effects, safety, and effectiveness [12] . These concerns may be even more prominent for the COVID-19 vaccine, based on the perceived speed of vaccine development. Similarly, parents showed a substantial shift in attitudes towards the COVID-19 vaccine based on safety and effectiveness. The majority of the respondents would accept a vaccine with high levels of safety and effectiveness, but only one-third would accept a vaccine with lower levels of safety and effectiveness. These preferences could hamper Vaccines 2021, 9, 472 6 of 8 acceptance of the vaccine. Interestingly, the public showed a different level of sensitivity toward safety and effectiveness, with more sensitivity towards effectiveness.

Although vaccines are currently available in some locations, safety and effectiveness may vary. For example, for two that were approved in the U.S., Pfizer-BioNTech's vaccine was 95% and Moderna's 94.1% efficacious in preventing the COVID-19 disease [13, 14] . The AstraZeneca vaccine used in the U.K., India, and Mexico was reported to have an average efficacy of 70% [15] . For the inactivated vaccines produced by Chinese pharmaceutical companies, efficacy ranged from 50 to over 90%, depending on the considered outcome and study site [16] . Currently, 89 vaccines are being tested in clinical trials, and 27 have reached the final stage [17] . As more vaccines come onto the market, the public may find itself choosing among vaccines that have widely varying levels of efficacy.

The study found a strong relationship between vaccine hesitancy and COVID-19 vaccination, and the respondents believe that the new vaccine carried more risks than the older vaccine. The role of vaccine hesitancy, and anti-vaccine movements, has been previously explored. For instance, Gaulano et al. found that Italian women who received information from anti-vaccination movements were less likely to accept mandatory vaccines [18] . However, it is essential to note that people might be hesitant about the COVID-19 vaccine but not for vaccines in general. The COVID-19 vaccine went through the process from development to distribution worldwide at "warp speed." It also adopted a new approach of using mRNA, which is different from traditional vaccines that use weakened or inactive components of the pathogen [19] . Scientists and governments are still assessing the effectiveness after the COVID-19 vaccine was authorized for emergency use in the U.S. [20] .

COVID-19 vaccine hesitancy is present not only in the general public, but also among healthcare workers. A recent survey by Kaiser Family Foundation found that nearly a third of the healthcare workers would probably or definitely refuse the vaccine [21] . Healthcare workers expressed concerns about not enough research having been done; the lack of adequate transparency among pharmaceutical companies, research companies, and governments; and fear of being part of another "Tuskegee Study" [22] . Thus, how to break through the vaccine hesitancy among healthcare workers, who have a higher risk of contracting the virus and play important roles in their patients' vaccine decision making, is of the utmost importance. Even in non-pandemic settings, health care workers have relatively low coverage of non-mandatory vaccines, and this varied by age, with younger personnel more likely to be vaccinated [23] .

This is a cross-sectional study and so we were unable to look at longitudinal connections. Additionally, we assessed intent to get a vaccine, but actual vaccine acceptance may differ as more information becomes available. The vaccine effectiveness and safety profiles that we chose were based on possible ranges from existing influenza and measles vaccines, but the actual characteristics of COVID-19 vaccines may differ. We also did not evaluate acceptance or hesitancy towards other vaccines routinely provided to children, such as the mumps-measles-rubella vaccine, and did not adjust our analyses for this variable. Nonetheless, using a large sample of parents, we were able to assess variations in vaccination intent using a validated vaccination hesitancy scale.

In this study of parents of school-aged children in a suburb of Shanghai, parents showed a substantial shift in attitudes towards the COVID-19 vaccine based on the vaccine's safety and effectiveness. The majority of respondents would accept a vaccine with the most ideal levels of safety and effectiveness, but only one-third would accept vaccines with the least ideal attributes. These findings indicate that COVID-19 vaccine acceptance may be substantially influenced by how effective the vaccine actually is. Controlling outbreaks of COVID-19 in the presence of these strong preferences would require substantial use of non-pharmaceutical interventions. Local circumstances are important to consider when developing programs to promote vaccines, as thoughts about different aspects of vaccination are not uniform across countries. We did not find consistent associations about education and vaccine hesitancy, in contrast to prevailing findings about this relationship in high income countries; more work needs to be done on fully understanding socio-cultural influences on vaccine decision-making. Continued surveillance of attitudes towards vaccination in low-and middle-income countries can help identify shifts in future opinions in vaccination attitudes. Informed Consent Statement: Informed consent was obtained from all subjects involved in the study.

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to personal information contained in some of the data fields.

Community acceptance and willingness-to-pay for a hypothetical Zika vaccine: A cross-sectional study in Indonesia

Learning from the past: Development of safe and effective COVID-19 vaccines

Immunogenicity and safety of a recombinant adenovirus type-5-vectored COVID-19 vaccine in healthy adults aged 18 years or older: A randomised, double-blind, placebo-controlled, phase 2 trial

Adverse consequences of rushing a SARS-CoV-2 VaccineImplications for Public Trust

A Timeline of COVID-19 Vaccine Development

More Than 108 Million Shots Given: Covid-19 Tracker

World Health Organization. Ten Threats to Global Health in 2019

El-Mohandes, A. A global survey of potential acceptance of a COVID-19 vaccine

Modification of a Vaccine Hesitancy Scale for use in adult vaccinations in the United States and China. Hum. Vaccin. Immunother. 2021. ahead of print

World Health Organization. Guidelines on Clinical Evaluation of Vaccines: Regulation Expectations

History of Vaccines, Educational Resource by the College of Physicians of Philadelphia. Vaccine Development, Testing, and Regulation

Vaccine hesitancy and concerns about vaccine safety and effectiveness in Shanghai, China

COVID-19 Vaccine Frequently Asked Questions

Moderna COVID-19 Vaccine Overview and Safety

How Does the AstraZeneca COVID-19 Vaccine Compare to Pfizer's and Moderna's? Available online

SARS-CoV-2 vaccines

Coronavirus Vaccine Tracker

Attitudes towards compulsory vaccination in Italy: Results from the NAVIDAD multicentre study

Understanding and Explaining mRNA COVID-19 Vaccines

Ensuring COVID-19 Vaccines Work CDC

KFF COVID-19 Vaccine Monitor

Some Health Care Workers Are Hesitant About Getting COVID-19 Vaccines. National Public Radio

Vaccination coverage of health care personnel working in health care facilities in France: Results of a national survey

We appreciate the openness of Minhang schools to participate in this project.

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.