key: cord-0703704-basp9lbz
authors: Kim, Sara S; Chung, Jessie R; Belongia, Edward A; McLean, Huong Q; King, Jennifer P; Nowalk, Mary Patricia; Zimmerman, Richard K; Balasubramani, Goundappa K; Martin, Emily T; Monto, Arnold S; Lamerato, Lois E; Gaglani, Manjusha; Smith, Michael E; Dunnigan, Kayan M; Jackson, Michael L; Jackson, Lisa A; Tenforde, Mark W; Verani, Jennifer R; Kobayashi, Miwako; Schrag, Stephanie J; Patel, Manish M; Flannery, Brendan
title: Messenger RNA Vaccine Effectiveness Against Coronavirus Disease 2019 Among Symptomatic Outpatients Aged ≥16 Years in the United States, February–May 2021
date: 2021-09-08
journal: J Infect Dis
DOI: 10.1093/infdis/jiab451
sha: adb6afbb6c1905c13e6135ee79300139f1f01b35
doc_id: 703704
cord_uid: basp9lbz

Evaluations of vaccine effectiveness (VE) are important to monitor as coronavirus disease 2019 (COVID-19) vaccines are introduced in the general population. Research staff enrolled symptomatic participants seeking outpatient medical care for COVID-19–like illness or severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) testing from a multisite network. VE was evaluated using the test-negative design. Among 236 SARS-CoV-2 nucleic acid amplification test-positive and 576 test-negative participants aged ≥16 years, the VE of messenger RNA vaccines against COVID-19 was 91% (95% confidence interval, 83%–95%) for full vaccination and 75% (55%–87%) for partial vaccination. Vaccination was associated with prevention of most COVID-19 cases among people seeking outpatient medical care.

Evaluations of vaccine effectiveness (VE) are important to monitor as coronavirus disease 2019 (COVID-19) vaccines are introduced in the general population. Research staff enrolled symptomatic participants seeking outpatient medical care for COVID-19-like illness or severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) testing from a multisite network. VE was evaluated using the test-negative design. Among 236 SARS-CoV-2 nucleic acid amplification test-positive and 576 test-negative participants aged ≥16 years, the VE of messenger RNA vaccines against COVID-19 was 91% (95% confidence interval, 83%-95%) for full vaccination and 75% (55%-87%) for partial vaccination. Vaccination was associated with prevention of most COVID-19 cases among people seeking outpatient medical care.

Keywords: SARS-CoV-2; COVID-19; vaccine effectiveness.

Randomized controlled trials and real-world effectiveness studies have demonstrated high coronavirus disease 2019 (COVID-19) vaccine effectiveness (VE) against severe outcomes and symptomatic illness among priority groups for vaccination, including healthcare workers and persons aged ≥65 years [1] [2] [3] [4] [5] .

Following the Advisory Committee on Immunization Practice's recommendations for COVID-19 vaccine allocation to target populations, states expanded vaccine availability to the general public aged ≥16 years starting in the spring of 2021 [6] . Given the more common clinical presentation of mild to moderate illness compared to severe outcomes, data are needed on VE for the prevention of COVID-19 among persons seeking care for COVID-19-like illness (CLI) in outpatient settings [7] . Since 2008, the US Influenza Vaccine Effectiveness Network (US Flu VE Network) has provided influenza VE estimates annually. The strength of this long-standing active surveillance network includes coupling of clinical and epidemiological data in thousands of patients annually to generate VE estimates midway through each influenza season. These estimates provide decision makers with real-time data to assess VE in the current season and contribute to informing global annual vaccine strain selection decisions. Investigations of VE in outpatient settings can enhance our understanding of protection among persons seeking care for mild or moderate illness, contribute to estimating the averted healthcare burden attributed to COVID-19, and inform community mitigation policies as vaccine coverage continues to increase among adults and adolescents in the United States. We used the robust surveillance platform of the US Flu VE Network to estimate VE against laboratoryconfirmed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection among persons aged ≥16 years with COVID-19-like symptoms seeking outpatient care or clinical SARS-CoV-2 testing.

We used the test-negative design to evaluate messenger RNA (mRNA) VE against outpatient COVID-19 by comparing vaccine receipt in persons testing positive or negative for SARS-CoV-2 infection [8] . Beginning in March 2020, participating health systems offering outpatient medical care at 5 study sites for the US Flu VE Network in Michigan, Pennsylvania, Texas, Washington, and Wisconsin began active surveillance for COVID-19.

Research staff screened persons who sought outpatient medical care (ie, telehealth, primary care, urgent care, and emergency departments) or clinical SARS-CoV-2 testing using a standard case definition for CLI of an acute onset of fever or feverishness, cough, or loss of taste or smell with symptom duration <10 days [9] . Research staff contacted potentially eligible outpatients by telephone or electronic message to confirm eligibility and enroll consenting participants. In addition to meeting the CLI definition, eligible participants had a clinical or research respiratory specimen collected for SARS-CoV-2 molecular testing within 10 days of illness onset. Standardized questionnaires collected demographic information, general health status, self-reported COVID-19 vaccination, and history of individual respiratory, gastrointestinal, and systemic symptoms experienced during acute illness, as well as potential risk factors for contracting COVID-19, such as working in a healthcare setting and having contact with a person with laboratory-confirmed COVID-19. SARS-CoV-2 nucleic acid amplification test results were used to classify SARS-CoV-2-positive cases and test-negative controls. Research testing, or testing for the purpose of this study, was performed if clinical results were unavailable for study use.

For this analysis, we included participants with illness onset on or after 1 February 2021, for those aged ≥65 years, and on or after 22 March 2021, for those aged 16-64 years; beginning dates of inclusion in analyses varied by site according to local COVID-19 vaccination policies for all persons aged ≥65 or ≥16 years (Supplementary Table 1 ). We determined vaccination status through participant interviews and verified vaccination based on participant-provided vaccination record cards, documentation of vaccination in electronic medical records, or state immunization information systems. Fully vaccinated participants were defined as those who received 2 doses of an mRNA vaccine (Pfizer-BioNTech BNT162b2 or Moderna mRNA-1273) ≥14 days before illness onset [2, 4] . Partially vaccinated participants were defined as those who received ≥1 dose of an mRNA vaccine ≥14 days before illness onset but who were not fully vaccinated. Those who did not report vaccine receipt and had no documentation of any COVID-19 vaccine before illness were defined as unvaccinated. Participants who received their first dose <14 days before illness (n = 100), had been vaccinated with Johnson & Johnson's Janssen (JNJ-784367350) vaccine (n = 22), or selfreported vaccine receipt without documentation (n = 35) were excluded.

For each category of COVID-19 vaccination, VE was calculated as 1 − odds ratio of vaccination among SARS-CoV-2 test-positive participants versus test-negative participants (controls), using multivariable logistic regression. Models were adjusted a priori for study site, age in years (continuous), and enrollment period (natural cubic spline with 3 percentile knots of interval between 1 January 2021 and illness onset date). We evaluated sex, race and Hispanic ethnicity, and having had a SARS-CoV-2-positive contact as additional covariates and included race/ethnicity and positive contact in the final models. We also performed sensitivity analyses comparing VE using plausible self-report with documented vaccination, where plausibility was determined by ability to report credible location of vaccination. Statistical analyses were conducted using SAS software, version 9.4. This activity was reviewed by the institutional review boards of the Centers for Disease Control and Prevention (CDC) and other participating institutions and was conducted consistent with applicable federal law and CDC policy.

Between 1 February and 28 May 2021, 27% of outpatients who were contacted for screening and enrollment agreed to participate. Among 812 enrolled participants aged ≥16 years with CLI, 236 (29%) tested positive for SARS-CoV-2. During the study period, 36 positive SARS-CoV-2 specimens from the US Flu VE Network were sequenced, of which 56% were identified as the alpha (B.1.1.7) variant. SARS-CoV-2 positivity was higher among male participants, those identifying as non-Hispanic black, those aged <65 years, and participants enrolled from the Michigan and Pennsylvania study sites (Table 1) Table 2) .

The effectiveness of mRNA vaccines against laboratoryconfirmed COVID-19 in outpatient settings was 91% (95% confidence interval, 83%-95%) among fully vaccinated and 75% (55%-87%) among partially vaccinated participants ( Table  2) . VE was similar when using documentation, plausible self-report, or both to classify vaccination status (Supplementary Table 2 ). In addition, VE including participants who received the Johnson & Johnson's Janssen vaccine was similar to that of mRNA vaccines.

During February-May 2021 when the alpha (B.1.1.7) variant was the predominant circulating strain in the United States, vaccination reduced laboratory-confirmed symptomatic illness by 91% among those fully vaccinated and 75% among those partially vaccinated in a multisite outpatient network evaluating COVID-19 VE [10] . These findings add to evidence from clinical trials of efficacy against symptomatic illness and observational studies of VE across the continuum of illness severity in multiple countries [1] [2] [3] [4] [5] [11] [12] [13] .

Monitoring VE against COVID-19 in outpatient settings is relevant for 3 reasons. First, outpatient settings may better capture younger age groups, which account for an increasing proportion of COVID-19 cases and are likely to present with moderate symptoms, necessitating outpatient care rather than hospitalization [14] . Furthermore, vaccine coverage is lower in younger adults and adolescents, and thus a higher proportion of cases may occur in this age group. Second, people with mild and moderate COVID-19 are rarely hospitalized and are more likely to seek care in outpatient facilities. Thus, when considering logistics of monitoring VE, planning for enrollment and sample size, evaluating duration of protection, and assessing protection against variants of concern in real time is more feasible in outpatient settings. In addition, outpatient networks have the capability to evaluate possible long-term effects of mild and moderate COVID-19 through follow-up surveys and extraction of related postenrollment medical visits and hospitalizations.

The third rationale for monitoring VE against COVID-19 in outpatient settings is that past experiences from the annual influenza vaccination program have demonstrated success of test-negative studies for monitoring VE among people seeking outpatient medical care for respiratory illness. In turn, VE studies in outpatient settings can be conducted in a timely manner and have less potential for confounding than traditional case-control and cohort studies [8] . Thus, implementing VE studies in outpatient settings to monitor vaccine protection could be valuable for informing policy decisions, such as community mitigation strategies and strain selection for vaccines or booster doses.

These results were subject to several limitations. First, because the uptake of Johnson & Johnson's Janssen vaccine in the general population was limited during the study period, participants receiving the Janssen vaccine were not included in this analysis. Including the 22 vaccinated participants who received the Janssen vaccine (4 case patients and 18 controls) resulted in similar estimates of VE (Supplementary Table 2 ). Second, surveillance populations at the study sites are not representative of the US population, and this analysis did not evaluate VE by race and Hispanic ethnicity. Additional evaluation of VE among racial/ethnic groups disproportionately affected by the pandemic and among other specific populations, such as persons with underlying health conditions, are needed.

As a third limitation, because we relied on vaccine documentation to determine vaccination status, we may have missed unrecorded vaccine doses. However, estimates including selfreported doses, without documentation, showed similar VE (Supplementary Table 2 ). Fourth, selection bias may occur in test-negative studies if vaccinated people were more likely than unvaccinated people to seek care or agree to participate in the study, but that would be expected to underestimate VE. Finally, this analysis measured VE against symptomatic COVID-19 caused by SARS-CoV-2 viruses that circulated during the study period, before emergence of the delta (B.1.617.2) variant in the United States. Further enrollment in the US Flu VE Network will evaluate COVID-19 vaccine protection against delta (B.1.617.2) and emerging variants. As of 29 August 2021, 62% of the US population had received ≥1 dose of a COVID-19 vaccine [15] . A growing number of VE studies have provided evidence that mRNA vaccines confer similar protection against COVID-19 in realworld conditions as in clinical trials, reducing risk of infection and related severe outcomes by ≥90% among those fully vaccinated [1, 2, 12] . In this study, receipt of mRNA vaccines was associated with prevention of most mild to moderate COVID-19 in outpatients seeking medical care or testing in the United States.

Studies should continue to monitor COVID-19 VE against symptomatic illness over time and against variant SARS-CoV-2 viruses to inform vaccination strategies. With the high VE against mild to moderate COVID-19 observed during the study period, early community vaccination strategies likely had a marked impact on disease burden. Efforts to increase vaccination coverage are warranted as the primary prevention strategy, in addition to use of masking, social distancing, and community mitigation strategies for schools, workplaces and gatherings.

Supplementary materials are available at The Journal of Infectious Diseases online. Consisting of data provided by the authors to benefit the reader, the posted materials are not copyedited and are the sole responsibility of the authors, so questions or comments should be addressed to the corresponding author. Abbreviations: CI, confidence interval; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; VE, vaccine effectiveness. a VE adjusted for study site, age in years (continuous), enrollment period (natural cubic spline with 3 percentile knots), race/ethnicity, and contact with a SARS-CoV-2-positive person.

ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that the editors consider relevant to the content of the manuscript have been disclosed.

Interim estimates of vaccine effectiveness of BNT162b2 and mRNA-1273 COVID-19 vaccines in preventing SARS-CoV-2 infection among health care personnel, first responders, and other essential and frontline workers-eight U.S. locations

IVY Network Investigators; IVY Network. Sustained effectiveness of Pfizer-BioNTech and Moderna vaccines against COVID-19 associated hospitalizations among adults-United States

COVE Study Group. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine

BNT162b2 mRNA Covid-19 vaccine in a nationwide mass vaccination setting

C4591001 Clinical Trial Group. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine

The Advisory Committee on Immunization Practices' updated interim recommendation for allocation of COVID-19 vaccine -United States

Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention

The test-negative design for estimating influenza vaccine effectiveness

Clinical symptoms among ambulatory patients tested for SARS-CoV-2

Centers for Disease Control and Prevention. COVID data tracker: variant proportions

Canadian Immunization Research Network (CIRN) Provincial Collaborative Network (PCN) Investigators. Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study

Vaccine Effectiveness Among Healthcare Personnel Study Team. Interim estimates of vaccine effectiveness of Pfizer-BioNTech and Moderna COVID-19 vaccines among health care personnel-33

Effectiveness of the Pfizer-BioNTech and Oxford-AstraZeneca vaccines on covid-19 related symptoms, hospital admissions, and mortality in older adults in England: test negative case-control study

ATS Lombardy COVID-19 Task Force. Association of age with likelihood of developing symptoms and critical disease among close contacts exposed to patients with confirmed SARS-CoV-2 infection in Italy

Centers for Disease Control and Prevention. COVID data tracker weekly view