key: cord-0690632-5afpwldk
authors: Taghioff, Susan M.; Slavin, Benjamin R.; Holton, Tripp; Singh, Devinder
title: Examining the potential benefits of the influenza vaccine against SARS-CoV-2: A retrospective cohort analysis of 74,754 patients
date: 2021-08-03
journal: PLoS One
DOI: 10.1371/journal.pone.0255541
sha: 6115ed05e86431aff5c6789734513d393b43cba6
doc_id: 690632
cord_uid: 5afpwldk

INTRODUCTION: Recently, several single center studies have suggested a protective effect of the influenza vaccine against severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2). This study utilizes a continuously updated Electronic Medical Record (EMR) network to assess the possible benefits of influenza vaccination mitigating critical adverse outcomes in SARS-CoV-2 positive patients from 56 healthcare organizations (HCOs). METHODS: The de-identified records of 73,346,583 patients were retrospectively screened. Two cohorts of 37,377 patients, having either received or not received influenza vaccination six months–two weeks prior to SARS-CoV-2 positive diagnosis, were created using Common Procedural Terminology (CPT) and logical observation identifiers names and codes (LOINC) codes. Adverse outcomes within 30, 60, 90, and 120 days of positive SARS-CoV-2 diagnosis were compared between cohorts. Outcomes were assessed with stringent propensity score matching including age, race, ethnicity, gender, hypertension, diabetes, hyperlipidemia, chronic obstructive pulmonary disease (COPD), obesity, heart disease, and lifestyle habits such as smoking. RESULTS: SARS-CoV-2-positive patients who received the influenza vaccine experienced decreased sepsis (p<0.01, Risk Ratio: 1.361–1.450, 95% CI:1.123–1.699, NNT:286) and stroke (p<0.02, RR: 1.451–1.580, 95% CI:1.075–2.034, NNT:625) across all time points. ICU admissions were lower in SARS-CoV-2-positive patients receiving the influenza vaccine at 30, 90, and 120 days (p<0.03, RR: 1.174–1.200, 95% CI:1.003–1.385, NNT:435), while approaching significance at 60 days (p = 0.0509, RR: 1.156, 95% CI:0.999–1.338). Patients who received the influenza vaccine experienced fewer DVTs 60–120 days after positive SARS-CoV-2 diagnosis (p<0.02, RR:1.41–1.530, 95% CI:1.082–2.076, NNT:1000) and experienced fewer emergency department (ED) visits 90–120 days post SARS-CoV-2-positive diagnosis (p<0.01, RR:1.204–1.580, 95% CI: 1.050–1.476, NNT:176). CONCLUSION: Our analysis outlines the potential protective effect of influenza vaccination in SARS-CoV-2-positive patients against adverse outcomes within 30, 60, 90, and 120 days of a positive diagnosis. Significant findings favoring influenza vaccination mitigating the risks of sepsis, stroke, deep vein thrombosis (DVT), emergency department (ED) & Intensive Care Unit (ICU) admissions suggest a potential protective effect that could benefit populations without readily available access to SARS-CoV-2 vaccination. Thus further investigation with future prospective studies is warranted.

a1111111111 a1111111111 a1111111111 a1111111111 a1111111111

With cases in excess of 140 million and a death toll over 3 million, COVID-19 has greatly impacted the global community [1] . In the nascency of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), demand for rapid, yet accurate data was voracious [2] . As the world continues to attempt to overcome the current pandemic and readies itself to combat a future one, the need for expeditious clinical answers remains paramount.

Federated electronic medical record (EMR) networks, such as TriNetX (TriNetX Inc, Cambridge, MA), aggregate the de-identified records of millions of patients from participating healthcare organizations (HCOs) into an accessible and searchable database in real-time [3, 4] . Several publications have already demonstrated the utility of federated EMR networks in addressing research questions regarding the implications of SARS-CoV-2 on maladies including obesity, rheumatological disease, gastrointestinal bleeding, and psychiatric illness [5] [6] [7] [8] . The efficiency and speed with which these previous retrospective studies were able to examine topics of interest, using real-time EMRs, allows for the collective advancement of COVID-19 knowledge in hopes of optimizing prevention and management.

Recently, several studies have suggested a possible protective effect of the influenza vaccine against SARS-CoV-2 [9] [10] [11] [12] . Although no cross-reactivity between influenza-induced antibodies and SARS-CoV-2 protection has been demonstrated, several theorized mechanisms of the potential protective effect of influenza vaccination have been proposed in the recent literature [9, 13, 14] . The first hypothesis centers around the presence of MF59 in the influenza vaccine: an oil-in-water squalene emulsion that has been shown to assist in potentiating an immune response to SARS-CoV variants [14] . Alternatively, influenza vaccination's potential protective effect may be explained by its ability to stimulate the activation of natural killer cells, the levels of which have been found to be considerably decreased in moderate and severe SARS-CoV-2 cases [15, 16] . Another proposed mechanism was described in a recent case-control study of 261 healthcare workers. The authors noted several prior studies that suggested both coronaviruses and influenza viruses engage with the angiotensin-converting enzyme 2 (ACE-2) and tetraspanin antibodies. Thus, there is belief that ACE-2 and tetraspanin antibodies may inhibit both coronavirus and low-pathogenic influenza A virus infections. Outcomes of this study pointed to a potential protective effect in those with influenza vaccination [11] . Additional studies reported that the influenza vaccine may lead to decreased risk of cardiovascular events due to potential interaction with immune and inflammatory systems to promote plaque stabilization [17, 18] . It has also been recently reported that influenza vaccine-induced antibodies may interact with the bradykinin 2 receptor, leading to an anti-inflammatory effect secondary to increasing nitric oxide [18, 19] .

In a single-center study of 2,005 patients, Yang et al. were the first to perform a retrospective review highlighting a potential protective effect of influenza vaccination against adverse outcomes associated with SARS-CoV-2. Only 10.7% of patients in this study were considered up to date on their influenza immunization. The authors reported a 2.44 greater odds ratio (OR) for hospitalization and 3.29 greater OR for intensive care unit (ICU) admission indicating a protective effect for SARS-CoV-2 positive patients who were up to date on their influenza immunization [9] .

This investigation seeks to explore the potential protective effects of influenza vaccination against SARS-CoV-2 using the TriNetX database. Specifically, this study aims to assess the possible benefit of influenza vaccination in mitigating critical adverse outcomes in SARS-CoV-2 positive patients using 73 million deidentified EMRs from 56 HCOs provided by a continuously updated network.

At the time of our search in January 2021, the analytics subset contained EMRs from 56 HCOs distributed predominantly throughout the United States of America, but also with participating institutions in the United Kingdom, Italy, Germany, Israel, and Singapore. Within the US, the geographic distribution of HCOs is 6% in the Northwest, 33% in the Midwest, 42% in the South, and 19% in the West [3] . The deidentified records of 73,346,583 patients were retrospectively screened using the TriNetX platform (Fig 1) .

In order to ensure accuracy, logical observation identifiers names and codes (LOINCs), the universal standard for identification of medical laboratory data, were used to identify patients positive for SARS-CoV-2 (LOINC 94500-6). CPT codes were used to identify patients who had received either the trivalent live intranasal (90660) or inactivated intramuscular influenza vaccine (90653) within a timeframe of six months-two weeks prior to receiving a SARS--CoV2-positive diagnosis. Additionally, Medicare patients receiving either the intranasal or intramuscular influenza vaccine were captured using the corresponding healthcare common procedure coding system (HCPCS) code (G0008). Any EMRs belonging to patients that were pregnant, incarcerated, experienced an outcome outside of a 120-day post-SARS-CoV-2 diagnosis window, or not meeting all of the aforementioned criteria by CPT code were excluded. Following application of inclusion and exclusion criteria, a cohort of 2,814,377 patients who had not received the influenza vaccine six months-two weeks prior to a positive SARS-CoV-2 diagnosis was compared to a second cohort of 37,377, patients who had received the influenza vaccine six months-two weeks prior to a positive SARS-CoV-2 diagnosis. We selected two weeks as the minimum end of our study's timespan as it takes approximately two weeks for the immune system to fully develop antibodies following influenza vaccination. Conversely, six months was chosen as the maximum end of the timespan between influenza vaccination and SARS-CoV-2-positive diagnosis because the accepted standard for adequate protection without a waning effect is six months [20] .

Following the creation of these two cohorts, we used the TriNetX platform to facilitate propensity score matching between cohorts with ICD-10 codes for numerous factors including age, race, gender, ethnicity, diabetes mellitus (E08-E13), elevated BMI status (E65-E68), hypertension (I10-I16), chronic ischemic heart disease (I25), heart failure (I50), COPD (J44), musculoskeletal disease (M00-M99), and factors influencing health status and contact with human services (Z00-Z99) which includes factors influencing health status including tobacco use, body mass index (BMI), and socioeconomic status. After propensity score matching, a cohort of 37,377 SARS-CoV-2 positive patients without influenza vaccination was paired with a second cohort of 37,377 SARS-CoV-2 positive patients, comparable in demographics and comorbidities, that had received influenza vaccination within the aforementioned time frame.

Propensity score 1:1 balancing was completed within the TriNetX platform via logistic regression utilizing version 3.7 of Python Software Foundation's Scikit-Learn package (Python Software Foundation, Delaware, USA). A greedy nearest neighbor matching algorithm approach was used, setting standard differences to a value of less than 0.1 to indicate appropriate matching. To eliminate record order bias, randomization of the record order in a covariate matrix occurs before matching. Baseline characteristics with a standardized mean difference between cohorts lower than 0.1 were considered well balanced.

Following optimization of the two cohorts for direct comparison, adverse outcomes were identified with ICD-10 or CPT codes as sepsis (A41. 

Following identification, adverse outcomes within 30, 60, 90, and 120 days of SARS-CoV-2-positive diagnosis were analyzed and compared between the two cohorts. 120 days was made the maximum endpoint of our study window to account for the presence of the poorly understood Post-Acute Covid Syndrome (PACS), an autonomic dysfunction phenomenon observed in many patients after recovering from SARS-CoV-2 [17] .

Using the TriNetX platform's Analytics function, statistical analysis and logistical regression were performed by comparing indices and relative risks of outcomes following the successful matching of cohorts with a p-value greater than 0.05. Outcomes for all measures were calculated using 95% confidence intervals (CIs). All p-values were two-sided and the alpha level was set at 0.05. Risk ratio was defined in this study as the ratio of the probability of an adverse SARS-CoV-2-related event occurring without history of up-to-date influenza vaccination versus the probability of the same adverse SARS-CoV-2-related event occurring in a patient with history of up-to-date influenza vaccination [21] .

Subsequently, Absolute Risk Reduction (ARR), defined as the difference in risk of an adverse SARS-CoV-2-related outcome between the influenza-vaccinated group and non-influenza-vaccinated group, was calculated for each adverse outcome. The reciprocal of ARR was then obtained to determine number needed to treat, henceforth referred to in this study as number needed to vaccinate (NNV), for all statistically significant variables. The NNV is a calculation specifying the average number of patients who needed to be up-to-date on their influenza vaccination in order to have prevented one adverse SARS-CoV-2-related outcome [22, 23] .

Propensity score matching resulted in 37,377 patients in each cohort. Prior to matching, all between-groups factors were found to be significantly different (p<0.0001). However, following matching, all demographic and diagnostic factors were no longer significant (p>0�05) ( Table 1) , indicating successful balancing.

Following propensity score matching by the TriNetX system, statistical analysis was performed for all adverse outcomes of interest at 4 time points: 30, 60, 90, and 120 days following a SARS-CoV-2-positive diagnosis (Tables 2-5) .

SARS-CoV-2-positive patients who received the influenza vaccine experienced significantly decreased sepsis (p = 0.0001-0.0020, Risk Ratio: 1.361-1.450, 95% CI: 1.123-1.699) and stroke (p = 0.0003-0.0154, Risk Ratio: 1.451-1.580, 95% CI: 1.075-2.034) across all time points. ICU admissions were significantly lower in SARS-CoV-2-positive patients receiving the influenza vaccine at 30, 90, and 120 days (p = 0.0073-0.0240, Risk Ratio: 1.174-1.200, 95% CI: 1.003-1.385), while approaching significance at 60 days (p = 0.0509, Risk Ratio: 1.156, 95% CI: 0.999-1.338) (Fig 2A) .

Patients who received influenza vaccination experienced significantly fewer DVTs 60-120 days after positive SARS-CoV-2 diagnosis (p = 0.0058-0.0108, Risk Ratio: 1.411-1.530, 95% CI: 1.082-2.076) ( Fig 2B) and experienced significantly fewer ED visits 90-120 days post SARS-CoV-2-positive diagnosis (p = 0.0001-0.0076, Risk Ratio: 1.204-1.580, 95% CI: 1.050-1.476) (Fig 2C) .

Additional findings included patients up-to-date on their influenza vaccination experiencing significantly less anorexia within 90 days of SARS-CoV-2-positive diagnosis (p = 0.0486, Risk Ratio: 1.276, 95% CI: 1.001-1.627) as well as decreased arthralgia within 120 days of SARS-CoV-2-positive diagnosis (p = 0.0041, Risk Ratio: 1.218, 95% CI: 1.064-1.395).

NNV with influenza vaccination to prevent one adverse SARS-CoV-2-related outcome calculations for significant findings for sepsis, stroke, and ICU Admission within 30, 60, 90, and 120 days of positive SARS-CoV-2 diagnosis are illustrated in Fig 3, along with NNV to prevent DVT within 60-120 days, and NNV to prevent ED Visits within 90-120 days (Fig 3) . 

Examining the potential benefits of the influenza vaccine against SARS-CoV-2

This study underscores the utility of federated EMR networks as a potential solution for the need for urgent clinical data, particularly during health crises such as pandemics. While the work of retrospective single-center studies continues to have advantages such as detailed 

Examining the potential benefits of the influenza vaccine against SARS-CoV-2 historical patient information that deidentified EMR networks cannot provide, the ability to scan, in minutes, the charts of 73 million patients from 56 HCOs in real-time to guide clinical decision-making is invaluable. EMRs included in our study monitored patients with positive SARS-CoV-2 diagnoses for adverse outcomes during a period of 120 days. This time window was chosen intentionally to 

Examining the potential benefits of the influenza vaccine against SARS-CoV-2 account for the possible presence of PACS. Although poorly understood, previous studies of PACS have reported orthostatic intolerance, often without objective hemodynamic abnormalities upon testing, as well as new illness-related fatigue to be the most common presentations. Development of these symptoms was found to occur between 0-122 days and 29-71 days post-SARS-CoV-2 diagnosis respectively [24, 25] . By focusing on rates of hospitalization and ICU admission, the study of Yang et al., garnered a sizable amount of media coverage [23, 24] . This study most closely mirrors this study's aim of appraising the potential impact of influenza vaccination on adverse outcomes associated with SARS-CoV-2. Prior to comparing findings between these two studies, it is important to note several key differences in methodology [9] . While both studies relied on medical coding to identify SARS-CoV-2 positivity and influenza vaccination status, the timeframes were different, with this study encompassing the first full year of SARS-CoV-2 cases globally from January 2020-January 2021 [1, 25] . This timespan enabled our study to include data from the 2019-2020 influenza vaccine formulation as well as the most recent 2020-2021 influenza season formulation. This contrasts with the timespan of the previously mentioned study, as well as the recently published retrospective review of 27,000 patients by Conlon et al. Both of these studies analyzed SARS-CoV-2 cases between March-August 2020, a period overlapping between two different influenza vaccinations and seasons which excludes peak influenza season, and did not set a 2 week-6 month time limit for influenza vaccine being "current/active" [9, 12] . Additionally, the Yang and Conlon study timeframes began 6 months after the CDC's recommended influenza vaccination time in October, therefore the vaccine antibodies were likely already waning [9, 12, 20] .

Our study found no association between influenza vaccination and risk of death in SARS--CoV-2-positive patients. This confirms the previous findings of Umasabor-Bubu et al., Pedote et al. and Ragni et al., which found that a history of influenza vaccination did not confer protection against death in reviews of 558, 664, and 17,600 patients respectively [26] [27] [28] .

Alternatively, two macro-scale studies have found there to be conflicting relationships between influenza vaccination and mortality in the elderly population. In a large scale study of over 2,000 counties in the United States, Zanettini et al. demonstrated a potential protective effect of influenza vaccination on SARS-CoV-2 mortality [29] . Conversely, Wehenkel et al. performed a macro-scale study of association between influenza vaccination rate and SARS--CoV-2 deaths in an examination of over 500,000 patients across 39 countries [30] . This study showed a positive association between COVID-19 deaths and influenza vaccination rates in elderly people 65 years of age and older. The conflicting findings of these studies may be attributable to their large scale nature and lack of analysis of individual patient EMRs, thereby further increasing the need for prospective randomized control studies to better define the potential protective effect of influenza vaccination against SARS-CoV-2.

In light of the over 140 million confirmed positive cases worldwide 1 , the use of NNV calculations allows for a deeper appreciation of the potential benefit of influenza vaccination. In addition to guarding against a possible "twindemic" of simultaneous outbreaks of influenza and SARS-CoV-2 [31] , the NNV trends observed within 30-120 days of SARS-CoV-2 diagnosis for sepsis, stroke, ICU admission, DVT, and ED visits further strengthen the case in favor of a protective effect of influenza vaccination (Fig 3) . Specifically, in order to prevent one individual from visiting the ED, developing sepsis, being admitted to the ICU, suffering a stroke, or having a DVT within 120 days of positive SARS-CoV-2 diagnosis, 176, 286, 435, 625, and 1,000 people respectively would need to have been up-to-date with their influenza vaccination. When considered on a global scale, the NNVs calculated in this study may serve to benefit not only those that will be infected with SARS-CoV-2, a diagnosis that has already affected over 140 million to date, but also the finances and resources of the health systems responsible should patients suffer these adverse outcomes [32] . Even more encouraging, apart from DVT for which NNV remained stable, the NNVs for sepsis, stroke, ICU Admissions, and ED Visits were down trending at the 120-day mark, implying that the NNV and thus potential protective benefit of influenza vaccination may be even stronger than observed in the present study.

Expanding upon our prospective understanding of the relationship between influenza vaccination and protection against adverse outcomes during SARS-CoV-2 is the work of Pawlowski et al. This retrospective review found that a history of eight different vaccines including Polio, H. influenzae type-B, measles-mumps-rubella, and Varicella, amongst others, within the past one, two, or five years is associated with decreased SARS-CoV-2 infection rates, even after cohort balancing [33] . This suggests that the protective effect observed by our group and others against SARS-CoV-2 may not be unique to influenza vaccination.

This study has the benefits of large cohort size and a tightly matched patient population, however reliance on a global database also introduces limitations that must be acknowledged. These limitations include our study's retrospective nature, absence of detailed historical patient data, and lack of ability to follow up regarding new symptoms. Our search query's reliance on the CPT, ICD-10, and LOINC coding of individual HCOs is another potential source of confounding as the accuracy of these factors is inherent to the EMRs comprising the database. This statement is particularly of interest as relates to false positive and false negative cases of SARS-CoV-2, which relies on the specificity and sensitivity of PCR and rapid antigen testing.

Federated EMR networks, such as TriNetX, have vast potential to challenge or verify scientific findings using sample sizes and turnaround times unachievable by individual centers, particularly during health crises such as pandemics. Our study was able to verify and challenge the relatively large difference in the potential protective effect of influenza vaccination observed by the previous study with a much more modest effect backed by nearly 75,000 global EMRs [9] . The potential protective effects of the vaccine against sepsis, stroke, DVT, ED visits, and ICU admissions at 30, 60, 90, and 120 days following SARS-CoV-2-positive diagnosis reaffirms the importance of annual influenza immunization.

While this observed potential protective effect is relatively small, the stringently matched cohort balancing and sample size afforded by TriNetX substantially increases our confidence in the fidelity of our findings. In the context of over 140 million cases globally, the potential protective benefits further elucidated by the NNV calculations for these same adverse outcomes suggests that a concerted effort to continue ramping up influenza vaccination in parallel with SARS-CoV-2 vaccination is strongly worth consideration. Although production and distribution of SARS-CoV-2 vaccines continues to increase daily, the fact remains that certain populations in the global community may still have to wait a long period of time before they are vaccinated and could therefore benefit from a more readily available source of even marginally increased protection [34] . That being said, less than half of US adults receive influenza vaccination each year, with Non-Hispanic Black, Hispanic, and American Indian/Alaskan Native individuals having had the lowest influenza vaccination coverage while also being disproportionately affected by SARS-CoV-2 [35] .

The influenza vaccine may be a viable option to attenuate the adverse effects of SARS-CoV-2 worldwide, with a specific potential to benefit populations struggling with access to or distribution of SARS-CoV-2 vaccination. Even patients who have already received SARS-CoV-2 vaccination may stand to benefit given that the SARS-CoV-2 vaccine does not convey complete immunity, although further research into the relationship and potential interaction between influenza vaccination and SARS-CoV-2 vaccination should be performed.

Using a federated EMR network of over 73 million patients across 56 global HCOs, this analysis examines the potential protective effect of the influenza vaccine against various adverse outcomes at 30, 60, 90, and 120 days of SARS-CoV-2-positive diagnosis. Significant findings in favor of the influenza vaccine in mitigating the risks of sepsis, stroke, DVT, ED visits, and ICU admissions suggest a protective effect that merits further investigation. Limitations include this study's retrospective nature and its reliance on the accuracy of medical coding. Future prospective controlled studies to validate these findings and determine if an increased emphasis on influenza vaccination will improve adverse outcomes in SARS-CoV-2-positive patients will be beneficial.

Conceptualization: Susan M. Taghioff, Benjamin R. Slavin, Devinder Singh. 

COVID-19 map-johns Hopkins Coronavirus resource Center

Considerations for diagnostic COVID-19 tests

Using a federated network of real-world data to optimize clinical trials operations

Impact of obesity on outcomes of patients with coronavirus disease 2019 in the united states: A multicenter electronic health records network study

Endoscopic Utilization and Outcomes of Upper Gastrointestinal Bleeding in COVID-19: A Global Real-World Database Analysis. SSRN

Bidirectional associations between COVID-19 and psychiatric disorder: Retrospective cohort studies of 62 354 COVID-19 cases in the USA

Temporal trends in severe COVID-19 outcomes in patients with rheumatic disease: A cohort study

Influenza vaccination and hospitalizations among COVID-19 infected adults

Annual influenza vaccination effect on the susceptibility to COVID-19 infection

A case-control study of the 2019 influenza vaccine and incidence of COVID-19 among healthcare workers

Impact of the influenza vaccine on COVID-19 infection rates and severity

Effect of Low-Pathogenic Human Coronavirus-Specific Antibodies on SARS-CoV-2

Potential adjuvants for the development of a SARS-CoV-2 vaccine based on experimental results from similar coronaviruses

Control of human viral infections by natural killer cells

The Potential Effect of Novel Coronavirus SARS-CoV-2 on NK Cells

Influenza vaccination promotes stable atherosclerotic plaques in apoE knockout mice

Influenza vaccination to reduce cardiovascular morbidity and mortality in patients with COVID-19: JACC state-of-the-art review

Influenza vaccine as prevention for cardiovascular diseases: Possible molecular mechanism

The Flu Season | CDC

Relative risk

How and why researchers use the number needed to vaccinate to inform decision making-a systematic review

Number needed to treat (or harm)

Autonomic dysfunction following COVID-19 infection: An early experience

Postdischarge symptoms and rehabilitation needs in survivors of COVID-19 infection: A cross-sectional evaluation

Association between influenza vaccination and severe COVID-19 outcomes at a designated COVID-only hospital in brooklyn

Association between exposure to influenza vaccination and COVID-19 diagnosis and outcomes. Vaccines (Basel)

Influenza vaccination and health outcomes in COVID-19 patients: A retrospective cohort study. Vaccines (Basel)

Influenza vaccination and COVID19 mortality in the USA

Positive association between COVID-19 deaths and influenza vaccination rates in elderly people worldwide

The COVID-19 and influenza "twindemic": Barriers to influenza vaccination and potential acceptance of SARS-CoV2 vaccination in african americans

Flu Shot May Shield You From Severe COVID

Exploratory analysis of immunization records highlights decreased SARS-CoV-2 rates in individuals with recent non-COVID-19 vaccinations

Shocking imbalance' of COVID-19 vaccine distribution underscores inequity

Prevention and control of seasonal influenza with vaccines: Recommendations of the Advisory Committee on Immunization Practices-United States