key: cord-0867045-tjwkr93v authors: Imran, Mahrukh; Puig-Barbera, Joan; Ortiz, Justin R; Fischer, Lauren; O’Brien, Dan; Bonafede, Machaon; Mansi, James A; Boikos, Constantina title: Relative Effectiveness of MF59 Adjuvanted Trivalent Influenza Vaccine vs Nonadjuvanted Vaccines During the 2019–2020 Influenza Season date: 2022-04-02 journal: Open Forum Infect Dis DOI: 10.1093/ofid/ofac167 sha: 422bb5eae7ed73e1b14e0665d4e3a295aac73a03 doc_id: 867045 cord_uid: tjwkr93v BACKGROUND: Age-related immunosenescence may impair the immune response to vaccination in older adults. Adjuvanted influenza vaccines are designed to overcome immune senescence in older adults. This study estimated the relative vaccine effectiveness (rVE) of MF59-adjuvanted trivalent inactivated influenza vaccine (aIIV3) vs egg-derived quadrivalent inactivated influenza vaccine (IIV4e) and high-dose trivalent inactivated influenza vaccine (HD-IIV3) in preventing influenza-related medical encounters in the 2019–2020 US season. METHODS: This retrospective cohort study used electronic medical records linked to pharmacy and medical claims data. The study population included adults age ≥65 years with a record of aIIV3, IIV4e, or HD-IIV3 vaccination. A doubly robust inverse probability of treatment weighting model was used to derive adjusted odds ratios (ORs). rVE was calculated by (1 – OR(adjusted))*100 and was determined overall and separately for age subgroups. An exploratory analysis evaluated the outcome separately in inpatient and outpatient settings. RESULTS: Subjects received aIIV3 (n = 936 508), IIV3e (n = 651 034), and HD-IIV3 (n = 1 813 819), and influenza-related medical encounters were recorded in 0.5%, 0.9%, and 0.7% of each cohort, respectively. Overall, the rVE of aIIV3 was 27.5% (95% CI, 24.4% to 30.5%) vs IIV4e and 13.9% (95% CI, 10.7% to 17.0%) vs HD-IIV3. aIIV3 had a more favorable rVE in inpatient and outpatient settings. Findings remained consistent across age subgroups and during alternative seasonal dates. CONCLUSIONS: Adults age ≥65 years vaccinated with aIIV3 had fewer influenza-related medical encounters compared with IIV4e or HD-IIV3 during the 2019–2020 US influenza season. Adults age 65 years and older are at increased risk of death and complications from respiratory virus infections [1] . Seasonal epidemics of influenza viruses cause substantial morbidity and mortality, and each year the highest rates of influenza-associated deaths and hospitalizations are reported among older adults in the United States and elsewhere [2, 3] . For this reason, adults age ≥65 years are considered a highpriority vaccination group by the US Advisory Committee on Immunization Practices (ACIP) [4] . Standard egg-grown inactivated influenza vaccines with 15 mcg per antigen may elicit diminished immune responses in older adults as compared with younger adult age groups due to age-related immunosenescence [5, 6] . To help address this phenomenon, an MF59-adjuvanted egg-grown trivalent inactivated influenza vaccine (aIIV3; Fluad, Seqirus USA Inc., Summit, NJ, USA) with 15 mcg per antigen has been developed that elicits a greater immune response, including production of cross-reactive antibodies, and has demonstrated greater effectiveness than unadjuvanted influenza vaccines in adults age ≥65 years [5, [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] . In addition, a high-dose egg-grown trivalent inactivated influenza vaccine (HD-IIV3; Fluzone High-Dose, Sanofi Pasteur Inc., Swiftwater, PA, USA) with 60 mcg per antigen has also been shown to have greater efficacy and effectiveness than lower-dose vaccines in older adults [18] [19] [20] . Both the adjuvanted and enhanced vaccines are currently licensed and available for use in the United States, United Kingdom, Canada, Europe, Australia, and other countries worldwide. In a prior study during the 2017-2018 and 2018-2019 US influenza seasons, we evaluated the effectiveness of aIIV3 relative to alternative standards of care for persons age ≥65 yearsnamely egg-derived quadrivalent inactivated influenza vaccine (IIV4e) and HD-IIV3 [17] . Given the variability of seasonal M A J O R A R T I C L E influenza epidemiology and to understand the consistency of the effectiveness of aIIV3, we sought to conduct a similar analysis in the 2019-2020 influenza season. The primary objective of this retrospective cohort study was to estimate the adjusted relative vaccine effectiveness (rVE) of aIIV3 vs IIV4e and of aIIV3 vs HD-IIV3 in the prevention of influenza-related medical encounters in adult subjects ≥65 years of age. A secondary objective was to determine rVE in older adult subgroups (≥65 to ≤74 years, ≥75 to ≤84 years, and ≥85 years). The primary analysis study period was from August 1, 2019, through March 7, 2020. This aligns with the Centers for Disease Control and Prevention (CDC) influenza surveillance season, defined as epidemiologic weeks 40 through 20 of the subsequent year, though we truncated the end of the study period to avoid potential bias arising from the co-circulation of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in the United States in March 2020. The study was designed, implemented, and reported in accordance with Good Pharmacoepidemiological Practice, applicable local regulations, and the ethical principles laid down in the Declaration of Helsinki. Study results have been reported according to the Reporting of Studies Conducted using Observational Routinely Collected Health Data (RECORD) recommendations [21] . We conducted the analysis using a data set linking patientlevel electronic medical records (EMRs) from primary care and specialty clinics with open and closed claims data, where available. Three national EMR systems form the basis of the integrated data set: Veradigm Health Insights Ambulatory database, which comprises Allscripts Touchworks and Allscripts PRO (Chicago, IL, USA), as well as Practice Fusion, Inc. (San Francisco, CA, USA), and a variety of medical practices of different sizes, as well as integrated delivery networks. The Komodo Healthcare Map (Komodo Health Inc., New York, NY, USA) consists of anonymized patient-level US pharmacy and medical claims data and includes both open and closed claims. Data from open claims can be captured within days of a health care encounter and are sourced from practice management systems, billing systems, and claims clearinghouses, whereas data from closed claims have longer lag times and are sourced from insurance providers and payers. The integrated data set includes data since 2014 for roughly 123 million individuals with representation from all 50 US states and provides comprehensive pharmaceutical, demographic, diagnostic, and health care utilization information on patients. Before linkage, each individual data set underwent de-identification and privacy certification to verify it met the minimum Protected Health Information (PHI) data requirements and was evaluated and certified for Health Insurance Portability and Accountability Act (HIPAA) compliance by a third-party statistician (see the Supplementary Data for de-identification and linkage details). As this study was a noninterventional retrospective study using a certified HIPAA-compliant de-identified database, the study does not fall within the regulatory definition of research involving human subjects as outlined by the Code of Federal Regulations (policy 46.102(f)), and approval for this analysis by an institutional review board was not necessary. The exposure of interest was aIIV3, which was compared with both IIV4e and HD-IIV3. The date of recorded immunization was considered the index date. Current Procedural Terminology (CPT) codes, codes for vaccines administered (CVX), and national drug codes (NDCs) (Supplementary Table 1 ) were used to identify vaccinated subjects from both EMRs and claims data. In addition, we identified patients receiving nonadjuvanted, standard-dose, trivalent influenza vaccine (IIV3e). During [22] . The study population included US residents ≥65 years of age at the time of vaccination with a record of receiving aIIV3, IIV4e, HD-IIV3, or IIV3e between August 1, 2019, and January 31, 2020 (vaccination intake period). Formulations of IIV4e were first distributed in the United States in 2013-2014 and gradually replaced IIV3e. Individuals receiving IIV3e were excluded from the analysis population due to limited sample size. Subjects needed to have activity in the Veradigm EMR as well as the claims database within the 12 months before the index date to be included in the analysis. Patients were excluded if they had received >1 influenza vaccination, had a record of influenza vaccination outside of the vaccination intake period, or had an influenza-related medical encounter (IRME) during the 2019-2020 season before being fully vaccinated (to allow for development of vaccine-specific influenza immunity, subjects were considered fully vaccinated 14 days after the index date). Subjects who had an influenza-related medical encounter before the start of the influenza season (ie, before September 29, 2019) and those with missing sex or geographic information were also excluded from the analysis. The outcome was an influenza-related medical encounter ascertained using International Classification of Diseases (ICD) codes specific to the diagnosis of influenza disease (Supplementary Table 2 ) [23] . Inpatient influenza-related medical encounters were evaluated separately when recorded as the admitting diagnosis vs a diagnosis in any position within the medical claim. The admitting diagnosis is the initial working diagnosis for which an individual was admitted, whereas any diagnosis includes secondary diagnoses, that is, conditions that coexisted at the time of admission or developed subsequently. Influenza-related medical encounters recorded during an emergency room (ER) visit were classified as inpatient. Covariates were identified per protocol and were ascertained from EMRs and claims in the 12 months before the index date (pre-index period). These included age, sex (male, female), race (Black, White, not reported, other), ethnicity (Hispanic, Non-Hispanic, not reported), US geographic region (Northeast, Midwest, South, West, other), index week, frailty index (a summary score for activities of daily living [24] ) (Supplementary Table 3 ), individual comorbidities included in the Charlson comorbidity index [25, 26] (Supplementary Table 4 ), and 2 variables used as proxies for health care-seeking behavior: number of outpatient visits in the pre-index period and number of inpatient admissions in the pre-index period. Differences in baseline covariates between the exposure groups (aIIV3, IIV4e, and HD-IIV3) were assessed using standardized mean differences (SMDs), with a value of ≤0.1 indicating a negligible difference. Inverse probability of treatment weighting (IPTW) was implemented to adjust for covariate imbalance between cohorts [27] . In the IPTW method, weights were assigned to individuals based on the inverse of their probability of receiving the treatment, as estimated by propensity scores. First, propensity scores were calculated for each exposure cohort using a multivariable logit model adjusted for all covariates listed above. Propensity scores were then used to create stabilized IPTWs. Weights were truncated at the 99th percentile to attenuate any extreme variability from outlier patients. Adjusted odds ratios (ORs) were estimated using a doubly robust approach. Final adjusted ORs were estimated using a multivariable logistic regression model (including all variables in the propensity score model) in the IPTW-weighted cohort [28] . rVE was calculated as 100*(1 -OR adjusted ) and is reported with 95% CIs. Analyses were repeated for each age subgroup and location of influenza-related medical encounter (inpatient and outpatient). Weights were redrawn for each age subgroup. Categorical variables with missing or null values were classified as "not reported/unknown"; missing or out-of-range values were not imputed. Analyses were conducted using SQL and SAS (version 9.4). The robustness of study assumptions was assessed with 4 sensitivity analyses. First, to improve the specificity of outcome case definitions, the moving epidemic method (MEM) was used to evaluate rVE during a period of highest incidence of laboratoryconfirmed influenza (as reported by the CDC): December 8, 2019, through March 7, 2020 [29] . Second, to account for the impact of potential co-circulation of SARS-CoV-2 with influenza on rVE estimates, a sensitivity analysis was conducted with an earlier study period cutoff date (September 29, 2019, through February 15, 2020). A third sensitivity analysis was based on a hypothetical complete influenza season (September 29, 2019, through May 16, 2020). Lastly, urinary tract infections (UTIs) were evaluated as a negative control outcome as they are not expected to be prevented or otherwise affected by the influenza vaccine and can be used to assess balance among cohorts as well as indicate residual bias in effect estimates. UTI-related visits were defined as an ICD-10 diagnosis of N39.0 in any position. A Cox regression model was used to evaluate UTIs to factor in seasonal variability in the frequency of UTIs [30] [31] [32] . A total of 3 553 040 individuals were included in the study, of whom 936 508 (26.4%) had a record of receiving aIIV3, 651 034 (18.3%) IIV4e, and 1 813 819 (51.0%) HD-IIV3 during the vaccine intake period (Table 1 ). In addition, 151 679 (4.3%) subjects received IIV3e during the same period (Table 1) . Table 2 lists the demographic characteristics of each cohort used in the rVE analysis (see Supplementary Table 5 for characteristics of the IIV3e cohort, including numbers of subjects with conditions included in the Charlson comorbidity index). The mean age (±SD) of aIIV3, IIV4e, and HD-IIV3 recipients was similar (75.0 ± 6.7, 74.2 ± 7.1, and 75.2 ± 6.9 years, respectively). Frailty index scores were as follows: aIIV3 group, 0.09 ± 0.09; IIV4e group, 0.10 ± 0.12; HD-IIV3 group, 0.10 ± 0.11. The same was true of Charlson comorbidity index scores: aIIV3, 1.4 ± 1.8; IIV4e, 1.7 ± 2.0; HD-IIV3, 1.6 ± 1.9. In all groups, most subjects were White and female; <15% were Hispanic. SMD differences between groups were generally between -0.05 and 0.05 (Table 2 ). An exception was region, where 56% of aIIV3 recipients resided in the South compared with ~36% of the other cohorts, and only 11% of aIIV3 recipients resided in the West, compared with 21%-23% of the other cohorts. Recipients of aIIV3 also had fewer baseline outpatient and inpatient visits ( Table 2) . Chronic pulmonary disease, diabetes, renal disease, and peripheral vascular disease were the most common medical conditions, with comparable rates across vaccine cohorts (Supplementary Table 4 ). There were no differences in the frequency of missing data between exposure groups (Table 1; Supplementary Table 4 ). Influenza-related medical encounters were recorded in recipients of aIIV3 (4991, 0.5%), IIV4e (5585, 0.9%), and HD-IIV3 (12 154, 0.7%). Among all individuals age ≥65 years, the rVE adjusted using the doubly robust model was 27.5% (95% CI, 24.4% to 30.5%) vs IIV4e and 13.9% (95% CI, 10.7% to 17.0%) vs HD-IIV3 ( Figure 1A ; see Supplementary Figure 1 for unadjusted rVE analyses). Findings were consistent within each age group ( Figure 1A ). Inpatient influenza-related medical encounters were recorded for 1500 (0.2%) aIIV3, 1638 (0.3%) IIV4e, and 3583 (0.2%) HD-IIV3 recipients, and 3491 (0.4%), 3947 (0.6%), and 8571 (0.5%) individuals from these cohorts had an outpatient influenza-related medical encounter. The rVE for an inpatient encounter (admitting diagnosis on the claim) was 13.4% (95% CI, 5.1% to 21.1%) vs IIV4e and 6.5% (95% CI, -1.3% to 13.6%) vs HD-IIV3. For a diagnosis in any diagnosis position on the claim, the rVE was 17.1% (95% CI, 10.6% to 23.2%) vs IIV4e and 6.5% (95% CI, 0.1% to 12.4%) vs HD-IIV3. Outpatient rVEs were 31.3% (95% CI, 27.8% to 34.6%) vs IIV4e and 16.9% (95% CI, 13.2% to 20.4%) vs HD-IIV3 ( Figure 1B ). The rVE during the period of highest influenza activity (December 8, 2019, to March 7, 2020) (Supplementary Figure 2 ) generated slightly higher point estimates than in the main period, at 28.2% (95% CI, 24.9% to 31.3%) vs IIV4e and 14.7% (95% CI, 11.3% to 17.9%) vs HD-IIV3, with consistent trends observed when stratified by age group (Figure 2A) . The pattern of rVEs remained consistent in the analyses that applied stricter criteria to account for SARS-COV-2 impact ( Figure 2B and C), with positive rVE estimates and confidence intervals for all comparisons in all age groups except the rVE for aIIV3 vs HD-IIV3 in the ≥85 age group (10.7%; 95% CI, -1.0% to 21.1%). In the negative control analysis, the covariate-adjusted incidence of UTIs was 5.1% in the aIIV3 cohort and 6.0% in the IIV4e cohort, with a hazard ratio (HR) of 1.02 (95% CI, 1.00 to 1.03). When compared with HD-IIV3, the adjusted incidence was 5.0% in the aIIV3 cohort and 5.0% in the HD-IIV3 cohort, with an HR of 0.99 (95% CI, 0.98 to 1.00). In this study cohort of >3 million influenza vaccine recipients in the 2019-2020 flu season, aIIV3 was more effective than IIV4e and HD-IIV3 in preventing influenza-related medical encounters in adults ≥65 years of age. The adjusted rVE of aIIV3 in preventing any influenza-related medical encounter was 27.5% (95% CI, 24.4% to 30.5%) vs IIV4e and 13.9% (95% CI, 10.7% to 17.0%) vs HD-IIV3. Similar trends were observed in subgroup analyses by age. Confidence intervals increased with age, most likely due to decreasing sample size. Relatively high point estimates and narrow confidence intervals for the outpatient visits likely drove the overall point estimates, particularly for the aIIV3 vs HD-IIV3 comparison. The rVE values for inpatient (admitting and any diagnosis) and outpatient influenzarelated medical encounters were significant in the comparison between aIIV3 and IIV4e. However, the inpatient rVE for aIIV3 vs HD-IIV3 was not statistically significant when influenza was the admitting diagnosis, although it was significant when influenza was reported during any diagnosis. Overall, in the United States, the burden of influenza in the 2019-2020 season included 400 000 influenza-related hospitalizations and 22 000 deaths [33] . Influenza virus activity was lower than in prior influenza seasons and consisted of 2 waves, first of influenza B, followed by A(H1N1) in the overall population. Influenza A(H1N1) was the predominant strain in the older adult population and accounted for 73% of all circulating viruses [33, 34] . Absolute vaccine effectiveness was estimated to be 39% (95% CI, 32% to 44%) overall and 39% (95% CI, 9% to 59%) in adults age ≥65 years by the US Centers for Disease Control and Prevention [35] . Both high-dose and adjuvanted influenza vaccines have been developed to overcome immunosenescence in older adults. MF59 has been found to increase both the magnitude and the breadth of the immune response as compared with traditional inactivated influenza vaccines [36] . This may explain the greater effectiveness over comparators across all age groups. In the case of the aIIV3 vs IIV4e comparison, the advantages of the fourth antigen in the quadrivalent vaccine may have been outweighed by the immunogenicity boost from the MF59 adjuvant. As HD-IIV3 also increases the magnitude of the immune response [37] , the additional breadth of protection against variant strains as seen with the adjutant may account for the benefits of aIIV3 against HD-IIV3 observed in this study. Our results add to a body of literature that shows that adjuvanted vaccines are at least as effective as, and possibly more effective than, high-dose vaccines [10, 17, 38] . In previous studies conducted using the same databases, we found improved effectiveness of aIIV3 relative to HD-IIV3 in the 2017-2018 ] to represent an operational definition of frailty in claims data using ADL dependency as a proxy outcome (Supplementary Table 3 ). and 2018-2019 seasons [17] . Other studies evaluating aIIV3 vs HD-IIV3 differed with respect to study population, setting, influenza case definition, and methodological aspects. In particular, researchers have previously demonstrated that the vaccine effectiveness of aIIV3 and HD-IIV3 did not differ significantly, but both vaccines were significantly more effective than IIV4e [38] . As larger numbers of people receive aIIV3, we may gain a more comprehensive understanding of the effectiveness of aIIV3 in real-world settings. Our study had several strengths. The use of a database integrating EMR and claims data permitted evaluation of a large cohort of older adults, providing robust statistical power to detect effects. The variety and completeness of data permitted adjustment of well-established confounders. Additionally, retrospectively ascertaining covariate information from the integrated database in the same manner for all vaccine cohorts limited information bias. Furthermore, we applied a doubly robust adjustment methodology in all analyses. Conclusions from the main analysis were supported by sensitivity analyses. The negative control analysis showed no differences between the 3 cohorts in UTI rates, and effect estimates were nonsignificant, suggesting that the doubly robust adjustment adequately addressed confounding by the included measured confounders. A key limitation of this study is the reliance on diagnostic codes for influenza disease rather than a laboratory-confirmed influenza diagnosis. However, results were consistent when limited to a period of high incidence of CDC-reported laboratoryconfirmed influenza (Figure 2A ) [34] . Moreover, incidence rates of CDC-reported, laboratory-confirmed influenza showed a similar trend when compared with the incidence of influenzarelated medical encounters in the study cohort (Supplementary Figure 2 ). While this is not a validation of the outcome definition per se, it does support the use of these diagnostic codes for the identification of influenza disease. Another limitation of this study was that older adults will likely be covered by Medicare, which makes the results more generalizable to the overall US older adult population. The type of health care insurance coverage received was not evaluated and may impact health careseeking behavior. Finally, residual confounding is possible in all observational research and is particularly prominent in studies using routinely collected data, as these data are not specifically collected for research purposes. In this analysis of a large integrated EMR and medical claims database, aIIV3 was associated with significantly fewer influenza-related medical encounters than IIV4e and HD-IIV3 in adults ≥65 years of age during the 2019-2020 influenza season in the United States. These findings are consistent with previous study results and lend further support to the use of aIIV3 to prevent influenza illness in older individuals [5, 7, 9-13, 17, 39-41] . Favors aIIV3 Figure 1 . Relative vaccine effectiveness of aIIV3 compared with IIV4e and HD-IIV3 among individuals age ≥65 years in the 2019-2020 US influenza season using doubly robust IPTW adjustment methodology. A, Any influenza-related medical encounter. B, Inpatient (admitting diagnosis and any diagnosis) and outpatient influenza-related medical encounters. Abbreviations: aIIV3, adjuvanted trivalent inactivated influenza vaccine; HD-IIV3, high-dose inactivated influenza vaccine; IIV4e, egg-derived quadrivalent inactivated influenza vaccine; IPTW, inverse probability of treatment weights; IRME, influenza-related medical encounter; rVE, relative vaccine effectiveness. Clinical practice guidelines by the Infectious Diseases Society of America: 2018 update on diagnosis, treatment, chemoprophylaxis, and institutional outbreak management of seasonal influenza Risk factors for serious outcomes associated with influenza illness in high-versus low-and middle-income countries: systematic literature review and meta-analysis Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices-United States, 2019-20 influenza season Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices-United States, 2020-21 influenza season Effectiveness of the MF59-adjuvanted trivalent or quadrivalent seasonal influenza vaccine among adults 65 years of age or older, a systematic review and meta-analysis Effectiveness of seasonal influenza vaccination in community-dwelling elderly people: an individual participant data meta-analysis of test-negative design case-control studies The comparative effectiveness of adjuvanted and unadjuvanted trivalent inactivated influenza vaccine (TIV) in the elderly Comparison of the safety and immunogenicity of an MF59®-adjuvanted with a non-adjuvanted seasonal influenza vaccine in elderly subjects Relative effectiveness of cell-cultured and egg-based influenza vaccines among elderly persons in the United States Relative effectiveness of influenza vaccines among the United States elderly Adjuvanted versus nonadjuvanted influenza vaccines and risk of hospitalizations for pneumonia and cerebro/cardiovascular events in the elderly Protection provided by influenza vaccine against influenza-related hospitalisation in ≥65 year olds: early experience of introduction of a newly licensed adjuvanted vaccine in England Effectiveness of the trivalent MF59 adjuvated influenza vaccine in preventing hospitalization due to influenza B and A(H1N1) pdm09 viruses in the elderly in Italy Antibody response against heterogeneous circulating influenza virus strains elicited by MF59-and non-adjuvanted vaccines during seasons with good or partial matching between vaccine strain and clinical isolates Cross-protection by MF59-adjuvanted influenza vaccine: neutralizing and haemagglutination-inhibiting antibody activity against A(H3N2) drifted influenza viruses Safety, immunogenicity, and tolerability of three influenza vaccines in older adults: results of a randomized, controlled comparison Relative effectiveness of adjuvanted trivalent inactivated influenza vaccine versus egg-derived quadrivalent inactivated influenza vaccines and high-dose trivalent influenza vaccine in preventing influenza-related medical encounters in US adults ≥65 years during the Efficacy and safety of high-dose influenza vaccine in elderly adults: a systematic review and meta-analysis Efficacy and effectiveness of high-dose versus standard-dose influenza vaccination for older adults: a systematic review and meta-analysis Efficacy of high-dose versus standard-dose influenza vaccine in older adults The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement Update: influenza activity in the United States during the 2018-19 season and composition of the 2019-20 influenza vaccine AFHSC Standard Case Definitions: Influenza-Like Illness. Defense Health Agency Using claims data to predict dependency in activities of daily living as a proxy for frailty Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies Doubly robust estimation of causal effects Influenza surveillance in Europe: establishing epidemic thresholds by the moving epidemic method Seasonality of symptomatic bacterial urinary infections in women Seasonality of urinary tract infections in the United Kingdom in different age groups: longitudinal analysis of The Health Improvement Network (THIN) The increase in hospitalizations for urinary tract infections and the associated costs in the United States Estimated influenza illnesses, medical visits, hospitalizations, and deaths in the United States-2019-2020 influenza season Centers for Disease Control and Prevention. FluView summary ending on Centers for Disease Control and Prevention. US flu VE data for The mechanism of action of MF59-an innately attractive adjuvant formulation Introductory paper: high-dose influenza vaccine Comparative effectiveness of influenza vaccines among U.S. Medicare beneficiaries ages 65 years and older during the 2019-20 season Effectiveness of adjuvanted influenza vaccination in elderly subjects in northern Italy A cluster-randomized trial of adjuvanted trivalent influenza vaccine vs. standard dose in U.S. nursing homes Effectiveness, immunogenicity, and safety of influenza vaccines with MF59 adjuvant in healthy people of different age groups: a systematic review and meta-analysis Patient consent. This retrospective cohort study does not include factors necessitating patient consent. A Peak influenza season, December 8,