key: cord-0028448-eb0l988i
authors: Fallani, Elettra; Orsi, Andrea; Signori, Alessio; Icardi, Giancarlo; Domnich, Alexander
title: An exploratory study to assess patterns of influenza- and pneumonia-related mortality among the Italian elderly
date: 2021-12-29
journal: nan
DOI: 10.1080/21645515.2021.2005381
sha: 6a982b5c50a95e2c2c7aae36f65cd1f1e7528d01
doc_id: 28448
cord_uid: eb0l988i

Older adults are at disproportionately high risk of severe influenza-related outcomes and represent the main target of the annual influenza vaccination. The protective effect of seasonal influenza vaccination on the observed mortality indicators is controversial. In this ecological study, spatiotemporal patterns of pneumonia- and influenza-related mortality registered in the Italian elderly over seven (2011–2017) consecutive seasons were explored and the epidemiological association between the observed local pneumonia- and influenza-related mortality and influenza vaccination campaign features were modeled by using both fixed- and random-effects panel regression models. The descriptive spatiotemporal analysis showed a clear North–South gradient, where northern regions tended to report more pneumonia- and influenza-related deaths. After adjustment for potential confounders, it was found that each 1% increase in influenza vaccination coverage rate would be associated (P < .001) with a 1.6–1.9% decrease in pneumonia- and influenza-related mortality. Moreover, each 1% increase in the use of MF59®-adjuvanted trivalent influenza vaccine would be associated (P < .05) with a further 0.4% decrease in pneumonia- and influenza-related mortality. This study supports the increase in annual influenza vaccination in Italy and suggests that a higher level of use of the adjuvanted influenza vaccine in the elderly may be beneficial.

Worldwide, influenza is one of the leading infectious disease in terms of both incidence and mortality rates. 1,2 Seasonal influenza vaccination represents the most effective public health intervention able to reduce the burden of disease. 2, 3 Indeed, the World Health Organization's (WHO) most recent position paper 2 has listed several priority targets for annual influenza vaccination: pregnant women, children aged 6 months to 5 years, the elderly, subjects with specific chronic conditions, healthcare workers, and international travelers. Among these, the elderly is probably the most recognized target group; indeed, as per the European Center for Disease Prevention and Control (ECDC), 4 all European Union (EU) Member States recommend seasonal influenza vaccination for older adults.

Influenza vaccine (IV)-induced immunogenicity and/or protection is often poor in the elderly as a result of immunosenescence. 5 In order to circumvent this unmet need, alternative IV formulations have been developed. The first worldwide available IV specifically developed for the elderly was that formulated as a standard-dose egg-based subunit trivalent IV including MF59® (Seqirus UK Ltd.) adjuvant (adjuvanted trivalent influenza vaccine; aTIV). 6 Italy was the first country to adopt aTIV in 1997, 6 where it was still available during 2020/21 influenza season. Other historically or currently commercialized IVs may also address immunosenescence, including (i) virosomal; 7 (ii) intradermal 8 and (iii) high-dose IVs. 9 The rationale for this study was primarily driven by a gap in the understanding of association between influenza vaccination coverage (IVC) rates and influenza-associated mortality. For instance, a previous Italian ecological study 10 did not find any meaningful association between the IVC rate and influenza excess mortality over time. However, the study by Rizzo et al. 10 did not distinguish between different types of available IVs at that time. Indeed, in the paper by Rizzo et al., 10 dating back to 2006, it has been stated that "In Italy, more immunogenic vaccine with novel adjuvants has been introduced since 1997 . . . but it is too early to evaluate their population impact." On the other hand, a more recent study 11 conducted in the Province of Treviso (northeastern Italy) found that the risk of all-cause death was significantly lower (by 33-39%) in the vaccinated elderly (as compared with unvaccinated subjects) in three consecutive seasons (2014/15-2016/17). Of note, aTIV was the most frequently administered IV in Treviso. 11 In the context of Italian fiscal federalism single regions, the autonomous provinces of South Tyrol and Trento (henceforth referred to as "regions") are granted a certain level of freedom to achieve their own public health goals. 12 Regarding influenza immunization, each year the Italian Ministry of Health issues a circular on the prevention and control of influenza; 13 each region may then fully adopt the national recommendations or provide its own circular/recommendations. 12, 14 Diversity in the adopted policies may result in both (i) the so-called "jeopardization" 12, 14 of IVC rates [up to double difference reported in the observed 2019/20 season IVC rates among older adults aged ≥65 years 15 and (ii) different patterns of use for the available types of IV. 12, 14 The primary aim of this study was to explore spatiotemporal patterns of pneumonia-and influenza (P&I)-related mortality observed in Italian older adults aged 65 years or above. The second goal was to investigate the epidemiological association between the observed local P&I mortality among subjects aged ≥65 years and IVC rates and IV policy patterns.

This is a typical ecological study: we investigated officially registered P&I-related mortality in the elderly (defined here as subjects aged ≥65 years) at the level (i.e., unit) of Italian provinces (N = 110) and/or regions (N = 21) over seven consecutive post-pandemic seasons (2010/11-2016/17) . In other words, we analyzed population groups and not single individuals. Both exploratory and analytical approaches were considered.

Readers interested in both strengths and limitations of the ecological study design are invited to read the paper by Morgenstern; 16 moreover, the limitations specific to this exploratory study will be discussed later in the manuscript.

In this paper, we considered only the post-pandemic period (i.e., starting from season 2010/11). This choice was based on the fact that the pandemic 2009 A/H1N1 (A/H1N1pdm09) virus completely replaced the so-called seasonal A/H1N1 (A/ H1N1s) that circulated before 2009. 17, 18 Data for 2018 onwards were not considered since no officially reported P&I-related mortality estimates were available at the time of data extraction (as of December 2020). 19, 20 

Most data came from the official Italian data flows publicly available from the Italian Ministry of Health 15, National Institute of Health, 18 National Institute of Statistics, 19, 20 and National Institute for Environmental Protection and Research. 21 Data regarding quotas for different types of IV were provided by Seqirus S.r.l., Italy (company database of regional demands for individual types of IV, i.e., data on tender allotments). The variables considered and corresponding data sources are reported in Supplementary Material, Table S1 .

The study outcome was the country-/province-/regionand year-specific estimate of P&I-related mortality in older adults aged ≥65 years as per the European Shortlist for Causes of Death (N = 65 causes) compatible with the three most recent International Classification of Diseases (ICD) versions for influenza (ICD-8: 470-474; ICD-9: 487; ICD-10: J10-J11) and pneumonia (ICD-8: 480-486; ICD-9: 480-486; ICD-10: J12-J18) codes. 20, 22 For this reason, we extracted the readily available dataset 20 on the P&I mortality rate (per 10,000 inhabitants) until the last available year of 2017 for the whole country, regions, and provinces.

Depending on data availability, 20 the spatiotemporal analysis could be conducted at the level of single provinces (N = 110). For this reason, first we visually explored the observed province-specific P&I mortality rates separately by year. This was done by plotting choropleth maps.

Moran's I global spatial autocorrelation coefficients 23 were then computed in order to measure the overall clustering pattern of the observed mortality rates. The interpretation of Moran's I is similar to that of Pearson's r correlation coefficient: positive statistically significant I values indicate geographic patterns of spatial clustering, negative significant I estimates show clustering of dissimilar values, while nonsignificant values at α < 0.05 indicate complete spatial randomness. Considering that Italy has the two Islands of Sicily and Sardinia, for Moran's I statistics the k nearest neighbor spatial weights matrix was used. 24 As a "rule-of-thumb" 25 we set the value of k as the square root of the total number of observations (N = 110); this means the k-value used was 10.

Providing that all and year-specific global I coefficients were statistically significant, we then further investigated the local indicators of spatial association (LISA). 26 Choropleth maps were created to visualize the four types of clusters/outliers, namely hot-hot (hotspots), i.e., observations that signified provinces with a higher than average mortality rate surrounded by provinces with a higher than average mortality rate, while cold-cold (coldspots) signified provinces with a lower than average mortality rate surrounded by provinces with a lower than average mortality rate. Low-high and high-low outcomes represented outliers: these were provinces with low/high average mortality rates surrounded by provinces with high/low average mortality rates, respectively.

The spatiotemporal analysis was performed in R stats packages, version 2.15.2. 27

The independent variables of interest were regional IVC rates and the proportion of aTIV doses to the total number of IV doses put into tender allotments. During the study period, IVC was recommended and fully reimbursed for all subjects aged ≥65 years, people ≥6 months affected by certain health conditions and some other categories. The Italian Ministry of Health routinely report region-and season-specific IVC rates for both the general population and older adults aged ≥65 years. 15 Data on province-specific IVC rates are not publicly available. Therefore, the unit of this analytical part of the analysis was a region (N = 21). The primary predictor of interest was IVC in older adults aged ≥65 years. However, a higher IVC rate in younger age groups may exercise some protective effect on the elderly owing to the phenomenon of herd protection. Indeed, some studies underlined the important role of children and adolescents in spreading influenza virus in their households [28] [29] [30] and therefore to their grandparents. A model by Fumanelli et al. 31 has suggested a significant social interaction between Italian elderly and younger individuals. For this reason and in order to account for the possible effects of herd protection, we also included a variable of IVC in subjects aged <65 years.

Another independent variable of interest was the proportion of potential aTIV users to the total number of IV doses put into tender allotments, and the data from the Seqirus Italy tender department. According to the latest Italian official recommendations, 13 aTIV may be used only for people aged ≥65 years. Therefore, we hypothesized that the higher local use of aTIV may be associated with better health-related outcomes among the Italian elderly.

To establish an association (or lack of association) between the region-and year-specific P&I mortality rates in the elderly and predictors of interest (i.e., IVC rates and share of aTIV doses) panel regression analysis was undertaken. Briefly, the panel considered 21 spatial units (i.e., regions) followed over seven consecutive post-pandemic years and therefore consisted of 21 × 7 = 147 observations. However, an important assumption has to be highlighted here. P&I mortality data are routinely reported for the whole calendar year, 19, 20 while the IV campaign usually starts in mid-October/November and almost all IV doses are administered by the end of December 32 . In Italy, according to the Italian National Institute of Health, most laboratory-confirmed influenza deaths occur between January and March, 32 and influenza-like illness (ILI) peaks were usually reached in late January or February (Supplementary Material, Table S2 ). 18 Moreover, considering the time lag of 2-6 weeks between IV administration and the peak of the vaccine-induced immune response, 33 it is more likely that IV administered in autumn/ winter of a year t-1 will mainly exercise its effect (if any) on bacterial influenza-related complications (that are the most frequent 35, 36 and require some time to be developed) leading to death in the first months of the following year t.

Both the fixed-effects (FE) and random-effects (RE) methods were applied. The FE approach may be useful in the context of causal inference: while standard regression techniques provide biased estimates of causal effects in case there are unobserved confounders, FE regression may provide unbiased estimates in this situation. 32, 34 In other words, in our models, region-level FEs were included to absorb unobserved region-level heterogeneity in the observed P&I mortality rates not explained by other covariates in the model. 37 Indeed, unobserved effects are typical in ecological and social research. 38 By contrast, the RE approach assumes that region-specific effects are not correlated with independent variables. 39 In any case, the Hausman's specification test was applied 40 to formally differentiate between FE and RE models; the null hypothesis of this test is that the RE model estimates are consistent and efficient.

The following socioeconomic, environmental, and virological variables were selected as potential confounders: public health expenditure per capita (€), population density (inhabitants per km 2 ), average winter temperature, and the predominant influenza virus (sub)type(s). The reasons for inclusion of these variables are described below.

Public health expenditure per capita represents a proxy measure of regional welfare and is commonly used in healthrelated econometric studies. [41] [42] [43] [44] Indeed, this parameter varies substantially among the Italian regions 20, 44 and has been found to be a significant predictor of regional measles, mumps, and rubella (MMR) vaccination uptake in Italy. 44 As per environmental factors, we selected two potential confounders, namely: population density and mean winter temperature regimens. The empirical idea for the former variable was that a higher population density would be associated with a higher virus transmission. 37, 45 In fact, the population density in Italy is highly non-homogeneous. 20 Second, single Italian regions lay in different climatological areas with highly different daily temperature paradigms; this fact could have direct implications on the influenza-related outcomes since the so-called "cold waves" usually interfere with the mortality rate. 46 Moreover, Lytras et al. 47 have concluded that in Greece the winter excess mortality rates attributable to cold temperatures were substantially higher than those attributable to influenza. Therefore, we proxied the cold waves in a given year and region as an average minimum temperature observed in the winter period. In our analysis, the winter period started at week 40 of the previous year and ended at week 20 of the next year, as per the FluMOMO model. 48 Finally, circulation patterns of influenza virus (sub)types (A/H1N1pdm09, A/H3N2 and B) may determine the magnitude of influenza-related outcomes. For instance, in Italy the predominance of the A/H3N2 subtype was associated with significantly higher excess mortality in the elderly. 10 The predominance of a single virus (sub)type over other (sub)types was a priori set to 50% of the total national detections. This assumption was however, formally proved by performing a single-proportion z-test. Moreover, the adopted classification rule was compared with the previously published Italian studies, 49,50 meeting full agreement. Otherwise [i.e., when the most prevalent virus (sub)type was detected in <50% cases], the overall virological picture was dubbed as co-circulation (Supplementary Table S2 ).

As recommended, 37, 51 in all panel regression models performed, the continuous variables (i.e., P&I mortality rates, public health expenditure per capita, population density, and average winter temperature) that were not percentages were transformed using natural logarithms (loge). The regression coefficients are therefore interpreted as elasticities. For instance, the model coefficient for IVC rate should be interpreted as the percent change in P&I mortality rate associated with a 1% change in coverage. 37, 51 The following panel model specification was considered:

for i = 1 . . . 21 and t = 2011 . . . 2017, where "P&I_mort_65 +" is P&I mortality rate in subjects aged ≥65 years; bs are regression coefficients; α is the unobserved time-invariant regional effect (in FE model) or constant intercept (in RE model); i is a region; t is a year; ε is the error term; "IVC_65 +" is IVC in subjects aged ≥65 years; "IVC_<65" is IVC in subjects aged <65 years "PHexp" is public health expenditure per capita; "Dens" is population density; "Temp" is average low winter temperature; "Virus" is a dummy variable indicating the predominant virus (sub)type.

Taking into account a high probability of heteroscedasticity and/or autocorrelation, all models considered also the Arellano's heteroscedasticity-autocorrelation (HAC) robust standard errors (SEs). We performed the model diagnostics by applying the Breusch-Godfrey test for panel models to detect serial correlation for the errors and Pesaran cross-sectional dependence (CD) and Breusch-Pagan Lagrange multiplier tests for CD in the constructed panel models. 52, 53 All the modeling was made in R stats packages. 27

Over seven years (2011-2017), a total of 71,876 P&I-related deaths were reported in older adults aged ≥65 years. There was some variability in terms of P&I-related mortality rates observed between years. The highest rates were observed in years 2017 (10.05 per 10,000) and 2015 (8.78 per 10,000). In the remaining years the mortality rate was lower and 6.7 < 8 per 10,000 ( Figure 1 ). We then explored choropleth charts by mapping provincespecific P&I-related death rates. A clear north-south gradient (especially in 2011, 2015, and 2017) was evident: compared with central and southern provinces, those located in the Northern Italy displayed higher P&I mortality rates ( Figure 1 ). As shown by Moran's Is, a significant (P < .001) clustered pattern of the observed mortality rates took place in all years with the I-value ranging from 0.28 to 0.36.

The LISA analysis (Supplementary Material, Figure S1 ) confirmed the north-south gradient: most hotspots and coldspots were located among northern and southern provinces, respectively. The few outliers detected (mainly cold-hot) were located in Sicily.

The total panel was composed of 147 observations and was balanced (i.e., no single space-time observations were missing). Table 1 reports principal descriptive statistics of the continuous variables of interest. During the study period, an average IVC in the elderly was 55.0%. Two significant drops in IVC were observed: the first occurred in 2012 (from 62.7% to 54.2%), the second in 2014 (from 55.4% to 48.6%). During the study period, only one region reached the recommended target of 75% (Umbria in the 2010/11 season). The proportion of aTIV use was highly non-homogeneous with a range of 0-76% (Table 1) .

For Table S2) .

Results of FE and RE panel regression models are reported in Table 2 . In the FE model, both IVC rate in the elderly, proportion of aTIV use, and average winter temperature were negatively associated with the observed P&I mortality rate in the Italian elderly. In particular, both FE and RE models predicted that each 1% increase in IVC rate in the elderly would be associated (P < .001) with a 1.6-1.9% decrease in P&I mortality. Analogously, each 1% increase in aTIV use would be associated (P < .05) with a 0.4% decrease in P&I mortality. By contrast, the co-circulation of type A virus subtypes was a significant positive predictor. No statistically significant association was observed for other independent variables. The output of the RE model was similar to that of the FE model. However, the Hausman's test suggested (P < .001) that the FE model should be retained. The model diagnostics justified the use of both HAC robust standard errors (Table 2) .

This study confirms that annual influenza vaccination in the elderly reduces overall P&I mortality rates and therefore that increased immunization rates are desirable. From the ecological and policy-making perspectives this study has also confirmed the usefulness of aTIV in preventing P&I-related mortality in the elderly Italian population. This is in line with a recently proposed concept of the appropriate use of IVs in Italy. 54 The protective effect of IV on (excess) mortality is still controversial. For instance, Rizzo et al. 10 and Simonsen et al. 55 have not documented any meaningful temporal association between IVC rate and winter excess mortality in Italy and the United States, respectively. By contrast, available meta-analyses of observational studies 56,57 suggest a significant reduction in mortality among vaccinated individuals. Contrary to the previous Italian time-trend study by Rizzo et al., 10 we were able to demonstrate a protective effect of IVs on P&I mortality. The reasons for this discrepancy are likely to be multiple. First, two different and non-overlapping time periods with both different circulating viruses and available IVs were assessed. Second, two different proxy outcomes to quantify influenzarelated mortality were used. Third, in the present study both time and space were incorporated in the analysis; this may provide additional benefits in countries like Italy with its "jeopardized" pattern of IVCs. 58 Our second main finding was that regions using a higher proportion of aTIV showed significantly lower P&I mortality in the elderly independent of IVC, virus circulation pattern, and other potential confounders. In the elderly population aTIV has systematically been shown to be both more immunogenic 59 and effective 60 than standard-dose non-adjuvanted IVs. In particular, meta-analysis by Nicolay et al. 59 has shown that the use of aTIV was associated with significantly higher seroconversion rates and geometric mean titers against both vaccine antigen strains and heterologous strains, independently from the (sub)type analyzed. Analogously, the systematic review by Domnich et al. 60 concluded that the available observational studies had usually displayed a greater effectiveness of aTIV against various influenza-related outcomes, as compared with non-adjuvanted counterparts. In this regard the ecological study design may confirm findings coming from primary experimental or observational research and may therefore be useful in the decision-making process.

The main strength of this study lies in the methodology adopted. While a limited number of time-space observations does not allow the model to be adjusted for "anything we want to" as well as the fact that some potentially useful data may be not available, the FE panel models provide unbiased estimates in situations when unobserved confounders are present (as in the case of this study). 38 Apart from the well-known general limitations of ecological studies (ecological fallacy in primis), 16 specific limitations apply to this study that must be considered. First, owing to data availability, the final regression models could be performed at the regional level only. A more spacedetailed (e.g., provincial or local health unit level) evaluation is warranted. Second, the data on market share of single IVs come from regional tender allotments and therefore may not exactly correspond to effective IV administration. However, we believe that this limitation had a limited impact on the results since it is unlikely that the wastage/ non-utilization rate differs among single IVs. Third, although we have no reason to believe that the automatic coding of causes of death may differ between regions, we could not completely rule out the between-region differences in reporting quality. However, this limitation may have only a small impact on the study results since the Italian National Institute of Statistics performs quality checks on a regular basis. Moreover, the FE panel model adopted may absorb this eventual heterogeneity.

To conclude, our analysis supports the increase in annual influenza vaccination in Italy and suggests that a higher IV uptake in the Italian elderly population would be beneficial. The use of aTIV in older adults is advised to reduce the burden of seasonal influenza disease.

Ethical review and approval were waived for this study, due to the fact that this is based on the publicly available aggregated information sources. No single subject data were available.

E.F. is PhD student at Siena University whose program was fully funded by Seqirus, a pharmaceutical company who manufacture and commercialize influenza vaccines. At the time of submission, E.F. became a Seqirus permanent employee. A.D. was a permanent employee of Seqirus at the time study conception and realization. A.S. was remunerated by Seqirus for his statistical analysis. A.O and G.I. declare no conflicts of interest regarding this publication.

This research was funded by Seqirus, a pharmaceutical company who manufacture and commercialize influenza vaccines. The APC was funded by Seqirus. 

The authors confirm that the data supporting the findings of this study are available within the article and its supplementary materials. In the supplementary materials, Table S1 summarizes all the data sources (and related url) used in the analysis. 

Impact of infectious diseases on population health using incidence-based disability-adjusted life years (DALYs): results from the burden of communicable diseases in Europe study, European Union and European economic area countries

Vaccines against influenza WHO position paper

Influenza vaccination: in the UK and across Europe

Seasonal influenza vaccination and antiviral use in EU/ EEA Member States

Immunosenescence: influenza vaccination and the elderly

Fluad®-MF59®-adjuvanted influenza vaccine in older adults

The virosomal adjuvanted influenza vaccine

Fluzone® intra-dermal (Intanza®/Istivac® Intra-dermal): an updated overview

High dose influenza vaccine for adults: a review of clinical effectiveness, cost-effectiveness, and guidelines

Influenza-related mortality in the Italian elderly: no decline associated with increasing vaccination coverage

Determinants of vaccination uptake, and influenza vaccine effectiveness in preventing deaths and hospital admissions in the elderly population

A ge-and risk-related appropriateness of the use of available influenza vaccines in the Italian elderly population is advantageous: results from a budget impact analysis

Prevention and control of influenza. Recommendations for 2020-2021 season

Appropriateness and preferential use of different seasonal influenza vaccines: a pilot study on the opinion of vaccinating physicians in Italy

Ecologic studies in epidemiology: concepts, principles, and methods

Influenza epidemiology in Italy two years after the 2009-2010 pandemic: need to improve vaccination coverage

Italian National Institute of Health

Mortality per cause

Italian National Institute of Statistics (ISTAT). Health for all

Italian National Institute for the Environmental Protection and Research (ISPRA) 2020. National system for the elaboration and diffusion of climatic data

European shortlist for causes of death published by Eurostat

Notes on continuous stochastic phenomena

Under the hood issues in the specification and interpretation of spatial regression models

Clinical research computing: a practitioner's handbook

Local indicators of spatial association-LISA

R: a language and environment for statistical computing

Risk factors of influenza transmission in households

Identifying pediatric age groups for influenza vaccination using a real-time regional surveillance system

Social contact networks for the spread of pandemic influenza in children and teenagers

Inferring the structure of social contacts from demographic data in the analysis of infectious diseases spread

Effectiveness of influenza vaccine in reducing influenza-associated hospitalizations and deaths among the elderly population; Lazio region, Italy, season 2016-2017

FluNews Italia: an integrated influenza surveillance

Time to peak serum antibody response to influenza vaccine

The incidence, natural history and associated outcomes of influenza-like illness and clinical influenza in Italy

Population-based study on incidence, risk factors, clinical complications and drug utilization associated with influenza in the United Kingdom

The Sage handbook of regression analysis and causal inference

Fixed and random effects models: making an informed choice

Quantifying child mortality reductions related to measles vaccination

Panel data and unobservable individual effects

Potential determinants of health system efficiency: evidence from Latin America and the Caribbean

Effect of economic recession and impact of health and social protection expenditures on adult mortality: a longitudinal analysis of 5565 Brazilian municipalities

Mortality changes after grants from the Global Fund to Fight AIDS, tuberculosis and malaria: an econometric analysis from 1995 to 2010

Austerity, measles and mandatory vaccination: cross-regional analysis of vaccination in Italy 2000-14

A geographic analysis of population density thresholds in the influenza pandemic of 1918-19

Investigating the impact of influenza on excess mortality in all ages in Italy during recent seasons (2013/14-2016/17 seasons)

variation by type/ subtype and age, and a possible harvesting effect

Influenza-associated mortality determined from all-cause mortality

Co-circulation of the two influenza B lineages during 13 consecutive influenza surveillance seasons in Italy

Virological surveillance of influenza in the eight epidemic seasons after the 2009 pandemic in Emilia-Romagna (Northern Italy)

Introductory econometrics: a modern approach

GRETL: econometric software for the GNU generation

Panel data econometrics in R: the plm package

The appropriateness of the use of influenza vaccines: recommendations from the latest seasons in Italy

Impact of influenza vaccination on seasonal mortality in the US elderly population

Effects of influenza vaccine on mortality and cardiovascular outcomes in patients with cardiovascular disease: a systematic review and meta-analysis

The effect of influenza vaccination on mortality and hospitalization in patients with heart failure: a systematic review and meta-analysis

Attitudes and beliefs on influenza vaccination during the COVID-19 pandemic: results from a representative Italian survey. Vaccines (Basel)

Immunogenicity of aIIV3, MF59-adjuvanted seasonal trivalent influenza vaccine, in older adults ≥65 years of age: meta-analysis of cumulative clinical experience

Effectiveness of MF59-adjuvanted seasonal influenza vaccine in the elderly: a systematic review and meta-analysis