key: cord-0920601-i8pb32et
authors: van Doorn, Eva; Darvishian, Maryam; Dijkstra, Frederika; Donker, Gé A.; Overduin, Pieter; Meijer, Adam; Hak, Eelko
title: Influenza vaccine effectiveness estimates in the Dutch population from 2003 to 2014: The test-negative design case-control study with different control groups
date: 2017-05-15
journal: Vaccine
DOI: 10.1016/j.vaccine.2017.04.012
sha: d05bd9b2a6536a3a64fb6156fc3fc116ec577625
doc_id: 920601
cord_uid: i8pb32et

Information about influenza vaccine effectiveness (IVE) is important for vaccine strain selection and immunization policy decisions. The test-negative design (TND) case-control study is commonly used to obtain IVE estimates. However, the definition of the control patients may influence IVE estimates. We have conducted a TND study using the Dutch Sentinel Practices of NIVEL Primary Care Database which includes data from patients who consulted the General Practitioner (GP) for an episode of acute influenza-like illness (ILI) or acute respiratory infection (ARI) with known influenza vaccination status. Cases were patients tested positive for influenza virus. Controls were grouped into those who tested (1) negative for influenza virus (all influenza negative), (2) negative for influenza virus, but positive for respiratory syncytial virus, rhinovirus or enterovirus (non-influenza virus positive), and (3) negative for these four viruses (pan-negative). We estimated the IVE over all epidemic seasons from 2003/2004 through 2013/2014, pooled IVE for influenza vaccine partial/full matched and mismatched seasons and the individual seasons using generalized linear mixed-effect and multiple logistic regression models. The overall IVE adjusted for age, GP ILI/ARI diagnosis, chronic disease and respiratory allergy was 35% (95% CI: 15–48), 64% (95% CI: 49–75) and 21% (95% CI: −1 to 39) for all influenza negative, non-influenza virus positive and pan-negative controls, respectively. In both the main and subgroup analyses IVE estimates were the highest using non-influenza virus positive controls, likely due to limiting inclusion of controls without laboratory-confirmation of a virus causing the respiratory disease.

The most effective way to prevent influenza virus infection and (severe) illness is by vaccination [1] . However, the composition of the influenza vaccine should be reconsidered annually, and eventually updated, due to amino acid substitutions causing antigenic drifts of the hemagglutinin and neuraminidase virus surface proteins which occurs continually over time to escape neutralization by the immune response [2, 3] . Despite the yearly update, the abil-ity of the vaccine to prevent influenza virus infection in the general population during an influenza season (vaccine effectiveness [VE] ) varies each year [4] . Hence, VE information is important for immunization policy decision makers, e.g. to decide which type of vaccine should be used (i.e. inactivated or live attenuated virus, with or without adjuvant) and who should be immunized (e.g. health care workers, children, elderly) [5] . However, it is not possible to determine the VE before an influenza season. Therefore, retrospective studies using observational data are performed to estimate the VE annually [4, 6] .

The test-negative design (TND) case-control study is a commonly used study design to estimate influenza VE (IVE). In this study design, patients seeking medical care for influenza-like illness (ILI) are tested for influenza virus infection [7] . The IVE is http determined by comparing the prevalence of influenza vaccination between ILI patients who tested positive for influenza [cases] and those who tested negative for influenza [controls] [7, 8] . As both cases and controls are selected from patients seeking medical care for ILI, the study design is assumed to minimize confounding by health care-seeking behavior or functional status compared to other types of observational studies [9] [10] [11] . Moreover, laboratory tests are used to define the influenza outcome which, compared to other study designs using non-specific influenza outcomes (e.g. ILI symptoms), reduces misclassification bias [9] [10] [11] .

Several studies have shown that the definition of the control group in TND studies may influence the estimates of the IVE [12] [13] [14] [15] [16] . Three types of control groups have been used in TND studies: (1) all ILI patients tested negative for influenza virus infection (all influenza negative), (2) ILI patients tested negative for influenza virus but positive for another respiratory virus (noninfluenza virus positive), and (3) ILI patients tested negative for both influenza virus and other respiratory viruses (pan-negative) [11] [12] [13] [14] [15] [16] [17] [18] . Although all influenza negative controls are commonly used, in several studies non-influenza virus positive controls have been used arguing that if another respiratory virus than influenza virus could be detected in the control group, the presence of misclassification is highly unlikely, as there is a confirmed infectious cause of ILI in both cases and controls. This is based on the fact that the same laboratory tests for influenza virus are used for both cases and controls [13, 15, 16] . On the other hand, other investigators argued that the presence of a non-influenza respiratory virus infection could be partly explained by the association between influenza vaccination and the increased risk of another respiratory virus infection due to a temporary nonspecific immune response [10] [11] [12] 18, 19] . Consequently, the definition of the second control group could lead to selection bias and thereby an overestimation of IVE since the risk of ILI symptoms caused by another pathogen would be higher in the vaccinated patients than in unvaccinated patients, resulting in a higher proportion of vaccinated individuals in the control group [11, 12, 14, 17, 18] . As a consequence, several studies have used pan-negative controls.

The aim of the present study is to estimate the IVE over ten influenza epidemic seasons in The Netherlands (from 2003/2004 to 2013/2014) using the three most commonly applied definitions of TND control groups and evaluate the differences among the IVE estimates.

We used data from the Sentinel Practices of NIVEL Primary Care Database [20, 21] . Sampling of patients with ILI or another acute respiratory infection (ARI) for laboratory diagnostics started in 1992. Since 2003 participating general practitioners (GPs) are asked to take nose and throat swabs from two ILI patients each week. Since 2005/2006 with the additional instruction to sample preferably one patient less than 10 years of age. If no ILI patients are encountered, the GP is asked to swab patients with another ARI instead [22] . The official standard definition of ILI was used in the GP offices to diagnose a patient with ILI, namely an acute onset of symptoms (full development of typical symptoms in 4 days) including a rectal temperature of at least 38°C and at least one respiratory or systemic symptom (i.e. cough, nasal catarrh, sore throat, frontal headache, retrosternal pain, myalgia) [21] . ARI is defined as an acute respiratory illness other than ILI, such as acute sinusitis or pneumonia, and with at least one of the following symptoms; coughing, rhinorrhea or sore throat [23] . Both ILI and ARI patients were included in this study to max-imize the power. Patient information is registered on the sample form, e.g. personal information (gender, age), date of symptoms onset and swabbing, use of antiviral medication and underlying medical conditions. The surveillance study has been registered in the Personal Data Protection Act Register of the Dutch Personal Data Protection Commission [No. RIVM/EPI-043]. No further ethical approval was needed since only anonymized data was used for the current study.

Collected samples from all swabbed subjects were sent to the National Institute for Public Health and the Environment (RIVM) for laboratory tests for a number of pathogens. These pathogens were identified using virus isolation and/or reverse transcription polymerase chain reaction (RT-PCR). RT-PCR changed over time from conventional block-based to real-time format with necessary adjustments in primer and probe design. Laboratory tests for the respiratory viruses influenza virus, respiratory syncytial viruses 

For each influenza season from 2003/2004 through 2013/2014 patients were selected when they were swabbed between week 48 and week 14 of the following year. Patients were excluded if (1) the vaccination status was unknown, (2) time between symptoms onset and swabbing was more than seven days, (3) a patient had received antiviral medication within the two weeks prior to the GP visit, (4) the date of swabbing was before the first of December of each season to make sure vaccination was given 14 days before symptoms onset, or (5) data was missing on other variables (i.e. gender, age, ILI/ARI diagnosis, underlying chronic disease and respiratory allergy) [7, 24] . Patients swabbed in the season 2009/2010 were excluded since this was an atypical (pandemic) influenza season. Eligible swabbed patients who tested positive for influenza virus A(H1N1), A(H1N1)pdm09, A(H3N2) or B were regarded as cases. Controls were defined as those patients tested (1) negative for influenza virus (all influenza negative) (2) negative for influenza virus, but positive for RSV, RV or EV (non-influenza virus positive), and (3) negative for these four respiratory viruses (pan-negative). We included RSV, RV and EV since only these viruses were tested throughout the whole study period.

Chi-square tests were used to test for significant differences in proportions of categorical covariates, and T-tests for differences in mean age between cases and control groups. A P-value <0.05 was considered statistically significant.

IVE was calculated by IVE = (1 À OR) Â 100% with influenza vaccine status as the exposure [7] . The unadjusted and adjusted IVE for potential confounders were estimated, i.e. age, ILI/ARI diagnosis, respiratory allergy, underlying chronic disease (e.g. asthma, chronic obstructive pulmonary diseases, diabetes mellitus and cardiovascular diseases), influenza season and level of vaccine match. Variables that were associated with the outcome (changed the OR > 5%) were retained in the final generalized linear mixedeffect model (GLMM) or multiple logistic regression model. When the 95% confidence interval (95% CI) did not contain zero or negative values, the IVE was considered significant [25] .

The GLMM in which influenza seasons are modelled as a random effect was used to estimate the IVE over all seasons and by seasons categorized by level of vaccine match [26] . Vaccine match status was categorized as (partial) match or mismatch based on the circulating influenza viruses and seasonal influenza vaccines used which information was extracted from data published by the Dutch National Influenza Center [26] [27] [28] [29] [30] [31] [32] [33] [34] [35] [36] [37] . The multiple logistic regression model was used to assess the IVEs for the individual seasons. Statistical analyses were conducted using SAS software (version 9.4) and R (version 3.2.0) [38] .

We performed several sensitivity analysis. We estimated (1) Influenza virus negative patients testing positive for at least one, or negative for all the viruses were considered as non-influenza virus positive and pannegative controls, respectively. This sensitivity analysis was conducted since the definition of the control groups is similar to previously conducted studies [12] [13] [14] [15] [16] .

GPs of the Dutch Sentinel Practices network swabbed a total of 11,199 patients from 2003 through 2014. From these, 4051 (36%) fulfilled the in-and exclusion criteria for this study ( Table 1 ). The majority of subjects were excluded because they were swabbed outside the influenza season (4153, 37%). Other subjects were excluded since information on e.g. age, clinical diagnosis or influenza vaccination was missing (928, 8%), the time between symptom onset and swabbing was more than seven days (1444, 13%) or they had received antiviral medication within two weeks prior Table 1 Characteristics of cases and the three different control groups: all influenza negative (Control group 1), non-influenza virus positive (Control group 2) and pan-negative (Control group 3). to the GP visit (62, 1%). From the included subjects, a total of 1297 (32%) patients tested positive for influenza virus (cases) and 2754 (68%) tested negative for influenza virus. Among those patients testing negative for influenza virus, 676 (25%) tested positive for RSV, RV or EV (non-influenza virus positive) and 2078 (75%) tested negative for these viruses (pan-negative). Statistical significant differences in age, GP ILI/ARI diagnosis, presence of any chronic disease and influenza vaccination status were found between cases and the different control groups. Compared to the control groups, cases were younger, more likely to be diagnosed with ILI, and had a lower proportion of any chronic disease and influenza vaccination. In addition, there were statistically significant differences in age and diagnosis when comparing the non-influenza virus positive and pan-negative controls; pan-negative controls were older and were more likely to be diagnosed with ILI compared to noninfluenza virus positive controls (see Table 1 ).

When comparing the unadjusted IVE estimates with IVE estimates adjusted for possible confounding factors, age, ILI/ARI diagnosis, chronic disease, respiratory allergy and the influenza season changed the OR by more than 5%. Therefore, in the following paragraphs only IVE estimates adjusted for these confounding factors are shown (influenza season parameter not included in estimating season-specific IVE).

The adjusted IVE estimate over all seasons was 35% (95% CI 15-48) when using all influenza negative controls (Fig. 1) . When using non-influenza virus positive controls the IVE increased to 64% (95% 49-75) whereas the IVE decreased to 21% (95% CI À1 to 39) when using the pan-negative controls. (Table 2) [27] [28] [29] [30] [31] [32] [33] [34] [35] [36] [37] . The pooled adjusted IVE estimates for these (partially) matched seasons were 39% (95% CI 16-56), 62% (95% CI 40-76) and 30% (95% CI 2-50) for all influenza negative, non-influenza virus positive and pan-negative controls, respectively (Fig. 1) . The pooled adjusted IVE estimates for the mismatched seasons were 31% (95% CI 7-49), 66% (95% CI 47-78) and 14% (95% CI À18 to 37) for Control group 1-3, respectively.

Adjusted IVE estimates for the different individual influenza seasons varied from negative IVE estimates to 95% (Fig. 2) 

The results of the sensitivity analysis are summarized in Table 3 . 

In general, the point IVE estimates varied for the different definitions of control patients and were generally, but not in each season, the highest when using non-influenza virus positive controls, followed by respectively all influenza negative controls and pan-negative controls which is consistent with other studies [12, 13, 15, 18] .

Similar differences in IVE estimates were found in a study performed in Portugal, in which the IVE was estimated for the mismatched 2012/2013 influenza season among ILI patients which were tested on RSV, PIV, hMPV, RV and ADV to define the control group patients [12, 39] . On the other hand, an American study which estimated the IVE over six influenza seasons (2004/2005 through 2009/2010) among children and adults aged 50 years and older found only minor differences in the IVE estimates when using the different control groups based on the detection of the same viruses as the Portugal study and enterovirus [14] . However, other studies performed in Australia which estimated the IVE in children for the matched influenza season of 2008/2009 and 2008-2012 seasons using all influenza negative and noninfluenza positive controls, found the highest IVE estimates when using non-influenza positive controls [13, 15] . The IVE estimate for (partial) matched seasons using non-influenza positive controls in our study is higher than the IVE estimate in a Dutch randomized controlled trial (RCT) conducted with patients aged 60 years and older (50% (95% CI: 35-61)) in the matched season of 1991-1992 [40, 41] . Moreover, the IVE estimate for mismatched seasons in our study is also higher than the IVE estimate found in a Cochrane review of RCTs with healthy subjects aged 18-65 years when using non-influenza positive controls (55% (95% CI: 41-66)) [42] .

The variation in the IVE estimates using different control groups can be explained by selection bias or misclassification bias [11, 12, 17] . In order to reduce selection bias, several studies suggested including non-influenza ILI patients tested negative for other respiratory viruses as controls (pan-negative controls). This suggestion is based on the assumption that influenza vaccination may increase the risk of a non-influenza respiratory virus infection by a temporary nonspecific immunity (viral interference), resulting in a higher proportion of vaccinated individuals in the control group [11] [12] [13] [14] 17, 18] . In our study we found no indication that influenza vaccination might have increased the risk of noninfluenza respiratory virus infection in vaccinated patients. We observed no difference in the vaccination coverage between the non-influenza positive controls and pan-negative controls (coverage in both groups 21.0% (P = 1.00)) [13] . Others have indicated that if a temporary nonspecific immunity is present, this is a short lasting response (around two weeks). Therefore, it is unlikely that this response influences the risk of other non-influenza respiratory viruses throughout the full study period since we have only included swabbed patients who received the vaccine at least 14 days before symptom onset [14, 19, 43] . Although, this explanation is only true when we assume individuals are susceptible to influenza virus infection only at the beginning of the study period and timing of infections is not taken into account [44] .

It should especially be questioned which population patients is represented by pan-negative controls since these are ILI/ARI patients tested negative for the evaluated respiratory viruses, i.e. ILI/ARI patients without an infection of one of the tested pathogens. Pan-negative patients might be more susceptible for health care-seeking behavior, and therefore include a higher proportion of ILI/ARI not caused by infection, since patients in this control group were older and the prevalence of any chronic disease was higher compared to the cases and other control groups. Also the delay in swabbing might play a role since the time between symptom onset and swabbing influences the sensitivity of laboratory tests [45, 46] . If the time between swabbing and symptoms onset is greater, the sensitivity of influenza A and B viruses RT-PCR detection decreases, e.g. from 88% for 4 days till 70% for 7 days delay [46] . In our study, 14.2% of the pan-negative patients were swabbed 6-7 days after symptom onset compared to 13.6% and 11.5% of all influenza negative and non-influenza virus positive controls. The sensitivity of the laboratory tests is also important for the assumption of including patients tested negative for influenza virus but positive for another respiratory virus as control group (non-influenza positive controls). The inclusion of this control group is based on the assumption that laboratory tests are adequate for both cases and controls, thereby eliminating falsenegative controls and misclassification bias. However, in the current study different laboratory techniques have been used to detect an infection with one of the tested pathogens. RT-PCR was used throughout the whole study period to detect influenza virus, RSV, RV and EV infection. However, due to innovations in these techniques over the study period, the sensitivity of the assays has increased a little. This might have reduced misclassification in later seasons. Furthermore, in season 2004/2005 only virus isolation was used for the detection of RV and EV, which also was the method used to detect PIV virus infections. Virus isolation has a lower sensitivity than RT-PCR. Due to this sensitivity gap misclassification of patients can still not be ruled out absolutely [46] [47] [48] .

Our sensitivity analysis excluding the seasons 2003/2004 and 2004/2005 for the overall estimate showed higher IVE estimates compared to the primary analysis, especially when using all influenza negative and pan-negative controls. No significant difference between the IVE estimates could be observed when using the different control groups, the confidence intervals overlapped more than in the primary analysis. When including the pandemic season the overall estimates were almost identical to the estimates from the primary analysis. However, when restricting to patients who were swabbed within 4 days after disease onset the IVE estimates decreased, especially when using non-influenza positive controls. Also the sensitivity analysis which used several extra respiratory pathogens to define the control groups, showed slightly different IVE estimates compared to the primary analysis which included three respiratory viruses for the definition of control groups. However, no general trend (increase or decrease of the IVE) could be observed when comparing the IVE estimates of the primary and sensitivity analyses which may be explained by the relative infrequent occurrence of these infections in primary care. We were able to analyze the IVE estimates over several seasons among the Dutch general practice population using the TND study with different control groups, however our study has several limitations. Firstly, a certain level of misclassification might be present in the non-influenza virus positive controls and pan-negative controls due to the differences in sensitivity of the laboratory tests used for the detection of other pathogens, especially for those detected by RT-PCR and those detected by virus isolation [49, 50] . Secondly, due to the limited number of eligible patients both patients diagnosed by the GP with ILI and ARI were included in this study to maximize the power. However, there may be differences in health care-seeking behavior of these two patient groups, which could have resulted in misclassification bias. Moreover, patients in the Sentinel Practices of NIVEL Primary Care Database network are not a systematic sample of ILI/ARI patients in the population since most persons with ILI/ARI will not visit their GP and from those who visit the GP, the GP did not have a strict instruction about which patients to sample (e.g. first patients in the week). In addition, subjects who have been hospitalized with an influenza virus infection through the first aid are not covered by the NIVEL Primary Care database, since those subjects are swabbed in the hospital. Despite including both ILI and ARI patients, the number of eligible patients was limited which resulted in wide confidence intervals and only few statistically significant IVE estimates. Finally, we did do not have information on how the vaccination status per individual patient was exactly collected and this might have resulted in misclassification bias. However, since all inhabitants in the Netherlands are registered at one GP office, we can assume that if the GP has vaccinated the patient that the GP takes this information from the registry data of the patient.

Our study shows differences in the IVE estimates when using three different control groups which are in line with other studies. Pan-negative controls seems less valid because a high proportion of patients in this group likely consult the GP because of noninfectious causes of ILI or ARI symptoms. When using noninfluenza positive controls, the IVE estimates are more consistent with previous effectiveness studies and clinical trial data, likely due to limiting controls without an infectious cause of respiratory disease; all controls have a laboratory confirmed infection explaining ILI and ARI symptoms. Nevertheless, when using non-influenza positive controls a higher IVE estimate was found in the primary analysis for mismatched seasons compared to matched seasons which is not as expected, but based on the sensitivity analysis seemed to be caused by the mismatched seasons. Future studies using the TND design should take into account the potential impact of defined control group as well as vaccine match status. Further studies on the study design are needed to confirm our findings and to give a more clear statement about the differences observed between the control groups. Future research on the study design should include more patients to be able to detect statistical significant IVE estimates, especially since adjusting for confounding is needed. This possibly can be done by expanding the GP network, increasing the number of patients a GP has to swab or by pooling data from several countries [51] [52] [53] . In addition, it is recommended for future studies to use if feasible, standardized equalsensitive tests for pathogen detection throughout the whole study period to minimize misclassification bias, although innovations in diagnostic tests increasing the sensitivity should not be ignored.

World Health Organization. Influenza (Seasonal) Fact sheet number 211

Comparison of the immune response to inactivated and live, attenuated influenza vaccines

Epitope-based vaccine against influenza

World Health Organization. Questions and answers. Vaccine effectiveness estimates for seasonal influenza vaccines

Key issues for estimating the impact and costeffectiveness of seasonal influenza vaccination strategies

Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review

European Centre for Disease Prevention and Control. Protocol for case-control studies to measure influenza vaccine effectiveness in the European Union and European Economic Area Member States

Study designs for timely estimation of influenza vaccine effectiveness using European sentinel practitioner networks

Effectiveness of seasonal influenza vaccine in community-dwelling elderly people: a meta-analysis of test-negative design case-control studies

The case test-negative design for studies of the effectiveness of influenza vaccine

The test-negative design for estimating influenza vaccine effectiveness

Estimates of 2012/13 influenza vaccine effectiveness using the case testnegative control design with different influenza negative control groups

Vaccine effectiveness against laboratory-confirmed influenza in healthy young children: a case-control study

Influenza vaccination is not associated with detection of noninfluenza respiratory viruses in seasonal studies of influenza vaccine effectiveness

Effectiveness of trivalent flu vaccine in healthy young children

Effectiveness of the 2010-2011 seasonal influenza vaccine in preventing confirmed influenza hospitalizations in adults: a casecase comparison, case-control study

The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials

Virus interference and estimates of influenza vaccine effectiveness from test-negative studies

Increased risk of noninfluenza respiratory virus infections associated with receipt of inactivated influenza vaccine

Netherlands institute for health services research

Continuous Morbidity Registration Dutch Sentinel General Practice Network

Netherlands institute for health services research. Influenza(-like illness) (in Dutch)

A case-control study of acute respiratory tract infection in general practice patients in The Netherlands

Vaccination period (in Dutch)

Variable influenza vaccine effectiveness by subtype: a systematic review and meta-analysis of test-negative design studies

the importance of circulating influenza virus types and subtypes

Het influenzaseizen 2003/'04 in Nederland met een beperkte epidemie door de virusvariant A/Fujian, en de vaccinsamenstelling voor het seizoen

Het influenzaseizoen 2004/'05 in Nederland met de grootste epidemie van de laatste 5 jaar, door virusvariant A/California, en de vaccinsamenstelling voor het seizoen

Het influenzaseizoen 2005/'06 in Nederland en de vaccinsamenstelling voor het seizoen

Het influenzaseizoen 2006/'07 in Nederland en de vaccinsamenstelling voor het seizoen

Het influenzaseizoen 2007/'08 in Nederland: antigene variatie, resistentie tegen oseltamivir en de vaccinsamenstelling voor het seizoen

Het influenza winterseizoen 2008/'09 in Nederland en de vaccinsamenstelling voor het seizoen

De Mexicaanse grieppandemie van 2009: een overzicht met focus op Nederland (in Dutch)

Het influenzaseizoen 2010/2011 in Nederland: het nieuwe A(H1N1)-virus van 2009 blijft actief (in Dutch)

Het influenzaseizoen 2011/12 in Nederland. Een kleine epidemie gedomineerd door het A(H3N2)-virus (in Dutch)

Het influenzaseizoen 2012/2013 in Nederland: een milde maar langdurige epidemie (in Dutch)

Het influenzaseizoen 2013/2014 in Nederland: lage influenza-activiteit (in Dutch)

R Foundation for Statistical Computing

The 2012/2013 influenza season in Portugal: an antigenic and genetic characterization of circulating viruses

The efficacy of influenza vaccination in elderly individuals. A randomized doubleblind placebo-controlled trial

Influenza in het seizoen 1991/'92: vaccin samenstelling voor het seizoen 1992/'93 (in Dutch)

Vaccines for preventing influenza in healthy adults

Immunity to respiratory viruses

Potential effect of virus interference on influenza vaccine effectiveness estimates in test-negative designs

Performance of laboratory diagnostics for the detection of influenza A(H1N1)v virus as correlated with the time after symptom onset and viral load

Viral loads and duration of viral shedding in adult patients hospitalized with influenza

Evaluation of a novel real-time RT-PCR using TOCE technology compared with culture and Seeplex RV15 for simultaneous detection of respiratory viruses

Testing of diagnostic methods for detection of influenza virus for optimal performance in the context of an influenza surveillance network

Strengths and limitations of assessing influenza vaccine effectiveness using routinely collected, passive surveillance data in Ontario, Canada

Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness

I-MOVE multi-centre case control study 2010-11: overall and stratified estimates of influenza vaccine effectiveness in Europe

Influenza vaccine effectiveness estimates in Europe in a season with three influenza type/subtypes circulating: the I-MOVE multicentre case-control study, influenza season 2012/13

The European I-MOVE multicentre 2013-2014 case-control study. Homogeneous moderate influenza vaccine effectiveness against A(H1N1) pdm09 and heterogenous results by country against A(H3N2)

We thank all the GPs from the Dutch Sentinel General Practice Network and their patients for taking swabs and supplying associated data used in this study.

This study was partly funded by the Dutch Ministry of Health, Welfare and Sport, that had no influence on data collection, study design or writing of this paper. All authors declare no conflict of interest.

ED, MD, FD, EH and AM contributed to the conception and design of the work. AM, FD, GD and PO collected the data and performed laboratory tests. ED and MD analyzed the data. All authors interpreted information for the work. ED drafted the manuscript. All authors critically reviewed the manuscript for contributing to important intellectual content. All authors approved the final version of the manuscript.