key: cord-0899009-txos0hdq authors: Kaslow, David C. title: Force of infection: a determinant of vaccine efficacy? date: 2021-04-12 journal: NPJ Vaccines DOI: 10.1038/s41541-021-00316-5 sha: 752bf1ab2aaf1965e77637f4d5e3f1bc04d6115d doc_id: 899009 cord_uid: txos0hdq Vaccine efficacy (VE) can vary in different settings. Of the many proposed setting-dependent determinants of VE, force of infection (FoI) stands out as one of the most direct, proximate, and actionable. As highlighted by the COVID-19 pandemic, modifying FoI through non-pharmaceutical interventions (NPIs) use can significantly contribute to controlling transmission and reducing disease incidence and severity absent highly effective pharmaceutical interventions, such as vaccines. Given that NPIs reduce the FoI, the question arises as to if and to what degree FoI, and by extension NPIs, can modify VE, and more practically, as vaccines become available for a pathogen, whether and which NPIs should continue to be used in conjunction with vaccines to optimize controlling transmission and reducing disease incidence and severity. Lower apparent vaccine efficacy (VE) in low resource settings, when compared to VE observed in high resource settings, has been reported for several pathogens, most notably poliovirus, typhoid, and rotavirus [1] [2] [3] [4] [5] . Observed VE also varied when evaluating a malaria vaccine candidate in different parasite transmission settings [6] [7] [8] . Numerous economic, social, and biological factors have been proposed to explain these settingdependent variations in VE 3, [9] [10] [11] . Many, if not most, of the proposed economic and social determinants of VE, such as, country income status, living conditions, access to healthcare, appear to act indirectly and non-specifically on VE; whereas many but not all biological factors, such as co-infections, malnutrition, and enteropathy, presumably act directly and proximally on VE. More practically, identification of direct and proximal determinants of setting-dependent VE that hold the promise of actionable intervention(s) seem a most urgent need in efforts to enhance and/or sustain VE. The COVID-19 pandemic has highlighted the contribution of non-pharmaceutical interventions (NPIs) in controlling transmission and reducing disease incidence and severity 12 , particularly in the absence of highly effective pharmaceutical interventions, such as vaccines. NPIs also contribute to controlling other major human diseases, including use of condoms for HIV/AIDS 13 , bed nets for malaria 14 , and hand washing for diarrhea 15 . By reducing the number of (susceptible) individuals effectively contacted by each (infected) person, e.g., through physical barriers, distancing, and masking, NPIs reduce λ, the force of infection (FoI) (see Box 1, Glossary of Key Terms). As vaccines become available for a pathogen, the question arises as to if and which NPIs should continue to be used, if not prioritized 16 . This then begs the broader useinspired scientific question, as raised previously 8 Interrogating the potential relationship of FoI and settingdependent VE A two-step approach was taken to interrogate the potential relationship between FoI and VE. The first explored three mathematical scenarios of VE as a function of various FoI settings. The second followed up on the decades-old observations of lower apparent efficacy of oral poliovirus 1 and oral typhoid vaccines 5 in low resource settings when compared to high resource settings. This empiric interrogation assessed the correlation between the incidence of disease in the placebo population (as a surrogate of FoI in the study population) and the observed VE in different geographical settings. Recent Phase 3 studies of malaria and rotavirus vaccine candidates across a number of settings, including low and high resource settings 6, 17 , provided data for empirically assessing if and how FoI might be a determinant of VE. Both the thought experiment of setting-dependent VE of a hypothetical vaccine and the retrospective analyses of rotavirus and malaria Phase 3 efficacy results make a multitude of assumptions that limit the robustness and soundness of any conclusions. For simplicity, factors previously shown or hypothesized to influence transmission, susceptibility, VE, and/or FoI, such as, country income status, age, underlying medical conditions, coinfections, access to healthcare, seasonality, NPI use, spreading events, and strain differences across different settings, and preexposure effect were excluded from consideration in both the hypothetical VE or observed VE analyses. Given these significant limitations in the analyses, the primary goal of the present study was not to provide a definitive answer to the questions of if and to what degree FoI determines VE in different settings. Rather the goal of these analyses was to continue to raise the awareness of the potential impact of FoI on VE 8, 18 , and to prompt prospective studies designed to assess if and how NPIs might reduce FoI and enhance VE when vaccines are introduced and scaled up. Ultimately well-designed studies that directly evaluate the potential relationship of FoI and settingdependent VE will provide the evidence needed for well-informed policy recommendations on the continued use or not of NPIs during vaccine introduction and scale-up. Three scenarios of the potential mathematical consequences of FoI on setting-dependent VE The potential effects of FoI on the level of VE were explored in three mathematical scenarios: (1) VE constant , where VE is independent of FoI; (2) VE linear , where VE decreases linearly as a function of increasing FoI; and, (3) VE natural log , where VE decreases logarithmically as a function of increasing FoI. As noted above, multiple simplifying assumptions were made when considering the mathematical consequences of FoI on VE, including homogeneity in the population with respect to a number of factors, such as, pathogen transmission, host susceptibility to infection and disease (be it genetic or acquired), FoI over time in a specific setting, and protective immunity as a result of vaccination across settings. With these simplifying assumptions in mind, equations that define the three mathematical scenarios (see Box 2, VE as a function of FoI) are shown graphically in Fig. 1 , using the example of a hypothetical vaccine that has a maximum VE of 83% studied under conditions of FoI that vary across two orders of magnitude, from 0.03 to 3.50 infections/person-year. While other more complex mathematical relationships between VE and FoI merit consideration, these three simple equations seemed a reasonable starting point from which to interrogate observed data from Phase 3 VE studies conducted in multiple epidemiological settings. Empiric evidence of FoI on observed setting-dependent VE Results from recent placebo-controlled Phase 3 studies of vaccine candidates for two diverse pathogens, Plasmodium falciparum and rotavirus, provided a database to determine which, if any, of the three mathematical scenarios best explained any settingdependent differences in VE. The selection of malaria and diarrhea as clinical endpoints provided an opportunity to analyze FoI and VE for both vector-transmitted and fecal-oral-transmitted pathogens, as well as parenterally and orally administered vaccine candidates, respectively. In addition to the assumptions mentioned above, several additional assumptions noted below facilitated the analyses of these multi-setting VE studies of two pathogens. First and foremost, the analyses of both pathogens assumed that the intent-to-treat (ITT) incidence of the most sensitive definition of the mildest disease endpoint in the youngest age cohort in the placebo arm best served as an internal Phase 3 study surrogate of λ, the FoI. The validity of this assumption relies upon several other assumptions, including the absence of any significant herd effect (see Box 1, Glossary of Key Terms) on the control from the vaccinated arm of the Phase 3 study. The rationale for making this herd effect assumption, typically also assumed for the control group used in estimating VE in the context of Phase 3 efficacy studies, relies upon: (1) the relatively small proportion of the total population in the study setting enrolled in the vaccinated group in the Phase 3 study; and, (2) the timing of incident disease in the control group relative to eliciting herd immunity and reaching the herd immunity threshold (see Box 1, Glossary of Key Terms) in the study population. A third key assumption relied upon a comparison of trendlines from the three mathematical scenarios described above to the closest fit trendline of observed VE (VE observed ) as a function of observed FoI (FoI observed , incidence in the placebo group) in each epidemiologic setting to determine if and how VE varied as a function of FoI. In this regard, because the Phase 3 VE results for both pathogens were known a priori to vary by epidemiologic setting, the posterior probability was low of selecting the VE constant mathematical scenario to categorize VE observed as a function of FoI observed . As noted below for each specific analysis, the observed trendline may not necessarily reflect a statistically significant association between VE observed and FoI observed , as assessed by a regression analysis. A single pivotal Phase 3 VE study (NCT00866619) enrolled 15,459 participants in two age categories (young children aged 5-17 months and infants aged 6-12 weeks at the time of enrollment) across 11 clinical research sites in seven African countries (one site in Burkina Faso, Gabon, Malawi, and Mozambique; two sites in Ghana and Tanzania; and three sites in Kenya). The trial assessed, as a primary aim, VE of a three-dose regimen of RTS,S/AS01 E against clinical malaria Box 1 Glossary of key terms Force of infection: Rate at which susceptible individuals in a population acquire an infectious disease in that population, per unit time. It is also known as the incidence rate or hazard rate 36 . (see equation 2.13, ref. 36 ) where λ t is the force of infection at time t, c e is the number of individuals effectively contacted by each person per unit time, I t is the number of infected in the population at time t, and N t is the number in the population at time t. Efficacy: The direct protection provided by vaccination against a defined clinical endpoint; it excludes any indirect (herd) effect 36 . Vaccine efficacy reflects the relative reduction between the vaccinated and control groups for one or more specific clinical endpoints. Calculations of the relative reduction typically use a hazard ratio, a risk ratio, or most simply, as shown below, an incidence ratio 37 ; Box 2 Vaccine efficacy as a function of force of infection The following equations define mathematical relationships between vaccine efficacy (VE) and force of infection (FoI) shown in Fig. 1 Table 23 , ref. 19 ). As noted above, the intent-to-treat (ITT) incidence of the more sensitive secondary definition of clinical malaria in the control group of infants aged 6-12 weeks at the time of enrollment (see Annex 7 Table 177 , ref. 20 .) served as the internal Phase 3 study FoI observed , the surrogate of λ in the analyses. The best fit trendline analysis of VE observed as a function of FoI observed revealed a logarithmic relationship (Fig. 2 , Observed VE) with an R 2 of 0.807. Regression analysis of VE observed as a function of ln FoI observed revealed a Significance F of 0.006. Using the VE natural log equation (Box 2), the observed VE max , VE min , FoI max , FoI min , and the FoI observed from each site generated a logarithmic relationship between the calculated site-specific VE and FoI observed (Fig. 2, Calculated VE) . These analyses suggest that malaria parasite FoI functions as a determinant of RTS,S/AS01 E VE. Multiple Phase 3 studies of two rotavirus vaccines, RV1 (Rotarix ® ) and RV5 (RotaTeq ® ), evaluated VE in diverse epidemiologic settings 17 . In comparison to the analyses conducted for malaria VE, the analyses of rotavirus VE observed as a function of rotavirus FoI observed was complicated by the evaluation of two different vaccine candidates, with two different regimens, in several different clinical protocols. Some of the Phase 3 studies conducted in low resource settings did not collect data on the incidence of rotavirus gastroenteritis (RVGE) of any severity. The analyses excluded these studies due to the absence of an intent-to-treat incidence of any severity RVGE in the placebo group to serve as a surrogate of λ. The analyses also excluded data from countries in which the placebo group had no or just a single case of RVGE of any severity. From those studies that collected sufficient incidence of any severity RVGE in the placebo group, an Analysis of Variance failed to detect a statistically significant difference (p-value = 0.749) when categorizing FoI observed by 2020 World Bank country income classifications (i.e., upper-v upper middle-v lower middle/ lower-income country) 21 (Table 1) . For RV1, results from 10 countries in five independent Phase 3 studies 17,22-26 (see Table 1 ) met the above FoI observed criteria for interrogation. The best fit trendline analysis of VE observed as a function of FoI observed revealed a linear relationship (Fig. 3a upper line, Observed VE) with an R 2 of 0.3892 and regression analysis with a Significance F of 0.158. The VE observed of 94.9% in one setting (Mexico) with FoI observed of 13.79 appeared to be a significant outlier. Reanalysis absent the data from Mexico revealed a linear relationship (Fig. 3a middle line, Observed VE), with an R 2 of 0.6264 and regression analysis Significance F of 0.0449. Using the VE linear equation (Box 2), the observed VE max , VE min , FoI max , FoI min , and the FoI observed from each of the 10 countries generated a linear relationship between the calculated site-specific VE and FoI observed (Fig. 3a lower line, Calculated VE). These analyses suggest that rotavirus FoI may function as a determinant of RV1 VE. For RV5, results from five settings in three independent Phase 3 studies 17,27-31 (see Table 1 ) met the above FoI observed criteria for interrogation. The best fit trendline analysis of VE observed as a function of FoI observed revealed an independent relationship (data not shown but provided for review) with an R 2 of −0.215 and regression analysis Significance F of 0.9838. Interrogating results from 7 settings in five independent Phase 3 studies 17,27-32 (see Table 1 ) by using the incidence of SRVGE in the placebo group as the FoI observed and surrogate of λ in the analyses, the best fit trendline analysis of VE observed as a function of FoI observed revealed a linear relationship (Fig. 3b , Observed VE) with an R 2 of 0.6692 and regression analysis Significance F of 0.081. Using the VE linear equation (Box 2), the observed VE max , VE min , FoI max , FoI min , and the FoI observed from each of the 7 settings in the reanalysis generated a linear relationship between the calculated site-specific VE and FoI observed (Fig. 3b lower line, Calculated VE) . These analyses suggest that rotavirus FoI may function as a determinant of RV5 VE, when the incidence of SRVGE, rather than RVGE of any severity, in the placebo group serves as the FoI observed in the analyses. That a relationship between FoI and VE appears logarithmic for a parenterally administered malaria vaccine candidate and linear for two orally administered rotavirus vaccine candidates may reflect different routes of infection, routes of vaccine administration, fold differences between the FoI max and FoI min (i.e., more than a hundred-fold for malaria and less than tenfold for rotavirus) or other differences between the pathogens, host responses, or vaccines. If a causal relationship rather than an indirect (e.g., pre-exposure effect 33 ), misleading 34 , or chance association between FoI and VE exists, then of the many proposed determinants of setting-dependent VE, FoI provides one of the most direct, mechanistically proximate potential determinants. Furthermore, for many but not all pathogens, modifying the FoI provides one of the most actionable interventions to enhance or sustain VE. While improving indirect or distal VE determinants, such as poverty, gut pathology, co-infections, malnutrition, and the microbiome 35 could significantly enhance efforts to control and eliminate simultaneously many pathogens, implementing interventions that effectively mitigate these VE determinants is complex and not immediately achievable. In contrast, modifying the FoI through the concomitant use of affordable, accessible, available, acceptable, and sustainable NPIs provides a proximate and actionable approach to optimizing VE. Considering and then prospectively verifying the speculation that introduction or continued optimal use of NPIs in an effort to reduce the FoI and thereby enhance or sustain VE, respectively, upon vaccine rollout seems prudent and, in the context of a pandemic, quite urgent. Further information on research design is available in the Nature Research Reporting Summary linked to this article. All data used in the analyses can be publicly accessed. The sources and web links for all the data have been cited in the references. All analyses conducted using Microsoft ® Excel ® for Microsoft 365 version 2101. Immunisation Against polioviruses in developing countries Herd immunity and herd effect: new insights and definitions Differences of rotavirus vaccine effectiveness by country: likely causes and contributing factors A systematic review of the effect of rotavirus vaccination on diarrhea outcomes among children younger than 5 years Oral immunisation against typhoid fever in Indonesia with Ty21a vaccine Public Assessment Report. Mosquirix H-W-2300 S: toward a first landmark on the malaria vaccine technology roadmap Certainty of success: three critical parameters in coronavirus vaccine development Rotavirus vaccine and diarrhea mortality: quantifying regional variation in effect size Heterogeneity of rotavirus vaccine efficacy among infants in developing countries Performance of rotavirus vaccines in developed and developing countries Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis Condom effectiveness in reducing heterosexual HIV transmission Insecticide-treated nets for preventing malaria Hand-washing promotion for preventing diarrhoea Modelling the costeffectiveness of introducing the RTS,S malaria vaccine relative to scaling up other malaria interventions in sub-Saharan Africa Vaccines for preventing rotavirus diarrhoea: vaccines in use Use of vaccines as probes to define disease burden GSK. Annex 6 to the Clinical Study Report for Study 110021 (MALARIA-055 PRI World Bank Country and Lending Groups-World Bank Data Help Desk Efficacy of human rotavirus vaccine against rotavirus gastroenteritis during the first 2 years of life in European infants: randomised, doubleblind controlled study Human rotavirus vaccine (RIX4414) efficacy in the first two years of life Evaluation of safety, immunogenicity and efficacy of an attenuated rotavirus vaccine, rix4414: a randomized, placebo-controlled trial in latin American infants Efficacy, safety and immunogenicity of RIX4414 in Japanese infants during the first two years of life Effect of human rotavirus vaccine on severe diarrhea in African infants Efficacy, immunogenicity, and safety of a pentavalent humanbovine (WC3) reassortant rotavirus vaccine at the end of shelf life Efficacy and safety of pentavalent rotavirus vaccine in Japan Efficacy of pentavalent rotavirus vaccine against severe rotavirus gastroenteritis in infants in developing countries in sub-Saharan Africa: a randomised, double-blind, placebo-controlled trial Safety and efficacy of a pentavalent human-bovine (WC3) reassortant rotavirus vaccine Assessment report for paediatric studies submitted according to Article 46 of the Regulation (EC) No Efficacy of pentavalent rotavirus vaccine against severe rotavirus gastroenteritis in infants in developing countries in Asia: a randomised, double-blind, placebo-controlled trial Estimating the per-exposure effect of infectious disease interventions Measurement of vaccine direct effects under the test-negative design The influence of the intestinal microbiome on vaccine responses An Introduction to Infectious Disease Modelling Design and Analysis of Vaccine Studies Field evaluation of vaccine efficacy Effects of the potency and composition of the multivalent human-bovine (WC3) reassortant rotavirus vaccine on efficacy, safety and immunogenicity in healthy infants Evaluate protective efficacy of diff strengths of human rotavirus vaccine after administration of 2 doses to infants aged 2 months Vaccine Efficacy against Rotavirus Diarrhea; Vaccine Given with Routine Childhood Vaccinations in Healthy African Infants: GSK 102248 GSK. Study to Assess the Efficacy, Immunogenicity and Safety of Liquid Human Rotavirus Vaccine To test 2 doses of GSK Biologicals' oral live attenuated human rotavirus (HRV) vaccine in healthy infants in co-administration with specific childhood vaccines: GSK 102247/036 safety, reactogenicity & immunogenicity of the Rotarix vaccine in Japanese infants: GSK 107625 Clinical Study Report The author thanks Dr. Marc Lipsitch for critical review and suggestions. This work was supported by the Bill & Melinda Gates Foundation, Seattle, WA [OPP1180199]. The funder had no role in the preparation of the manuscript or decision to publish. D.C.K. conceived, wrote, reviewed, approved and is accountable for this paper. D.C.K., an employee of PATH (a not-for-profit organization), has no financial interest in any for-profit organization, and declares no competing interests. Supplementary information The online version contains supplementary material available at https://doi.org/10.1038/s41541-021-00316-5.Correspondence and requests for materials should be addressed to D.C.K.Reprints and permission information is available at http://www.nature.com/ reprintsPublisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons. org/licenses/by/4.0/.