key: cord-0685131-7a543f7v authors: Gazit, Sivan; Shlezinger, Roei; Perez, Galit; Lotan, Roni; Peretz, Asaf; Ben-Tov, Amir; Herzel, Esma; Alapi, Hillel; Cohen, Dani; Muhsen, Khitam; Chodick, Gabriel; Patalon, Tal title: SARS-CoV-2 Naturally Acquired Immunity vs. Vaccine-induced Immunity, Reinfections versus Breakthrough Infections: a Retrospective Cohort Study date: 2022-04-05 journal: Clin Infect Dis DOI: 10.1093/cid/ciac262 sha: 1ff6e94297a4a025555bfb0a9c8451b23f913cf2 doc_id: 685131 cord_uid: 7a543f7v BACKGROUND: Waning of protection against infection with SARS-CoV-2 conferred by 2 doses of the BNT162b2 vaccine begins shortly after inoculation and becomes substantial within four months. With that, the impact of prior infection on incident SARS-CoV-2 reinfection is unclear. Therefore, we examined the long-term protection of naturally acquired immunity (protection conferred by previous infection) compared to vaccine-induced immunity. METHODS: A retrospective observational study of 124,500 persons, compared two groups: (1) SARS-CoV-2-naïve individuals who received a two-dose regimen of the BioNTech/Pfizer mRNA BNT162b2 vaccine, and (2) previously infected individuals who have not been vaccinated. Two multivariate logistic regression models were applied, evaluating four SARS-CoV-2-related outcomes - infection, symptomatic disease (COVID-19), hospitalization and death – between June 1 to August 14, 2021, when the Delta variant was dominant in Israel. RESULTS: SARS-CoV-2-naïve vaccinees had a 13.06-fold (95% CI, 8.08-21.11) increased risk for breakthrough infection with the Delta variant compared to unvaccinated-previously-infected individuals, when the first event (infection or vaccination) occurred during January and February of 2021. The increased risk was significant for symptomatic disease as well. When allowing the infection to occur at any time between March 2020 to February 2021, evidence of waning naturally acquired immunity was demonstrated, though SARS-CoV-2 naïve vaccinees still had a 5.96-fold (95% CI, 4.85-7.33) increased risk for breakthrough infection and a 7.13-fold (95% CI, 5.51-9.21) increased risk for symptomatic disease. CONCLUSIONS: Naturally acquired immunity confers stronger protection against infection and symptomatic disease caused by the Delta variant of SARS-CoV-2, compared to the BNT162b2 two-dose vaccine-induced immunity. The heavy toll that SARS-CoV-2 infection has been taking on global health and healthcare resources created an urgent need to estimate which part of the population is protected against COVID-19 at a given time in order to set healthcare policies such as lockdowns and to assess the possibility of herd immunity. Though antibody levels might be useful to assess short-term protection on a population level, to date, there is still no consensus on an evidence-based, long-term measurement to assess immune correlate of protection [1] . This lack of correlate of protection has led to different approaches in terms of vaccine resource allocation, such as the need for vaccine administration in recovered patients. With that, evidence of waning vaccine-induced immunity against COVID-19 have surfaced, [2] [3] [4] [5] [6] [7] though research has demonstrated that this reduction is milder against severe disease, meaning that vaccinated individuals are more protected against severe disease than unvaccinated ones, even if a breakthrough infection (infection after vaccination) occurs. [8] Alongside the question of long-term protection against infection provided by the vaccine, the degree and duration to which previous infection with SARS-CoV-2 affords protection against repeated infection also remains unclear. Apart from the paucity of studies examining long-term protection against reinfection [9, 10] , there is a challenge in defining reinfection as opposed to prolonged viral shedding [11] . While clear-cut cases exist, namely two separate clinical events with two distinct sequenced viruses, relying solely on these cases will likely result in an under-estimation of the incidence of reinfection. Different criteria based on more widely-available information have been suggested [12] , as, for example, the Centers for Disease Control and Prevention's (CDC) guidelines refer to two positive SARS-CoV-2 polymerase chain reaction (PCR) test results at least 90 days apart. [13] These challenges and the CDC's suggested solution to tackle them, require long-term follow-up and free and available access to testing, facilitated largely by integrated healthcare organizations, though this does not eliminate the risk of underestimation. Using similar criteria to the CDC's, population-M a n u s c r i p t 5 based studies demonstrated naturally acquired immunity [14, 15] with no signs of waning immunity for at least 7 months, though protection was lower for those aged 65 or older [9] . Now, when sufficient time has passed since both the beginning of the pandemic and the deployment of the vaccine, we can examine the long-term protection of naturally acquired immunity compared to that afforded by the vaccine. To this end, we compared the incidence rates of breakthrough infections to the incidence rates of reinfection, leveraging the centralized computerized database of Maccabi Healthcare Services (MHS), Israel's second largest Health Maintenance Organization. A retrospective cohort study was conducted. The study population included MHS members aged 16 or older who were twice vaccinated prior to February 28, 2021 or who had a documented SARS-CoV-2 infection by February 28, 2021. The study only included persons who received the BioNTech/Pfizer mRNA BNT162b2 vaccine, as this was given to the vast majority of the Israeli population. The eligible study population was divided into two groups: (1) [18] before the spread of the Omicron variant. Two models were applied to evaluate four SARS-CoV-2-related outcomes as dependent variables, while the study groups were the main independent variables. In both models, we estimated naturally acquired immunity vs. vaccine-induced immunity for each outcome, by applying logistic regression to calculate the odds ratio (OR) between the two groups with associated 95% confidence intervals (CIs). Results were then adjusted for underlying comorbidities, including obesity, cardiovascular diseases, diabetes, hypertension, chronic kidney disease, cancer and immunosuppression conditions. Additionally, for each models, in order, to assess the potential robustness of an unmeasured confounder, we conducted a sensitivity analysis using the E-value metric. [25] The E-value is defined as the minimum strength of association that an unmeasured confounder would need to have with both the exposure and the outcome to fully explain away a specific exposure-outcome association, conditional on the measured covariates. [26] In model 1, we examined naturally acquired immunity and vaccine-induced immunity by comparing the likelihood of SARS-CoV-2-related outcomes between previously infected individuals who have never been vaccinated to fully vaccinated SARS-CoV-2-naïve individuals. These groups were matched in a 1:1 ratio by age, sex, GSA and time of first event. The first event (the preliminary exposure) was either the time of administration of the second dose of the vaccine or the time of A c c e p t e d M a n u s c r i p t 7 documented infection with SARS-CoV-2 (a positive PCR test result), both occurring between January 1, 2021 and February 28, 2021. Thereby, we matched the "immune activation" time of both groups, examining the long-term protection conferred when vaccination or infection occurred within the same period. The three-month interval between the exposure and the outcome was implemented to capture reinfections (as opposed to prolonged viral shedding) by following the 90-day guideline of the CDC. In model 2, we compared the SARS-CoV-2 naïve vaccinees to unvaccinated and previously infected individuals while intentionally not matching the time of the first event (exposure) (i.e., either vaccination or infection), in order to compare vaccine-induced immunity to naturally acquired immunity, regardless of time of infection. Therefore, matching was done in a 1:1 ratio based on age, sex and GSA alone. Similar to model 1, either event (vaccination or infection) had to occur by February 28, to allow for the 90-day interval. The four SARS-CoV-2 study outcomes were the same for this model, evaluated during the same follow-up period. Additionally, we included a sensitivity analysis that addressed the timing of vaccination. As individuals with chronic illness were primarily vaccinated between December and February, we conducted the same design of model 2, this time with those vaccinated later, between March and April 2021, therefore comparing the SARS-CoV-2 naïve March and April vaccinees to those unvaccinated and previously infected at any time until February 28, 2021 (to allow for the 90-day interval). Finally, we performed an alternative model of analysis, in order to address the possible selection bias of mandating previously infected individuals to be unvaccinated until the end of the follow-up period as well as vaccinated individuals not to have received the booster (third) dose by that time, as the booster vaccination campaign began On July 31, 2021. Therefore, we applied a Cox proportional hazards regression to calculate the Hazard Ratio (HR) of SARS-CoV-2 infections and symptomatic SARS-CoV-2 infections between the groups with associated 95% confidence intervals (CIs). Participants' vaccination status was determined on June 1 (the start of the follow-up period), and for A c c e p t e d M a n u s c r i p t 8 each person the follow-up ended at the earliest of these events: the tested-outcome (infection or symptomatic infection), vaccination (either a first dose for members of the previously infected group or a third dose for those in the vaccinated group) or the end of the follow-up period. The same matching was applied, as well as adjustment for the same variables. Analyses were performed using Python version 3.73 with the statsmodels package. P < 0.05 was considered statistically significant. This study was approved by the MHS (Maccabi Healthcare Services) Institutional Review Board (IRB). Due to the retrospective design of the study, informed consent was waived by the IRB, and all identifying details of the participants were removed before computational analysis. Overall, 673,676 MHS members 16 years and older were eligible for the study group of fully vaccinated SARS-CoV-2-naïve individuals and 62,883 were eligible for the study group of unvaccinated previously infected individuals ( Figure S1 ). Of those previously infected from the beginning of the pandemic and up to February 2021, who could have potentially been eligible for the study group of the unvaccinated and previously infected individuals, 693 COVID-19-related deaths were recorded. Mean age of death was 78 (SD-12), 90% of deaths were among those 60 years old and over. A c c e p t e d M a n u s c r i p t 9 In model 1, we matched 16,215 persons in each group. Overall, demographic characteristics were similar between the groups, with some differences in their comorbidity profile (Table 1, model 1) . During the follow-up period, 257 cases of SARS-CoV-2 infection were recorded, of which 238 occurred in the vaccinated group (breakthrough infections) and 19 in the previously infected group (reinfections) ( Figure S2 ). After adjusting for comorbidities, we found a statistically significant 13.06fold (95% CI, 8.08 to 21.11) increased risk for breakthrough infection as opposed to reinfection (P<0.001). Apart from age ≥60 years, there was no statistical evidence that any of the assessed comorbidities significantly affected the risk of an infection during the follow-up period ( Table 2) . To further characterize the association with older age, we added an interaction analysis which yielded a non-statistically significant (P=0.79) interaction term of age ≥60 years, vaccination and risk for incidence infection. Table S1 ). None of the covariates were significant, except for age ≥60 years. A c c e p t e d M a n u s c r i p t 10 The sensitivity analyses that adjusted for individuals' test frequency as a proxy for healthcare seeking behavior did alter results (Supplementary Data). Eight cases of COVID-19-related hospitalizations were recorded, all of which were in the vaccinated group and. No COVID-19-related deaths were recorded in our cohorts. In model 2, we matched 46,035 persons in each of the groups (previously infected vs. vaccinated) ( Table 1 ). Figure 1 demonstrates the timely distribution of the first infection in reinfected individuals. When comparing the vaccinated individuals to those previously infected at any time (including during 2020), we found that throughout the follow-up period, 748 cases of SARS-CoV-2 infection were recorded, 640 of which were in the vaccinated group (breakthrough infections) and 108 in the previously infected group (reinfections). After adjusting for comorbidities, a 5.96-fold increased risk (95% CI, 4.85 to 7.33) increased risk for breakthrough infection as opposed to reinfection could be observed (P<0.001) ( Table 3) . Apart from SES level and age ≥60, that remained significant in this model as well, there was no statistical evidence that any of the comorbidities significantly affected the risk of an infection. The E-value for breakthrough infection was 22.1 (and 7.29 for the lower bound of the CI). Overall, 552 symptomatic cases of SARS-CoV-2 were recorded, 484 in the vaccinated group and 68 in the previously infected group. There was a 7.13-fold (95% CI, 5.51 to 9.21) increased risk for symptomatic breakthrough infection than symptomatic reinfection (Table S2) (Table S7) . When comparing the later vaccinees to those previously infected at any time (from 2020), 570 cases of SARS-CoV-2 infection were recorded, 463 of which were in the March-April vaccinated group (breakthrough infections) and 107 in the previously infected group (reinfections). After adjusting for comorbidities, a 4.63-fold increased risk (95% CI, 3.53 to 5.38) for breakthrough infection as opposed to reinfection could be observed (Table S8) . As for symptomatic cases, there was a 6.67-fold (95% CI, 4.9 to 9.06) increased risk for symptomatic breakthrough infection than symptomatic reinfection (Table S9 ). There were 7 cases of COVID-19 related hospitalizations, 4 of which among the April-March vaccinees and 3 among the previously infected. This is the largest real-world observational study comparing naturally acquired immunity, gained through previous SARS-CoV-2 infection, to vaccine-induced immunity, afforded by the BNT162b2 mRNA vaccine. Our large cohort, enabled by Israel's rapid rollout of the mass-vaccination campaign, allowed us to investigate the risk for additional infectioneither a breakthrough infection in vaccinated individuals or reinfection in previously infected onesover a longer period than thus far described. Our analysis demonstrates that SARS-CoV-2-naïve vaccinees had a 13.06-fold increased risk for breakthrough infection with the Delta variant compared to those previously infected, when the first event (infection or vaccination) occurred during January and February of 2021. The increased risk was significant for a symptomatic disease as well. Broadening the research question to examine the extent of the phenomenon, we allowed the first infection to occur at any time between March 2020 to February 2021 (when different variants were A c c e p t e d M a n u s c r i p t 12 dominant in Israel), compared to vaccination only in January and February 2021. Although the results could suggest waning naturally acquired immunity against the Delta variant, those vaccinated are still at a 5.96-fold increased risk for breakthrough infection and at a 7.13-fold increased risk for symptomatic disease compared to those previously infected. SARS-CoV-2-naïve vaccinees had more COVID-19-related-hospitalization compared to those who were previously infected, though the numbers are too small to determine statistical significance. Importantly, in neither group no COVID-19-related deaths were recorded. The advantageous protection afforded by naturally acquired immunity that this analysis demonstrates could be explained by the more extensive immune response to the SARS-CoV-2 proteins than that generated by the anti-spike protein immune activation conferred by the vaccine [27, 28] . However, as a correlate of protection is yet to be proven [1, 29] , including the role of B-Cell [30] and T-cell immunity [31, 32] , this remains a hypothesis. Our study matches the CDC report, [10] examining cohorts in California and New York, demonstrating that infection-induced protection was more substantial than vaccine induced immunity during the the Delta period. The report demonstrates an opposite trend during the previous Alpha dominant period; however, a significant limitation, addressed as such by the researchers of this report as well, pertains to the lack of addressing the varying times-since-vaccination, which could bias the result, especially in the early stages of the follow-up. Our study has several limitations. First, as the Delta variant was the dominant strain in Israel during the outcome period, the decreased long-term protection of the vaccine compared to that afforded by previous infection cannot be ascertained against other strains, including the Omicron. Second, our analysis addressed protection afforded solely by the BioNTech/Pfizer mRNA BNT162b2 vaccine, and therefore does not address other vaccines or long-term protection following a third dose, an assessment which might require more data before carrying out. Additionally, as this is an observational real-world study, where PCR screening was not performed by a pre-set protocol, we A c c e p t e d M a n u s c r i p t 13 might be underestimating asymptomatic infections, as these individuals often do not get tested. A related concern is that the frequency of PCR testing differed between groups, meaning that one group manifested different health seeking behavior during the pandemic and therefore is potentially more diagnosed rather than more infected. To address that potential detection bias, we conducted a sensitivity analysis where the number of PCR tests undertaken throughout the pandemic was adjusted for, as a proxy for COVID-19-related health seeking behavior. The findings demonstrated that this adjustment did not change the results. Furthermore, the analysis merits addressing the potential survivorship bias, which might have accounted for the stronger protection of the unvaccinated previously infected group. As reported in the results, COVID-19 related mortality in this group (prior to the outcome period) was evaluated at approximately 1% with mean age of 78 years. Therefore, it does not seem to overall account for the significant protection conferred by natural infection across the different age groups. Moreover, as individuals with chronic illness were primarily vaccinated between December and February, confounding by indication needs to be considered; though the groups somewhat differ in their comorbidity profile, adjusting for obesity, cardiovascular disease, diabetes, hypertension, chronic kidney disease, chronic obstructive pulmonary disease, cancer and immunosuppression had only a small impact on the estimated effect as compared to the unadjusted OR. Therefore, residual confounding by unmeasured factors is unlikely. Nonetheless, in order to assess whether the association between previous infection or vaccination and a following infection (breakthrough-or re-infection) could be attributed to unmeasured confounding, e.g. by differential groups behavior (such as social distancing and mask wearing), we calculated the E-value for an unmeasured confounding. The E-value for both models suggested that only a highly strong association between both the group (vaccinated vs. previously infected individuals) and healthcare seeking behavior, and healthcare seeking behavior and the outcome of a subsequent infection (breakthrough-or reinfection) would account for all the observed association between vaccinating convalescent patients and their reduced risk for reinfection. To further address this issue, we conducted a different sensitivity analysis, where we implemented the same design of model 2, comparing those previously infected at any time to later vaccinees, namely A c c e p t e d M a n u s c r i p t 14 those who completed the second dose between March and April 2021. This time, the latter group had slightly more comorbidities than those previously infected, though again these were not found to affect significantly. The results suggest waning of vaccine-induced immunity against the Delta variant, and still point to an increased risk of those vaccinated. Those later vaccinees are at a 4.63-fold increased risk for breakthrough infection and at a 6.67-fold increased risk for symptomatic disease compared to those previously infected. Lastly, as per Israeli regulations the second dose was administered within 21-28 days of the first dose, we could not assess whether an extended interval between the doses affects effectiveness. This analysis demonstrated that naturally acquired immunity affords longer lasting and stronger protection against infection and symptomatic disease due to the Delta variant of SARS-CoV-2, compared to the BNT162b2 two-dose vaccine-induced immunity. M a n u s c r i p t 20 M a n u s c r i p t 21 A c c e p t e d M a n u s c r i p t 22 A correlate of protection for SARS-CoV-2 vaccines is urgently needed Correlation of SARS-CoV-2-breakthrough infections to time-from-vaccine Waning of BNT162b2 Vaccine Protection against SARS-CoV-2 Infection in Qatar Protection of BNT162b2 Vaccine Booster against Covid-19 in Israel Waning Immune Humoral Response to BNT162b2 Covid-19 Vaccine over 6 Months Viral loads of Delta-variant SARS-CoV-2 breakthrough infections after vaccination and booster with BNT162b2 Waning of SARS-CoV-2 booster viral-load reduction effectiveness Sustained Effectiveness of Pfizer-BioNTech and Moderna Vaccines Against COVID-19 Associated Hospitalizations Among Adults -United States Assessment of protection against reinfection with SARS-CoV-2 among 4 million PCR-tested individuals in Denmark in 2020: a population-level observational study COVID-19 Cases and Hospitalizations by COVID-19 Vaccination Status and Previous COVID-19 Diagnosis -California and New York What reinfections mean for COVID-19 Setting the criteria for SARS-CoV-2 reinfection-six possible cases Accessed 15 A 1 to 1000 SARS-CoV-2 reinfection proportion in members of a large healthcare provider in Israel: a preliminary report Antibody Status and Incidence of SARS-CoV-2 Infection in Health Care Workers COVID-19 dynamics after a national immunization program in Israel Israel to revise COVID testing rules amid rapid spread of omicron variant, soaring demand SARS-CoV-2 variants in analyzed sequences The use of an automated patient registry to manage and monitor cardiovascular conditions and related outcomes in a large health organization Prevalence and factors associated with resistant hypertension in a large health maintenance organization in Israel The epidemiology of diabetes in a large Israeli HMO Decline in estimated glomerular filtration rate and subsequent risk of end-stage renal disease and mortality Israel National Cancer Registry Waning Immunity after the BNT162b2 Vaccine in Israel Ioannidis and Poole opposed to the Cornfield conditions? A defence of the E-value Sensitivity analysis in observational research: Introducing the E-Value SARS-CoV-2 mRNA Vaccines: Immunological Mechanism and Beyond Leading Edge Adaptive immunity to SARS-CoV-2 and COVID-19 Dynamics of SARS-CoV-2 neutralising antibody responses and duration of immunity: a longitudinal study Antibody Evolution after SARS-CoV-2 mRNA Vaccination Longitudinal analysis shows durable and broad immune memory after SARS-CoV-2 infection with persisting antibody responses and memory B and T cells Durability of SARS-CoV-2-specific T cell responses at 12-months post-infection SD -Standard Deviation; SES -Socioeconomic status on a scale from 1 (lowest) to 10; CVD -Cardiovascular Diseases DM -Diabetes Mellitus; CKD -Chronic Kidney Disease M a n u s c r i p t 15 NOTES Funding: There was no external funding for the project. A c c e p t e d M a n u s c r i p t