key: cord-0690882-o22webo6
authors: Kow, Chia Siang Chia; Ramachandram, Dinesh Sangarran; Hasan, Syed Shahzad
title: The effectiveness of BNT162b2 mRNA vaccine against COVID-19 caused by Delta variant of SARS-CoV-2: a systematic review and meta-analysis
date: 2022-01-31
journal: Inflammopharmacology
DOI: 10.1007/s10787-021-00915-7
sha: 06d39068c428f191cd52c1126143cc87968b50f4
doc_id: 690882
cord_uid: o22webo6

Meta-analyses were utilized to determine the overall effectiveness of BNT162b2 mRNA vaccine (Pfizer vaccine) against COVID-19 caused by Delta variant from large real-world studies. A systematic literature search with no language restriction was performed in electronic databases to identify eligible observational studies that reported the effectiveness of the BNT162b2 mRNA vaccine to prevent reverse transcription-polymerase chain reaction (RT-PCR) confirmed COVID-19 caused by Delta variant of SARS-CoV-2 (B.1.617.2). Random-effects meta-analysis model was used to estimate the pooled odds ratio (OR) at a 95% confidence interval, and the vaccine effectiveness was indicated as (pooled OR – 1)/OR. Seven studies were included for this meta-analysis. The meta-analysis revealed that the administration of BNT162b2 mRNA vaccine protected against RT-PCR confirmed COVID-19 caused by Delta variant ≥ 21 days after the first dose, with vaccine effectiveness of 55% (95% confidence interval 46–63%), as well as ≥ 14 days after the second dose, with vaccine effectiveness of 81% (95% confidence interval 69–88%). In conclusion, the BNT162b2 mRNA vaccine offers a substantial protection rate against RT-PCR confirmed COVID-19 caused by the Delta variant upon full vaccination, albeit with slightly reduced effectiveness relative to other strains of SARS-CoV-2.

The Delta variant of SARS-CoV-2, also known as B.1.617.2, belongs to a viral lineage of SARS-CoV-2 first identified in India during an intense wave of coronavirus disease 2019 in April and May 2021. The Delta variant is highly transmissible, where it was reported that it could be more than twice as transmissible as the original strain of SARS-CoV-2 (Andrews et al. 2021). COVID-19 caused by Delta variant still lead to typical symptoms including headache, sore throat, runny nose, and fever, but cough and loss of smell are less common. The lineage has since proliferated and linked to a resurgence of COVID-19 cases in many parts of the world, including those with robust vaccination drives, and this may lead to phenomenon of hyperlocal outbreaks (concentrated amounts of cases in neighborhoods with low vaccination rate) which could overwhelm the healthcare Inflammopharmacology Please add an Editor's footnote that this review is limited to consideration of the literature on coronavirus vaccines available at the time of preparation of manuscript. Issues relative to the recent omicron variant have not been considered as there is no available literature on the effects of vaccines on this variant.

* Chia Siang Chia Kow chiasiang_93@hotmail.com 1 system due to unequal proportion of vaccination across different areas (Blanquart et al. 2021) . Therefore, there have been concerns in the medical fraternity that the currently available COVID-19 vaccines may not be adequate to protect against COVID-19 caused by the Delta variant (Bian et al. 2021) . This paper aimed to summarize through metaanalyses the overall effectiveness of the BNT162b2 mRNA vaccine against COVID-19 caused by Delta variant from real-world studies.

This study was conducted and reported according to the recommendations outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Page et al. 2021 ant) ]. In addition, the references from narrative reviews or other systematic reviews were cross-checked to identify additional missing publications during the initial search. Studies were eligible for inclusion in our systematic review and meta-analysis if they (1) were observational studies (of any design, for example, case-control, cohort, case series); (2) reported the effectiveness of the BNT162b2 mRNA vaccine to prevent reverse transcription-polymerase chain reaction (RT-PCR) confirmed COVID-19 caused by Delta variant of SARS-CoV-2 (B.1.617.2); (3) compared vaccine effectiveness between vaccinated and unvaccinated individuals or between preand post-vaccination; and (4) reported adjusted effectiveness estimates. For two or more studies that utilized the same data source for their investigations on vaccine effectiveness, we included the study that performed analysis with the latest data cut-off date. Studies that utilized surrogate measures of vaccine effectiveness against COVID-19 caused by Delta variant of SARS-CoV-2 by reporting vaccine effectiveness during Delta predominance period were excluded. Studies that reported unadjusted effectiveness estimates, and studies that reported the effectiveness of the vaccine to prevent COVID-19-related mortality or COVID-19-related hospitalization were also excluded. We did not include preprints editorials, commentaries, and narrative reviews.

The outcome of interest, namely vaccine effectiveness, was defined as a relative risk reduction in RT-PCR confirmed COVID-19 caused by Delta variant in vaccinated individuals (post-vaccination) compared with unvaccinated individuals (pre-vaccination) (Weinberg and Szilagyi 2010) . All relevant information from the eligible studies was extracted and recorded in a pre-determined data collection table. The following information was extracted from each included study: first author's surname, year of publication, study design, country where the study was performed, number of participants, the incidence/ frequency of COVID-19 in both vaccinated and unvaccinated individuals, adjusted effectiveness estimates, and covariates adjusted in the study. Newcastle-Ottawa Scale was used for critical appraisal of the quality of included observational studies. Two investigators (CSK and SSH) independently evaluated the quality of studies with the Newcastle-Ottawa Scale (Wells et al. 2013 ) and a Newcastle-Ottawa Scale of at least 8, indicating high quality. Consensus discussions between the two investigators were carried out to resolve disagreements on the inclusion of studies, extraction of study characteristics, and quality appraisal of included studies.

A random-effects model was used to estimate the pooled odds ratio (OR) for the occurrence of COVID-19 caused by Delta variant between vaccinated and unvaccinated individuals, at 95% confidence intervals, when three or more studies were reporting the same type of effect measure (either odds ratio or hazard ratio [HR]). We examined the heterogeneity between studies using the I 2 statistics and the χ 2 test, with 50% and p < 0.10, respectively, were considered as an indication of the presence of heterogeneity. The vaccine effectiveness was indicated as (pooled HR − 1)/HR or (pooled OR − 1)/OR, together with a 95% confidence interval. All analyses were performed using Meta XL, version 5.3 (Epi-Gear International, Queensland, Australia).

Our literature search yielded 4441 records. After deduplication and application of eligibility criteria, 14 relevant articles were shortlisted for inclusion through full-text examination ( Tang et al. 2021 ) are deemed moderate-to-high quality with a Newcastle-Ottawa Scale ranging from 7 to 8 (Table 1) .

The meta-analysis performed using the data extracted from three studies (Martínez-Baz et al. 2021; Nasreen et al. 2021; Tang et al. 2021 ) revealed a significant protective effect produced by the first dose of BNT162b2 mRNA vaccine (after 14 days or more) against SAR-CoV-2 infection caused by the Delta variant (pooled OR 0.42; 95% confidence interval 0.36-0.49; I 2 = 0%; p = 0.63; Fig. 2 ). The pooled estimate shows vaccine effectiveness of 58% (95% confidence interval 51-64%). Similarly, the meta-analysis of two studies ( with vaccine effectiveness of 55% (95% confidence interval 46-63%).

With the second dose of the BNT162b2 mRNA vaccine, our meta-analysis of six studies (Andrews et al. 2021; Martínez-Baz et al. 2021; Nasreen et al. 2021; Sheikh et al. 2021; Skowronski et al. 2021; Tang et al. 2021) documented an even higher significant protective effect measured at 14 days or more post second dose (pooled OR 0.19; 95% confidence interval 0.12-0.31; I 2 = 97%; p = 0.01; Fig. 3) , where the pooled estimate shows vaccine effectiveness of 81% (95% confidence interval 69-88%). Thus, there is adequate evidence against our model hypothesis of 'no significant protective effect' against SAR-CoV-2 infection caused by the Delta variant, at the current sample size.

Based on the findings, it appears that the BNT162b2 mRNA vaccine still offers substantial protection against RT-PCR confirmed COVID-19 caused by the Delta variant in the real-world settings, in which partial vaccination (21 days or more after the first dose) reduced the risk of acquisition of COVID-19 caused by the Delta variant by 55%, while full vaccination (14 days or more after the second dose) reduced the risk of acquisition of COVID-19 caused by the Delta variant by 81%. Nevertheless, the protection rate was slightly lower than previously reported in a meta-analysis of real-world studies (Kow et al. 2021 ) conducted before the Delta predominance period; 55% versus 57% upon partial vaccination and 81% versus 88-96% upon full vaccination.

The reduced effectiveness of the BNT162b2 mRNA vaccine against RT-PCR confirmed COVID-19 caused by the Delta variant relative to other strains of SARS-CoV-2 is most possibly due to the Delta variant notably escapes neutralizing antibodies elicited by vaccination. Previously, in vitro study (Planas et al. 2021) has reported that antibodies elicited by the BNT162b2 mRNA vaccine were efficacious against the Delta variant but about three-to five-fold less potent than they were against the alpha variant (B.1.1.7). It is foreseeable since the BNT162b2 mRNA vaccine encodes an optimized SARS-CoV-2 full-length spike glycoprotein. At the same time, the Delta variant is characterized by the spike glycoprotein mutations T19R, Δ157-158, L452R, T478K, D614G, P681R, and D950N, which contribute to the regulation of spike glycoprotein dynamics (Kannan et al. 2021 This systematic review and meta-analysis have its limitations: first, only a small number of studies (7 out of 2258 studies screened) were available for inclusion in this systematic review and meta-analysis, and second, all of the included studies in this systematic review and meta-analysis were of the retrospective design, which can have an inferior level of evidence compared with prospective studies. However, we believe it is of utmost importance to disseminate our findings at this stage to alleviate the concerns of practitioners and the general public surrounding the protection rate of the BNT162b2 mRNA vaccine amid the Delta predominance period. In addition, our findings can offer valuable insights to the policy-makers regarding the urgency to administer booster vaccine doses.

In conclusion, the BNT162b2 mRNA vaccine offers a substantial protection rate against RT-PCR confirmed COVID-19 caused by the Delta variant upon full vaccination, albeit with slightly reduced effectiveness relative to other strains of SARS-CoV-2. Therefore, measures should be taken to hasten the global vaccination efforts to curb COVID-19 transmission, which may drive future emergence of variants of concern, and to perform more investigations on the vaccine adjuvants, which can boost longer-lasting immune response upon vaccination. With our current findings and due to emergence of Omicron variant of SARS-CoV-2, we believe that a booster or a third dose of BNT162b2 mRNA vaccine should be considered, and should prioritize those above 65 years old, 18-64 years old with underlying medical condition, and immunocompromised individuals, who are more prone to severe course of COVID-19. (14) S k ow ronsk i et al, Q ue bec C anada (14) N asreen et al, C an ada (7) N asreen et al, C anada (14) A ndrew s et al, E ngla nd (14) 14 day s or m ore subgroup 

and spikevax against mild and severe COVID-19 in the UK. medRxiv

Impact of the Delta variant on vaccine efficacy and response strategies

Characterisation of vaccine breakthrough infections of SARS-CoV-2 Delta and Alpha variants and withinhost viral load dynamics in the community

Lifting of COVID-19 restrictions in the UK and the Delta variant

Evolutionary analysis of the delta and delta plus variants of the SARS-CoV-2 viruses

Real-world effectiveness of BNT162b2 mRNA vaccine: a meta-analysis of large observational studies

Working Group for the Study of COVID-19 in Navarre; Investigators, other members of the Working Group for the Study of COVID-19 in Navarre (2021) Product-specific COVID-19 vaccine effectiveness against secondary infection in close contacts

Effectiveness of COVID-19 vaccines against variants of concern

The PRISMA 2020 statement: an updated guideline for reporting systematic reviews

Reduced sensitivity of SARS-CoV-2 variant Delta to antibody neutralization

Public Health Scotland and the EAVE II Collaborators (2021) SARS-CoV-2 Delta VOC in Scotland: demographics, risk of hospital admission, and vaccine effectiveness

Two-dose SARS-CoV-2 vaccine effectiveness with mixed schedules and extended dosing intervals: test-negative design studies from British Columbia and Quebec, Canada

BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the Delta (B. 1.617. 2) variant in Qatar

Six-month effectiveness of BNT162B2 MRNA COVID-19 vaccine in a large US integrated health system: a retrospective cohort study

Vaccine epidemiology: efficacy, effectiveness, and the translational research roadmap

The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses