key: cord-0836379-5ncmy9iw authors: Snow, Timothy Arthur Chandos; Saleem, Naveed; Ambler, Gareth; Nastouli, Eleni; McCoy, Laura E.; Singer, Mervyn; Arulkumaran, Nishkantha title: Convalescent plasma for COVID-19: a meta-analysis, trial sequential analysis, and meta-regression date: 2021-08-30 journal: Br J Anaesth DOI: 10.1016/j.bja.2021.07.033 sha: 5828b1411ebf87cb0cf42a27d73a696f19303fff doc_id: 836379 cord_uid: 5ncmy9iw BACKGROUND: SARS-CoV-2-specific antibodies, particularly those preventing interaction between the viral spike receptor-binding domain and the host angiotensin-converting enzyme 2 receptor, may prevent viral entry into host cells and disease progression. OBJECTIVE: We performed a systematic review, meta-analysis, trials sequential analysis (TSA) and meta-regression of randomized control trials (RCTs) to evaluate the benefit of convalescent plasma for COVID-19. The primary outcome was 28-30-day mortality. Secondary outcomes included need for mechanical ventilation and intensive care (ICU) admission. DATA SOURCES: PubMed, Embase, MedRxiv, and the Cochrane library on 2nd July 2021. RESULTS: Seventeen RCTs were identified recruiting 15,587 patients with 8027 (51.5%) allocated to receive convalescent plasma. Convalescent plasma use was not associated with a mortality benefit (24.7% vs. 25.5%; OR 0.94 (0.85 – 1.04); p = 0.23; I(2) = 4%; TSA adjusted CI 0.84 – 1.05), or reduction in need for mechanical ventilation (15.7% vs. 15.4%; OR 1.01 [0.92 – 1.11]; p = 0.82; I(2) = 0%; TSA adjusted CI 0.91 – 1.13), or ICU admission (22.4% vs. 16.7%; OR 0.80 (0.21 – 3.09); p = 0.75; I(2) = 63%; TSA adjusted CI 0.0 – 196.05). Meta-regression did not reveal any association with titre of convalescent plasma, timing of administration, nor risk of death and treatment effect (p>0.05). Risk of bias was high in most studies. CONCLUSIONS: In patients with COVID-19, there was no clear mortality benefit associated with convalescent plasma. In patients with mild disease, convalescent plasma did not prevent either the need for mechanical ventilation or ICU admission. PROSPERO REGISTRATION: CRD42021234201. Illness severity associated with SARS-CoV-2 is unpredictable, ranging from asymptomatic infection to acute respiratory distress syndrome, multiorgan failure, and death . 1, 2 By April 2021, COVID-19 has claimed over 2.8 million deaths worldwide. 3 Most proposed therapeutic strategies for COVID-19 have either targeted viral clearance or mitigating the excessive host inflammatory response associated with multiorgan failure and death. 4 SARS-CoV-2-specific antibodies, particularly those preventing viral spike receptor-binding domain (RBD) interaction with the host angiotensin-converting enzyme 2 (ACE2) receptor, can neutralize the virus. 5 The theoretical benefits of convalescent plasma in COVID-19 are supported by the association of its use during SARS coronavirus infection and a reduction in mortality, albeit limited to observational data. 6 Any potential benefits conferred by convalescent plasma in COVID-19 disease therefore require evaluation. We performed a systematic review, meta-analysis, and trial sequential analysis of randomized controlled trials of convalescent plasma in the treatment of COVID-19. As convalescent plasma may be expected to provide most benefit in those at greatest risk of death, we also performed a metaregression to investigate the relationship between treatment effect and overall risk. We further evaluated whether administration of convalescent plasma earlier in the disease course, or plasma containing higher titre antibodies, was associated with a mortality benefit. This review was registered with the international Prospective Register of Systematic Reviews (PROSPERO registration number: CRD42021234201) and is reported adhering to the Preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines (Supplementary Information). PubMed, Embase, MedRxiv, and the Cochrane library were systematically searched using a controlled vocabulary (MeSH) and keywords without date or language restrictions. The last search update was on 2nd July 2021. The Boolean search strategy was as follows: ((COVID-19 OR SARS-CoV-2) AND (convalescent plasma OR convalescent serum OR serotherapy OR passive immunization OR convalescence OR immunoglobulin OR IVIG OR antibody* OR monoclonal OR polyclonal OR recombinant) AND (clinical trials OR randomized trials OR randomised trials OR RCTs)). The control group was not defined in our search terms. Research papers and review articles were hand-searched for any further relevant trials. Inclusion and exclusion criteria were determined a priori. All trials comparing convalescent plasma or plasma products with either a placebo or standard care control group were considered. We included patients being treated with other COVID-19 therapies (co-interventions), details of which are provided in Supplementary Information. Non-randomized clinical trials and paediatric populations were excluded. J o u r n a l P r e -p r o o f Titles and abstracts were independently screened by two investigators (NS, TS) to exclude nonrelevant trials with any discrepancies resolved by a third (NA). Any relevant full-text articles were retrieved and analysed for eligibility using the pre-defined inclusion criteria. The same authors performed subsequent data collection and analysis independently with discrepancies resolved by the same third author. Using a standardised data collection form, information was extracted from the selected trials. Data included country of trial, total number of participants, trial design, age of patients, number of patients admitted to intensive care, number of patients requiring mechanical and/or non-invasive ventilation, and number of patients who died. For patients in the treatment arm, details were collected on the timing of convalescent plasma therapy with regard to symptom onset, dose and duration of convalescent plasma, and antibody titre. The primary outcome was mortality. Where available, 28 or 30-day mortality were analysed. Secondary outcomes included progression to severe disease defined as a requirement for mechanical ventilation or intensive care admission. As convalescent plasma administration may be expected to provide most benefit in those at the greatest risk of death, we also performed a metaregression to investigate the relationship between treatment effect and overall risk of death, as defined by the control group mortality. Additionally, the effect on mortality of time from symptom onset to administration of convalescent plasma, and the level of neutralising antibody titre within administered convalescent plasma, were also assessed. To ascertain whether administration of convalescent plasma was associated with any clinical benefit after the onset of critical illness, we performed subgroup analysis on patients admitted to the ICU at time of enrolment, and on those patients receiving respiratory support at the time of trial enrolment. The Cochrane Collaboration tool for assessing risk of bias (RoB2) 7 was used to assess the methodological quality of the randomized control trials. This included the following domains: randomisation process, assignment to intervention, missing outcome data, measurement of outcome, selection of the reported result, other bias and overall bias. The risk of bias in each domain was judged as either low, high, or unclear. The Grading of Recommendation Assessment, Development, and evaluation approach (GRADEpro Guideline Development Tool. McMaster University, 2015) 8 was used to assess the quality of each outcome measure. The quality of evidence was downgraded based on the following assessments: risk of bias, inconsistency, indirectness, imprecision, and other considerations. A funnel plot and Harbord's test were used to assess publication bias. 9 The overall quality of evidence was subsequently rated as high, moderate, low or very low. individual trial data were combined for mortality using Mantel-Haenszel models with the reference group taken as the group randomized to standard care or placebo. The meta-analysis was performed using Revman for Windows (version 5.1, Cochrane Collaboration, Oxford, UK). Statistical heterogeneity was assessed using the I 2 methodology. I 2 values ˃30%, >50% and >75% indicated moderate, substantial, and considerable heterogeneity among trials, respectively. A random-effects model was used to analyse data. All p values were two-tailed and considered statistically significant if <0.05. Data on dichotomous outcomes are presented as odds ratio (OR), 95% confidence intervals, p-values; I 2 values. Meta-regression was performed using Stata version 16.1 (StataCorp, College Station, TX, USA). Trial Sequential Analysis (TSA) was performed using TSA program version 0·9·5·10 (www.ctu.dk/tsa) as type 1 errors may occur in meta-analyses with sample sizes that are too small. TSA tests the credibility of the meta-analysis results by combining an estimate of the required information size calculated from the cumulative sample size of included trials, with an adjusted threshold for statistical significance. Meta-analysis monitoring boundaries (Trial Sequential Monitoring Boundaries) and the required information size (RIS) were quantified, alongside diversity adjusted information size (D 2 ) and adjusted 95% confidence intervals. Diversity adjustment was performed according to an overall type I error of 5% and power of 80%. RIS was calculated using a Relative Risk Reduction (RRR) of 31.5%, based on use of convalescent plasma in influenza A 10 and the control event proportion obtained from our actual meta-analysis. The final protocol differed from the published PROSPERO protocol in the following ways: a random effects model was used rather than a fixed effects model due to the number of studies identified but included fixed effects as an additional sensitivity analysis. An additional sensitivity analysis was performed on trials in which the control group only received standard care. In addition to predefined primary and secondary outcomes, the odds of adverse events associated with the administration of convalescent plasma were also evaluated. Subgroup analysis was not performed on patients on respiratory support at enrolment as this data was not available. The RRR used for TSA analysis was incorrectly stated in the protocol as 26.6%, the correct RRR of 31.5% was therefore used instead. The search strategy identified 3493 articles. 3093 articles remained following removal of duplicates and a further 3060 were excluded based on title/abstract alone. Of the remaining 33 trials, 14 were excluded at full review; nine were non-randomized, [11] [12] [13] [14] [15] [16] [17] [18] [19] three used a non-convalescent plasma product, [20] [21] [22] one had an overlapping data set, 23 and one randomized to early or late convalescent plasma. 24 Two trials administered neutralizing monoclonal antibodies. 25, 26 As there were no primary outcome events (mortality) in one of the two trials, 25 we were unable to perform a meta-analysis on monoclonal antibodies in COVID-19. All analyses were therefore limited to the 17 trials that used convalescent plasma for COVID-19 disease. 27-43 ( Figure 1 ) Ten trials enrolled patients requiring advanced respiratory support including mechanical ventilation, 29, 31, 32, 36-42 Seven trials enrolled patients on non-invasive ventilation (NIV), 31, 32, 39-43 and 12 trials enrolled patients on high flow nasal oxygen (HFNO). 31-37, 39-43 (Table 1 and Supplemental Table 1 ) Convalescent plasma was administered either as three doses on days 1, 3 and 5 in one study, 42 two doses ranging from 200-250 ml 30, 33 12 hours apart in one trial 40 or 24 hours apart in six trials, 28, 30, 33-35, 38, 41 or as a single dose ranging from 100-600 ml in six trials. 27, 29, 31, 32, 36, 37, 39, 43 Additional COVID-19 directed co-interventions used in the identified trials are listed in Supplemental Table 2 . The control group were administered either a normal saline placebo in two trials, 31, 35 nonconvalescent plasma in two trials, 37, 39 or intravenous immunoglobulin (IVIG) in one trial. 41 The remaining 12 trials were open label. The 17 selected trials included 15,587 patients with 8027 (51.5%) allocated to the convalescent plasma arm and a mean weighted mortality of 25.1%. Mortality was defined at 21 42 or 25 days 31 in two trials and 28-30 days in the remaining trials. There was no evidence of a mortality benefit with convalescent plasma therapy compared to standard care (24.7% vs. 25.5%; OR 0.94 (0.85 -1.04); p = 0.23; I 2 = 4%; TSA adjusted CI 0.84 -1.05). The cumulative Z-curve crossed neither the conventional nor the TSA boundary for benefit or harm but did cross the boundary for futility having accrued more than the required information size (RIS) cases. (Table 2 and Figure 2 ) At the time of reporting of mortality, 30.2% convalescent plasma group patients and 31.3% control group patients were still in hospital. Six trials 33, [37] [38] [39] [40] 42 reported mortality for patients admitted to the ICU at enrolment including 13,291 (51.1%) allocated to the treatment arm with a mean mortality of 24.9%. Convalescent plasma treatment was not associated with a mortality benefit in ICU patients (24.6% vs. 25.3%; OR 0.91 [0.75-1.09] p=0.31; I 2 =39%). Meta-regression was used to assess the relationship between antibody titre and treatment effect. Six trials measured neutralising antibody titres 27, 30, 37-39, 42 and five trials measured IgG levels. 28, 31, 32, 35, 36 There was no evidence of association between treatment effect (logOR) and log-concentration of neutralising antibodies (p=0.45; I 2 =0%) or IgG (p=0.30; I 2 =0%). Additionally, there was no evidence of a relationship between treatment effect and time from symptom onset to administration of convalescent plasma and mortality (p=0.27; I 2 =16%), or between treatment effect and risk of death and mortality (p=0.27; I 2 =7%). A sensitivity analysis performed on the primary outcome of 28-30-day mortality using a fixed effects model revealed no mortality benefit with convalescent plasma therapy compared to standard care (24.7% vs. 25.5%; OR 0.96 [0.89 -1.03); p = 0.23; I 2 = 4%; TSA adjusted CI 0.88 -1.04). An additional sensitivity analysis was performed excluding the three studies which administered either non-convalescent plasma 37, 39 or IVIG as control. 41 Convalescent plasma was not associated with a mortality benefit (24.7% vs. 25.4%; OR 0.96 [0.90 -1.04); p = 0.35; I 2 = 0%; TSA adjusted CI 0.89 -1.04). As the risk of bias was high in most trials, no additional analyses were performed on trials with a low risk of bias. A TSA sensitivity analysis was attempted using the relative risk reduction calculated from our meta-analysis of 3.0%, however this could not be performed as only 8.4% of RIS cases had been accrued. Two trials reported incidence of ICU admission 31, 35 including 308 patients of whom (62.5%) were allocated to the treatment group with a combined incidence of 14%. Convalescent plasma was not associated with a reduction in ICU admission compared to standard care ( -1.13) . The Z-curve crossed neither conventional nor TSA boundary for benefit or harm but did cross the boundary for futility having surpassed the required information size (RIS). (Figure 3) Adverse events 15 trials reported the incidence of total adverse events. 27, 28, 31-43 These included a total population of 15,060 patients with 7782 (51.7%) allocated to the treatment arm and a combined incidence of 56.2%. Convalescent plasma administration was not associated with an increased rate of total adverse events compared to standard care (55.6% vs. 56.8%; OR 1.03 [0.80-1.34] p=0.80; I 2 =28%; TSA adjusted CI 0.72 -1.50). The Z-curve crossed neither conventional or TSA boundary for benefit or harm but did cross the boundary for futility having exceeded the required information size (RIS). (Supplemental Figure 1 ) Additional adverse event analyses can be found in the Supplementary Information. Table 3 ) Inconsistency was not serious excluding 'Need for ICU admission' which was deemed serious due to substantial heterogeneity. Indirectness was deemed not serious. Imprecision was judged as not serious in all domains excluding 'Need for ICU admission' as only 5% of RIS had been accrued. Some evidence of publication bias/small study effects was seen due to asymmetry of the funnel plot (Harbord's test, p = 0.010). The overall quality of evidence on GRADE assessment for our primary and secondary outcomes was marked as 'very low'. (Table 3 and Supplemental Figure 2 ). In patients with COVID-19, use of convalescent plasma was not associated with a mortality benefit. In patients with mild disease, convalescent plasma did not prevent either the need for mechanical ventilation nor ICU admission. A trial sequential analysis suggests futility in continuing trial recruitment. Among patients with mild disease, convalescent plasma was not associated with a reduction in intensive care admission or requirement for advanced respiratory support. No association was seen between the titre of anti-SARS-CoV-2 antibody infused, time from symptom onset to convalescent plasma administration, or risk of death and treatment effect of convalescent plasma. Data on the significance of seroconversion on mortality in COVID-19 are conflicting. Levels of S-and RBD-specific IgG levels are higher in severe/critically ill patients during hospitalization compared to patients with mild or moderate disease. 44, 45 At both early and late timepoints, plasma concentrations of IgA, IgG and IgM antibodies are higher in survivors compared to those who subsequently die. 46 In contrast, other studies suggest that the generation of S-, RBD-, and N-specific IgG occurs one week later in patients with severe/critically ill COVID-19 compared to those with mild/moderate disease, suggesting that early administration of convalescent plasma may benefit patients with more severe disease. 45 The potential utility of endogenous anti-SARS-CoV-2 antibodies in overcoming acute infection with COVID-19 was supported by observational data. Early after symptom onset, levels of anti-N antibodies correlated strongly with disease severity. 44 This may reflect illness severity, with greater antibody production in response to a greater antigen burden. We therefore hypothesised that administration of high-titre convalescent plasma may offer the greatest benefit and that anti-SARS-CoV-2 antibodies would have a beneficial effect on patients at greatest risk of death. However, meta-regression did not reveal any association between the risk of death and mortality benefit of convalescent plasma, nor any association between titre of convalescent plasma and mortality benefit. Indeed, the concept of using convalescent plasma as a means of passive immunisation against COVID-19 was supported by early observational data suggesting administration soon after hospitalization using high-titre anti-spike protein RBD IgG significantly reduced mortality. 47 We were however unable to find any association between timing of convalescent plasma administration with respect to symptom onset and effect on mortality. None of the clinical trials stratified patients based on their levels of circulating anti-SARS-CoV-2 antibody titres before enrolment. A significant proportion of critically ill patients with COVID-19 generate high titres of anti-SARS-CoV-2 antibodies. The benefit of further augmenting this response through administration of convalescent plasma is questionable. It is not known whether early administration of high titre convalescent plasma could play a role in the management of high-risk patients, or in those with a progressively worsening illness trajectory, who lack endogenous anti-SARS-CoV-2 antibodies. Existing data suggest that administration of convalescent plasma is safe with no increase in adverse events; this provides reassurance for ongoing and future clinical trials. We found significant heterogeneity between trials about convalescent plasma titres, doses, and timing of administration. These factors are likely to influence the efficacy of treatment. Furthermore, there is no standardised assay for measurement of neutralising antibodies, and different studies measured different antibodies against COVID-19, limiting the interpretation of impact of antibody titre on outcome. The data in this meta-analysis are heavily weighted by the RECOVERY trial, 38 and interpretation of data is limited due to the high risk of bias in more than half of the trials. A significant number of patients enrolled in the trials had also received various co-interventions including antiviral medications, steroids, and other immunomodulators including tocilizumab. We were unable to correct for this and cannot exclude any interaction with convalescent plasma treatment. It was not possible to evaluate the effect of different dosing strategies on outcome. Nine trials permitted more than one dose of convalescent plasma therapy, 28, 30, 33-35, 38, 40-42 but only two reported outcomes with respect to dose administration. 40, 41 Similarly, the reported incidence of allergic reactions, infections and other complications varied significantly between trials. This may be due to differences in definitions, screening, reporting of complications, and variable patient followup. Whilst TSA suggests futility in ongoing trial recruitment, a smaller clinically relevant effect may still exist which would require further enrolment. Further trial data are required before firm conclusions can be made. This includes longer term outcomes as a proportion of patients remained as inpatients at the data censure cut point. In summary, there was no clear benefit associated with convalescent plasma in COVID-19, with futility in continuing trial recruitment. No association was seen between the titre of anti-SARS-CoV-2 antibody infused, time from symptom onset to convalescent plasma administration, or risk of death and treatment effect of convalescent plasma. Early administration of high titre convalescent plasma to high-risk patients with a progressively worsening illness trajectory who lack endogenous anti-SARS-CoV-2 antibodies requires further attention, as does the use of monoclonal antibodies directed against SARS-CoV-2. b. Trial sequential analysis of mortality in RCTs. Uppermost and lowermost curves represent trial sequential monitoring boundary lines for benefit and harm, respectively. Horizontal lines represent the traditional boundaries for statistical significance. Triangular lines represent the futility boundary. The cumulative Z-curve represents the trial data. A diversity-adjusted required information size (RIS) of 1522 was calculated using =0·05 (two sided), =0·20 (power 80%). Relative risk reduction of mortality reduction was 31.5%. The cumulative Z-curve crosses neither the conventional nor the TSA boundary for benefit or harm, but did cross the boundary for futility having exceed the required information size (RIS) Proportion of asymptomatic coronavirus disease 2019: A systematic review and meta-analysis Clinical efficacy of convalescent plasma for treatment of COVID-19 infections: Results of a multicenter clinical study Life-saving effect of convalescent plasma treatment in covid-19 disease: Clinical trial from eastern Anatolia Convalescent Plasma in COVID-19. Mortality-Safety First Results of the Prospective Multicenter Factors Associated with Good Patient Outcomes Following Convalescent Plasma in COVID-19: A Prospective Phase II Clinical Trial Effect of Convalescent Plasma on Mortality among Hospitalized Patients with COVID-19: Initial Three-Month Experience Safety and Efficacy of Convalescent Plasma for Severe COVID-19: Interim Report of a Multicenter Phase II Study from Saudi Arabia Treatment of COVID-19 Patients with Convalescent Plasma in Houston Convalescent plasma as potential therapy for severe COVID-19 pneumonia Treatment of Severe COVID-19 with Convalescent Plasma in the Bronx The use of intravenous immunoglobulin gamma for the treatment of severe coronavirus disease 2019: a randomized placebo-controlled double-blind clinical trial Intravenous Immunoglobulin Plus Methylprednisolone Mitigate Respiratory Morbidity in Coronavirus Disease Evaluating the effects of Intravenous Immunoglobulin (IVIg) on the management of severe COVID-19 cases: A randomized controlled trial SARS-CoV-2 Neutralizing Antibody LY-CoV555 in Outpatients with Covid-19 Effect of Convalescent Plasma Therapy on Time to Clinical Improvement in Patients With Severe and Life-threatening COVID-19: A Randomized Clinical Trial Efficacy of Convalescent Plasma Therapy compared to Fresh Frozen Plasma in Severely ill COVID-19 Patients: A Pilot Randomized Controlled Trial Randomized controlled trial of convalescent plasma therapy against standard therapy in patients with severe COVID -19 disease A Randomized Trial of Convalescent Plasma in Covid-19 Severe Pneumonia The therapeutic effectiveness of Convalescent plasma therapy on treating COVID-19 patients residing in respiratory care units in Baghdad A randomized, double-blind, controlled trial of convalescent plasma in adults with severe COVID-19 Convalescent plasma in patients admitted to hospital with COVID-19 (RECOVERY): a randomised, controlled, open-label Severe Acute Respiratory Syndrome Coronavirus 2 Convalescent Plasma Versus Standard Plasma in Coronavirus Disease 2019 Infected Hospitalized Patients in New York: A Double-Blind Randomized Trial Convalescent Plasma in Critically ill Patients with Covid-19 Efficacy and safety of convalescent plasma and intravenous immunoglobulin in critically ill COVID-19 patients. A controlled clinical trial High Dose Convalescent Plasma in COVID-19: Results from the Randomized Trial A randomized clinical trial evaluating the immunomodulatory effect of convalescent plasma on COVID-19-related cytokine storm Early Humoral Response Correlates with Disease Severity and Outcomes in COVID-19 Patients Dynamic changes in anti-SARS-CoV-2 antibodies during SARS-CoV-2 infection and recovery from COVID-19 Weak anti-SARS-CoV-2 antibody response is associated with mortality in a Swedish cohort of COVID-19 patients in critical care Significantly Decreased Mortality in a Large Cohort of Coronavirus Disease