key: cord-0956053-54ssfdli authors: Albuquerque, A. M.; Tramujas, L.; Sewanan, L. R.; Brophy, J. M. title: Tocilizumab in COVID-19 - A Bayesian reanalysis of RECOVERY date: 2021-06-21 journal: nan DOI: 10.1101/2021.06.15.21258966 sha: c8284f200d128bf42608e985800fbabf6dc285e5 doc_id: 956053 cord_uid: 54ssfdli Background: Randomised Evaluation of COVID-19 Therapy (RECOVERY) demonstrated that tocilizumab reduces mortality in hospitalized COVID-19 patients. However, substantial uncertainty remains whether tocilizumab's effect is similar across clinically relevant subgroups. Whether this uncertainty can be resolved with Bayesian methods is unknown. Design, Setting, Participants, and Interventions: RECOVERY was a controlled, open-label, platform UK trial that randomized (1:1) 4116 adults with oxygen saturation <92% on room air or receiving oxygen therapy with C-reactive protein [≥]75 mg/L to either usual care or tocilizumab plus usual care. Main outcome measures: Mortality and hospital discharge within 28 days. Methods: Using Bayesian methods, we combined RECOVERY with evidence-based priors incorporating previous COVID-19 tocilizumab RCTs. The probability of tocilizumab's benefit for respiratory support and corticosteroid subgroups and sensitivity analyses were performed with different prior distributions and baseline risks. Results: For all-cause mortality, the posterior probabilities of decreased deaths with tocilizumab were >99% and 19% in patients using and not using corticosteroids, respectively. In patients on simple oxygen only, non-invasive ventilation and invasive mechanical ventilation, the probabilities of decreased mortality were 96%, >99% and 77%, respectively. The probabilities for a clinically significant mortality reduction, as assessed by an absolute risk difference > 3% (number needed to treat [≤] 33), were 77%, 96%, 56%, respectively. Sensitivity analyses highlighted the uncertainty and lack of conclusive evidence for tocilizumab's effect in patients on invasive mechanical ventilation and those without concurrent corticosteroids. Posterior probabilities of benefit for hospital discharge outcome were high and consistent across most subgroups. Conclusions: In this Bayesian reanalysis, COVID-19 hospitalized patients exposed to corticosteroids or on non-invasive ventilation have a high probability of a clinically meaningful mortality benefit from tocilizumab. Tocilizumab also likely improves discharge from hospital in most subgroups. Future research should further address if patients on invasive mechanical ventilation can also benefit from tocilizumab. The Randomised Evaluation of COVID-19 Therapy (RE-COVERY), a large, open-label, platform, randomized controlled trial (RCT), compared tocilizumab to usual care in patients hospitalized with COVID-19. [1] Results showed a benefit for the primary outcome, mortality reduction at 28 days. Further the authors report that "consistent results were seen in all prespecified subgroups of patients, including those receiving systemic corticosteroids" and "regardless of the amount of respiratory support." The ability to provide reliable subgroup analyses is of obvious importance in enhancing personalized clinical decision-making. [2] RECOVERY was designed and analyzed following the standard null hypothesis significance testing (NHST) paradigm. However, the limitations of NHST evaluating RCTs, particularly for subgroup analyses, have been long recognized. [3] Moreover, given that subgroup differences were assessed with low-powered interaction tests, the conclusion of consistent results across all patients may be questioned and could profit from further analyses. [2] Bayesian methods have been proposed as an alternative that may permit additional insights. [4] [5] [6] In brief, Bayesian analyses can increase power by incorporating evidence from other RCTs; avoid the nullism, dichotomization, and statistical reification of NHST and directly answer the clinical question of interest: what is the probability of tocilizumab's effect in each pertinent subgroup? [7, 8] These features may contribute to a more thorough understanding of RCT results, such as those in the RECOVERY trial. Herein, we re-analyze the tocilizumab data using Bayesian methods with a primary goal of providing an enlightened appreciation of the results and the reliability of specific subgroup conclusions. ORCIDs: Arthur M. Albuquerque ; Lucas Tramujas ; Lorenzo R. Sewanan ; James M. Brophy Corresponding author: James M. Brophy; @brophyj; james.brophy@mcgill.ca Funding: JMB is a research scholar supported by Les Fonds de Recherche Québec Santé which had no influence on the choice of topic, the results or conclusions. Role of the funding source: There was no specific funding dedicated to this project. Contributorship statements: AMA conceived the study, wrote the protocol, collected the data, wrote the statistical code, interpreted the findings, and wrote the manuscript. LT collected the data, interpreted the findings, and wrote the manuscript. LRS collected the data and critically revised the manuscript. JMB revised the protocol and the statistical code, interpreted the findings, and wrote the manuscript. RECOVERY was a multi-center, open-label, platform RCT designed to evaluate different drugs, including tocilizumab, in patients hospitalized with COVID-19. In National Health Service hospitals in the UK, 4,116 adults with oxygen saturation <92% on room air or receiving oxygen therapy and with C-reactive protein ≥75 mg/L were randomized to either usual care or tocilizumab plus usual care in a 1:1 ratio. The primary outcome was 28-days all-cause mortality, and the main secondary outcomes were time to discharge from hospital, discharge from hospital within 28 days and, among patients not receiving invasive mechanical ventilation at randomization, a composite outcome of invasive mechanical ventilation or death. RECOVERY was designed, with 90% power and alpha = 0.01, to detect a 5% absolute risk reduction assuming a control mortality risk of at least 25%. We analyzed both mortality and discharge from hospital within 28 days (hereafter, mortality and hospital discharge) outcomes, focusing on two clusters of clinically pertinent subgroups. First, we analyzed the effect of tocilizumab as a function of adjunctive therapy, specifically whether corticosteroids were used or not during the follow-up period. Second, we analyzed the effect of tocilizumab as a function of baseline respiratory disease severity as defined by the RECOV-ERY trialists: simple oxygen only; non-invasive ventilation, including patients on high−flow nasal oxygen, continuous positive airway pressure ventilation or other non−invasive ventilation; and invasive mechanical ventilation at randomization. Bayesian analysis consists of updating prior beliefs with the current RECOVERY data (likelihood) to form a posterior distribution which allows one to make direct probability statements about the treatment effect by calculating the area under the curve. [8] One can calculate not only the probability of any benefit but also of clinically meaningful benefits. In the Bayesian framework, repeated analyses of the same data are not associated with the well-known multiplicity issues of frequentist analyses. [3] We used medians and 95% highest density intervals, defined by the narrowest interval containing 95% of the probability density function, to describe our posterior distributions. [9] While the above calculations follow the laws of probability, the most contentious issue of a Bayesian analysis is the choice of priors whose potential subjective nature is often portrayed as its Achilles heel. There are multiple ways of eliciting priors, [10] and to remain objective we used data from other tocilizumab COVID-19 RCTs to create evidencebased priors for each corresponding subgroup. Priors were formed by extracting the number of events and sample sizes from applicable tocilizumab RCTs included in a weekly updated systematic living review. [11] The last update of our analysis was on June 12 th , 2021. Further details about the data extraction process can be found in the Supplementary Material. Our estimands are expressed as risk differences (RD), chosen for their clinical decision-making utility. [2] We estimated the posterior probabilities of benefit for multiple RD thresholds, including RD >0%, >1%, >2%, and >3%, the later three equivalent to the numbers needed to treat (NNT) of 100, 50, and 33, respectively. We derived RDs from the odds ratio. [12] Posterior distribution calculations for each subgroup and outcome followed a stepwise approach. First, we pooled data from similar studies with a random-effect meta-analysis using a restricted maximum-likelihood estimator to create evidence-based priors. Next, we estimated the log-odds ratio of the RECOVERY and using conjugate normal analysis combined this with the evidence-based priors to determine the log-odds posterior distributions. [8] Next, we drew and exponentiated 100,000 samples from the posterior distributions to change to an odds ratio scale. Lastly, RDs were derived, where the baseline risk was the RECOVERY control arm for that specific subgroup. [5] We performed sensitivity analyses to test the robustness of our results. As there is no one "correct" prior, we followed previously published recommendations for prior selections, [8, 13] and tested four different mortality prior distributions: non-informative, skeptical, optimistic, and pessimistic. The high variance for the non-informative prior, despite recognized limitations, [8] allows a posterior distribution dominated by RECOVERY data. The skeptical prior reflects clinical equipoise, promoting shrinkage towards null effect and thereby tempers researcher overenthusiasm. The optimistic prior was chosen to reflect the RECOVERY design projection of a 20% relative risk reduction. [1] Lastly, as proposed by recent recommendations, [13] a pessimistic prior reflecting a belief that tocilizumab could possibly cause harm due to, for example, increased secondary infections, was considered. Consequently, we chose the following means for our sensitivity priors; i) non-informative and skeptical priors' mean log-odds = 0 ( = log[OR=1]), ii) optimistic prior mean = −0.223 ( = log[OR=0.8] ) and iii) pessimistic prior mean = 0.223 ( = log[OR=1.25], reciprocal of the optimistic prior). We assumed these log priors to be normally distributed with variance equal to the evidence-based priors' variance of each respective subgroup. The non-informative prior is an exception, which assigned a variance of 10,000. Regarding the sec-ondary hospital discharge outcome, an odds ratio greater than one means benefit, so while we used the same prior means, their signs were reversed. We used the same evidence-based variances for this secondary outcome. A final sensitivity analysis involved varying the baseline risk, since a RD limitation is its strong dependence on the baseline risk. As mentioned above, our baseline analysis used the observed RECOVERY control arm risk. To test how our posterior distributions with evidence-based priors vary with different baseline risks, we estimated the risk differences with forty different baseline risks (spanning +-20% change from the original risk) for each subgroup. We pre-registered our data analysis and extraction protocol before any analyses were performed. [14] We had planned to analyze subgroup outcome data as a function of time from symptom onset but abandoned this due to a lack of objective prior evidence. We added two additional analyses to our original protocol: 1) corticosteroids subgroup analysis, [15] and 2) sensitivity analyses with different baseline risks. [5] All analyses were conducted in R (R Environment version 4.0.4). The data and full analysis code are available at https://bit.ly/3xnTJSV. This study was exempt from obtaining formal institutional review board approval and the requirement to obtain informed patient consent because it is secondary research of publicly available data sets. There were ten potential RCTs to be incorporated for evidence-based prior distributions, [16] [17] [18] [19] [20] [21] [22] [23] [24] [25] but one had highrisk of bias and five failed to report the required subgroup analyses and thus are not included in this analysis. [18, 19, [21] [22] [23] 25] RECOVERY mortality results were extracted from the peer reviewed publication, [1] and are presented in Table 1 as a function of baseline disease severity as determined by respiratory status and as a function of adjunctive corticosteroids therapy. Results from our search for prior tocilizumab mortality evidence is also presented in Table 1 . [16, 17, 20, 24] The data extraction processes and additional clinical details for each trial are shown in the Supplementary Material. Figure 1 and Supplementary Table 1 show the estimated evidence-based prior, RECOVERY data (likelihood), and posterior distributions on tocilizumab's effect for each subgroup. Although multiple studies are available to compute the prior distribution, RECOVERY provided a notably greater amount of evidence for all subgroups as witnessed by the close approximation of the RECOVERY and the final posterior distributions. As expected, the addition of the RECOVERY data has greatly improved the precision of our . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) prior estimates of tocilizumab's effect as seen by the narrowing of the posterior distributions. Examining the specific clinical subgroups, the benefit of tocilizumab is especially evident for patients using corticosteroids and those not requiring invasive ventilation. Figure 2 and Supplementary Table 2 show the posterior distributions and probabilities for each subgroup using the evidence-based priors on the risk difference scale. In patients not using corticosteroids, the median risk difference was -2.8 (95% highest density interval [HDI], -9.2 to 3.5) and the posterior probability of a risk difference benefit (≥ 0%) was only 18.9% (Figure 2A shaded dark blue area). In patients using corticosteroids, the median risk difference was 5.8 (95% HDI, 2.8 to 8.6) and the posterior probability of a risk difference benefit was >99% (Figure 2A shaded light blue area). Cumulative posterior probability distributions as a function of varying risk differences are shown in Figure 2B . Importantly, there is an approximately 96% probability that the tocilizumab benefit is at least 3 lives saved (NNT ≤ 33) among patients receiving corticosteroids (Supplementary Table 2 ). In patients on simple oxygen only, non-invasive ventila-tion, and invasive mechanical ventilation, the risk differences were 3.3 (95% HDI, -0.2 to 6.7), 5.7 (95% HDI, 1.7 to 9.6), and 2.5 (95% HDI, -4.1 to 8.9), respectively (Supplementary Table 2 ). The posterior probabilities of a risk difference benefit were 96.2%, >99%, and 77.3% ( Figure 2C ). The posterior probabilities for benefits as large as 3% risk difference (NNT ≤ 33) were 57%, 90.6%, and 44% in patients on simple oxygen, non-invasive ventilation, and invasive ventilation, respectively ( Figure 2D ). The robustness of Figure 2 results to the choice of priors, graphically displayed in Supplementary Figure 1 , is demonstrated graphically in Figure 3 and numerically in Supplementary Table 3 . For example, even with a skeptical prior, there was a > 94% probability of tocilizumab benefit for the corticosteroid, simple oxygen, and non-invasive ventilation subgroups. Similarly, the lack of clear tocilizumab benefit for the non-corticosteroid and invasive ventilation subgroups were not substantially modified by the choice of different priors. For example, the posterior probability for any benefit among the invasive mechanical ventilation subgroup ranged from 38% with the pessimistic prior distribution to only 83% with the optimistic prior (Supplementary Table 4 ). Moreover, . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) the posterior probabilities of a substantial clinical benefit (> 3% risk difference [NNT < 33]) for this subgroup remained modest at 44% for the evidence based and 52.6% for the optimistic prior, respectively. Figure 4 shows the posterior probabilities for the different subgroups as a function of sensitivity analyses with different baseline risks. The posterior probabilities for any benefit (risk difference ≥ 0%) did not change regardless of the baseline risk in all subgroups. Patients using corticosteroids ( Figure 4B ) or on non-invasive ventilation ( Figure 4D ) were particularly insensitive to baseline risks with posterior probabilities of >90% for benefits as large as 2%, provided the baseline risk remained above 15% and 22%, respectively. Overall, there was > 95% posterior probabilities of > 2% absolute difference in earlier hospital discharge for patients receiving corticosteroids and for those receiving simple oxygen or non-invasive ventilation therapy. These results were robust while using different prior distributions. Extensive details can be found in the Supplementary Material (Supple-mentary Tables 5 -8 and Figures 3 -8 ). Herein we report our Bayesian reanalysis of COVID-19 subgroups from the RECOVERY tocilizumab trial using a variety of transparent priors. For the mortality outcome, the posterior probabilities of any benefit (risk difference ≤ 0%) along with evidence-based priors were strikingly different between patients using and not using corticosteroids (>99% versus 19%, respectively). While the point estimates for benefit with tocilizumab were similar across different respiratory risk profiles, the probabilities of clinically meaningful effects varied substantially, perhaps in part due to differences in sample size and statistical power. Patients on non-invasive ventilation showed the largest benefit with tocilizumab and the most certainty of being associated with a clinically meaningful effect, indicated by 90% probability that the risk difference is greater than 3% (NNT ≤ 33) with the evidencebased prior. Patients receiving simple oxygen, also showed a high (>95%) probability of any benefit with tocilizumab but less certainty that the benefit was as large as NNT of 33 . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (< 60%). The least certainty of tocilizumab benefit was seen in the group receiving invasive mechanical ventilation where there was a 77% probability of any benefit but a less than 45% probability that its magnitude was as great as a NNT of 33. Lastly, sensitivity analyses showed that the probabilities of any benefit are consistent between priors and baseline risks across most subgroups. In particular, these analyses highlighted the uncertainty around data on invasive mechanical ventilation and the lack of conclusive evidence in favor of tocilizumab's benefit in this subgroup. In the RECOVERY publication, [1] the authors state for tocilizumab's effect for mortality, "We observed similar results across all prespecified subgroups . . . Given the number of hypothesis tests done, the suggestion of a larger proportional mortality reduction among those receiving a corticosteroid compared with those not (interaction p=0·01) might reflect the play of chance." Here, we present a more in-depth analysis and interpretation of these results, casting doubt about the claim of tocilizumab's universal benefit across sub-. CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. groups. First, we show that posterior probabilities of small and large benefits are robustly different between patients using or not corticosteroids. Second, although point estimates are similar between respiratory support subgroups, the posterior probabilities of larger effect sizes are notably distinct, contradicting RECOVERY's general conclusion applied to all subgroups. Ultimately, we revealed a clear need for more evidence of tocilizumab's benefit in patients on invasive mechanical ventilation. A meta-analysis on COVID-19 evaluated the interaction between interleukin-6 inhibitors, combining both tocilizumab and sarilumab, with disease severity and concomitant corticosteroid use on mortality. [26] By applying a Bayesian hierarchical meta-regression model, they have found that "there was no difference" for these subgroups in the odds ratio scale. On the other hand, we report strikingly different posterior distributions of tocilizumab's effect between the patients using or not corticosteroids and on distinct respiratory support (Figure 1 ). There may be several explanations for this difference in results. First, the previous metaanalysis included a study on sarilumab with 836 patients, mixing different drugs to the same analysis. Second, our analyses included three additional trials. [16, 20, 24] Third and most importantly, different statistical models were used. While they evaluated the interaction between treatment and subgroup class, we separately estimated the posterior distributions for each subgroup. Moreover, we also transformed results to the risk difference scale and performed multiple sensitivity analyses. In summary, our study provides more easily and clinically interpretable results than previous analyses and underscores how tocilizumab can differently benefit subgroups of patients. Previous research on COVID-19 has shown that corticosteroids, when not combined with tocilizumab, also reduce deaths, especially in patients with more severe disease. [27] These results could be explained by the direct association of COVID-19's disease severity with the degree of inflammation. Paradoxically, our results suggest that tocilizumab, also an anti-inflammatory drug, reduces deaths with more certainty and larger effect size in patients with less severe disease than in critically ill patients on invasive mechanical ventilation. Moreover, the low probability of tocilizumab's benefit in patients not using corticosteroids (Supplementary Table 4 ) highlights the essential role of the latter in the treatment of COVID-19. [15] Thus, our results reinforce previous evidence on corticosteroids' efficacy and raise questions about the relationship of anti-inflammatory drugs with the pathophysiology of COVID-19. In addition to reducing deaths, our study suggests that tocilizumab increases hospital discharge rate. Another meta-. CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . Posterior probabilities from sensitivity analyses using multiple different baseline risks on the mortality outcome. Panel A shows results for patients not using corticosteroids; Panel B shows results for patients using corticosteroids. Panel C shows results for simple oxygen only; Panel D shows results for non-invasive ventilation; Panel E shows results for invasive mechanical ventilation. Each line represents the posterior probability of benefit for a specific cutoff, such as risk difference lower to 0%, 1%, 2% and 3%. Vertical black dashed lines represent the respective baseline risk underlying other analyses (Figure 2) , i.e., risk in the control group in the RECOVERY trial for each subgroup (Table 1 ). analysis has found that tocilizumab has little or no benefit in clinical improvement when analyzing pooled results, defined by proxy outcomes such as hospital discharge. [11] In contrast to these results, we found that the posterior probabilities of benefit in clinical improvement are >90% in patients on different respiratory support. There are also >90% posterior probabilities of benefit as large as NNT of 33 in patients on simple oxygen only or on non-invasive ventilation using evidence-based priors (Supplementary Figure 4D) . Our analyses show that these posterior probabilities are stable to the choice of prior, indicating the robustness of our results (Supplementary Table 8 ). Thus, tocilizumab most likely provides a relevant clinical improvement in patients at different clinical severity, except for the invasive ventilation group and the non-corticosteroid users where additional data are needed. Our study has several strengths. Most importantly, Bayesian analyses permit the inclusion of prior beliefs and or prior objective evidence. We only included data from RCTs with a low or moderate risk of bias, as assessed by the living systematic review from which we based our data extraction process. [11] Further, we tried to mitigate potential biases associated with researcher degrees of freedom by pre-registering the data extraction process and part of the analysis plan, [14] and restricting our analyses to RECOV-ERY specified subgroups. Next, in contrast to P-values and confidence intervals, Bayesian analyses can provide intuitive and understandable probability estimates of each subgroup's treatment effect. Moreover, these analyses not only inform the probability of any benefit but also calculation of the probabilities of clinically meaningful benefits. This enhances the readers' ability to distinguish clinical from statistical significance. Lastly, we incorporated most of the high-quality evidence available on tocilizumab and COVID-19 to our prior distributions. Notwithstanding these strengths, our study also has limitations. First, we did not have access to patient-level data for any RCTs included in this article. Subgroup analyses that separate patients by a single baseline characteristic are oversimplified and can bring shortcomings. [2] Lack of patientlevel data does not allow analyses using more complex statistical models that incorporate multiple characteristics. [28] Second, our Bayesian analyses were not planned when the RECOVERY was published and thus must be interpreted as exploratory. Third, is the classical argument of Bayesian subjectivity due to the need for priors. [29] Although we agree with need for transparency and caution in the choice of priors, the synthesis of objective prior evidence with current data is likely to furnish the most accurate and least biased treatment estimates. Bayesian analyses are not necessarily more subjective than frequentist methods, simply more explicit about the underlying assumptions. By using mul-tiple priors, incorporating data from previously published RCTs, following recent recommendations for Bayesian analyses, [13] and explicitly stating how our priors are defined, we argue that Bayesian analyses are, in fact, more transparent and robust than usual analyses. Fourth, we limited our focus to benefit-related outcomes and did not analyze results regarding adverse effects. Fifth, because there was one study with high-risk of bias or we could not extract subgroupspecific data, we did not include a total of four studies that contributed to 46% of weight in the meta-analysis, used as our reference, [11] regarding hospital discharge. [19, 22, 23, 25] Although we could not also include six studies with allcause mortality data, these trials only contributed to less than 7% of weight in the meta-analysis (Supplementary Material). [18, 19, [21] [22] [23] 25] In conclusion, Bayesian methods overcome the standard null hypothesis significance testing limitations by estimating the probability of benefit and harm while incorporating prior evidence. By highlighting the difference between statistically and clinically significant results, Bayesian analyses provide additional insights on traditional RCT subgroup analyses. Specifically, COVID-19 hospitalized patients exposed to corticosteroids have a high probability of a clinically meaningful mortality benefit from tocilizumab. Similarly, tocilizumab offers a high probability of a clinically significant mortality reduction in patients on simple oxygen only or non-invasive ventilation, especially for the latter. Tocilizumab also most likely increases clinical improvement (hospital discharge) in hospitalized COVID-19 patients. Future research should further address if patients on invasive mechanical ventilation can also benefit from tocilizumab. RECOVERY: Tocilizumab in Patients Admitted to Hospital with COVID-19: A Randomised, Controlled, Open-Label, Platform Trial Personalized Evidence Based Medicine: Predictive Approaches to Heterogeneous Treatment Effects Multiplicity in Randomised Trials II: Subgroup and Interim Analyses Bayesian Statistical Inference Enhances the Interpretation of Contemporary Randomized Controlled Trials Extracorporeal Membrane Oxygenation for Severe Acute Respiratory Distress Syndrome and Posterior Probability of Mortality Benefit in a Post Hoc Bayesian Analysis of a Randomized Clinical Trial Bayesian Interpretation of the EX-CEL Trial and Other Randomized Clinical Trials of Left Main Coronary Artery Revascularization Invited Commentary: The Need for Cognitive Science in Methodology Bayesian Approaches to Clinical Trials and Health Care Evaluation Statistical Rethinking : A Bayesian Course with Examples in R and Stan Prior Specification in Bayesian Statistics: Three Cautionary Tales Interleukin-6 Blocking Agents for Treating COVID-19: A Living Systematic Review Questionable Utility of the Relative Risk in Clinical Research: A Call for Change to Practice Using Bayesian Methods to Augment the Interpretation of Critical Care Trials. An Overview of Theory and Example Reanalysis of the Alveolar Recruitment for Acute Respiratory Distress Syndrome Trial Bayesian Reanalysis of RE-COVERY on Tocilizumab and COVID-19: Analysis Plan and Data Extraction Protocol Interleukin-6 Receptor Inhibition in Covid-19 -Cooling the Inflammatory Soup Effect of Tocilizumab vs Usual Care in Adults Hospitalized With COVID-19 and Moderate or Severe Pneumonia: A Randomized Clinical Trial Tocilizumab in Hospitalized Patients with Severe Covid-19 Pneumonia Timely Administration of Tocilizumab Improves Survival of Hospitalized COVID-19 Patients Tocilizumab in Patients Hospitalized with Covid-19 Pneumonia Effect of Tocilizumab vs Standard Care on Clinical Worsening in Patients Hospitalized With COVID-19 Pneumonia: A Randomized Clinical Trial Tocilizumab plus Standard Care versus Standard Care in Patients in India with Moderate to Severe COVID-19-Associated Cytokine Release Syndrome (COVINTOC): An Open-Label, Multicentre, Randomised, Controlled, Phase 3 Trial Efficacy of Tocilizumab in Patients Hospitalized with Covid-19 Tocilizumab Failed to Reduce Mortality in Severe COVID-19 Patients: Results From a Randomized Controlled Clinical Trial. preprint Interleukin-6 Receptor Antagonists in Critically Ill Patients with Covid-19 Effect of Tocilizumab on Clinical Outcomes at 15 Days in Patients with Severe or Critical Coronavirus Disease 2019: Randomised Controlled Trial Drug Treatments for Covid-19: Living Systematic Review and Network Meta-Analysis Association Between Administration of Systemic Corticosteroids and Mortality Among Critically Ill Patients With COVID-19: A Meta-Analysis The Predictive Approaches to Treatment Effect Heterogeneity (PATH) Statement Post Hoc Bayesian Analyses