key: cord-0805660-7ftu9b9q authors: Martinez-Sanz, J.; Muriel, A.; Ron, R.; Herrera, S.; Perez-Molina, J. A.; Moreno, S.; Serrano-Villar, S. title: Effects of Tocilizumab on Mortality in Hospitalized Patients with COVID-19: A Multicenter Cohort Study date: 2020-06-09 journal: nan DOI: 10.1101/2020.06.08.20125245 sha: 58320d2d67f2b51e2f2296447c85ebdd36936640 doc_id: 805660 cord_uid: 7ftu9b9q Background While there are no treatments with proven efficacy for patients with severe coronavirus disease 2019 (COVID 19), tocilizumab has been proposed as a candidate therapy, especially among patients with higher systemic inflammation. Methods We conducted a cohort study of patients hospitalized with COVID 19 in Spain. The primary outcome was time to death and the secondary outcome time to intensive care unit admission (ICU) or death. We used inverse probability weighting to fit marginal structural models adjusted for time varying covariates to determine the causal relationship between tocilizumab use and the outcomes. Results A total of 1,229 and 10,673 person/days were analyzed. In the adjusted marginal structural models, a significant interaction between tocilizumab use and high C reactive protein (CRP) levels was detected. Tocilizumab was associated with decreased risk of death (aHR 0.34, 95% CI 0.16 to 0.72, p=0.005) and ICU admission or death (aHR 0.38, 95% CI 0.19 to 0.81, p=0.011) among patients with baseline CRP >150 mg/L, but not among those with CRP [≤]150 mg/L. Exploratory subgroup analyses yielded point estimates that were consistent with these findings. Conclusions In this large observational study, tocilizumab was associated with a lower risk of death or ICU or death in patients with higher CRP levels. While the results of ongoing clinical trials of tocilizumab in patients with COVID 19 will be important to establish its safety and efficacy, our findings have implications for the design of future clinical trials and support the use of tocilizumab among subjects with higher CRP levels. There are still no treatments with proven efficacy to prevent mortality in patients with severe coronavirus disease 2019 (COVID- 19) pneumonia. However, various medications such as hydroxychloroquine, azithromycin, and lopinavir/ritonavir have been used off-label worldwide to minimize the impact of the current SARS-CoV-2 pandemic. 1 Tocilizumab is an FDA-approved humanized monoclonal antibody against the soluble interleukin-6 (IL-6) receptor. It is widely used in the treatment of autoimmune disorders such as rheumatoid arthritis or cytokine release syndrome. 2, 3 Tocilizumab has been suggested as an effective treatment for severe COVID-19 pneumonia due to the increased interleukin 6 (IL-6) blood levels in patients with COVID-19 4 and its correlation with a more severe lung damage. 5 Tocilizumab is not currently approved for use by the FDA in COVID-19 patients. No efficacy results from observational studies or clinical trials in this disease have been published, and the available data comes from small studies with surrogate endpoints that are underpowered to detect significant clinical effects or lack a control group. [6] [7] [8] [9] [10] Despite this absence of information, tocilizumab has been widely used due to its potential effect in the treatment of SARS-CoV-2-induced cytokine release syndrome in which IL-6 plays an important role. 5, 11, 12 IL-6 determination is rarely available in clinical settings. However, C-reactive protein (CRP)-an inflammatory biomarker upstream in the IL-6 pathway-, is commonly used to monitor the activity of inflammatory diseases. 13 In attempt to recruit the population with COVID19 with a higher probability to respond, some ongoing clinical trials of tocilizumab have considered heightened high CRP levels as an inclusion criterion (clinicaltrials.gov: NCT04346355 and NCT04356937). Given the urgent need to respond to the COVID-19 pandemic, observational studies are important to evaluate clinical outcomes associated with the medications empirically used to treat COVID-19. However, critical analytical issues, including the risk of immortal time bias and indication bias from time-varying confounding 14 , challenge the validity of observational data in this setting. Here, we investigate the association between tocilizumab use and mortality in a large cohort of hospitalized COVID-19 patients in Spain. We hypothesized that tocilizumab use would be associated with a lower risk of death and influenced by baseline systemic inflammation levels. We used marginal structural modeling to account for baseline and time-varying confounders. We analyzed data from 2,047 subjects included in the HM Hospitales cohort-a multicenter cohort of patients admitted to any of the 17 hospitals in the HM Group in Madrid and diagnosed with COVID-19 from January 31 st to April 23 rd , 2020. HM Hospitales made their anonymous dataset freely accessible to the international medical and scientific community. The dataset includes all available clinical information on patients diagnosed with COVID-19, confirmed by polymerase chain reaction in nasopharyngeal swabs or another valid respiratory sample. The dataset collects the different interactions in the COVID-19 treatment process including detailed information on diagnoses, treatments, admissions, intensive care unit (ICU) admissions, diagnostic imaging tests, laboratory results, discharge or death, and diagnostic and procedural records coded according to the International Statistical Classification of Disease and Related Health Problems (ICD-10) classification. 15 We excluded patients younger than 18 years and those who died or were transferred to another facility within 24 hours after admission to the emergency department. This study was approved by the Ethics Committee at University Hospital Ramón y Cajal (ceic.hrc@salud.madrid.org, approval number 191/20). . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint The primary end point was the time from study baseline to death. The secondary outcome was a composite event including admission to the ICU or death (hereafter ICU/death). Study baseline was defined as the first day of hospitalization. We tested the associations among the preadmission variables with treatment variable by Chi-square tests for categorical variables and Wilcoxon rank sum tests for continuous variables. We calculated the incidence rates of death and ICU/death and compared the time of death or the composite endpoint according to tocilizumab using Kaplan-Meier methods and log-rank tests. We fitted marginal structural models to estimate discrete time hazards of death according to tocilizumab use via an inverse probability treatment weight (IPTW) estimation to account for the non-randomized treatment administration of tocilizumab, baseline confounding, and time-varying confounders. 14, 16 We assumed that once a patient received tocilizumab, they remained on it until the end of follow-up. This assumption helped obtain a conservative estimate of the treatment hazard ratio analogous to intention-to-treat analysis in an unblinded randomized controlled trial. We structured the data set to allow for exposure, outcomes, right-censoring, and time-dependent covariates to change daily after admission. Propensity score logistic models predicted exposure at baseline and censoring over time as a result of recognized confounders of severe COVID-19 17, 18 including age, gender, comorbidities (hypertension, diabetes, ischemic heart disease, kidney disease, congestive heart failure, lung disease), oxygen blood saturation and need for oxygen therapy at baseline, and time-varying parameters of clinical severity (blood pressure, heart rate, total lymphocyte and neutrophil count, lactate dehydrogenase, alanine aminotransferase, urea, D-dimers, and CRP). There were 1,229 subjects in the dataset with the information needed to fit marginal structural models. The characteristics of the individuals not included due to missing data in the information required for the statistical modelling strategy are shown in Table S1 in the Supplement. The main differences between groups in the analyzed population were comparable to those found in the population with missing . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint information. IPTW were stabilized and truncated below the first percentile and above the 99th percentile. The models included a main term for the exposure and a flexible functional form of time, that is, restricted cubic splines with 5 knots set at the first, 25 th , 50 th , 75 th , and 99 th percentiles of the subjects' day of follow-up, and the interaction term between tocilizumab and elevated CRP levels (>150 mg/L, cutoff selected based on the 75 th percentile value, 143 mg/L). The interaction term between tocilizumab and CRP was significant, and thus we report the adjusted (weighted) hazard ratios (HRs) derived from marginal structural models for the primary and secondary outcomes segregated by CRP levels. We planned exploratory sensitivity analyses restricted to subjects who received specific concomitant treatments against SARS-CoV-2 (corticosteroids, hydroxychloroquine, azithromycin, lopinavir/ritonavir). Due to the recognized prognostic value of lymphocyte counts and D-dimer levels, we also performed sensitivity analysis to explore the possible confounding effect of D-dimer >1000 ng/mL (upper limit of the normal range in the reference laboratory) or absolute lymphocyte count <1000/uL (lower limit of the normal range in our reference laboratory). Statistical analyses were performed using Stata v. 16 We analyzed 1,229 subjects accounting for 11,900 observations and 10,673 person-days of follow-up who were diagnosed with COVID-19 in HM hospitals between January 31 st and April 23 rd , 2020 and have the information needed for IPTW estimation. We excluded 99 patients because they died, were discharged, or were transferred to a different hospital within 24 hours after admission to the emergency department. A total of 181 subjects (14.7%) died, 82 (6.7%) were admitted to the ICU, and 186 had a composite outcome of death or ICU admission (15.1%). The median time to censoring date was 6 (IQR 3-9) days. Of the 1,229 patients, 260 (21%) received a median total dose of 600 mg (IQR 600-800 mg) of tocilizumab. The first dose was administered at a median time of 4 (IQR 3 -5) days . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint from inpatient admission. The distribution of the patient's characteristics according to tocilizumab use is shown in Table 1 . Compared to the control group, there was a higher frequency of men and previous lung disease in the tocilizumab group while controls were significantly older and had a higher prevalence of diabetes. As expected, there were small differences between both groups in some of the baseline vital signs and laboratory parameters that were indicative of greater disease severity in the tocilizumab group than in the control group. The 1,229 subjects accounted for 11,900 observations, and the crude incidence rate of death was 17 We used Kaplan-Meier estimates as a first approach to visualize the cumulative probabilities of death and ICU/death. We did not observe differences in the estimates of death or ICU/death in the pooled analysis ( Figure 1A-B) . However, we found a significantly lower cumulative probabilities of both outcomes among patients with baseline CRP levels above >150 mg/L (Figure 1C-D) but not among those with CRP ≤150 mg/L (Figure 1E-F) . . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. (Figure 2) . Weighted hazard ratios derived from marginal structural models adjusted for sex, age, comorbidities (hypertension, diabetes, ischemic heart disease, chronic kidney disease, congestive heart failure, lung disease), need for oxygen therapy at baseline, oxygen blood saturation, and time-varying parameters of severity (blood pressure, heart rate, total lymphocyte and neutrophil count, LDH, ALT, urea, D-dimer, and CRP). Abbreviations: ALT, alanine aminotransferase; CI, confidence interval; ICU, intensive care unit; LDH, lactate dehydrogenase. . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint Figure 3 and Table S2 show the adjusted hazard ratios for exploratory sensitivity analyses restricted to patients with baseline lymphocyte count <1000 cell/µl and baseline D-dimer >1000 ng/mL segregated by CRP levels. The results are consistent with the principal analysis. Individuals with baseline CRP levels higher than 150 mg/dL maintained a lower risk of death and ICU/death, but no significant effects of tocilizumab were found among those with low CRP levels. Weighted hazard ratios derived from marginal structural models adjusted for sex, age, comorbidities (hypertension, diabetes, ischemic heart disease, chronic kidney disease, congestive heart failure, lung disease), need for oxygen therapy at baseline, oxygen blood saturation, and time-varying parameters of severity (blood pressure, heart rate, total lymphocyte and neutrophil count, LDH, ALT, urea, D-dimer, and CRP). Abbreviations: ALT, alanine aminotransferase; CI, confidence interval; ICU, intensive care unit; LDH, lactate dehydrogenase. . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint We also explored the effects of concomitant therapies against SARS-COV-2 in sensitivity analyses restricted to subjects who received corticosteroids (n=582), hydroxychloroquine (n=1,134), azithromycin (n=812), or lopinavir/ritonavir (n=753) ( Table S2 ). The effect sizes among subjects with baseline CRP >150 mg/L were very similar to those observed in the principal analyses for both the primary and secondary outcomes (all p-values <0.05 except azithromycin and lopinavir/ritonavir, with p=0.105 in the primary and p=0.079 in the secondary outcome, respectively). This is the first study to evaluate the effects of tocilizumab on the mortality of hospitalized patients with COVID-19. While the overall risk of death or ICU admission did not differ among patients who received tocilizumab to those who did not and had CRP levels ≤150 mg/L, we found a 66% reduction in the risk of is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint the CT scan after 5 days. 7 In a single-arm study of 63 patients with a proinflammatory and pro-thrombotic state due to severe COVID-19, treatment with tocilizumab was associated with a decrease in CRP, D-dimer, and ferritin levels. 6 Thus, tocilizumab and other repurposed medications have been widely used offlabel to treat COVID-19 in an attempt to mitigate the dramatic clinical consequences of SARS-Cov-2 pandemic, despite the lack of information on the effects of tocilizumab on robust clinical outcomes. The first confirmed case of COVID-19 in Spain occurred on January 31 of 2020, and 235,772 cases had been identified by May 25 th , 2020. 14 Due to the impact of the disease at a time when randomized trials were lacking, many protocols were developed, and the use of 2-3 doses of tocilizumab adjusted by weight was allowed by the Spanish National Guidelines as a possible treatment for COVID-19. 23 Shortly after the release of this document, the number of doses was restricted to a single dose adjusted by weight (400 mg or 600 mg) to avoid a tocilizumab shortage. In this multicenter cohort, we could compare 260 subjects who received tocilizumab with 969 who did not. These subjects accounted for 181 deaths, 82 ICU admissions, and 186 combined events of ICU admission or mortality. We selected an analytical approach capable of dealing with the potential confounders inherent to observational studies in which subjects receiving tocilizumab were expected to have more risk factors for clinical progression and greater disease severity at baseline. In our cohort, controls were significantly older and had a higher prevalence of hypertension, which are the risk factors that have been more robustly associated with severe COVID-19 and death. 4, 17, 24, 25 However, subjects who received tocilizumab tended to have a greater prevalence of other potential risk factors for disease severity such as lung disease, as well as differences in baseline vital signs and laboratory parameters indicative of greater disease severity. All of these factors were included as covariates, and the estimates were consistent across the two endpoints analyzed. We found a strong and consistent protective effect of tocilizumab among patients with CRP levels above 150 mg/L (aHR 0.34, 95% CI 0.17 -0.71). The selection of the modeling strategy was a critical decision. Longitudinal studies in which exposures, confounders, and outcomes are measured repeatedly over time . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint can facilitate causal inferences about the effects of exposure on outcome. 14 However, there are key analytical issues in this setting, including the risk of immortal time bias (i.e., the requirement for patients to survive long enough to receive the intervention of interest, which can lead to a potentially incorrect estimation of a positive treatment effect), and indication bias from time-varying confounding (e.g., the use of tocilizumab following elevations of CRP). 14 Standard regression models for the analysis of cohort studies with time-updated measurements may result in biased estimates of treatment effects if time-dependent confounders affected by prior treatment are present. 14, 26 Marginal structural models are a powerful method for confounding control in longitudinal study designs that collect time-varying information on exposure, outcome, and other covariates, such as the present one. 14, 16 Our study has a number of limitations. As with any observational study, there is still a risk of unmeasured confounding. Tocilizumab targets the IL-6 receptor, and thus using baseline IL-6 levels instead of CRP in the interaction term with tocilizumab use could have helped to better discriminate the population benefiting most from tocilizumab treatment. Although IL-6 measurements are rarely available in clinical settings, CRP is widely accessible and is an inflammatory biomarker upstream of the IL-6 pathway. 13 Hence, we doubt that the use of CRP instead of IL-6 limited the scope of the results. Ongoing trials of tocilizumab in COVID-19 have also considered heightened CRP instead of IL-6 to identify patients with heightened inflammation and, therefore, potential greater benefit with this treatment (clinicaltrials.gov: NCT04346355 and NCT04356937). In addition, the results should be interpreted cautiously and must not be taken as confirmatory of tocilizumab efficacy because of the relatively wide confidence intervals in the principal analysis. The sensitivity analyses suggested that patients with high CRP and high D-dimer levels or lymphopenia may also be target populations for tocilizumab use. However, despite the fact that the size effects observed here were consistent with those obtained in the principal analyses, the sub-analyses must only be interpreted as exploratory and hypothesis-generating. The main strengths of the study include the large sample size and multicenter contribution that is representative of a real-life setting. This can allow . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint generalizability of the results. The availability of daily information on covariates defining treatments and laboratory parameters allowed us to control confounding issues using marginal structural models. Finally, the high number of outcomes powered the statistical analysis, and the results are novel and biologically plausible. In summary, we analyzed a large number of consecutive patients hospitalized with COVID-19 and found that tocilizumab was associated with a lower risk of mortality or ICU admission/mortality among patients with CRP >150 mg/L, but not among those with lower CRP levels. Although the results of ongoing clinical trials of tocilizumab in patients with COVID-19 are mandatory to establish its safety and efficacy, our findings have implications for the design of future clinical trials and support the use of tocilizumab among subjects with higher levels of inflammatory markers. . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 9, 2020. . https://doi.org/10.1101/2020.06.08.20125245 doi: medRxiv preprint Absolute lymphocyte count (cells/µl), median (IQR) Treating COVID-19 -Off-Label Drug Use, Compassionate Use, and Randomized Clinical Trials during Pandemics Tocilizumab in rheumatoid arthritis: A meta-analysis of efficacy and selected clinical conundrums Therapeutic efficacy of humanized recombinant anti-interleukin-6 receptor antibody in children with systemiconset juvenile idiopathic arthritis Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study The cytokine release syndrome (CRS) of severe COVID-19 and Interleukin-6 receptor Tocilizumab may be the key to reduce the mortality Pilot prospective open, single-arm multicentre study on off-label use of tocilizumab in patients with severe COVID-19 Effective treatment of severe COVID-19 patients with tocilizumab Use of Tocilizumab for COVID-19-Induced Cytokine Release Syndrome: A Cautionary Case Report Tocilizumab treatment in COVID-19: A single center experience Tocilizumab for the treatment of severe COVID-19 pneumonia with hyperinflammatory syndrome and acute respiratory failure: A single center study of 100 patients in Supportive Treatment With Tocilizumab for COVID-19: A Systematic Review General Office of the National Health Committee of China, China Traditional Chinese Medicine Administration Office From C-Reactive Protein to Interleukin-6 to Interleukin-1: Moving Upstream to Identify Novel Targets for Atheroprotection Controlling for Time-dependent Confounding using Marginal Structural Models WHO | WHO Family of International Classifications (WHO-FIC) Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19 Baseline Characteristics and Outcomes of 1591 Patients Infected with SARS-CoV-2 Admitted to ICUs of the Lombardy Region SARS-CoV-2 Cell Entry Depends on ACE2 and TMPRSS2 and Is Blocked by a Clinically Proven Protease Inhibitor A crucial role of angiotensin converting enzyme 2 (ACE2) in SARS coronavirus-induced lung injury The cytokine release syndrome (CRS) of severe COVID-19 and Interleukin-6 receptor Tocilizumab may be the key to reduce the mortality Autopsy Findings and Venous Thromboembolism in Patients With COVID-19: A Prospective Cohort Study Absolute neutrophil count (cells/µl) ALT (U/L), median (IQR) Urea (mg/dL), median (IQR) C-reactive protein (mg/L), median (IQR) /mL), median (IQR) Interleukin 6 (pg/mL), median (IQR) Outcome Non-ICU length of stay (days), median (IQR) All variables were available in the 1,229 subjects, with exception of IL-6, which was measured only in 88 individuals We acknowledge all study participants who made this research possible. We thank HM Hospitales group for releasing the dataset used to perform this research to the scientific community. Outside the submitted work, S. S.-V. reports personal fees from ViiV Healthcare, Janssen Cilag, Gilead Sciences, and MSD as well as non-financial support from ViiV Healthcare and Gilead Sciences and research grants from MSD and Gilead Sciences. J.M.-S. reports non-financial support from ViiV Healthcare, non-financial support from Jannsen Cilag, non-financial support from Gilead Sciences. JA.P. reports grants, personal fees and nonfinancial support from ViiV Healthcare, and grants from MSD, outside the submitted work.S.M. reports grants, personal fees and non-financial support from ViiV Healthcare, personal fees and non-financial support from Janssen, grants, personal fees and non-financial support from MSD, grants, personal fees and non-financial support from Gilead, outside the submitted work. There are no potential conflicts of interest.