key: cord-0031976-i21afq78 authors: Giacomelli, Andrea; Cozzi-Lepri, Alessandro; Casalini, Giacomo; Oreni, Letizia; Ridolfo, Anna Lisa; Antinori, Spinello title: Estimating the effectiveness of remdesivir on risk of COVID-19 mortality: The role of observational data date: 2022-05-20 journal: Pharmacol Res DOI: 10.1016/j.phrs.2022.106268 sha: 1f69682d25a47969ae16073aed5aaf4657d21b94 doc_id: 31976 cord_uid: i21afq78 nan Estimating the effectiveness of remdesivir on risk of COVID-19 mortality: The role of observational data Dear Editor, A significant effect of remdesivir in reducing COVID-19 mortality is still claimed in several observational studies [1, 2] . To provide a rational to conduct these studies, the authors usually do not take into consideration the evidence of meta-analysis of RCTs, presume a priori unreliable estimates of remdesivir treatment effect on COVID-19 mortality and do not apply a solid methodological approach which is mandatory when we look at comparing the effect estimates from randomized trials and observational studies [3] . In a recent study by Marrone et al. [2] the authors assumed an a priori 3% probability of death in COVID-19 hospitalized patients treated with dexamethasone plus remdesivir and 17% in dexamethasone alone. Nevertheless, at the time of study conduction, the only universally accepted treatment for COVID-19 hospitalized patients (dexamethasone) showed a far below estimate of treatment effect on mortality (rate ratio, 0.82; 95%CI, 0.72-0.94) [4] . It is worth mentioning that in the same study up to 65.9% of patients in the remdesivir plus dexamethasone group received high flow oxygen supplementary therapy at remdesivir start. In fact, if on the one hand in case of non-severe illness the World Health Organization recently released a conditional recommendation suggesting the treatment with remdesivir, on the other in case of severe or critical illness it is still not known whether remdesivir provides any protective effect against death [5] . In another large observational study estimating the effect of remdesivir on COVID-19 intra-hospital mortality, in which the authors compared the outcome of 28,855 remdesivir exposed patients with 16,687 remdesivir unexposed patients, the authors found that remdesivir exposure was associated with a significant reduction in mortality at 28 days [Hazard Ration 0.89 (0.82-0.96)] [1] . In this study, the main approach used to control for measured confounding by using propensity score matching followed by a standard Cox regression model which further controls for other factors at the analysis stage is unusual. Only a marginal Cox regression analysis can replicate the counterfactual of a randomised comparison in which everybody received remdesivir vs., counter to the fact, everybody received standard of care. In addition, the authors could have evaluated also the impact of one or more potential unmeasured confounders hypothesised to have similar association with the intervention and the risk of outcome to one of the main predictors in the analysis (e.g. the use of corticosteroids or convalescent plasma) by calculating an e-value [6] . In the same manuscript the authors concluded that their data "complement ACTT-1 [7] and support remdesivir as a foundational treatment for hospitalized COVID-19 patients" suggesting a conceptual replication of the ACTT-1, a sentence that is not actually supported by the applied methodology [3] . In conclusion, the contribution of observational studies to assess the effectiveness of treatment for COVID-19 could be significant only if a rigorous methodology to emulate a hypothetical RCT, which represent nowadays the standard for this type of analyses, is applied. None. A.G and A.C.L. conceived the manuscript. G.C., A.L.R., L.O. and S.A. critically revised the initial draft and contributed to preparation of the article. None related to the present manuscript. A.G. received consultancy fees from Mylan and educational and travel support from Gilead Sciences and ViiV Healthcare. S.A. has received support for research activities from Pfizer and Merck Sharp & Dome. A.C.L., G.C., A.L.R., L.O. has nothing to disclose. Remdesivir treatment in hospitalized patients with COVID-19: a comparative analysis of in-hospital all-cause mortality in a large multi-center observational cohort Remdesivir plus dexamethasone versus dexamethasone alone for the treatment of COVID-19 patients requiring supplemental O2 therapy: a prospective controlled non-randomized study Effect estimates in randomized trials and observational studies: comparing apples with apples The Recovery Collaborative Group, Dexamethasone in hospitalized patients with Covid-19 Remdesivir and three other drugs for hospitalised patients with COVID-19: final results of the WHO solidarity randomised trial and updated meta-analyses Sensitivity analysis in observational research: introducing the E-value ACTT-1 study group members. Remdesivir for the treatment of Covid-19 -final report Giacomo Casalini a,c , Letizia Oreni a , Anna Lisa Ridolfo a , Spinello Antinori a,c a III Division of Infectious Diseases