key: cord-0025000-n46zuzmr
authors: Wolkewitz, Martin; Martinuka, Oksana
title: Response to “Overlooked Shortcomings of Observational Studies of Interventions in Coronavirus Disease 2019: An Illustrated Review for the Clinician” by Tleyjeh et al.
date: 2021-12-03
journal: Open Forum Infect Dis
DOI: 10.1093/ofid/ofab614
sha: 3d3e815cd00c46a2248e36343aa5c566ca7d3df9
doc_id: 25000
cord_uid: n46zuzmr

nan

. Similarly, the issue of bias in observational studies assessing drug effectiveness in hospitalized patients with COVID-19 was described in our methodological review [2] . In our review, we focused on the studies published in 4 leading clinical journals and examined the presence of 3 main types of biases, namely immortal time bias, type-dependent confounding bias, and competing risk bias. In the majority of the reviewed studies, the primary outcome was in-hospital death, and discharge alive was considered a competing event by these studies. Overall, all of the 11 assessed studies were prone to the competing risk bias. Among them, only 1 study addressed the competing risk bias. In studies, conventional methods such as the naïve Kaplan-Meier approach and a standard Cox regression model were applied. In using the Kaplan-Meier methodology, the competing event (ie, discharge alive) was treated as a censored observation, potentially leading to biased estimates of the primary event probabilities. However, this is not a meaningful model assumption, as the recovered patients were not representative of those who were still hospitalized in terms of their risk of dying. Furthermore, the studies applied the standard Cox regression analysis, which is incomplete in the presence of competing events [2] . With this, we want to emphasize the same conclusions derived by Tleyjeh et al. on the importance of competing risk analysis in studies evaluating intervention in COVID-19.

In addition, Tleyjeh et al. provided recommendations on the application of the Fine-Gray subdistribution hazard model for the competing risk analysis. We agree that in the presence of competing risks the subdistribution hazard model allows for estimating the effect of time-invariant covariates on the cumulative incidence of the outcome; however, it may no longer be suitable with internal time-dependent covariates, such as treatment exposures or biomarkers. The subdistribution hazard model requires that values of internal time-dependent covariates be known for the entire follow-up time for patients who experienced a competing event. However, in competing risk settings, the information on time-dependent covariates is mostly unavailable. Thus, the Fine-Gray approach often does not allow for making inferences about the association of an internal timedependent covariate with the cumulative incidence function [3] . The subdistribution approach can produce highly biased hazard ratio estimands in the assessment of the time-dependent covariate, for example, for time-varying treatment; for example, a simulation showed that this model produced strong effects in settings without any true treatment effect [4] . Thus, when studying potential treatment effects on clinical outcomes in COVID-19 patients, more sophisticated models for timedependent data are required [5] . 

Overlooked shortcomings of observational studies of interventions in coronavirus disease 2019: an illustrated review for the clinician

Methodological evaluation of bias in observational coronavirus disease 2019 studies on drug effectiveness

A review of the use of time-varying covariates in the Fine-Gray subdistribution hazard competing risk regression model

Simulation shows undesirable results for competing risks analysis with time-dependent covariates for clinical outcomes

A marginal structural model for multiple-outcome survival data: assessing the impact of injection drug use on several causes of death in the Canadian Co-infection Cohort