key: cord-0798489-gi53dq8m
authors: Neyens, Thomas
title: Did an effect of kidney transplantation on COVID‐19 mortality go unnoticed due to selection bias?
date: 2021-05-26
journal: Transpl Int
DOI: 10.1111/tri.13880
sha: f09a2840db6fb72ebfd747aa9f74036f44f08da2
doc_id: 798489
cord_uid: gi53dq8m

nan

I have read the letter by Hugo et al. [1] and the commentary with interest. Hugo et al. [1] conclude that they could not show adverse effects of prior solid organ transplantation on COVID-19 mortality, based on a case-control analysis. The commenters claim that this conclusion is incorrect, due to selection bias in the case-control matching. I acknowledge the good scientific intentions of all authors involved; in what is written below, I will share my insights, form a statistical point of view, without expert knowledge of transplantation science and the related literature.

The research question in the letter by Hugo et al. [1] is clear: 'Is solid organ transplantation history associated with mortality in COVID-19 patients?'. The study adopts an observational, retrospective design. To the best of my understanding, the data in the sample were collected in a non-probabilistic way, that is there was no process to choose participants before the data were collected in function of the research question at hand. Instead, the researchers use a database that contains a subset of the COVID-19 patient population. Probabilistic matching is then used to correct for baseline differences between cases, that is COVID-19 patients with a transplantation history, and controls, that is COVID-19 patients without a transplantation history. The matching is important, since these differences might confound the association under investigation, namely the effect of transplantation history on COVID-19 mortality. The researchers match for age, gender and comorbidities. In other words, if matched correctly, they draw conclusions on differences in mortality between COVID-19 patients with and without a transplantation history who have similar characteristics in terms of gender, age and comorbidity distributions.

One condition of the case-control approach is that cases and controls are sampled from the same population. I assume that this is the case, since the authors state: 'a matched-pair analysis (1:30) of 46 transplant recipients with 1380 controls without transplantation within one registry (LEOSS) was performed'. I also deduct this from the header in Table 1 [1] . However, the commenters, if I understand them correctly, hint towards a scenario where only controls were obtained from the LEOSS registry, while cases originated from the general population. If that is true, I agree with the commenters that this will very likely result in selection bias, since the controls originate from a subset of the general population of COVID-19 patients that likely has an overrepresentation of severe cases [2] , while this is not true for the cases.

If, however, both cases and controls originate from the LEOSS registry, which I assume in the remainder of this text, I believe that the comparison by Hugo et al. [1] could be valid in theory, if we can make at least three assumptions: (i) gender, age and comorbidities are the only, or at least the most important confounders. Note that the matched sample of controls will then likely have a higher mortality than the general public, since patients with a transplantation history have an increased probability to be old and to have comorbidities [3] . Comparing their mortalities without matching would not allow the researchers to disentangle the effects of the confounders and transplantation history. The mortality rates in the control group are very high though, and it is counterintuitive that the findings, after matching, are not roughly in line with findings documented in other larger-scale studies [4] . (ii) Inclusion in LEOSS is alike for transplantation and non-transplantation patients; if this is not the case, selection bias can occur. I do not have enough information on the LEOSS study to draw a conclusion on this. (iii) The effects of the severity of COVID-19 and transplantation history on mortality do not interact. If they would interact, a conclusion on the comparison between COVID-19 patients with or without a transplantation history would likely differ between a study using cases and controls from the LEOSS data, where severe COVID-19 patients are likely overrepresented, and a study where cases and controls were obtained from the general population including those with mild pathologies. This would render the study by Hugo et al. [1] only comparable with studies that investigate patients with similar COVID-19 severity.

The previous paragraph mentions theoretical considerations that underlie the analysis of Hugo et al. [1] Although I appreciate that not all assumptions can be perfectly validated in a complicated real-life setting, I have some concerns about the execution of the analysis: (i) I agree with the commenters that the age matching is poor, which potentially convolutes the association under investigation, especially since age was not taken up as a covariate. (ii) The sample size of the cases is small and the case-to-control ratio of (1:30) is extreme, while I am not convinced of its beneficial effects on the analysis' power. The small sample limitation has been acknowledged by the authors though. (iii) I do not understand the rationale behind the sensitivity analysis: I, therefore, conclude that (i) there should be more information on the data selection process, namely the potential bias originating from opportunistic participation in the LEOSS registry and the selection of cases, (ii) the performance of the age matching is poor and (iii) a number of modelling choices are unclear and/ or suboptimal, while they are not thoroughly discussed. On the other hand, I appreciate that a formal test via matching has been undertaken, which was not the case in the two referenced papers [3, 5] . But, note additionally that Pereira et al. [3] have a control group (from literature) that consists of hospitalized patients, so somewhat severe cases as well. Their mortalities are much lower than those in the study of Hugo et al., so it remains unclear to me whether they are so large in Hugo et al. [1] due to the matching or due to another underlying mechanism that may cause selection bias.

Rahmel A. Stable and safe organ procurement and transplantation during SARS-CoV-2 pandemic in Germany

Solid organ transplantation is not a risk factor for COVID-19 disease outcome

First results of the "Lean European Open Survey on SARS-CoV-2-Infected Patients (LEOSS)

COVID-19 in solid organ transplant recipients: initial report from the US epicenter

Factors associated with COVID-19 related death using OpenSA-FELY

Covid-19 and kidney transplantation

Is transplantation per se a risk factor for worse outcome of SARS-CoV-2 infection in kidney transplant recipients? We read with great interest the recent article by Hugo et al. reporting comparable mortality following SARS-CoV-2 infection in 46 solid organ transplant (SOT) recipients compared in multivariable conditional logistic regression to 1380 controls without transplantation matched for known COVID-19 risk factors [1] , and the responding letter by Budde et al. suggesting misinterpretation of the data due to a selection bias of the control population [2] . The latter fear that misleading conclusions could have detrimental effects on decision making concerning risk-stratification and immunizations strategies.

Since the beginning of the SARS-CoV-2 pandemic and through the different waves that hit our countries, overwhelmed healthcare systems with triage for access to life-saving ventilator support, different thresholds for intubation, evolving ventilation techniques including lung protective strategies, high-flow nasal cannula or non-invasive positive pressure ventilation [3] , as well as multiple treatment strategies including hydroxychloroquine, azithromycin, lopinavir/ritonavir (mostly used during the first wave), and dexamethasone, remdesivir, tocilizumab, convalescent plasma (mostly during the second wave), altogether led to mortality rates that largely fluctuated, decreased for instance in Spain from 24% to 13.2% between the first and second wave [4] , and largely limit comparisons between studies and populations. Except for dexamethasone, reports on favourable effects of the various used medications are scarce, most being without any notable beneficial effect [5] . Although specific risk factors for severe outcome; including age, body mass index, diabetes mellitus, preexisting cardiopathy, chronic lung disease and basal renal function have been identified, it remains unclear how pre-existing SOT influences COVID-19 outcome [6, 7] .Whereas initial reports during the first wave from New York suggested increased mortality in SOT recipients with COVID-19 [8], a first experience from the Swiss Transplant Cohort Study (STCS) limited to 21