key: cord-0738054-3eg749ax
authors: Padhi, Sunali; Pati, Abhijit; Panda, Aditya K
title: Effect of Ivermectin in the Treatment of Coronavirus Disease 2019: A Trial Sequential Analysis Highlights the Requirement of Additional Randomized, Controlled Trials
date: 2021-08-06
journal: Clin Infect Dis
DOI: 10.1093/cid/ciab692
sha: 46a47d481940e42b0a570f3e85da78496eb2389d
doc_id: 738054
cord_uid: 3eg749ax

nan

To the Editor-We read with great interest the recent article by Roman et al [1] in which the authors explored the potential role of ivermectin in the treatment of coronavirus disease 2019 (COVID-19). They included 10 randomized, controlled trials (RCTs), totaling 1173 severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)-infected cases and investigated the effect of ivermectin on all-cause mortality, hospital length of stay, adverse events, and viral clearance.

The authors reported that additional ivermectin administration had no meaningful effect on reducing all-cause mortality, hospital length of stay, adverse event, or viral clearance in the COVID-19 patients.

We did not determine whether an adequate number of RCTs had been conducted before doing a data search or whether additional RCTs are required to conclude the role of ivermectin in the treatment of COVID-19, if any. We believe the research community would be very much interested in our search results.

Meta-analyses using a small number of trials or patients increase the chances of false-positive (type I error) or false-negative (type II error) results, leading to erroneous conclusions. In recent years, trial sequential analysis (TSA) has emerged as a promising statistical tool for addressing these challenges. The TSA uses various methodologies to determine the monitoring boundaries, required information size, and futility boundaries. The TSA outcome is more reliable than the usual meta-analysis results because the calculation of information size and threshold adjustment decreases early false-positive results. When the cumulative z curve reaches the required information size line or passes the monitoring or futility boundary, it indicates that enough trials have been done to derive a valid conclusion and that additional clinical trials are unlikely to affect the inference [2] [3] [4] .

We used the data from Roman et al [1] and performed TSA to study the efficacy of ivermectin on primary and secondary treatment outcomes in COVID-19 patients. We estimated the required information size to reject or support the role of ivermectin to be 33.33% relative risk reduction, maximum type I error of 1%, and maximum type II error of 10%, which yielded different required sample sizes for the studied outcome (all-cause mortality, n = 10342; hospital stay, n = 1893; adverse events, n = 216; viral clarence, n = 517; Figure 1 ). The cumulative z curve crossed the required information size predicted for adverse events ( Figure 1C ) and futility boundary for virus clearance ( Figure 1D ), which indicates that enough trials have already been conducted to conclude no role of ivermectin in improving adverse events or viral clarence. The cumulative z curve for all-cause mortality and length of hospital stay analyses did not cross the monitoring or futility boundaries, nor did it reach the required information size line, indicating that more trials are needed to reach a definitive conclusion for all-cause death ( Figure 1A ) and hospital stay outcome ( Figure 1B) . The present metaanalysis included 1173 COVID-19 cases; thus, additional RCTs in approximately 9170 COVID-19 cases (4585 patients in each intervention group) would be required to yield a conclusive finding. Based on the TSA results, we propose that more RCTs in different populations be conducted to reach the requisite event size for drawing a definitive conclusion about the importance of ivermectin in the treatment outcome of COVID-19.

Ivermectin for the treatment of COVID-19: a systematic review and meta-analysis of randomized controlled trials

Trial sequential analysis (TSA)

Trial sequential analysis in meta-analyses: a clinically oriented approach with real-world example

Trial sequential analysis in systematic reviews with meta-analysis