key: cord-0026246-po55fjwa
authors: Audisio, Katia; Lia, Hillary; Robinson, Newell Bryce; Rahouma, Mohamed; Soletti, Giovanni; Cancelli, Gianmarco; Perezgrovas Olaria, Roberto; Chadow, David; Tam, Derrick Y.; Vervoort, Dominique; Farkouh, Michael E.; Bhatt, Deepak L.; Fremes, Stephen E.; Gaudino, Mario
title: Impact of the COVID-19 Pandemic on Non-COVID-19 Clinical Trials
date: 2022-01-10
journal: J Cardiovasc Dev Dis
DOI: 10.3390/jcdd9010019
sha: d24713555c8cce95cbc9dce6a13b638c7b5a1d8a
doc_id: 26246
cord_uid: po55fjwa

Randomized controlled trials (RCT) were impacted by the COVID-19 pandemic, but no systematic analysis has evaluated the overall impact of COVID-19 on non-COVID-19-related RCTs. The ClinicalTrials.gov database was queried in February 2020. Eligible studies included all randomized trials with a start date after 1 January 2010 and were active during the period from 1 January 2015 to 31 December 2020. The effect of the pandemic period on non-COVID-19 trials was determined by piece-wise regression models using 11 March 2020 as the start of the pandemic and by time series analysis (models fitted using 2015–2018 data and forecasted for 2019–2020). The study endpoints were early trial stoppage, normal trial completion, and trial activation. There were 161,377 non-COVID-19 trials analyzed. The number of active trials increased annually through 2019 but decreased in 2020. According to the piece-wise regression models, trial completion was not affected by the pandemic (p = 0.56) whereas trial stoppage increased (p = 0.001). There was a pronounced decrease in trial activation early during the pandemic (p < 0.001) which then recovered. The findings from the time series models were consistent comparing forecasted and observed results (trial completion p = 0.22; trial stoppage p < 0.01; trial activation, p = 0.01). During the pandemic, there was an increase in non-COVID-19 RCTs stoppage without changes in RCT completion. There was a sharp decline in new RCTs at the beginning of the pandemic, which later recovered.

The Coronavirus Disease 2019 (COVID-19) pandemic has had a profound impact on all areas of the healthcare system, including clinical research [1] . Research funding was diverted to the initiation of trials related to addressing the COVID-19 pandemic and development of vaccines, researchers were restricted from accessing laboratory space, and trial participants were unable to attend routine follow-up visits for non-COVID-19 research-related care [2] .

Randomized controlled trials (RCT) represent the gold standard for biomedical research [3] . Faced with the challenges of the COVID-19 pandemic, RCTs had to adjust protocols to accommodate the sudden suspension of recruitment, in-person data collection, and safety visits, as well as delivery of interventions, which may lead to a pause or premature closure of the trial.

The primary study outcomes were trial completion and trial stoppage. Trial initiation was the secondary outcome.

Categorical variables were reported as frequency counts and percentages and compared using X 2 and Fisher's exact tests as appropriate. Continuous variables were expressed as median and inter-quartile range and compared using a Mann-Whitney test after assessment of normality. For the calculation of the percentage of studies stopped or completed within a certain year or month, the denominator was defined as the number of trials active at the beginning of the year or month plus the numbers of trials initiated within that year or month without further correction. For the calculation of the percentage of trials initiated, the denominator was defined as the numbers of trials open at the beginning of that year or month. For monthly calculations, March 2020 was considered as a pandemic month. The trends over time in terms of the absolute numbers of trials stopped, completed, or activated are depicted graphically.

In addition, the effects of the pandemic on non-COVID-19 trials were assessed using piece-wise regression and using time series ARIMA models. Piece-wise regression models were used to estimate the difference in the numbers of stopped, completed, or activated trials over time, using 11 March 2020 as the start of the pandemic. An additional variable including the months since 11 March 2020 was created to determine if the pandemic effect was sustained or transitory.

Time series models were fit for each endpoint using monthly values from 2015-2018 with the Auto ARIMA function through the Python pmdarima package. The Augmented Dickey-Fuller test was applied to each to assess for stationarity of the data. Non-stationarity was accounted for by the Auto ARIMA function. Monthly values for 2019 and 2020 were forecasted using the fitted model and plotted with the actual values to assess differences over time. Confidence intervals at 95% were plotted for forecasted values. Independence for model residuals was evaluated using autocorrelation to white noise assessment. The forecasted curve was smoothed using Holt's exponential smoothing from the Statsmodels package. Parameters were specified as a smoothing level of 0.6 and a smoothing trend of 0.2 for stopped trials and were selected by the Holt function for completed and initiated trials. The smoothed curve was plotted alongside the real data and forecasted curves.

Two-sided significance testing was used and a p-value < 0.05 was considered significant without adjustment for multiple testing. Statistical analyses were performed using R (version 3.4.2 R Project for Statistical Computing) within RStudio.

The details of the study cohort are depicted in Figure S1 . The initial query of the ClinicalTrials.gov database yielded 361,899 results. After excluding trials with a start date earlier than 1 January 2010, trials with start dates after our study period, and trials which were stopped or completed prior to our study period, a total of 212,286 records remained. We included 161,377 non-COVID-19 trials in the final analysis after removal of 50,909 observational studies and 2043 records with incomplete data. Over the study period, 121,409 trials were initiated, 65,685 were completed and 11,964 were stopped. Table S2 and Figures S2 and S3 depict the annual changes over time of trial status. Overall, there was an increasing number of non-COVID-19 trials initiated from 1 January 2015 through to 2019, with a reduction in 2020.

The characteristics of trials overall and separately for the PRE and PAN cohorts are summarized in Table 1 

There was a statistically significant increase in the number of trials stopped during the pandemic (p = 0.001), whereas there was no effect of the pandemic on trial completion (p = 0.56) ( Figure 1A -C and Figure S4A -C). There was a sharp reduction in trial initiation in the COVID-19 period, which later recovered, (Figures 1C and 2 ).

There was a statistically significant increase in the number of trials stopped during the pandemic (p = 0.001), whereas there was no effect of the pandemic on trial completion (p = 0.56) ( Figure 1A -C and Figure S4A -C). There was a sharp reduction in trial initiation in the COVID-19 period, which later recovered, (Figures 1C and 2) . In the SARIMA model that examined the number of new monthly initiated trials, there was a decrease in new trial initiations in the months of March, April, May, and June 2020 beyond 95% CI bounds ( Figure 3A) . In the SARIMA model that examined the number of new monthly initiated trials, there was a decrease in new trial initiations in the months of March, April, May, and June 2020 beyond 95% CI bounds ( Figure 3A ). Table 2 ).

The number of monthly completed trials was above the 95% CI bounds of the forecasted model for the month of March 2020 only (+25.6%; actual: 1822, forecasted: 1451, 95% CI: 1153-1748) ( Figure 3B and Table 2 ).

In the fitted SARIMA model, the actual number of monthly stopped trials for the months of March, July, September, November, and December 2020 exceeded the forecasted values of the model beyond 95% CI bounds ( Figure 3C ). The greatest increase occurred in November 2020 (+47.7%; actual: 378, forecasted: 256, 95% CI: 198-315) ( Table 2) . Tables S3-S5 display SARIMA model fit and summary statistics. 

In this analysis, we found that during the COVID-19 pandemic, there was a significant increase in the stoppage of non-COVID-19-related trials compared to the non-pandemic years, with no difference in trial completion. Furthermore, there was a marked decrease in non-COVID-19 trial initiation early in the pandemic, which rebounded later during 2020.

We believe that the differential effect of the pandemic on trial completion and stoppage is related to the fact that trials initiated before the pandemic and therefore at a further stage were more likely to be completed during the pandemic, whereas trials started during the pandemic or at an earlier stage were stopped at a higher rate. Indeed, the distribution of the start years was heavily weighted towards the earlier years in the pre-pandemic period and U-shaped in the pandemic period.

Prior reports showed a significant reduction in research activities during the current pandemic. In an international survey of 60 large academic cardiac surgery centers, research activity was reported to be reduced by more than 50% from pre-pandemic levels [8] . A report on oncology trials found that up to 20% of centers in Asia and the US had stopped enrollment entirely between March and April 2020, with 60% of centers reporting continued enrollment but at a lower rate when compared with the pre-pandemic era [9] . In a survey of 933 oncology patients, Fleury et al. found that 20% of respondents reported that they were less likely to participate in clinical research, citing the ongoing COVID-19 pandemic and restricted access to care [10] . The US National Institute of Health estimated that almost 80% of non-COVID-19 clinical trials were stopped or interrupted as a result of the pandemic [11] . Even for trials that were not stopped, enrollment was problematic during the COVID-19 crisis. Sathian et al., in a systematic review evaluating the impact of the COVID-19 pandemic on the conduction of clinical trials, found that most sites conducting clinical trials not related to COVID-19 experienced a delay in timelines or a complete stoppage during the pandemic, [12] . Selvaraj et al., in an analysis on the topics of cardiovascular trials before and during the COVID-19 pandemic, found that most of the new trials focused exclusively on COVID-19-retaled cardiovascular outcomes. [13] These analyses, however, were published early in the pandemic, focused only on specific clinical subspecialties, or did not specifically select non-COVID-19 trials. The novelty of our analysis is that we performed the first systematic analysis evaluating the overall impact of the COVID-19 on non-COVID-19 RCTs and their initiation, stoppage, and completion.

Clinical trials may provide patients with access to experimental therapies and new medications; when suspended or prematurely stopped, patients lose this crucial resource. Oncology trials, for example, often enroll patients who have few, if any, alternative treatment options by offering personalized treatment modalities such as immunotherapy [14] .

Initiation of new trials not related to COVID-19 therapies was similarly impacted. In an analysis of Phase 1 through 4 oncology trials, Lamont et al. found that when compared with the pre-pandemic period, the COVID-19 pandemic was associated with a 60% decrease in the initiation of new trials [15] . Although the exact long-term consequences remain unknown, the decrease in trial initiation will likely delay the development of new therapies for the foreseeable future.

With the sustained strain on hospitals caused by the COVID-19 pandemic, the modification and suspension of clinical research is likely to continue. At the start of the pandemic, many academic medical centers suspended all in-person research activities whereas others left the decision up to the discretion of the primary investigator [16] . Although it is clear that essential research activities need to continue, its definition remains elusive [17] . Continued restriction in patient movement and hospital activities will impact data collection and monitoring visits, compliance with the investigated therapy, and other protocol-related requirements.

In response to the COVID-19 crisis, the United States Food and Drug Administration (FDA) and European Medicine Agency (EMA) issued guidance for industry, investigators, and institutional review boards [18, 19] . Recommendations include virtual or in-home study visits, shipment of interventional medications to the patients' home, and other forms of remote monitoring. Although these are important steps in the right direction, these temporizing measures do not fully address the future of clinical research in a post-COVID-19 environment.

Trial design needs to adapt to this changing landscape to allow for the continuation of crucial, non-COVID-19-related research, as well as prepare for possible future disruptions. Conventional clinical trials are typically run from clinical sites where patients report for face-to-face interaction with study personnel and undergo study-related treatment and testing. This structure is fragile in the case of pandemic crises similar to COVID-19, as it carries the risk of exposure to infection of study participants [20] . By allowing virtual and at-home consenting and subsequent care, trials may be able to recruit potential participants even during a crisis similar to the current pandemic. This would require the restructuring of protocols such as that patients could perform the functions of research personnel with little to no assistance [21] . Digital devices can also collect symptom scores and baseline vital data that can be electronically transmitted to central data repositories [22] . During the COVID-19 pandemic, a number of trials have successfully been conducted without a physical clinical site [23, 24] . A restructuring of trials without clinical sites offers several advantages such as increased access to treatments for patients located further from clinical sites, decreased cost, and a more patient-centered approach [25] .

Our analysis should be interpreted in the context of several limitations. First, the ClinicalTrials.gov database is constantly updated, and these results reflect trial status as of February 2021. Second, although the ClinicalTrials.gov database is the largest clinical trial registry in the world, there is a potential for missing unregistered trials, and we did not search for trials registered to other registries. Third, the ClinicalTrials.gov database relies on compliance by individual study investigators to update their status, and there is a potential that some studies may have been suspended or stopped without updating their status on the database; it is also possible that there have been errors in data entry and trial status reporting. The rates of trial stoppage, either temporary or permanent, may be underreported. Furthermore, the design type of the clinical trials and the subject matter breakdown were not available in the ClinicalTrials.gov database; therefore, a sub-analysis evaluating if the trials with these variables were affected by the COVID-19 pandemic was not possible.

To conclude, the COVID-19 pandemic has had a significant impact on non-COVID-19-related clinical trials. There has been a significantly higher number of stopped trials in addition to a significantly lower number of newly initiated trials. Trial design and protocols have to rapidly change and adapt to the post-COVID-19 world. Virtual visits, digital monitoring, and remote delivery of study interventions can allow not only for "future-proofing" of clinical trials, but also allow for increased participation with decreased cost.

Supplementary Materials: The following are available online https://www.mdpi.com/article/10.3 390/jcdd9010019/s1. Table S1 : Full list of trial definitions, Table S2 : Annual changes over time in trial status, Table S3 : SARIMA model fit and summary statistics for stropped trials, Table S4 : SARIMA model fit and summary statistics for initiated trials, Table S5 : SARIMA model fit and summary statistics for completed trials. Figure S1 : Derivation of the Study Database, Figure S2 : Yearly number of trials initiated (blue bar), stopped (orange bar), or completed (gray bar), Figure S3 : Total number of trials that were active per year, Figure S4 : (A) Total number of trials that were stopped over the study period by month, (B) Total number of trials that were completed over the study period by month, (C) Total number of trials that were initiated over the study period by month. Data Availability Statement: Data collected for the study will be made available by the corresponding author upon reasonable request after publication. 

Safeguarding Non-COVID-19 Research: Looking Up from Ground Zero

Randomized Trials Versus Common Sense and Clinical Observation

The Consequences of the COVID-19 Pandemic on Non-COVID-19 Clinical Trials

Characteristics of clinical trials evaluating cardiovascular therapies for Coronavirus Disease 2019 Registered on ClinicalTrials.gov: A cross sectional analysis

The ClinicalTrials.gov results database-update and key issues

Data Structures for Statistical Computing in Python

Response of Cardiac Surgery Units to COVID-19: An Internationally-Based Quantitative Survey

Impact of COVID-19 on oncology clinical trials

Association of the COVID-19 Outbreak With Patient Willingness to Enroll in Cancer Clinical Trials

COVID-19 and readjusting clinical trials

Impact of COVID-19 on clinical trials and clinical research: A systematic review

The Landscape of Cardiovascular Clinical Trials in the United States Initiated Before and During COVID-19

Facilitating access to new therapeutic options through clinical trials: The vision of a regulator to reconcile innovation and safety

Trends in Oncology Clinical Trials Launched Before and During the COVID-19 Pandemic

Preserving Clinical Trial Integrity During the Coronavirus Pandemic

Pandemic Pandemonium: Pausing Clinical Research During the COVID-19 Outbreak

FDA Guidance on Conduct of Clinical Trials of Medical Products During the COVID-19 Public Health Emergency

Implications of Coronavirus Disease (COVID-19) on Methodological Aspects Ongoing Clinical Trials

Risk of COVID-19 among front-line health-care workers and the general community: A prospective cohort study

The COVID-19 pandemic: A catalyst to improve clinical trials

Advancing digital health: FDA innovation during COVID-19. Npj Digit

Fluvoxamine vs Placebo and Clinical Deterioration in Outpatients With Symptomatic COVID-19: A Randomized Clinical Trial

Minimizing the impact of the COVID-19 epidemic on oncology clinical trials: A retrospective study of Beijing Cancer Hospital