key: cord-0966598-6ucotep8 authors: Webb, B. J.; Buckel, W.; Vento, T.; Butler, A. M.; Grisel, N.; Brown, S. M.; Peltan, I. D.; Spivak, E. S.; Shah, M.; Sakata, T.; Wallin, A.; Stenehjem, E.; Poulsen, G.; Bledsoe, J. title: Real-World Effectiveness and Tolerability of Monoclonal Antibodies for Ambulatory Patients with Early COVID-19 date: 2021-03-17 journal: nan DOI: 10.1101/2021.03.15.21253646 sha: 9e4565a0c8b7183c2dbedbc7fed8599c38ae50cb doc_id: 966598 cord_uid: 6ucotep8 Importance: Interventions to reduce hospitalization of patients with COVID-19 are urgently needed. Randomized trials for efficacy suggest that anti-SARS-CoV2 neutralizing monoclonal antibodies (MAb) may reduce medically-attended visits and hospitalization but effectiveness has not been confirmed in a real-world setting. Objective: Estimate the effectiveness of MAb infusion in a real-world cohort of ambulatory patients with early symptomatic COVID-19 at high risk for hospitalization. Design: Quasi-experimental observational cohort study using target trial emulation and causal inference methodology in pre-and post-implementation groups. Setting: Infusion centers and urgent care clinics within an integrated healthcare system in the United States Participants: 13,534 high-risk adult outpatients with symptomatic, laboratory-confirmed COVID-19 within 7 days of symptom onset. Exposures: A single intravenous infusion of either bamlanivimab 700 mg or casirivimab/imdevimab 1200 mg/1200 mg. Main Outcomes and Measures: The primary outcome was emergency department visit or hospitalization within 14 days of positive test. Patients who received MAb infusion were compared to contemporaneous controls using inverse probability of treatment weighting, and to a pre-implementation cohort using propensity-weighted interrupted time series analysis. An exploratory analysis compared effectiveness of casirivimab/imdevimab and bamlanivimab. Results: 7404 patients who would have been MAb-eligible were identified in a pre-implementation cohort (July 1-November 27, 2020). In the post-implementation period (November 28, 2020-January 28, 2021), 594 received MAb treatment and 5536 MAb-eligible patients did not. Among Mab recipients, 479 (80.6%) received bamlanivimab and 115 (19.4%) casirivimab/imdevimab. The primary outcome occurred in 75 (12.6%) MAb recipients, 1018 (18.4%) contemporaneous controls, and 1525 (20.6%) patients in the pre-implementation cohort. MAb treatment was associated with fewer subsequent emergency department visits and hospitalizations (odds ratio estimating the average treatment effect 0.69, 95% CI 0.60-0.79). After implementation, propensity-weighted probability of emergency department visit or hospitalization decreased by 0.7% per day (95% CI 0.03-0.10%, p<0.001). Overall, 7 (1.2%) MAb patients experienced an adverse event; two (0.3%) were considered serious. In the exploratory analysis, the effect of casirivimab/imdevimab versus bamlanivimab was not significant (OR 0.52, 95% CI 0.17-1.63, p=0.26). Conclusions and Relevance: MAb treatment of high-risk ambulatory patients with early COVID-19 was well-tolerated and effective at preventing the need for subsequent medically-attended care. Monoclonal antibodies (MAbs) designed to avidly bind to the receptor binding domain of the SARS-CoV-2 spike glycoprotein are an emerging passive neutralizing therapy for COVID-19. In fall 2020, bamlanivimab (Eli Lilly, Indianapolis IN) and casirivimab/imdevimab (Regeneron, Tarrytown NY) received United States Food and Drug Administration emergency use authorization (EUA) for treatment of mild/moderate symptomatic COVID-19 in ambulatory patients at higher risk for hospitalization 1, 2 and were distributed for administration under a Department of Health and Human Services program. Secondary endpoints from phase II/III clinical trials suggest that early administration of these MAbs may prevent emergency department (ED) visits or hospitalization, particularly in highest-risk subgroups. [3] [4] [5] However, additional evidence is needed to clarify the true magnitude of this effect and better characterize adverse event rates. Here, we apply principles of target trial emulation and causal-inference methodology to assess the real-world effectiveness and tolerability of MAbs for COVID-19 after implementation in a large, integrated healthcare system. Intermountain Healthcare is a regional integrated healthcare system that provides care to more than 1.5 million patients each year. During the COVID-19 pandemic, Intermountain has offered SARS-CoV-2 testing at urgent care facilities, emergency departments, and community drive-up testing sites in Utah and southeastern Idaho. As part of patient notification and clinical trial enrollment processes, a report of all positive test results is generated daily and includes clinical and demographic data. Clinical for this study were extracted from the Intermountain . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021. ; enterprise data warehouse and Intermountain Prospective Observational COVID-19 (IPOC) database. Comorbidities were defined using the Charlson and Elixhauser definitions. 6, 7 Comorbidity data were complete for patients with prior encounters within the integrated health system, patients with missing prior encounter data were excluded. At the time of EUA approval, due to high community transmission, patients eligible for MAb using the EUA criteria far exceeded infusion capacity. To address resource scarcity, the Scarce Medications Allocation Subcommittee of the Utah Crisis Standards of Care (CSC) Workgroup was convened with the dual aims of targeting available MAb infusions to patients most likely to benefit and ensuring equity in delivery. 8 A simple clinical prediction score for predicting severe COVID-19 resulting in hospitalization or mortality among ambulatory patients was validated in a large cohort of Utah patients and adopted for use in MAb allocation. 9 The score weights age, gender, shortness of breath, comorbidities, and non-white race or Hispanic/Latinx ethnicity to address recognized disparities in poor COVID-19 outcomes in these populations. Clinical eligibility for MAb was defined by the CSC committee as the following: 1) at or above the risk score threshold (set at ≥7.5 points, which identified approximately the top decile of estimated risk among COVID-19 positive patients), 2) laboratory-confirmed COVID-19 by nucleic acid amplification test or antigen detection, 3) symptomatic disease with symptom onset within no more than 7 days. Patients were ineligible to receive MAb therapy for the following conditions: 1) hospitalized due to COVID-19, 2) new, COVID-related hypoxemia (defined as peripheral oxygen saturation <90% at rest or new supplemental oxygen requirement, or for those . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) To provide equitable access to treatment, 16 regional infusion sites (7 hospital-based infusion centers and 9 urgent care facilities) were selected based on population density, prevalence of underserved patients, and travel time for patients in rural communities. Two pathways for patient identification were developed: first, a hotline and email address were set up to receive referrals from patients and providers in the state. Second, recognizing that patients with poorer healthcare access might have less awareness about treatment availability and less likely to have a referring provider, a process was implemented to proactively identify patients at the time of test positivity. To do this, the risk calculator result was electronically integrated into the daily report of all new positive cases. Each day, a clinician using the report reviewed available medical records for candidate patients with new positive tests and attempted to contact patients by telephone to verify eligibility for MAb infusion. A telephone interpreter service was used for all patients with non-English language preferences. Eligible patients were then scheduled at the nearest infusion site with appointment availability. At a daily huddle, all infusion sites reported infusion-associated adverse events, defined as symptoms requiring clinical evaluation or management during the infusion or one-hour observation period. The first bamlanivimab infusions were provided in infusion centers and urgent care clinics on December 1, 2020 (to patients with positive tests as of November 28, 2020) and the first casirivimab/imdevimab infusions were administered on December 30, 2020. Due to drug preparation requirements, when casirivimab/imdevimab became available it . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted March 17, 2021. ; replaced bamlanivimab as the sole product used at infusion centers, whereas urgent care sites continued to administer only bamlanivimab. To minimize bias and improve causal inference in an observational study design, we applied principles of target trial emulation in designing our analyses. 10 First, we identified two cohorts: 1) a pre-implementation cohort comprised of ambulatory patients with positive COVID-19 tests performed between July 1 and November 27, 2020 and 2) a post-implementation cohort of patients with positive tests during the period when MAb therapy was available (November 28, 2020 through January 28, 2021). All patients had at least 14 days of follow-up from the time of testing. We limited the entire cohort to patients who would have been screened for MAb eligibility based on a risk prediction score of at least 7.5 points, calculated using the same electronic method applied in the actual patient identification process. We then excluded patients who were either admitted at the time of COVID-19 testing or within 72 hours following testing. By doing this, we excluded patients who would not have been eligible for MAbs because of hospitalization, or advanced disease and hypoxia at the time of screening, and those who would not have had sufficient time to receive MAb treatment and derive benefit had treatment been available. We prespecified analyses in the pre-and post-implementation cohorts using causal inference methodology intended to address different biases in observational data in a complementary way. The primary outcome was a composite of subsequent ED visit or hospitalization in the 14 days after testing. This outcome was chosen to account for increasing admission thresholds during the study period, which presented risk of secular confounding . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021. ; affecting the pre-implementation cohort. Admission criteria were static during the period in which MAbs were available, and we performed a sensitivity analysis with the outcome of hospitalization within 14 days in the post-implementation group. To estimate the average treatment effect in the treated (ATT) for patients who received MAbs, we first developed a propensity model using multivariable logistic regression to estimate the propensity for MAb treatment within the post-implementation group. 11 Propensity model variables were selected on the basis of expert opinion, previous evidence, plausibility, and results of a focus group of clinicians involved in the MAb screening process. We then used the propensity model to conduct inverse probability of treatment weighting (IPTW) to estimate the ATT for the primary outcome associated with MAb treatment. 12 Adequate covariate balance after IPTW was assessed using standardized mean differences. We performed a sensitivity analysis limited to the 14-day hospitalization outcome only. Adjustment for multiple comparisons was not performed for the sensitivity analysis and results should be considered hypothesis generating. To aid in comparing these results to those from randomized trials, we used the Chatellier method of estimating the number needed to treat (NNT) from the odds ratio. 13 We then conducted an interrupted time series (ITS) analysis using segmented regression with propensity-weighting to estimate the change in probability of the primary outcome in patients before and after MAb treatment was available. 14 The segmented regression for ITS analysis was conducted at the individual patient level with days as the time series unit, applying IPTW using the propensity model developed in the post-implementation cohort. The output of the model includes the baseline trend in the pre-implementation group, and the level change and trend change post-implementation in the per-day probability of subsequent emergency department visit or hospitalization. . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021 Finally, we conducted a planned secondary analysis to compare the efficacy of casirivimab/imdevimab with bamlanivimab. We took advantage of the natural experiment resulting from complete transition of infusion centers from bamlanivimab to casirivimab/imdevimab therapy once the latter agent became available. Analyses were restricted to patients who received their treatment at infusion centers and adjusted for residual unbalanced features and secular trend in non-treated contemporaneous controls in a multivariable regression model. Statistical analyses were performed using R, version 4.0.3 (Vienna, Austria). Study elements fulfilled STROBE reporting guidelines for cohort studies. This study was determined to be exempt from review by the Intermountain Institutional Review Board. A total of 13,534 ambulatory patients with symptomatic, laboratory-confirmed COVID-19 with a risk score ≥7.5 points were included in the study, including 7,404 patients in the pre- Table 1 ). Using logistic regression adjusting for gender, obesity and the secular trend in non-treated contemporaneous controls (eTable 4), odds ratio for the primary endpoint for casirivimab/imdevimab versus bamlanivimab was 0.52 (95% CI 0.17-1.63, p=0.26). Both monoclonal antibody products were well tolerated. A total of 7 (1.2%) patients experienced infusion-associated adverse events (Table 3) . Two events (0.3%) were considered severeone patient with known coronary disease developed chest pain during infusion and another had a syncopal episode; both patients were managed in the emergency department with good outcomes. Five (0.8%) mild reactions were observed: pruritis, hives, rigors, nausea/vomiting and oral tingling. None of the mild reactions required premature discontinuation of the infusion and all resolved within hours to days. In this real-world evaluation of SARS-CoV-2 monoclonal antibody infusion therapy, administration of MAb treatment to a high-risk population of ambulatory COVID-19 patients within seven days of symptom onset was associated with significant reductions in subsequent emergency department visits and hospital admissions. For context, the NNT to prevent one medically-attended visit was less than 8. This effect estimate is consistent with sub-group analyses of higher-risk patients from MAb clinical trials, [3] [4] [5] supporting the clinical effectiveness of these drugs and informing optimal patient selection for treatment. It is likely that the estimated effect size in our cohort was due to enrichment for a population both at greater risk for poor outcomes and earlier in the symptom course than specified by the EUA criteria. 1, 2 . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021 These results lend additional support to the concept that passive immune therapies 15 are effective when administered early after symptom onset when viral replication is highest 16 and in patients who fail to mount a robust early humoral response. 5 Of note, while the EUA for both agents authorizes administration for up to 10 days after symptom onset, 1, 2 symptom onset beyond day 7 was an exclusion criterion in the casirivimab/imdevimab trial, 5 and the median time from symptom onset to infusion in the bamlanivimab trial 3 was 4 days. Operationally, we found that because of test-seeking behaviors, scheduling the monoclonal antibody infusion within two days of testing was necessary to achieve infusion within this early window. We employed centralized eligibility review and recruitment paired with a network of infusion locations to identify MAb-eligible patients and meet symptom-to-infusion interval goals. Our patients' experience also corroborates safety data from clinical trials, suggesting that MAb treatment is well-tolerated. Serious events were rare and no anaphylactic-type events were observed. However, data from much larger populations will be necessary to accurately characterize the incidence of rare events. Although we observed a signal suggesting a possible efficacy difference favoring casirivimab/imdevimab over bamlanivimab in reducing medically attended visits, our sample size was inadequate to confirm. This merits further comparative effectiveness investigation in larger cohorts. Early clinical trial data suggest that the efficacy of combination monoclonal antibodies targeting multiple, non-overlapping epitopes may be superior to monovalent products. 4 Differential activity against emerging variant SARS-CoV2 strains may also play a role. In contrast to casirivimab/imdevimab, bamlanivimab may exhibit reduced activity against the E484 17 is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021 Our study has several limitations. First, despite a target trial emulation design and complementary causal inference analyses, it is impossible to fully mitigate biases inherent to observational data. We recognize that in the post-implementation group, unmeasurable or unmeasured confounding factors may influence the estimates for counterfactual treatment effect. This is addressed by the interrupted time series analysis, and we are reassured that this complementary analysis does corroborate the ATT estimate. However, it is possible that unmeasured factors influenced these estimates. Although such interventions are uncommon for ambulatory patients in our health system, we were unable to measure concomitant prescription of other repurposed therapies such as corticosteroids. In addition, date of symptom onset was not available precluding use as inclusion criterion for control group patients. Although our integrated health system provides care for more than two-thirds of all COVID-19 hospitalizations in our region, it is possible that some patients may have been admitted to an ED or hospital outside of our system after testing, resulting in outcome misclassification. Despite intentional and programmatic efforts at both the state and integrated healthcare network level to address healthcare disparities in MAb delivery, we did observe a significantly lower rate of MAb infusion to patients from communities of color. This can be partially understood by the dramatic intercurrent decline in the proportion of non-white patients among positive cases in Utah during the study period, from 56.3% in July 2020 to 27.5% by February 2021. However, this does not fully account for differences in the post-implementation group and highlights the ongoing need to address equity in healthcare access to COVID-19 care. Finally, . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021. ; https://doi.org/10.1101/2021.03.15.21253646 doi: medRxiv preprint our sample size was not sufficiently powered to detect rare adverse events or to make conclusions regarding comparative effectiveness between agents. In a real-world implementation targeting high-risk ambulatory COVID-19 patients within seven days of symptom onset, anti-SARS-CoV-2 monoclonal neutralizing antibody infusion appears to be well-tolerated and effective at preventing subsequent ED visits or hospitalizations. These data may help guide patient selection to maximize effectiveness of MAb therapy, an important consideration given current resource constraints of large-scale MAb deployment as part of public health efforts to decrease hospitalizations. Further, these data might guide implementation of future sustainable delivery models when Mab treatment is no longer government subsidized. Additional data from clinical trials on the impact on mortality, time to symptom resolution, and long-term sequelae are still needed to fully understand the benefit of these agents. Further study in larger real-world cohorts are necessary to better characterize rare infusion-related adverse events and to evaluate the comparative effectiveness of different Mab products. Linking genomic sequencing surveillance and monoclonal treatment data will also be important in future studies to inform differential effectiveness against emerging variant strains. . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021 CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted March 17, 2021 . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) Abbreviations: SD -Standard Deviation, IQI -25%-75% Interquartile Interval a Self-identification as non-white race or Hispanic/Latinx ethnicity b Solid organ or hematopoietic stem cell transplant recipient, human immunodeficiency virus or currently receiving chemotherapy c Body Mass Index ≥30 d Severe adverse events defined as requiring referral to emergency department for management . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) Yes . CC-BY-NC-ND 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted March 17, 2021. ; https://doi.org/10.1101/2021.03.15.21253646 doi: medRxiv preprint An EUA for Bamlanivimab-A Monoclonal Antibody for COVID-19 An EUA for casirivimab and imdevimab for COVID-19. Med Lett Drugs Ther SARS-CoV-2 Neutralizing Antibody LY-CoV555 in Outpatients with Covid-19. The New England journal of medicine Effect of Bamlanivimab as Monotherapy or in Combination With Etesevimab on Viral Load in Patients With Mild to Moderate COVID-19: A Randomized Clinical Trial REGN-COV2, a Neutralizing Antibody Cocktail, in Outpatients with Covid-19. The New England journal of medicine A new method of classifying prognostic comorbidity in longitudinal studies: development and validation Comorbidity measures for use with administrative data. Med Care Utah Crisis Standards of Care Monoclonal Antibody Allocation Guidelines Simple Scoring Tool to Estimate Risk of Hospitalization and Mortality in Ambulatory and Emergency Department Patients with COVID-19 Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available Estimating causal effects from large data sets using propensity scores Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies The number needed to treat: a clinically useful nomogram in its proper context Segmented regression analysis of interrupted time series studies in medication use research Early High-Titer Plasma Therapy to Prevent Severe Covid-19 in Older Adults. The New England journal of medicine SARS-CoV-2, SARS-CoV, and MERS-CoV viral load dynamics, duration of viral shedding, and infectiousness: a systematic review and metaanalysis. Lancet Microbe Increased Resistance of SARS-CoV-2 Variants B.1.351 and B.1.1.7 to Antibody Neutralization. bioRxiv : the preprint server for biology Funding and Conflicts of Interest Declaration: IDP reports salary support through a grant from the National Institutes of Health (NIH) and, outside the present study, grant support from the Centers for Disease Control and Prevention (CDC), Janssen and support to his institution from Asahi Kasei Pharma. SMB reports salary support from the U.S. NIH, CDC and the Department of Defense; he also reports receiving support for chairing a data and safety monitoring board for a respiratory failure trial sponsored by Hamilton, effort paid to Intermountain for steering committee work for Faron Pharmaceuticals and Sedana Pharmaceuticals for ARDS work, support from Janssen for