key: cord-0901245-nmbhuj6s authors: Zheng, Neil S.; Warner, Jeremy L.; Osterman, Travis J.; Wells, Quinn S.; Shu, Xiao-Ou; Deppen, Stephen A.; Karp, Seth J.; Dwyer, Shon; Feng, QiPing; Cox, Nancy J.; Peterson, Josh F.; Michael Stein, C.; Roden, Dan M.; Johnson, Kevin B.; Wei, Wei-Qi title: A retrospective approach to evaluating potential adverse outcomes associated with delay of procedures for cardiovascular and cancer-related diagnoses in the context of COVID-19 date: 2020-12-10 journal: J Biomed Inform DOI: 10.1016/j.jbi.2020.103657 sha: a46d18dde60fc78734f6655a85ad4aabee1b17c4 doc_id: 901245 cord_uid: nmbhuj6s OBJECTIVE: During the COVID-19 pandemic, health systems postponed non-essential medical procedures to accommodate surge of critically-ill patients. The long-term consequences of delaying procedures in response to COVID-19 remains unknown. We developed a high-throughput approach to understand the impact of delaying procedures on patient health outcomes using electronic health record (EHR) data. MATERIALS AND METHODS: We used EHR data from Vanderbilt University Medical Center’s (VUMC) Research and Synthetic Derivatives. Elective procedures and non-urgent visits were suspended at VUMC between March 18, 2020 and April 24, 2020. Surgical procedure data from this period were compared to a similar timeframe in 2019. Potential adverse impact of delay in cardiovascular and cancer-related procedures was evaluated using EHR data collected from January 1, 1993 to March 17, 2020. For surgical procedure delay, outcomes included length of hospitalization (days), mortality during hospitalization, and readmission within six months. For screening procedure delay, outcomes included 5-year survival and cancer stage at diagnosis. RESULTS: We identified 416 surgical procedures that were negatively impacted during the COVID-19 pandemic compared to the same timeframe in 2019. Using retrospective data, we found 27 significant associations between procedure delay and adverse patient outcomes. Clinician review indicated that 88.9% of the significant associations were plausible and potentially clinically significant. Analytic pipelines for this study are available online. CONCLUSION: Our approach enables health systems to identify medical procedures affected by the COVID-19 pandemic and evaluate the effect of delay, enabling them to communicate effectively with patients and prioritize rescheduling to minimize adverse patient outcomes. The coronavirus disease of 2019 has significantly impacted health systems and patient care. In February 2020, the Center for Disease Control and Prevention (CDC) released guidelines that recommended deferring elective procedures in inpatient settings to conserve beds and personal protective equipment for a likely surge of critically ill patients with COVID-19. [1] Meanwhile, medical centers experienced fewer admissions for common emergencies such as heart attack and stroke, potentially as a consequence of patient anxiety. [2] [3] [4] Patient anxiety and avoidance of elective or routine care may persist even as health systems lift their restrictions on elective procedures. Studies prior to COVID-19 have shown that delay of certain procedures is associated with increased risk of adverse outcomes such as complications with the procedure or even death. [5, 6] As health systems begin rescheduling procedures, evidence-based guidelines are needed to prioritize procedures for rescheduling and to help educate patients to minimize the impact of COVID-19 on patient outcomes. We developed two complementary approaches, one for inpatient surgical procedures and the other for outpatient screening tests, using Vanderbilt University Medical Center electronic health records (VUMC EHRs) to address several clinical needs. Our surgical procedure approach identifies all inpatient surgical procedures performed routinely, helping hospitals evaluate the effect of COVID-19 on delayed procedures. In this study, we focused only on cardiovascular and cancer-related diagnoses and procedures. Adverse outcomes measured include length of hospital stay, mortality during hospitalization, and 6-month readmission rate. A screening approach examines the potential impact of delaying screening tests or diagnostic tests. Using retrospective data, we estimated cancer screening test delay prior to diagnosis and evaluated its impact on patient outcomes, including 5-year survival and cancer stage at diagnosis. Flowcharts summarizing the approaches to surgical procedure and screening are shown in Figure 1 . The study was approved by the Institutional Review Board of VUMC (#200731). Flowcharts summarizing the separate approaches to surgical and screening procedures to evaluate the potential impact of surgical or screening delay on patient outcomes. Patients who did not receive the diagnosis or did not receive the relevant procedure or screening were excluded from analysis. Phecodes are manually aggregated diagnosis codes for phenome-wide association studies. We used VUMC's Research and Synthetic Derivative, which contains data derived from EHRs between 1993 and 2020 for over three million unique individuals. [7] We identified procedures by Current Procedural Terminology (CPT) -a set of medical codes used to report medical procedures and services -and The International Classification of Diseases, 10th Revision, Procedure Coding System (ICD-10-PCS) -a system of codes used by health insurers to classify medical procedures for billing purposes. All diagnoses that are associated with procedures were converted to ICD-10-CM (Clinical Modification); diagnoses that were coded in ICD-9-CM were mapped to equivalent ICD-10-CM using the Center for Medicare & Medicaid Services' 2018 General Equivalence Mappings (https://www.cms.gov/Medicare/Coding/ICD10/2018-ICD-10-CM-and-GEMs). VUMC ceased elective procedures and non-urgent in-person visits between March 18, 2020 and April 24, 2020, which will hereafter be referred to as the 2020 timeframe. We selected March 18, timeframes. We also counted the number of unique patients who received any inpatient care during established timeframes. Inpatient stays were identified by a built-in flag in the EHR database. The proportion of patients receiving the procedure ( ) approximates the assumption of the binomial distribution, where the patients are independent and the probability each patient receives the procedure ( ) is constant. To check for 2018 and 2019, we calculated the relative ratio and 95% confident intervals for procedures performed in 2018 compared to 2019. We include procedures that have a non-significant change or increased in inpatient proportion between 2018 and 2019, which is indicated when the lower 95% CI for the relative ratio < 1. We then set , the proportion of patients receiving the procedure in 2019. Looking at the number of unique inpatient visits at VUMC for 2018, 2019 and 2020 by month, we observed that the number of inpatient visits during 2020 was greater than during 2019 except for the months of March, April and May (Figure 2) . This is consistent with VUMC's policy of ceasing elective procedures and non-urgent visits through March and April. Therefore, we assumed that the number of inpatient visits in 2020 would have been equivalent or higher than 2019 under non-pandemic circumstance. However, estimating the true number of inpatient visits under a counterfactual scenario for the binomial distribution is difficult. timeframe. Then the probability that patients will receive the procedure during the = 2020 2020 timeframe out of the total of patients is given by the following probability mass = 2019 function: We used one-tailed binomial tests (significance level set at α < 0.05) to determine whether a procedure was performed significantly fewer times when comparing the 2020 to 2019 timeframes. Since we assumed , setting means the binomial test 2020 ≥ 2019 = 2019 provides a conservative estimate for the significance of change in procedure frequency. For this approach, we focused on any surgical procedures (CPT 10004-69990 and any ICD-10-PCS that starts with 0, Supplementary Table 1 ) and excluded procedures related to imaging and diagnostic tests, which are better addressed by the screening approach. We limited this component of the study to only cardiovascular and cancer-related diagnoses, which were identified by ICD codes (Supplementary Table 1 ), due to their greater potential risk of adverse outcomes and mortality resulting from delay. We also grouped procedures using the built-in terminology hierarchy for CPT and ICD-10-PCS to ease the computational burden when identifying diagnoses. To estimate surgical procedure delay, we first identified diagnoses related to each procedure. A procedure can be paired with several diagnoses. For example, coronary artery bypass (ICD-10-PCS 02100Z9) can be paired with 'Total occlusion of coronary artery' (ICD-10-CM I25.82) and 'Atherosclerotic heart disease of native coronary artery with unstable angina pectoris' (ICD-10-CM I25.110). We assumed that most patients who received a procedure during an inpatient visit also received a corresponding diagnosis code during the same visit. Using historical data from January 1, 1993 to March 18, 2020, we counted the number of co-occurrences between procedures and diagnoses during the same inpatient visit. We kept diagnosis-procedure pairs that co-occurred in 50 or more inpatient visits, which is an arbitrary threshold that is adjustable for future studies to reduce computational burden and unstable statistical estimation due to small sample size. Then, for each diagnosis-procedure pair, we calculated the proportion of patients with the diagnosis that received the procedure using historical data. This proportion helped filter out common diseases that may co-occur frequently with unrelated procedures only due to their high prevalence. For example, hypertension has high prevalence and co-occurs frequently with many cardiovascular surgical procedures, but the more likely intent of the surgical procedures is to treat a specific cardiovascular disease rather than to treat hypertension. We kept diagnosis-procedure pairs where the proportion of diagnosed patients receiving the procedure  0.10. This threshold can be reduced to include more uncommon procedures. After the diagnosis-procedure pairs were identified, we determined the first diagnosis date and first procedure date after diagnosis for each patient across their whole EHR. Patients who did not undergo procedure were excluded from analysis. Procedure delay was defined as the difference between the first diagnosis date and the first procedure date after diagnosis. Patients whose first diagnosis date was the same as their procedure date were assigned a delay of 0 (e.g., emergency surgical procedures). However, VUMC is a tertiary care center and some patients may only visit VUMC for their procedure to treat a chronic condition. Since these patients have no previous EHRs at VUMC, it may appear as if these patients' first diagnosis dates and procedure dates were equivalent, causing an underestimation of true procedure delay. Therefore, we only included patients with at least one outpatient visit prior to their first diagnosis. Using historical inpatient and outpatient data from January 1, 1993 to March 18, 2020, we investigated the potential impact of delaying screening tests settings prior to breast, colorectal, lung, and prostate cancer diagnosis. Recent studies have shown a significant decrease in cancer screenings and newly diagnosed cancers during the COVID-19 pandemic. [8, 9] Therefore, cancer screening tests were highly likely to have been delayed during COVID-19. We supply phecodes, which are manually aggregated diagnosis codes for phenome-wide association studies, [10, 11] Therefore, in our analyses, we adjusted for frequency of screening test, which was defined as years between the age at which clinical guidelines recommend regular testing to age at diagnosis divided by the number of screening tests the patient received prior to diagnosis. Tests that took place within one month of the diagnosis date were likely involved in the diagnosis and were therefore excluded. For surgical procedures, the primary outcomes were length of hospital stay, mortality during hospitalization and readmission within 6 months. We defined the hospitalization length to be the days between the procedure date and the discharge date. Mortality during hospitalization was defined as death in hospital following procedure date. Readmission within 6 months was defined as any inpatient or emergency visits within 6 months after discharge from a procedural inpatient stay. For screening procedures, the primary outcomes were 5-year survival and cancer stage at diagnosis. Since the cause of death was not available for all patients, we determined survival status for the 5-year timeframe after the diagnosis date, assuming that the majority of deaths during this 5-year timeframe can be attributed to the diagnosed cancer. We identified the cancer stage at diagnosis using VUMC's cancer registry data. We performed linear regression analyses between surgical procedure delay (months) and hospitalization length (days), as well as logistic regressions for mortality during hospitalization and readmission within 6 months. Regression models were adjusted for sex, race, age at the first diagnosis, insurance type (Commercial, Medicare, Medicaid, Other Government, Other), and the year that the procedure was performed. We also evaluated the potential impact per 6-months of delay in screening. We employed Cox proportional hazard models to evaluate 5-year survival, censoring at any-cause death or last follow-up date. We treated the cancer stage as an ordinal outcome variable in logistic regressions. All models were adjusted for sex, race, age at the first diagnosis, insurance type, the year that the procedure was performed, and the frequency of screening test prior to the first diagnosis. All statistical analyses were performed with R version 3.6.1. Statistical tests were based on 2tailed probability and a significance level set at α<0.05. Three clinicians independently reviewed all the significant associations between procedure delay and adverse patient outcomes: cardiovascular-related associations were reviewed by one cardiologist and cancer-related associations were reviewed by two oncologists. The reviewers were provided the procedure, diagnosis, outcome and effect size and were asked to indicate whether the association was plausible or implausible. A third clinician reviewed any disagreements between the two oncologists. As of June 2020, there were 3,169,625 individuals with available EHRs in VUMC's Research and Synthetic derivatives, including data collected from as early as January 1, 1993. Demographic data is presented in Table 1 . Most patients are adults with several years of EHR data available for retrospective analysis. We Table 2 ). Table 2 shows the 10 inpatient procedures that were most significantly negatively impacted during the 2020 timeframe compared to the 2019 timeframe. Closure of enterostomy, large or small intestine 23 4 82. 6 1.42  10 -6 a P-value derived from one-tailed binomial tests. Of the 416 inpatient surgical procedures, we identified 718 diagnosis-procedure pairs. We found 27 significant associations between surgical procedure delay and patient outcomes (Supplementary Table 3) , including 22 associations for adverse patient outcomes such as increased hospitalization length or higher risk of readmission. The top 10 associations between procedure delay (months) and adverse patient outcomes are reported in Table 3 . There are some procedures that are coded both in CPT and ICD-10-PCS and therefore may appear more than once (e.g., coronary artery bypass). Patients may receive both a CPT and ICD-10-PCS code when receiving a procedure. a CKD = chronic kidney disease; ESRD = end stage renal disease. b Procedure descriptions are abbreviated from description. c Reporting percentage reduction in volume of respective procedure group between 2019 and 2020 timeframes d N represents the number of individuals included in analysis for each diagnosis-procedure pair from historical data. e Hospital LOS = hospitalization length of stay (days); 6-month readmission = any-cause inpatient or emergency room readmission within 6 months after discharge from a procedural inpatient stay. f Reported betas and odds ratios (OR) are per month of procedure delay. Beta and 95% CIs are derived from linear regression models with hospitalization length (days) as the outcome. OR and 95% CIs are derived from logistic regression models with mortality during hospitalization and readmission within 6 months as the outcomes. All models were adjusted for sex, race, age at first diagnosis, insurance type, and year that procedure was performed. In this study, we selected four common cancer screening tests to demonstrate the screening approach: colonoscopy for colorectal cancer, low-dose computed tomography (CT) for lung cancer, mammography for breast cancer, and prostate specific antigen (PSA) test for prostate cancer. Results from association analyses between delay of cancer screening tests (per 6-months) and patient outcomes are reported in .619 a CT = computed tomography; PSA = prostate-specific antigen b N represents the number of cancer patients that received screening tests prior to diagnosis that were included in analysis from historical data. Cancer staging data was only available for patients diagnosed at VUMC. c Reported hazard ratios (HR) and odds ratios (OR) are per 6-months of screening test delay. HR and 95% CIs are derived from Cox proportional hazard models for 5-year survival. OR and 95% CIs are derived from ordinal logistic regression models for cancer stage at diagnosis. All models were adjusted for sex, race, age at first diagnosis, insurance type, screening test frequency, and year that diagnostic test was performed. There were 32 significant associations between procedure delay and adverse patient outcomes, including 27 surgical procedure associations and 5 screening associations. The combined review of the surgical and screening procedure approaches indicated that 24 out of 32 (75.0%) significant associations between procedure or screening delay and patient outcomes were plausible. Clinicians identified 19 of 22 (86.4%) of the associations for surgical procedure delay and adverse patient outcomes (e.g., increased hospital length of stay) as plausible. For the screening approach, both oncologists classified all five of the significant associations between delay of cancer screening and 5-year mortality or cancer stage at diagnosis as plausible and potentially clinically significant. Our approaches to evaluate surgical procedures and cancer screenings offer complementary perspectives to help health systems reschedule procedures and educate patients on the potential risks of delaying procedures. Clinician review indicated that the majority of the identified significant associations were plausible and potentially clinically significant. Both approaches are built for EHRs structured with the widely adopted Observational Medical Outcomes Partnership (OMOP) Common Data Model, which will allows medical centers to efficiently implement and adapt the pipeline for their own analyses. [12] The surgical procedure approach provides a high-throughput method to identify procedures negatively impacted by COVID-19 and evaluates potential adverse patient outcomes that may result from delaying procedures. For instance, our top association indicated that delay of coronary artery bypass for patients with atherosclerotic heart disease is associated with increased hospitalization length, which is consistent with previous studies that showed delays of coronary artery bypass are associated with in-hospital mortality. [13] On the other hand, clinician review marked a few associations as implausible, such as the association between one-month delay of removal of implantable defibrillator and reduced 6-month readmission for patients with ventricular fibrillation. The screening procedure approach allows risk assessment for patients that delayed their screening due to COVID-19. We found that a six-month delay in cancer screening was associated with increased 5-year mortality in patients who were diagnosed with colorectal, lung, and prostate cancer, and with having a more advanced cancer stage at breast and lung cancer diagnosis. Mammography delay was not significantly associated with 5-year mortality, which is likely attributed to the high 5-year survival rate for breast cancers (90% for all stages combined for cases diagnosed between 2008 and 2014). [14] Studies have shown that early detection and treatment for breast and lung are associated with improved disease-specific and overall survival. [15] [16] [17] [18] [19] A delay in screening due to COVID-19 may delay the date of diagnosis, thereby also influencing the time from diagnosis to treatment. There is, however, mixed-evidence on the benefits of frequent PSA test for screening asymptomatic, average-risk patients compared to the potential harms. [20] [21] [22] [23] [24] Given that all the individuals included in analysis were eventually diagnosed with cancer, it is possible that some of the administered PSA tests that preceded cancer diagnosis were for surveillance after the initial screening test was indicative of a suspected cancer or high-risk of developing cancer. Nonetheless, the results suggest that health systems should communicate with the patients about the importance of regular screenings, especially to high-risk patients such as those with family history or other identified risk markers. It is worth pointing out that while our demonstration included only cardiovascular and cancer-related diagnoses, our approach can be easily adapted to analyze any subset of diagnoses. For instance, the screening pipeline can be adapted to evaluate non-cancer outcomes, such as diabetic retinopathy or diabetic foot problems. There are limitations to our definition of procedure and screening delay. There is no structured variable indicating the date that the healthcare provider recommended a procedure for a patient. Our definition for surgical procedure delay (the difference between first diagnosis date and first procedure date post-diagnosis) may overestimate the true procedure delay. For instance, patients with chronic conditions may not need a procedure immediately and a longer time lag does not necessarily indicate a procedure delay. Additionally, previous studies have demonstrated that the chart fragmentation and lack of longitudinal data may harm phenotyping performance. [25, 26] Since VUMC is a tertiary care center, there may be some patients whose diagnoses or procedures were recorded at another healthcare setting. We only included patients with at least one outpatient visit prior to their first diagnosis to help capture a more comprehensive medical history. Nonetheless, an overestimation of surgical procedure delay likely results in an underestimation of the impact of procedure delay on adverse patient outcomes. Similarly, there is no structured variable indicating when a patient is due for a recommended screening test and some patients may not have been overdue when diagnosed. We adjusted our analysis by frequency of screening test to control for differences in screening recommendations. Additionally, we used retrospective data to estimate the consequences of delays in procedures on outcomes, where historical delays may not fully reflect delays related to COVID-19. However, delays related to COVID-19 may actually compound upon delays that patient would typically experience under non-pandemic circumstances. Since we estimated delay across hundreds of diagnosis-procedure pairs, validating our delay estimates is difficult in a high-throughput manner. Therefore, our definitions for delay should be treated as the current best estimates using retrospective data. Despite these limitations, a majority (75.0%) of the significant associations by our approach were marked as plausible by clinician reviewers, supporting the potential of our approach as a discovery tool. While procedure and screening delay may contribute to adverse patient outcomes, there are many other reasons that may also contribute to adverse patient outcomes, such as surgical complications, comorbidities, or disease severity. In our analysis, we adjusted for several important cofounders, such as type of insurance or age at diagnosis, but other factors like disease severity may impact the procedure delay and outcomes. However, identifying additional cofounders across many diseases and procedures, such as disease severity, can be difficult to do in a high-throughput manner. In addition, detailed characterization of patient features with respects to different outcomes would be helpful to better understand the findings but is difficult with outcomes for several hundred diagnosis-procedure pairings. Further study is needed to detail the underlying reasons for associations found in this study. Our analyses are also limited by considering all-cause inpatient readmission and all-cause mortality. Cause of death was only available for those who died during in-hospital stay at VUMC, limiting detailed analyses. Future research investigating disease-specific readmission or mortality may help better explain the observed associations. There is no standardized list of elective procedures that is readily available to allow a comprehensive evaluation of all procedures that were ceased or delayed across health systems. Some of the associations identified by our surgical procedure pipeline involve procedures that may be considered by the health system to be essential and non-elective. However, several studies have reported fewer hospital admission for life-threatening conditions such as stroke and myocardial infarction during COVID-19. [2] [3] [4] Therefore, identifying and characterizing procedures that have been affected by COVID-19, elective or non-elective, would help health systems identify and prioritize vulnerable patients and bring them back for required procedure(s) to reduce the risk adverse outcomes related to the delay. While clinicians might have intuitive knowledge of what procedures are being impacted, our approach can enable health systems and leaders to determine what can be safely delayed and to be more proactive about what cannot be delayed at a more granular level. This could help with hospital space and personal protective equipment planning and help take pressure off the clinicians who might have to evaluate "medical necessity" when ordering procedures. In addition, our findings may be valuable during physician-patient communications to help patient make informed decisions when considering the risks of delaying selected procedures and the risk of COVID-19 transmission during inpatient visits. Our approach also encounters issues that are inherent to how patient data is entered into EHRs. For instance, Papanicolaou tests are a screening for cervical cancer and were likely impacted by COVID-19. However, Papanicolaou tests are typically entered into EHRs using a generic code for preventative medical examination, which makes it difficult to determine if a patient received the screening. Natural language processing on clinical notes may address these issues in the future. In summary, our high-throughput approach can help health systems identify and prioritize procedures and vulnerable patient population. The surgical procedure and screening approaches are portable and flexible, allowing for natural adaptations to each health system's unique needs or for future pandemic-like events. Moreover, our results demonstrate that informatics approaches can provide critical insights towards minimizing the adverse patient outcomes during unexpected times of crisis. The surgical procedure and screening pipelines are made freely available for download at https://github.com/nszheng/procedure-delay. Both pipelines are written using structured query language (SQL) and R for EHRs structured within the OMOP Common Data Model. [12] The study was supported by National Institutes of Health (NIH) under grant numbers P50 GM115305, R01 HL133786, RO1 GM120523, R35 GM131770, and NIH/National Cancer Institute (NCI) Cancer Center Support Grant P30 CA068485. The dataset used for the analyses described were obtained from Vanderbilt University Medical Center's resources, the Research and Synthetic Derivative, which are supported by institutional funding and by the National Center for Advancing Translational Science grant 2UL1 TR000445-06 from NCATS/NIH. The funders had no role in study design, data collection, and analysis, decision to publish, or preparation of the manuscript. Center for Disease Control and Prevention. Healthcare Facilities: Preparing for Community Transmission Reduction in ST-Segment Elevation Cardiac Catheterization Laboratory Activations in the United States during COVID-19 Pandemic Hospital admissions for strokes appear to have plummeted, a doctor says, a possible sign people are afraid to seek critical help. The Washington Post The Covid-19 Pandemic and the Incidence of Acute Myocardial Infarction Reexploration for bleeding after coronary artery bypass surgery: risk factors, outcomes, and the effect of time delay Early mortality after hip fracture: is delay before surgery important? Secondary use of clinical data: the Vanderbilt approach Effects of the COVID-19 Pandemic on Cancer-Related Patient Encounters Changes in the Number of US Patients With Newly Identified Cancer Before and During the Coronavirus Disease 2019 (COVID-19) Pandemic PheWAS: demonstrating the feasibility of a phenome-wide scan to discover gene-disease associations Mapping ICD-10 and ICD-10-CM Codes to Phecodes: Workflow Development and Initial Evaluation Feasibility and utility of applications of the common data model to multiple, disparate observational health databases Delay in admission for elective coronary-artery bypass grafting is associated with increased inhospital mortality Cancer statistics Timing and Delays in Breast Cancer Evaluation and Treatment An overview of prognostic factors for long-term survivors of breast cancer Role of detection method in predicting breast cancer survival: analysis of randomized screening trials Natural history of stage I non-small cell lung cancer: implications for early detection Survival of patients with stage I lung cancer detected on CT screening Screening for prostate cancer with the prostate-specific antigen test: a review of current evidence Early detection of prostate cancer: AUA Guideline Are physicians doing too much colonoscopy? A national survey of colorectal surveillance after polypectomy Prostate-specific antigen and prostate cancer: prediction, detection and monitoring Guidelines for colonoscopy surveillance after screening and polypectomy: a consensus update by the US Multi-Society Task Force on Colorectal Cancer Impact of data fragmentation across healthcare centers on the accuracy of a high-throughput clinical phenotyping algorithm for specifying subjects with type 2 diabetes mellitus The absence of longitudinal data limits the accuracy of high-throughput clinical phenotyping for identifying type 2 diabetes mellitus subjects