key: cord-0863085-tq57agth
authors: SYED, Shorabuddin; SYED, Mahanazuddin; PRIOR, Fred; ZOZUS, Meredith; SYEDA, Hafsa Bareen; GREER, Melody L.; BHATTACHARYYA, Sudeepa; GARG, Shashank
title: Machine Learning Approach to Optimize Sedation Use in Endoscopic Procedures
date: 2021-05-27
journal: Stud Health Technol Inform
DOI: 10.3233/shti210145
sha: 2cd245f0e695c33aa35231450091c203ba3f6652
doc_id: 863085
cord_uid: tq57agth

Endoscopy procedures are often performed with either moderate or deep sedation. While deep sedation is costly, procedures with moderate sedation are not always well tolerated resulting in patient discomfort, and are often aborted. Due to lack of clear guidelines, the decision to utilize moderate sedation or anesthesia for a procedure is made by the providers, leading to high variability in clinical practice. The objective of this study was to build a Machine Learning (ML) model that predicts if a colonoscopy can be successfully completed with moderate sedation based on patients’ demographics, comorbidities, and prescribed medications. XGBoost model was trained and tested on 10,025 colonoscopies (70% - 30%) performed at University of Arkansas for Medical Sciences (UAMS). XGBoost achieved average area under receiver operating characteristic curve (AUC) of 0.762, F1-score to predict procedures that need moderate sedation was 0.85, and precision and recall were 0.81 and 0.89 respectively. The proposed model can be employed as a decision support tool for physicians to bolster their confidence while choosing between moderate sedation and anesthesia for a colonoscopy procedure.

About 17-20 million endoscopy procedures are performed in the United States annually [1] . Traditionally, moderate sedation has been used to perform these procedures. However, in 10-33% of cases, patients do not tolerate the sedation well leading to an aborted or incomplete procedure that is repeated with anesthesia [2] . Deep sedation provided by an anesthesiology provider is an alternate to moderate sedation. It is highly successful but expensive and not as widely available [3] . At present, the decision to utilize moderate sedation or anesthesia for a procedure is made by the providers leading to a high variability in clinical practice. Prediction scores to determine tolerance of moderate sedation for endoscopy procedures have been developed. However, these scores are modest in predicting the success of moderate sedation (AUC <70%) [4] .

Artificial Intelligence (AI) techniques including Machine Learning (ML) and Deep Learning (DL) are being used in a variety of clinical applications ranging from diagnosis to outcome prediction [5] [6] [7] . ML is an iterative process in which the algorithm tries to find the optimal combination of both model variables and variable weights with the goal of minimizing error in the predicted outcome [8] . With ease of data extraction from Electronic Health Record (EHR) systems, prediction accuracy of the AI models is surpassing clinical experts in certain domains [9] . A limited number of studies have applied AI techniques to improve quality of endoscopy procedures, specifically on the optimal method of sedation. To address this knowledge gap, we built a ML model to determine if a colonoscopy can be successfully completed with moderate sedation.

This is an Institutional Review Board (IRB) approved retrospective study that included all patients undergoing colonoscopy at the University of Arkansas for Medical Sciences (UAMS) from May 1st, 2014 to August 31st, 2020. UAMS is an integrated health care delivery organization that utilizes the EPIC platform (Epic Systems Corp, Verona, WI) for electronic health records (EMR). All adults (>=18 years of age) who had a colonoscopy with moderate sedation at UAMS during the study period were identified in the EMR. Patients who had colonoscopy: 1) with anesthesia, 2) without sedation, 3) with another procedure on same day, or 4) with documented poor bowel preparation were excluded from the study.

The features included in this study were based on literature and feedback from a panel of board-certified gastroenterologists [4, 10] . The selected features included Body mass index (BMI) recorded at the time of the procedure, demographics (age, gender, race, ethnicity, zip code), history of smoking or alcohol use, illicit substances use, visit type (inpatient, outpatient, emergency), comorbidities, current medications that can affect tolerance of moderate sedation, provider performing the procedure, and total procedure time. Co-morbid illness assessment was done by calculating the Elixhauser Comorbidity Index (ECI) score using the Van Walraven algorithm [11, 12] . Patients were divided into 4 groups based on BMI: BMI<30, class I obesity (BMI 30-34.99), class II obesity (BMI 35-39.99) and class III obesity (BMI 40 and above). Medications that can alter the tolerance or efficacy of moderate sedation were grouped into seven categories: 1) opiates, 2) antihistamines, 3) antiepileptic, 4) non-benzodiazepine hypnotics, 5) anti-depressants or anti-anxiety, 6) benzodiazepines, and 7) antipsychotics. Total number of these medicines were calculated for each patient from their medication list at the time of the procedure. Most of the colonoscopies were performed by gastroenterologists and each provider was treated as a separate category. Hepatologists and surgeons performed significantly fewer procedures. Therefore, they were kept as two groups.

The primary outcome of this study was to determine if a procedure could be successfully performed with ≤ 10 units of moderate sedation. Midazolam and Fentanyl are used for moderate sedation at UAMS. Based on literature and feedback from a panel of boardcertified gastroenterologists [4, 10] , a sedation unit was defined as: 1) Midazolam 1 mg = 1 unit, and 2) Fentanyl 25 mcg = 1 unit. Each procedure in the dataset was labelled as low or high sedation based on the cutoff of 10 sedation units.

The features were normalized by subtracting the mean and dividing by the standard deviation. The dataset was randomly split into a training and a test set (70% -30%). We developed the model to predict required sedation level for colonoscopy procedures using XGBoost [13] . The model was tuned and trained with the following hyperparameter settings: max_depth = 3, eta = 0.1, gamma = 0.2, min_child_weight = 4, subsample = 1, and nrounds = 145, the other hyperparameters were set to their default values. As the dataset was imbalanced, we used 10-fold cross validation. Performances of the model on the test set was evaluated by the following metrics: AUC, prediction accuracy, precision, and F1 scores.

After applying the exclusion criteria, the final dataset included 10,025 colonoscopies performed on 8,681 distinct patients during the study period. Procedures done with low and high sedation were 7,404 and 2,621 respectively. Demographics and clinical characteristics of patients undergoing colonoscopy procedure for both training and validation set is shown in Table 1 . The top three patient comorbidities in the dataset were hypertension (73%), obese (43%), and depression (36%). Before the colonoscopy schedule date, 25.1% of patients were on opioids (any of the aforementioned seven opioid categories). The 10 fold cross-validated AUC on the testing set was 0.762 [0.753-0.777], F1-score on predicting procedures that need moderate sedation was 0.85, precision and recall were 0.81 and 0.89 respectively. However, the F1 score for predicting high sedation procedure was 0.46. The AUC-ROC of the prediction model is shown in Figure 1 .

We used a secondary model, Random Forest (RF) [14] to identify which discrete features were most influential in predicting sedation levels for the colonoscopy procedures. The top three features were: 1) physician performing the procedure, 2) total procedure time, and 3) patient's age.

To our knowledge, this is the first study to evaluate the use of ML to predict if a patient will require low or high dose of moderate sedation to have a successful colonoscopy. The XGBoost model achieved reliable accuracy (over 80%) in predicting procedures that could successfully be completed with moderate sedation. This is clinically meaningful as these patients can be scheduled for a colonoscopy with moderate sedation with a low rate of failure. Physician performing the procedure, total procedure time and age of the patient were the most important features and are consistent with observations in clinical practice. In addition, most of these features are included in the high conscious sedation requirements (HCSR) score built by McCain et al, 2020 [4] . According to the HCSR score, patient age has significant association to the level of sedation needed for successful completion of the procedure [4] . Physicians tend to have a significant variation in their sedation administration during the procedure that depends on their prior training, experience and patient population. Higher sedation doses are needed for longer procedures and for younger patients, and sedation requirements are expected to decrease with increasing age or shorter duration of a procedure.

There are multiple limitations to this study that we wish to acknowledge. We only included medication prescribed at UAMS and not active medications that the patients were on before the procedure. The active medication list is documented as free text and needs extensive chart review. In addition, the model's accuracy to predict procedures needing high sedation was less when compared to moderate sedation, further analysis is needed to understand features corresponding to deep sedation procedures. To overcome the mentioned limitations and improve the model's prediction accuracy, we intend to add more data to this model, to increase its accuracy over time so that it can be implemented in daily clinical practice to guide the choice of sedation for a colonoscopy.

Patients' data used were obtained under IRB approval (IRB# 262202) at the UAMS. This study was supported in part by the Translational Research Institute (TRI), grant UL1 TR003107 received from the National Center for Advancing Translational Sciences of the National Institutes of Health (NIH). The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. 

Burden of gastrointestinal disease in the United States: 2012 update

Upper gastrointestinal bleeding: incidence, etiology and outcomes in a population-based setting

Substantial Increase in Anesthesia Assistance for Outpatient Colonoscopy and Associated Cost Nationwide. Clinical gastroenterology and hepatology : the official clinical practice journal of the

Creation of a score to predict risk of high conscious sedation requirements in patients undergoing endoscopy

Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology

Role of Machine Learning Techniques to Tackle the COVID-19 Crisis: Systematic Review

Application of Machine Learning in Intensive Care Unit (ICU) Settings Using MIMIC Dataset: Systematic Review

Comparing different supervised machine learning algorithms for disease prediction. BMC medical informatics and decision making

Improving the accuracy of medical diagnosis with causal machine learning

Safety and Efficacy of Moderate Sedation in Super Obese Patients Undergoing Lower and Upper GI Endoscopy: a Case-Control Study. Obesity surgery

A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data

Toolkit to Compute Time-Based Elixhauser Comorbidity Indices and Extension to Common Data Models

A Scalable Tree Boosting System

Random Forests