key: cord-0863671-45pmayol authors: Scott, Jinel; Waite, Stephen; Napolitano, Alexandra title: Restricting Daily Chest Radiography in the Intensive Care Unit: Implementing Evidence-Based Medicine to Decrease Utilization date: 2020-07-09 journal: J Am Coll Radiol DOI: 10.1016/j.jacr.2020.05.035 sha: c727eabf2fe160f83f5c30b1d3b5d94d2df9f810 doc_id: 863671 cord_uid: 45pmayol PURPOSE: In this study, the authors applied evidence-based medicine to decrease the utilization of routine chest radiography in adult intensive care units and used time-driven activity-based costing to demonstrate cost savings. METHODS: A multidisciplinary team was formed with representatives from radiology, surgery, internal medicine, and nursing. The process of performing a portable chest radiographic examination was mapped, and time trials were performed by the radiology technologists and radiology resident. This information was used to determine the cost of performing portable intensive care unit (ICU) chest radiographic studies. The clinical team changed resident education, ordering protocols, and workflows to discontinue the use of routine daily chest radiography, emphasizing that it should be ordered only in specific situations, such as on admission or after central line placement. In addition, as a balancing measure, the team tracked complications such as unplanned extubations and ventilator days. RESULTS: Changing ordering practices in the adult ICUs to align with established evidence-based guidelines resulted in a 37% decrease in the utilization of portable chest radiography between June and December, without a concomitant increase in unplanned extubations or ventilator days. In addition, a proportionate cost savings was realized, as demonstrated by the application of time-driven activity-based costing. CONCLUSIONS: This performance improvement initiative successfully increased the value of care delivered to ICU patients by aligning institutional clinical practice with evidence-based medicine. This resulted in decreased utilization and the cost associated with delivering care without a concomitant increase in complications. A common, yet often overlooked, source of overutilization in radiology comes from daily portable chest radiography (CXR) in intensive care units (ICUs). A study performed by Clec'h et al [1] in 2007 showed that restrictive use of CXR in the ICU resulted in no difference in mortality, length of stay, or ventilator-free days compared with routine, daily use. A subsequent meta-analysis performed by Oba and Zaza [2] in 2010 arrived at the same conclusions. However, despite multiple studies with conclusive evidence, including the ACR's recommending against this practice, a restrictive, event-driven approach has not been uniformly accepted, and at many institutions daily CXR remains the standard [2] . Gershengorn et al [3] found that performing daily CXR, after adjustment for patient case mix and hospital factors, only minimally declined from 2008 to 2014, with a 0% to 3% relative reduction in the odds of use. At Kings County Hospital (KCH) in Brooklyn, New York, a multidisciplinary performance improvement team was assembled with the aim of decreasing the utilization of portable CXR in the adult ICUs. The team aimed to decrease the utilization of portable CXR by 5% between June and December 2019. Setting KCH is an urban, level 1 trauma center in New York City and is 1 of 11 hospitals in NYC Health and Hospitals, the largest public health system in the country. It has both a medical ICU (MICU) and a surgical ICU (SICU). Routine daily radiography is performed between 2 AM and 4 AM to ensure that radiology reports are available for review during rounds. This is during "off hours" and coincides with shifts during which there are fewer radiology technologists (RTs) available because of the demand from the emergency department. A multidisciplinary team was assembled that included stakeholders with interest in performance improvement and patient safety and/or with decision-making capacity. The project leader (first author) reached out directly to all team members, including the directors of the MICU and SICU, the ICU nursing director, the director of cardiothoracic imaging (second author), a radiology resident (third author), and a radiology supervisor. The project was managed by the radiology team, while medicine and surgery team members served as project champions. To design the project, charter members of the performance improvement team met to delineate what we were trying to accomplish, why the project was important, what changes could be made that would result in improvement; to identify barriers to success; to identify outcome measures and balancing measures; and to determine how to show that a change is an improvement. The team also formally identified the project sponsors, project leader, project champions, and team members. Finally, a time line was devised with target start and end dates. Once completed, the performance improvement team adopted the project charter by consensus. The charter established the total scope of the improvement effort (adult ICUs at KCH), defined the objectives (5% reduction of portable CXR utilization from June to December), and outlined the course of action required to achieve the objectives. It aligned with the strategic pillars of KCH, including quality and outcomes, care experience, financial sustainability, and a culture of safety. The project champions embarked on an education campaign targeting residents and critical care attending physicians. They emphasized that daily CXR rarely changes management; the significant disadvantages associated with this practice, including radiation exposure, sleep disturbances, equipment dislodgement, and skin shear injuries from positioning maneuvers; and more accurate and effective methods already in use to evaluate the same information garnered from CXR. For example, endotracheal tube position at the teeth is routinely documented at the time of intubation and daily by respiratory therapy, and central line insertion depth, visible through the dressing, is routinely documented by nursing. They advocated using body weight, fluid input and output data, and point-of-care ultrasound to ascertain fluid status [4] . Finally, instead of relying on CXR to evaluate the progression of pneumonia, clinical indicators such as temperature trends, hypoxemia, secretions, and changing ventilator requirements would be used as a more sensitive strategy to evaluate and track improvement [5] . House staff education was a particular challenge because each month brought a new cohort of residents and interns. Weekly e-mail reminders were sent to residents, and faculty members were tasked with emphasizing the new approach to patient care during rotation orientation and reemphasizing these strategies in daily rounds. In addition, visual cues deployed at workstations served as reminders of the new, restrictive, event-driven approach to ordering radiographs. The practice of standing daily CXR orders on ICU admission was discontinued. Instead, the need for CXR was determined only after examining the patient or on the basis of clinical events such as placement of a line, desaturation, or fever. A hard stop preventing this practice could not be deployed with the electronic health record (EHR) system, so fidelity to the new workflow and practices relied heavily on continuous education and feedback. Project champions adopted an iterative strategy of auditing the ICU census list frequently and providing immediate feedback to the critical care teams. Several steps were undertaken in applying time-driven activity-based costing (TDABC) to this performance improvement initiative. Step 1: Construct Process Map. A detailed process map for performing portable CXR in the ICUs was developed by our RTs (Fig. 1 ). In general, process maps should include all resources directly and indirectly required in each step of the process, including personnel, facilities, and equipment [6] . For simplicity and the purposes of our initiative, we focused on the RT cost. Physician, facilities, and equipment resources were not factored into our assessment. Step 2: Time Each Step in the Process Map. Information on the duration of each step in the process map was obtained through direct visualization (Fig. 1 ). The radiology resident (third author) performed timed trials and recorded the time required at each step (Table 1) . It should be noted that during the time trials, and the most common scenario in general, nurses and additional RTs were not available to assist the RT performing the examination. 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 Step 3: Calculate Capacity Cost Rate for Resource. The capacity cost rate is defined as how much it costs a hospital for a resource to be available for direct patient care [6] ( Table 2 ). This is calculated by dividing the expenses attributable to the resource by the available capacity of the resource. In our scenario, the numerator was equated to the expenses of a staff RT incurred by the hospital (monthly total cost [MTC]), and the denominator was the availability of the RT for patient care (monthly capacity [MC] ). Calculate MTC of a RT. To calculate the MTC, we determined the full annual compensation of the RTs, including salary, benefits, health insurance, pension, and payroll taxes [6] (Table 2) . We then added to this figure other costs that allow RTs to perform their duties, such as supervision costs and IT. This figure was then divided by 12 to arrive at the MTC, that is, how much it costs the system per month to have a RT available. Calculate MC of a RT. This figure was determined by subtracting from 365 days all the time the RT is not available for work during the year, including sick days, 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 vacation days, and holidays ( Step 4: Calculate the Cost of Performing Portable CXR. The cost of performing a single chest radiographic examination was calculated by multiplying the capacity cost rate by the total time used by the RT (Table 2) . Our team aimed for 5% reduction of ICU portable CXR utilization between June and December 2019. After the performance improvement initiative, there was a 37% decrease in the average monthly number of portable chest radiographic examinations performed, from 733 to 463 (Fig. 2) . When the number of chest radiographic examinations is normalized to ventilator days, there was still a decrease, from an average of 1.5 before the intervention to 1.1 after the intervention, a change of 27% (Fig. 3) . Normalized to the volume of patients, before the intervention, there was an average of 4.2 radiographic examinations per patient and 3 per patient after the intervention, representing a 29% decrease (Fig. 3) . Unit-specific pre-and postintervention data demonstrated decreases in utilization from a monthly average of 310 to 177 in the MICU, a 43% decrease (Fig. 4) , and from 361 to 253 in the SICU, a 30% decrease (Fig. 4) . During this period, no increase in ventilator days or the incidence of unplanned extubations was observed (Fig. 3) . Furthermore, by using TDABC, we were able to determine the unit cost of performing a single portable chest radiographic examination at our institution as $15.87. Multiplying this by the total number of studies performed monthly gave the total monthly cost. As a direct result of our intervention, the total average monthly cost of portable CXR decreased from $11,633 before the intervention to $7,348 after the intervention, representing a 37% decrease (Fig. 2) . The implementation of a restrictive approach to ordering portable CXR in the adult ICUs decreased the utilization of portable CXR by 37%, without an increase in complications or unplanned extubations. To achieve our aim, we launched a Choose Wisely campaign in the ICUs, educated residents and attending physicians on the research regarding the utility of daily CXR in the ICU, discontinued the practice of daily standing orders for CXR, and changed the workflow such that CXR was ordered only after clinical determination of necessity. Additional nonquantified benefits included decreased patient radiation exposure, reduced patient sleep disturbances, and decreased risk for tube dislodgement associated with positioning patients for portable radiography. Although the exposure to patients from a single chest radiographic examination is thought to be of minimal risk, cumulative radiation exposure may become significant because of the high frequency of this test [7] . Sleep disturbance is commonly encountered among ICU patients and has significant psychophysiological effects that protract recovery. Sleep disturbance has been found to promote delirium, a contributor to morbidity and mortality in the ICU [8, 9] . A restrictive approach reduces the negative impact caused by sleep disturbance when patients undergo nighttime and early-morning CXR. In addition, bedside CXR is a source of discomfort for patients and carries the risk for accidental removal of devices (catheters, tubes) and microbial dissemination, all resulting in additional costs [10] . Overall, we were able to diminish non-value-added work in the department such that overnight RTs, residents, and attending physicians felt an immediate and positive difference in their work: they were no longer inundated with ICU studies that did not influence patient care. Furthermore, we were able to deploy radiology resources more efficiently and effectively, as the restrictive approach allowed greater access to equipment and staff members for patients most at need, particularly during the period of high demand from the emergency department. Ultimately, the impressive outcomes of this performance improvement initiative are related directly to the significant success the radiology department had assembling a multidisciplinary team of key stakeholders around a common goal and establishing "buy-in" from the clinicians. The project leader (first author) reached out to colleagues from both the MICU and SICU, who accepted that their practice was not reflective of current recommendations from the ACR and several critical care societies. They also recognized that the changes we proposed were not only appropriate on the basis of current recommendations but could be easily implemented. Although there is literature suggesting that a simple request from SICU and MICU directors has been shown to reduce imaging rates, without further intervention, ordering rates will begin to increase eventually [11] . The team understood that to sustain any improvements, a more comprehensive, systematic approach will be needed. Project champions were invaluable in achieving the significant reach we realized throughout this effort. Their outreach and education efforts specifically targeted the critical care faculty, a total of 11 attending physicians, and resulted in 100% participation. Without this level of participation, the adoption of the new approach to care in the adult ICUs would have fallen short, and implementation efforts would have failed. It is important to note that the EHR during this period did not allow a change that would have blocked the old ordering practice, so it was imperative to achieve maximum reach and adoption for superior outcomes. The results of this initiative also demonstrated a positive financial impact to ICU patient management. A similar study published by Keveson et al [12] addressed the financial benefit realized from a restrictive approach to CXR in the ICU. To demonstrate cost savings, they used internally generated estimates of direct and indirect costs as well as those in published literature. This project builds on that by concept by demonstrating another method of determining cost using TDABC, an approach pioneered by Kaplan and Porter [6] . This is meant to be a more accurate accounting of costs. They noted that there is an almost complete lack of understanding of how much it costs to deliver patient care and how it compares with outcomes achieved [6] . Using TDABC can help providers and institutions understand the cost of providing care and can link cost to process improvements and outcomes measures ultimately promoting systemic and sustainable cost reductions [6] . The use of TDABC has been increasing because it is recognized as an essential tool in process improvement and management [13] . As a result of the success of this initiative at KCH, the other 10 acute care hospitals in the enterprise are updating their practice to conform to a restrictive model. By applying the principles of TDABC, we were able to determine that the restrictive model can potentially save the institution about $4,000 a month or $48,000 annually. If the success of this initiative is extrapolated throughout the enterprise, the system can potentially realize savings of about $5 million over the next 10 years. Given the challenges of delivering care in the setting of a safety net organization, this represents a significant amount of savings. The success of this project also represents an opportunity for our department to examine the utility of CXR in other clinical scenarios to determine if the institution's practices align with evidence-based medicine, including routine preadmission or preoperative "clearance" CXR. Applying TDABC to these scenarios can be a powerful tool to link process improvement and improved utilization to cost savings for the institution. The availability of data made it challenging to analyze and report to the stakeholders and team in a timely manner. Data were reported every 4 to 6 weeks, potentially adversely affecting our level of engagement and our ability to continuously engage the team to push beyond "quick wins" into sustainability. Furthermore, toward the end of this project, the hospital migrated to a new EHR, which disrupted the project's flow and the availability of data. Another limitation of this study is that data were not collected that delineated the impact of the education campaign and workflow change separately. For example, the exact number of e-mail reminders sent, opened, and read and the exact number of times residents received education on the new approach were not documented. As a result, it is difficult to independently evaluate how much each intervention contributed to the outcomes we observed. Although we maintained our improvement throughout the length of this project, there is a significant threat of losing these gains in the long term. The education campaign spearheaded by the medical and surgical directors on our team (project champions), though a weak intervention, was extremely successful and resulted in 100% faculty participation. The workflow change they successfully implemented was the stronger intervention and gained significant penetration. However, maintaining fidelity to both interventions (education and workflow change) required a labor-intensive, iterative approach that may not be easily sustainable over a longer period of time or during periods of crisis. For example, KCH has been significantly affected by coronavirus disease 2019 and saw several nonfaculty, non-critical care physicians and even Navy personnel deployed to the critical care units to aid in the response. In addition, some units, like the postanesthesia care unit and medical floors, were converted to makeshift critical care units to accommodate an overwhelming demand for critical care resources. Although the impact of coronavirus disease 2019 on this initiative is yet to be fully determined, it is a safe assumption that there was no time to thoroughly orient and educate these new teams on all the ICU practices, and as a result some physicians may have ordered unwarranted daily CXR. In addition to the already established benefits, this restricted approach would have been the best approach during this crisis to decrease virus transmission to other patients, medical staff members, and RTs. This example affirms that the strongest intervention that would allow better sustainability in the long term would be a change in the EHR that prevents standing orders for daily CXR. -Institutions can safely discontinue the practice of daily ICU CXR, in keeping with already established evidence-based guidelines. -Weak interventions (education) should be coupled with stronger interventions (workflow and process changes and hard stops) for the best outcomes and sustainability. -Tools such as TDABC can be used to determine cost as an outcome measure, gauge the utility of improvement initiatives, alter workflow, and communicate the value proposition to stakeholders. -A multidisciplinary, team-based approach to performance improvement is imperative for superior outcomes in radiology. -The value radiology departments bring to institutions should extend beyond image interpretation. Both radiology leadership and frontline staff members should take a central role in implementing already established, evidence-based practices in imaging. Are daily routine chest radiographs useful in critically ill, mechanically ventilated patients? A randomized study Abandoning daily routine chest radiography in the intensive care unit: meta-analysis Trends in use of daily chest radiographs among US adults receiving mechanical ventilation The utility of point-of-care ultrasound in the assessment of volume status in acute and critically ill patients Management of pneumonia in intensive care How to solve the cost crisis in health care Routine chest xrays in intensive care units: a systematic review and meta-analysis Sleeping on a problem: the impact of sleep disturbance on intensive care patients-a clinical review Delirium in the intensive care unit An integrated approach for prescribing fewer chest x-rays in the ICU Single intervention for a reduction in portable chest radiography (pCXR) in cardiovascular and surgical/trauma ICUs and associated outcomes Adding value to daily chest Xrays in the ICU through education, restricted daily orders and indicationbased prompting Time-driven activity-based costing in radiology: an overview The authors thank the other members of the performance improvement team: Leon Boudourakis, MD (project champion), Anne Fleurimond, RT, Joseph Gorga, MD (project champion), Patrick Hammill, MD, and Gem Snagg, RN. The authors also especially thank the chief quality officer, Geralda Xavier, MD, and her staff, Mikael Phillip and James Fishon, for their support and guidance during this project.