key: cord-0692083-sjcq70hq
authors: Ross, Patrick A.; Engorn, Branden M.; Newth, Christopher J. L.; Gordon, Chloe; Soto-Campos, Gerardo; Bhalla, Anoopindar K.
title: Declining Procedures in Pediatric Critical Care Medicine Using a National Database
date: 2021-03-05
journal: Crit Care Explor
DOI: 10.1097/cce.0000000000000359
sha: ca320537ef3eacc38c013cb1f4f40c839ec81192
doc_id: 692083
cord_uid: sjcq70hq

OBJECTIVES: To investigate the change in rate of invasive procedures (endotracheal intubation, central venous catheters, arterial catheters, and peripheral inserted central venous catheters) performed in PICUs per admission over time. Secondarily, to investigate the change in type of respiratory support over time. DESIGN: Retrospective study of prospectively collected data using the Virtual Pediatric Systems (VPS; LLC, Los Angeles, CA) database. SETTING: North American PICUs. PATIENTS: Patients admitted from January 2009 to December 2017. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: There were 902,624 admissions from 161 PICUs included in the analysis. Since 2009, there has been a decrease in rate of endotracheal intubations, central venous catheters placed, and arterial catheters placed and an increase in the rate of peripheral inserted central venous catheter insertion per admission over time after controlling for severity of illness and unit level effects. As compared to 2009, the incident rate ratio for 2017 for endotracheal intubation was 0.90 (95% CI, 0.83–0.98; p = 0.017), for central venous line placement 0.69 (0.63–0.74; p < 0.001), for arterial catheter insertion 0.85 (0.79–0.92; p < 0.001), and for peripheral inserted central venous catheter placement 1.14 (1.03–1.26; p = 0.013). Over this time period, in a subgroup with available data, there was a decrease in the rate of invasive mechanical ventilation and an increase in the rate of noninvasive respiratory support (bilevel positive airway pressure/continuous positive airway pressure and high-flow nasal oxygen) per admission. CONCLUSIONS: Over 9 years across multiple North American PICUs, the rate of endotracheal intubations, central catheter, and arterial catheter insertions per admission has decreased. The use of invasive mechanical ventilation has decreased with an increase in noninvasive respiratory support. These data support efforts to improve exposure to invasive procedures in training and structured systems to evaluate continued competency.

P ediatric Critical Care Medicine (PCCM) intensivists need initially to learn and subsequently to maintain the skills necessary to provide both airway support and vascular access to critically ill patients. In a recent single-center study, we demonstrated a decline over time in the number of arterial catheter and central venous catheter (CVC) placed by pediatric critical care fellows during their training (1) . It is possible there has been a www.ccejournal.org xxx 2021 • Volume 3 • Number 1 decline in the rate of procedures performed in PICUs, in general, over time, due to an increase in noninvasive ventilation and use of peripherally inserted central catheters (PICCs). There is concern that performing fewer procedures over time may translate into decreased competency of physicians and in turn greater risk for patients. Through reviewing the procedures performed in PICUs using a national database, we sought to assess our hypothesis that over time, invasive procedures performed in PICUs across North America have decreased. Our primary outcome was the change in the rate of invasive procedures performed per admission.

The study was approved by our local institutional review board (Children's Hospital Los Angeles CHLA-18-00125). We performed a retrospective analysis of prospectively collected data using the Virtual Pediatric Systems (VPS; LLC, Los Angeles, CA) database from January 2009 to December 2017. Data from years that an ICU did not submit Pediatric Risk of Mortality (PRISM) III scores were excluded.

Data abstracted included the total number of admissions, procedures, types of respiratory support, and mean PRISM III scores per ICU per calendar year. All procedures recorded were noted to be placed in PICU and not present at admission.

To address the effect of change in procedures relative to concurring changes in the PICU workforce, we also extracted data from publications by the American Board of Pediatrics Physician Workforce.

Our primary outcome was the change in the rate of procedures per admission. Procedures included the following: endotracheal intubations, insertion of CVC, arterial catheters, and PICC. In a subgroup with respiratory support data available, we investigated the rate of use of types of respiratory support per admission including conventional mechanical ventilation (CMV), high-frequency oscillatory ventilation (HFOV), noninvasive respiratory support with pressure as bilevel positive airway pressure (BiPAP) and continuous positive airway pressure (CPAP), and noninvasive respiratory support without pressure as high-flow nasal oxygen (HFNO).

Data are expressed as total counts, percentages, and medians (interquartile range). We used a line graph to demonstrate the change in percentage of procedures performed per admission over time. Count data were evaluated and found to be overdispersed with a variance much greater than mean value. Therefore, the data fit a negative binomial regression model. For multivariable analysis, we used a multilevel mixed effects negative binomial regression model adjusting for number of admissions and controlling for unit level effects. We present the incidence rate ratio (IRR) for the procedures performed as predicted from the regression model. Initial evaluation of data showed a change in the severity of illness measured with PRISM III over time. The multivariable analysis was repeated controlling for number of admissions, unit level effects, and mean value of PRISM III per unit per year. Year was treated as a categorical value modeled with the reference year of 2009.

In the VPS dataset there were 932,500 admissions from January 2009 to December 2017. After excluding admissions without unit specific yearly PRISM III data, there were 902,624 admissions available for analysis ( 

Over the 9 years of the study, there was a decline in the percentage of intubations, CVC insertion, and arterial catheter insertion per admission, whereas percentage of PICC insertions per admission remained constant (Table 1 and Fig. 1) . In multivariable modeling, the IRR of intubations, CVC insertion, and arterial catheter insertion decreased, and the IRR of PICC insertion increased from 2009 to 2017 after controlling for unit level severity of illness per year (PRISM III) as well as unit level effects ( Table 2) . These results were consistent when PRISM III was not included in the modeling (Supplemental Table 1 , Supplemental Digital Content 1, http://links.lww. com/CCX/A521).

Over the 9 years of the study, in a subgroup with available data, there has been a decline in the percentage of admissions receiving CMV and HFOV ( Table 3 and Fig. 2) . In multivariable modeling, the IRR decreased from 2009 to 2017 for CMV and HFOV after controlling for initial severity of illness (PRISM III) as well as unit level effects ( Table 4 ). In multivariable modeling, the IRR increased for noninvasive ventilation with either BiPAP/CPAP or HFNO from 2009 to 2017 after controlling for initial severity of illness (PRISM III) and unit level effects (Table 4 ). These results were consistent when PRISM III was not included in modeling (Supplemental Table 2 , Supplemental Digital Content 1, http://links.lww.com/CCX/A522).

From the American Board of Pediatrics Physician Workforce Data in 2009, there were 371 total fellows and 1,654 board-certified faculty less than 70 years old. By 2017, this increased 42% to 527 fellows and 35% to 2,234 faculty, a net increase of 36% (2, 3). Using a subset of our data for units that contributed to the dataset in both 2009 and 2017, although admissions increased by 63%, the net increase in procedures was less (intubations 50.4%, arterial catheters 35.4%, and CVC 7.3%) except for PICC catheters which increased by 94.7%.

Our study shows that over 9 years in North American PICUs, there has been a significant decrease in the rate of invasive procedures (endotracheal intubations, CVC insertions, and arterial catheter insertions) per admission. In the same time period, use of invasive ventilation has decreased, and noninvasive methods of respiratory support have increased. The decreasing intubations may reflect the change in practice patterns with rising noninvasive ventilation (4, 5) . It is possible that the decline in arterial catheter placement reflects an acceptance of pulse oximetry and capnometry in the management of pediatric respiratory failure. We believe our study has serious implications for the field of PCCM. There has been a decrease over time in the number procedures performed by residents (6, 7) well as by PCCM fellows (1). We have now demonstrated a decrease over time in procedures per admission for a large cohort of pediatric critical care units in the United States and Canada. Decreased opportunity to perform procedures may result in a delay in trainees achieving competency. Decreased procedures may also affect whether PCCM faculty are maintaining competency.

There has been an increase in the number of admissions to these PICUs over the 9 years of the study, so there is an overall larger number of total procedures, although procedures per admission has decreased. However, there has also been an increase in the number of providers (trainees and faculty) in PCCM as indicated by the ABP Physician Workforce Data (2, 3) . Further, this analysis does not include the likely increasing contribution of nurse practitioners, physician assistants, and airway rapid response team involvement in PICU procedures (8, 9) . Although total procedures have increased, as providers have also increased, physicians may not have the same opportunity to perform invasive procedures that they did previously, most notably for CVC placement.

To address the concern regarding decreasing competence for intubations, there is a distinct benefit to first attempt tracheal intubation success. Increasing intubation attempts are associated with desaturation (10), and increased desaturations or increased tracheal intubation associated events are associated with longer length of mechanical ventilation and longer PICU stay (11) . Stinson et al (12) showed that failure of first attempt intubation was independently associated with progression of acute respiratory compromise to cardiopulmonary arrest after controlling for confounding variables. The number of intubations needed in training to achieve high first attempt success varies greatly (26-76) between studies (13-15) as well as between individuals, so it is difficult to set one benchmark for training. Unfortunately for trainees in 2020, the emergence of the global pandemic caused by severe acute respiratory syndrome coronavirus 2 has likely further reduced their practical experience with intubation. The potential for aerosolization of the virus during endotracheal intubation may place the intubating physician at greater risk. This has increased the need for first attempt tracheal intubation success. Trainees may be less frequently allowed to intubate patients that are positive for coronavirus disease 2019 or when the patient status is unknown awaiting testing. The Committee on Occupational Health from the ASA has recommended "During laryngoscopy and intubation: …Designate the most experienced anesthesia professional available to perform intubation, if possible" (16) . How long this problem will remain and impact trainees is unknowable.

With the increasing number of trainees and declining number of intubations, we must consider how to fill this gap. There is some suggestion that simulation may improve skills (17, 18) . There has also been a commitment to this type of education as the majority of PCCM fellowships incorporate simulation training in their curricula (19) . Despite studies demonstrating benefit and the ubiquity in fellowships, there is still concern that simulation training does not always translate to clinical improvement (20) . Assessment of performance following simulation training is very good for procedures that have an anticipated progression or a checklist that can be followed. However, it is more difficult to assess whether the procedure was done well or smoothly and how well it would be performed in a difficult clinical situation.

Studies thus far have addressed only the development of procedural competency of PCCM trainees. The maintenance of competency among PCCM faculty needs to be considered in future studies and an ongoing conversation within the field. There are survey data from Pediatric Emergency Medicine Medical Directors where 62% felt the number of tracheal intubation opportunities were insufficient to maintain competency among their faculty (21) . There is no literature indicating whether PICU faculty are performing enough intubations to remain competent. The same arguments as for maintaining competency for tracheal intubation apply to placement of arterial catheter and CVC.

In short, we may be doing fewer procedures per admission and must worry about acquiring and maintaining our skills. Simulation may help, but it is imperfect and needs refinement to reflect real world conditions with anatomy that varies. Simulation also needs outcome measures that reflect the clinical environment. Finally, as to the documentation of the maintenance of our skills, currently, there is no assessment of procedural skills (including mechanical ventilation in diverse clinical situations) required to maintain American Board of Pediatrics Critical Care certification. This is counter to the American Board of Anesthesiologists which requires a simulation course to complete Maintenance of Certification in Anesthesiology. This requirement should be addressed going forward for PCCM.

Our study has several limitations. First, we have only aggregate data for institutions and year. We unfortunately did not have individual patient-level data nor individual procedures for each provider over time. It is possible that an individual patient may have had multiple procedures or admissions. We cannot verify the accuracy of the reporting as it occurs at the level of the contributing PICUs. However, many institutions such as ours will have trained individuals specifically employed to contribute data to this registry. Further, there is no large multiinstitutional existing dataset with this level of detail to our knowledge, and this analysis may represent the most detailed assessment possible We have demonstrated a decline in the number of procedures performed as well as the use of HFOV and CMV with a rise in noninvasive support. For our trainees, we need to discuss how we can demonstrate that they have achieved proficiency. Do we need to set a minimum number of successful intubations during fellowship? Should we be conferring a certificate of competency for HFOV and CMV at the conclusion of their fellowship? It is also important to note that we did not have data to assess changes in practice on placement of chest tubes. We believe that this is also decreasing and needs to be considered. Consider that although the California Children's Services PICU Standards (1999), the American Academy of Pediatrics Guidelines (2004), and Society of Critical Care Medicine Practice Statement (2019), all stress competence in placing chest tubes and the former require documentation annually, none specify the numbers expected to maintain such competence assuming it was ever attained in training (22) (23) (24) . Finally, we must as group discuss the means of maintaining and certifying competency in our PCCM faculty.

Over the 9 years of this study of North American PICUs, there has been a significant decrease in the rate of intubations, CVC insertions, and arterial catheter insertions and an increase in PICC insertions per admission. There has also been a significant decrease in the use of invasive mechanical ventilation which was offset by an increase in noninvasive means of respiratory support. These data have significant implications for the development and maintenance of procedural skills in the field of PCCM.

Declining procedures by pediatric critical care medicine fellowship trainees

American Board of Pediatrics: Pediatric Physician Workforce Databook

American Board of Pediatrics: Pediatric Physician Workforce Databook

Comparison in the management of respiratory failure due to bronchiolitis in a pediatric ICU between

Increased use of noninvasive ventilation associated with decreased use of invasive devices in children with bronchiolitis

Predicting neonatal intubation competency in trainees

National Emergency Airway Registry for Children (NEAR4KIDS) Collaborators and Pediatric Acute Lung Injury and Sepsis Investigators (PALISI): Downward trend in pediatric resident laryngoscopy participation in PICUs

Procedures performed by advanced practice providers compared with medical residents in the ICU: A prospective observational study

Development of a multidisciplinary pediatric airway program: An institutional experience

Pediatric Acute Lung Injury and Sepsis Investigators (PALISI); National Emergency Airway Registry for Children (NEAR4KIDS): The number of tracheal intubation attempts matters! A prospective multi-institutional pediatric observational study

Pediatric Acute Lung Injury and Sepsis Investigators (PALISI) Network: Relationship between adverse tracheal intubation associated events and PICU outcomes

American Heart Association Get With the Guidelines-Resuscitation Investigators: Failure of invasive airway placement on the first attempt is associated with progression to cardiac arrest in pediatric acute respiratory compromise

National Emergency Airway Registry for Children Investigators and Pediatric Acute Lung Injury and Sepsis Investigators Network: The development of tracheal intubation proficiency outside the operating suite during pediatric critical care medicine fellowship training: A retrospective cohort study using cumulative sum analysis

Learning manual skills in anesthesiology: Is there a recommended number of cases for anesthetic procedures?

An application of the learning curve-cumulative summation test to evaluate training for endotracheal intubation in emergency medicine

Committee on Occupational Health: COVID-19 Information for Health Care Professionals

Retention curves for pediatric and neonatal intubation skills after simulation-based training

Changing the view: Impact of simulation-based mastery learning in pediatric tracheal intubation with videolaryngoscopy

Pediatric critical care medicine fellowship simulation use survey

Improved procedural performance following a simulation training session may not be transferable to the clinical environment

Tracheal intubation practice and maintaining skill competency: Survey of pediatric emergency department medical directors

American College of Critical Care Medicine of the Society of Critical Care Medicine: Guidelines and levels of care for pediatric intensive care units

Voting Panel: Criteria for critical care infants and children: PICU admission, discharge, and triage practice statement and levels of care guidance