key: cord-1016614-jxcku1px
authors: Ostapenko, Alexander; McPeck, Samantha; Liechty, Shawn; Kleiner, Daniel
title: Impacts on Surgery Resident Education at a First Wave COVID-19 Epicenter
date: 2020-11-24
journal: J Med Educ Curric Dev
DOI: 10.1177/2382120520975022
sha: 7f22556ec989872a11c1853897533dc18598287e
doc_id: 1016614
cord_uid: jxcku1px

PURPOSE: This study aims to identify the effects of the COVID-19 pandemic on surgical resident training and education at Danbury Hospital. METHODS: We conducted an observational study at a Western Connecticut hospital heavily affected by the first wave of the COVID-19 pandemic to assess its effects on surgical residents, focusing on surgical education, clinical experience, and operative skills development. Objective data was available through recorded work hours, case logs, and formal didactics. In addition, we created an anonymous survey to assess resident perception of their residency experience during the pandemic. RESULTS: There are 22 surgical residents at our institution; all were included in the study. Resident weekly duty hours decreased by 23.9 hours with the majority of clinical time redirected to caring for COVID-19 patients. Independent studying increased by 1.6 hours (26.2%) while weekly didactics decreased by 2.1 hours (35.6%). The operative volume per resident decreased by 65.7% from 35.0 to 12.0 cases for the period of interest, with a disproportionately high effect on junior residents, who experienced a 76.2% decrease. Unsurprisingly, 70% of residents reported a negative effect of the pandemic on their surgical skills. CONCLUSIONS: During the first wave of the COVID-19 pandemic, surgical residents’ usual workflows changed dramatically, as much of their time was dedicated to the critical care of patients with COVID-19. However, the consequent opportunity cost was to surgery-specific training; there was a significant decrease in operative cases and time spent in surgical didactics, along with elevated concern about overall preparedness for their intended career.

The COVID-19 pandemic has had a multitude of unprecedented effects on healthcare systems across the United States. Danbury Hospital is located in Western Connecticut, an area considered to be one of the epicenters of the first wave of the pandemic from March to May of 2020. Within the healthcare system, alterations to usual operations and changes in the allocation of human and material resources dramatically changed everyday workflow in hospitals. [1] [2] [3] Examples of this include the cancellation of non-emergent operations, the transition of various sectors to Telehealth medicine, and the redistribution of surgical residents to non-surgical services. Other effects on surgical residents have involved modification of duty hour limitations and adjustments to resident education. Around the world, institutions have transitioned to virtual platforms for academic sessions. Many local and national research conferences have been postponed or cancelled, and requirements for standardized exams have changed. 4 The effects of these revisions in the long term are challenging to predict, particularly because the response to these singular events has varied significantly across states, healthcare systems, and hospitals. 5 We aim to utilize both quantitative and qualitative data to analyze these effects in the short term, and postulate how this may evolve over time. Specifically, we hypothesize that surgical residents are working fewer hours and logging fewer operative cases, and that along with changes in education and academic opportunities, this has led to rising concern regarding preparedness for future surgical careers.

Within the Nuvance Health Network, major changes to usual operations due to the COVID-19 pandemic were instituted between March 3rd and May 25th, 2020. We therefore chose this as the period of interest. We focused on 3 components of surgical education: clinical experience, didactic conferences, and operative volume.

For clinical experience, we compared the number of duty hours logged by residents in New-Innovations Portal during the period of interest with the same time in 2019, and calculated a gross difference and percent change. To evaluate didactic conferences, we calculated the average weekly hours of scheduled didactic lectures during the same period in 2019 Impacts on Surgery Resident Education at a First Wave COVID-19 Epicenter 2 Journal of Medical Education and Curricular Development and 2020. All scheduled didactics time is recorded in a residency calendar, which was reviewed for both time periods. Additionally, we developed a survey to assess resident perception of changes in didactic structure and overall education during this time. A focus group of research residents and attendings met in order to develop the survey, which was piloted for clarity and length with 2 surgical residents who were in their research year. This survey was administered anonymously through SurveyMonkey® to all surgical residents at Danbury Hospital between June 9th and June 26th, 2020. We examined total major surgeries logged by residents through the ACGME portal during the period of interest, compared to 2019, and calculated a gross difference as well as percent change in order to assess operative opportunities. A student's t-test was used to calculate statistically significant difference with the null hypothesis that there was no significant difference, and a P-value <.5 was considered statistically significant. All analysis was performed with StataSE software, version 16.

For questions regarding hours, we calculated the perceived difference in hours for each individual response. Mean and standard deviation for the change were calculated for each question. The survey also contained 5-point Likert questions, for which the percentage of residents who responded positively with "agree" or "strongly agree" or negatively with "disagree" or "strongly disagree" was calculated. Our Institutional Review Board deemed this study exempt (IRB# 2012208337) and waived the need for participant consent.

There were 18 surgical residents (12 male, 6 female) in 2019 and 22 (12 male, 10 female) in 2020.

Clinical experience was assessed in 2 ways: first, we examined the duty hours logged for clinical work and number of outpatient clinics attended, and second, through several anonymous survey questions, completed by 91% of surgical residents. Surgical residents worked an average of 64.7 hours/week before the COVID-19 pandemic, and 40.8 hours/week during the pandemic, a 37.0% decrease (Table 1) . A significant portion of the clinical experience for surgical residents was redirected to caring for COVID-19 patients during the pandemic. In the survey, residents reported working between 28 and 38 (SD = 26.7) hours/week caring for COVID-19 patients (Table 1 ). In regards to outpatient clinics, in 2019 for the period of interest residents averaged 4.7 clinics, while in 2020 this decreased by 70.2% to 1.4 clinics per resident.

An average of 5.9 hours/week were spent on organized didactics before COVID-19 ( Table 2, Supplemental Table 1 ). This included 3 hours of protected time for resident education based on the SCORE curriculum, morbidity and mortality conference, grand rounds, specialty attending conferences, and trauma review conference. During the pandemic, all conferences were done remotely through teleconferencing, and the average time spent on organized didactics was 3.8 hours/week-a reduction of 35.6% (Table 2 ). Residents were split on whether the quality of didactics improved, with 35% reporting an improvement, and 35% perceiving a decrease in quality. Despite a significant drop in clinical work of 22.1 hours per week, residents reported an increase in independent studying of only 1.6 hours per week: from 6.1 to 7.7 hours per week (Table 2) . 

This restructuring of the program is similar to that reported by institutions in other highly affected areas. 7 Unlike this study, prior literature did not address the effect of this restructuring on resident training, but discussed their experience and offered recommendations on how to safely and effectively prepare hospitals and programs. 8, 9 In this study, we demonstrate that surgical residents had a significant contribution to the overall COVID-19 response at Danbury Hospital, with an average resident spending 28 to 38 hours per week caring for critical COVID-19 patients ( Prior studies describe a wide variability in surgical critical care training and fund of knowledge of graduating residents. 11, 12 Therefore, this sudden increase in critical care training is one of beneficial effects on surgical training. 10 One of the ways to enhance resident clinical experience to supplement the drop in clinical duties and outpatient clinic attendance was through resident involvement in telehealth clinics. 13 At our institution there were several barriers to this proposal, including a lack of infrastructure to transition to telehealth and the uncertainty of the timing of elective surgeries resumption. Both of these factors resulted in low volume of appointments initially; however, as telehealth became more common, incorporation of residents became more feasible. More widespread incorporation of resident involvement in telehealth clinics can potentially be an invaluable supplementation to clinical experience.

The COVID-19 pandemic changed surgical resident didactics, resulting in a decrease in protected time for academics. This was a surprising finding, given the implementation of video conferencing and noted reduced clinical responsibilities of residents. All conferences at our institution transitioned to video platforms, allowing presenters to share screens from remote locations and facilitating assembly of large groups in a safe manner. Other advantages of video platforms include the ability to record lectures for viewing outside of scheduled time, and increased ease in inviting leading experts and educators from prestigious academic institutions to present and discuss topics within their specialty.

Another surprising finding in our study was that despite a decrease in clinical duties by 17 hours per week, independent studying only increased by only 1.6 hours/ week. Given this significant decrease in clinical hours, we expected a larger increase in time spent studying independently. Several factors may play a role here. Given the timing of the national surgical in-training exam (ABSITE), residents may have felt less pressure to increase their time in independent study. Residents who formerly utilized independent study time to prepare for elective cases naturally would decrease time spent on this endeavor. This study was conducted during the pandemic and includes both subjective data from the survey as well as objective data from the time allotted for didactics. Further longitudinal investigation is warranted to evaluate the effect of the pandemic on ABSITE performance, board certifying exam scores and passing rate.

At our institution, attending-led, weekly mock oral exams are performed at the end of the academic year to prepare senior for their Board exams. Junior and senior residents are led through various scenarios examining their surgical management, decision-making, and ability to describe necessary operative steps. At a time when surgical volume and educational opportunities are decreasing, this method of education can be very beneficial and has been very successful at our institution.

Perhaps most obviously, the COVID-19 pandemic significantly impacted the operative component of surgical training (Table 3 ). The cancellation of all elective cases resulted in a 60% reduction in total major cases logged by residents. Although prior studies have reported on resident perception of drop in case volume through surveys, this is the first study to objectively report a significant decrease which disproportionally affected junior residents. The American Board of Surgery (ABS) decreased the number of required operative cases for graduating seniors as a direct consequence of the pandemic. 14 However, such a dramatic decrease in surgical volume will likely affect residents at all levels. In the survey, 70% of residents reported that the pandemic has negatively affected their surgical skills and 35% reported concern about preparedness to become an attending. Junior residents may be less concerned about preparedness to become an attending with several more years of training and hope that the pandemic and its effect will be short lived.

The long-term impacts of the pandemic remain to be seen; yet surgery residents still have a limited 5 years to acquire the clinical knowledge and operative experience to become surgeons. Per ABS, the requirement to qualify for board certification is 54 weeks of surgical clinical experience and 750 logged Ostapenko et al 5 procedures in defined categories. 11 Therefore, the significant drop in operative volume is concerning, as physical skill is fundamental to surgical education. One solution to supplement the growing deficit of operative experience is simulation-based training (SBT). Prior studies have demonstrated that surgical residents value the ability of SBT to expose them to new procedures, but conclusions were divided on the best ways to implement SBT within curricula. 15 Through SBT, residents can improve dexterity and speed in operative maneuvers and enhance their technical skill. 16 Resident performance can even be assessed by attendings or colleagues observing remotely through videoconferencing. This provides a unique opportunity to progress physical skills while maintaining social distancing, and additionally provides another outlet for independent study while clinical hours are reduced.

High quality surgical videos can also help compensate for diminished operative volume. Although not a tactile exercise, when viewed in a group setting with discussion driven by faculty, these sessions can supplement resident operative education. 13 Videos can also play a role in flipped classroom models in which pre-recorded lectures are watched prior to conferences, which enhances knowledge acquisition and enriches discussion.

Currently, there are not many tools available to assess overall resident operative competency, therefore demonstrating decrements in residents' ability as a result of the pandemic is challenging. Several procedure-specific evaluation tools have been proposed such as the Operative Performance Rating System and similar assessments for laparoscopic skills. More universally, Gofton et al 17 proposed an assessment, the Ottawa Surgical Competency Operating Room Evaluation (O-SCORE), which assesses surgical resident technical skills for any procedure. This tool has been shown to discriminate between residents of different technical levels, regardless of their year in training, and has been validated for assessing training in operative competency. Implementation of similar curriculum should be strongly considered given the drop in operative volume to continue monitoring resident progression through training and intervene early when deficiencies are identified.

In the event of future outbreaks, hospitals and healthcare networks capable of maintaining elective operative flow should attempt to do so, as several studies have demonstrated that they do not incur significant risk of COVID-19 transmission in patients discharged home. 18 Other proposed solutions include maintaining separate "COVID-free" facilities or surgical centers for elective operations if COVID-19 hospitalizations were sufficiently managed by hospitals. This is integral not only for economic viability of the hospital but also for continuing surgical training.

The main limitation of this study was that it was limited to a single surgical residency program. Therefore, the results may not be generalizable to residents in other programs in the United States. However, as one of the earliest areas affected by COVID-19, we are able to analyze its effects in a timely fashion that may benefit other geographic areas affected similarly in the future. While residents in states with lower incidence of COVID-19 may not be as significantly impacted as residents at our institution, continued evolution of the COVID-19 pandemic and the rise of new epicenters of disease may make these results more generalizable over time. Despite the limitations, these results are integral in critically thinking about the future of surgical education. The COVID-19 pandemic will continue to affect residency programs across the country with changes to clinical work, didactics, and operative experience of surgical residents.

As physicians, our highest mandate is patient care. We have an ethical and moral responsibility to take care of COVID-19 patients, and there is a great deal to be learned from such experiences. Nonetheless, the cultivation of surgical knowledge and physical skills is integral to the development of future surgeons, and the short duration of residency education is an incomparably formative time. It is important to keep in mind that the role COVID-19 as a disease will have in the future of medical care is impossible to divine, and that regardless of the role it plays, medicine will still need the specific capabilities for which surgeons are trained.

During the first wave of the pandemic, surgical residents made a significant contribution to care of patients with COVID-19. The impacts of the pandemic on surgeon training continue to evolve, and undoubtedly will have complex long-term effects, both positive and negative. It is important to continually assess how resident training is affected, and to consider innovative approaches to maintain clinical, operative, and educational experiences.

Alexander Ostapenko https://orcid.org/0000-0002-4030-8195

Supplemental material for this article is available online.

Joint Statement: Roadmap for Resuming Elective Surgery after COVID-19 Pandemic

COVID-19): Situation Report, 72. World Health Organization

Immediate and long-term impact of the COVID-19 pandemic on delivery of surgical services

Residency and fellowship program accreditation: effects of the novel coronavirus (COVID-19) pandemic

Impact of COVID-19 on neurosurgery resident training and education

COVID-19: elective case triage guidelines for surgical care

Emergency restructuring of a general surgery residency program during the coronavirus disease 2019 pandemic: the University of Washington experience

Restructuring of a general surgery residency program in an epicenter of the coronavirus disease 2019 pandemic: lessons from

Reforming our general surgery residency program at an urban level 1 Trauma Center during the COVID-19 pandemic: towards maintaining resident safety and wellbeing

Critical care education in general surgery residencies

General surgery resident rotations in surgical critical care, trauma, and burns: what is optimal for residency training?

A survey of critical care training amongst surgical residents: will they be ready?

Using technology to maintain the education of residents during the COVID-19 pandemic

Modifications to training requirements -COVID-19 update. American Board of Surgery

Residents' perspectives of the value of a simulation curriculum in a general surgery residency program: a multimethod study of stakeholder feedback

An overview of research priorities in surgical simulation: what the literature shows has been achieved during the 21st century and what remains

The Ottawa surgical competency operating room evaluation (O-SCORE): a tool to assess surgical competence

Operating-Room Procedures do not Increase Risk of COVID-19 Infection