key: cord-0977893-epjw6xvi authors: Fan, Timothy; Workman, Alan D.; Koch, George; Rathi, Vinay K.; Scangas, George A.; Metson, Ralph title: Educational utility of an online video‐based teaching tool for sinus and skull base surgery date: 2021-03-24 journal: Laryngoscope Investig Otolaryngol DOI: 10.1002/lio2.551 sha: 352561d703ec5a130c1f94c1da499b2a4db80dd2 doc_id: 977893 cord_uid: epjw6xvi OBJECTIVE: Surgical education has undergone major changes in recent years, as hands‐on learning opportunities have been replaced or supplemented with online tools. The goal of this project is to examine the educational impact of a surgical training website, SinusVideos.com, on otolaryngologists at various levels of training. METHODS: Visitors to the website were asked to complete a survey after viewing a narrated video of a surgical procedure. Surveys were analyzed for demographics, needs assessment, and educational impact. RESULTS: A total of 105 completed surveys were completed by 68 (64.8%) attendings/practicing physicians, 32 residents/fellows (30.5%), and 5 medical students (4.8%). Whereas 14.3% of viewers reported online videos as their primary source for surgical preparation, 70.5% considered them important secondary supplements. After viewing a video, 92.4% of respondents reported a gained confidence in performing the surgery, and 62.9% said the video altered how they would perform the surgery in the future. Viewers' ratings of their knowledge (on a 1‐7 Likert scale) of a particular surgical procedure before vs after watching the observed procedure increased significantly for participants at all levels of training—medical students (2.8 before vs 5.4 after, P < .01), residents/fellows (4.8 before vs 5.8 after, P < .0001), and attendings/practicing physicians (5.6 before vs 6.4 after, P < .0001). CONCLUSION: High quality online surgical videos appear to be an effective learning tool for surgical trainees and practicing physicians alike. The educational benefit of such tools, as well as their widespread accessibility, makes them a powerful instrument for the training of surgeons worldwide. LEVEL OF EVIDENCE: Level 5. Approaches to procedural education for surgical trainees have undergone major changes in recent years, due to shifts in institutional priorities and technological advancements. [1] [2] [3] Reduced learning opportunities and decreased case numbers have created an educational gap affecting all surgical specialties, including otolaryngology. 4 Online and video-based surgical education tools have helped bridge this gap by providing enhanced access to surgical training and continuing education opportunities. Online videos offer unprecedented accessibility to learn at each user's unique pace with choice of content and learning style. 5 The ability to continually update videos as new evidences emerges offers online video library users exposure to the most current surgical techniques. 5 The benefits of delivering educational content via online videos were magnified during the COVID-19 pandemic, when in-person learning was diminished or halted across the nation for medical trainees at all levels. Free online video sharing sites are particularly important for surgical trainees in developing countries, where access to educational resources is limited, and training quality differs starkly between urban and rural programs. 6, 7 While surgical videos can be found from numerous online sources, many websites have no quality checks, and both accuracy and suitability vary substantially. 8 The need for high-quality, peerreviewed otolaryngology educational videos prompted the launch of SinusVideos.com, which has traffic of several thousand visitors per month, over 40% of whom are from outside the United States. 7 This strictly educational website contains over 150 edited, narrated videos ranging from basic to advanced sinus surgery techniques. In recent years, the content has expanded to include skull base procedures, as well as endoscopic ear and Eustachian tube surgeries. The purpose of the current study was to query SinusVideos.com viewers at various levels of surgical training to assess their needs and utilization of the educational content, as well as its impact on their clinical practice. SinusVideos.com is an otolaryngology online educational tool that hosts videos of live sinus surgeries recorded in the operating room. These videos are edited and narrated by a trained surgeon, and classified according to anatomic region or surgical technique. A total of 154 videos have been uploaded to the site as of October first, 2020. Topics range from basic endoscopic sinus surgery techniques to advanced skull base procedures. Since SinusVideos.com was launched by the senior author (R.M.) and his fellows in 2009, it has received over one million pageviews, with United States (47.4%) having the highest viewer population, followed by India (7.2%), United Kingdom (2.9%), Turkey (2.4%), and Canada (2.2%). 7 The website is strictly educational and receives no outside funding or commercial support. No income is generated from use of the website, and the authors do not receive any financial resources from its operation. Due to the anonymous nature of the present study, it was exempted from review by the Mass General Brigham Institutional Review Board. From October 1st, 2018 through July 1st, 2020, viewers to the website were notified prior to watching videos that there would be an optional survey at the end of the video. The survey asked viewers to identify their gender, education level, age and practice background. Viewers were also asked to identify how they were referred to Sinusvideos.com and whether they were utilizing the videos for personal or professional education. Viewers additionally completed Likert scale responses (1-7) regarding their knowledge of the procedure specific to the video that they were watching, both before and after viewing the video. Survey responses were collected using Formidable Forms Pro version 4.04 (Strategy11, Riverton, Utah). A total of 105 surveys were submitted by website viewers whose demographics are shown in Table 1 . Most respondents (64.8%) identified themselves as attendings or practicing physicians, while 30.5% were residents or fellows, and 4.8% were medical students. The majority of viewers was 25-44 years of age (56.2%), practiced general otolaryngology (59%), and was affiliated with an academic institution (54.3%). A high proportion of individuals found the website through personal recommendation (47.6%), whereas others located it through search engines (37.1%), or the YouTube channel (11.4%). Fifteen participants (14.3%) considered online videos their primary source for preparation for surgical procedures, whereas 74 (70.5%) considered them important secondary supplements for their surgical education. Preparation to perform a specific surgery was the most common reason given for visiting SinusVideos.com (55.2%). Whereas, 71.4% said that they had previously performed the procedure being viewed, 28.6% had never done so. In addition, 43.8% said they planned to be performing the procedure within the next week. When viewers were asked to rate their pre-viewing knowledge of a particular surgery based on Likert 1-7 scale, attendings/practicing physicians self-ranked with the highest mean score (5.6 ± 1.3), followed by residents/fellows (4.8 ± 1.6), and medical students (2.8 ± 1.6), as shown in Table 2 . Comparison of pre-and post-viewing scores, demonstrated a significant improvement in knowledge after viewing the videos for all groups. The magnitude in knowledge gained, however, was greatest for medical students at 2.6 (2.8 ± 1.6 before vs 5.4 ± 1.5 after, P < .01), followed by residents/fellows at 1.0 (4.8 ± 1.6 before vs 5.8 ± 1.2 after, P < .0001), and then attendings/practicing physicians at 0.8 (5.6 ± 1.3 before vs 6.4 ± 0.8 after, P < .0001), as shown in Figure 1 . In addition to a gain in knowledge, the large majority of respondents (92.4%) reported that they also gained confidence in performing the viewed procedure after visiting SinusVideos.com (Table 3) Table 4 . Learning theory states that adult education is often self-motivated, relevancy oriented, and practicality-driven. 9 These criteria appear to closely align with the goals of a surgical training website and its viewership. In contrast to the more traditional print materials available for surgical training, video format offers the viewer the complex movements and subtle cues of the operative field within the realities of live surgery. 2 With modern access to the internet, surgical videos can be accessed worldwide to match the user's needs and pace, while ensuring up-to-date content. 5 A unique benefit of educational online resources has become evident with the COVID-19 pandemic. As cases rapidly grew in the United States, clinical participation for medical students across the nation was suspended indefinitely, per recommendations by the American Association of Medical Colleges (AAMC). 10 At the resident and fellow level, cancellation of elective surgeries to preserve medical resources, and restricting essential surgeries to essential personnel significantly decreased trainee case volumes. 11 Facing this unprecedented challenge, medical institutions turned to online learning for solutions in fulfilling educational requirements. Online videos offer trainees safe and productive experiences during a hiatus in their didactic and clinical routines. The COVID-19 pandemic accelerated development and increased awareness of online resources that will benefit current and future students alike. In our study, over 90% of respondents reported increased confidence in performing a surgical procedure after viewing it online. In addition, nearly two-thirds of users said that watching the video would change the way they perform the procedure in the future. These findings support the clinical relevance of such a website and its potential to positively impact patient care. Furthermore, more than 70% of viewers stated that they intended to perform the viewed procedure within 1 month. This finding demonstrates the immediate impact of the website and its ability to educate on an as-needed basis, in comparison to formally scheduled training sessions. Among the study population, over 80% of viewers said that watching online videos is an important part of their surgical education. These findings are consistent with those of Rapp et al, who reported that 90% of residents and medical students actively use videos for surgical preparation, emphasizing the relevance and essential role online resources play in modern surgical training. 8 They also demonstrate the importance that high quality surgical videos will play in the maintenance of competent and well-trained surgeons for the future. In the current study, viewership of a surgical procedure on video resulted in a significant improvement in the observer's knowledge base across all stages of training. The medical student cohort had the largest advancement in average rating of knowledge, followed in order by residents/fellows, and attendings/practicing physicians. These results are not unexpected, as those with a greater pre-existing knowledge have less room for improvement. In a study of otolaryngology residents who watched video teaching modules prior to the performance of neck dissection surgery, such viewings led to fewer surgical errors and less "takeover" events by attendings. 12 In studies of general surgery and plastic surgery residents, utilization of online learning videos also resulted in a reduction in operative time and error rates following the educational experience. 13, 14 The majority of viewers responding to the SinusVideos.com survey identified themselves as attendings or practicing physicians, highlighting the continuing education needs addressed by online teaching tools. Online video sharing also serves to overcome financial and geographical limitations for surgical trainees. 5 The growth in mul- Viewing of online videos of otolaryngologic procedures appears to increase both the surgeon's knowledge base and confidence for the procedure viewed. These benefits were found for viewers across all levels of training from medial student to practicing surgeon. The utilization of online surgical training resources, like SinusVideos.com, is likely to increase in the future, as they provide efficient, personalized training, while reducing the burden of travel and expense. Teaching surgical skills -changes in the wind Development of a surgical video atlas for resident education: 3-year experience General surgery residency inadequately prepares trainees for fellowship Video-based surgical learning: improving trainee education and preparation for surgery The impact of e-learning in medical education Neurosurgery videos on online video sharing sites: the next best teacher? Online teaching tool for sinus surgery: trends toward mobile and global education YouTube is the most frequently used educational video source for surgical preparation An overview of adult-learning processes COVID-19: Updated Guidance for Medical Students' Roles in Direct Patient Care American College of Surgeons releases new clinical guidance document for elective surgical case triage during COVID-19 High definition video teaching module for learning neck dissection Knowledge and usability of a trauma training system for general surgery residents Educational utility of an online video-based teaching tool for sinus and skull base surgery The authors declare have no conflicts of interest. All authors have reviewed and approved this manuscript.