key: cord-1003909-rydpeb81 authors: Wu, Shye-Jao; Fan, Ya-Fen; Sun, Shen; Chien, Chen-Yen; Wu, Yih-Jer title: Perceptions of medical students towards and effectiveness of online surgical curriculum: a systematic review date: 2021-11-11 journal: BMC Med Educ DOI: 10.1186/s12909-021-03014-x sha: 51267d7a5dac227ca6ac81725bbe78763f1a958b doc_id: 1003909 cord_uid: rydpeb81 BACKGROUND: Online education has been used as an adjunct modality for teaching and it attracts attention in recent years as many medical students can not accomplish their clerkship in the hospital due to COVID-19 pandemic. This study aims to collect the articles related to online surgical education for medical students, and to analyze the effectiveness of online education and the perceptions of the medical students. METHOD: We performed a systemic literature search in PubMed, MEDLINE, EMBASE, ERIC and Cochrane library. Keywords used for searching included “medical student”, “online education”, “online teaching”, “online learning”, “distance learning”, “electronic learning”, “virtual learning” and “surgical”. Medical education research study quality instrument (MERSQI) was used for the evaluation of the quality of the searched articles. RESULTS: From 1240 studies retrieved from the databases, 13 articles were included in this study after screening. The publication year was from 2007 to 2021. The mean MERSQI score of the 13 searched articles was 12.5 +/− 1.7 (range 10.0-14.5). There were totally 2023 medical students who attended online surgical curriculum. By online course, improvement of understanding and knowledge on the studied topics could be reached. The confidence in patient encounters could be improved by online curriculum with sharing experiences, discussing, and role playing. However, students felt concentration was poor during online course. Medical students studying through video platform could get better test scores than those studying with textbooks. Regarding basic surgical skills, online teaching of suturing and knot-tying could be possible and was appreciated by the students who could practice away from the hospital and get feedbacks by instructors through online environment. The scores for the clinical competence assessment for incision, suturing and knot-tying were found to be no significant difference between the online teaching group and face-to-face teaching group. CONCLUSION: Online surgical curriculum for medical students is not easy but inevitable in the era of COVID-19 pandemic. Although online course is not the same as physical course, there are some efforts which could be tried to increase the effectiveness. Basic surgical skills could also be taught effectively through online platform. Even if the COVID-19 pandemic is over in the future, online curriculum could still be a helpful adjunct for surgical education. be very important elements for surgical clerkship. In addition to physical classes, online education has been used as an adjunct modality for teaching in the past. However, due to pandemic of COVID-19, many medical students around the world cannot go through their clerkship in the hospital but complete the training course behind the desk at home by online education [1] . Although it has been reported that the electronic learning could complement traditional teaching methods in undergraduate surgical teaching [2] , it is still concerned by the tutors and the medical students whether online education is as much effective as inperson education or not, especially for the training of basic surgical skills. The aim of this study is to collect the published articles related to online surgical education for medical students, to analyze the effectiveness of online education and the perceptions of the medical students and to summarize all the online curriculum designed from all around the world to help medical students to learn what they should learn and what they want to learn. This systematic review was conducted in accordance with the guidelines for Systemic Reviews and Meta-analyses [3] . We performed a systematic literature search in Pub-Med, EMBASE, MEDLINE, and ERIC. There were no similar articles in the Cochrane library. Keywords used for searching included "medical student", "online education", "online teaching", "online learning", "distance learning", "electronic learning", "virtual learning" and "surgical". The search was limited to the English language and to human studies but not limited to the publication time. In addition to the articles searched by key words, the reference lists of all the relevant articles were also checked carefully. Two investigators independently reviewed the titles and abstracts of the searched articles which were included in this study if the following criteria were met: (1) medical students; (2) online education; (3) curriculum for surgical training. Those articles deemed relevant were selected for further consideration (Fig. 1) . Thereafter, data extraction of included studies was completed by two independent reviewers. Only the searched studies related to surgical training for medical students were analyzed [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] . The articles not specifically to online education for medical students were not enrolled in this study. The articles related to training of residency were not analyzed. The articles involving teaching of medical students beyond basic surgical skills were not included, either. For the articles reporting the surgical training of both residents and medical students, these articles were discarded if the part of the training of medical students could not be extracted. Review articles were also excluded from this study. The extracted data included author's name, year of publication, age and gender of medical students, curriculum for online education, effectiveness of the online course, and perceptions of medical students. The extracted data were compiled into Tables 1 and 2 . Medical education research study quality instrument (MERSQI) was used for the evaluation of the quality of the searched articles. The MERSQI [17] includes 10 items in 6 domains: study design, sampling, type of data, validity, data analysis and outcomes. The maximal score for each domain was 3 and the range of the maximal MER-SQI score was 5-18. Continuous variables were presented as mean +/− standard deviations or median (range or interquartile range (IQR)). Categorical variables were expressed as numbers and percentages. Perceptions of medical students were presented with Likert scale which ranged from strongly disagree to strongly agree. By our searching strategy, 1240 studies were retrieved from the databases. After screening, 13 articles were included in this study (Fig. 1) . Among the 13 articles searched from the databases, there were totally 2023 medical students who attended undergraduate surgical curriculum which were composed of online course (1894 students) and combined physical and online course (129 students) and the publication year was from 2007 to 2021. There were 2 studies with all-grade students, 3 studies with grade 3 students, 2 studies with grade 3 and 4 students, and 1 study each with grade 1 students, grade 4 students, final-year students, students except grade 1, students registered to the surgery clinical rotation and students participating longitudinal study design. Among all the 13 searched articles, there were only 3 articles in which age of medical students was mentioned (age range 21-24 years old in 1, median age 23 years old (range 22-24) in 1 and media age 25 years old (range 24-27) in 1), and there were 4 articles in which percentage of female gender was described (45, 47.4, 50.6, 75%,). There were 8 studies investigating the perceptions of medical students on online surgical education and 5 articles in which the effect of online teaching of basic surgical skills (suture, knot-tying) was studied. The mean MERSQI score of the 13 searched articles was 12.5 +/− 1.7 (range 10.0-14.5). The perceptions of medical students after online surgical education reflected what they needed and what they wanted. Online teaching is not the same way of teaching as the traditionally face-to-face teaching but it is no doubt that the teachers did teach the medical students irrespective of through online platform or in the classroom. In a study by Pettitt-Schieber et al. [15] , there were significant increase in understanding of the surgical subspecialty course after online education (pre-course 2.0 +/− 0.8 vs post-course 3.3 +/− 0.5 by 4-point Likert scale, p < 0.0001). In a study by Chandrasinghe et al. [5] , the medical students felt to be benefited from the discussions during online course, which helped to improve understanding and knowledge on the studied topic and was ranked as 4.9 +/− 0.4 (95% confidence interval 4.8-4.9) by 1046 medical students with 5-point Likert scale [4] . In a study by Newcomb et al. [9] , the confidence of medical students in exploring patient's perceptions, sharing information with patients, checking understanding of patients, exploring concerns, and establishing plans for patients could get improved after virtual classes in which instructors shared their practices for communication with patients by video, followed by a discussion on the students' former experience of the communication with patients, and then participating role play sessions with simulated patients [9] . There were 80% of the participating students giving "A+" to this curriculum which was not only to teach clinical approaches to surgical patients, but also teach telemedicine through online platform [9] . In a study by Shin et al. [4] , the confidence in ability to independently see and complete initial assessment of surgical patients could get improved after virtual casebased curriculum and was ranked as 2.0 (pre-course) to 4.0(post-course) with 5-point Likert scale. For the virtual case-based curriculum [4] , medical students were provided with a patient scenario, the instructor leading the discussion role-played as the patient from whom the students obtained history gathering and requested focused physical exam findings and then the students brainstormed for differential diagnoses and diagnostic workup. Moreover, in addition to increasing confidence of medical students on patient encounters, the test score for the content-based knowledge could also be improved [4] from 55% +/− 3.54% (pre-course) to 72.5% +/− 2.14% (post-course) with p value 0.0002. In a study by Schmitz et al. [8] , medical students studying online with video platform got better test scores than those studying with textbooks (correct rate 0.67 +/− 0.02 vs 0.60 +/− 0.02, In a study by Kronenfeld et al. [7] , there were no significant difference of effectiveness to prepare for national board medical examination and oral examination between in-person sessions and electronic sessions irrespective of faculty-led lectures or resident-led problem based learning. In a study by Lindeman et al. [10] , blended curriculum (online teaching plus in-person lectures) was used as a mixed teaching model for basic surgical clerkship and was found to be superior to the didactic lectures. The blended course and in-person teaching was ranked as 3.80 vs 3.52 respectively with 5-point Likert scale (p = 0.02) for the lecture series, 4.30 vs 3.98 (p = 0.004) for the teaching effectiveness, 3.67 vs 3.36 (p = 0.01) for the overall clerkship, and 3.39 vs 3.08 (p = 0.03) for the improved confidence. However, online surgical curriculum still had some negative impacts for medical students. In a study by Ray et al. [6] , medical students felt concentration was poor during online course. Online class adversely affected the overall learning of which practical learning was adversely affected further [6] . Regarding the role of medical conference on medical education, cancellation of physical medical conference was thought to be adversely affect building-up of medical knowledge, and virtual medical conference was not thought to be an effective tool to enhance learning for medical students [6] . Use of simulated patients and simulation technology for online class were not thought to be useful by medical students [6] . Among the clinical surgical training, in addition to lectures and patient encounters, training of surgical basic skills (suturing, knot-tying) is also one of the important things medical students care most. In a study by Quaranto et al. [14] , medical students could increase their confidence score in suturing (pre-course 8.0 +/− 1.3 vs postcourse 13.8 +/− 0.9, p < 0.001) and knot tying (pre-course 7.9 +/− 0.7 vs post-course 9.7 +/− 0.9, p = 0.03) through online teaching. In a study by Xeroulis et al. [11] , medical students were asked to learn through online interactive video demonstration and instruction, and then practiced the technique for suturing and knot-tying. There was no significant difference on average global rating scores for basic surgical skills either by interactive video-based instruction or by instruction-only video (without interactive video) and expert feedback [11] . In a study by Handaya et al. [16] , the medical students watching the video for knot tying got better scores for knot tying than the students not watching the video (10.9 +/− 1.8 vs 7.5 +/− 1.7, p = 0.000) before online classes. After online teaching, irrespective of watching the video for knot tying or not, there was no significant difference in scores of knot tying between the two groups (11.2 +/− 1.5 vs 10.9 +/− 2.0, p = 0.706). In a study by McGann et al. [12] , e-learning programs with instrument identification, knot-tying and suturing were used as the tools to teach basic surgical skills for medical students who had suture instruments provided in advance and could practice by themselves at home at their paces. Online feedback was given by instructors after the students completed Nearly all students met their course objectives and significantly increased their confidence [12] . In a study by Co et al. [13] , web-based learning of surgical skills was used for online teaching for the medical students who had suture instruments given in advance and were taught by the demonstration of the tutors through online environment. The scores for the clinical competence assessment for incision, suturing and knot-tying were found to be no significant difference (p = 1.0) between the online teaching group (4.7/5) and face-to-face teaching group (4.8/5) [13] . Online education has been used as an adjunct modality for teaching and it attracts attention in recent years as many medical students can not accomplish their clerkship in the hospital due to COVID-19 pandemic. The way of online learning for medical students is quite different from that of traditional teaching because students are far away from the hospital and the patients. There were many medical students (n = 6069) who did not like online teaching and feel online teaching is not effective enough to offer what medical students need [18, 19] . However, online curriculum is inevitable for medical education in the era of COVID-19 pandemic. Moreover, regarding surgical training for medical students, in addition to patient encounters, training of basic surgical skills is another important issue. For the reasons mentioned above, it is more challenging to teach medical students online for surgical training course. It is known that there are limitations in online education itself when it comes to the efficacy of teaching. Although there were medical students who were not satisfied with online teaching [6, 17] , they did still think the instructors were well prepared for the online teaching, which means the students could feel the efforts the instructors have made for the online education [17] . The drawbacks of online teaching mentioned above are not absolutely unable to be overcome. Emphasis on interactive discussions during online teaching could be more stimulating. Instructors usually ask students questions or answer questions requested by students during teaching irrespective of online classes or physical classes. If the students are not familiar with the contents the instructors teach, they usually could not respond fast or adequately and the tuition might be not very impressive for the students. However, if the students are given some time for brainstorming or answer-searching after the questions are asked by the instructors, the whole tuition may become more stimulating and the students may feel they could engage more in the online classes [4] . The break between question asked by instructors and answer responded by students could be tried to achieve better teaching effectiveness and satisfaction. On the contrary, there were medical students who did express they benefited from virtual class and discussions [5, 9, 15] . Even though medical students did not have real patient encounters, they still could have the feeling of increased confidence in seeing and evaluating surgical patients independently after online course [5, 9] , which shows that in addition to didactic lectures, discussion during online education is one of important elements to improve the effectiveness of teaching, and means that it is possible to get acceptable satisfaction from medical students receiving online surgical clinical training. When it comes to medical conferences, online meetings take place more frequently than before in the era of COVID-19 pandemic. In fact, medical students could experience all the materials presented in the conference including speaker's presentation and Q/A section irrespective of physical or online conferences. Thus, the effectiveness of online conferences could be similar to that of physical conferences. However, medical students felt the concentration was poor during online teaching, which may be caused by powerful function of computers and electronic devices by which students could do other irrelevant things during online tuition. Distraction during online tuition may have strong impacts on decreasing the merits of online education and ought to be one of the important causes why medical students felt online conference adversely affected the effectiveness of learning. Regarding teaching with simulation, there were inconsistent opinions expressed by medical students who thought simulated teaching should be a part of medical curriculum but felt simulated patients and simulation technology were not useful for online classes [6] . It has been well known that simulation is one of the important teaching modalities to help medical students approach the real patients in the future, especially for basic clinical skills such as wound suturing, knot-tying, placement of nasogastric tube or urinary catheter, and so on. The inconsistent answers by medical students may imply they felt they could learn and benefit by simulated teaching but patient encounters and learning by doing are what they want the most. Learning by doing is the most direct way to teach medical students how to suture and how to tie a knot and to let medical students be familiar with basic clinical skills, but many medical students lost their opportunities for patient encounters in the era of COVID-19 pandemic and therefore, they could only practice basic surgical skills on the simulated kits but not on the real patients. In this study, it was found that even by online teaching, medical students still could get satisfactory training for basic surgical skills if they were given suture instruments in advance, was taught with video, practiced suturing and knot-tying with suture kits by themselves, and interacted with online platform or expert feedback [11] [12] [13] [14] 16] . Although medical students could get confidence in the ability of basic surgical skills by online classes, they eventually have to practice successfully for the real patients to verify their abilities. Individualized learning pace could be one of the unique advantages derived from online courses. Students can reach the platform of e-learning at any time and can repeat to approach the online programs as their wishes. With online course only, medical students may feel they are not well prepared for clinical work in the future. It could be understood why medical students have such kind of viewpoints in mind because they do not see the patients in person during online course and they do not prove their abilities for clinical work by themselves. The feeling of not well preparedness by medical students is really one of the major drawbacks of online teaching but it could be solved and overcome. There are still some methods to improve the effectiveness of online course such as photo-assisted teaching, video-assisted teaching, live demonstration through online platform and so on. In online classes, frequent use of photos and videos may be helpful to let medical students feel they attend patient care or surgeries on-site, which may be able to decrease the students' depression from cancellation of physical conferences and activities. To the best of our knowledge, this is the first paper of systematic review for online surgical education for medical students. Online teaching is not easy but is inevitable in the era of COVID-19 pandemic, especially for surgical training of medical students. Although online course is not the same as physical course, there are some efforts which could be tried to increase the effectiveness of online teaching and to earn the satisfaction from medical students. It is possible to teach basic surgical skills effectively through online platform. Even if the COVID-19 pandemic is over in the future, online curriculum could still be a helpful adjunct for surgical education. United Nations Educational, Scientific and Cultural Organization Electronic learning can facilitate student performance in undergraduate surgical education: a prospective observational study A 24-step guide on how to design, conduct, and successfully publish a systemic review and meta-analysis in medical research Efficacy of virtual case-based general surgery clerkship curriculum during COVID-19 distancing A novel structure for online surgical undergraduate teaching during the COVID-19 pandemic Medical student's perspective regarding undergraduate surgical education with special reference to pandemic Medical student education during COVID-19: electronic education does not decrease examination • fast, convenient online submission • thorough peer review by experienced researchers in your field • rapid publication on acceptance • support for research data, including large and complex data types • gold Open Access which fosters wider collaboration and increased citations maximum visibility for your research: over 100M website views per year • At BMC, research is always in progress. Learn more biomedcentral.com/submissions Ready to submit your research Ready to submit your research ? Online ahead of print Development of a tailor-made surgical online learning platform, ensuring surgical education in times of the COVID-19 pandemic Building rapport and earning the surgical patient's trust in the era of social distancing: teaching patient-centered communication during video conference encounters to medical students A blended online curriculum in the basic surgery clerkship: a pilot study Teaching suturing and knot-tying skill to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback Implementation of an e-learning academic elective for hands-on basic surgical skills to supplement medical school surgical education Online teaching of basic surgical skills to medical students during the COVID-19 pandemic: a case-control study Development of a interactive remote basic surgical skills mini-curriculum for medical students during the COVID-19 pandemic Implementation and evaluation of eight virtual surgical electives for medical students during the COVID-19 pandemic Effectiveness of tutorial videos combined with online classes in surgical knotting course during COVID-19 pandemic Association between funding and quality of published medical education research Perceptions of medical students towards online teaching during the COVID-19 pandemic: a national cross-sectional survey of 2721 UK medical students Impact of the COVI-19 pandemic on medical education: medical students' knowledge, attitudes, and practices regarding electric learning Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations Nil. 1 Authors' contributions S-J: conception and design of study, acquisition of data, data analysis and interpretation, drafting and revision of manuscript, approval of final version of manuscript. Y-F: acquisition of data, revision of manuscript, approval of final version of manuscript. S: acquisition of data, revision of manuscript, approval of final version of manuscript. C-Y: data analysis and interpretation, revision of manuscript, approval of final version of manuscript. Y-J: conception and design of study, revision of manuscript, approval of final version of manuscript. There is no funding for this study. The data and material will be available on request. Because this study design of this manuscript was systemic review, there is no need to get ethics approval and consent. If this manuscript is accepted after peer review, all the authors agree to publish this study in BMC Medical Education. All the authors declare no competing interests.