key: cord-0697460-kfreuz70
authors: Saiboon, Ismail M.; Zahari, Fareena; Isa, Hisham M.; Sabardin, Dazlin M.; Robertson, Colin E.
title: E-Learning in Teaching Emergency Disaster Response Among Undergraduate Medical Students in Malaysia
date: 2021-04-29
journal: Front Public Health
DOI: 10.3389/fpubh.2021.628178
sha: 67097ef52f442c19df12feceba28a17c36b4e77b
doc_id: 697460
cord_uid: kfreuz70

Introduction: Teaching disaster response medicine (DRM) to medical students requires considerable resources. We evaluate the effectiveness of e-learning in teaching emergency disaster response (ELITE-DR), a novel initiative, in educating medical students of the cognitive aspect of DRM. Methods: A prospective cross-sectional study among pre-clinical year medical students was carried out to determine their knowledge on DRM and perception regarding the ELITE-DR initiative using a validated online questionnaire. A three-part self-learning video covering the principles and medical management of DRM were distributed before answering the questionnaire served as the training. Results: A total of 168 students participated in the study. Their overall knowledge showed a significant increase in between pre-and-post-interventions. Recall and simple decision-making knowledge aspects were better than complex decision-making knowledge. It appeared that participants assimilate knowledge better from visual rather than audio stimuli. Participants with high perception-scores demonstrated better knowledge-scores. However, e-learning was not preferred as a substitute for face-to-face (F2F) teaching. Conclusion: ELITE-DR shows promise in teaching DRM. Simple recall and comprehension levels of knowledge were well-served through this technique. However, for more complex decision-making knowledge, a different approach might be required. ELITE-DR offers flexibility, accessibility, and personalized learning. The content presentation is improved by using several different visual stimuli. This approach is useful for cognitive aspect learning, but it should not replace standard F2F teaching.

Globally, disaster medicine is inadequately represented in the undergraduate medical curriculum (1) . Even though more medical schools have incorporated disaster medicine into their curriculum lately, it is believed that medical undergraduates still do not possess adequate knowledge and skill in this area (2) . Teaching disaster response medicine (DRM) to undergraduate (UG) medical students is challenging, and not all medical schools include DRM as part of their curriculum (3) (4) (5) . DRM teaching has many facets or components. Apart from knowledge, there are elements of planning, decision-making (both clinical and operative), simple or complex treatment strategies, clinical procedures, protocols, etc. (6) (7) (8) . These are usually taught at the post-graduate level or as a subspecialty (9) . However, as the recent COVID-19 pandemic has shown, UG education of disaster medicine is vital and should include some basic knowledge, simple procedures, and basic decision-making elements.

Disaster response is traditionally delivered using face-toface (F2F) training, simulation, and role play (10, 11) . This is a challenge for many academic institutions, as simulation role-play requires significant teaching manpower (12) . Other difficulties include restrictions on teaching time within the 5or 6-year curriculum (12, 13) , difficulty gathering students in a single, suitable educational setting, and lack of direct access to experts (10) .

In 2020, the COVID-19 pandemic has highlighted the difficulties in delivering UG curricula, especially for DRM (14) (15) (16) (17) . In Malaysia, as many parts of the world, this difficulty is brought about the government-imposed limitation to social interaction with the introduction of the Movement Control Order Act (18) that included suspending primary, secondary, and tertiary education. Since the majority of activities in DRM teaching involve gathering and close interactions, the implementation of the Movement Control Order Act posed a greater challenge to teaching DRM to UG medical students, as traditional methods of teaching become prohibited during the pandemic. Faced with these challenges, e-learning has been suggested as a promising alternative instead of traditional F2F methods (19) (20) (21) .

In our institution, the Emergency Medicine module is taught in Year-5 over 1 credit hour (1 credit-hour = 40 notional hours). Presently DRM, which is part of this module, is taught in the form of face-to-face classroom method with field simulation exercise. This study attempts to experiment with deliverance of the cognitive aspect of teaching and learning contents of DRM as an online learning rather than face-to-face among the undergraduates in the pre-clinical years (Year-1 and Year-2), who are not normally students of this module. This study, elearning in teaching emergency disaster response (ELITE DR), focused only on the cognitive aspect of DRM, uses a one-way asynchronous online video teaching. As outcomes of the study, we set out to evaluate the effectiveness of this novel initiative and the medical students' perception of it. The hypothesis was that the cognitive aspect of DRM could be taught effectively and acceptably using the ELITE-DR approach.

This was a prospective, cross-sectional, interventional study involving pre-clinical year students at Faculty of Medicine Abbreviations: DRM, disaster response medicine; ELITE DR, e-learning in teaching emergency disaster response; F2F, face-to-face; PS, perception score; SLV, self-learning-video; UG, undergraduate.

Universiti Kebangsaan Malaysia (UKM), looking at pre-and post-intervention outcomes. Enrolment for the study was performed using convenience sampling. Pre-clinical year medical students, from the first and second year of the program, were invited to participate in this study since DRM was not part of the pre-clinical year curriculum. Therefore, it removed the bias of doing this intervention by excluding students who had prior exposure to disaster management teaching or training. To further minimize potential confounders such as referring to other printed or online materials and discussion among the participants, it was emphasized to the participants that the marks in the questionnaires would not affect their curriculum assessment. This was to alleviate further stress among the participants and to promote compliance with the methodology. Each participant was required to watch a set of the self-learningvideo (SLV) completely at least once.

The study was conducted between 2nd April 2019 and 31st March 2020. Approval was obtained from the Medical Research and Ethics Committee of UKM and funding was provided by the Faculty of Medicine as a Fundamental Research grant (approval number FF-2019-087).

The SLV consisted of three video lectures of 8-10 min duration to maintain participants' focus and attention. The The SLV content was validated by a panels of local emergency physicians who specialized in disaster medicine. They viewed the SLVs several times and made valuable remarks that contributed to the validity of the video. The recommended changes were made to the videos following comments from the panelists, and the process repeated until all panelists were satisfied with its content and arrangement. The study materials were then uploaded onto an online platform that was accessible to all participants.

The study collected quantitative data which included the participants' knowledge and perceptions. Respondents were invited to answer a self-administered questionnaire. Twenty questions assessed knowledge, while 26 questions assessed perceptions. Questions assessing knowledge were divided into principles and medical management of DRM. The knowledgebased questions were multiple-choice questions with a single best answer, and each question carried one (1) mark. The 26 items on the perceptions comprised the self-gain, presentability, and e-learning in the medical curriculum. These questions were developed by a group of three expert panels from among the local emergency physicians who specialized in DRM. The Delphi technique was used to develop the questionnaires. All questions were validated by expert panels of DRM to ensure those questions are clinically relevance. Further validation of the questionnaire was performed with a group of medical students from another institution that was not involved in this study.

Self-gain referred to the elements of that bring direct benefits to the participants and their preference, such as knowledge gained, flexibility, personalized learning, usefulness, ease of use, and familiarity of using online material or application in completing their task. In terms of presentability, the participants' preference for the SLV was evaluated. For e-learning in teaching DRM, those elements such as the use of e-learning as a standard teaching modality, substituting standard teaching with SLV, and recommendation of the SLV to fellow students were covered. Perception was measured by using a 4-point Likert scale instrument. Participants were asked to rank their agreeability to the statements given based on a 4-graded scale. Marks were given for each scale from −2 for strongly disagree; −1 for disagree; +1 for agree; and +2 for strongly agree. The total score was then calculated and divided by the number of participants to give the perception score (PS). The mean PS score was used to categorize the perception of the participants ranging from strongly disagree to strongly agree according to the scale shown in Table 1 .

The SLVs and the validated questionnaire were given to the eligible participants after briefing and consenting. A pre-test questionnaire was given to establish the baseline DRM knowledge among the participants. Each participant then received the threepart SLVs via web-links as below:

Strongly agree (Part 1) https://youtu.be/DAdVnFLozww (Part 2) https://youtu.be/ySWylU-1xmI (Part 3) https://youtu.be/3LiH0kS2brs.

The participants were given 7 consecutive days of access to the SLVs from the pre-test date. None of the participants received any teaching from facilitators during the learning session, as the intention was to simulate a selfinstructional, unsupervised learning situation. Participants were strictly advised against referring to other resources of DRM either through printed materials or online or to discuss with each other in order to limit the potential confounding factors. Post-intervention assessment (post-test) on knowledge and perception was conducted using a self-administered questionnaire after the participants had completed their dedicated 7 consecutive days of learning. A flow diagram detailing the study is given in Figure 2 .

There were 274 medical students in the pre-clinical years in the Faculty of Medicine UKM. Using the Krejcie and Morgan table (22) , it was considered that a minimum of 155 participants was required to achieve a statistical power of 80% at a confidence interval of 95%. For the internal consistency measurement of the questionnaire, Cronbach's alpha score was 0.83.

Statistical analyses were performed using Minitab Statistical Software (version 19, Pennsylvania State University, PA, USA). Demographic characteristics of the participants were obtained by descriptive analysis. Data were summarized using mean and standard deviation for continuous variables, frequency, and percentages for categorical variables. The 99% confidence interval was calculated for the mean scores. A paired t-test was used to assess the mean differences between the two groups (knowledge between pre-and post-test), and one-way ANOVA was used to compare the PS achieve among the four groups of PS. All differences were considered statistically significant if p < 0.01.

From a total of 274 undergraduate medical students in the preclinical year eligible for this study, 261 participants consented and were enrolled into the study. Thirteen were excluded from the study, 12 were because they had attended a disaster response medicine course prior this and one declined to participate. A total of 93 participants did not complete the study; a final total of 168 participants completed the study (Figure 3) .

Of the 168 participants, the majority were females from the first year (N = 135; 80.4%). Most of the participants (86.3%) watched the SLVs only once. The demographic details of the participants are shown in Table 2 . Table 3 shows the pre-and post-test data for knowledge on the principles, and medical management of DRM and their respective sub-components. The mean pre-and post-test marks for knowledge of DRM were 6.99 ± 2.65 and 13.31 ± 5.21, respectively (p < 0.001). On sub-analysis there was significant improvement in knowledge on the principles and medical management of DRM (p < 0.001).

The medical management components like triage and decontamination also significantly improved between pre-and post-test (all p < 0.001) but not in the areas of treatment and transport with p = 0.029 and p = 0.180, respectively. Table 4 shows the responses and mean score on perception for self-gain. Self-gain questions revealed that the participants "strongly agree" that e-learning is highly flexible, useful, easy to handle, and improved their knowledge. However, for familiarity with e-learning, such as finding the technique easier to use for revision, and allowing them to accomplish more work, the participants only scored "agree." Table 5 displays the result and mean score on SLV Presentability. The majority of the participants agreed or strongly agreed with the eye-catching visual stimuli of the videos (PS = +1.05 to +1.27). Animation, highlighted and enlarged words, and pictures were the preferred visual stimuli and helped participants retain facts (PS = +1.27). The participants scored "agree" (PS = +0.77 to +0.83) for audio stimuli, e.g., music, that had been incorporated in the videos. Table 6 shows the result and mean score on perception of the e-learning medical curriculum. Most of the participants would strongly recommend this video to others to enhance their learning ability of DRM (PS = +1.26 to +1.38). Most of the participants "agree" that DRM taught through elearning, should be incorporated into the medical curriculum (PS = +0.71 to +0.99) in the form of adjunct material (PS = +1.12). However, they "disagree" (PS = −0.36) that DRM through e-learning could, or should, completely replace F2F sessions. Analysis of participants' knowledge and their PS revealed that those who graded higher PS could obtained a better knowledge score. One-way ANOVA analysis also revealed a significant difference between the PS groups' knowledge score (p < 0.001) as shown in Table 7 .

This study has demonstrated that a novel e-learning package can successfully be used to teach DRM to UG medical students. Previous studies have been shown that e-learning can be as effective as F2F teaching when it comes to understanding knowledge aspects such as simple recall and comprehension (23) (24) (25) (26) . In contrast to the higher levels of learning outline in the Bloom's taxonomy, such as analysis, application, synthesis, and assessment, recall, and comprehension levels of learning are particularly well-served by e-learning. The participants, however, did not score well for medical management aspects, especially for the treatment and transport components. This was expected because the participants were pre-clinical students, and these subjects would have been unfamiliar to them where a deeper clinical understanding, further appraisal, and decision-making skills were required. Feedback and debriefing have been shown to be important to enhance understanding in these areas (27) . We may improve these skills if the feedback can be provided while viewing the video. An e-learning video platform that can assess the participants' understanding and collect their immediate feedback (28) , such as ED-Puzzle or Common Ground (CG) scholar, may be one approach to this. The CG scholar platform has been shown to support critical thinking and promote a higher-order of thinking skills (29) . It incorporates active knowledge production, ubiquitous learning, and recursive feedback, which involved receiving and giving reviews from peers and instructors to allow learners to reflect on their work. Our study used Screencast-O-Matic, a one-way directed video application that could not provide or create these higher-order thinking skills for the participants.

Participants did particularly well on the triage topic. This could be related to the structured algorithm, which was available in the video and hence required only simple decision-making (lower-order thinking). The structured algorithm directed the participants to follow the signs or symptoms elicited before deciding.

Perceptions were categorized according to the PS scale in Table 1 . In self-gain, the participants agreed on most of the learning items, especially those involving knowledge improvement, flexibility, personalization, usefulness, and ease of handling. They found e-learning easier to use and convenient. Having a flexible and personalized e-learning environment is important to encourage an active and inclusive learning environment (30) . However, in terms of familiarity, such as revising using digital materials alone or using technologies in accomplishing more work, the PS score was much lower. Therefore, while participants find e-learning helpful, they need to be familiarized with e-learning tools, especially when searching for new data or knowledge.

Limitations in the familiarity with usage of digital technology can lead to difficulties for students to accomplish their goals. Consequently, the effort they need to invest to generate the expected outcomes tends to be higher than that of students better familiarized with online technologies (31) . In terms of presentability, the participants awarded high scores for visual inputs compared to audio inputs. This is coherent with a previous study where visual computer-based learning did not show any significant difference with or without an auditory narrative (32) . The pictures used able to catch my attention

The music helped to sustain my attention

The music uplift my mood

The bolded words attract my attention

The enlarged words attract my attention

The animation, pictures, and visual stimulus help me to remember the content better It appeared that visual stimuli were preferred to audio stimuli for factual learning and knowledge retention.

In terms of e-learning incorporation in the DRM, the participants agreed with most of the statements, except the statement that e-learning could replace F2F teaching totally. Presumably, this is because, in F2F teaching, students receive not just visual stimuli but also audio, emotional, tactile, and feedback stimuli that make a more immersive, powerful, and retentive learning experience. Furthermore, psychomotor skills could not be adequately covered with e-learning. However, participants agreed that e-learning is greatly beneficial, but not up to the level of replacing the current format of DRM teaching.

It is interesting to note that most of our participants in this study were females as shown in Table 2 . This is generally due to there are more female students in medical school throughout Malaysia with a ratio of about 60:40 (female:male) (33) . Another reason why there were more female participants was due to larger dropout rate among male participants (48%, n = 30) as compared to females (36%, n = 76) who did not complete the study.

The number of questions in the questionnaires is relatively low and might not be adequate in assessing some topics. Nevertheless, our study gives a general idea of the capability of video teaching in acquiring factual knowledge and decision This study did not explore or evaluate the psychomotor skills that students would usually perform during F2F simulation exercises of DRM, including Airway, Breathing, Circulation, and Immobilization procedures. These include standard first aid procedures (bleeding and wound management, splinting, and bandaging), invasive procedural skills (airway and ventilation management, intravenous cannulation), carrying and lifting of victims, etc. Generally, an online platform always has difficulties in teaching and assessing procedural skills. A further study in assessing teaching and learning procedural skills could be conducted in the future.

We did not evaluate the relative time spent by the participants in watching the three videos. This might help reveal whether the duration of the video watching relates to the effectiveness of learning and knowledge retention.

The videos in our study do not have "closed-captioning" since we felt that all the important facts have been spelled out in the videos. However, having closed captioning might have had positive influence on the participants' understanding. This will constitute further improvement in our future educational material or research using video for e-learning. Another limitation of our video was the lack of features for printing key points or summary from the video. Providing the viewers the ability to print key points or a summary of the videos might help in learning. This feature allows key frames of the segment to be converted to textual annotation using segmental encoding and decoding deep learning models (34) .

The study also did not compare synchronous (real-time interaction using any online application like Zoom, Microsoft Teams, etc.) with asynchronous teaching (not real-time interaction) of DRM. This study employed an asynchronous one-way video teaching rather than synchronous e-learning with feedback incorporated. Future research should explore the impact of synchronous and asynchronous e-learning with and without incorporated feedback to determine the best way of delivering DRM to UG medical students.

Our study did not compare with the other technique of disaster response medicine teaching because most of the time this subject were taught using a classroom medium either as a face-to-face immersive simulation, table-top exercise or hybrid simulation of approach combining e-learning with classroom immersive simulation. Therefore, we felt it was not appropriate to compare our study that utilize a full asynchronous online approach with the current established methods. Furthermore, we did not evaluate the psychomotor skills in our study.

Finally, this study did not incorporate debriefing even though debriefing is a very powerful learning tool because debriefing was not suitable for an asynchronous methods of teaching. Furthermore, debriefing after watching the video would disrupt the findings of the study. We wanted to determine the effect of a pure asynchronous online teaching on disaster response medicine topics. However, in the future study, we are going to include the element of debriefing with the synchronous mode of teaching.

Our study revealed that ELITE-DR, a novel e-learning platform is beneficial in teaching-learning of emergency DRM among UG medical students. Recall of knowledge comprehension and simple analysis-application for basic decision-making was particularly well-served through ELITE-DR, whereas complex decision-making knowledge aspects such as treatment and transport decisions were likely to require a different approach, perhaps one that incorporates feedback. Higher flexibility, usefulness, ease of access, and personalized learning were some of the benefits that make e-learning an acceptable approach for DRM teaching. In e-learning, UG students preferred visual stimuli compared to audio stimuli. The majority of UG students agreed that e-learning could provide as an adjunct but should not replace F2F teaching.

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

The studies involving human participants were reviewed and approved by Medical Research and Ethics Committee of Universiti Kebangsaan Malaysia. The patients/participants provided their written informed consent to participate in this study.

IS, FZ, HI, DS, and CR provided the study concept and performed data analysis. FZ and IS performed data collection. IS, FZ, and CR interpreted the data. All authors were involved in writing and critically reviewing the final manuscript.

This study was from the fundamental research grant of the Faculty of Medicine UKM. Research and ethical permission was obtained for carrying out the study from the university research and ethical committee (UKM-REC Approval Number FF-2019-08).

Relevance of disaster and deployment medicine for medical students: a pilot study based on an interdisciplinary lecture series

Pilot study of a longitudinal integrated disaster and military medicine education program for undergraduate medical students

Knowledge, attitude and practice of disaster preparedness and mitigation among medical students. Disaster Prev Manag

Development of web-based learning packages for emergency skills

A multiphase disaster training exercise for emergency medicine residents: opportunity knocks

Proposal for a community-based disaster management curriculum for medical school undergraduates in Saudi Arabia

Deployment and disaster medicine in an undergraduate teaching module

The effectiveness of simulation based medical education in teaching concepts of major incident response

Postgraduate education in disaster health and medicine

Video-based learning vs. traditional lecture for instructing emergency medicine residents in disaster medicine principles of mass triage, decontamination, and personal protective equipment

Disaster training in 24 hours: evaluation of a novel medical student curriculum in disaster medicine

Simulation based education in delivering emergency medicine module

Evaluation of a new community-based curriculum in disaster medicine for undergraduates

Mass gathering events and reducing further global spread of COVID-19: a political and public health dilemma

Medical student education in the time of COVID-19

The COVID-19 pandemic through the lens of a medical student in India

A multimodal multi-institutional solution to remote medical student education for otolaryngology during COVID-19

Malaysia Announces Movement Control Order After Spike in Covid-19 Cases (Updated)

Live lecture versus video-recorded lecture: are students voting with their feet

Design and development of flood disaster game-based learning based on learning domain

Determining sample size for research activities

Teaching medical students about attention deficit hyperactivity disorder (ADHD): the design and development of an e-learning resource

Evaluation of student outcomes in online vs. campus biostatistics education in a graduate school of public health

Learning from simple ebooks, online cases or classroom teaching when acquiring complex knowledge. A randomized controlled trial in respiratory physiology and pulmonology

Effectiveness of teaching automated external defibrillators use using a traditional classroom instruction versus self-instruction video in non-critical care nurses

Video feedback and e-Learning enhances laboratory skills and engagement in medical laboratory science students

Promoting critical clinical thinking through e-learning

Exploration of an e-learning model to foster critical thinking on basic science concepts during work placements

Towards learner-constructed e-learning environments for effective personal learning experiences

Explaining university students' effective use of e-learning platforms

Auditory narrative does not improve learning when added to visual computer-based learning modules

Gender ratio in undergraduate medical program, Medical Faculty, IIUM

Semantic text summarization of long videos