key: cord-309201-c1awh48y authors: Elzainy, Ahmed; El Sadik, Abir; Al Abdulmonem, Waleed title: Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University date: 2020-10-22 journal: J Taibah Univ Med Sci DOI: 10.1016/j.jtumed.2020.09.005 sha: doc_id: 309201 cord_uid: c1awh48y OBJECTIVES: During the COVID-19 pandemic, academic institutions are promptly shifting all educational activities to the e-learning format. The present work describes concurrent procedures for online teaching and assessment performed at the College of Medicine, Qassim University, KSA. We also explored the impact of e-learning and assessment on the performance of students and faculty, and the challenges to their sustainability. METHODS: In this descriptive cross-sectional study, we recorded the number and duration of different online educational activities during the COVID-19 pandemic. Training sessions for various procedures of virtual classrooms and online assessments were organised for teachers and students. A newly established e-assessment committee arranged different online assessments. A comparison between the mean problem-based learning (PBL) grades of the same students was conducted either face-to-face or online. A student satisfaction survey and online staff focus group about the online learning experiences were conducted, and weekly staff perception reports were prepared. The results obtained were then analysed. RESULTS: A total of 620 virtual classrooms were successfully implemented over 994 h including theoretical lectures, PBL sessions, seminars, and tutorials. A significant increase in the mean PBL grades was observed for female students during the online sessions. Out of the basic year students and staff, 58.82% reflected their high satisfaction towards virtual classrooms, online assessment, and online workshops. CONCLUSION: The present study elaborates on the benefits of e-learning and assessment. We observed higher student achievements and promising staff perceptions with obvious improvement in their technological skills. These findings support the shift towards future implementation of more online medical courses. ‫ﺖ‬ ‫ﻟ‬ ‫ﺠ‬ ‫ﻨ‬ ‫ﺔ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻘ‬ ‫ﻴ‬ ‫ﻴ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻴ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻲ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻤ‬ ‫ﻨ‬ ‫ﺸ‬ ‫ﺄ‬ ‫ﺓ‬ ‫ﺣ‬ ‫ﺪ‬ ‫ﻳ‬ ‫ﺜ‬ ‫ﺎ‬ ‫ﻣ‬ ‫ﺨ‬ ‫ﺘ‬ ‫ﻠ‬ ‫ﻒ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻘ‬ ‫ﻴ‬ ‫ﻴ‬ ‫ﻤ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻴ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻴ‬ ‫ﺔ‬ . ‫ﺗ‬ ‫ﻢ‬ ‫ﻣ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺭ‬ ‫ﻧ‬ ‫ﺔ‬ ‫ﻣ‬ ‫ﺘ‬ ‫ﻮ‬ ‫ﺳ‬ ‫ﻂ‬ ‫ﺩ‬ ‫ﺭ‬ ‫ﺟ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﻧ‬ ‫ﻔ‬ ‫ﺲ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻄ‬ ‫ﻠ‬ ‫ﺒ‬ ‫ﺔ‬ ‫ﺃ‬ ‫ﺛ‬ ‫ﻨ‬ ‫ﺎ‬ ‫ﺀ‬ ‫ﺟ‬ ‫ﻠ‬ ‫ﺴ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻌ‬ ‫ﻠ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺋ‬ ‫ﻢ‬ ‫ﻋ‬ ‫ﻠ‬ ‫ﻰ‬ ‫ﺣ‬ ‫ﻞ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻤ‬ ‫ﻌ‬ ‫ﻀ‬ ‫ﻼ‬ ‫ﺕ‬ ‫ﺳ‬ ‫ﻮ‬ ‫ﺍ‬ ‫ﺀ‬ ‫ﻋ‬ ‫ﻘ‬ ‫ﺪ‬ ‫ﺕ‬ ‫ﻭ‬ ‫ﺟ‬ ‫ﻬ‬ ‫ﺎ‬ ‫ﻟ‬ ‫ﻮ‬ ‫ﺟ‬ ‫ﻪ‬ ‫ﺃ‬ ‫ﻭ‬ ‫ﺗ‬ ‫ﻢ‬ ‫ﻋ‬ ‫ﻘ‬ ‫ﺪ‬ ‫ﻫ‬ ‫ﺎ‬ ‫ﺇ‬ ‫ﻟ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻴ‬ ‫ﺎ‬ . ‫ﻛ‬ ‫ﻤ‬ ‫ﺎ‬ ‫ﺗ‬ ‫ﻢ‬ ‫ﻋ‬ ‫ﻤ‬ ‫ﻞ‬ ‫ﻭ‬ ‫ﺗ‬ ‫ﺤ‬ ‫ﻠ‬ ‫ﻴ‬ ‫ﻞ‬ ‫ﺍ‬ ‫ﺳ‬ ‫ﺘ‬ ‫ﺒ‬ ‫ﺎ‬ ‫ﻧ‬ ‫ﺔ‬ ‫ﺭ‬ ‫ﺿ‬ ‫ﺎ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻄ‬ ‫ﻼ‬ ‫ﺏ‬ ، ‫ﻭ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺭ‬ ‫ﻳ‬ ‫ﺮ‬ ‫ﺍ‬ ‫ﻷ‬ ‫ﺳ‬ ‫ﺒ‬ ‫ﻮ‬ ‫ﻋ‬ ‫ﻴ‬ ‫ﺔ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﺼ‬ ‫ﻮ‬ ‫ﺭ‬ ‫ﺃ‬ ‫ﻋ‬ ‫ﻀ‬ ‫ﺎ‬ ‫ﺀ‬ ‫ﻫ‬ ‫ﻴ‬ ‫ﺌ‬ ‫ﺔ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﺪ‬ ‫ﺭ‬ ‫ﻳ‬ ‫ﺲ‬ ‫ﺑ‬ ‫ﺎ‬ ‫ﻹ‬ ‫ﺿ‬ ‫ﺎ‬ ‫ﻓ‬ ‫ﺔ‬ ‫ﺇ‬ ‫ﻟ‬ ‫ﻰ‬ ‫ﺧ‬ ‫ﺒ‬ ‫ﺮ‬ ‫ﺍ‬ ‫ﺕ‬ ‫ﺟ‬ ‫ﻠ‬ ‫ﺴ‬ ‫ﺔ‬ ‫ﻣ‬ ‫ﺠ‬ ‫ﻤ‬ ‫ﻮ‬ ‫ﻋ‬ ‫ﺔ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻛ‬ ‫ﻴ‬ ‫ﺰ‬ ‫ﻋ‬ ‫ﻦ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻌ‬ ‫ﻠ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻴ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻲ‬ . ‫ﺍ‬ ‫ﻟ‬ ‫ﻨ‬ ‫ﺘ‬ ‫ﺎ‬ ‫ﺋ‬ ‫ﺞ‬ : ‫ﺗ‬ ‫ﻢ‬ ‫ﺗ‬ ‫ﻨ‬ ‫ﻔ‬ ‫ﻴ‬ ‫ﺬ‬ ٦٢٠ ‫ﻓ‬ ‫ﺼ‬ ‫ﻼ‬ ‫ﺍ‬ ‫ﻓ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﺍ‬ ‫ﺿ‬ ‫ﻴ‬ ‫ﺔ‬ ‫ﺑ‬ ‫ﻨ‬ ‫ﺠ‬ ‫ﺎ‬ ‫ﺡ‬ ‫ﻋ‬ ‫ﻠ‬ ‫ﻰ‬ ‫ﻣ‬ ‫ﺪ‬ ‫ﻯ‬ ٩٩٤ ‫ﺳ‬ ‫ﺎ‬ ‫ﻋ‬ ‫ﺔ‬ ‫ﺷ‬ ‫ﻤ‬ ‫ﻠ‬ ‫ﺖ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻤ‬ ‫ﺤ‬ ‫ﺎ‬ ‫ﺿ‬ ‫ﺮ‬ ‫ﺍ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻨ‬ ‫ﻈ‬ ‫ﺮ‬ ‫ﻳ‬ ‫ﺔ‬ ، ‫ﻭ‬ ‫ﺟ‬ ‫ﻠ‬ ‫ﺴ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻌ‬ ‫ﻠ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺋ‬ ‫ﻢ‬ ‫ﻋ‬ ‫ﻠ‬ ‫ﻰ‬ ‫ﺣ‬ ‫ﻞ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻤ‬ ‫ﻌ‬ ‫ﻀ‬ ‫ﻼ‬ ‫ﺕ‬ ، ‫ﻭ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻨ‬ ‫ﺪ‬ ‫ﻭ‬ ‫ﺍ‬ ‫ﺕ‬ ‫ﻭ‬ ‫ﺣ‬ ‫ﻠ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻨ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺵ‬ . ‫ﻻ‬ ‫ﺣ‬ ‫ﻈ‬ ‫ﻨ‬ ‫ﺎ‬ ‫ﺯ‬ ‫ﻳ‬ ‫ﺎ‬ ‫ﺩ‬ ‫ﺓ‬ ‫ﺫ‬ ‫ﺍ‬ ‫ﺕ‬ ‫ﺩ‬ ‫ﻻ‬ ‫ﻟ‬ ‫ﺔ‬ ‫ﺇ‬ ‫ﺣ‬ ‫ﺼ‬ ‫ﺎ‬ ‫ﺋ‬ ‫ﻴ‬ ‫ﺔ‬ ‫ﻓ‬ ‫ﻲ‬ ‫ﻣ‬ ‫ﺘ‬ ‫ﻮ‬ ‫ﺳ‬ ‫ﻄ‬ ‫ﺪ‬ ‫ﺭ‬ ‫ﺟ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻄ‬ ‫ﺎ‬ ‫ﻟ‬ ‫ﺒ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺃ‬ ‫ﺛ‬ ‫ﻨ‬ ‫ﺎ‬ ‫ﺀ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺠ‬ ‫ﻠ‬ ‫ﺴ‬ ‫ﺎ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻴ‬ ‫ﺔ‬ ‫ﻟ‬ ‫ﻠ‬ ‫ﺘ‬ ‫ﻌ‬ ‫ﻠ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻘ‬ ‫ﺎ‬ ‫ﺋ‬ ‫ﻢ‬ ‫ﻋ‬ ‫ﻠ‬ ‫ﻰ‬ ‫ﺣ‬ ‫ﻞ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻤ‬ ‫ﻌ‬ ‫ﻀ‬ ‫ﻼ‬ ‫ﺕ‬ . ‫ﻋ‬ ‫ﻜ‬ ‫ﺲ‬ ‫ﺃ‬ ‫ﻛ‬ ‫ﺜ‬ ‫ﺮ‬ ‫ﻋ‬ ‫ﺪ‬ ‫ﺩ‬ ‫ﻣ‬ ‫ﻤ‬ ‫ﻜ‬ ‫ﻦ‬ ٥٢.٨٢ ٪ ‫ﻣ‬ ‫ﻦ‬ ‫ﻃ‬ ‫ﻼ‬ ‫ﺏ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺴ‬ ‫ﻨ‬ ‫ﻮ‬ ‫ﺍ‬ ‫ﺕ‬ ‫ﺍ‬ ‫ﻷ‬ ‫ﺳ‬ ‫ﺎ‬ ‫ﺳ‬ ‫ﻴ‬ ‫ﺔ‬ ‫ﺑ‬ ‫ﺎ‬ ‫ﻹ‬ ‫ﺿ‬ ‫ﺎ‬ ‫ﻓ‬ ‫ﺔ‬ ‫ﺇ‬ ‫ﻟ‬ ‫ﻰ‬ ‫ﺃ‬ ‫ﻋ‬ ‫ﻀ‬ ‫ﺎ‬ ‫ﺀ‬ ‫ﻫ‬ ‫ﻴ‬ ‫ﺌ‬ ‫ﺔ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﺪ‬ ‫ﺭ‬ ‫ﻳ‬ ‫ﺲ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺮ‬ ‫ﺿ‬ ‫ﻰ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻌ‬ ‫ﺎ‬ ‫ﻟ‬ ‫ﻲ‬ ‫ﺗ‬ ‫ﺠ‬ ‫ﺎ‬ ‫ﻩ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻔ‬ ‫ﺼ‬ ‫ﻮ‬ ‫ﻝ‬ ‫ﺍ‬ ‫ﻻ‬ ‫ﻓ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﺍ‬ ‫ﺿ‬ ‫ﻴ‬ ‫ﺔ‬ ، ‫ﻭ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻘ‬ ‫ﻴ‬ ‫ﻴ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻴ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻲ‬ ‫ﻭ‬ ‫ﻭ‬ ‫ﺭ‬ ‫ﺵ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻌ‬ ‫ﻤ‬ ‫ﻞ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻴ‬ ‫ﺔ‬ . ‫ﺍ‬ ‫ﻻ‬ ‫ﺳ‬ ‫ﺘ‬ ‫ﻨ‬ ‫ﺘ‬ ‫ﺎ‬ ‫ﺟ‬ ‫ﺎ‬ ‫ﺕ‬ : ‫ﺃ‬ ‫ﻭ‬ ‫ﺿ‬ ‫ﺤ‬ ‫ﺖ‬ ‫ﻫ‬ ‫ﺬ‬ ‫ﻩ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺪ‬ ‫ﺭ‬ ‫ﺍ‬ ‫ﺳ‬ ‫ﺔ‬ ‫ﻓ‬ ‫ﻮ‬ ‫ﺍ‬ ‫ﺋ‬ ‫ﺪ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻌ‬ ‫ﻠ‬ ‫ﻢ‬ ‫ﺍ‬ ‫ﻹ‬ ‫ﻟ‬ ‫ﻜ‬ ‫ﺘ‬ ‫ﺮ‬ ‫ﻭ‬ ‫ﻧ‬ ‫ﻲ‬ ‫ﻭ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﺘ‬ ‫ﻘ‬ ‫ﻴ‬ ‫ﻴ‬ ‫ﻢ‬ . ‫ﻻ‬ ‫ﺣ‬ ‫ﻈ‬ ‫ﻨ‬ ‫ﺎ‬ ‫ﺍ‬ ‫ﺭ‬ ‫ﺗ‬ ‫ﻔ‬ ‫ﺎ‬ ‫ﻋ‬ ‫ﺎ‬ ‫ﻓ‬ ‫ﻲ‬ ‫ﺇ‬ ‫ﻧ‬ ‫ﺠ‬ ‫ﺎ‬ ‫ﺯ‬ ‫ﺍ‬ ‫ﻟ‬ ‫ﻄ‬ ‫ﻼ‬ ‫ﺏ‬ ‫ﻭ‬ ‫ﺗ‬ ‫ﺼ‬ ‫ﻮ‬ ‫ﺭ‬ ‫ﺍ‬ ‫ﻭ‬ Objectives: During the COVID-19 pandemic, academic institutions are promptly shifting all educational activities to the e-learning format. The present work describes concurrent procedures for online teaching and assessment performed at the College of Medicine, Qassim University, KSA. We also explored the impact of e-learning and assessment on the performance of students and faculty, and the challenges to their sustainability. Methods: In this descriptive cross-sectional study, we recorded the number and duration of different online educational activities during the COVID-19 pandemic. Training sessions for various procedures of virtual classrooms and online assessments were organised Q7 for teachers and students. A newly established e-assessment committee arranged different online assessments. A comparison between the mean problem-based learning (PBL) grades of the same students was conducted either face-to-face or online Q8 . A student satisfaction survey and Q9 online staff focus group about the online learning experiences were conducted, and weekly staff perception reports were prepared. The results obtained were then analysed Q10 . Results: A total of 620 virtual classrooms were successfully implemented over 994 h including theoretical lectures, PBL sessions, seminars, and tutorials. A significant increase in the mean PBL grades was observed for female students during the online sessions. Out of the basic year students and staff, 58.82 Q11 % reflected their high satisfaction towards virtual classrooms, online assessment, and online workshops. The present study elaborates on the benefits of e-learning and assessment. We observed higher student achievements and promising staff perceptions with obvious improvement in their technological skills. These findings support the shift towards future implementation of more online medical courses. The COVID-19 pandemic has led to the global disruption of medical education which necessitated working online. 1 Urgent response to the current situation required an increase in medical educators' awareness towards online teaching. 2 Several researches determined the effectiveness of digital technologies for life-long e-learning and continuous professional development. 3 E-Learning has been established worldwide in response to the shortage of health educators and the need to switch into TEAL Q13 . 4 ,5 E-learning has several advantages Q14 , such as encouraging students for self-directed learning 6 and updating the curricula. 7 The College of Medicine at Qassim University, established in 2001, adopted the PBL system as an interactive educational strategy. 8 The college shifted into digitalised PBL materials for one year, which was a good preparation for complete online PBL sessions. Recent technologies allowed the progressive innovation of e-learning. 9, 10 Several studies have investigated the benefits of these technologies in medical education, especially the PBL system. 11, 12 Official online platforms, mainly through the Blackboard learning management system (LMS) version 9.1 (Blackboard, Washington, DC), are used in Qassim university to conduct educational sessions including lectures, tutorials, PBL sessions, seminar presentations, and open discussion forums. Online formative assessments, through the Blackboard, were also performed. These assessments reflect the nature of online learning and give the students more responsibility for their Q15 learning. 13 Online assessment allows the learners to demonstrate their capabilities in critical thinking and solving problems, which are the key benefits of shifting from traditional teaching to e-learning where the teacher is mainly a facilitator. 14 The present study described the procedures performed to facilitate the urgent transition to e-learning and online assessment during the COVID-19 pandemic and to highlight its expected benefits and impact on student and staff satisfaction and performance. It also aimed to compare the scores of male and female students during both face-to-face and online PBL sessions, and to explore the expected challenges of this experience to sustain its future implementation after the COVID-19 pandemic. This was a descriptive observational study conducted Q16 over 65 days. During this period, four weeks of PBL sessions were accomplished for the basic year students. The study collected data from all the undergraduate students, involved in this e-learning experience, of preclinical phase (n ¼ 425) (male students ¼ 252; female students ¼ 173) and clinical phase (n ¼ 249) (male students ¼ 155; female students ¼ 94), and 120 instructors (47 basic and 73 clinical). Data of 23 students were not included as they dropped out from both the basic and clinical phases Q17 . The aim and procedure of the study were clarified to the participating students and staff, and their consents were obtained. Students' identity will not be disclosed for ethical reasons. The confidentiality of the information obtained was maintained. All theoretical activities, including lectures, PBL, tutorials, and seminar sessions, in College of Medicine at Qassim University were adapted to the e-learning modality through the Blackboard, version 9.1 (Blackboard, Washington, DC) and Zoom Cloud Meetings . The authors contributed to the rescheduling of timetables for all these activities. All practical or clinical sessions were postponed. Webinars about virtual classrooms and online assessments were presented for staff and students. An e-assessment committee was established for the first time consisting of thirteen membersdnine basic scientists and four clinical staff. This committee formulated, revised, and uploaded the online assessments with their logistics and evaluated the results using item analysis. The educational strategies for the live streaming sessions, during the COVID-19 pandemic, at the College of Medicine at Qassim University included lectures, PBL sessions, tutorials, and seminar presentations to achieve the course objectives. Comparisons of the mean PBL marks during control (face-to-face) and online (virtual) sessions were done for male and female students of the first and third years. Secondyear students were excluded as they started a new block with the shift to e-learning. The students completed an online satisfaction survey on their perceptions of the e-learning experience, with a 5-point Likert scale. Weekly reports concerning staff perceptions on the effectiveness of live streaming activities were collected with a 3-point Likert scale. The Cronbach's alpha test was used for testing the internal consistency and reliability of the students' and staff's perceptions Q20 . Kendall's tau B, a nonparametric measure of association that exists between two variables, was used to test the correlation of the items of the students' survey. An online focus group for the staff, using the Focus-GroupIt software (https://www.focusgroupit.com/), was performed. The questions were presented in the form of a SWOT analysis (Figure 1 ). The group was composed of one moderator, one observer, and seven participants (the supervisors of basic sciences departments and one radiology staff). The two-hour-long online synchronous focus group discussion was recorded. The analysed data were reviewed and interpreted by an independent investigator. The data were analysed using the Statistical Package for the Social Sciences (SPSS) software, version 21 (IBM Corp., Armonk, NY). Descriptive statistics (percentages, mean, Q21 and standard errors of the mean) were used to describe the quantitative variables with their analysis through pairedsamples (to compare the male and female mean PBL marks) and independent t-tests (to compare the mean marks of the face-to-face and online PBL sessions). A p-value of <0.05 was considered significant. Weekly reports though the official learning management systemdBlackboarddregarding the number, duration, and modality of different educational activities including the live streaming sessions and students' attendance rate were collected from the course organisers in coordination with the e-learning unit, phase coordination, and e-assessment committees. Evaluation of students during their e-learning experience was done based on their assessment during the online PBL sessions. Tables 1 and 2 present the details regarding the virtual classrooms, conducted mostly through Blackboard, of the preclinical and clinical phases Q22 . They represent the numbers of e-learning activities successfully implemented. Significant increase in the mean PBL marks of the female students of both first and third years was observed during the online sessions than in the face-to-face sessions of the relevant year. Additionally, there was a significant increase in the mean PBL marks of the female students of the first and third years than that of the male students of the relevant year in both face-to-face and online sessions (Tables 3 and 4) . Two hundred and fifty Q23 students of the preclinical phase (58.82%) completed the perception survey. Students' satisfaction towards the new modality of e-learning and online assessment was reported (Table 5 ). The items covered in the students' survey included the following: the success of elearning in compensating for the urgent suspension of faceto-face teaching during the COVID-19 pandemic, efficiency of instructions announced before the online teaching, staff's resistance and experience in e-learning requirements, and effectiveness of online assessment in testing their knowledge and skills levels. The Cronbach's alpha test performed for all items of this survey resulted in an overall score of Q24 0.67. Kendall's tau B was used to test the correlation of these items. The correlation coefficient ranged from 0.134 to 0.394. Open-ended comments were received from 225 out of 250 students (90%), which were classified into two categoriesdone for teaching activities and the other for online assessment. Eighty-seven per cent Q25 (n ¼ 195) of the students reflected their enthusiasm towards the e-learning modality: for example, 'Very amazing; online teaching experience is the future of learning' and 'Online lectures are super-satisfying' Q26 . They expressed their satisfaction in having the same staff delivering the lectures for both male and female students. E-Learning provided a chance for the shy studentsdas they could participate freely through online chattingd and motivated them for verbal discussions: 'Initially, I was shy and shared my opinions during the open discussions only through chat; by the time I was encouraged to share orally Q27 '. They expressed satisfaction with the rescheduling of educational activities and their allocated time and duration; for example, 'Modification of the timetable allows more time for educational and recreational activities, thus allowing to live like a normal human'. The students expressed that some of the staff lacked adequate experience in conducting open discussions during online teaching. Seventy per cent (n ¼ 158) of the students reported that frequent online quizzes motivated them to study; for example, 'Online quizzes are very helpful to improve my grades'. They appreciated the conduction of the mock quiz; for example, 'Mock exam was very helpful for training before the online exams'. Electronic assessment ensured fewer errors carried 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 out by the students while filling out bubbles in Q28 their answer sheets. Lastly, they recommended that some courses could be implemented online in the future. Staff satisfaction in virtual classrooms was also observed (Tables 6 and 7) , which reflected that the live streaming sessions were very effective. The online focus group discussion was categorised into four themes based on the SWOT analysis. Concerning the strengths, most of the staff agreed that the new arrangement of educational activities efficiently compensated for the suspension of face-to-face teaching Q29 . They were satisfied with the university's efforts to improve staff awareness regarding virtual classrooms and online assessment through webinars Q30 . The majority of them appreciated the tremendous shift to implement online summative assessments; for example, 'Online assessment assured the staff about students' achievement of learning outcomes' and 'Conduction of live oral exams based upon clear standardised checklist was highly effective'. The concerns expressed by the participants included some staff's limited online teaching experience and Q31 the insufficient number of IT technicians which interferes with proper digitalisation. Regarding the opportunities that could be gained, the staff acknowledged the constitution of the e-assessment committee in the focus group; 'Such committee was an urgent requirement to tackle the full First 114 27 231 3634 37 91 13 Second 108 7 216 3512 31 72 12 Third 81 34 189 1979 19 84 12 Total 303 68 636 9125 87 247 37 Bb: Blackboard. A. Elzainy et al. 4 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 responsibility for online assessments'. They reflected the improvement of their expertise towards the novel pedagogical e-learning techniques and their enthusiasm to construct online courses; for example, 'Adoption of electronic courses allows better arrangement of educational activities and gives more chances for students' self-directing learning'. Two staff members reported the inconvenience of some students in taking the online quizzes, especially during the initial period, while the others specifically talked about Q32 those who live in distant rural areas with insufficient internet coverage. Four staff members emphasised the limited capabilities of the official version of Blackboard, particularly in conducting the morning sessions. Advanced technologies emerged during the COVID-19 pandemic to sustain world productivity. The Horizon 2020 Teaching and Learning report highlighted the role of advanced technology in medical education. The present study represents the major change in the educational culture. E-learning was highly beneficial for competent educators as it decreased the needs for in-class attendance. 15 In agreement with McCoy et al., 16 students and staff reflected that live streaming lectures efficiently compensated the suspension of face-toface teaching and provided more chances for open discussions. Nomination of the same staff to virtually present each topic for both male and female students encouraged more peer sharing and competition among the students Q33 . The rescheduled educational activities were more convenient to the students, as reflected in their attendance. Recent technologies resolved the lack of physical attendance and increased learning effectiveness. 17, 18 The Horizon 2020 report highlighted the effectiveness of online teaching in overcoming the restrictions such as shortage of venues for large group lectures. However, one of the main challenges of e-learning, as reflected in the current work, is in teaching the psychomotor, practical, and clinical skills efficiently. Murphy 19 recently reported that most medical schools suspended Q34 the clinical settings during the COVID-19 pandemic. This could be overcome by using virtual-reality simulators. 20, 21 Unfortunately, most of the students were unsatisfied with how some staff members practiced e-learning. A previous study performed in a similar culturedUnited Arab Emiratesdobserved that the teachers felt worried about the shift into a new educational strategy. Psychological assurance was recommended to encourage them to deal with the unknown consequences. Multiple webinars about proper virtual classrooms and peer sharing of experiences between the staff members solved this problem. Goh et al. 18 claimed that live streaming applications will improve the technological skills of the educators. PIVOT MedEd 22 appreciated the free elearning webinars for health professional educators worldwide and the national coordination between medical schools in sharing such training courses. Successful collaborative online learning demanded the support of IT technicians, as previously reported. 16, 23 The Cronbach's alpha test implied that the survey tool had a good level of internal consistency and reliability for both the students' survey and staff's overall satisfaction in the live streaming experience. The correlation coefficient indicated that the items in the students' survey were well correlated. However, the application of Kendall's tau B test on the staff perception was non-feasible since it measures the association between two variables, unlike the current study which focused on the staff perception on the effectiveness of virtual classrooms. The higher achievement level detected in the mean marks of online PBL compared with face-to-face sessions could be attributed to the easier access to the explanation of the phenomena. The students' assessment during the PBL sessions in this work was based upon their commitment, team spirit, interaction with peers and tutors, presentation skills, and ability for brain storming and analysing the phenomena. The students' assessment during the PBL sessions was based upon their performance during the session rather than their achievements through other summative assessment methods such as multiple choice questions which are associated with higher chances of cheating Q35 . 24 These findings are in agreement with the previous study 25 which observed that online PBL enhanced critical thinking and fulfilled the intended learning objectives. Therefore, online PBL could enhance the metacognitive skills, ability to solve problems, and team working. Collaborative interaction in the online environment helped enhance peer sharing. 26 After the SARS epidemic, one medical school in China adopted online PBL as an educational strategy for the subsequent years. 1 The higher PBL scores in female students could be attributed to the difference in the style of thinking, learning, and capabilities of problem-solving. 27 Makonye 28 detected that female students have more ability for knowledge perception and reflection of their own ideas, and a higher competitive attitude. Additionally, this gender variation in PBL scores could be due to a higher commitment of female students in attending different educational activities. 29 However, Ajai and Imoko 30 observed equal performance of male and female students in PBL sessions, and Q36 recommended further studies to examine the underlining causes. Validity and reliability of assessment should be established to ensure students' achievement of the learning objectives. 14 The ability to solve any technical obstacle met during the online mock exam helped the e-assessment committee to manage the subsequent exams appropriately. 25 Results of the online assessments and their item analysis represented evidence-based high-quality evaluation. This perception was supported by Jawaid et al. 31 and Bandele et al. 32 who reported that students expressed a more positive attitude towards online exams. Similar findings were also observed by Martin et al. 33 who emphasised that ideal assessment was based upon optimal evaluation strategies. The online tests were revised by the e-assessment committee, in coordination with the supervisors of the relevant departments, to estimate sufficient time for each exam. Redistribution of students' grades towards more objective assessment strategies such as PBL, seminar presentations, and oral assessments was kept in consideration. This minimised the subjectivity of grading, as expressed in the feedback gained from the focus group, and discrepancy in students' grades, in agreement with Ozden et al. 34 . The procedures implemented during the online exams to minimise the chance of cheating and unauthorised collaboration with peers included scheduling of brief exams of not more than 30 min with a timer set for the whole exam and also for each individual Q37 question. Formulation of a considerable number of scenario-based questions was implemented focusing on higher-order critical thinking, following the Bloom's taxonomy. 35 Questions and answer choices were randomised; each question was presented on a separate page with forced completion of these questionsdstudents were not allowed to return to the previously-submitted questionsdin agreement with Fontanillas et al. 36 . A backup version of the questions with the same difficulty index was prepared for those students who experienced technical difficulties during submission. The answers were not displayed to the students until the examiner's permission was obtained and all participants had completed answering Q38 . The potential use of TEAL in medical educationdthe future learning eradis expected after the resolution of the COVID-19 pandemic. Analysis of the benefits of e-learning in the present study could help the decision-makers of educational policies and committees of curriculum reform to implement them in the future. Goh and Sandars 11 pointed out that the medical educators worldwide, being deeply involved in the current tremendous shift towards e-learning, have to adapt to the current major educational challenges. Appropriate e-learning resources should be available to guarantee the implementation of these enormous changes. More use of technological tools will enable the medical schools to establish the active process of e-learning. 37 The Horizon 2020 report focused on 'learning engineering' such as the virtual reality simulators to facilitate the rapid development of teaching and learning. Online courses form one of the key success factors to achieve the program learning outcomes of medical graduates. The current work explored the benefits of the shift towards e-learning and online assessment, which is a promising strategy with great educational potentials, after the WHO's declaration of the COVID-19 pandemic. This successful digital learning environment was observed in terms of student and staff satisfaction, achievement, and improvement of technological educational skills. The present study recommends a sustained monitoring and updating of the e-learning resources, particularly the official LMS, and availability of sufficient number of information technology personnel. Multiple webinars and workshops suggested increasing the student and staff awareness of online teaching and assessment via Q39 improving the current faculty development program. Furthermore, the adoption of teaching through complete and partially online courses, and a total shift from physical attendance for PBL sessions to online ones are encouraged in the future. All data are available from the corresponding author upon reasonable request. Researchers would like to thank the Deanship of Scientific Research, Qassim University for funding the publication of this project. The authors have no conflict of interest to declare. Ethical approval was taken from the ethical committee of Qassim University. Written informed consents were obtained from all the participants. WAA conceived and designed the study, conducted research, provided research materials, and collected and organised the data. AE and AES analysed and interpreted the data. All authors wrote the initial and final drafts of the article, and provided logistic support. All authors have critically reviewed and approved the final draft and are responsible for the content and similarity index of the manuscript. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 JTUMED653_proof ■ 22 October 2020 ■ 6/7 COVID-19 and medical education Online Learning during the COVID-19 Pandemic: what do we gain and what do we lose when classrooms go virtual? Internet-based learning in the health professions: a meta-analysis World Health Organization. Human resources for health and implementation of the outcomes of the United Nations' high-level commission on The role of e-learning in medical education The impact of E-learning in medical education Analysing undergraduate medical curricula: experience from a Saudi medical college Ethical priority setting for universal health coverage: challenges in deciding upon fair distribution of health services Assessing the role of online technologies in project-based learning The use of e-learning in medical education: a review of the current situation Meta-analysis of inquiry-based learning effects of guidance Classroom assessment in Web-based instructional environment: instructors' experience Students' perceptions of E-assessment at Saudi electronic university Using online digital tools and video to support international problem-based learning Developing technologyenhanced active learning for medical education: challenges, solutions, and future directions Evaluation of e-learning for medical education in low-and middle-income countries: a systematic review A vision of the use of technology in medical education after the COVID-19 pandemic COVID-19: how the virus is impacting medical schools Virtual patient design and its effect on clinical reasoning and student experience: a protocol for a randomized factorial multi-center study Learning or technology enhanced learning in medical educationdhope, not hype Problem-based learning in the digital age Formative and summative assessment of the problem based learning tutorial session using a criterion referenced system The effects of online and face-to-face problem based learning environments in mathematics education on student's academic achievement E-assessment process: giving a voice to online learners Gender-related differences in learning in student-led PBL tutorials The enactment of problem based approaches in pre-service mathematics and the levels of performance of teacher students in problem projects of teacher students in problem projects Female students get more marks as compared to male students: a statistical study Gender differences in mathematics achievement and retention scores: a case of problem-based learning method Computer based assessment (CBA): perception of residents at dow university of health sciences Opinions of undergraduates on the use of electronic examination in a Nigerian university Award-winning faculty online teaching practices: course design, assessment and evaluation, and facilitation Students' perceptions of online assessment: a case study Taxonomy of educational objectives E-assessment process: giving a voice to online learners Exploring the implementation of an electronic record into a maternity unit: a qualitative study using Normalisation Process Theory The authors would like to acknowledge the College of Medicine, Qassim University for the generous facilitation of the required learning resources.