key: cord-0871829-a439fjzs
authors: Elledge, Ross; Williams, Rhodri; Fowell, Christopher; Green, Jason
title: Maxillofacial education in the time of COVID-19: the West Midlands experience
date: 2020-07-30
journal: Br J Oral Maxillofac Surg
DOI: 10.1016/j.bjoms.2020.07.030
sha: a69c8328b424ad32898cf04f409cc8d836e5c6a5
doc_id: 871829
cord_uid: a439fjzs

COVID-19 has accelerated a reliance on virtual technology for the delivery of postgraduate surgical education. We sought to develop a regional teaching programme with robust quality assurance. Webinars were delivered on a weekly basis by subspecialty experts using Zoom™ augmented with interactive polling software. Trainee feedback comprised Likert item rating on content and delivery, free text comments and self-assessed confidence levels using visual analogue scale (VAS) scores. A focus group was also convened and transcripts assessed with grounded theory analysis. Likert items revealed 442 (93.2%) positive responses regarding content and 642 (96.7%) positive responses regarding trainer delivery. There were statistically significant improvements in VAS scores across all programme content. Key themes from the focus group analysis were the pragmatics of delivering online education, issues surrounding trainer interactivity in the virtual world, the identification of the FRCS as a driving factor and a desire for case-based content and pre-learning of information (the “flipped classroom”). We are continuing to be reactive to trainee feedback in developing our online learning programme which will also include a regional Moodle-based virtual learning environment (VLE), the subject of future educational research in our region.

Technology-enhanced learning (TEL) has seen an increasing variety of formats in recent years, including virtual learning environments as either standalone interventions or as part of a "blended learning" approach 1 . In the wake of the COVID-19 pandemic and associated rules surrounding social distancing to reduce the spread of Severe Acute Respiratory Syndrome coronavirus-2 (SARS-CoV-2), virtual education in postgraduate surgical training has seen something of an accelerated uptake [2] [3] [4] [5] [6] .

Whilst work has been done on virtual clinics following on from national guidance from the British Association of Oral and Maxillofacial Surgeons (BAOMS), there is a clear need to ensure trainees are not forgotten at a time when the quality of surgical training is under threat [7] [8] [9] . We sought to therefore implement a robust online learning programme with inbuilt quality assurance from trainer and trainee feedback.

From the inception of the COVID-19 pandemic we put into place a weekly Zoom™ webinar with a nominated Consultant "screen sharing" a presentation. Webinars often involved an additional "moderator" fielding questions from the "chat" function. This was further augmented with interactive polling software such as Kahoot! and Socrative by MasteryConnect.

Trainees were asked to give feedback using a SurveyMonkey® questionnaire which examined perceptions of content and trainers on 5-point Likert items. Free text comments were available to express areas of particularly good practice and suggestions for improvements. Trainees were also asked to self-assess confidence levels using a visual analogue scale (VAS) from 0 to 100.

Trainers were also asked to give formal feedback of their individual sessions.

In addition, trainees were asked to volunteer and representatives taken from each training unit to join a focus group using Zoom™. The focus group was facilitated by one of the authors (CF) in his capacity as an "external" member (being a current Training Programme Director in another region) and used a semi-structured interview technique.

Analysis of the data included examining the proportion of respondents agreeing with positive statements on the Likert items along with Wilcoxon signed rank test of VAS scores. The transcript from the focus group meeting was analysed by two of the authors (RE and JG) using grounded theory analysis incorporating three levels of coding (open, axial and selective) [10] [11] [12] [13] .

Feedback surveys from seven Zoom™ webinar teaching sessions between 13 th May 2020 and 24 th June 2020 were analyzed, with a total of 95 individual responses. Lecture subjects and trainee attendance is shown in Table 1 . Table 2 demonstrates aggregate scores of Likert items with regards to content of the Zoom™ webinars. Responses were overwhelmingly positive with 442 (93.2%) responses agreeing with positive statements concerning content. Trainees particularly liked features such as polling software or quizzes and "pre-loading" with information to prepare prior to the Zoom™ webinar.

A common theme was the propensity to enjoy case-based discussions and "exam-style grilling", J o u r n a l P r e -p r o o f with many trainees basing their perception of the value of the teaching on how well it might prepare them for the exit Fellowship examination. Trainees also liked it when two consultants delivered teaching, with one manning a "chat" function and answering questions in tandem with the delivery of lecture-based content.

With regards to suggestions for improvements, trainees stressed the need to keep to the allotted time, a desire for recommended reading and clear references (where not provided), and a desire to be put "on the spot", again driven by a clear wish for exam-style practice.

Combined scores of Likert items with regards to trainer performance is given in Table 3 and again, perception was positive, with 642 (96.7%) of responses agreeing with positive statements. Self-assessment of confidence levels on the VAS scales by respondents are shown by individual Zoom™ webinar in Table 4 , with a statistically significant improvement seen across the entire teaching programme.

Trainers felt that positive features included finding trainees had read up beforehand and that there was good interaction. Many found that add-ons such as Kahoot! helped with this interactivity and that the technology was dependable. Negative aspects included difficulty in gauging enjoyment using an online platform, as screen sharing may preclude seeing the faces of all attendees. One trainer described "feeling like one is on 'transmit'" and it was noted that some trainees kept their video cameras turned off which was "disconcerting".

A comprehensive review of the three levels of coding derived from the focus group is demonstrated in Table 5 . A number of themes were identified.

The virtual teaching was well received which agreed with written feedback obtained from sessions. It was delivered at an appropriate pace and regularity and comments were made regarding the ease of access to teaching; 'Saves travelling… (Trainee #1) 'Easier than having an all day out….' (Trainee #2)

One concern was regarding a lack of interaction with peers -this was seen in a negative light by some;

'The most useful thing was meeting all the trainees and chatting, networking…' (Trainee #2) 'It is quite nice to see your colleagues and share the good, the bad and the ugly and know where you are standing…' (Trainee #1)

Interestingly the trainees had issues with interactivity with trainers, which mirrored those found by trainers in the written feedback. Some trainees preferred not to be watched and had video turned off. Several reasons were given for this including lack of access to cameras and personal preference. It was acknowledged that visual cues are an important facet in teaching.

However, there were negative comments about facial expressions seen in some sessions;

' …a couple of consultants that responded with disparaging faces' (Trainee #3) ' …I don't think they know that they are making that face towards that The introduction of a virtual learning programme in our region has been well received, with consistently high ratings for content and teaching, as well as improvements in self-assessed knowledge levels. Trainees clearly liked the ease of access of the online webinars, regularity, concise format and interactive case based webinars. There was a pronounced focus on acquiring the knowledge to pass the Fellowship examination, echoing worrying trends identified by others in surgical training 19 . Encouragingly, pre-learning in preparation for an interactive teaching J o u r n a l P r e -p r o o f session of problem solving was actively sought, echoing successes previously with "flipped classrooms" in our region 20 .

Grounded theory is inductive and constructionist, acknowledging that conditions give rise to discursive practices and analysis with pre-conceptions fails to allow the data to speak for itself 11, 21 . Perceived limitations of the virtual learning strategy were the loss of collegiality and networking. Difficult interactions with trainers in an "artificial" encounter where communication may be strained, along with technical glitches and the inability to cover all topics were all points that need to be taken into account in planning the future. In higher surgical training, the transfer of theoretical knowledge in webinars can only represent part of an educational programme running in parallel with clinical work, with a clear need for this to be supplemented with more "hands-on" teaching, such as simulation training and dissection.

Response bias may be felt to be an issue, with such a small number of easily identifiable trainees potentially feeling "pressured" into responding positively to surveys and focus groups. We sought to mitigate this by the use of a independent facilitator from outside the region and ensuring that surveys and focus groups transcripts were anonymised. Self-assessed VAS scores are useful but previous work has highlighted the poor correlation of these with clinical performance, with potential over-estimation of clinical competence and increased risk-taking attitudes 22, 23 .

Future plans within the region will include continuing regular Zoom™ webinars in the post-COVID-19 era, combined with face-to-face study days aimed at more practical teaching events (e.g. cadaveric dissection courses). This will be augmented by a HEWM Moodle VLE (https://pgvle.co.uk/login/index.php), likely to be the subject of future educational research by our group. Above all, in shaping the future of our higher training in our region, we are mindful of being responsive to our trainees, for as de Cossart and Fish stress, "a curriculum has to be J o u r n a l P r e -p r o o f built carefully from proper foundations......the nature of professional practice and the knowledge underpinning it are content specific and individual to a culture and its values 19 ."

None declared.

Not required. Participation of trainees in the focus group was entirely voluntary and all participants were informed of the intention to publish the findings and disseminate to a wider audience on a national/international platform. As such ethics approval was not required or sought. J o u r n a l P r e -p r o o f

Current thinking in medical education research: an overview

Orthopaedic education during the COVID-19 pandemic

Medical and surgical education challenges and innovations in the COVID-19 era: a systematic review

We asked the experts: virtual learning in surgical education during the COVID-19 pandemic: shaping the future of surgical education and training

The impact of COVID-19 on plastic surgery residency training

Accelerating education during COVID-19 through virtual learning

Considerations for oral and maxillofacial surgeons in COVID-19 era: can we sustain the solutions to keep our patients and healthcare personnel safe?

Provision of emergency maxillofacial service during the COVID-19 pandemic: a collaborative five centre UK study

Updated COVID Advice from BAOMS and ENT UK for our surgical teams

The Discovery of Grounded Theory: Strategies for Qualitative Research

Discovering' chronic illness: using grounded theory

Grounded theory in medical education research

Capturing the teachable moment: a grounded theory study of verbal teaching interactions in the operating room

Maxfax bites

Early effects of COVID-19 on maxillofacial surgery residency training: results from a national survey

COVID-19 and educational engagement

Resident education in the time of a global pandemic: development of the collaborative OMS virtual interinstitutional didactic (COVID) program

Cultivating a thinking surgeon: new perspectives on clinical teaching, learning and assessment

Flipped classrooms" in training in maxillofacial surgery: preparation before the traditional didactic lecture?

The Birth of the Clinic

We would like to thank the lecturers who in addition to the authors of this work included KevinMcMillan, Stephen Dover, Khaleeq Ur-Rehman and Richard Burnham. Finally, we would like to acknowledge the enthusiasm of all our trainees for engaging with the virtual learning programme and providing valuable feedback that is the subject of this paper.J o u r n a l P r e -p r o o f