key: cord-0873543-7d4cxgfn authors: Cherak, Stephana J; Brown, Allison; Kachra, Rahim; Makuk, Kira; Sudershan, Sanjana; Paget, Mike; Kassam, Aliya title: Exploring the impact of the COVID-19 pandemic on medical learner wellness: a needs assessment for the development of learner wellness interventions date: 2021-06-30 journal: Can Med Educ J DOI: 10.36834/cmej.70995 sha: 909be440b7dfdf5fa3fe899c68885084e0a47664 doc_id: 873543 cord_uid: 7d4cxgfn BACKGROUND: On March 11, 2020 the World Health Organization declared the novel coronavirus SARS-CoV-2 disease (COVID-19) a global pandemic. We sought to understand impact of COVID-19 on learner wellness at a large tertiary care academic institution to inform the future development of learner wellness interventions during the COVID-19 pandemic. METHODS: A cross-sectional, internet-based survey collected quantitative and qualitative data from learners April-June 2020. Descriptive statistics and univariate analyses were reported for quantitative data. Open-ended, qualitative responses were analyzed deductively using thematic analysis. RESULTS: Twenty percent of enrolled learners in that faculty of medicine (540/2741) participated including undergraduate [Bachelor’s] students (25.7%), graduate [science] students (27.5%), undergraduate medical students (22.8%), and postgraduate resident physicians (23.5%). We found that learner wellness across all stages of training was negatively impacted and the ways in which learners were impacted varied as a result of their program’s response to the COVID-19 pandemic. CONCLUSIONS: Learners in health sciences and medical education report worsening well-being because of the programs and the systems in which they function with the added burden of the COVID-19 pandemic. Future interventions would benefit from a holistic framework of learner wellness while engaging in systems thinking to understand how individuals, programs and respective systems intersect. The importance of acknowledging equity, diversity and inclusion, fostering psychological safety and engaging learners as active participants in their journey during a pandemic and beyond are key elements in developing wellness interventions. Learners in Canadian medical schools have significantly higher rates of psychological distress, mood disorders, and lifetime suicidal ideation compared to university students in non-medical programs. 1 Globally, medical learners experience significantly increased rates of burnout and psychiatric morbidity. [2] [3] [4] Educators and learners alike cite concerns about the effects of health sciences training and medical education on learner well-being, [5] [6] [7] as well as the lack of standards for how best to structure and optimize wellness initiatives for learners to thrive in their training. [8] [9] [10] [11] [12] [13] On March 11, 2020 the World Health Organization (WHO) declared the novel coronavirus SARS-CoV-2 disease (COVID-19) a global pandemic. 14 The impact of the COVID-19 pandemic on learners continues to evolve rapidly and impact learners in various ways. Without targeted interventions, consequences for learner wellness may become more prevalent and severe. 10, 15 To address this concern, we conducted a needs assessment to understand learner well-being in training environments disrupted by the COVID-19 pandemic. The aim of our study was to inform the development of learner wellness interventions at academic institutions such as medical schools in order to promote wellness and enhance wellbeing among the next generation of health care scientists and professionals during the COVID-19 pandemic. A cross-sectional survey was designed to collect data from all learners enrolled at the accredited Cumming School of Medicine, University of Calgary, in Calgary, Alberta, Canada (N = 2741). Participants were invited through e-mail correspondence from the Dean of Medicine, Assistant or Associate Deans, program administrators or directors, and student-led organizations. All learners were sent follow-up email invitations at weekly intervals for eight weeks. Four groups of learners at the Cumming School of Medicine participated in this study: undergraduate students (i.e., Bachelor of Health Sciences [BHSc] and Bachelor of Community Rehabilitation [BCR] students); graduate science students (i.e., MSc and PhD students); undergraduate medical students; and postgraduate resident physicians. Information on program requirements are available at the Cumming School of Medicine webpage. 16 Some participants were learners in multiple groups (e.g., students in the combined MD-PhD program). To prevent duplication and to gain as much comprehensive data as possible, these individuals were assigned to the learner group they were enrolled in at the start of the COVID-19 pandemic (on March 11, 2020) . Data were collected between April 07, 2020 and June 02, 2020. An online survey was developed based on recommendations from the International Association for Medical Education in order to develop synthetic frameworks to attempt to view medical learners holistically, focusing on real-world activities and performance. 17 Survey items were informed by the World Health Organization-Five (WHO-5) Well-Being Index, 18 the Wellness Innovation Scholarship for Health Professions Education and Health Sciences (WISHES) framework domains. 19 We also explored factors impactful (i.e., individual, program, systematic) to learners' training based on comprehensive scoping review of interventions for improved wellness of Canadian learners in medical schools (under peer-review). The assessment tools were chosen specifically to inform the development of future wellness interventions for medical learners that could be targeted to subjective learner well-being (i.e, informed from the WHO-5), validation for the wellness domains (i.e., informed from the WISHES wellness domains) 1 , and factors impactful to learners' education during the COVID-19 pandemic. See Supplemental Table 1 for descriptors of WISHES wellness domains and impactful factors. The survey consisted of discrete answer questions (including Likert-scale items) to collect quantitative data and open-ended responses to collect qualitative data. The survey was revised for brevity (i.e., conciseness and exact use of words) and clarity (i.e., to be coherent and intelligible), and based on feedback from pilot testing with three learners enrolled at the Cumming School of Medicine. Given the rapid transition to online learning at our institution and the need to distribute the online survey quickly in order to capture learner well-being status at the start of the pandemic, a full pilot study was not feasible. Responses from pilot testing were not included in final analyses. The final version of the survey contained 21 questions divided into three sections: 1) demographics; 2) factors impactful for learners to thrive or struggle in their training during the COVID-19 pandemic; and 3) assessment of learner well-being and wellness domains with regard to the COVID-19 pandemic. A summary of the measurement scales and validated observational assessments tools used in the survey are provided in Table 1 . All questions and possible responses for the online survey are available in Appendix A. This study received ethical approval from the University of Calgary Conjoint Health Research Ethics Board (REB20-0117). Participation in this study was voluntary, and informed consent was obtained from all participants prior to beginning the online survey. Learners did not receive any incentives or compensation for their participation. We used descriptive statistics to assess learner demographics and questions with discrete answer choices. Independent t tests were used to examine differences between dichotomized variables (e.g., visible ethnic minority, diagnosis of clinical disability). Total scores were calculated for the WHO-Five Well-Being Index and the WISHES domains as well as mean scores with confidence intervals (CI) for each group, 18 to allow for direct comparison between assessment tools and because scales measuring subjective wellness outcomes (e.g., healthrelated quality of life) are conventionally translated to a percentage scale. Table 1 provides information on the possible range and calculation method for how total scores were computed. To examine group differences (e.g., gender, learner program) we used an Analysis of Variance (ANOVA) with Bonferroni corrections to account for post-hoc analyses. Using Promax rotation, we performed an exploratory factor analysis on the wellness domains assessment tool to examine item loading as a way of assessing construct validity. Reliability analyses were performed for the WHO-Five and WISHES wellness domains by calculating a Cronbach's alpha. Quantitative data were analyzed using STATA IC 15 (StataCorp. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC). Two independent investigators analyzed open-ended responses in duplicate using a deductive thematic approach to qualitative analysis. 26 A deductive approach entailed the application of themes that we expected based on our existing knowledge of a multi-dimensional construct of well-being from a previous scoping review (under review). Furthermore, we applied the WISHES wellness domains, factors impactful (at the levels of individual, program and system) to establish validity evidence for the framework. We also coded the data with respect to the categories of content, format, process and outcome of learner concerns to inform the development of learner wellness interventions. Codes that did not fit within the existing framework and categories were constructed and all coding was reviewed on an ongoing basis to promote consistency between investigators, and peer debriefing was used to ensure adequate sampling and thematic representation. 27 Discrepancies were resolved by discussion and negotiated to establish a final coding scheme. Using an engaged scholarship approach; 28,29 two learners graduated from or currently representing each of the learner programs (S.C., A.B., R.H., K.M., M.P., S.S., A.K.) coded and analyzed full data independently using NVivo Qualitative Data Analysis Software Version 12 (QSR International). Dyads had an average interrater agreement of 80.4% (dyad-specific agreement provided in Supplemental Table 3 ) and discrepancies were resolved by in-depth discussion. Insightful excerpts and comments from respondents are provided to highlight potential program-specific targets for wellness interventions during the COVID-19 pandemic. To inform the development learner wellness interventions, results are separated according to learner program. A total of 540 learners completed the survey between April 07, 2020 (i.e., 27 days after the start of the pandemic) and June 02, 2020 (i.e., 83 days after the start of the pandemic), representing 19 deemed satisfactory given timing of survey distribution with regard to the "peak" of the pandemic in our geographic location 30 and the number of substantial alterations in learners' personal and professional lives at that time. Precaution should be exercised when interpreting the data given respondents provided data at a single point in time (i.e., completed the survey once). The majority of respondents were women (72.6%) and not a visible minority (i.e., Caucasian/white in color) (69.2%) ( Table 2 ). Nearly half of learners (48.5%) were diagnosed clinically with a condition relating to pain, flexibility, mobility, mental health, seeing, hearing, dexterity, learning or memory. Overall, learners most frequently (95.8%) reported individual (self) factors as impactful for them to thrive in their training, whereas, both individual (58.8%) and program factors (55.5%) were frequently reported as impactful to lead learners to struggle. In terms of validity evidence, reliability of the WHO-Five Well-Being Index and WISHES wellness domains assessment tools were 0.86 and 0.74, respectively, indicating a satisfactory level of internal consistency (Table 3 ). Our assessment of construct validity for the WHO-Five Well-Being Index and WISHES wellness domains was also satisfactory. The exploratory factor analysis using Promax rotation (i.e., construct validity) showed 1-factor solution accounting for 50% of variance with factor loadings greater than 0.6 for each of the five questions. Significant group differences in WHO-Five Well-Being Index Scores were detected between genders (p-value=0.01), learners with clinically diagnosed conditions (p-value<0.01) and training programs (p-value<0.01). Wellness domains negatively impacted by the COVID-19 pandemic differed only between groups based on gender (p-value=0.01). The distribution of responses for wellness domains negatively impacted is provided in Supplemental Table 2 . The qualitative results provided additional insight as themes between learner concerns (content, format, processes, outcomes) impactful factors (individual, program, system), and their subjective assessment of wellness domains during the pandemic. Themes from the seven open-ended responses are summarized in Supplemental Table 3 . Most learners appreciated the goodwill and timely efforts of their program and the academic institution but felt inadequately prepared to continue their program to meet national standards and training requirements. Despite a decline in May 2020 of new COVID-19 cases in Alberta, Canada (Figure 1 ), learners persist to report their wellbeing as below the 50th percentile, indicating that without targeted interventions poor learner well-being is unlikely to improve over time. A dominant theme was the lack of control over individual well-being which led them to struggle in their training during the COVID-19 pandemic. Recommendations for additional wellness support included mental support (for individuals), intellectual support (for programs), financial support (from the system). The results of this study explore the impact of the COVID-19 pandemic on learners at a single academic medical institution in Canada using a holistic framework for wellness. We found the ways in which learners were impacted varied as a result of their program's response to the COVID-19 pandemic. We found neutral well-being scores for learners overall, and as such, we must interpret these results with caution taking-into-account that our response rate was 20%. We did find significant differences in well-being scores with respect to program, gender identity and a clinical diagnosis. Learners who identified as women or non-binary had lower scores than men and those with a clinically diagnosed condition had lower well-being scores than those learners that did not. Further exploration of the impact of program, gender identity as well as the presence of a clinically diagnosed condition on learner well-being is needed. The themes identified across learner programs are consistent with what is known currently on learner wellbeing-medical schools are called to help their progressively diverse student cohorts to effectively enhance self-actualization and professional development both during training and as future health care professionals. 5, 12, 15, 31, 32, 33 From our needs assessment we uncovered three potential targets within two wellness domains for program-specific wellness interventions during the COVID-19 pandemic. These targets include: (1) the processes (e.g., learning methodologies, learning responsibilities) and (2) outcomes (e.g., educational deliverables, career trajectories) related to intellectual and occupational wellness domains respectively, as well as (3) the processes (e.g., informal check-ins, coffee chat hours) for maintaining social wellness. In designing new wellness interventions to respond to the COVID-19 pandemic and learner well-being in general, we suggest that six main recommendations that future wellness interventions consider. First, a holistic approach to wellness that acknowledges a "one-size fits all" approach may not work for all learners is important to consider given that each learner has their own lived experience. Second, individual, program and system factors must be accounted when designing wellness interventions. The onus cannot fall on individual learners often subjected to dysfunctional program and system factors that may influence well-being. For example, mindfulness meditation and yoga as individual level interventions can only go so far in maintaining learner wellness; program and system-level interventions also have a role in modelling and supporting learner wellness. Third, during the COVID-19 pandemic and beyond, consider maintaining social wellness among learners equally as important as teaching and training since learning can occur through social interaction. Fourth, ensure safe learning environments by fostering psychological safety so that learners can share their lived experiences, which can help normalize disclosure and help seeking. Fifth, consider equity diversity and inclusion principles such as intersectionality in relation to well-being. For example, gender identity, clinical diagnoses, financial status and other socio-demographic variables warrant further consideration. Last, engage learners as active participants in their learning process. As key stakeholders, learners may have innovative solutions that will inform each other as well as program and system level interventions thereby creating a community of practice. In order to address these needs among learners, new wellness interventions 34 will need to be developed while acknowledging the program and systems in which the learner functions (higher education, healthcare or an intersection of both). The quantitative and qualitative data converged showing many learners are experiencing hardships in several wellness domains. Thus, given that most existing opportunities are optional 35 and do not acknowledge a holistic framework for learner wellness, 36 it is unlikely simply changing existing wellness initiatives to be mandatory would be sufficient to meet the increased wellness demands from learners due to the COVID-19 pandemic. 37 The COVID-19 pandemic continues to evolve rapidly and continues to impact learners in various ways. Our data was collected from each learner at a single point in time at the start of the first wave of the pandemic. Sequential phases of surveillance to determine the wellness trajectories among learners may require targeted interventions at different time points. 38 What works at one stage of medical education may not be helpful at the next stage of training. 38 For learners, the impact of the COVID-19 pandemic on medical education is not to be challenged with a gallant sprint; adversities on learners will continue to persist long after the current pandemic is no longer the prime concern. 19 Finally, an additional challenge to note is regarding the feasibility and acceptability of online wellness interventions. Based on our data we posit that online wellness interventions might be more successful if interventions include a socially-distanced in-person component, in addition to components aimed to enhance intellectual and occupational wellness. Still, many questions remain unanswered and much work is required to fully understand the utility and long-term impact of online wellness interventions, especially in most at-risk learners. Questions for future inquiry include identifying the synchronicity of online wellness interventions, determining best modalities to promote online wellness and most effective methodologies to implement online interventions. We suggest that developing an operational definition for wellness associated with a core outcomes set of well-being measures related to specific learner programs might help to develop and implement future programspecific, online interventions. The experiences and lessons learned from the COVID-19 pandemic can serve as a foundation to design wellness interventions for medical learners during a pandemic and beyond. Nonetheless, there are numerous limitations to consider surrounding the applicability and generalizability of the conclusions drawn from this research. External validation of the WISHES wellness domains in other learner cohorts would contribute validity evidence to the WISHES framework and assessment tool. However, well-being among learners is universal to all medical schools 10 and the responses gathered herein may be relevant to learners in other contexts. Due to the timing of the "peak" of the first wave of the pandemic in our geographic location and the number of substantial alterations in learners' personal and professional lives at that time, our low response rate indicates that input may be missing from an important cohort of learners-learners most impacted with poorest well-being. Another limitation is regarding the use of an internet-based survey, as limitations with this format can result in misinterpretation and missed perspectives, failing to capture critical information. We did not assess academic performance and achievement prior to the COVID-19 pandemic, which may have confounded student status. Finally, through impacts on wellness may differ according to learner disabilities and commitments outside of school (e.g., parents, caregivers), our study was not powered to examine differences between visible and non-visible minorities and perspectives from visible minorities were under-represented generally. This may be relevant as differences in cultural values such as family responsibilities and social support networks may influence learners' wellbeing. Learners in health sciences and medical education report worsening well-being because of the programs and the systems in which they function with the added burden of the COVID-19 pandemic. Future interventions would benefit from a holistic framework of learner wellness while engaging in systems thinking to understand how individuals, programs and respective systems intersect. The importance of acknowledging equity, diversity and inclusion, fostering psychological safety and engaging learners as active participants in their journey during a pandemic and beyond are key elements in developing wellness interventions. This consent form is only part of the process of informed consent. It should give you the basic idea of what the research is about and what your participation will involve. If you would like more detail about something mentioned here, or information not included here, please ask. Take the time to read this carefully and to understand any accompanying information. You were identified as a possible participant in this study because you are a learner currently enrolled in the University of Calgary's Cumming School of Medicine as an undergraduate student, medical student, graduate student or resident physician. Your participation in this research study is voluntary. Wellness programs need to be effective, evidenced-based yet personalized and tailored to meet individual needs and circumstances. In response to the "epidemic of burnout in medicine" a number of wellness initiatives are growing at our institution and the gaze of our leadership is shifting towards early prevention and intervention through engagement, advocacy and scholarship. The Wellness Innovation Scholarship for Health Professions Education Scholarship (WISHES) is designed to be an education laboratory focused on the wellness scholarship of learners across Cumming School of Medicine from the pre-medical school health sciences bachelors program, graduate science programs in medicine, undergraduate medical education and postgraduate medical education. The WISHES framework is a holistic framework which focusses on areas of wellness such as mental, physical, occupational, social and intellectual domains stratified by the levels of individual learners, the training programs and the intersection of the higher education system with the health care system. The current coronavirus (COVID-19) pandemic has impacted learners at the Cumming School of Medicine. Learners are being impacted by the pandemic with regard to their personal well-being. We wish to explore this impact using a multi-faceted approach to wellness in learners, recognizing: 1) wellness can be impacted in different domains specifically mental health, physical health social health, occupational health and intellectual health and 2) that wellness initiatives can occur at the individual (learner), program (postgraduate medical education and resident program) and system (higher education system and health care systems) levels. Specifically, we aim to investigate the following two objectives: 1. To determine the extent and nature of learner wellness initiatives to facilitate wellness in domains of mental health, physical health, occupational health, social health and intellectual health at the individual, program and system levels during the COVID-19 pandemic. 2. To explore how learners, describe their own wellness with respect to five domains of wellness at the individual, program and system levels during the COVID-19 pandemic. We are aiming to recruit at least 50% of learners from each of the groups at the Cumming School of Medicine which may include up to 1,450 participants across all of the programs. This study is comprised of two parts. This is the survey part of the study. If you would like to participate in an interview, you may include your contact information in the survey if you wish. Your participation in both parts of this study is completely voluntary. Data will be collected over the next 4-6 weeks. All data will be analyzed in aggregate. We will retain the data for 5 years. We do not anticipate any kind of physical, psychological, or social risks associated with this study. The questions are not sensitive of nature. If at any point, you do not want to answer a question, you may skip the question or withdraw from the study by closing the survey window. The proposed research responds to a critical need to enhance learner wellness at our institution during the COVID-19 pandemic. Our study aims to have a large impact to the medical education programs at the University of Calgary. Through the context of the COVID-19 pandemic, the findings gathered from your interview will help us to better understand various mental, physical, social, occupational and intellectual processes that allow learners to thrive and promote wellness during impactful disruptions to medical education. Gathering insights into the challenges and successes of these wellness initiatives will allow for end-of-study knowledge translation that include dissemination to the Cumming School of Medicine, conference and workshop presentations, and journal publications. You are free to choose not to participate in the study. If you decide not to take part in this study, there will be no penalty to you. Your decision will not affect your education or employment. Yes. You can decide to stop at any time by not completing the survey or closing the survey window. Please be assured that any study data obtained from the survey is anonymized and will be analyzed in aggregate. You will not be paid for your participation in this research study. Qualtrics is an online survey platform with servers in the University of Calgary. All data are encrypted and stored directly on its servers at the University of Calgary. Researcher access to the survey data is password-protected and the transmission is encrypted. Survey responses cannot be linked to your computer. All survey responses will be anonymized. The researchers intend to keep the research data and records for approximately 5 years. After which time, all data will be destroyed. Any future use of this research data is required to undergo review by a Research Ethics Board. The researchers for this study have no conflicts of interest to declare. We will also be conducting interviews as part of this research. If you would like to be contacted to participate in an interview, please add your contact information in the space provided after completing the survey. Study results will be made publicly available through scholarly publications and a Cumming School of Medicine report. Taking part in this study is completely voluntary. You can choose whether or not you want to participate. Whatever decision you make, there will be no penalty to you. ▢ I identify as a woman (1) ▢ I identify as a man (2) ▢ I identify as non-binary (3) ▢ I prefer to self describe, please specify below: (4) ________________________________________________ ▢ I prefer to not answer this question (5) Q5 Do you identify as a visible minority (non-Caucasian in race or non-white in colour)? ▢ System factors (i.e., higher education system or health care system factors, such as University of Calgary or Alberta Health Services) (3) ▢ Other factors, please specify below: (4) ________________________________________________ Q15 Please indicate for each of the five statements which is closest to how you have been feeling over the past two weeks. Over the past two weeks... More than half of the time (3) Less than half of the time (4) Some of the time (5) At no time (6) . ________________________________________________________________ Q19 Please describe any wellness tools or strategies that you find helpful in coping with the COVID-19 pandemic (these can be personal or delivered by the Cumming School of Medicine). ________________________________________________________________ Q20 What additional wellness supports would you like to see offered to you as a learner during the COVID-19 pandemic? ________________________________________________________________ Q21 Is there anything you would like to add about wellness initiatives for learners during the COVID-19 pandemic? ________________________________________________________________ End of Block: Block 3 Medical student psychological distress and mental illness relative to the general population: a Canadian crosssectional survey Burnout in medical students before residency: a systematic review and meta-analysis Prevalence of depression amongst medical students: a meta-analysis The global prevalence of anxiety among medical students: a meta-analysis Medical student wellbeinga consensus statement from Australia and New Zealand To the point: a prescription for well-being in medical education The clinical learning environment Resident wellness matters: optimizing resident education and wellness through the learning environment Well-being in graduate medical education: a call for action Finding the why, changing the how: improving the mental health of medical students, residents, and physicians Physician burnout, well-being, and work unit safety grades in relationship to reported medical errors Physician health charter calls on health systems, organizations to share responsibility for burnout Medical education needs reform to improve student well-being and reduce burnout, say experts WHO Timeline -COVID-19: World Health Organization Medical student mental health 3.0: improving student wellness through curricular changes Cumming School of Medicine; Future Students Frameworks for learner assessment in medicine: AMEE Guide No. 78 The WHO-5 Well-Being Index: a systematic review of the literature acknowledging a holistic framework for learner wellness: the human capabilities approach Medical student mental health 3.0: improving student wellness through curricular changes The WHO-5 Well-Being Index: a systematic review of the literature Depression with atypical features in a sample of primary care outpatients: prevalence, specific characteristics and consequences Screening for depression in primary care: will one or two items suffice? Eur Arch Psychiatry Clin Neurosci Use of brief depression screening tools in primary care: consideration of heterogeneity in performance in different patient groups The Assessment and Measurement of Wellness in the Clinical Medical Setting: A Systematic Review Attempting rigour and replicability in thematic analysis of qualitative research data; a case study of codebook development To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qualitative Research in Sport, Exercise and Health Conceptualizing 20 years of engaged scholarship: a scoping review Integrated knowledge translation (IKT) in health care: a scoping review COVID-19 Alberta Statistics. Interactive aggregate data on COVID-19 cases in Alberta 2020 Available from Evidence-based interventions for medical student, trainee and practicing physician wellbeing association between learning environment interventions and medical student well-being: a systematic review Ethical use of student profiles to predict and prevent development of depression symptoms during medical school Interventions to prevent and reduce burnout among undergraduate and graduate medical education trainees: a systematic review Becoming a member of the team Wellbeing and mental health amongst medical students in Canada Rethinking the role of senior medical students in the COVID-19 response Understanding medical education: evidence, theory, and practice