key: cord-0894269-pr1fd8mj authors: Denning, Max; Goh, Ee Teng; Tan, Benjamin; Kanneganti, Abhiram; Almonte, Melanie; Scott, Alasdair; Martin, Guy; Clarke, Jonathan; Sounderajah, Viknesh; Markar, Sheraz; Przybylowicz, Jan; Chan, Yiong Huak; Sia, Ching-Hui; Chua, Ying Xian; Sim, Kang; Lim, Lucas; Tan, Lifeng; Tan, Melanie; Sharma, Vijay; Ooi, Shirley; Winter Beatty, Jasmine; Flott, Kelsey; Mason, Sam; Chidambaram, Swathikan; Yalamanchili, Seema; Zbikowska, Gabriela; Fedorowski, Jaroslaw; Dykowska, Grazyna; Wells, Mary; Purkayastha, Sanjay; Kinross, James title: Determinants of burnout and other aspects of psychological well-being in healthcare workers during the Covid-19 pandemic: A multinational cross-sectional study date: 2021-04-16 journal: PLoS One DOI: 10.1371/journal.pone.0238666 sha: 134d0eb5d07b1e3fe524fabacc31d4b0034d1640 doc_id: 894269 cord_uid: pr1fd8mj The Covid-19 pandemic has placed unprecedented pressure on healthcare systems and workers around the world. Such pressures may impact on working conditions, psychological wellbeing and perception of safety. In spite of this, no study has assessed the relationship between safety attitudes and psychological outcomes. Moreover, only limited studies have examined the relationship between personal characteristics and psychological outcomes during Covid-19. From 22nd March 2020 to 18th June 2020, healthcare workers from the United Kingdom, Poland, and Singapore were invited to participate using a self-administered questionnaire comprising the Safety Attitudes Questionnaire (SAQ), Oldenburg Burnout Inventory (OLBI) and Hospital Anxiety and Depression Scale (HADS) to evaluate safety culture, burnout and anxiety/depression. Multivariate logistic regression was used to determine predictors of burnout, anxiety and depression. Of 3,537 healthcare workers who participated in the study, 2,364 (67%) screened positive for burnout, 701 (20%) for anxiety, and 389 (11%) for depression. Significant predictors of burnout included patient-facing roles: doctor (OR 2.10; 95% CI 1.49–2.95), nurse (OR 1.38; 95% CI 1.04–1.84), and ‘other clinical’ (OR 2.02; 95% CI 1.45–2.82); being redeployed (OR 1.27; 95% CI 1.02–1.58), bottom quartile SAQ score (OR 2.43; 95% CI 1.98–2.99), anxiety (OR 4.87; 95% CI 3.92–6.06) and depression (OR 4.06; 95% CI 3.04–5.42). Significant factors inversely correlated with burnout included being tested for SARS-CoV-2 (OR 0.64; 95% CI 0.51–0.82) and top quartile SAQ score (OR 0.30; 95% CI 0.22–0.40). Significant factors associated with anxiety and depression, included burnout, gender, safety attitudes and job role. Our findings demonstrate a significant burden of burnout, anxiety, and depression amongst healthcare workers. A strong association was seen between SARS-CoV-2 testing, safety attitudes, gender, job role, redeployment and psychological state. These findings highlight the importance of targeted support services for at risk groups and proactive SARS-CoV-2 testing of healthcare workers. a1111111111 a1111111111 a1111111111 a1111111111 a1111111111 The Covid-19 pandemic has led to an unprecedented strain on healthcare services globally. Considerable changes in healthcare delivery have necessarily taken place. These have included cessation of routine services, repurposing of clinical areas, redeployment of staff to unfamiliar clinical environments [1, 2] , and in some circumstances, the rationing of services [3] . The impact of these modified working conditions on safety culture and psychological well-being are poorly understood. Traumatic events or adverse conditions during natural disasters, conflict, and pandemics may lead to burnout [4] [5] [6] . Burnout is defined as "a syndrome of exhaustion, depersonalization, and reduced professional efficacy" [7] and leads to poorer patient safety outcomes [8] [9] [10] . Burnout is composed of two elements: "exhaustion", linked to excessive job demands; and "disengagement", linked to insufficient job resources [11] . During the Covid-19 pandemic healthcare systems have faced rising demands and limited resources, as such, it is important to understand the corresponding rates of burnout. Similarly, infectious disease outbreaks have well-documented effects on the psychological wellbeing of healthcare workers (HCWs). During the Severe Acute Respiratory Syndrome (SARS), H1N1 and Ebola outbreaks, studies showed that frontline HCWs were at higher risk of developing psychological sequelae, including chronic stress, anxiety, depression and posttraumatic stress disorder [12] [13] [14] [15] [16] [17] . Various factors are understood to have contributed to this phenomenon, such as excessive workload, concerns about occupational exposure, or infection of HCWs' families. In comparison to previous pandemics, the psychological impact of Covid-19 may be more significant and widespread, given the scale of the pandemic [18] [19] [20] . Singapore by the National Healthcare Group Domain Specific Research Board (NHS DSRB) Ref 2020-00598. Countries selected for inclusion represented a range of Covid-19 mortality rates, health system design, economic development, and had regional coordinators that could adapt the questionnaire to the local context and champion distribution. See Table 1 for comparison of country settings. UK. The UK has 66 million residents [21] . Healthcare is publicly funded through general taxation and provided free at point of delivery by the National Health Service. The gross domestic product (GDP) is $42,962 per capita [22] , of which 9.6% ($3,859) is spent on healthcare [23] . The UK has 2.8 physicians and 8.2 nurses and midwifes per 1,000 people [24, 25] . The first documented case of Covid-19 was on 29th January 2020 and a national lockdown was initiated on 23rd March 2020 that introduced workplace, public space and school closures. In order to increase clinical capacity measures were taken including the cessation of elective services, redeployment of staff, reconfiguration of hospitals and establishment of a series of temporary 'Nightingale' hospitals. As of 11 July 2020 the UK has had 288,133 Covid-19 infections and 44,650 related deaths [26]. The survey consisted of four parts; demographic questions followed by 3 validated psychometric instruments; the Safety Attitudes Questionnaire, Oldenburg Burnout Inventory and Hospital Anxiety and Depression Scale. Local collaborators in each country adapted the demographic questions to be culturally appropriate and contextually relevant. Demographic data included gender, ethnicity, professional role, workload, and Covid-19 status (see S1 File). Oldenburg Burnout Inventory (OLBI). The OLBI is a 16-item validated tool for the investigation of burnout [31, 32] . Items consist of both positively and negatively worded questions related to exhaustion and disengagement that are recorded on a four-point Likert scale. For the purpose of descriptive analyses, we considered participants to be at 'high risk of burnout' if they met the cut-offs of 2.1 and 2.25 for the exhaustion and disengagement subscales, respectively, as used in previous studies [33] [34] [35] [36] . To increase specificity in the regression analyses, a higher cut-off of the 75th percentile of OLBI scores was used. Hospital Anxiety and Depression Scale (HADS). The HADS was developed in 1983 [37] and has since been widely used for assessing depression and anxiety [38] . It is self-reported, concise, and uses separate subscales for anxiety and depression, each consisting of seven items rated on a four-point Likert scale. It has been validated in several countries and adapted for use in different languages and settings [39] [40] [41] [42] . A score of 7 or less is considered normal, 8-11 as borderline and greater than 11 is diagnostic of anxiety or depression. The HADS was used in studies evaluating the psychiatric morbidity amongst SARS survivors [43, 44] . Safety Attitudes Questionnaire (SAQ). The Safety Attitudes Questionnaire (SAQ) measures staff perceptions of safety. It has been validated in several countries, languages [45] [46] [47] [48] [49] and healthcare settings, including critical care and inpatient wards [50] . Thirty-five statements were included, each followed by a 5-point Likert scale from "strongly disagree" to "strongly agree". SAQ scores represent the proportion of respondents that "agree" or "strongly agree" with positive statements relating to each subscale, vice versa for negatively-worded questions [50] (S1 File). Scores are expressed across six domains: safety climate, teamwork, stress recognition, perception of management, working conditions, and job satisfaction. On all scales, a higher percentage score represents a more positive perception. Taken together, the scores provide insight into healthcare workers' perceptions of operational conditions in their workplace. Demographic questions were translated by a native speaker (JP) and the translation validated through back translation by an independent native Polish speaker (GZ) (S1 File). This cross-sectional study was conducted between 27th March and 16th June 2020. The questionnaire was administered using Google Forms (Google LLC, USA) in Europe, and FormSG (GovTech, Singapore) in Singapore. Invitations to participate were distributed using targeted email communications with weekly reminders, and advertisement on social media platforms (Twitter and Whatsapp). Written, informed consent was obtained from all participants. The study dataset was anonymized and uploaded (S2 File). Allowing for up to 10 covariates in the multivariate model and a sensitivity of 0.05, a sample size of 2,000 participants was required. Data were analysed using Stata v14 (StataCorp. 2015. Stata Statistical Software: Release 14. College Station. TX: StataCorp LP). Reliability of each psychometric instrument (SAQ, OLBI, HADS) were assessed using Cronbach's alpha. A complete case analysis approach was used. For each questionnaire, the values of each question were correlated with the individual's total score. Alpha scores >0.70 were deemed as acceptable reliability. Statistical significance was set at 2-sided p < 0.05 using the Wald test The primary outcome measure was burnout, secondary outcome measures were anxiety and depression. Explanatory variables for burnout included SAQ scores, demographic questions, and HADS outcomes. Explanatory variables were assessed against the 75 th percentile of OLBI scores using logistic regression. Variables found to be significant on univariate analysis were included in the multivariate analysis as well as forced variables that were deemed important to control for (country, role, and redeployment status). The "svy" command was used in the STATA setup for logistic regression. A total of 3,537 responses were received ( Table 2 ). Amongst these, 2,544 (72%) of respondents were female and 923 male (26.1%). 684 (19.3%) responses were from doctors, 1,590 (45%) from nurses, 517 (14.6%) from other clinical staff (including healthcare support workers, allied health professionals, pharmacists etc), and 746 (21.1%) non-clinical staff. 765 responses were from the UK, 232 from Poland, 2,503 from Singapore, and 37 from other countries, which were excluded due to the low response rate for the purpose of analysis to minimise a response bias. During the pandemic, 766 (21.7%) clinical staff were redeployed as part of response measures and 777 (22%) respondents had received at least one test for SARS-CoV-2 infection. The questionnaires had strong reliability as evident by their high α coefficients (HADS α = 0.90, OLBI α = 0.88, SAQ α = 0.94). In our study, 2,364 (67%, 95% CI 65%-68%) of respondents were identified as being at high risk of burnout, whilst 701 (20%, 95% CI 18%-21%) and 389 (11%, 95% CI 9%-12%) met the criteria for anxiety and depression, respectively. A number of respondents met criteria for more than one condition (Fig 1) . Significant predictors of anxiety (Table 4 ) included: female gender (OR 1.47, 95% CI 1.13-1.91), undisclosed gender (OR 2.12; 95% CI 1.10-4.08), SAQ scores lower than the 25th In our study, 2,364 (67%) respondents were at high risk of burnout. Prior to the onset of Covid-19 studies reported rates of burnout in the UK of 31.5% [51] and 42% [52] for doctors and nurses, respectively. In Singapore figures were similar with 33% [53] and 51% [54] of nurses and doctors exhibiting symptoms of burnout, respectively. The higher rates observed in this study suggest that the Covid-19 pandemic, or changes as a result of the pandemic may have led to an increased rate of burnout amongst staff. Our results demonstrate that clinical roles confer a higher burnout risk compared with non-clinical roles. This may be explained by the nature of these roles. Particular challenges might have included adapting to a new method of working, increased service demands, prolonged periods wearing personal protective equipment, feeling "powerless" to manage patients' conditions, and a fear of becoming infected or infecting others [55] . Similar findings were seen in Toronto during the SARS epidemic, where HCWs that treated SARS patients had significantly higher levels of burnout than those that did not [6] . Staff who were redeployed to new clinical areas had a higher risk of burnout. This may be due to physical conditions such as spending prolonged periods wearing protective equipment or due to the stress of adapting to a new clinical environment. Moreover, areas that required redeployed staff, by definition, had (or anticipated having) demand in excess of resources, necessitating the reallocation of staff. The combination of these increased demands, limited resources, and the psychological stress of dealing with an unfamiliar disease in an unfamiliar environment may have led to increased rates of burnout. This hypothesis would be supported by by the demands-resources model of burnout [7, 11] . Anxiety and depression were noted in 20% and 11% of respondents respectively. Respondents with anxiety or depression were likely to also have symptoms of burnout. This is a significant burden of psychological morbidity. This finding is consistent with a recent meta-analysis of studies in China and Singapore, which demonstrated that approximately 1 in 5 HCWs have experienced symptoms of anxiety (23.2%) or depression (22.8%) during Covid-19 [18]. Similarly, rates of depression (19.8%) were also seen in Italian HCWs, although with a lower prevalence of anxiety(8%) [19] . Our study found that anxiety was more prevalent than depression amongst HCWs. To our best knowledge, there has been no published work reporting rates of depression, anxiety or burnout in the UK or Poland during Covid-19. Female gender was predictive of anxiety (OR 1.47), which is in keeping with previous findings during Covid-19 [56, 57] . However female gender was also found to be inversely correlated with depression, which contrasts from previous research [56, 57] . These findings may reflect differences in the sampled population, such as the proportion of redeployed staff or be related to the timing of sampling compared with the onset of the Covid-19 pandemic. Burnout, anxiety and depression have a negative impact on staff and patient outcomes [9, 58] as well as leading to workforce attrition [59] . The high rates seen during the Covid-19 pandemic risk compounding a pre-existing healthcare workforce crisis [60, 61] , which may inturn impact on patient outcomes during the recovery phase of the pandemic. Initiatives shown to have a positive effect on psychological wellbeing include: clear communication, access to personal protective equipment, adequate rest, and psychological support [57, 62] . An unexpected finding was the inverse relationship between staff SARS-CoV-2 testing and mental health. Two possible explanations exist: 1. provision of testing is a proxy for a well-run organisation, staff feeling well supported feel positively about working conditions and perception of management and, in turn are less likely to develop adverse mental health outcomes. 2. Staff suffering from burnout, anxiety or depression were less likely to seek out testing, possibly due to disengagement, physical or psychological symptoms [63] . Irrespective of the cause, both explanations are important as they support the need for staff testing, in particular for staff groups identified at risk of Covid-19 or poor mental wellbeing. Safety attitudes were significantly associated with psychological outcomes in this study. It cannot be determined whether safety attitude is a contributory factor for burnout, anxiety, and depression, or if these psychological states lead to poor safety attitudes. However, this is an important finding, as safety attitudes are both modifiable and independently associated with clinical outcomes [50, 64, 65] . The SAQ domains can be divided into net causes (teamwork, working conditions, safety climate subscales) and net effects (perception of management, job satisfaction, stress recognition) [66] . This suggests that in addition to supporting psychological wellbeing, initiatives that promote safety climate, working conditions, and teamwork may have benefits on safety attitudes and in turn psychological outcomes. There are some limitations to our approach. The countries investigated are well stratified by: Covid-19 death rate, gross domestic product and geographic region (Western Europe, Eastern Europe and Asia-Pacific). However, the use of convenience sampling (a combination of social media and targeted email communications), means it is difficult to estimate response rate, response bias, and external validity. However, this study recruited a large number of respondents in a multi-centre, international population with a diverse range of healthcare workers. The results are therefore likely to be internally valid and associations between covariates reliable. Our sample was 72% female, which is broadly in line with the demographics of the healthcare workforce in the countries studied [67, 68] . There was wide variation in the number of respondents between countries and an overrepresentation of nurses in the Polish cohort, this alongside data on only a limited number of variables may have resulted in residual confounding on multivariate regression analyses. While the OLBI has many good psychometric qualities, a clinical cut-off for when someone is considered "burned out" has been an issue of debate [69] . The cut-off values used in this study to describe prevalence are based on findings from a Swedish group as correlated with clinician-diagnosed burnout [70, 71] . The same cut-off values have been adopted in multiple other studies [34] [35] [36] . Given the high prevalence of burnout in this sample, and a lack of universally agreed cut-offs when using the OLBI, to improve specificity we used the 75th percentile of burnout scores rather than (lower) cut-offs values for the purpose of regression analyses. While investigating the prevalence of psychological findings during Covid-19 is important, it is unclear if findings are as a direct result of Covid-19. It is also unclear if acute derangements persist over time. Repeated measurements will be needed to identify any potential longterm effects of the Covid-19 pandemic. Finally, the contextual differences between participating countries, may limit the extent to which direct comparisons can be drawn between study countries. Based on these findings, we outline several preliminary recommendations that may positively impact on the psychological health of HCWs and patient safety. As highlighted by the association between safety attitudes and psychological outcomes, institutions should pay particular attention to safety culture during the Covid-19 pandemic. The use of patient safety teams, for example, can support the integration of human factors principles, such as effective communication, into organizational processes that will improve patient and staff safety [72] . The use of such teams during a time of organisational change can help "design, adapt and reconfigure work systems, maximize individual and team performance under high-risk, high-stakes environments, while minimizing the introduction of new significant safety risks or unintended consequences into the work system". Similarly, institutions should boost and expand learning systems to capture risks and improvement opportunities, and leverage these to protect staff and patients. This is of particular importance given the limited evidence about the effects of Covid-19 on patients, staff and institutions [73] . Previous research has suggested that burnout is a precursor to depression [74] , consequently, benefit may been seen from interventions to address burnout before the onset of depression or anxiety. At the individual level, evidence-based interventions include mindfulness, self-awareness exercises, and appreciative interviews [75] . At the organizational level, quality improvement projects that improve organizational communication and streamline workflows can reduce burnout rates [76] . Measures to mitigate harm arising from psychological distress following the Covid-19 pandemic are important to prevent long-term harm. Greenburg et al [77] proposed six evidencebased principles to support the mental health of HCWs following the Covid-19 pandemic: appropriate appreciation, investigating absences (for welfare reasons), conducting return to work interview, paying close attention to at-risk groups, continually monitoring staff, and helping HCWs make sense of their experience. Further research is needed to investigate the mechanisms underlying the associations identified in this study. Interrupted time series or longitudinal studies would be appropriate to investigate chronicity of findings and generate hypotheses about causality. Alongside this, interventions to reduce psychological harm or improve safety culture should be evaluated for efficacy, with case control or ideally, randomized-controlled designs. Our findings demonstrate a significant burden of burnout, anxiety, and depression amongst healthcare workers. A strong association was seen between SARS-CoV-2 testing, safety attitudes, gender, job role, redeployment and psychological state. These findings highlight the importance of targeted support services and proactive SARS-CoV-2 testing of healthcare workers. Moral Injury in Times of COVID-19 England's health policy response to covid-19 Ethical Challenges Arising in the COVID-19 Pandemic: An Overview from the Association of Bioethics Program Directors (ABPD) Task Force. The American journal of bioethics Burnout among healthcare workers at L'Aquila: its prevalence and associated factors Burnout among healthcare providers in the complex environment of the Middle East: a systematic review Long-term psychological and occupational effects of providing hospital healthcare during SARS outbreak The measurement of experienced burnout Healthcare Staff Wellbeing, Burnout, and Patient Safety: A Systematic Review Analysis of affecting factors on patient safety culture in public and private hospitals in Iran Burnout Among Healthcare Professionals and Its Effect on Patient Safety Patient Safety Network: Agency for Healthcare Research and Quality The job demands-resources model of burnout Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: stress and psychological impact among frontline healthcare workers The occupational and psychosocial impact of SARS on academic physicians in three affected hospitals Immediate and Sustained Psychological Impact of an Emerging Infectious Disease Outbreak on Health Care Workers. The Canadian Depression after exposure to stressful events: lessons learned from the severe acute respiratory syndrome epidemic Prevalence of psychological symptoms among Ebola survivors and healthcare workers during the 2014-2015 Ebola outbreak in Sierra Leone: a crosssectional study Anxiety and depression: toward overlapping and distinctive features How does the Hospital and Anxiety and Depression Scale measure anxiety and depression in healthy subjects? A validation study of the hospital anxiety and depression scale (HADS) in a Spanish population Hospital Anxiety and Depression Scale (HADS): Validation in Mexican Patients with Inflammatory Bowel Disease International experiences with the Hospital Anxiety and Depression Scale-a review of validation data and clinical results Posttraumatic stress, anxiety, and depression in survivors of severe acute respiratory syndrome (SARS) Long-term psychiatric morbidities among SARS survivors Assessing safety culture in pharmacies: the psychometric validation of the Safety Attitudes Questionnaire (SAQ) in a national sample of community pharmacies in Sweden Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ) The Turkish version of the safety attitudes questionnaire: psychometric properties and baseline data Validation of the safety attitudes questionnaire (short form 2006) in Italian in hospitals in the northeast of Italy Hospital safety culture in Taiwan: a nationwide survey using Chinese version Safety Attitude Questionnaire The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research burnout and coping mechanisms in UK doctors: a cross-sectional study Nurses' intention to leave their profession: A cross sectional observational study in 10 European countries Prevalence of Burnout among Nurses in a Community Hospital in Singapore: A Cross-Sectional Study Prevalence of Burnout in Medical and Surgical Residents: A Meta-Analysis The prevalence and influencing factors in anxiety in medical workers fighting COVID-19 in China: a cross-sectional survey Factors Associated With Mental Health Outcomes Among Health Care Workers Exposed to Coronavirus Disease Occurrence, prevention, and management of the psychological effects of emerging virus outbreaks on healthcare workers: rapid review and meta-analysis Sleep disorders, depression and anxiety are associated with adverse safety outcomes in healthcare workers: A prospective cohort study Why do surgeons consider leaving practice Human: Solving the global workforce crisis in health care-Nuffield Trust guest comment London: Nuffield Trust Falling short: the NHS workforce challenge. The Health Foundation COVID-19: Peer Support and Crisis Communication Strategies to Promote Institutional Resilience Health-Seeking Behaviors of Filipino Migrants in Australia: The Influence of Persisting Acculturative Stress and Depression Assessing safety culture: guidelines and recommendations. Quality and Safety in Health Care Teamwork assessment in internal medicine: a systematic review of validity evidence and outcomes Causal Relationship Analysis of the Patient Safety Culture Based on Safety Attitudes Questionnaire in Taiwan Healthcare Workforce Statistic Singapore: Ministry of Health Singapore Narrowing of NHS gender divide but men still the majority in senior roles Leeds: NHS Digital The construct validity of an alternative measure of burnout: Investigating the English translation of the Oldenburg Burnout Inventory. Work & Stress: The conceptualisation and measurement of burnout Burnout and physical and mental health among Swedish healthcare workers on the clinical validity of the maslach burnout inventory and the burnout measure Human factors systems approach to healthcare quality and patient safety COVID-19: Patient Safety and Quality Improvement Skills to Deploy during the Surge. International journal for quality in health care: journal of the International Society for Quality in Health Care Rates of medication errors among depressed and burnt out residents: prospective cohort study Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians A Cluster Randomized Trial of Interventions to Improve Work Conditions and Clinician Burnout in Primary Care: Results from the Healthy Work Place (HWP) Study Managing mental health challenges faced by healthcare workers during covid-19 pandemic We would like to thank the Pansurg collaborative for support and infrastructure supporting this project. We would like to thank Patient Safety Watch for support and advice relating to safety attitudes and patient safety in this paper.