key: cord-0747650-a7mmbi6z
authors: Ahn, Junseok; Lee, Jukab; Hong, Youjin; Park, Jangho; Chung, Seockhoon
title: Stress and Anxiety to Viral Epidemics-6 for Medical Students: Psychometric Properties of the Anxiety Measure for the COVID-19 Pandemic
date: 2021-08-03
journal: Front Psychiatry
DOI: 10.3389/fpsyt.2021.705805
sha: 63d39f63b72df316aa6520ca63db70263a624d18
doc_id: 747650
cord_uid: a7mmbi6z

The aim of this study was to explore the psychometric properties and validity of Stress and Anxiety to Viral Epidemics-6 items (SAVE-6) among medical students who are at high risk of coronavirus disease 2019 (COVID-19) infection. A total of 212 medical students participated in the online anonymous survey that used SAVE-6, Coronavirus Anxiety Scale (CAS), Generalized Anxiety Disorder-7 items (GAD-7), and Work and Social Adjustment Scale (WSAS). We observed that the single-factor structure model of the SAVE-6 scale showed good internal consistency (Cronbach's alpha = 0.756) and a good convergent validity with GAD-7 (rho = 0.320, p < 0.001), CAS (rho = 0.229, p < 0.001), and WSAS (rho = 0.278, p < 0.001). The appropriate cut-off score of the SAVE-6 scale was determined as 15 points in accordance with at least a mild degree of generalized anxiety (GAD-7 score of 5) among medical students. In conclusion, the SAVE-6 scale can be applied to medical students as a reliable and valid rating scale to assess anxiety response to the present viral pandemic.

The ongoing global coronavirus disease 2019 (COVID- 19) pandemic, which began in January 2020, has seized the entire world. In Korea, since the first confirmed case on January 20, 2020, 149,191 confirmed cases and 1,993 deaths have occurred as of June 2021 1 . Many patients have died in a psychiatric hospital in the neighboring area of Daegu city, which recorded a major breakout. Thereupon, patients as well as doctors, nurses, guardians, and other healthcare workers in the hospital were often infected by the virus. Since then, several hospitals conducted cohort quarantine or closed the emergency room that was occupied by the infected people for a certain period (1) . Currently, a system of examination for classification and confirmation of patients has been moderately established; however, in the earlier days of the pandemic, healthcare workers experienced unprecedented quarantining (2) . Despite the ongoing vaccination drives for healthcare workers as per the government's vaccination policy, they are still unable to be completely liberated from the anxiety of accidental exposure to the infection.

Like medical personnel, medical school students are also prone to anxiety regarding COVID-19 in hospitals since the onset of the COVID-19 pandemic (3) . Although virtual classes were introduced as a part of social distancing, due to the nature of medical education, medical students were scheduled to meet for on-site education in venues like laboratory classes in basic medicine, clinical clerkship in training hospitals, and medical licensing examinations (4) . Medical students are on the cusp of becoming medical experts as they are not yet certified medical professionals but are still trainees in the field (5) . They may feel the responsibility of being medical experts, in spite of inadequate medical practice. Simultaneously, they constantly worry about spreading infection to their families or partners, similar to the general public. As can be seen in the medical students' syndrome, those who lack practical experience in the field are more vulnerable to worrying about diseases due to their inadequate knowledge of diseases or symptoms (6) . As COVID-19 continues to progress, medical students are forced to overcome the fear of an uncertain disease and simultaneously face the difficulties of working in hospitals just like other medical personnel.

We developed the Stress and Anxiety to Viral Epidemics-9 items (SAVE-9) scale for measuring work-related stress and anxiety of healthcare workers in response to the ongoing viral pandemic (7) . Since medical students are not healthcare workers, it is not appropriate to apply the SAVE-9 scale to them. We observed that the SAVE-9 scale was clustered into two factors: factor I-"anxiety about the viral epidemic" and factor II-"work-related stress associated with the viral epidemic." We previously explored the validity of factor I (namely, SAVE-6) for measuring anxiety of the general population in Korea (8) and Lebanon (9) . Several rating scales such as Coronavirus Anxiety Scale (CAS) (10), COVID-19-Anxiety Questionnaire (11) , Fear of COVID-19 Scale (12), Obsession with COVID-19 Scale (13), Coronavirus Pandemic Anxiety Scale (14) , COVID-19 Anxiety Syndrome Scale (15) , and COVID-19 Anxiety Scale (16) were also developed and applied to assess the anxiety response of the general population to the viral epidemic. SAVE-6 included items inquiring about the apprehension of an individual during the current pandemic situation, worry about avoidance behavior of others, and concern about their own health and that of their family members (8, 9) . In this study, we hypothesized that the SAVE-6 scale can be applied usefully to measure the anxiety response of medical students to the viral epidemic. Thus, we aimed to explore the psychometric properties and applicability of SAVE-6 among medical students who are at high risk of contracting COVID-19. 

This study was conducted through an online anonymous survey using Google Forms among medical students at the University of Ulsan College of Medicine (UUCM) between July 13 and August 1, 2020. The study protocol was approved and written informed consent for participation was waived by the Institutional Review Board (2020-1067) of the Asan Medical Center.

The Stress and Anxiety to Viral Epidemics-6 items (SAVE-6) scale is a version extracted from the original SAVE-9 scale (7) which was developed to assess work-related stress and anxiety of healthcare workers in response to the viral epidemic. The utility of SAVE-6 among the general population has been studied in Korea (8) and Lebanon (9) . The items are rated on a 5-point Likert scale: 0 (never), 1 (rarely), 2 (sometimes), 3 (often), and 4 (always) 2 . A higher total score indicates a higher level of anxiety in response to the viral epidemic.

The Generalized Anxiety Disorder-7 items (GAD-7) scale, a self-rating questionnaire, assesses general anxiety of people. It comprises seven items and is rated using a scale ranging from 0-3 (where, 0 = not at all, 3 = nearly every day), and the total score ranges from 0 to 21. A higher score reflects a more severe degree of anxiety symptoms (17) . We used the Korean version of the GAD-7 scale 3 . In this sample, Cronbach's alpha = 0.894, and McDonald's omega = 0.903.

The CAS scale screens anxiety and fear associated with COVID-19 in people (10) . It consists of five items including dizziness, sleep disturbance, tonic immobility, appetite loss, and abdominal distress and is rated on a scale of 0-4 (0 = not at all, 4 = nearly every day). The Korean version of CAS was validated and used in this study (18) . In this sample, Cronbach's alpha = 0.854, and McDonald's omega = 0.870.

The Work and Social Adjustment Scale (WSAS) examines functional impairment due to an identified psychiatric problem. It consists of five domains: (1) the ability to work or study, (2) home management, (3) social leisure activities, (4) private leisure activities, and (5) the ability to maintain close relationships. The WSAS is rated on a scale of 0-8 (0 = not at all, 8 = severely impaired) (19) . In this study, we applied the Korean version of the WSAS that was created and translated with the author's permission in previous studies (18) . In this sample, Cronbach's alpha = 0.717, and McDonald's omega = 0.776.

The SAVE-6 total score differences in gender (men vs. women), generalized anxiety (GAD-7 ≥ 5 vs. GAD-7 < 5), and functional impairment of mental health (WSAS ≥ 11 vs. WSAS < 11) were examined using independent t-tests. Correlations of the SAVE-6 total score with GAD-7, CAS, and WSAS were examined using Spearman's correlations, since the distributions of those scales scores were not within the normal limit. Before performing confirmatory factor analysis (CFA), the normality assumption of each of the six items was checked based on skewness and kurtosis for an acceptable limit of range ± 2 (20) . The sampling adequacy and data suitability were examined using the Kaiser-Meyer-Olkin (KMO) test and Bartlett's test of sphericity. A bootstrap (2,000 samples) maximum likelihood CFA was conducted for the six items of SAVE-6 to explore the factorial validity for a unidimensional structure. Multi-group CFAs were run to examine whether SAVE-6 measures anxiety response the same way across gender (men vs. women), generalized anxiety (GAD-7 ≥ 5 vs. GAD-7 < 5), and functional impairment of mental health (WSAS ≥ 11 vs. WSAS < 11). Satisfactory model fit was defined by a standardized root-mean-square residual (SRMR) value ≤ 0.05, root-mean-square-error of approximation (RMSEA) value ≤ 0.10, comparative fit index (CFI) and Tucker Lewis index (TLI) values ≥ 0.90 (21, 22) . The reliability and internal consistency of the factor was examined using Cronbach's alpha and McDonald's omega coefficients. Receiver operating characteristic (ROC) analysis was performed to explore the appropriate cut-off score of the SAVE-6 scale in accordance with generalized anxiety symptoms. Furthermore, we conducted an independent t-test and a chi-square test to examine the differences in clinical variables or rating scale scores using the IBM SPSS Statistics for Windows, Version 21.0 and AMOS version 27.

A total of 212 medical students in the UUCM participated in this survey ( Table 1) . Among them, 150 (70.8%) were men, and the proportions of students in each grade were similar. No students were infected, two of them had quarantine experience, and 15 (7.1%) of them reported having a past history of psychiatric symptoms.

The normality assumption for the six items of SAVE-6 were checked using the skewness and kurtosis values, and we accepted values ranged within ± 2 ( Table 2) . Before the factor analysis, we checked sampling adequacy and data suitability, and observed that the KMO measure was 0.79 and Bartlett's test of sphericity was p < 0.001. CFA showed a single-factor model with good fit for all indices (CFI = 0.96; TLI = 0.94; SRMR = 0.04; RMSEA = 0.07), and these results supported the factorial validity of the SAVE-6 scale. Multi-group CFAs were conducted to 

Stress and anxiety to viral epidemics-6 items (SAVE-6) 11.0 , which demonstrated that measurement invariance was not observed when we measured anxiety response across gender, anxiety, or mental health using the SAVE-6 scale.

The SAVE-6 scale showed good internal consistency among medical students (Cronbach's alpha = 0.756, and McDonald's omega = 0.773), and it was similar to the Cronbach's alphas if each item was deleted (0.677-0.759, Cut-Off Score for Stress and Anxiety to Viral Epidemics-6 Items Among Medical Students ROC analysis was conducted to explore the appropriate cutoff score of the SAVE-6 scale among medical students in accordance with at least a mild degree of generalized anxiety (GAD-7 score of 5). We observed that a score of 15 points was appropriate (area under the curve = 0.657, sensitivity = 0.51, specificity = 0.77).

In this study, we explored the psychometric properties and convergent validity of SAVE-6 among medical students and observed that the single-factor structure of SAVE-6 showed good internal consistency and convergent validity with other anxiety scales like GAD-7 and CAS. Furthermore, the appropriate cutoff score of the SAVE-6 scale was determined as 15 with at least a mild degree of generalized anxiety (GAD-7 score of 5) among medical students. The SAVE-9 scale was originally developed to assess healthcare workers' stress and anxiety to the viral epidemic. Before commencing the study, we considered applying the SAVE-9 scale to medical students, since they stayed at the hospital and occasionally performed patient care roles. However, we decided to use SAVE-6, which was originally meant to be applied to the general population, since SAVE-9 had a few items that were not applicable to medical students. First, item 9 of SAVE-9, "Do you think that your colleagues would have more work to do due to your absence from a possible quarantine and might blame you?" was not appropriate for medical students, since they do not work professionally and thus are not replaced by other medical students. Additionally, item 6, "Do you feel skeptical about your job after going through this experience?" is also not applicable to medical students. Clinical clerkship is not a "job" for medical students, as they will begin working professionally as doctors in the future. Furthermore, item 7, "After this experience, do you think you will avoid treating patients with viral illnesses?" can be a question about "selecting their majors after getting a medical license."

In this study, a single-structure model of SAVE-6 was confirmed to be valid and in line with previous studies (8, 9) . However, we observed a relatively low factor loading value of 0.446 for item 1, "Are you afraid that the virus outbreak will continue indefinitely?" The survey was conducted during the summer of 2020, when people were worried that the COVID-19 pandemic would be difficult to control, which may have contributed to the high proportion of answers of "often" (53.8%) and "always" (17.0%) among medical students. In this model, values >0.6 for factor loading are acceptable. However, a value of <0.5 is also acceptable when the composite reliability is higher than 0.6 (23) . In this study, we observed good reliability (Cronbach's alpha = 0.756, and McDonald's omega = 0.773), thus this model was accepted. Furthermore, the reliability was not significantly more even if the item 1 was deleted ( Table 2) . The factor loading value was <0.6 for item 5, "Are you worried that others might avoid you even after the infection risk has been minimized?", due to the high proportion of the responses of "never" (45.8%) and "rarely" (36.8%). This result was similar to that of our previous study of SAVE-6 applied to the general Korean population (8) .

The appropriate cut-off score for the SAVE-6 scale in accordance with at least a mild degree of GAD-7 was determined to be 15 among the participants of this study. In our previous studies, we observed the same results among the general population (8) and healthcare workers (factor I of the SAVE-9 scale) (7). Although it can vary depending on groups, races, or regions, SAVE-6 can be a useful tool for measuring the anxiety response of medical students to a viral epidemic like the current COVID-19 pandemic.

The anonymous online survey method is a limitation of this study. Amid the ongoing pandemic, we conducted an online survey to prevent the spread of the viral infection. Among the participants, no one was infected, and only two experienced quarantine. This low proportion of actual infection experience or quarantine may have influenced the results. Insufficient sample size is also one of the limitations of this study. Another limitation is that rating scales in this study were not formally validated for medical students. Additionally, the participation of UUHM students and the uneven gender ratio of the sample can be regarded as limitations. Furthermore, information about the participants' ages was not recorded since all participants were in their 20s, and we grouped them based on their grades and not age. In conclusion, the SAVE-6 scale can be applied to medical students as a reliable and valid rating scale to assess anxiety response to the COVID-19 pandemic.

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

The studies involving human participants were reviewed and approved by Institutional Review Board (2020-1067) of the Asan Medical Center. The patients/participants provided their written informed consent to participate in this study.

JA drafted or provided critical revision of the article. JA and JL performed experiments and analysis. JL provided final approval of the version to publish. YH agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. SC and JP contributed substantially to the conception and design of the study, the acquisition of data, and or the analysis and interpretation. All authors contributed to the article and approved the submitted version.

Stress and psychological impact of the COVID-19 outbreak on the healthcare staff at the fever clinic of a tertiary general hospital in Beijing: a cross-sectional study

Effect of a national policy of universal masking and uniform criteria for severe acute respiratory coronavirus virus 2 (SARS-CoV-2) exposure on hospital staff infection and quarantine

Medical students as essential frontline researchers during the COVID-19 pandemic

Perception on online teaching and learning among health sciences students in higher education institutions during the COVID-19 lockdownways to improve teaching and learning in Saudi Colleges and Universities

Attitude of medical students about their role and social accountability in the COVID-19 pandemic

Medical student syndrome: fact or fiction? A cross-sectional study

Development of the stress and anxiety to viral epidemics-9 (SAVE-9) scale for assessing workrelated stress and anxiety in healthcare workers in response to COVID-19

The stress and anxiety to viral epidemics-6 items (SAVE-6) scale: a new instrument for assessing the anxiety response of general population to the viral epidemic during the COVID-19 pandemic

Factorial validity of the arabic version of the stress and anxiety to viral epidemics-6 items (SAVE-6) scale among the general population in Lebanon

Coronavirus anxiety scale: a brief mental health screener for COVID-19 related anxiety

Development of the COVID-19-anxiety questionnaire and first psychometric testing

The fear of COVID-19 scale: development and initial validation

Thinking" about COVID-19 is clinically dysfunctional?

Coronavirus pandemic anxiety scale (CPAS-11): development and initial validation

The COVID-19 anxiety syndrome scale: development and psychometric properties

COVID-19 anxiety scale (CAS): development and psychometric properties

A brief measure for assessing generalized anxiety disorder: the GAD-7

Validation of the Korean version of the obsession with COVID-19 scale and the Coronavirus anxiety scale

The work and social adjustment scale: a simple measure of impairment in functioning

Essentials of Statistics for the Behavioral Sciences

Confirmatory Factor Analysis for Applied Research

Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming

Structural Equation Modeling Using AMOS Graphic

ACKNOWLEDGMENTS Specially, we would like to thank Dr. Sherman A. Lee (Department of Psychology, Christopher Newport University) for the permission to use the Coronavirus Anxiety Scale and the wonderful discussion about researches in this pandemic era.

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.Publisher's Note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.Copyright © 2021 Ahn, Lee, Hong, Park and Chung. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.