key: cord-348464-1c08mb2k authors: Winter, Taylor; Riordan, Benjamin C.; Pakpour, Amir H.; Griffiths, Mark D.; Mason, Andre; Poulgrain, John W.; Scarf, Damian title: Evaluation of the English Version of the Fear of COVID-19 Scale and Its Relationship with Behavior Change and Political Beliefs date: 2020-06-15 journal: Int J Ment Health Addict DOI: 10.1007/s11469-020-00342-9 sha: doc_id: 348464 cord_uid: 1c08mb2k The COVID-19 pandemic has many individuals around the world fearing for their lives. The constant news coverage, rapid transmission, and relatively high mortality rate, make fearfulness a natural response. To assess the fear of COVID-19, the Fear of COVID-19 Scale (FCV-19S) was developed. The primary aim of the present study was to conduct the first psychometric assessment and validation of the English version of the FCV-19S. Two samples were collected in New Zealand. Sample 1 comprised 1624 participants of which 1397 completed all questions and were used in the analyses. Sample 2 comprised 1111 participants of which 1023 completed all questions and were used in the analyses. Several psychometric tests were conducted to ascertain the scale’s reliability and validity. Across both samples, the FCV-19S had high internal consistency. Consistent with the earlier validation studies, the FCV-19S displayed a moderately strong relationship with the perceived infectability and germ aversion subscales of the perceived vulnerability to disease scale (PVDS). Furthermore, FCV-19S scores were negatively correlated with the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS) scores. With respect to the motivating role of fear, there was a significant relationship between FCV-19S scores and adherence to the lockdown rules that were implemented in New Zealand. Finally, consistent with recent reports on the politicization of the COVID-19 pandemic, an exploratory question found that participants who rated themselves as more conservative tended to report lower FCV-19S scores. The English version of the COVID-19S is a sound unidimensional scale with robust psychometric properties and can be used with confidence among English-speaking populations. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11469-020-00342-9) contains supplementary material, which is available to authorized users. Behavior below for more detail on Alert Level 4). Sample 1 comprised more males (60.3%) than female participants, who were aged between 18 and 88 years old (mean [M] = 47.5 years; standard deviation [SD] = 16.3 years), and were largely New Zealand European (84.6%; 5.7% Maori or Pasifika, 1.8% Asian, and 7.9% other). Sample 2 comprised 1111 participants of which 1023 completed all questions and were used in the analyses. Sample 2 was collected during Alert Level 3. Level 3 immediately followed Alert Level 4, allowing people to expand their social circle to close family that they do not currently live with (see Lockdown Behavior below for more detail on Alert Level 3). Sample 2 comprised more female (69.7%) than male participants, who were aged between 18 and 85 years (M = 42.0 years; SD = 13.3 years), and were largely New Zealand European (75.4%; 7.6% Maori or Pasifika, 3.4% Asian, and 13.6% other). With respect to recruitment, both samples were recruited via posts on popular social networking sites and articles via several New Zealand news websites. Participants who agreed to take part in the study clicked on a hyperlink and were taken to the study webpage. The first page included a description of the study and an electronic consent form. Participants who provided informed consent were asked to complete a 15-min survey. The study was reviewed and approved by the University of Otago Human Ethics Committee. Demographic Information Age, gender (male, female, other), and ethnicity were collected. Fear of The FCV-19S is a seven-item measure assessing the extent to which a person fears COVID-19 (Ahorsu et al. 2020) . The scale asks participants to indicate the extent to which they agree with each item (e.g., "When I watch news and stories about coronavirus 2019 on social media, I become nervous or anxious") from 1 (strongly disagree) to 7 (strongly agree). Both Sample 1 (α = .89) and Sample 2 (α = .88) completed the FCV-19S. Perceived Vulnerability to Disease Scale The Perceived Vulnerability to Disease Scale (PVDS) is a 15-item measure of an individual's perceived vulnerability to disease and asks them to rate from 1 (strongly disagree) to 7 (strongly agree) the extent to which they agree with each item (Duncan et al. 2009 ). The scale has two subscales. Seven items assess perceived infectability (e.g., "I have a history of susceptibility to infectious diseases") and eight items assess germ aversion (e.g., "It really bothers me when people sneeze without covering their mouths"). Both Sample 1 (perceived infectability α = 0.90, germ aversion α = 0.71) and Sample 2 (perceived infectability α = 0.92, germ aversion α = 0.77) completed the PVDS. See Supplementary Table 1 for confirmatory factor analysis. Scale (WEMWBS) is a 14-item measure of mental wellbeing. Participants are asked to indicate from 1 (none of the time) to 5 (all of the time) how often they experienced each statement (e.g., "I've been feeling optimistic about the future", "I've been feeling close to other people") (Tennant et al. 2007 ). Only Sample 2 (α = .91) completed the WEMWBS. See Supplementary Table 2 for confirmatory factor analysis. Lockdown Behavior A State of National Emergency was declared in New Zealand on March 25, 2020, providing the New Zealand Government with access to "…extra-ordinary powers that will support delivery of an effective and timely response to COVID-19" (Ardern 2020) . In brief, this allowed the implementation of a four-level Alert System. Alert Level 4 was implemented between March 26 and April 27, with all businesses (expect essential services) and educational facilities closed. Moreover, a set of rules regarding personal movement were implemented, with people instructed to stay home, only associate with individuals they live with, and limit travel to their local area. Alert Level 3 immediately followed Alert Level 4, implemented between April 28 and May 3. Alert Level 3 allowed some businesses and educational facilities to open. However, social contact was still severely limited, with individuals only allowed to extend their social circle to close family they do not currently live with. To assess whether participants abided by New Zealand's lockdown rules, participants were asked to indicate from 1 (strongly disagree) to 7 (strongly agree) whether they abided by the five rules (e.g., "I ensure I maintain the 2-meter rule when out in public") ( Table 3) . Political Beliefs Given recent work suggesting COVID-19 has become highly politicized in the USA (Conway et al. 2020; Rothgerber et al. 2020) , the survey also included a single exploratory item to assess participants' political beliefs (Jost 2006; Sibley and Wilson 2007) . More specifically, following Sibley and Wilson (2007) , participants were given the instructions "Often, people use the terms 'liberal' or 'conservative' to describe their political beliefs. How would you rate yourself in these terms?" (p. 75). Participants responded on a scale ranging from 1 (very liberal), through 4 (moderate), to 7 (very conservative). Descriptive statistics were used to describe the study participants' characteristics. The analysis also tested the skewness, kurtosis, and distributions of each scale item in the FCV-19S, the internal consistency (Cronbach's alpha), and inter-and item-total correlations. A confirmatory factor analysis (CFA) was conducted using maximum likelihood estimation to measure the factor structure of the FCV-19S and report the factor loadings and the goodness of fit using root mean square error of approximation (RMSEA where good fit is typically less than 0.1) and comparative fit index (CFI where good fit is typically more than 0.9). To date, most published psychometric reports have focused on classical test theory. The use of classical test theory, in which raw scores, linear combinations of these scores, and responses that are ordinal in scale, is considered as data on an interval scale. Rasch analysis is a statistical technique traditionally for binary data, but some polytomous generalizations can also be used for interval data . Standard Rasch analysis is based on unidimensional models. In unidimensional models, it is assumed that only one hidden feature of the individual determines the individual's performance in the scale. If the data do not fit well with the Rasch model, the unidimensional assumption is rejected. This means that more than one hidden feature has affected an individual's performance, so the feature cannot be assessed well using the scale in question . Here, Rasch analysis using the partial credit model was used to assess the unidimensionality and item fits of the FCV-19S (Masters 1982) . Item validity was assessed using information-weighted fit statistic (infit) mean square (MnSq), and outlier-sensitive fit statistic (outfit) MnSq with values between 0.5 and 1.5 considered acceptable. The presence of disordering threshold in the FCV-19S was assessed using average and step measures of the descriptors. A monotonic increase in difficulties between 0.5 and 1.5 suggests no disordering. The unidimensionality of the FCV-19S was examined by conducting principal component analysis of the residuals (PCAR) on the items. Explaining at least 50% of the variance in the Rasch dimension, and an eigenvalue of less than 2.0 on first contrast, provides evidence of unidimensionality (Linacre 2012) . The response pattern across subgroups of the population (age and gender groups) was assessed by differential item functioning (DIF). All analyses were conducted in R (version 4.0.0; R Core Team, 2019) using the LAVAAN (Rosseel 2012) and WINSTEPS 3.71 software (Linacre 2012) . To test the concurrent validity, Pearson's correlations were used to assess the relationship between the FCV-19S and the PVDS (Samples 1 and 2), the WEMWBS (Sample 2), and adherence to lockdown rules (Samples 1 and 2). Finally, Spearman rank order correlations were used to test the relationship between FCV-19S and political beliefs. For Samples 1 and 2 respectively, the mean FCV-19S score was 15.6 and 18.3 (SD = 7.7 and 7.9), PVD was 57.0 and 58.5 (SD = 10.9 and 14.0), and WEMWBS was 49.1 (SD = 8.7). Table 1 shows the summary statistics and item analysis for each scale item in the FCV-19S (mean item scores, standard deviation, skew, kurtosis, item difficulty, item discrimination, and internal consistency if item was deleted). As seen in Table 1 , items 3, 6, and 7 were not normally distributed (indicated by a Skew and Kurtosis falling outside of the − 2 to 2 range), due to the fact that most participants "strongly disagreed" with these items. Finally, the internal consistency if an item was deleted ranged from .84 to .86, suggesting that dropping any item in the scale would not improve overall internal consistency. CFA of the FCVS-19 scale showed good fit with CFI of 0.90 for Sample 1 and 0.92 for Sample 2 ( Table 2 ). RMSEA was slightly higher than levels indicative of good fit, with RMSEA of 0.16 for Sample 1 and 0.13 for Sample 2, where a traditional cutoff of good fit is normally less than 0.1. Both samples, however, independently support a similar level of fit and all significantly loaded onto the same latent factor with standardized loadings between 0.6 and 0.8. All items fitted well with their latent construct as the infit and outfit MNSQ were within acceptable range (0.5-1.5) in both samples (Table 3 ). The most difficult item for Sample 1 and To assess concurrent validity, the FCV-19S was correlated with perceived vulnerability to disease (Sample 1 and 2) and wellbeing (Sample 2). The FCV-19S demonstrated good concurrent validity. More specifically, there was a moderately strong relationship between the FCV-19S and the two subscales of perceived vulnerability to disease scale: perceived infectability (Sample 1: r = 0.35, p < 0.001; Sample 2: r = 0.40, p < 0.001) and germ aversion (Sample 1: r = 0.39, p < 0.001; Sample 2: r = 0.45, p < 0.001). In addition, there was a negative relationship between FCV-19S and the WEMWBS (r = −0.31, p < 0.001), such that those who had higher fear scores reported lower overall wellbeing scores. Finally, when assessing participants' adherence to New Zealand's Lockdown Rules, FCV-19S was significantly associated with adherence with all five rules during Alert Level 4 (Sample 1) and three of the five rules during Alert Level 3 (Sample 2) (Table 4) . Finally, consistent with the view that COVID-19 has become a politicized topic, there were modest negative correlations between the FCV-19S scores and political beliefs (Sample 1: M = 3.74, SD = 1.49, rho = −.20, p < .001; Sample 2: M = 2.57, SD = 1.15, rho = −.07, p = .014). That is, participants that rated themselves as more toward the conservative end of the political spectrum tended to report lower FCV-19S scores. The primary aim of the present study was to evaluate the English version of the FCV-19S. Across two large samples, the FCV-19S had high internal consistency. Mirroring the Bangla (Sakib et al. 2020) , Italian (Soraci et al. 2020) , Arabic (Alyami et al. 2020) , and Hebrew (Bitan et al. 2020) validation studies, participants tended to "strongly disagree" with items 3, 6, and 7. As Alyami (2020) note, items 3, 6, and 7 refer to somatic responses to COVID-19 fear (e.g., "My heart races or palpitates when I think about getting coronavirus-19"), rather than the more general level of fear tapped by the remaining items (e.g., "When watching news and stories about coronavirus-19 on social media, I become nervous or anxious"). Consistent with the earlier validation studies, the FCV-19S displayed a moderately strong relationship with the perceived infectability and germ aversion subscales of the PVD scale (Duncan et al. 2009 ). Moreover, the FCV-19S scores were negatively correlated with the WEMWBS, reflecting the fact that as fear of COVID-19 increased wellbeing decreased. This finding is consistent with previous studies reporting positive correlations between the FCV-19S and the hospital anxiety and depression scale (Ahorsu et al. 2020; Alyami et al. 2020) , Patient Health Questionnaire (Sakib et al. 2020) , and the depression and anxiety stress scale (Bitan et al. 2020) . With respect to the motivating role of fear, there was a significant relationship between FCV-19S scores and adherence to the lockdown rules that were implemented in New Zealand (Harper et al. 2020; Pakpour and Griffiths 2020; Tannenbaum et al. 2015) . For example, fear of COVID-19 was associated with participants maintaining the 2-m rule (i.e., maintain 2-m distance from other people when out in public) and keeping physical activity to outdoor places that could be readily accessed by foot. This finding is consistent with Harper et al. (2020) , who reported a positive correlation between FCV-19S scores and participants judgment of the degree to which several behaviors and practices had changed due to the pandemic (e.g., hand washing, care of children, and the elderly). Consistent with the view that the politicization of COVID-19 is not limited to the USA, participants that rated themselves as more conservative displayed lower FCV-19S scores than participants that rated themselves more toward the liberal end of the political spectrum. Although conservative politicians in New Zealand have not gone as far as USA President Donald Trump, who early on referred to the virus as a hoax (Franck 2020) , they have argued that the liberal government should reduce alert levels more quickly, effectively communicating a lower level of risk (Burrows 2020; Coughlan 2020) . Indeed, in the USA, Rothgerber et al. (2020) demonstrated that perceptions of health risk (e.g., the likelihood of being infected with COVID-19) mediated the relationship between conservatism and abiding by social distancing rules. Although the study comprised over 3000 participants in total, there are some limitations to consider when interpreting the results. Data were not collected from a nationally representative sample (i.e., they comprised a self-selecting sample) and all the data were self-report which is subject to established method biases. Given the cross-sectional nature of the data, the relationships between all the variables examined are associational, and the only way to establish the directional nature of the variables would be to carry out a longitudinal study. However, for a scale validation study, the design was robust. The current study demonstrates that the English version of the COVID-19S is a sound unidimensional scale with robust psychometric properties that can be used with confidence Also shown is the association between FCV-19S and adherence to each rule among English-speaking populations. Critically, the COVID-19S displays sound concurrent validity and is associated with adherence to public health messages that aim to reduce the spread of COVID-19 (e.g., maintaining the 2-m rule). Conflict of Interest The authors declare that they do not have any interests that could constitute a real, potential or apparent conflict of interest with respect to their involvement in the publication. The authors also declare that they do not have any financial or other relations (e.g. directorship, consultancy or speaker fee) with companies, trade associations, unions or groups (including civic associations and public interest groups) that may gain or lose financially from the results or conclusions in the study. Sources of funding are acknowledged. Ethical Approval All procedures performed in this study involving human participants were in accordance with the ethical standards of University's Research Ethics Board and with the 1975 Helsinki Declaration. Informed Consent Informed consent was obtained from all participants. Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The fear of COVID-19 scale: development and initial validation Psychometric evaluation of the Arabic version of the fear of COVID-19 scale Coughing while asian': living in fear as racism feeds off coronavirus panic. The Guardian State of national emergency declared to fight COVID-19 Asian parents remove child from school as Covid-19 racism spikes. stuff.co.nz Fear of COVID-19 scale: psychometric characteristics, reliability and validity in the israeli population New Zealand should consider quitting lockdown early, David Seymour says Why are conservatives less concerned about the coronavirus (COVID-19) than liberals? Testing experiential versus political explanations Simon bridges says the lockdown should be lifted next week. stuff.co.nz Perceived vulnerability to disease: development and validation of a 15-item self-report instrument Trump says the coronavirus is the democrats' 'new hoax Functional fear predicts public health compliance in the COVID-19 pandemic Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science As they fight virus, Asian Americans battle racism The end of the end of ideology Social reaction toward the 2019 novel coronavirus (COVID-19) Using hospital anxiety and depression scale (HADS) on patients with epilepsy: confirmatory factor analysis and rasch models Psychometric validation of the Persian Bergen Social Media Addiction Scale using classic test theory and Rasch models A user's guide to WINSTEPS® MINISTEP Rasch-model computer programs program manual 3.80.0. Chicago: Winsteps First COVID-19 suicide case in bangladesh due to fear of COVID-19 and xenophobia: possible suicide prevention strategies A Rasch model for partial credit scoring The fear of COVID-19 and its role in preventive behaviors Psychosocial consequences of infectious diseases COVID-19 fear in Eastern Europe: validation of the fear of COVID-19 scale Lavaan: an R package for structural equation modeling and more Politicizing the covid-19 pandemic: ideological differences in adherence to social distancing Psychometric validation of the bangla fear of COVID-19 scale: confirmatory factor analysis and rasch analysis Adaptation of the fear of COVID-19 scale: its association with psychological distress and life satisfaction in Turkey Political attitudes and the ideology of equality: differentiating support for liberal and conservative political parties in New Zealand Effects of the COVID-19 pandemic and nationwide lockdown on trust, attitudes towards government, and wellbeing Validation and psychometric evaluation of the Italian version of the fear of COVID-19 scale Appealing to fear: a meta-analysis of fear appeal effectiveness and theories The warwick-edinburgh mental well-being scale (WEMWBS): development and UK validation COVID-19 coronavirus pandemic Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations