key: cord-0774050-wl8lhw88
authors: Iversen, M. M.; Norekvål, T. M.; Oterhals, K.; Fadnes, L. T.; Mæland, S.; Pakpour, A. H.; Breivik, K.
title: Psychometric Properties of the Norwegian Version of the Fear of COVID-19 Scale
date: 2021-01-20
journal: Int J Ment Health Addict
DOI: 10.1007/s11469-020-00454-2
sha: 9e84d04ee4fcf6f5e4431c2e92da0a54540b7256
doc_id: 774050
cord_uid: wl8lhw88

To examine the psychometric properties of the Norwegian version of the Fear of COVID-19 Scale (FCV-19S), randomly selected individuals from a larger registry study were invited. We assessed the reliability and validity of the instrument in a sample of 1089 adults in Norway (response rate 73%). Internal consistency measured by Cronbach’s alpha (0.88) was acceptable. Omega alphaHierarchical (ωt = 0.69) was lower indicating that the general factor is less reliable, explaining 69% of the total variance. Confirmatory factor analysis indicated that the FCV-19S is not strictly unidimensional. Exploratory graph analysis and confirmatory factor analysis supported a two-factor model (cognitive and somatic fear), which were highly correlated (r = 0.84). The Norwegian version of the FCV-19S showed an underlying two-factor structure. However, the high correlation means the two latent factors (cognitive and somatic fear) act as indicators for a second-order general factor and support use of the FCV-19S sum score. The FCV-19S appears to be a valid instrument to assess fear of COVID-19 with good psychometric properties. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11469-020-00454-2.

in order to assess psychosocial responses (fear and anxiety) related to COVID-19, the Fear of was developed to design appropriate programmes to mitigate fear. The collection of patient-reported information to capture the individual's fear of COVID-19 is both timely and important (Ahorsu et al. 2020) . The current evidence suggests that a psychiatric epidemic is cooccurring with the COVID-19 pandemic . In line with this, some evidence suggests that infectious disease-related public health emergencies (epidemics) may increase suicide risk (Zortea et al. 2020) . Mental health care and fear of COVID-19 necessitate greater attention during the COVID-19 pandemic.

The prevalence of the COVID-19 pandemic throughout the world means that comparative international research is required. The FCV-19S has been developed as a scale with seven questions and is assumed to have an unidimensional structure. Although the unidimensional structure has been supported by research on several translated versions of the scale Lin et al. 2020; Sakib et al. 2020; Satici et al. 2020) , the Eastern European and Israeli version suggests a bi-dimensional structure representing physiological responses (three questions) and emotional responses (four questions), respectively (Bitan et al. 2020; Reznik et al. 2020) . Although authors from the New Zealand and Greek studies revealed weaker fit values based on conventional assumptions, they did not modify the models (Tsipropoulou et al. 2020; Winter et al. 2020) . The Arabic and Italian versions confirmed an unidimensional structure when the model had been modified to allow for a number of correlations between pairs of residuals (Alyami et al. 2020; Soraci et al. 2020 ). Since such correlated residuals might signal multidimensionality (Brown 2006) , in-depth investigation of the FCV-19S facture structure is warranted.

The FCV-19S offers great potential for international comparative research on the psychosocial responses to COVID-19 as the instrument is translated into many languages and cultures and used in different populations as vulnerable populations, including elderly, children, adolescents and people with pre-existing physical and mental disease (Ahorsu et al. 2020; Bitan et al. 2020; Chang et al. 2020a; Chang et al. 2020b; Chen et al. 2020; Harper et al. 2020; Pakpour et al. 2020a; Reznik et al. 2020; Sakib et al. 2020; Satici et al. 2020; Soraci et al. 2020) . Thus, having a Norwegian translation of the FCV-19S is an advantage.

Our study aimed to examine the psychometric properties of the Norwegian version of the FCV-19S and determine the level of fear of COVID-19 in a Norwegian population. As part of construct validity, we tested whether confirmatory factor analysis would detect a one-factor structure in these data. If the fit of the unidimensional model is unsatisfactory, we will follow up with exploratory analysis to analyse the dimensionality of the scale. To test concurrent validity, we hypothesise that the FCV-19S scores are negatively associated with satisfaction with life, and positively associated with the shortened Hopkins symptom checklist (SCL-10), and that it discriminates between men and women and those with high and low socioeconomic status. study surveying the effect of the lockdown during the COVID-19 pandemic. The individuals invited to participate were drawn from the Contact and Reservation Registry through the Norwegian Digitalisation Agency. In total, 29,535 individuals consented to participate in the first wave of the study. For the present validation study, 1500 individuals were randomly selected to participate in a follow-up survey. With an anticipated response rate of 30-40%, we estimated that this would give us a satisfactory number of participants for the psychometric analysis. A total of 1089 (73%) consented to participate in this second emailing. As 15 responded to no items in this follow-up survey, and an additional 11 did not respond to the FSV-19S, 1063 individuals were available for analysis ( Fig. 1) .

Characteristics of the Study Population Demographic information collected included age (in groups), gender, marital status, smoking status, education level (lower secondary school, upper secondary school, college/university less than 4 years, college/university 4 years or more), household income, employment status before the COVID-19 outbreak Fig. 1 Flowchart of selection and inclusion in the validation study (working, retired, sick leave, disability pension, seeking employment, student/military service), change of employment status after the COVID-19 outbreak (working from home, laid off, unemployed, new employment, receive wages but not working), sector of employment (healthcare, retail, transport, industry, education, fire-service/police) and Norwegian citizenship. Demographic information was collected during the first and second emailing (Fig. 1) .

Questions specifically related to the COVID-19 pandemic over the last 4 weeks included quarantine, social distancing, working from home and/or home schooling, ill with suspected, possible or confirmed COVID-19 and living in the same household as someone with suspected, possible or confirmed COVID-19. This information was collected during the first emailing (Fig. 1) .

General Health and Meaningfulness Two global items on general health and meaningfulness were included: 'How would you rate your general health?' (1 not at all to 10 to a very high degree), and 'To what degree do your experience what you do as meaningful?' (very poor/poor/neither good nor poor/good/very good). This information was collected during the first and second emailing (Fig. 1) .

The 10-Item Hopkins Symptom Checklist SCL-10 is a shortened version of the original 25item symptom checklist (SCL-25) (Hesbacher et al. 1980) , and is designed to measure anxiety and depression in large health surveys. The participants are asked to rate, on a scale from 1 to 4, how bothered or distressed they were over the past 14 days by each of the 10 symptoms, four of which address anxiety and six depression. The questionnaire has demonstrated good psychometric properties in previous Norwegian studies (Strand et al. 2003) . The SCL-10 was distributed in the second emailing ( Fig. 1) .

The FCV-19S is a seven-item scale that assesses the fear of COVID-19. The seven items (e.g. "I am most afraid of corona") are rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree) with scores ranging from 7 to 35. The higher the score, the greater the fear of COVID-19 (Ahorsu et al. 2020) . The FCV-19S was distributed in the second emailing (Fig. 1 ).

A cross-cultural adaptation process was conducted to assure equivalence between the original source and the Norwegian target version of the FCV-19S. The translation process was conducted systematically in six steps including forward and back-translation as recommended (Beaton et al. 2000) . The research team encountered some difficulties in translating some phrases in the original English version of the FCV-19S into Norwegian. The issues were discussed with the developer of the FCV-19S for clarity. The persons who participated in the cognitive interviews (n = 18) reported that they clearly understood the items and response options. Questions or suggested changes were considered by the research team but did not result in any additional changes to the final version of the instrument. A summary of the overall translation procedure is described in Textbox 1.

Step 1: Forward translation i. Two forward translations of the English FSV-19S were made by two bilingual translators for whom the target language (Norwegian) was their mother tongue. ii. The translators worked independently and wrote a report (TL1 and TL2) that identified challenging phrases and described their rationale for final translation choices. iii. The two translations were compared by the research team and discrepancies were identified.

Step 2: Synthesis i. The research team synthesized the reports (TL1 and TL2) into one consensus version (TL3) and described how they resolved discrepancies.

•

Step 3: Back translation i. Two individuals who had a good understanding of English and also spoke Norwegian fluently independently translated TL3 back into English (TL4 and TL5). Neither of the translators who spoke English as their native language was aware of the original version of the FSV-19S.

•

Step 4: Synthesis i. The research team agreed on the modified Norwegian version of the FSV-19S (TL6).

ii. The research team discussed the timing of administration and meaning of certain words and sentences.

iii. The instrument developer was contacted in order to clarify issues.

•

Step 5: Instrument pilot testing i. Cognitive interviews were conducted to determine the feasibility and whether the items were understandable. The individuals were asked to comment on the questionnaire items and the amount of time needed to respond.

•

Step 6: Revised instrument i. The researchers evaluated the adapted FSV-19S questionnaire (TL6) and all necessary changes were made.

For the first wave of the data collection, an electronic battery of questionnaires was distributed via email through the SurveyXact system on 15 and 16 April 2020. Two reminders were sent, first via text message and then via email. The restrictions imposed at the time included social distancing, closure of schools and universities, as well as sports arenas and other public places where people could potentially gather in large numbers. Employees were encouraged to work from home, and travel restrictions and quarantine and isolation requirements were imposed. There were no changes to restrictions during this first wave of data collection. The survey closed on 30 April 2020. For this validation study, a follow-up emailing was performed on 4 June 2020. A battery of questionnaires including FCV-19S were distributed via email through the SurveyXact system to 1500 randomly selected individuals (Fig. 1) . Two reminders were sent, and the survey closed on 23 June 2020. By this time, the restrictions had brought the pandemic under control in Norway, and the restrictions had been eased at the time of the second emailing. Schools had re-opened, and organised sports activities were slowly picking up. However, social distancing and the advice to avoid public transport were still maintained.

The study was approved by the Norwegian Regional Committee for Ethics in Medical Research (REK 2020/131560). All participants provided informed consent by responding to the emailed survey, and confidentiality and the right to withdraw from the study were assured. The study complied with the ethical principles outlined in the Declaration of Helsinki.

The descriptive statistics and correlation analyses were analysed in the IBM SPSS Statistics Version 25.0 software. The remaining analyses were conducted in the R statistical environment (R Development Core Team 2020) using various packages (R Foundation for Statistical Computing n.d.). Reliability was assessed using Cronbach's alpha, Omegatotal alpha and Omegahierarchical (using two specific factors) which are available in the psych package (Revelle 2014) . Exploratory dimensionality assessment was performed using Exploratory graph analysis available in the EGAnet package . Exploratory graph analysis is a relatively new and promising statistical method for estimating the number of factors and has demonstrated a good ability to determine the correct number of underlying factors Golino and Christensen, 2019) .

Confirmatory factory analysis (CFA) was performed using Lavaan package version 06.6 (Rosseel 2012). The CFA models were estimated using the robust-weighted least square (WLMSV) estimator due to the highly skewed categorical data (Flora and Curran 2004) . Missing data were dealt with using pair-wise deletion. Model fit was assessed using robust versions of Chi-square, the comparative fit index (CFIrobust), the root mean square error of approximation (RMSEArobust) and SRMRrobust. CFI values greater than 0.90 together with RMSEA values of less than 0.08 and SRMR of less than 0.08 were considered acceptable (Brown 2006) , whereas CFI values above 0.95 and RMSEA of below 0.06 and SRMR of less than 0.05 were preferred (Hu and Bentler 1999) . Measurement invariance across gender, age (over 50 versus under 50 years of age) and household income (over versus below 500,000 NOK) (1 € = NOK 10.67, as of 4 July, 2020), respectively, was tested by comparing a model where the fit of a model of which the factor loadings and thresholds were equal across groups (strong invariance) with the fit of a model of which the same parameters (except for identification items) were free to vary (configural invariance). If the change in CFI was > 0.002 (Meade et al. 2008) , the factor loadings and thresholds were relaxed in tandem for one and one item at the time (see Muthén and Muthén 2017 p.546 ). Items were flagged as functioning differently across groups if delta chi-squared was significant. Finally, the covariation between factors was constrained to be equal across groups to explore whether this led to a significantly poorer fit as measured by delta chi-squared. The significant level was set at p < 0.01 in these invariance tests to adjust for family-wise error rate as a means to avoid potential type I errors when performing multiple tests.

In total, 1063 (73%) were available for analysis; 588 (55%) were female and 475 (45%) male. The age distribution was quite even with the highest percentage in the group aged 50-59 years (21%), and the lowest among those aged 18-29 years (12%). The majority had education at university level (60%), and nearly half of them were full-time workers (50%) ( Table 1) . Five questions described coronavirus-related actions over the last 4 weeks. Half of the respondents had been working from home or home schooling (50%). Most answered that they had tried to keep a distance from people around them (88%), while 5.8% had been ill with suspected, possible or confirmed COVID-19 infection or been in a household with a person with suspected, possible or confirmed COVID-19 infection (5.1%) ( Table 2) . Fear of COVID-19

As shown in Table 3 , less than 10% of the respondents either agreed or strongly agreed with most of the FCV-19S items suggesting that the level of fear of COVID-19 is generally low in this population. For three of the items, all of which assessed somatic symptoms (q3, q6, and q7), only two or less strongly agreed with the item. Two items were somewhat less asymmetric; however, since 15% and 33% either agreed or strongly agreed that "they were most afraid of corona" (q1) and that "it made them uncomfortable to think about corona" (q2), respectively. The asymmetric response is also highlighted in Figure S1 , which shows that 14.5% strongly disagreed on all the items and therefore had the lowest possible sum score on the FCV-19S. Apart from these extremely low scorers, the distribution of the total scale score was rather close to a normal distribution (skewness = 0.83, kurtosis = 0.55).

Both Cronbach's alpha (0.88) and Omega alphaTotal (ωt = 0.91) indicate that the scale has a very good internal consistency. However, the Omega alphaHiercical (ωh) coefficient suggests that the general factor is not very strong explaining only 69% of the total variance. 

The one-factor model (M1) has an unsatisfactory fit to the data (Table 4 ). While the CFI was good (> 0.95), both SMRS and particularly RMSEA were above conventional cut-offs for acceptable fit (> 0.08). Using modification indices, we allowed for correlations between 5 pairs of residuals (local dependencies) to obtain an acceptable fit (M1b). Figure 2 shows that these local dependencies are far from negligible (r = 0.22-0.51). The inclusion of these local dependencies had a clear impact on the factor loadings of two items as the factor loading of q1 decreased from 0.81 to 0.68 from M1 to M1b while the factor loading of q2 decreased from 0.78 to 0.64. . 2 Modified one-factor model (M1b). q1-q7 refer to questions in FSV-19S as written in full Table 3 Due to the poor fit of the unmodified unidimensional model, we conducted an exploratory graph analysis (EGA) to detect the number of factors in the scale. As shown in Fig. 3 , the EGA analysis suggests that the COVID-19 scale consists of two dimensions. Given their content, we interpret these dimensions as reflecting cognitive fear (q1, q2, and q4) and somatic fear (q3, q5, q6, and q7). The robustness of the factor structure was supported by EGA bootstrap analyses (1000 draws with replacements), using both "glasso" and "TMFG" estimators . Although a CFA model based on these two factors (M2) had a significantly better fit than the unmodified unidimensional model (ΔΧ 2 = 98.71, df = 1, p < 0.001), the RMSEA index was unsatisfactory also in this model (0.116). To obtain an acceptable fit for this index (M2b), we had to allow for four rather large local dependencies (q1 & q2, q2 & q5, q2 & 3, and q6 & q7) (Fig. 4) .

The correlated two-factor model was measurement invariant across gender and household income but not age. Q4 (I am afraid of losing my life because of corona) functioned somewhat differently for individuals above 50 years than younger people (ΔX 2 = 13.01, df = 4, p < 0.01) as the above 50-year-old group seemed to be somewhat more likely to have a higher score on this item than the younger age group with similar level of cognitive fear. Allowing the loading and thresholds of this item to be free to vary across these age groups had only a minor impact (− 0.04 standard deviation units) on the differences in latent means on the cognitive fear factor (0.58 versus 0.62 standard deviation units higher cognitive fear in the older age group). The covariation between the cognitive and somatic fear factors was found to be invariant across gender, age, and household income.

It should be noted that the two factors were highly correlated (r = 0.84). A mathematically identical model (with the same model fit) but with a conceptually different meaning is shown in Fig. 5 . In this second-order hierarchical model, the large correlation between the factors is transformed into a second-order general fear of COVID-19 factor of which the two latent factors serve as indicators (loadings of the general factor constrained to be equal to identify the model). This model suggests that, even if there are two separate first-order COVID-19 fear factors (cognitive and somatic fear), both are strongly determined by the second-order of general fear of COVID-19 factor. Table 3 Fig. 5 Second-order mode of cognitive and somatic fear as first-order factors and general fear of COVID-19 as a secondary factor (M3). q1-q7 refer to questions in FSV-19S as written in full Table 3 Fig . 4 Correlated two-factor model of cognitive and somatic fear with correlated residuals (M2b). q1-q7 refer to questions in FSV-19S as written in full Table 3 International Journal of Mental Health and Addiction

The sum score of FCV-19S correlated significantly with other constructs like poorer mental health (SCL-10) (r = 0.35, p < 0.001) and lower life satisfaction (r = − 0.19, p < 0.001) ( Table 5) . A higher FCV-19S score was positively associated with being female, older age groups, and lower socioeconomic status (lower education and income). FCV-19S was statistically significantly associated with questions like being worried that they themselves and their family could be infected by the virus, as well as worries linked to the possibility of experiencing financial problems or losing or being laid off from their job. Similarly, FCV-19S correlated with one question concerning coronavirus-related actions over the last 4 weeks before the survey, e.g., a negative correlation with working from home or home schooling. The Table 5 Correlation coefficients for Fear of The cognitive (r = 0.91) and somatic (r = 0.90) subscales had similar associations with the sum score of FCV-19S, as well as other constructs. This was also the case for most sociodemographic variables (Table 5 ). Only "Household income" and "The outbreak could cause me to be laid off or lose my job" were not statistically significantly associated with the cognitive subscale. This subscale also tended to have a somewhat weaker correlation with mental health problems (SCL-10, r = 0.26 vs. 0.38) and life satisfaction (r = − 0.14 vs. − 0.21) than the somatic subscale. The somatic subscale had a somewhat weaker correlation with age (r = 0.12 vs. 0.20) and worries about themselves and their family possibly getting infected (r = 0.29-0.50 vs. 0.34-0.65) than the cognitive subscale.

Exploratory graph analysis and confirmatory factor analysis found support for a two-factor model (cognitive and somatic fear), which were highly correlated (r = 0.84). Therefore, it might be most fruitful to present the FCV-19S by using a hierarchical model where a general factor is a second-order factor accounting for the high correlation between the first-order factors (cognitive and somatic fear). This model is theoretically meaningful and supports use of the FCV-19S sum score.

The internal consistency reliability for the Norwegian version of the FCV-19S was found to be very good when assessed by Cronbach's alpha (0.88). This is in line with studies from other countries (Ahorsu et al. 2020; Alyami et al. 2020; Bitan et al. 2020; Reznik et al. 2020; Sakib et al. 2020; Satici et al. 2020; Soraci et al. 2020; Tsipropoulou et al. 2020; Winter et al. 2020) . Although Omega alphatotal is often regarded as a better alternative than Cronbach's alpha (McNeish 2018; Revelle and Condon 2018), it produced very similar results in the present study (0.91). It should be noted that although the items are ordinal, they were treated as continuous variables in the reliability analyses, as this is probably most appropriate when assessing the reliability of simple unweighted sum scores (Gustafsson and Aberg-Bengtsson 2010; Revelle and Condon 2018) . A potential limitation of both these reliability coefficients is that they assume that the scale is unidimensional. As mentioned in the introduction section, the results from some studies have indicated that the FCV-19S might not be strictly unidimensional (Alyami et al. 2020; Soraci et al. 2020) . Accordingly, the Omega hierarchical coefficient (ωh) was found to be only 0.69, which is at the boundary of what is conventionally regarded as acceptable reliability (Nunnally and Bernstein 1994) . The Omega hierarchical coefficient is model-based and assesses the reliability of the general factor in either a bi-factor or a hierarchical second-order factor structure (Savalei and Reise 2019). Our results thus suggest that when assessing the reliability of the latent variable representing the common variance across all the items in FCV-19S, the often-used Cronbach's alpha (and ωt) will lead to a somewhat inflated result. Thus, researchers are advised to include ωh in future reliability assessments of this scale.

Despite some previous studies have shown unidimensional structure for FCV-19S, there are some inconsistencies in their underlying factor structures in other versions, including a bidimensional structure representing physiological and emotional responses (Bitan et al. 2020; Reznik et al. 2020; Pakpour et al. 2020b; Pakpour et al. 2020c ). Furthermore, RMSEA values above the preferred cut-off value of 0.06 were identified (Alyami et al. 2020; Tsipropoulou et al. 2020; Winter et al. 2020) . In line with this, the unidimensional model showed poor fit in our study and several correlated residuals had to be included to obtain acceptable fit.

The results from the EGA analysis suggest that the FCV-19S consists of two dimensions: cognitive fear and somatic fear. These dimensions are similar to those detected in the Eastern European and Israeli version of the scale (Bitan et al. 2020; Reznik et al. 2020; Pakpour et al. 2020b ) except for item 5 (When watching news and stories about corona on social media, I become nervous or anxious), which was categorised as a somatic factor in our study. One reason for this difference could be that the Eastern European and Israeli study used PCA to assess dimensionality and assumed that the factors were orthogonal to each other.

After allowing for three correlated pairs of residuals, the two-factor model had a good fit to the data. Our analyses indicate, moreover, that multidimensionality has an impact on the size of the factor loadings (M1 versus M1b). This means that in a traditional IRT/RASCH model, when assuming unidimensionality, the parameter values will probably be wrong. This bias will subsequently be problematic if factor loadings or discriminative parameters (IRT) are used as baseline for example in computer adaptive testing, calculation of reliability, or when making any changes to the scale by removal of items based on the size of these parameters.

The correlated two-factor model was found to be measurement invariant across gender and household income and age with one exception. This study suggests that the item (q4), which measures whether one is afraid of losing one's life due to corona, functions somewhat differently depending on whether one is above 50 years or not. The consequence of this is that individuals above 50 years old seem to be more likely to endorse this item than younger people with a similar degree of cognitive fear of COVID-19. It is perhaps not surprising that this item functions somewhat differently dependent on age given the fact that the risk of death due to COVID-19 is much lower for people younger than 50. Our analyses suggest that this lack of invariance has negligible effect on mean age group differences on the cognitive fear factor which supports the inclusion of this item when analysing this subscale.

It is worth noting that the correlation between the cognitive and somatic fear factors was very large (r = 0.84) in our study, so large in fact as to question their discriminant validity as two separate factors (Brown 2006) . We regard this large correlation as support for a secondorder hierarchical model in which two latent factors (somatic and cognitive fear) act as indicators of a second-order general fear of COVID-19 factor. Distinguishing between cognitive and somatic components of anxiety has been supported (Schoen and Holtzer 2017) , and the general factor supports use of the FCV-19S sum score. Given the large correlation between the cognitive and somatic factors, we believe that it is often sufficient to treat the scale as essential unidimensional and use the sum score. In some cases however, differencing between cognitive and somatic fear might provide unique information that might turn out to be of importance for further understanding of fear of COVID-19.

In previous validation studies, the sum score of FCV-19S has shown good concurrent validity with other constructs measuring for example anxiety and depression (Ahorsu et al. 2020; Alyami et al. 2020; Bitan et al. 2020; Reznik et al. 2020; Sakib et al. 2020; Satici et al. 2020; Soraci et al. 2020; Tsipropoulou et al. 2020; Winter et al. 2020) . Our results were in line with these studies and confirmed sound concurrent validity as the FCV-19S sum score was positively correlated with SCL-10 and negatively correlated with satisfaction with life. FCV-19S was statistically significantly associated with one of the coronavirus-related actions over the last 4 weeks before the survey, namely that fear of COVID-19 had a negative correlation with working from home or home schooling. It is not surprising that those working from home report less fear of COVID-19 than those who do not have this opportunity, as they probably feel that they have a lower risk of catching the virus. Fear of COVID-19 has been associated with people practising social distancing by maintaining the two-metre rule (i.e. maintaining a 2-m distance from other people when in public places), and only engaging in physical activity in outdoor places that were readily accessible on foot (Winter et al. 2020) . Interestingly, Harper et al. (2020) also reported a positive correlation between FCV-19S scores and participants' judgement of the degree to which several behaviours and practices had changed due to the pandemic (e.g. hand washing and care of children and the elderly). Furthermore, the relationship between fear and preventive behaviours has been explored (Chang et al. 2020b ). In addition, fear of COVID-19, as measured by the FCV-19S, is found to be a mediator in the association between problematic social media use and distress and insomnia (Chang et al. 2020b; Lin et al. 2020 ), thus given further support for its construct validity.

The cognitive and somatic subscales had in most cases significant and similar degree of associations with the other variables as the total scale. However, in some cases, the use of these subscales provided possible insight in rather unique relations. "Household income" and "The outbreak could cause me to be laid off or lose my job" were only statistically significantly associated with the somatic subscale. This subscale also had a somewhat stronger association with mental health problems than the cognitive subscale. The cognitive fear subscale, on the other hand, tended to have a somewhat stronger correlation with age as well as worries about family and themselves getting infected by the virus. According to Cohen's criteria (1988) , most of the effect sizes in this study can be classified as small. However, regarding the FCV-19S relationship with mental health problems (SCL10) and worries about themselves and their family possibly getting infected, the effect sizes were medium to large.

As many as 14.5% strongly disagreed with all the FCV-19S items and therefore had the lowest possible sum score. This is very close to the conventional cut-off for a floor effect (Terwee et al. 2007 ) ( Figure S1 ). However, the results of the study should be interpreted in light of the prevalence of COVID-19 in the country at the time of the data collection. In Norway, the first cases of COVID-19 were confirmed in February 2020. The peak of the outbreak was during March and April. As of 1 July, the total number of confirmed cases was 8912 and there had been 251 deaths. In the city of Bergen, the second largest city in Norway, 575 cases and 31 deaths have been confirmed so far (Norwegian Institute of Public Health 2020). In the data collection period, 4-23 June, only five citizens tested positive for COVID-19. Apart from some extremely low scorers, which is not unexpected given the data collection period, the distribution of the total scale score seems to be rather close to a normal distribution.

The sampling technique is a strength of this study. Individuals were drawn from the Contact and Reservation Registry through the Norwegian Digitalisation Agency for inclusion in a larger COVID-19 study, and then randomly selected to participate in a follow-up survey in which we included the FCV-19S. The response rate was 73%. To date, most other validation studies of the FCV-19S are convenience studies, using snowball sampling or social media networks. In addition, our study had a broad age and gender distribution. However, as with all large-scale validation studies, this study also has inherent shortcomings. The study design was cross-sectional, and therefore, this study did not examine the stability of the FCV-19S over time. The measurement time may not have been ideal since COVID-19 was decreasing at the time, and fear was therefore expected to do the same. However, this is uncertain as the easing of restrictions may increase fear in some people. The data showed close to normal distribution.

The Norwegian version of the FCV-19S showed not to be strictly unidimensional. We found support for a bi-dimensional fit with two highly correlated factors representing cognitive and somatic fear. Due to the high correlation, we believe it is fruitful to regard the two latent factors as indicators of a second order general factor. This general factor seems to have a very strong impact on cognitive and somatic fear which support use of the FCV-19S sum score. We found that the total scale correlated meaningfully with other variables. Further research is needed to investigate whether the subscales provide important information over and above what can be determined from the sum score of FCV-19S.

The online version contains supplementary material available at https://doi.org/ 10.1007/s11469-020-00454-2.

Funding Open Access funding provided by Western Norway University Of Applied Sciences.

Conflict of Interest The authors declare that they have no conflict of interest.

The study was approved by the Norwegian Regional Committee for Ethics in Medical Research (REK 2020/131560). All participants provided informed consent by responding to the emailed survey, and confidentiality and the right to withdraw from the study were assured. The study complied with the ethical principles outlined in the Declaration of Helsinki.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

The fear of COVID-19 scale: development and initial validation

Psychometric evaluation of the Arabic version of the fear of COVID-19 scale

Guidelines for the process of cross-cultural adaptation of self-report measures

Fear of COVID-19 scale: psychometric characteristics, reliability and validity in the Israeli population

Confirmatory factor analysis for applied research

Psychometric testing of three COVID-19-related scales among people with mental illness

Factors related to preventive COVID-19 infection behaviors among people with mental illness

Internet-related behaviors and psychological distress among schoolchildren during COVID-19 school suspension

Estimating the stability of the number of factors via bootstrap Exploratory Graph Analysis: a tutorial

An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data

EGAnet: Exploratory Graph Analysis: a framework for estimating the number of dimensions in multivariate data using network psychometrics

Investigating the performance of Exploratory Graph Analysis and traditional techniques to identify the number of latent factors: a simulation and tutorial

Unidimensionality and the interpretability of psychological instruments

Functional fear predicts public health compliance in the COVID-19 pandemic

Psychiatric illness in family practice

Epidemiology of mental health problems in COVID-19: a review

Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives

Investigating mediated effects of fear of COVID-19 and COVID-19 misunderstanding in the association between problematic social media use and distress/insomnia

Defining the epidemiology of Covid-19 -Studies needed

Thanks coefficient alpha, we'll take it from here

Power and sensitivity of alternative fit indices in tests of measurement invariance

Los Angeles: Muthén & Muthén. Norwegian Institute of Public Health

Psychometric theory

Assessing the fear of COVID-19 among different populations: a response to Ransing et al. Brain, Behavior, and Immunity

Assessing the psychological response to the COVID-19: a response to Bitan et al. "fear of COVID-19 scale: Psychometric characteristics, reliability and validity in the Israeli population

Assessing psychological response to the COVID-19: the fear of COVID-19 scale and the COVID stress scales

R: a language and environment for statistical computing

R Foundation for Statistical Computing (n.d.). Vienna, Austria: R Foundation for Statistical, Computing. R Foundation for Statistical Computing

Can COVID-19 related mental health issues be measured? Brain, Behavior, and Immunity

Package 'psych

The Wiley handbook of psychometric testing: a multidisciplinary reference on survey, scale and test development

COVID-19 fear in Eastern Europe: validation of the fear of COVID-19 scale

lavaan: an R package for structural equation modeling

Psychometric validation of the Bangla fear of COVID-19 scale: confirmatory factor analysis and Rasch analysis

Adaptation of the fear of COVID-19 scale: its association with psychological distress and life satisfaction in Turkey

Don't forget the model in your model-based reliability coefficients: a reply to McNeish

Differential relationships of somatic and cognitive anxiety with measures of processing speed in older adults. Neuropsychology, development and cognition. Section B, Aging, neuropsychology and cognition

Validation and psychometric evaluation of the Italian version of the fear of COVID-19 scale

Measuring the mental health status of the Norwegian population: a comparison of/he instruments SCL-25, SCL-10, SCL-5 and MHl-5

Quality criteria were proposed for measurement properties of health status questionnaires

Psychometric properties of the Greek version of FCV-19S

Evaluation of the English version of the fear of COVID-19 scale and its relationship with behavior change and political beliefs

The impact of infectious disease-related public health emergencies on suicide, Suicidal Behavior, and Suicidal Thoughts