key: cord-1007275-k06j9t8r
authors: Vrdelja, Mitja; Vrbovšek, Sanja; Klopčič, Vito; Dadaczynski, Kevin; Okan, Orkan
title: Facing the Growing COVID-19 Infodemic: Digital Health Literacy and Information-Seeking Behaviour of University Students in Slovenia
date: 2021-08-12
journal: Int J Environ Res Public Health
DOI: 10.3390/ijerph18168507
sha: 0862f2c33d894b946e99a014c180af8ac4516862
doc_id: 1007275
cord_uid: k06j9t8r

The entire world is faced with the COVID-19 pandemic, which is also accompanied by an infodemic. This refers to the rapid spread of (accurate and false) information, mainly through internet usage increasing. Digital health literacy (DHL) is therefore important for addressing challenges related to online health information and services, as well as for navigation through the complex information landscape with huge amounts of different (and conflicting) information about COVID-19. The aim of this study is to examine the level of DHL in relation to COVID-19 in Slovenian university students and to determine online information-seeking behaviour in order to plan and prepare effective communication interventions for this sub-population. A cross-sectional survey, administered by an online questionnaire, was conducted to collect data on DHL. A total of 3621 students participated, of whom 70% were female and the average age was 22.65 years (SD = 4.65). Bivariate analyses were performed to assess the association of key characteristics with DHL. Overall, the results show that the level of DHL among students is sufficient. Most difficulties were reported in assessing the reliability of information (n = 1484, 49.3%). Approximately one third of the students (n = 847, 27.9%) reported having problems in finding information of their interest, and somewhat more (n = 900, 29.6%) reported difficulties in making a selection among all the information found. Students with a sufficient level of DHL are more likely to seek information through search engines and websites of official institutions, while students with a limited level of DHL more frequently reported using social media for health information searches. It is necessary to establish interventions for a systematic lift of the DHL and health literacy (HL) of all population groups.

The COVID-19 pandemic caused by the SARS-CoV-2 virus has profoundly impacted the whole world and has also significantly changed it [1] . Millions of people have been infected with the virus worldwide, many have been hospitalized due to the disease, and millions of people have died [2] . The consequences of the COVID-19 pandemic will be large and extensive throughout all areas [3] .

At the beginning of the pandemic, the World Health Organization (WHO) emphasized that along with the epidemic of an infectious disease comes an infodemic [4] . During the crisis, the information landscape has become (even more) complicated, and people are more often confronted with conflicting information resulting in a high level of uncertainty through complex information environments [5] . This may lead to people acting carelessly and apply the knowledge gained to address or solve a health problem [35] . According to Sørensen, DHL is essential for saving time, costs and lives [36] . Previous research has demonstrated that high levels of self-reported DHL are associated with better health and quality of health care; more positive health behaviours, including prevention and management of chronic diseases; and increased procedural health knowledge [37] . People with limited or insufficient DHL usually find it more difficult to comprehend health information [38] . Recent studies from Germany and Portugal demonstrated that even those people with satisfactory level of HL and DHL have difficulties in judging whether they can trust health information found online and on social media [30, 39] . There is a significant positive association between having sufficient levels of some subdimensions of DHL and the sources used for information search (e.g., website of public bodies) [40] .

Therefore, the development of HL is essential for empowering individuals to understand and use online information in an effective and health-promoting way [41] . As demonstrated, DHL directly and indirectly affects health. The direct relationship concerns DHL and health behaviours, such as healthy eating, exercise, and sleep [42, 43] . The indirect paths lead from DHL to information-seeking behaviour which has an effect on health (social media use is negatively associated with mental health) [44] . Due to the digital transformation in late modern society, DHL is becoming increasingly relevant for people to take health-related decisions [45] , especially in the time of the COVID-19 pandemic when numerous activities and services moved to the Internet. It is important to emphasize that people with higher DHL are less likely to be infected with COVID-19, and higher DHL is also associated with higher well-being and self-efficacy for pandemic-related stress [38] . At the same time, new technologies are constantly emerging that can make a significant contribution to strengthening DHL skills and improve health outcomes [46] . Today's young people are people born after the year 2000 [47] , who represent a generation that has grown up with new technology and have spent their lives surrounded by many digital tools that are an integral part of their lives [48] . As a result of this, today's students think and process information differently from their predecessors [49] . Many young adults use the internet as their primary source of health information, spend a large amount of time online, utilize more and different social media networks, and show trust in digital information [50] . A recent survey among Slovenian university students showed that they use the Internet for an average of 286 min a day during the week, which is slightly less than five hours a day, and on average 282 min a day during the weekend, which is only slightly less than on weekdays [51] . This is another reason why young people have better access to digital information compared to older population groups [52] , so based on their experience, it is not surprising that young people have higher DHL than other population groups [23] . More recent international studies showed that DHL among university students is welldeveloped, but there is still a significant proportion of students facing difficulties with some dimensions of HL [39, 40, 53] . Next to age, there are also other sociodemographic factors that are associated with students' DHL, such as socioeconomic status (SES) and gender. While there a clear tendency towards a higher frequency of limited DHL for individuals with lower SES [54] , the evidence related to gender differences of HL remain mixed, with some studies indicating a higher HL for women [55] [56] [57] [58] .

The aim of this article was to examine the level of COVID-19 related DHL in the Slovenian university student population. Further, we wanted to ascertain the level of DHL in relation to socio-demographic factors and to determine which online sources they use and how often, what is relevant regarding information, and how satisfied they are with the information they find. In addition, the study examined the differences between DHL and the use of different online sources, the perceived importance of different aspects of the information obtained and the satisfaction with the information found.

The study is a part of the COVID-HL Consortium, a network of more than 50 countries, which conducted a university students survey based on the same questionnaire, which will undergo international comparisons [59] . As far as we know, this is the first study of DHL among the university student population in Slovenia. This cross-sectional survey was conducted among Slovenian university students from 2 to 23 November 2020, when incidence and mortality rates increased substantially in Slovenia. During that time, the total number of confirmed cases of COVID-19 infections in Slovenia increased from 37,396 (2 November 2020) to 67,106 (23 November 2020), which means that the number of confirmed cases almost doubled during this time alone. The increase in the number of cases is seen in Figure 1 . According to the National Institute of Public Health, 765 people died of COVID-19 in Slovenia during this period and by the beginning of July 2021, a total of more than 4700 inhabitants of Slovenia had died, which is quite a lot considering the fact that Slovenia has 2 million inhabitants. 

The study is a part of the COVID-HL Consortium, a network of more than 50 countries, which conducted a university students survey based on the same questionnaire, which will undergo international comparisons [59] . As far as we know, this is the first study of DHL among the university student population in Slovenia. This cross-sectional survey was conducted among Slovenian university students from 2 to 23 November 2020, when incidence and mortality rates increased substantially in Slovenia. During that time, the total number of confirmed cases of COVID-19 infections in Slovenia increased from 37,396 (2 November 2020) to 67,106 (23 November 2020), which means that the number of confirmed cases almost doubled during this time alone. The increase in the number of cases is seen in Figure 1 . According to the National Institute of Public Health, 765 people died of COVID-19 in Slovenia during this period and by the beginning of July 2021, a total of more than 4700 inhabitants of Slovenia had died, which is quite a lot considering the fact that Slovenia has 2 million inhabitants. The questionnaire was delivered in the form of an online survey, designed with the 1KA or EnKlikAnketa (https://www.1ka.si/ accessed on 24th October 2020) online survey tool. A link to the survey was included in the invitation to participate. Before completing the survey, the respondents were informed about the aim of the survey, that their participation was voluntary and could be revoked without justification at any point, and that their confidentiality and anonymity were fully protected in the survey.

A non-probability sample was realized including a two-step invitation procedure; the first step included invitations to participate that were sent via e-mail to all faculties and colleges in Slovenia, including 16 colleges, 75 faculties, 9 independent higher education institutions and 2 postgraduate schools across Slovenia. All universities were asked to forward the invitation to their students by using internal communication channels (second step). The fact that the respondent was enrolled in one of the faculties or higher education institutions served as a criterion for inclusion in the sample for this study. Those who completed the survey but were not students were excluded. The questionnaire was delivered in the form of an online survey, designed with the 1KA or EnKlikAnketa (https://www.1ka.si/ accessed on 24 October 2020) online survey tool. A link to the survey was included in the invitation to participate. Before completing the survey, the respondents were informed about the aim of the survey, that their participation was voluntary and could be revoked without justification at any point, and that their confidentiality and anonymity were fully protected in the survey.

A non-probability sample was realized including a two-step invitation procedure; the first step included invitations to participate that were sent via e-mail to all faculties and colleges in Slovenia, including 16 colleges, 75 faculties, 9 independent higher education institutions and 2 postgraduate schools across Slovenia. All universities were asked to forward the invitation to their students by using internal communication channels (second step). The fact that the respondent was enrolled in one of the faculties or higher education institutions served as a criterion for inclusion in the sample for this study. Those who completed the survey but were not students were excluded.

After data cleaning and consistency checking, the final sample included 3621 respondents aged between 18 and 63 years, with an average age of 22.65 years (SD = 4.65). Based on a basic population of 71,957 university students in Slovenia (30 October 2020), this corresponds to 5%. Of these, 70.0% were women and 30.0% were men. Compared to the general population, male university students were slightly underrepresented in our sample (30% vs. 39.5%). The distribution of respondents by sociodemographic characteristics can be seen in Table 1 . More than half of the respondents were at the first (Bologna) level of study (56.1%) and almost two thirds reported a middle subjective social status (64.7%).

To allow cross-country comparisons, the same COVID-HL survey instrument was used across all participating countries. Necessary translations were made in accordance with standardized procedures suggested by WHO [60] .

For the purposes of this article, we collected data on the sociodemographic characteristics of the respondents (gender, age, current level of studies, and subjective social status (SSS)). Respondents were divided into four categories according to their age: (1) 20 years or less; (2) 21-23 years; (3) 24-26 years; and (4) 27 years or more.

In terms of study level, we divided students in three categories: (1) undergraduate study programme or first cycle Bologna degree; (2) master's programme or second cycle Bologna degree; and (3) doctoral study programme or third cycle Bologna degree.

Regarding subjective social status (SSS), students indicated their overall socioeconomic position through the translated MacArthur Scale [61] from 1 (lowest status) to 10 (highest status), where they would rank compared to other inhabitants of Slovenia. Based on the answers, three categories of SSS were defined: low SSS (1 to 4), middle SSS (5 to 7), and high SSS (8 to 10) [40] .

COVID-19-related DHL was determined using three subscales of the DHLI questionnaire (Digital Health Literacy Instrument, [37] ) which were adapted for COVID-19 and translated from English. We used the following subscales of the DHLI: (1) searching for COVID-19-related information online; (2) assessing the reliability of COVID-19-related information; and (3) determining the personal relevance of COVID-19-related information. Each subscale included three items, which could be answered on a scale from 1 ("Very difficult") to 4 ("Very easy"). The reliability of these three subscales, calculated using Cronbach's alpha, ranged between 0.77 and 0.79.

To assess the frequency of use of online sources when searching for COVID-19-related information, a question including ten sources was used (e.g., search engines, websites of official institutions, etc.). Frequency of use could be rated on a four-point scale from certain aspects (e.g., up-to-dateness, verification) of the information sought, a six-item question was used [62] . Response options ranged from 1 ("Not important at all") to 4 ("Very important"). One exemplary item is "How important is it for you that . . . the information is verified?"

A single item captured how satisfied the respondents were with the information about COVID-19 that they found online on a scale from 1 ("Very dissatisfied") to 5 ("Very satisfied").

In addition to univariate analyses (frequencies and descriptive statistics), we also performed bivariate analyses. To allow bivariate analysis, we dichotomized the DHL subscales based on a median split; those below or exactly at the median were classified into the group with 'limited' DHL, and those above the median into the group 'sufficient' DHL. In a final analytical step, DHL was stratified by frequency of the use of online sources, perceived importance of individual aspects of searched information, and satisfaction with the information found.

Using the chi-squared test, we then determined whether there are any differences between socio-demographic characteristics (gender, age, level of studies and SSS) and the two levels of all three DHLI subscales. Using t-tests, we also determined whether there are statistically significant differences between 'sufficient' and 'limited' DHLI groups in the frequency of use of online sources used for information search, and the perceived importance of individual aspects of the information sought or in satisfaction with the information found.

All analyses with p < 0.5 were considered statistically significant. However, since we had a relatively large sample, a particular association may prove to be statistically significant even though it has a negligible effect. Therefore, we also used Cramér's V (for the chi-squared test) or Cohen's d (for t tests) to calculate the size of the effect. For Cramér's V, the effect is small at ≥0.1, medium at ≥0.3, and large at ≥0.5 [63] . For Cohen's d, the following interpretation was used: ≥0.2 (small), ≥0.5 (medium), and ≥0.8 (large) [63] . For values below the threshold for small effects, we conclude that the difference (although significant) is practically negligible. Table 2 shows the frequencies of all items on DHL in connection with COVID-19. In summary, most difficulties can be found for the ability to assess the reliability of the information found, while the least difficulties are reported in the area of determining the personal relevance of health information. Respondents reporting difficulties (answered either "Very difficult" or "Difficult") in the dimension of "information search" range from 9.5% to 29.6%. The percentage of respondents reporting problems in the subscale of evaluating reliability ranges from 19.1% to 49.3%, while between 13.6% and 17.7% report difficulties in determining the personal relevance of the information retrieved.

The data showed that the DHL subdimension evaluation reliability is the most problematic for students, as the mean value for this dimension is 2.77 (SD 0.67), whereas the mean value for the subdimension information search is 3.0 (SD 0.56), and for the subdimension determining relevance it is 3.08 (SD 0.56), which makes it the highest across all subdimensions. Table 3 shows the distribution of limited versus sufficient DHL stratified for sociodemographic characteristics (gender, age, level of study, SSS) and the statistical characteristics of the relationship between each sociodemographic variable, and classification in a particular DHL group calculated using the chi-squared test. Note: Relevant effect sizes are highlighted in bold. χ 2 is chi-square, df are degrees of freedom, p is p-value, and V is Cramér's V.

Those with higher SSS reported significantly less difficulties on all three DHLI subscales. For the other three socio-demographic variables, significant differences occurred only on the subscales of information search and evaluating reliability. Females reported more difficulties, while older respondents and those with a more proficient study level reported less difficulties on these two subscales.

With most of the statistically significant differences, Cramér's V is less than 0.1, which means that they are trivial.

There were statistically significant and statistically relevant (as they reach the small effect size threshold) differences in gender, age, and level of studies on the subscale of assessing the reliability of information, with females reporting a slightly lower DHL (χ 2 = 52.42, p < 0.001, V = 0.13). However, with increasing age (χ 2 = 43.91, p < 0.001, V = 0.12) or level of study (χ 2 = 33.42, p < 0.001, V = 0.11), less difficulties in DHL on assessing the reliability of information are reported in our sample.

The difference in gender (χ 2 = 28.42, p < 0.001, V = 0.10) was also statistically significant, and relevant in the information search subscale were females again reporting a slightly lower DHL. assessing the reliability of information, with females reporting a slightly lower DHL (χ 2 = 52.42, p < 0.001, V = 0.13). However, with increasing age (χ 2 = 43.91, p < 0.001, V = 0.12) or level of study (χ 2 = 33.42, p < 0.001, V = 0.11), less difficulties in DHL on assessing the reliability of information are reported in our sample.

The difference in gender (χ 2 = 28.42, p < 0.001, V = 0.10) was also statistically significant, and relevant in the information search subscale were females again reporting a slightly lower DHL. Figures 2 and 3 show the proportions of the respondents' answers to questions regarding the frequency of use of online sources and the importance of individual aspects of the information sought. As shown in Figure 2 , respondents most often used search engines to search for COVID-19-related information (84.8%), followed by websites of public bodies, such as the National Institute of Public Health (NIJZ), the Ministry of Health of the Republic of Slovenia, the Government of the Republic of Slovenia (69.7%), and media portals (66.9%). In contrast, online consultation (6%), blogs on health topics (9.4%), and websites of doctors or health insurance companies (14.2%) were least frequently used.

As depicted in Figure 3 , almost all respondents (99.3%) perceived it as fairly and very important that the information is verified. In contrast, 18% of respondents attach no or only little importance to the issue that different opinions are presented in the information obtained.

Regarding the satisfaction with the information found on COVID-19 online, 4.1% reported that they were very dissatisfied and 9.0% were dissatisfied. Furthermore, almost half of the respondents (49.3%) reported that they were only partially satisfied with the information they find on COVID-19 online, 35.0% were satisfied and 2.6% were very satisfied with the information they find. Table 4 shows that respondents with sufficient DHL regarding information search As shown in Figure 2 , respondents most often used search engines to search for COVID-19-related information (84.8%), followed by websites of public bodies, such as the National Institute of Public Health (NIJZ), the Ministry of Health of the Republic of Slovenia, the Government of the Republic of Slovenia (69.7%), and media portals (66.9%). In contrast, online consultation (6%), blogs on health topics (9.4%), and websites of doctors or health insurance companies (14.2%) were least frequently used.

As depicted in Figure 3 , almost all respondents (99.3%) perceived it as fairly and very important that the information is verified. In contrast, 18% of respondents attach no or only little importance to the issue that different opinions are presented in the information obtained.

Regarding the satisfaction with the information found on COVID-19 online, 4.1% reported that they were very dissatisfied and 9.0% were dissatisfied. Furthermore, almost half of the respondents (49.3%) reported that they were only partially satisfied with the information they find on COVID-19 online, 35.0% were satisfied and 2.6% were very satisfied with the information they find. Table 4 shows that respondents with sufficient DHL regarding information search used search engines, websites of public bodies and Wikipedia significantly more frequently than respondents with limited DHL. In turn, those having a lower DHL used social media, blogs, web counselling services and health portals significantly more frequently. Respondents with sufficient DHL on this subscale deemed up-to-date, verified and comprehensively addressed information significantly more important than respondents with limited DHL, while the latter attached a higher importance to the fact that different opinions are presented. Respondents with sufficient DHL on the subscale of evaluating the reliability of health information used websites of public bodies and Wikipedia significantly more frequently, and deemed up-to-date information as significantly more important, than respondents with limited DHL on this subscale. The latter used social media, blogs, web counselling services and health portals significantly more frequently and deemed it significantly more important that different opinions are presented. Table 5 shows a similar pattern in the frequency of use of online sources, with respondents with limited DHL, regarding determination of the relevance of information, using social media, blogs, web counselling services and health portals significantly more frequently than respondents with sufficient DHL on this subscale. The latter used only websites of public bodies significantly more frequently, but they deemed up-to-date, verified, comprehensively addressed information and information that comes from official sources as significantly more important than respondents with limited DHL. In turn, university students with limited ability to determine personal relevance perceived the presentation of different opinions as significantly more important. Both Tables 4 and 5 show that respondents with sufficient DHL were significantly more satisfied with the information they find than their counterparts with limited DHL.

Even though the difference between the groups in frequency of the use of online sources, perceived importance of individual aspects of information searched, and satisfaction with the information found is statistically significant, the threshold for the small effect size (Cohen's d) is reached only in seven comparisons and consequently only these seven differences are considered as relevant.

Those with sufficient DHL on the subscale of information reliability used websites of public bodies (t = 6.51, p < 0.001, d = 0.24) and Wikipedia or other online encyclopedias (t =6.26, p < 0.001, d = 0.23) as a search resource significantly more often, and used social media (t = −6.89, p < 0.001, d = −0.25) significantly less often as a source of information than respondents with limited DHL. Those with sufficient DHL on the subscale for determining the adequacy of information also used the websites of public bodies (t = 6.41, p < 0.001, d = 0.24) more often than respondents with limited DHL.

Small effect sizes were also found for information satisfaction on all three DHL subscales, information search (t = 12.58, p < 0.001, d = 0.48), evaluating information reliability (t = 12.46, p < 0.001, d = 0.46) and determining relevance of information (t = 10.23, p < 0.001, d = 0.39). On the subscale of information search, the Cohen's d coefficient narrowly misses the threshold for a medium effect size. In all three subscales, those in the sufficient DHL group are more satisfied with the information they find.

The cross-sectional study contributes to the literature on DHL in general, and provides valuable insights into COVID-19-related DHL among Slovenian university students and their online information-seeking behaviour. The study findings are also important with regard to possible interventions designed to prevent and curb the spread of the coronavirus. In general, the results indicate that DHL levels among students are sufficient. Of all the DHL questions used, the percentage of respondents reporting no difficulties fell below 70% on only two questions (both within the reliability assessment subscale), which is similar to some other studies [12, 41, 51] . Given that higher DHL is associated with higher well-being and self-efficacy for pandemic-related stress [53] , this finding is promising. At the same time, people with higher DHL are less likely to be infected with COVID-19 [53] , while other studies also show that students are clearly very confident that they are able and skilled enough to navigate through the digital health information landscape [23] .

The Internet provides constant access to all types of (accurate and false) information from various sources, with individuals having, to some extent, autonomous, independent, anonymous, and free access to health information. Although the information is very easily accessible, the question arises as to how to find high quality information and how to navigate through the information complexity. It is an interesting paradox. Our research results showed that about a third of the surveyed Slovenian students (847 students or 27.9%) have difficulties in finding the information they are interested in, and a slightly higher percentage (900 students or 29.6%) find it difficult to choose from all the information they find. This points to the fact that there is a great deal of information about the coronavirus and that even young people have difficulties assessing it, although they are very experienced at using digital media [64, 65] . This is also confirmed by the finding that as many as half of our respondents (1484 students or 49.3%) have difficulties assessing the reliability of information, which is seven percent more than found in the German COVID-HL survey (42.3%) [37] , which means that this is the most difficult task. Concerning the use of the information obtained, a high level of DHL is shown; 85.4% of respondents reported not having problems assessing whether the information is useful to them, 82.4% reported having no problems in using information in everyday life, and 86.4% reported using it to make decisions about their own health. Based on these findings, we consider that there is a need for the establishment of a national website managed by a professional institution (these usually have a higher level of trust than governmental institutions), which would be a uniform online information platform. In order to avoid a lengthy process of validating and reviewing the various issues that need to be communicated in a timely manner in a crisis situation such as COVID-19 pandemic, it would make sense to form a cross-sectional group of experts. It would prepare various information to communicate on a uniform website and also on social media, where a strategic communication approach is needed, based on timely proactive communication and rapid reactive communication in order to address the issue of dis-/misinformation that often arises on social media. WHO, other EU organizations and governments established information portals, dedicated to the dissemination of COVID-19 information to increase HL among different population groups (such as covid19.who.int, cdc.gov, ecdc.europa.eu, www.government.nl/topics/ coronavirus-covid-19, www.santepubliquefrance.fr/dossiers/coronavirus-covid-19 etc all accessed on 24 July 2021). These could mitigate some of the DHL-related problems in different population groups, both among students and also the general population. In Slovenia, a national website for COVID-19 vaccination was established (www.cepimose.se accessed on 24 July 2021) and is edited by the National Institute of Public Health. The website has (with intensive communication) become very known and is being frequently visited (according to Google analytics, from 1st of February to 26th of July, the website had 1.08 million views and more than 253,000 users).

Therefore, communication could be the key. The authorities should provide information in a comprehensible way, recognizing that people and groups with low HL may need more explanation and different communication formats, such as animations, to explain the virus, the disease, its transmission and protective measures [65] . There is also a need for increased public health communication and online engagement through existing channels [66] . Targeted communication is also important for better navigation of information environments during the infodemic, identification of mis/dis-information, and decision-making based on reliable and trustworthy information [30] . In any case, an open and transparent communication can be crucial in all of this; namely, it can strengthen trust in official information sources, because without trust it is not possible to communicate effectively and efficiently.

Regarding the sources of information about the novel coronavirus, we found that students with sufficient DHL (specifically with regard to the reliability subscale) use websites of official institutions and search engines (e.g., Google) more frequently, while students with limited abilities to critically assess online health information are more likely to search for information through social media [67] . Studying how people behave online, how and what information they search for, how they navigate the web and the mess of COVID-19-related (mis/dis)information are valuable insights into an individual's healthrelated behaviour [13] . It is crucial to know the individuals' communication behaviours [68] , especially among the young adults who often use digital platforms. Therefore, critical HL has never been more important than in these times of pandemic, when we are witnessing a large surplus of information and high expectations regarding (self-)control over health [29] . This particularly points toward the need to address this dimension of HL in a more focused manner and earlier on in schools by, e.g., training pupils in how to critically analyze information and sources, critically read health messages, news and claims, etc.

Our research further finds that the level of information satisfaction is significantly higher in university students with sufficient DHL. The results of our study are similar to the COVID-HL survey in Pakistan, where the majority of students were satisfied or partly satisfied with information regarding the coronavirus [53] . There are probably a number of reasons for this. One reason could be that those with higher DHL are more able to search, understand, assess and use the information they are looking for, and that they are also more persistent in finding correct and reliable information and are not satisfied with just the first information they encounter (and not evaluating the source).The reasons can also be related to the perceived benefits, the costs and the user (past) experience [69] . This also raises calls for further research to understand predictors not only of information search, but also of information satisfaction.

In addition, given that university students are among the more educated and more skilled users of digital platforms, the question arises about the DHL levels of other population groups that are less educated and more vulnerable. Given the importance (digital) HL has for preventive behaviour and also for vaccination-related attitudes and behaviours, interventions that aim to improve HL could make an important contribution to overcome the pandemic as soon as possible.

To our knowledge, this is the first study investigating DHL and aspects of online information-seeking behaviour of university students in Slovenia. However, our study also has certain limitations. The main limitation of the study is that no statistical analysis was performed to find out any correlation between DHL and the ability to find correct and high-quality information and trust in information sources. Because of this, we cannot be certain if the subscales of DHL adequately represent an individual's actual digital HL or just their subjective assessment of it. Second, in our study we focused mainly on the sources used for information search, and further empirical research should take into account more dimensions of information-seeking behavior such as attitudes, social norms or usability [70, 71] . Third, we did not have probability sampling, nor did we weight the sample, which means that the sample is not representative of the student population in Slovenia. Since the study was conducted at the beginning of the new academic year and lasted only three weeks, it is quite possible that it did not include those most affected by the pandemic and who may have even had to stop their studies in the previous academic year. We also relied on the management of university faculties to provide the students with the questionnaire. Universities differed in their approach to this inquiry, so there may have been differences in reach here as well. As the questionnaire was only available in an online format, we may have excluded those with lower access to digital devices or digital literacy and are probably also the members of the most vulnerable groups. Another limitation may be that, according to their results on individual subscales, we divided individuals into two groups ('limited' and 'sufficient') by means of median split. This procedure is based solely on an artificial division of the sample and results in loss of information, including the risk that individuals with similar mean values are divided into two different categories.

The study represents an important implication for planning communication interventions for the student population in Slovenia-from the current COVID-19 perspective, as well as for other public health activities in the future. The study shows that a proportion of Slovenian university students have difficulties in finding and making the selection of health information. They also have problems with assessing the reliability of information. Therefore, there is a specific need for interventions that promote the skills that allow critical finding and evaluation of health information retrieved online. In this context, the specific needs of female and younger university students, as well as those with lower SSS, should be taken into account. We suggest that facing the infodemic should become an important public health priority in the future, because it will not cease to exist with the end of COVID-19 pandemic. Additionally, public health activities should not only focus on the individual abilities, but interventions should also focus on information providers and technical solutions to identify misleading health information. From the perspective of the first "infodemiologist", there are four pillars of infodemic management: (1) information monitoring; (2) building eHealth literacy and science literacy capacity; (3) encouraging knowledge refinement and quality improvement processes, such as fact-checking and peer-review; and (4) accurate and timely knowledge translation, minimizing distorting factors such as political or commercial influences [72] . 

The SARS-CoV-2 pandemic: A syndemic perspective

Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: A retrospective cohort study

Using social and behavioural science to support COVID-19 pandemic response

How to fight an infodemic

How threat perceptions relate to learning and conspiracy beliefs about COVID-19: Evidence from a panel study

COVID-19 pandemic, infodemic and the role of eHealth literacy Community

Planning for a COVID-19 Vaccination Program

Fighting fake news in the COVID-19 era: Policy insights from an equilibrium model from an equilibrium model

Saint-Lary, O. Mandatory vaccination of infants in France: Is that the way forward?

From mandatory to voluntary vaccination: Intention to vaccinate in the case of policy changes

Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: A systematic review of published literature

Vaccine Hesitancy, Acceptance, and Anti-Vaccination: Trends and Future Prospects for Public Health

Infodemiology and Infoveillance: Tracking Online Health Information and Cyberbehavior for Public Health

Infodemics and infodemiology: A short history, a long future

The Determinants of Conspiracy Beliefs Related to the COVID-19 Pandemic in a Nationally Representative Sample of Internet Users

Thought I'd Share First": An Analysis of COVID-19 Conspiracy Theories and Misinformation Spread on Twitter

Medical disinformation and the unviable nature of COVID-19 conspiracy theories

Infodemiology: The Epidemiology of (Mis)information

Dealing With the COVID-19 Infodemic: Distress by Information, Information Avoidance, and Compliance With Preventive Measures. Front

The "Pandemic" of Disinformation in COVID-19. SN Compr

COVID-19: Health literacy is an underestimated problem

Health Literacy, Digital Health Literacy, and COVID-19 Pandemic Attitudes and Behaviors in U. S. College Students: Implications for Interventions

COVID-19: The key to flattening the curve is health literacy

Health literacy in Europe: Comparative results of the European health literacy survey (HLS-EU)

The Neglected European Public Health Disparity

People with Suspected COVID-19 Symptoms Were More Likely Depressed and Had Lower Health-Related Quality of Life: The Potential Benefit of Health Literacy

The enigma of health literacy and COVID-19 pandemic

Critical health literacy and the COVID-19 crisis

Coronavirus-Related Health Literacy: A Cross-Sectional Study in Adults during the COVID-19 Infodemic in Germany

Views of People With High and Low Levels of Health Literacy About a Digital Intervention to Promote Physical Activity for Diabetes: A Qualitative Study in Five Countries

How is health literacy addressed in primary care? Strategies that general practitioners use to support patients

Understanding and Responding to Health Literacy as a Social Determinant of Health

Disparities in COVID-19 related knowledge, attitudes, beliefs and behaviours by health literacy

The eHealth Literacy Scale

Covid-19: Digital Health Literacy Is a Key to Saving Time, Costs and Lives

Development of the Digital Health Literacy Instrument: Measuring a Broad Spectrum of Health 1.0 and Health 2.0 Skills

Designing Digital Health Information in a Health Literacy Context; University of Amsterdam

Associations between COVID-19-Related Digital Health Literacy and Online Information-Seeking Behavior among Portuguese University Students

Digital Health Literacy and Web-Based Information-Seeking Behaviors of University Students in Germany During the COVID-19 Pandemic: Cross-sectional Survey Study

IC-Health Project: Development of MOOCs to Promote Digital Health Literacy: First Results and Future Challenges

The Effect of Individual Factors on Health Behaviors Among College Students: The Mediating Effects of eHealth Literacy

Association Between Health Literacy, eHealth Literacy, and Health Outcomes Among Patients With Long-Term Conditions

Mental health problems and social media exposure during COVID-19 outbreak

The Health Literacy Skills Framework

Technology approaches to digital health literacy

Working with generations X and Y In generation Z period: Management of different generations in business life

Information technology and Gen Z: The role of teachers, the internet, and technology in the education of young people

Mobile technology and generation Z in the English language classroom-A preliminary study

eHealth Literacy and Health Behaviors Affecting Modern College Students: A Pilot Study of Issues Identified by the American College

Raziskava o Doživljanju Epidemije COVID-19 Med Študenti; Nacionalni inštitut za javno zdravje

Sense of coherence mediates the relationship between digital health literacy and anxiety about the future in aging population during the COVID-19 pandemic: A path analysis

COVID-19 and Health Information Seeking Behavior: Digital Health Literacy Survey amongst University Students in Pakistan

Digital Health Literacy and Health-Related Well-Being Amid the COVID-19 Pandemic: The Role of Socioeconomic Status Among University Students in Hong Kong and Macao

Health Literacy among Health and Social Care University Students

Exploring Health Literacy Profiles of Texas University Students

Magrinyà-rull, P. Determinants of health literacy in the general population: Results of the Catalan health survey

Health literacy: Exploring disparities among college students

COVID-19 Health Literacy Survey: University Students (COVID-HL-Survey). Questionnaire and Scale Documentation

Process of Translation and Adaptation of Instruments

The MacArthur Scale of Subjective Social Status

Informations und engagementsbezogenes Medienhandeln von Jugendlichen [Information and engagement related media activities of young people

Jugendliche und Die Aneignung Politischer Informationen in Online-Medien [Young People and the Acquistion of Political

Statistical Power Analysis for the Behavioral Sciences

Beyond the 'digital natives' debate: Towards a more nuanced understanding of students' technology experiences

Why health promotion matters to the COVID-19 pandemic, and vice versa

Assessment of COVID-19 Knowledge Among University Students: Implications for Future Risk Communication Strategies

The evolving concept of health literacy

Problem Solving and Communicative Action: A Situational Theory of Problem Solving

Determinants of online information search: A critical review and assessment

PRISM: A Planned Risk Information Seeking Model

Usability of Health Information Websites Designed for Adolescents: Systematic Review, Neurodevelopmental Model, and Design Brief

How to Fight an Infodemic: The Four Pillars of Infodemic Management

Informed Consent Statement: Informed consent was obtained from all subjects involved in the study. Data Availability Statement: Data will be made available upon request.

The authors declare no conflict of interest.