key: cord-269969-xl1ooxoj
authors: Duong, Tuyen Van; Pham, Khue M.; Do, Binh N.; Kim, Giang B.; Dam, Hoa T. B.; Le, Vinh-Tuyen T.; Nguyen, Thao T. P.; Nguyen, Hiep T.; Nguyen, Trung T.; Le, Thuy T.; Do, Hien T. T.; Yang, Shwu-Huey
title: Digital Healthy Diet Literacy and Self-Perceived Eating Behavior Change during COVID-19 Pandemic among Undergraduate Nursing and Medical Students: A Rapid Online Survey
date: 2020-09-30
journal: Int J Environ Res Public Health
DOI: 10.3390/ijerph17197185
sha: 
doc_id: 269969
cord_uid: xl1ooxoj

Assessing healthy diet literacy and eating behaviors is critical for identifying appropriate public health responses to the COVID-19 pandemic. We examined the psychometric properties of digital healthy diet literacy (DDL) and its association with eating behavior changes during the COVID-19 pandemic among nursing and medical students. We conducted a cross-sectional study from 7 April to 31 May 2020 at 10 public universities in Vietnam, in which 7616 undergraduate students aged 19–27 completed an online survey to assess socio-demographics, clinical parameters, health literacy (HL), DDL, and health-related behaviors. Four items of the DDL scale loaded on one component explained 71.32%, 67.12%, and 72.47% of the scale variances for the overall sample, nursing, and medical students, respectively. The DDL scale was found to have satisfactory item-scale convergent validity and criterion validity, high internal consistency reliability, and no floor or ceiling effect. Of all, 42.8% of students reported healthier eating behavior during the pandemic. A 10-index score increment of DDL was associated with 18%, 23%, and 17% increased likelihood of healthier eating behavior during the pandemic for the overall sample (OR, 1.18; 95%CI, 1.13, 1.24; p < 0.001), nursing students (OR, 1.23; 95%CI, 1.10, 1.35; p < 0.001), and medical students (OR, 1.17; 95%CI, 1.11, 1.24; p < 0.001), respectively. The DDL scale is a valid and reliable tool for the quick assessment of digital healthy diet literacy. Students with higher DDL scores had a higher likelihood of healthier eating behavior during the pandemic.

The unprecedented coronavirus disease (COVID-19) pandemic has created vast socioeconomic burdens [1] , morbidity, and mortality [2, 3] . The pandemic has also changed eating behaviors for the worse [4] [5] [6] [7] . To deal with this challenge, the USA National Institute of Health Nutrition Research Task Force developed a 2020-2030 strategic plan to improve health and prevent or combat diseases and conditions that have been affected by food and nutrition [8] .

Healthy dietary intake has shown protective effects on the immune systems and health outcomes during the COVID-19 crisis [9, 10] . There are no data available, and rigorous clinical trials conducted to elaborate and confirm the benefits of a healthy diet in the current COVID-19 pandemic. Diversified and balanced diets improve the immune response to viral infection (e.g., SARS-CoV-2) [11] , helping to reduce the severity [12] and any complications of COVID-19 [13] . Yet, unhealthy eating behaviors rapidly increased worldwide [14, 15] , including in Vietnam [16] . In ASEAN countries, the proportions of disordered eating attitudes among university students were 10%-20.6% [17] .

The COVID-19 pandemic has also caused an "infodemic" of diverse information and sources [18, 19] . Health literacy [20] and eHealth literacy [21] are highly recommended as strategic approaches to contain the pandemic. Nursing and medical students were mobilized to respond to the global health crisis [22] [23] [24] [25] , and because these future health workers can help combat misinformation and disinformation [26, 27] , their digital literacy should be promoted [28, 29] .

It is critical to promote healthy dietary behaviors to improve health outcomes [30] and contain the COVID-19 disease and its consequences [31] [32] [33] . The assessments of eating behaviors and nutritional status are critical to identifying comprehensive approaches for managing COVID-19 [34] and suggesting sustainable food intake [35] . To identify behavior changes and develop strategies to improve students' eating behaviors, their ability to access, understand, appraise, and apply the healthy diet information on the internet during the pandemic requires a short, valid, and reliable survey tool.

We examined the psychometric properties of an expanded digital healthy diet literacy (DDL) domain of health literacy to investigate associations between DDL and eating behavior changes during the COVID-19 pandemic among nursing and medical students at 10 public universities in Vietnam.

We conducted a cross-sectional online survey from 7 April to 31 May 2020. Participants from 10 universities across Vietnam were recruited, including those from six universities in the nation's north, two in the south, and two in the country's central region. The study settings were all public universities that train and provide the nation's healthcare workforce.

Undergraduate medical and nursing students were invited as they are the medical university's major focus and the country's future healthcare providers. The data collection procedure was similar to a previous study [36] . In brief, researchers as university lecturers invited students to voluntarily participate, and there were no direct benefits or compensations for participating in the survey. Lecturers sent the survey link to student leaders via email, Messenger, and Zalo. The student leaders sent the link to other students. The online consent forms were signed before taking the survey. Students filled in the form with their name and phone number to avoid duplications, while data were coded and analyzed confidentially.

A total sample of 7616 students (out of 32,632 possible participants) aged 21 to 27 years completed the survey. The studied and possible students at each university are listed in Table 1 . 

Students reported sociodemographic information, including age, gender, academic year (1 to 6 for the medical field, 1 to 4 for nursing field), academic field (medical vs. nursing), and ability to pay for medication (very or fairly difficult vs. very or fairly easy). Clinical parameters were assessed including self-reported body height (cm) and weight (kg). Body mass index (BMI, kg/m 2 ) was also calculated. Students also reported health problems that resembled symptoms of COVID-19, which were recorded as suspected COVID-19 symptoms (S-COVID-19-S) [37] . These included common symptoms of fever, cough, and dyspnea along with less common symptoms of myalgia, fatigue, sputum production, confusion, headache, sore throat, rhinorrhea, chest pain, hemoptysis, diarrhea, and nausea/vomiting. If students had any of those symptoms, they were classified as having S-COVID-19-S or symptoms like COVID-19. Chronic health problems were assessed using Charlson comorbidity index items [38, 39] .

Health literacy (HL) was evaluated using a 12-item short-form health literacy questionnaire (HLS-SF12) that has been widely used in Asian countries [40] , including in Vietnam [41] [42] [43] . The HLS-SF12 questionnaire was used to measure comprehensive health literacy, including four stages of information processing (e.g., accessing, understanding, appraising, and applying), and three domains of health (e.g., health care, disease prevention, and health promotion) [44, 45] .

During the COVID-19 pandemic, digital healthy diet literacy (DDL) guides people towards healthier eating behaviors that can improve immune resistance [9, 10] . Therefore, as an expanded concept of health literacy, DDL refers to the ability to access, understand, judge, and apply digital healthy-diet-related information to improve healthy eating behavior and health outcomes that are critical to contain the pandemic. We adapted the HL conceptual framework and expanded a DDL domain by adding four more items to assess the information processing ability, including the ability to (1) . . . find reliable and accurate healthy diet information on the internet, (2) . . . understand healthy diet information and dietary guidelines on the internet, (3) . . . judge whether healthy diet information on the internet is applied for individuals, and (4) . . . apply healthy diet information from the internet into individuals' daily lives to eat healthily.

Participants reported difficulty in performing each task item based on 4-point Likert scales from 1 = very difficult to 2 = fairly difficult, 3 = fairly easy, and 4 = very easy. The HL and DDL indices were standardized to a unified metric from 0 to 50 with higher scores representing better HL or DDL [46] using Formula (1):

where Index is the specific index calculated, Mean is the mean of all participating items for each individual, 1 is the minimal possible value of the mean (leading to a minimum value of the index of 0), 3 is the range of the mean, and 50 is the chosen maximum value. Both HLS-SF12 and DDL are subjective measures.

Students reported their current health-related behaviors compared with before the pandemic [36] . We did not assess the actual dietary intake or eating habits in this study. Students simply self-reported the perception of eating behaviors. Students rated their eating behavior as less healthy, unchanged, and healthier. They also ranked their smoking, drinking, and physical activity on a scale ranging from never to stopped, less, unchanged, and more. During the pandemic, healthier eating, continued or additional physical activity, and decreases in or the cessation of both smoking and drinking are crucial, along with the risk management strategies of hand-washing, mask-wearing, and social distancing [31] . On the one hand, we did not investigate whether the "unchanged" eating behavior during the pandemic was considered "unhealthy" or "healthy" behavior. On the other hand, in health promotion, people are suggested to comply with healthy behaviors on every basis. These healthy behaviors are even more important during the pandemic; people should have healthier eating behaviors that can improve immune function and prevent viral infection. Therefore, we aimed to compare the "healthier diet" and other behavioral categories, including "unchanged" and "less healthy". Similarly, because physical activity and cessation/reduction of smoking/drinking are suggested, "never, stopped, or less" were grouped into one category, and "unchanged or more" was another category. "Healthier diet" and "unchanged or more physical activity" were positive behaviors; "unchanged or more" smoking or drinking were negative behaviors.

The study was reviewed and approved by the Institutional Ethical Review Committee of Hanoi University of Public Health, Vietnam (IRB No. 133/2020/YTCC-HD3). Students voluntarily took the survey.

Principal component analysis (PCA) with the oblique rotation (Promax) method was utilized to assess the construct of the DDL scale. Correlations between the DDL scale and its four items were estimated using Spearman's correlation test which provided evidence of item-scale convergent validity. In addition, the correlation between DDL and HLS-SF12 was estimated using the Pearson correlation test that provides evidence of criterion validity [47] . Cronbach's alpha test was used to check the internal consistency of the DDL scale. The floor and ceiling effects of the DDL scale were assessed by calculating percentages of the possibly lowest and highest DDL index scores.

The frequency of eating behaviors (less healthy/unchanged vs. healthier) in different categories of socio-demographics, clinical parameters, and other health-related behaviors were explored using a Chi-square test. In addition, a one-way ANOVA test was used to check the distribution of HL and DDL scales by two categories of eating behavior. Multivariable logistic regression models were used to assess the associations of HL and DDL along with eating behavior change. Adjusted variables in the multivariable model were those demonstrating the associations with eating behavior change at p < 0.20 in the univariable analysis [48] . In order to exclude colliders which may cause multicollinearity, Spearman's correlation test was used to check correlations between them. If the case of a moderate or high correlation, a representative variable was selected in the multivariable analysis.

Data analysis was conducted using IBM SPSS Version 20.0 for Windows (IBM Corp., Armonk, NY, USA). p < 0.05 was set for statistical significance.

The mean age was 21.4 ± 1.8 years. Out of all ages, 37.5% were men, 60.1% were 3rd-6th-year students, 75.7% were medical students, and 51.8% reported the ability to pay for medications at a very easy or fairly easy level. Of the study sample, 20.8% were underweight, 6.5% were overweight or obese, 19.2% reported S-COVID-19-S, and 4.4% reported one or more chronic health problems. In all, 2.9%, 6.3%, and 69.7% of students reported "unchanged or more" smoking, drinking, and physical activity during the pandemic as compared to that before the pandemic, respectively. During the pandemic, 42.8% of students reported healthier eating behavior compared to before the pandemic. Means of HL and DDL scores were 34.4 ± 6.9 and 33.9 ± 8.5, respectively (Table 2 ). HL index, mean ± SD 34.4 ± 6.9 34.0 ± 6.9 34.9 ± 6.9 <0.001 34.4 ± 6.9 34.0 ± 6.9 34.9 ± 6.9 <0.001 34.4 ± 6.9 34.0 ± 6.9 34.9 ± 6.9 < 0.001 DDL index, mean ± SD 33.9 ± 8.5 33 * Result of one-way ANOVA test or Chi-square test appropriately. ** Suspected COVID-19 symptoms included common symptoms (fever, cough, dyspnea) and less common symptoms (myalgia, fatigue, sputum production, confusion, headache, sore throat, rhinorrhea, chest pain, hemoptysis, diarrhea, and nausea/vomiting).

The Kaiser-Meyer-Olkin values (KMO) for the whole scale of the overall sample, nursing, and medical students were 0.78, 0.77, and 0.79, respectively. In addition, ranges of KMO values for individual items of the overall sample, nursing, and medical students were 0.75-0.83, 0.74-0.81, and 0.75-0.83, respectively. These values were higher than 0.6, which was set for measuring the sampling adequacy [49] . Furthermore, Bartlett's Test of Sphericity values of the overall sample, nursing, and medical students were less than 0.05 which indicated data suitability for the PCA [49] .

Four items were strongly loaded on a single component and explained 71.32%, 67.12%, and 72.47% of the scale variance in the overall sample, nursing, and medical students, respectively ( Table 3) . Ranges of correlations between the DDL scale and its four items were 0.80-0.83, 0.76-0.80, and 0.81-0.84 for the overall sample, nursing, and medical students, respectively. This provides adequate evidence of the item-scale convergent validity [50] . The DDL correlated with HL at a rho value of 0.68 for all, which provided satisfactory evidence of the criterion's validity [47] . Table 3 . Construct, convergent, criterion validity, internal consistency, floor, and ceiling effects of digital healthy diet literacy scale (N = 7616). Cronbach's alpha values of the DDL scale for the overall sample, nursing, and medical students were 0.86, 0.83, and 0.87, respectively, which were larger than 0.70, indicating the satisfactory reliability [51] . Percentages of the lowest and highest score in the overall sample (0.20% and 12.00%), nursing students (0.30% and 7.90%), and medical students (0.20% and 13.30%) were smaller than 15% which were reflected no floor and ceiling effects [52] .

Age highly correlated with the academic year (rho = 0.95), gender moderately correlated with the academic field (rho = 0.36), and smoking moderately correlated with drinking (rho = 0.50; Table S1 ). Therefore, age, gender, and drinking were selected with medical payment ability, BMI, chronic health conditions, and physical activity for the overall sample; with BMI, and physical activity for the sample of nursing students; and with medical payment ability, chronic health conditions, and physical activities for the sample of medical students in the multivariable analysis. After adjusting for these mentioned confounders, a 10-score increment of HL and DDL indices were associated with the increased likelihood of healthier eating behavior of 23% and 18% for the overall sample, 24% and 23% for the sample of nursing students, and 23% and 17% for the sample of medical students (Table 4 ). 

The current study shows the digital healthy diet literacy (DDL) scale is a brief, valid, and reliable tool with satisfactory construct, criterion, and convergent validity, with a high level of internal consistency reliability, and with no floor or ceiling effect. The psychometric properties of the expanded DDL domain of HL were similar to the HLS-SF12 scale [40, 41, 53] and e-healthy diet literacy (e-HDL) scale [54] . Moreover, the performance of the DDL scale was similar in medical and nursing students. In a previous study, the e-HDL scale was developed with inconsistent response options for eleven survey questions. The number of questions was not equally distributed in different subscales [54] . Therefore, a shorter DDL questionnaire with the same concept and response options of the original health literacy that is needed for research and practice [44, 45] .

In this study, our findings illustrate that higher scores of health literacy and digital healthy diet literacy were positively associated with healthier eating behavior during the pandemic for both nursing and medical students. College students with higher eHealth literacy engaged better in positive health-promoting behaviors [29, 55] . A previous study also showed that higher e-HDL scores were associated with better health status and health-related behaviors in the general population in Taiwan [54] . In addition, food literacy was found to be associated with healthier food consumption in the public in the Netherlands [56] and Canada [57] . In university settings, it is strategic to create opportunities (e.g., academic courses, media, and the internet) and motivators (e.g., social responsibility, and personal development) for students to develop food literacy and apply them in improving healthy eating behaviors and health outcomes [58] . Digital healthy diet literacy should be emphasized and taken into account for better decision making and health outcomes [59] .

Medical school students play important roles in responding to the pandemic [22, 23, 60] and can promote healthy behaviors (e.g., healthy eating, preventive behaviors) to their peers, communities, and patients using social media or other available modalities [61, 62] . Improving digital literacy focusing on a healthy diet for nursing and medical students is a strategic approach [28, 29] that can influence public behavior in positive ways.

We conducted an online cross-sectional study in which the findings cannot be interpreted as causal relationships. The category of "unchanged" eating behavior during the pandemic does not distinguish "unhealthy" from "healthy" behaviors that may potentially bias the analysis. In addition, we did not use questions about actual nutritional habits or behaviors and diet. The actual dietary intake was not assessed in the current study. Future studies are suggested to recruit questionnaires investigating dietary intake, such as a food frequency questionnaire or a 24 h food record form. Another limitation was that respondents were not informed about the meaning of "healthy eating behaviors" that may cause reporting bias and potentially affect the association between DDL and eating behaviors. Furthermore, the test-retest reliability of the DDL scale was not evaluated. However, the findings from the large sample analysis can possibly be generated to nursing and medical students. Despite the limitations, the online survey is suggested in conducting the study with fewer resources required and providing timely evidence for research and practice, further contributing to COVID-19 containment. Future studies are suggested to compare DDL, eating behaviors, and their association in students with those in general populations and healthcare workers. A longitudinal design is recommended to assess the long-term effect and causality.

The digital healthy diet literacy scale with four items (DDL-4) was an extended domain of a comprehensive health literacy framework. This scale was found to be a valid and reliable tool for the quick assessment of students' ability to access, understand, appraise, and apply healthy diet information found on the internet. Nursing and medical students with higher HL or DDL scores had a higher likelihood of healthier eating behavior. The findings of our study provide a brief, valid, and reliable tool for research and practice during and after the COVID-19 pandemic. Funding: This work was supported by the Taipei Medical University (108-6202-008-112; 108-3805-022-400).

We would like to thank all experts, research assistants, and students who participated in the study.

The authors declare no conflict of interest. 

The socio-economic implications of the coronavirus pandemic (COVID-19): A review

Global, regional, and national estimates of the population at increased risk of severe COVID-19 due to underlying health conditions in 2020: A modelling study

Estimating excess 1-year mortality associated with the COVID-19 pandemic according to underlying conditions and age: A population-based cohort study

Eating habits and lifestyle changes during COVID-19 lockdown: An Italian survey

Effects of COVID-19 Home Confinement on Eating Behaviour and Physical Activity: Results of the ECLB-COVID19 International Online Survey

Dietary Choices and Habits during COVID-19 Lockdown: Experience from Poland

Changes in Dietary Behaviours during the COVID-19 Outbreak Confinement in the Spanish COVIDiet Study

US Department of Health & Human Services; National Institutes of Health. 2020-2030 Strategic Plan for NIH Nutrition Research: A Report of the NIH Nutrition Research Task Force

Strengthening the Immune System and Reducing Inflammation and Oxidative Stress through Diet and Nutrition: Considerations during the COVID-19 Crisis

Optimal Nutritional Status for a Well-Functioning Immune System Is an Important Factor to Protect against Viral Infections

Nutritional status, diet and viral respiratory infections: Perspectives for SARS-CoV-2

Metabolic Impacts of Confinement during the COVID-19 Pandemic Due to Modified Diet and Physical Activity Habits

The impact of nutrition on COVID-19 susceptibility and long-term consequences

The rise of eating disorders in Asia: A review

Health effects of dietary risks in 195 countries, 1990-2017: A systematic analysis for the Global Burden of Disease Study

Non-communicable diseases, food and nutrition in Vietnam from 1975 to 2015: The burden and national response

Risk of disordered eating attitudes and its relation to mental health among university students in ASEAN

Infodemic" and Emerging Issues through a Data Lens: The Case of China

Coronavirus-Related Health Literacy: A Cross-Sectional Study in Adults during the COVID-19 Infodemic in Germany

COVID-19: Health literacy is an underestimated problem

COVID-19 pandemic, infodemic and the role of eHealth literacy

A Bold Response to the COVID-19 Pandemic: Medical Students, National Service, and Public Health

Medical student involvement in the COVID-19 response

WAB team instead of SWAT team -students as front-line force during the COVID-19 Pandemic

Medical students for health-care staff shortages during the COVID-19 pandemic

Top Concerns of Tweeters During the COVID-19 Pandemic: Infoveillance Study

Conversations and Medical News Frames on Twitter: Infodemiological Study on COVID-19 in South Korea

Electronic health-literacy skills among nursing students

The Associations among Individual Factors, eHealth Literacy, and Health-Promoting Lifestyles among College Students

Healthy diet: Health impact, prevalence, correlates, and interventions

Individual risk management strategy and potential therapeutic options for the COVID-19 pandemic

Potential interventions for Novel Coronavirus in China: A systematic review

A Comprehensive Literature Review on the Clinical Presentation, and Management of the Pandemic Coronavirus Disease 2019 (COVID-19)

Micronutrients as immunomodulatory tools for COVID-19 management

Environmental and nutritional impacts of dietary changes in Spain during the COVID-19 lockdown

Fear of COVID-19 Scale-Associations of Its Scores with Health Literacy and Health-Related Behaviors among Medical Students

Overview of Novel Coronavirus (2019-nCoV)

Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries

A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation

Development and validation of a new short-form health literacy instrument (HLS-SF12) for the general public in six Asian countries

Validation of the short-form health literacy questionnaire (HLS-SF12) and its determinants among people living in rural areas in Vietnam

Factors associated with health literacy among the elderly people in Vietnam

People with suspected COVID-19 symptoms were more likely depressed and had lower health-related quality of life: The potential benefit of health literacy

Health literacy and public health: A systematic review and integration of definitions and models

Measuring health literacy in populations: Illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q)

Comparative Report of Health Literacy in Eight EU Member States. The European Health Literacy Project

Validity and reliability of measurement instruments used in research

Simulation study of confounder-selection strategies

An index of factorial simplicity

Beyond internal consistency reliability: Rationale and user's guide for multitrait analysis program on the microcomputer

My current thoughts on coefficient alpha and successor procedures

Quality criteria were proposed for measurement properties of health status questionnaires

A new comprehensive short-form health literacy survey tool for patients in general

E-healthy diet literacy scale and its relationship with behaviors and health outcomes in Taiwan

eHealth Literacy and Health Behaviors Affecting Modern College Students: A Pilot Study of Issues Identified by the American College Health Association

Towards the measurement of food literacy with respect to healthy eating: The development and validation of the Self Perceived food literacy scale among an adult sample in the Netherlands

Food Literacy and Healthy Diets of Canadian Parents: Associations and Evaluation of the Eat Well Campaign

Challenges, Opportunities, and Motivators for Developing and Applying Food Literacy in a University Setting: A Qualitative Study

Which literacy for health promotion: Health, food, nutrition or media?

We Signed Up for This!"-Student and trainee responses to the Covid-19 pandemic

Medical Student Education in the Time of COVID-19

School Nurses on the Front Lines of Healthcare: The Approach to Maintaining Student Health and Wellness during COVID-19 School Closures

This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license