key: cord-0777861-qnbn0h1l
authors: Adli, Imam; Widyahening, Indah Suci; Lazarus, Gilbert; Phowira, Jason; Baihaqi, Lyanna Azzahra; Ariffandi, Bagas; Putera, Azis Muhammad; Nugraha, David; Gamalliel, Nico; Findyartini, Ardi
title: Knowledge, attitude, and practice related to the COVID-19 pandemic among undergraduate medical students in Indonesia: A nationwide cross-sectional study
date: 2022-01-21
journal: PLoS One
DOI: 10.1371/journal.pone.0262827
sha: 0714b02ed630325da8c511fe54a2214c054b66f6
doc_id: 777861
cord_uid: qnbn0h1l

INTRODUCTION: The potential role of medical students in raising awareness during public health emergencies has been acknowledged. To further explore their potentials as public educators and role models for the communities during the coronavirus disease 2019 (COVID-19) pandemic, this study aims to assess the knowledge, attitude, and practice of these students toward COVID-19. METHODS: An online cross-sectional survey was conducted among undergraduate medical students in Indonesia. Socio-demographics characteristics, social interaction history, information-seeking behavior, as well as knowledge, attitude, and practice toward COVID-19 were collected through a self-reported questionnaire. A p-value of <0.05 indicated statistical significance. RESULTS: Out of 4870 respondents, 64.9% had positive attitude and 51.5% had positive practice toward COVID-19, while only 29.8% had adequate knowledge. Knowledge was slightly positively correlated with attitude and practice (ρ = 0.074 and ρ = 0.054, respectively; both p<0.001), while attitude was weakly correlated with practice (ρ = 0.234, p<0.001). Several factors including age, sex, place of residence, institution type, academic level, family income, history of chronic illness, prior volunteering experience, and perceptual awareness on COVID-19 were significantly associated with either knowledge, attitude, and/or practice toward COVID-19. Furthermore, health institution’s and the government’s press releases, as well as health expert opinions were deemed as the most reliable sources of COVID-19-related information–yet trivially none of these sources were associated with knowledge, attitude, and practice in the study population. CONCLUSION: Many undergraduate medical students in Indonesia had positive attitude and practice against COVID-19, yet only a few had adequate knowledge. This warrants further interventions to keep them updated with COVID-19 evidence to maximize their potentials in raising public awareness on COVID-19.

a1111111111 a1111111111 a1111111111 a1111111111 a1111111111

Since the declaration of the coronavirus disease 2019 (COVID-19) as a pandemic in early 2020 [1] , global communities have strived to implement various strategies in mitigating the devastating disease burden caused by the virus. In Indonesia, the government has prompted several unprecedented measures to control the spread of the disease [2] , including implementing large-scale social distancing, increasing the capacity of COVID-19 diagnostic tests, and launching a national research consortium to accelerate innovations to combat the disease [3, 4] . Despite these, the COVID-19 disease spread remains concerning as the number of cases and deaths resulting from the disease has perpetually surged-rendering Indonesia as the hardest-hit country in the region [2] . This may partly be attributable to the fact that COVID-19 literacy among Indonesian population is still poor [5, 6] . Although a previous study revealed that Indonesian population has had positive behaviors toward COVID-19 prevention, some of the essential preventive measures were still lacking, especially in terms of social distancing, selfisolation, maintenance of healthy lifestyle, and health-seeking behavior [5] . This indicated that further strategies to increase the public's awareness and preventive behaviors on COVID-19 are imperative, in which medical students may provide unyielding support by taking part in raising awareness on COVID-19.

The role of medical students in raising awareness during public health emergencies have long been established. A systematic review by Martin et al revealed that medical students have been involved in public health campaigns during previous viral outbreaks, including human immunodeficiency virus, influenza, severe acute respiratory syndrome, and Ebola [7] . Being perceived as having a higher level of health literacy, medical students may serve as role models for the public to adopt COVID-19 preventive health behaviors. During the COVID-19 pandemic, Indonesian medical students have also taken part in disseminating health information to the public, mainly through the use of social media and news outlets [8] . However, as the disease burden of COVID-19 in Indonesia persists despite rigorous efforts, comprehensive assessments of medical students' knowledge, attitude, and practice are imperative to further enhance their potentials in educating the public. Specifically, this may provide crucial information for stakeholders to identify field gaps and devise strategies to further encourage communities to follow health standards. Furthermore, this information may also be utilized by medical institutions to improve the medical curricula to prepare for future outbreaks. Therefore, this study aims to assess the knowledge, attitude, and practice of Indonesian undergraduate medical students toward the COVID-19 disease.

A cross-sectional survey among undergraduate medical students in Indonesia was conducted from 13 July to 11 October 2020. Participants were recruited using a snowball sampling technique and all data were collected via an online self-reported questionnaire using Google Forms (http://forms.google.com/) as the data collection period coincided with implementation of the COVID-19 lockdown policy in Indonesia. The questionnaire was filled anonymously, voluntarily, and with written consent given by all respondents. To avoid duplicate responses, all participants were required to log into their email accounts, but any personal contact information were not recorded to protect the anonymity of the respondents. During the data collection period, the questionnaire was spread using social media platforms every three days to increase the number of respondents. All procedures conducted in this study have been approved by the Health Research Ethics Committee of the Faculty of Medicine Universitas Indonesia and Cipto Mangunkusumo Hospital (ethical clearance number: 758/UN2.F1/ETIK/ PPM.00.02/2020).

The questionnaire was developed through literature searches of previously validated questionnaires [9] [10] [11] [12] , which was then translated to Bahasa Indonesia through backward and forward translations by three of the authors (GL, IA and AMP), and modified to match the context of the study. A preliminary survey was then conducted on 30 participants to enhance the comprehension and the validity of the questionnaire. Further details on the calculation of minimum sample size and the development of the questionnaire have been previously discussed elsewhere [13] .

The questionnaire encompassed four primary sections including: (1) socio-demographics characteristics, (2) social interaction history, (3) levels of trust in COVID-19 health information sources, and (4) knowledge, attitude, and practice. Socio-demographics characteristics consisted of age, sex, place of residence, institution type, academic level, living circumstances, marital status, family income, and history of chronic diseases. Living circumstances comprised the number of people living in the household and type of household (e.g., family, non-family, or alone), while family income was classified as low, lower-middle, upper-middle, and highincome class for monthly family income of � IDR 1,500,000, IDR 1,500,001-2,500,000, IDR 2,500,001-3,500,000, and >IDR 3,500,000, respectively [14] . On the other hand, the social interaction history section aimed to assess the volunteering experience of respondents in health and non-health sectors, their own and family's COVID-19 disease history, and their history of physical contacts with COVID-19 patients. In addition, we also assessed the medical students' general perception on the reliability of various health information sources, including televisions, newspapers, online news, social media, official statements from the government and health institutions, and expert opinions.

The final section aimed to investigate the participants' knowledge, attitude, and practice toward the COVID-19 disease. Knowledge was assessed using a 10-items questionnaire encompassing various areas of COVID-19 disease, including pathogenesis, clinical presentation, diagnosis, treatment, and prevention. Each correct answer accounts for one point with a maximum score of 10 points. In contrast, assessment of attitude and practice consisted of 12 questions each using a five-point Likert scale. Higher knowledge, attitudinal, and behavioral scores indicated favorable perceptions. Lastly, the reliability of the questionnaire was appraised using Cronbach's alpha, with a coefficient for knowledge, attitude, and practice of 0.655, 0.726, 0.807, respectively, indicating satisfactory internal reliability [15] .

Submitted responses were collected in and managed with the MS Excel 1 for Office 365 MSO ver. 2002 (Microsoft Corporation, Redmond, WA, 2018). Subsequently, data were analyzed using SPSS 24.0 (SPSS Inc., Chicago, IL) and visualized using R ver. 4.0.3 (R Foundation for Statistical Computing, Vienna, Austria) [16] . Categorical data were presented as frequency and percentages, while continuous data as means or medians along with the appropriate measure of dispersion according to the normality of data distribution as tested with Kolmogorov-Smirnov tests.

Outcomes on the knowledge, attitude, and practice were dichotomized according to the Bloom's cut-off (�80%) [17] , where a sum knowledge score of �8 indicated adequacy, and a score of �48 indicated positive attitude and practice, respectively. Potential factors associated with the dependent variables were first analyzed using univariate logistic regression. Any factors associated with each outcome at p�0.20 were deemed eligible for inclusion in the multivariate analysis. In addition, correlation between trust in health information sources and knowledge, attitude, and practice, as well as intercorrelations among the dependent variables were investigated with Spearman's rho (ρ). A p-value of <0.05 denoted statistical significance.

Out of 4870 participants with a median age of 20 years (interquartile range [IQR]: 19-21), 3399 (69.8%) were female and 3925 (80.6%) were pre-clinical students. Most participants resided in Java (86.9%), followed by Eastern Indonesia (6.0%), Sumatra (4.9%), and Central Indonesia (2.1%). Further details on the characteristics of the included participants can be seen on S1 Table.

We discovered that about 64.9% and 51.5% respondents yielded positive attitude and practice toward COVID-19, while only 29.8% yielded adequate knowledge score. Most of the participants were knowledgeable in the prevention (97.1%), respiratory transmission (96.4%), clinical and radiological findings (83.9% and 80.8%), and therapeutic aspects of COVID-19 (83.3%). However, low numbers of correct answers were found in questions related to the laboratory findings (31.8%), zoonotic transmission route of SARS-CoV-2 (31.8%), and the differences in clinical manifestations between COVID-19 and common cold (57.1%; S2 Table) . Furthermore, only 16.1% of the participants correctly answered the incubation period of SARS-CoV-2. In addition, a considerable number of participants believed that the communities' awareness on COVID-19 were still lacking (37.0%) and disagreed that COVID-19 patients could be treated at home (22.5%). Item-specific responses of the attitude and practice of Indonesian medical students toward COVID-19 can be seen on S3 and S4 Tables, respectively.

In this study, we found that the correlation between knowledge with attitude and practice was negligible (ρ = 0.074 and ρ = 0.054, respectively; both p<0.001). Attitude was also weakly correlated with practice (ρ = 0.234, p<0.001; Fig 1) However, contrary to our findings in the knowledge section, we discovered that students in public universities had a relatively lower practice score compared students in private universities (OR 0.71 [95% CI: 0.63-0.80], p<0.001). Students from lower-middle income class also had lower practice scores relative to that of students from high income class (OR 0.69 [95% CI: 0.54-0.89], p = 0.004; Table 3 ). In addition, we also found that students whose family members had been infected by COVID-19 had a more positive attitude ( 

In addition to the knowledge, attitude, and practice toward COVID-19, we also explored the study population's levels of trust toward COVID-19-related national health information sources. We discovered that most of the participants considered that health information released by health institutions (89.3%), health experts (78.0%), and the government (70.8%) to be reliable. In contrast, only 26.0% and 12.7% of the participants deemed online news and media social to be trustworthy (Fig 2) . Nearly half of the participants also trusted the health information broadcasted by television and newspaper outlets (45.8% and 44.3%, respectively).

No robust correlations could be established between trust in specific health information sources and the students' knowledge, attitude, or practice. Although the negative association between trust in social media and the students' knowledge was statistically significant, the magnitude of the correlation was clinically negligible (ρ = -0.040; p = 0.005; S5 Table) .

Medical education primarily aims to inculcate medical students' high-quality skills and competence in preparing them as future healthcare professionals. In a global health crisis, medical students play a pivotal role in raising public awareness, which in turn may contribute to successful emergency management by mitigating risks, supporting preventive measures, and minimizing negative psychological burdens [18] . To maximize the potentials of these students in educating the communities, it is thus important to explore their knowledge, attitude, and practice toward COVID-19. The present cross-sectional study showed that a majority of Indonesian medical students had a positive attitude and practice against COVID-19. However, this number was not accompanied by a proportionate number of students with adequate knowledge, indicating the urgent need to take active measures to keep these students updated with COVID-19-related evidence.

In the present study, female medical students were superior to males in terms of knowledge and practice. This finding is further validated by a meta-analysis demonstrating that women 

Indonesian undergraduate medical students' knowledge, attitude, and practice toward COVID-19 were 49.5% more likely to practice and adopt health-protective behaviors in the context of a pandemic outbreak [19] . Our study also revealed that a higher percentage of students from public medical schools demonstrated adequate knowledge towards COVID-19, while medical students from private institutions reported a higher level of practice. Although these results may have noted the importance of embedding and promoting equality between public and private medical institutions as well as between fellow public or private medical institutions themselves in terms of the medical curriculum adopted and opportunities to practice clinical skills, these findings should be interpreted cautiously, especially considering the complex interrelationship between the explored variables. One of the most apparent findings to emerge from the analysis was that medical students in clinical years yielded higher knowledge scores compared to pre-clinical students. This result may be explained by the fact that medical students in their final years have been exposed to more experiences and learning opportunities in clinical setup, thereby offering a vast wealth of potential to help and contribute to the pandemic response. With the rigorous years of clinical training they have undergone, qualified clinical-year medical students may therefore contribute beyond being public educators by volunteering to clinically assist the healthcare workers in fighting against COVID-19 [20] .

Our analysis further validated that voluntary participation, whether in health or non-health sectors, played a major role in determining one's levels of knowledge, attitude, and practice. In response to the ongoing COVID-19 pandemic, a plethora of volunteering efforts has been established and launched. Willingness to volunteer has been demonstrated to be higher in those who establish preparedness behavior and exhibit higher awareness of responsibility [13] . In addition, depending on the role and scope, volunteering might offer the opportunities to develop relevant knowledge and skills, a positive sense of community, and pro-social behavior [21] . These might explain the higher scores observed in the present survey among medical students with volunteering experience. Accordingly, based on our findings, incremental efforts should more specifically be made by the medical institutions in promoting volunteerism and encouraging more medical students to partake in volunteering opportunities to gain indispensable learning opportunities and collaborate with other healthcare professionals [22] . Additionally, it was also evident from our study that poor practices were demonstrated among respondents who were unsure whether or not they had been in contact with any COVID-19 positive patient or had been infected with COVID-19. This finding might indicate that the lack of awareness surrounding COVID-19 negatively affects one's level practice. Therefore, a comprehensive approach to increase the awareness of surrounding environment of these students, and in a broader scope-the general population, is urgently required. This may be achieved through rigorous contact tracing, intensive risk communication, as well as mass education efforts [23] .

With the exponential technological advancement over the past few decades, social media seems to be the most plausible way to promote public health behavioral change to increase COVID-19 protective measures [24] . However, our findings suggested that trust in social media as a source of COVID-19 health information was inversely associated with favorable practice in the study population. Although the correlation was clinically negligible, this result noted the importance of managing the information flow of social media, as a source of unfiltered and potentially misleading information, while simultaneously protecting one's freedom of speech. This might be attained by developing algorithms and capabilities to detect fake news, cultivating a standard of conduct in dealing with fake news, and increasing the media literacy and ethical standards of digital users [25] . Nevertheless, it is worth noting that further studies investigating the association between social media and COVID-19 preventive practice among the Indonesian general population are required to confirm our premises as the current study population was confined to medical students. Furthermore, the fact that virtually no other health information sources was significantly associated with the levels of knowledge, attitude, or practice toward COVID-19 in the study population may also indicate that some more influential resources such as scientific articles or medical textbooks, which were unexplored in this study, may impact the overall trend. Overall, the gaps in knowledge relating to COVID-19 persisted although most respondents in the study demonstrated a high level of attitude and a fair level of practice. These results showed that positive attitude and appropriate practices regarding COVID-19 documented among medical students might suggest their valuable role as role models for the general population. However, as future health professionals, demonstration of high standards of attitude and practice has to be aptly supported by excellence in clinical knowledge and understanding, especially if they are to be involved in global health emergencies. Addressing this knowledge gap will warrant not only a more effective public education but also a safer and more efficient involvement of medical students in public health emergencies beyond their role in raising public awareness [7] .

One's level of knowledge is substantially influenced by an effective and efficient education system that plays a key role in ensuring high-quality teaching and learning. The low level of knowledge reported might be justified by the rapidly evolving COVID-19 evidence [26] , which represents an enormous challenge to medical education and thus may subsequently hinder the delivery of educational materials. Our findings necessitate prompt actions by medical institutions to enhance the breadth of knowledge and understanding of Indonesian medical students in regards to COVID-19, particularly with reference to infection prevention and control principles. This was demonstrated by Boodman et al., who described the involvement of medical students in Canada to produce a weekly evidence-based newsletter designed to answer COVID-19 clinical questions raised by doctors. Besides improvements observed in research and inter-professional communication skills among the students, this strategy allowed medical students to gain a deeper understanding of COVID-19 while contributing in a concrete way to the pandemic [27] . In addition, attention should also be paid to gradually allow medical students to engage safely in patient-based training with an appropriate balance of online and inperson learning. In-person activities can be conducted by mitigating the risk of physical contact with patients through physical distancing and suitable personal protective equipment [28] .

The findings of our study might be of assistance and applicable for stakeholders and policymakers in designing and transforming existing public health interventions and medical curriculum to equip medical students with the appropriate tools to adapt during a global health crisis. The current pandemic has corroborated the noteworthiness of implementing exhaustive and systematic disaster training programs as part of the medical school curriculum to fight not only the current pandemic but also future unforeseeable global health crises. A key priority should therefore be to plan these dedicated programs to strengthen students' disaster and pandemic preparedness against similar global health calamities [29] .

This study has several strengths and limitations. The relatively large sample size and the wide geographical reach contributed to the strength of the study. Furthermore, the questionnaire had previously been validated and yielded a fair reliability, thus further ascertaining the validity of our findings. However, the study was limited by the unbalanced distribution of pre-clinical and clinical medical students, which could have potentially limited the generalizability of the study results. The generalizability of our findings might also be affected by the constantly evolving evidence on and situation due to COVID-19, thereby implying that the knowledge, attitude, and practice of medical students in Indonesia found in this study may change over time. Moreover, due to the cross-sectional nature of the survey, we were not able to disentangle the directionality of the relationships observed. An additional uncontrolled factor was the possibility that possible confounding variables, which were not scrutinized in this study, might affect our results. To the best of our knowledge, this is the first reported study assessing the levels of knowledge, attitude, and practice toward the COVID-19 disease among Indonesian medical students, thus providing key parameters for policymakers and institutions in formulating effective strategies and tools to enhance the medical students' potentials in raising public awareness and protective practices in the current COVID-19 pandemic and prospective potential public health emergencies.

Undergraduate medical students in Indonesia had a considerably positive attitude and practice against COVID-19. However, further interventions are required as these figures were not complemented with a proportionate number of students with adequate knowledge. Such interventions should aim to keep the students updated with COVID-19 evidence and simultaneously providing them with opportunities to contribute to the pandemic as public educators and role models for communities, while also equipping them with appropriate knowledge and skills to prepare for future public health emergencies. In turn, this approach may create a positive feedback loop enhancing the students' knowledge, attitude, and practice, which were positively intercorrelated in this study.

Supporting information S1 

WHO declares COVID-19 a pandemic

Indonesia: WHO coronavirus disease (COVID-19) dashboard. 2021 [cited 21

COVID-19 and Indonesia

Review and analysis of current responses to COVID-19 in Indonesia: Period of

Knowledge, attitudes, practices and information needs during the COVID-19 pandemic in Indonesia

Survey data of COVID-19-related knowledge, attitude, and practices among indonesian undergraduate students

A rapid systematic review exploring the involvement of medical students in pandemics and other global health emergencies

Medical students in Indonesia: An invaluable living gemstone during coronavirus disease 2019 pandemic

Coronavirus disease-2019: Knowledge, attitude, and practices of health care workers at Makerere University Teaching Hospitals

Knowledge, attitudes, and practices towards COVID-19 among chinese residents during the rapid rise period of the COVID-19 outbreak: A quick online cross-sectional survey

Knowledge, attitude and practice toward the novel coronavirus (COVID-19) outbreak: A population-based survey in Iran. Bull World Health Organ

Survey tool and guidance: Rapid, simple, flexible behavioural insights on COVID-19-29

Willingness to volunteer and readiness to practice of undergraduate medical students during the COVID-19 pandemic: a cross-sectional survey in Indonesia

Analisis konsumsi rumah tangga miskin di Kelurahan Kebonsari Kulon Kecamatan Kanigaran Kota Probolinggo

The use of Cronbach's alpha when developing and reporting research instruments in science education

R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing

Knowledge and attitude towards antimicrobial resistance among final year undergraduate paramedical students at University of Gondar, Ethiopia

Communications in public health emergency preparedness: A systematic review of the literature

A meta-analysis of the association between gender and protective behaviors in response to respiratory epidemics and pandemics

Involvement of medical students during the coronavirus disease 2019 pandemic: A cross-sectional survey study

Perceptions of and reflections on volunteering: The impact of community service on citizenship in students

Learning through service: Student perceptions on volunteering at interprofessional hepatitis B student-run clinics

COVID-19 risk assessment tool: Dual application of risk communication and risk governance

Influence of social media platforms on public health protection against the COVID-19 pandemic via the mediating effects of public health awareness and behavioral changes: Integrated model

Fighting fake news in the COVID-19 era: Policy insights from an equilibrium model

SARS-CoV-2/COVID-19: Evolving reality, global response, knowledge gaps, and opportunities

Idle medical students review emerging COVID-19 research

Developments in medical education in response to the COVID-19 pandemic: A rapid BEME systematic review: BEME Guide No. 63

Preparing medical students for a pandemic: A systematic review of student disaster training programmes

The authors would like to thank the collaborators of the MEDICO- 19