key: cord-0787137-6daxsnwm authors: Almalki, Manal title: Perceived Utilities of COVID-19 Related Chatbots in Saudi Arabia: a Cross-sectional Study date: 2020-09-03 journal: Acta Inform Med DOI: 10.5455/aim.2020.28.218-223 sha: 7207bb0dc1c86f19e0c154159c3dd08c6b08d5c4 doc_id: 787137 cord_uid: 6daxsnwm INTRODUCTION: Health chatbots are increasingly being utilized in healthcare to combat COVID-19. However, few studies have explored the perception and willingness of end-users toward COVID-19-related chatbots. Furthermore, no studies have been conducted in Saudi Arabia. AIM: This paper explored 166 end-users’ perceived utilities of health chatbots in Saudi Arabia, and how their characteristics affect their perceptions. METHODS: We conducted a quantitative descriptive study by implementing an online survey. The survey asked 20 questions on participants’ demographics and their perception of health chatbots’ usefulness. RESULTS: We found that users were more willing to use health chatbots to seek general information about COVID-19 (82.5%) over seeking information regarding COVID-19 medical treatments (72.3%). Furthermore, participants with undergraduate degrees tend to use them to learn how to prevent COVID-19’s spread (P = 0.015), to self-track COVID-19 symptoms (P = 0.028), and to seek information about medication (P = 0.035) in comparison to those who had postgraduate degrees. Participants who frequently searched for health information on the internet were more likely to look for nearby medical services using health chatbots (P = 0.023). Lastly, participants who provided any sort of healthcare services information were more likely to self-assess COVID-19 symptoms by using health chatbots (P = 0.036). CONCLUSION: Participant awareness and use of health chatbots were low; however, most had positive perceptions of these emerging technologies and displayed willingness to use them. Further research is needed to capture the real-world usability of these novel technologies by employing more rigid methodological designs (e.g, field trials). During the novel SARS-CoV-2 coronavirus (COVID-19) pandemic, health chatbots have been increasingly used to combat the virus's spread (1) . Health chatbots offer a form of instantaneous conversations between a human person and an artificial intelligence (AI) program, or through voice and/or text-based commands using natural human languages (2) . Health chatbots can be launched in diverse platforms such as messaging mobile-based applications (apps), social media networks (e. g, Twitter), emails, and websites (3, 4) . Examples of health chatbots related to COVID-19 are the Saudi Ministry of Health's chatbot (5) , the World Health Organisation's (WHO) chatbot (6) , the UK government's chatbot (7) , the VA coronavirus chatbot from US Department of Veterans Affairs (8) , and India's government chatbot (9) . Our recent scoping review (10) provided insights on how health chatbots have been used in multiple domains. This review finds that their utilization spans paediatric care, geriatric care, public health and surveillance, large scale monitoring systems, and artificial intelligence to support healthcare personnel (e. g, automate tasks like filling forms and scheduling appointments). In addition, this scoping review (10) sheds light on the multiple ap-plications of health chatbots for the end-users. Firstly, chatbots can be used to combat misinformation and fake news by providing a broad level of information from reliable sources to answer users' inquiries in a timely manner. Secondly, chatbots have been utilized to disseminate health information and knowledge that caters to the needs of both current patients as well as general information seekers alike about the novel coronavirus, symptoms, medical treatments, and precautions to reduce the chance of being infected or spreading COVID-19. Thirdly, chatbots can facilitate self-triages and personal risk assessments by asking the users to complete a questionnaire about their symptoms. If the severity of the user's symptoms reaches a pre-designated threshold, the chatbot instantly alerts them to contact their health specialist (11) . Fourthly, chatbots can track COVID-19 symptoms (e. g, fever, headache, shortness of breath) and various health aspects (e. g, physical activities, heart rate, diet) on a daily basis with ongoing symptom measurements. The users' collected data allows the bots to categorise them into groups based on the severity of their symptoms, and-using machine learning-predict the cases who are at higher risk. Customised health advice and recommendations about self-care are then provided to the user based on the recorded symptoms. The final purpose of health chatbots concerns contact tracing and notifications of potential exposure. When the users are within close proximity of someone who has contracted the virus, they will be automatically alerted by the chat bots. On the other hand, many challenges are reported in the literature concerning the use health chatbots. For example, some health chatbots become virtually inactive due to the lack of interest from the community (12) . Moreover, perceptions about chatbots' integrity, benevolence, and ability to provide accurate information varies based on the end-users' demographic characteristicsoften in a negative way (13) . For instance, Caucasian participants perceived the chatbot to have lower ability and benevolence than Asian participants. In addition, some end-users raised concerns about their privacy as chatbots collect personal data including their names, phone numbers, and locations, and this may hinder the effective deployment of health chatbots (11). Few studies to date have explored the perception and willingness towards COVID-19 related chatbots; however, no studies investigating this topic have been conducted within the Saudi Arabia community (10) . Therefore, this study was conducted to elicit information from the end-users in Saudi Arabia regarding their perception and willingness to use health chatbots during COVID-19, and the how their individual characteristics may affect their perceptions of chatbots' usefulness. After securing the approval of Jazan University's Human Research Ethics Committee to conduct a quan-titative descriptive study, we designed and implemented an online survey. The first page of the survey included the plain language statement and the participant consent form. The participants received information about the aims of the study, eligibility criteria, information about the kind of questions that participants would be asked during the survey, before proceeding to the first section, the candidate received the author's contact information and was required to indicate that she or he agreed to participate. Participants were also informed that they could withdraw from the survey without repercussion before submitting the form. Completing the survey took approximately 10 minutes. A copy of the questionnaire can be found in Appendix 1. The online survey was developed after conducting the aforementioned scoping review (10) . The questionnaire was built in Microsoft Form and comprised two sections and 20 questions. Section one included 11 questions that asked for demographic information (i.e, gender, age, nationality, their highest level of education, and current occupation) and general information about participants (i.e, provided healthcare-related services, had medically diagnosed conditions such as high blood pressure and diabetes, perceived information technology (IT) skills, searched health information on the internet, awareness about health chatbot, and past health chatbot use). This section was comprised of multiple choice, closed-ended questions. Section two had 9 questions that asked participants to rate their perceptions of using health chatbots to perform various actions (see Appendix 1), and these questions were designed to emphasize the purposes of health chatbots identified in the scoping review. A fivepoint Likert scale (ranging from "strongly unlikely" to "strongly likely") was used in this section. Participants recruitment Participants were recruited via social media and messaging apps such as WhatsApp, Twitter, Telegram, Instagram, Snapchat, and Facebook, which have the most popular user engagement in Saudi Arabia (14) . Recruitment was conducted over the period of June 17 th to July 15 th , 2020. People were eligible to participate if they were over 18 years old, lived in Saudi Arabia, and had a smartphone that supported 3G network or above. Other characteristics such as gender, nationality, language, and occupation were not restricted. Data analysis procedures Raw data from eligible participants were downloaded via Microsoft Form and imported into IBM SPSS Statistics software (version 1.0.0.1032). The dichotomous variables (e.g, gender: Female/Male, past health chatbot use: Yes/No) were not coded; however, the rest of the demographic information was re-coded into binary variables to avoid potential issues in statistical model fitting (more information can be found in Appendix 1). For example, the options of the variable 'the highest level of education' (i.e, secondary school, diploma, Bachelor's degree, Master's degree, Ph.D. or equivalent) were re-coded and organised into two groups 'undergraduate degrees' if the participant had a bachelor degree or less and 'postgraduate degrees' if the participant had a Master's degree or above. Data was analysed through descriptive (i.e, frequency and percentage for categorical data) and inferential statistics (i.e, Mann-Whitney U-Test for not normally distributed data). Values were considered statistically significant at (P <0.05). A total of 166 out of 173 individuals who participated provided sufficient information for analysis. The highest proportion of respondents were male (n= 87, 52.5%). More than two thirds (n=113, 68%) were aged 30 years and above and were employed. The majority were Saudi (90%) and healthy (i.e, no diagnosed medical conditions, 82%). About 57.2% had at least a university undergraduate degree. 42.2% provided healthcare-related services in settings such as healthcare facilities, quarantine or isolation centres or check-up points; or home-based care for a family member, relative or friend. Nearly 64.5% of participants reported having high to a very high level of information technology (IT) skills. Almost 70% searched frequently for health information. Of 166 participants, 40% were aware of health chatbots and 24% had used chatbots before. Table 1 summarises the characteristics of participants. Table 2 presents the perceived utilities and usefulness of health chatbots in Saudi Arabia. The majority of participants (82.5%) reported that they would use health chatbot to seek general information about COVID-19 (e.g, news, the number of active cases), and to learn how to prevent the spread of COVID-19 (e.g, how to wash hands, wear face masks). Nearly 82% endorsed that they would use health chatbots to seek general health information about COVID-19, and 81% would use them to learn about COVID-19 symptoms and other health aspects. Additionally, 79% of participants indicated that they would use these chatbots to look for nearby medical services (e.g, testing centres for COVID -19) . The least common purposes to use chatbots were to self-assess COVID-19 symptoms (76%), to self-track my COVID-19 symptoms (73%), to find out if someone who has contracted COVID-19 is in close proximity (73%), and to seek information about COVID-19 medical treatments (72%). The statistical comparisons performed with Mann-Whitney U Tests revealed no statistically significant differences in all perceptions of health chatbots' utilities between groups of the following variables: gender, age, nationality, health status (medically diagnosed conditions), perceived IT skills, awareness of health chatbots, and past use of health chatbots (see Table 3 for further information). For example, one of the conducted Mann-Whitney tests showed no significant differences between males and females in their tendency to seek general health information on COVID-19. The following results present statistically significant differences in scoring tendencies at the 5% level: We found a statistically significant difference in comparing the participants who had undergraduate degrees (n=95) with those with postgraduate degrees (n=71). The analysis indicated that the participants with undergraduate degrees tend to use health chatbots to learn how to prevent the spread of COVID-19 (P = 0.015), to self-track COVID-19 symptoms (P = 0.028), and to seek information about medication (P = 0.035) more frequently than those with postgraduate degrees. The Mann-Whitney U Test also revealed a statisti- Perceived Utilities of COVID-19 Related Chatbots in Saudi Arabia: a Cross-sectional Study cally significant difference (P = 0.042) how groups with different employment status seek information about COVID-19 symptoms. Both groups were found to be willing to use chatbots; however, employed participants (n=114) scored higher in using chatbots to seek information about their symptoms than unemployed ones (n=52). There was a statistically significant difference found by comparing the participants who had provided any sort of healthcare-related services (n=70) with those who had not (n=96). This difference indicates that participants who provided any healthcare-related services are more likely to self-assess for COVID-19 symptoms by using health chatbots (P = 0.036). Lastly, there was a statistically significant difference between the participants who frequently searched for health information on the internet (n=116) and those who sought out health information less frequently (n=50). The participants who frequently searched for health information on the internet scored higher in having tendencies to look for nearby medical services by using health chatbots (P = 0.023) than the others. Note: the numbers from 1 to 9 in the first row indicate the perceived utilities of health chatbots reference as illustrated in Table 2 . To our knowledge, this is the first study exploring Saudi Arabia's acceptability of health chatbots related to COVID-19 from the perspective of the end-users. We concluded that most of the participants had limited experience with these emergent technologies (i.e, had not used chatbots in other settings before); however, they were willing to use health-specific chatbots for various activities, including seeking information about healthcare services, how to prevent the spread of COVID-19, and how to regularly self-assess symptoms. In addition, our findings indicated that the participants were more willing to use health chatbot to seek general information about COVID-19 over seeking information about COVID-19 medical treatments. Furthermore, the majority of the participants were not aware of health chatbots; despite this, we found that these previously-unaware participations had positive perceptions of these novel health technologies' functionalities. The statistical comparison revealed perception of health chatbots' functionality and usefulness varied based on the people characteristics; in particular, the person's education level, employment status, frequency of seeking health information on the internet, and if they had been provided with any sort of previous healthcare-related services. Those findings are consistent with previous research studies exploring peoples' acceptance of novel health technologies (15) (16) (17) (18) . As this study revealed lack a of familiarity and experience of health chatbots, we encourage future research, treatment teams and public health officials to raise peoples' awareness about these emergent technologies and their diverse applications in healthcare (19) . Health mass media campaigns, social role models' endorsements, or adaption of health chatbots by national healthcare providers may help in this regard by influencing their popularity and feelings of legitimacy (15). This study has its own strength and limitations. Our sample was comprised of a diverse selection of males and females with different levels of education, age, health status (healthy individuals and people with chronic conditions), employment status cohort, and low and high levels of familiarity with technology. Thus, our sample may be representative of the population that might be asked to use chatbots related to COVID-19. However, the recruitment technique through social media may introduce a selection bias (i.e, internet users) which may compromise the generalisability of our findings. Therefore, our future work includes utilizing a more rigid methodological design (i.e, field trials) to capture the real-world usability and overall perception of health chatbots to combat COVID-19, and how using these emergent technologies influence public opinions in Saudi Arabia. This paper presents a cross-sectional study of the use of health chatbots to combat COVID-19. Participants' awareness and experience were found to be low, but most participants had positive perceptions and willingness to learn more about and use these emergent health technologies. Our future work will explore options to increase the implications of the positive influence chatbots may have in Saudi Arabian healthcare. • Acknowledgments: This study was funded by the Scientific Research Deanship at Jazan University. We also would like to thank Dr Mohammed Zain, the statistical consultant, for his advice on performing non-parametric tests during data analysis. • Author's contribution: The author was involved in all steps of preparation this article and also made final proof reading. • Conflicts of interest: None declared. • Financial support and sponsorship: Nil. Chatbots in the fight against the COVID-19 pandemic Frontiers: machines vs. humans: The impact of artificial intelligence chatbot disclosure on customer purchases A guide to chatbots for COVID-19 screening at pediatric health care facilities Survey of conversational agents in health MOH launches live chat service via 937 service center The WHO health alert: Communicating a global pandemic with WhatsApp UK turns to WhatsApp to share coronavirus information An overview of mobile applications (apps) to support the coronavirus disease-2019 response in India Health chatbots for fighting COVID-19: Scoping review [this paper has been submitted for publication to Acta Inform Med AI Chatbot design during an epidemic like the novel coronavirus Designing a competent chatbot to counter the COVID-19 Pandemic and empower risk communication in an emergency response system User reactions to COVID-19 screening chatbots from reputable providers Over 18 million users of social media programs and applications in Saudi Arabia Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study Conversational agents in health care: Scoping review and conceptual analysis Design and evaluation of a mobile chat app for the open source behavioral health intervention platform mobilecoach Text-based healthcare chatbots supporting patient and health professional teams: Preliminary Artificial intelligence chatbot behavior change model for designing artificial intelligence chatbots to promote physical activity and a healthy diet: Viewpoint