key: cord-0025277-t3tlj38t
authors: Jansen-Kosterink, Stephanie; Hurmuz, Marian; den Ouden, Marjolein; van Velsen, Lex
title: Predictors to Use Mobile Apps for Monitoring COVID-19 Symptoms and Contact Tracing: Survey Among Dutch Citizens
date: 2021-12-20
journal: JMIR Form Res
DOI: 10.2196/28416
sha: 3ced818c29e2dcedf8b5c13898752209e6b50500
doc_id: 25277
cord_uid: t3tlj38t

BACKGROUND: eHealth apps have been recognized as a valuable tool to reduce COVID-19’s effective reproduction number. The factors that determine the acceptance of COVID-19 apps remain unknown. The exception here is privacy. OBJECTIVE: The aim of this article was to identify antecedents of acceptance of (1) a mobile app for COVID-19 symptom recognition and monitoring and (2) a mobile app for contact tracing, both by means of an online survey among Dutch citizens. METHODS: Next to the demographics, the online survey contained questions focusing on perceived health, fear of COVID-19, and intention to use. We used snowball sampling via posts on social media and personal connections. To identify antecedents of the model for acceptance of the 2 mobile apps, we conducted multiple linear regression analyses. RESULTS: In total, 238 Dutch adults completed the survey; 59.2% (n=141) of the responders were female and the average age was 45.6 years (SD 17.4 years). For the symptom app, the final model included the predictors age, attitude toward technology, and fear of COVID-19. The model had an r2 of 0.141. The final model for the tracing app included the same predictors and had an r2 of 0.156. The main reason to use both mobile apps was to control the spread of the COVID-19 virus. Concerns about privacy was mentioned as the main reason to not use the mobile apps. CONCLUSIONS: Age, attitude toward technology, and fear of COVID-19 are important predictors of the acceptance of COVID-19 mobile apps for symptom recognition and monitoring and for contact tracing. These predictors should be taken into account during the development and implementation of these mobile apps to secure acceptance.

It is spring 2020 and the COVID-19 pandemic has the world in its grip. Infection with COVID-19 can lead to a simple cold or no symptoms at all, while it can also rapidly develop into a life-threatening disease, especially for patients with existing cardiovascular problems, obesity, or diabetes [1] . To hamper the spread of COVID-19 and to manage the intensive care unit capacity, many countries have applied a lockdown strategy for their citizens [2] . In order to control the spread of COVID-19 after a lockdown, and to minimize the effective reproduction number of the disease, several measures can be applied, of which social distancing, combined with aggressive case finding and isolation, seems to be the most effective [3] . eHealth apps have been recognized as a valuable tool for supporting symptom recognition and monitoring [4] , for contact tracing [5] , and ultimately, for reducing COVID-19's effective reproduction number by means of timely intervention. In short, a contact tracing app would record a citizen's contacts with other people via Bluetooth technology and, in the case of a COVID-19 infection, will warn the persons that the index patient recently had contact with so that they can apply self-isolation and be attentive for any COVID-19 symptoms. However, for such apps to be effective, high uptake among the population is necessary. For the case of a tracing app, it has been estimated that 56% of a country's population should use the app to suppress the epidemic [6] . It is therefore crucial that the design of these apps and the implementation strategies that accompany them take the factors that affect acceptance into account.

The factors that determine acceptance of COVID-19 apps are largely unknown [7] . The exception here is privacy. Since the initial plan of governments to implement these technologies, a fierce public debate erupted on whether or not large-scale tracing of contacts for this goal is an unacceptable breach of privacy or not. While the issue of privacy has been recognized as an important antecedent of acceptance of mobile health apps [8] , the unique and disturbing situation that the COVID-19 pandemic places us in makes it difficult to apply existing models and frameworks for eHealth acceptance. In May 2020 the Dutch government wanted to develop and implement 2 mobile apps to prevent the spread of the COVID-19 virus and support Dutch municipal health services. The aim of this article was to identify antecedents of acceptance of (1) a mobile app for COVID-19 symptom recognition and monitoring, and (2) a mobile app for contact tracing, both by means of an online survey among Dutch citizens.

To identify antecedents of acceptance of a mobile app for COVID-19 symptoms recognition and monitoring (hereafter: symptom app), and a mobile app for contact tracing (hereafter: tracing app), an online survey was developed, tested, and distributed among Dutch citizens. This study did not require formal ethical approval (as ruled by CMO Oost Nederland, file number: 2020-6628). At the beginning of the survey, participants were asked for consent to use their data for research purposes.

The online survey (Multimedia Appendix 1) consisted of 4 parts. The first part included questions on demographics, the second part contained questions related to perceived health, the third part consisted of questions related to the fear of a COVID-19 infection, and the final part included questions to assess the intention to use the 2 suggested mobile apps. In April 2020, the Dutch government announced plans to develop and implement 2 mobile apps for preventing the spread of the COVID-19 virus. However, the exact design of these apps remained unknown at this time. Therefore, we introduced both mobile apps in the survey via a short description of their general aim. We pretested the survey with 14 Dutch citizens to improve legibility.

We assessed gender, age, smartphone use, educational level (student, primary school, secondary school, high school, bachelor's degree/university/PhD), work status (unemployed and searching for work, not able to work due to illness, volunteer work, part-time work, full-time work, retired, student), income level (below-average wages, average wages, above-average wages), and living status (living alone, living together, other). We assessed the participants' attitude toward technology using the Personal Innovativeness in the Domain of Information Technology scale by Agarwal and Prasad [9] , consisting of 4 statements and accompanied by a 5-point Likert scale (ranging from 1 [strongly disagree] to 5 [strongly agree]). Finally, we also asked whether participants were (once) infected with COVID-19. The answer options for this question were: Yes, In doubt, or No.

To assess perceived health, we asked participants to complete 3 questions. These questions were used previously to assess perceived health among Dutch citizens [10] . These questions/statements were (1) How would you describe your health?; (2) How concerned are you about your health?; and (3) I am ill more often than other people of the same age and sex. These were accompanied by a 5-point Likert scale ranging from 1 (bad, not concerned, and totally disagree, respectively) to 5 (excellent, very concerned, and totally agree, respectively).

The participants' fear of a COVID-19 infection was assessed by means of 4 questions related to this topic: 

Finally, participants were asked to rate their intention to use the 2 mobile apps: (1) a symptom app and (2) a tracing app. The statements for the construct intention to use were based on van Velsen et al [11] . All 3 questions were accompanied by a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). Next to these closed questions, respondents were also asked what the main reasons were to "use" and "not to use" the mobile apps.

Distribution of the survey (via QualtricsXM) started on April 15, 2020. Participants were eligible if they were 18 years of age or older. We used a snowball sampling via posts on social media (LinkedIn, Twitter, and Facebook) and personal connections. Next to this, we recruited participants via a Dutch panel of older adults that indicated they were interested in participating in research on the topic of eHealth. The survey was closed on April 30, 2020. Due to the method of recruitment, a response rate could not be calculated.

Data were analyzed using SPSS (version 19; IBM). Descriptive statistics were performed for all outcomes. Cronbach α values were calculated to assess internal consistency for attitude toward technology, perceived health, fear of COVID-19, and intention to use. Next, survey scores were interpreted for these factors as being negative (score 1 or 2), neutral (score of 3), or positive (score 4 or 5). Via a paired (2-tailed) t test, the difference in intention to use score between both mobile apps was tested. To identify antecedents of acceptance of (1) a symptom app and (2) a tracing app, we conducted multiple linear regression analyses (backward model analyses). The intention to use each app was used as the dependent variable. The independent variables were selected based on Pearson correlation coefficients. Demographic characteristics and factors that (borderline) significant correlated (Pearson correlation cut-off level P≤.10) with the dependent variable "intention to use" were included in the multiple linear regression analyses. For the paired t test and regression analyses, the level of significance was set at P<.05. For the final models the r 2 was calculated, which indicates the percentage of the variance in the dependent variable that the independent variables explain collectively. To support the quantitative results, the responses on the 2 open questions were sorted and counted by the first author and discussed with the second author, taking an inductive approach. Disagreements were discussed until unanimous agreement was reached.

In total, 238 Dutch citizens completed the survey. Fifteen responders only completed the intention to use survey of a tracing app as this app was presented first and these responders stopped with the survey after these questions; 59.2% (141/238) of the responders were female and the average age was 45.6 years (SD 17.4 years). Only 2.1% (5/238) of responders did not own a smartphone and 74.8% (178/238) claimed that they carried their smartphone with them for most of the day. The average age of our sample is higher than the average age of the Dutch population. There was also an overrepresentation of female participants and participants with a high education level [12] . Compared with the statistics of 2018, in the current sample, there is an overrepresentation of participants owning a smartphone and compared with the statistics of 2020 there is an underrepresentation of participants who are unemployed [12] . The internal consistency of the Attitude Toward Technology scale was good (Cronbach α=.85). Most responders (176/238, 73.9%) had a moderate attitude toward technology. Only 3/238 responders (1.3%) claimed to be infected with COVID-19. All demographic characteristics are presented in Table 1 . 

The internal consistency of the 4 items in this scale was acceptable to good (Cronbach α=.78). The mean score on this topic was 3.3 (SD 0.68). The majority of the responder's opinion on this topic was neutral (192/238, 80.7%) and 16% (38/238) of the responders were afraid for a COVID-19 infection. Only a few responders (8/238, 3.4%) were not afraid ( Table 2) . 

For the 3 items to assess the perceived health of the responders the internal consistence was acceptable (Cronbach α=.69). The mean score on this scale was 3.8 (SD 0.68). Most respondents were positive about their health (139/238, 58.4%).

The intention to use was assessed for the symptom app and the tracing app. For both scales, internal consistency was excellent (Cronbach α for the symptom app=.96 and Cronbach α for the tracing app=.96). For both apps, the majority's intention to use was neutral (Table 2) . However, an additional paired t test indicated that there was a significant difference in the scores on intention to use for the symptom app (mean 3.38 [SD 1.07]; n=223) and the tracing app (mean 3.27 [SD 1.13]; n=223; t 222 =-2.598 and P=.01), indicating that the responders were more willing to use a mobile app for COVID-19 symptom recognition and monitoring compared with a mobile app for contact tracing.

The intention to use the symptom app was related to income level (r=0.132, P=.05), attitude toward technology (r=0.220, P<.001), and fear of COVID-19 (r=-0.291, P<.001). The intention to use the tracing app was related to age (r=0.135, P=.04), attitude toward technology (r=0.223, P<.001), and fear of COVID-19 (r=-0.303, P<.001). Based on these outcomes, the independent variables within the linear regression analysis were age, income level, attitude toward technology, fear of COVID-19, and perceived health. Table 3 provides an overview of the correlations between all demographics and factors, and the intention to use. 

Perceived health a Correlation is significant at the .05 level (2-tailed).

A multiple linear regression analysis was conducted to predict the intention to use a symptom app based on age, income level, attitude toward technology, fear of COVID-19, and perceived health. The final model included the predictors attitude toward technology, fear of COVID-19, and age (F 3,3 =12.012; P<.001).

The model has an r 2 of 0.141. It contains 3 factors that affect the intention to use, but only 2 of them are significant predictors: 

An overview of all reasons the responders brought forth for using both mobile apps is presented in Tables 4 and 5. The main reason (33/116, 28.4) for responders to use the symptom app was to control the spread of the COVID-19 virus. In addition, respondents were willing to use this mobile app to monitor own complaints (22/116, 19.0%) and to gain more insight into the spread and symptoms of the COVID-19 virus (19/116, 16.4%).

The main reason to use a tracing app was also to control the spread of the COVID-19 virus (45/147, 30.6%). Next to this, respondents were willing to use this mobile app to gain more insight into the spread and symptoms of the COVID-19 virus (34/147, 23.1%) and for one's own health (19/147, 12.9%). Other reasons for not using the mobile apps were the expected usefulness of the app (symptom app=23.9% [27/113] and tracing app=13.4% [19/142]) and a fear of becoming over aware of the situation and its potential consequences, leading to unnecessary stress (symptom app=8.0% [9/113] and tracing app=11.3% [16/142] ). The fear the use of the app will be forces by government

The aim of this paper was to identify antecedents of acceptance of (1) a mobile app for COVID-19 symptom recognition and monitoring, and (2) a mobile app for contact tracing among Dutch citizens by means of an online survey.

Our main finding is that for both mobile apps age, attitude toward technology, and fear of COVID-19 are antecedents of acceptance. A large group of the Dutch citizens (101/223, 45.3%) is willing to use a mobile app for COVID-19 symptom recognition and monitoring. The main reasons to use this mobile app are to (1) control the spread of COVID-19; (2) monitor their own complaints, and (3) gain more insight into the spread and symptoms of the COVID-19 virus. For the case of a mobile app for COVID-19 contact tracing, 41.2% (98/238) of the Dutch adults appear to be willing to use this mobile app. The main reasons for use are (1) to control the spread of the COVID-19 virus, (2) to gain more insight into the spread and symptoms of the COVID-19 virus, and (3) for their own health. Privacy, doubting the usefulness of the mobile app, and a fear of becoming over aware of the situation and its potential consequences, leading to unnecessary stress, are the main reasons to not use the mobile apps. Overall, Dutch citizens were more willing to use a mobile app for COVID-19 symptom recognition and monitoring compared with a mobile app for contact tracing.

It is difficult to relate our findings to the existing literature, as limited technology acceptance studies have focused on mobile apps to be used during a pandemic, and insights into factors that determine the acceptance of COVID-19-related mobile apps are lacking [7] . In general, age and attitude toward technology are widely acknowledged antecedents of acceptance. For age there is evidence that older age is associated with a lower level of acceptance of mobile apps [13] . Previous results also indicated that attitude toward technology is an important antecedent of acceptance of mobile apps [13, 14] . The degree to which an individual is willing to try out any new mobile app is related to the intention to use [13] . Since this study, the mobile apps, announced by the Dutch Government in April 2020, have been developed and implemented. In a recent study by Bente et al [15] , the contact tracing app (the CoronaMelder) was tested for usability, and was found easy to use. A comparable study was executed in Germany by Blom et al [16] . They analyzed the potential barriers for the large-scale adoption of the official contact tracing app that was introduced in Germany. The foremost barrier toward using the contact tracing app was the lack of willingness to correctly adopt the app. Besides, compared with the younger group (aged 18-59 years), the older age group (aged 60-77 years) was less likely to use a compatible smartphone. Therefore, access was also mentioned as barrier in this study [16] . Another cross-country survey study (participating countries: France, Germany, Italy, the United Kingdom, and the United States) on the acceptance of a contact tracing app is more optimistic [17] , as the willingness to install the app was high among all 5 counties and across all subgroups of the population. In addition, this study concluded that epidemiological evidence shows that app-based contact tracing can suppress the spread of COVID-19 if a high enough proportion of the population uses the app [17] .

Our results show that fear of COVID-19 is the most important COVID-19-related factor that predicts acceptance of mobile apps to deal with the COVID-19 pandemic. Because it is difficult to translate this fear into a technology design, this finding needs to be seen in a bigger picture. Public health campaigns during the COVID-19 epidemic will need to educate citizens about the dangers of COVID-19 (personally and for society as a whole), and should then offer downloading COVID-19 mobile apps as a personal strategy to deal with this fear. Next, the positive attitude toward technology that precedes a decision to download a COVID-19 app should be taken into consideration when using these innovations. The end-user population might be skewed toward those with interest in technology (traditionally these are younger, highly educated men [18] ), which can create a use divide, and thus, a health divide in society. Measures should be installed to support those groups in society that are not, by nature, technically interested, such as having promotional stalls in the community and diverse channels of user support.

The following 4 limitations should be taken into account for this study. First, due to our recruitment method (snowball sampling via social media), our sample could have been affected by a selection bias. Our sample was mainly composed of participants with a high educational level and a moderate attitude toward technology. Therefore, our results are based on the views of a somewhat skewed sample of the Dutch population, which might reduce the generalizability of our findings. Second, for our analysis, the power of our sample was sufficient. However,

Are patients with hypertension and diabetes mellitus at increased risk for COVID-19 infection? The Lancet Respiratory Medicine

COVID-19: One-month impact of the French lockdown on the epidemic burden

Impact of lockdown on COVID-19 epidemic in Île-de-France and possible exit strategies

Emergency Response to COVID-19 in Canada: Platform Development and Implementation for eHealth in Crisis Management. JMIR Public Health Surveill

Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing

Effective Configurations of a Digital Contact Tracing App: A Report to NHSX

Scoping review of mobile phone app uptake and engagement to inform digital contact tracing tools for COVID-19

Mobile Health Apps to Facilitate Self-Care: A Qualitative Study of User Experiences

A Conceptual and Operational Definition of Personal Innovativeness in the Domain of Information Technology

Public knowledge and preventive behavior during a large-scale Salmonella outbreak: results from an online survey in the Netherlands

Personalization has a Price, Controllability is the Currency: Predictors for the Intention to use Personalized eGovernment Websites

Understanding determinants of consumer mobile health usage intentions, assimilation, and channel preferences

Consumer Attitude: Does It Influencing the Intention to Use mHealth?

The Dutch COVID-19 Contact Tracing App (the CoronaMelder): Usability Study. JMIR Form Res

Barriers to the Large-Scale Adoption of a COVID-19 Contact Tracing App in Germany: Survey Study

Acceptability of App-Based Contact Tracing for COVID-19: Cross-Country Survey Study

Demographics, attitudes, and technology readiness

Predictors to Use Mobile Apps for Monitoring COVID-19 Symptoms and Contact Tracing

), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information

iss. 12 | e28416 | p

a larger sample would improve the generalizability of our outcomes, as mainly Dutch citizens from the eastern part of the Netherlands (87.0% [207/238] of our sample) completed our survey. Third, in our survey the 2 mobile apps are introduced by means of a short description of their general aim. It is unclear if this description was sufficient for the responders to understand the purpose of both mobile apps. Our survey was distributed before the development of the CoronaMelder app in the Netherlands. The study by Bente et al [15] indicated that during this period there were many misconceptions concerning contact tracing among the Dutch population. It is likely that these short descriptions of the general aim of the 2 mobile apps were insufficient to take those misconceptions away. Fourth, the explained variance of both our models is relatively low.Normally, in studies such as these, this number is boosted by including the predictors perceived ease of use and perceived usefulness. However, including these 2 factors leads to little practical results, that is, concluding that the apps should be easy to use. By contrast, the identification of COVID-19-related factors remains an important extension of the existing technology acceptance models.

Age, attitude toward technology, and fear of COVID-19 are important predictors of the acceptance of COVID-19 mobile apps for symptom recognition and monitoring and for contact tracing. These predictors should be taken into account during the development and implementation of these mobile apps to secure acceptance.

The survey was developed by SJ-K, MH, and LvV. Statistical analyses were performed by SJ-K and LvV. All authors were involved in the distribution of the survey and participated in drafting the article and revising it critically for important intellectual content.

None declared.

Survey questions and answer options in Dutch and English (D=demographic questions; C=fear of COVID-19 questions; H=perceived health questions; TAM-BI=behavioural intention).[DOCX File , 21 KB-Multimedia Appendix 1]