key: cord-0286221-g8919ekh authors: Utz, Christine; Becker, Steffen; Schnitzler, Theodor; Farke, Florian M.; Herbert, Franziska; Schaewitz, Leonie; Degeling, Martin; Durmuth, Markus title: Apps Against the Spread: Privacy Implications and User Acceptance of COVID-19-Related Smartphone Apps on Three Continents date: 2020-10-27 journal: nan DOI: 10.1145/3411764.3445517 sha: 6e1688cdeec8550a8bdd41005c00ef7d604dcf38 doc_id: 286221 cord_uid: g8919ekh The COVID-19 pandemic has fueled the development of smartphone applications to assist disease management. Many"corona apps"require widespread adoption to be effective, which has sparked public debates about the privacy, security, and societal implications of government-backed health applications. We conducted a representative online study in Germany (n = 1,003), the US (n = 1,003), and China (n = 1,019) to investigate user acceptance of corona apps, using a vignette design based on the contextual integrity framework. We explored apps for contact tracing, symptom checks, quarantine enforcement, health certificates, and mere information. Our results provide insights into data processing practices that foster adoption and reveal significant differences between countries, with user acceptance being highest in China and lowest in the US. Chinese participants prefer the collection of personalized data, while German and US participants favor anonymity. Across countries, contact tracing is viewed more positively than quarantine enforcement, and technical malfunctions negatively impact user acceptance. In early 2020, the global pandemic of coronavirus disease 2019 , caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has driven the development of digital tools to assist traditional disease management methods in limiting the spread of the novel coronavirus and future pathogens. Since then, numerous software projects, especially involving smartphone applications, have been launched by public and private entities around the world, with specific purposes that greatly vary, but all with the common goal to help contain the spread of the pandemic. These include smartphone apps for digital contact tracing, which was identified to be an effective method to assist health authorities in breaking chains of infection [21] . It uses proximity information from smartphones to determine which other users of compatible systems a person has been in recent close contact with, and if a user tests positive for coronavirus, these contacts can be notified to encourage timely isolation and testing. Among the first smartphone apps released for this purpose was Singapore's TraceTogether app, launched on March 20, 2020 [26] , and multiple countries around the globe have since followed suit. Other regions developed digital health certificate systems, first introduced in February 2020 in the eastern Chinese city of Hangzhou [39] . Checkpoints could require people to present their personal QR code displayed in the associated app and only let them pass if the system considered them low-risk. The travel industry has expressed an interest in similar systems to reestablish international travel for people with a recent negative test result [38] . Hong Kong issued a smartphone app, combined with a QR code wristband, to ensure that people do not break the government-mandated quarantine for new arrivals [60] . Other countries including South Korea and Australia issued symptom check apps that allow users to monitor their health for possible symptoms of COVID-19 [8, 57] . The Australian app also serves as an example for countless apps issued by both public and private organizations to provide information about the virus, its spread, rules of hygiene, and local regulations. The use of smartphone applications in the fight against the pandemic has sparked intense public debates about the privacy, security, and societal implications of government-recommended health apps and specific aspects of their implementations. In Europe, the debate mainly focused on the selection of a centralized or a decentralized architecture for digital contact tracing [18] , which involves questions of data transmission and the data recipient and ultimately led to multiple countries adopting a decentralized approach due to privacy concerns. The Chinese health code system has raised questions about the consequences of technical issues and long-term societal implications of apps used to regulate movement for the sake of disease prevention [32] . The quarantine enforcement app issued by the Polish government was subject to criticism due to the collected data, technical malfunctions, and data retention of up to six years [54] . The public interest in the organizational and technical details of these "corona apps" is no surprise: Since their efficiency may depend on widespread voluntary adoption [21] , many were recommended for general adoption by governments and health authorities. User acceptance and their willingness to use these apps can thus be critical for the overall success of smartphone apps in the efforts to fight the pandemic. Many of the publicly discussed and criticized aspects are well-known elements in the theory of "privacy as contextual integrity", which acknowledges that factors beyond the technical implementation, like social norms and expectations, influence perceptions of privacy violations [44] . People's willingness to share personal data from or with their personal devices to benefit their healthcare has previously been studied in a wide range of different contexts, including mental health [36, 43] , HIV [66] , recovery from surgery [1] and rheumatic diseases [41] , but these studies are typically confined to specific locations or populations. The COVID-19 pandemic offers the unique opportunity to study on a large scale, in the context of a virus that could infect anyone at any given time, which individual and privacyrelated factors influence people's willingness to use an app that not only serves individual goals but also has a societal purpose. Research in this area thus not only informs the debate around corona apps but can aid the design of health-related apps that would benefit from widespread adoption outside the specific context of the pandemic. As early as spring 2020, when the first smartphone apps for digital contact tracing were rolled out, the HCI community has taken this opportunity to investigate people's willingness to use mobile apps to help fight the COVID-19 pandemic, focusing on apps for digital contact tracing [4, 31, 33, 56, 61, 69] . With countries around the world also having issued apps for different purposes in the pandemic, it is interesting to study factors for the adoption of corona apps for purposes beyond contact tracing and how these factors differ between app types. Public debates can lead to different outcomes in different countries, influenced by cultural differences, trust in technology and institutions, and regional developments of the pandemic. It is therefore insightful to study user acceptance of corona apps in different regions. In this work, we present the results of an online survey conducted in Germany, the US, and China between June and August 2020 to investigate user acceptance of corona apps and the factors that influence people's willingness to use them. These countries were chosen because they differ with respect to their perception of privacy and the state of the COVID-19 pandemic. Our study is based on a vignette design of hypothetical corona apps and inspired by existing apps from around the world and the contextual integrity framework. Our research makes the following contributions to the HCI community: • We expand existing knowledge about user perception and acceptance of COVID-19-related smartphone apps beyond the purpose of digital contact tracing and investigate people's willingness to use them for other purposes found in government-issued corona apps, i. e., quarantine enforcement, symptom checks, health certificates, and information. Our data shows that contact tracing apps have the highest public support across all countries. • We extend existing research on the acceptability of corona apps beyond the Western world and conduct the study in China, where the pandemic first started and the use of smartphone apps for health screening and movement control is widespread. While in all surveyed countries the most widely discussed and used apps see more support, acceptance in China is higher and not related to individual concerns or the expected benefits. • Our results show that there is skepticism towards apps provided by the government that results in 15 to 21 % of participants not willing to use any app in Germany and the US, while in China users are more concerned that apps might raise stress levels through continued awareness. Previous studies have found that privacy is often not the main concern of users when deciding whether to adopt a certain technology or not. While this behavior is frequently attributed to the privacy paradox [24, 45] -participants express high privacy concern but rarely act accordingly -researchers increasingly argue that the trade-off is more complex. According to Nissenbaum's theory of privacy as contextual integrity (CI), individual privacy preferences and decisions can be described with respect to the appropriateness of information flows [44] . What constitutes an appropriate flow is determined by different factors, such as actors (Whose data is involved? Who will send and receive it?), information types (What types of data are concerned?), and transmission principles (What are the technical and organizational means of the data transmission?). The examples of public debates in Section 1, such as the Polish quarantine app or the discussion about a (de)centralized infrastructure, illustrate that public debates about the privacy implications of new technology often implicitly refer to these factors. The understanding of privacy as contextual integrity is based on philosophical privacy theories that go beyond the famous "right to be let alone" [67] and frames privacy not as an individual right with fixed boundaries (e. g., the private home vs. the public square) but as a concept that focuses on the role of information in relations. This focus on informational privacy is useful in the context of the digital technologies we consider in this study, but it is worth noting that other dimensions of privacy like decisional and locational privacy [52] as well as physical, social, and psychological Since the emergence of the COVID-19 pandemic in early 2020, multiple research groups have investigated people's privacy perceptions of smartphone apps for digital contact tracing. One of the earliest studies was conducted by Zhang et al. [69] , who explored US Americans' perceptions of privacy and surveillance in the COVID-19 pandemic in an online survey with 2612 participants, administered between March 30 and April 1, 2020. Their preliminary results indicate that Americans favor traditional contact tracing and health screenings over app-based digital contact tracing. In a conjoint analysis the researchers identified two attributes of contact tracing apps with statistically significant effects on the reported likelihood of downloading the app: participants preferred decentralized data storage and Bluetooth proximity technology over location tracking. Between late March and early April, 2020, Altmann et al. [4] conducted several representative online surveys in France, Germany, Italy, the UK, and the US to study the acceptance of app-based contact tracing. When shown the description of a hypothetical contact tracing app, 75 % of participants indicated their willingness to install the app, with a significantly lower acceptance in Germany and the US than in the other three countries. The study found lower acceptance for participants who have less trust in their national government, and the main reasons against app installation were identified to be fear of government surveillance after the pandemic and the phone being hacked. In early April, Simko et al. [56] started a longitudinal study on contact tracing and privacy with a sequence of online surveys, each with around 100 participants from around the world. Their preliminary results indicate that 72 % of participants would be at least somewhat likely to download a contact tracing app if it provides "perfect data protection". In April 2020, Trang et al. [61] conducted a survey with 518 participants in Germany to examine app specifications for mass acceptance of contact tracing apps in three dimensions: benefit appeal, privacy design, and convenience design. Participants were categorized into three groups based on their willingness to install a contact tracing app: critics, undecided, and advocates. For critics, self-benefit and high privacy were most important, while high convenience design had the strongest effect for undecided participants. For advocates, all three dimensions played a subordinate role. Between late April and early May, 2020, Li et al. [33] surveyed 208 US citizens on privacy-utility trade-offs on the basis of six contact tracing app scenarios in two dimensions: centralized vs. decentralized architecture and location collection of infected users (in public places) vs. no location collection. Their preliminary findings show that a majority of participants preferred to install apps that use centralized servers and share diagnosed users' recent locations in public places to reveal hot spots of infection. Kaptchuk et al. [31] conducted a survey with 789 US participants to study the influence of accuracy and privacy on the intention to install contact tracing apps. They found that 70-80 % of participants were willing to install an app that is perfectly private, accurate, or both, and that false negatives had a significantly stronger influence than false positives or privacy risks. A related, broad field of research are users' privacy perceptions and sharing behavior of health data [9, 25, 36, 43, 48, 49] . A study investigating individuals' views of sharing sensor data [43] revealed that users were more comfortable sharing activity data such as sleep, mood, and physical activity as opposed to communication logs, location, and social activity. Users were more comfortable with sharing the mentioned data with their doctors than with family members or electronic health record systems [43] . Patients of a clinic for mood and anxiety disorders were asked about a hypothetical app to better diagnose and treat their health disorder [36] . Most of the patients stated to be willing to install such an app. Patients were reluctant to share personal communication data (audio and SMS) but more willing to share less personal data, such as when their phone screen was turned on and off. Relevant factors for non-disclosure of HIV health information in the context of sex-social apps were stigmatization and the fear for discrimination and disadvantages [49] . People using at-home DNA testing feared surveillance by the government, saw the misuse of a third party as potential risk of sharing health DNA data and expressed the desire for transparency and some level of control over their health DNA data. Participants also showed resignation towards privacy as they felt a lack of control over their data [9] . In an interview study on the perception and use of mobile health apps, "lack of need, " "lack of app literacy" and "lack of awareness" were mentioned as barriers for the usage of health apps [48] . Users reported aspects such as "lack of time and effort" and too much storage space or high battery consumption as barriers to a continued usage of health apps [48] . In the context of a workplace health promotion campaign involving the use of step-counting technology, participants had only little concerns to share their activity data with organizational entities, such as their employer or technology companies, but were more concerned regarding disclosure to other individuals [25] .The positive rhetoric of the campaign also had a positive influence on the willingness to share activity data. The most common and widely applied theoretical frameworks for investigating factors that can explain usage intention and acceptance of information technology include the theory of planned behavior [2] and the technology acceptance model (TAM [19] ); Venkatesh et al. [63] provide an overview. Factors that have been identified to directly or indirectly influence the intention to use and accept technologies (e. g., apps, social network sites, blogs) are perceived usefulness and perceived ease of use [12, 19] , social influence [29, 63] , facilitating conditions, demographic factors like gender, age and experience [63] , and trusting the party behind the technologies [11] . Another investigated factor is privacy. Gu et al. [27] studied privacy concern for mobile applications in relation to the permissions they request. They found that an app's popularity had a positive and the overall privacy concern a negative effect on download intention. Following this research, Wottrich et al. [68] studied the trade-off between privacy and the value an app has for the user. They found that perceived intrusiveness and privacy concern have a negative impact on the decision whether or not to install an app, though the positive effect of the perceived value of the app is more important in the privacy calculus. Focusing on health-related apps, Zhou et al. [70] surveyed and interviewed 117 smartphone users, the majority of whom had already used mobile health apps. The study found that privacy and security issues can be barriers to adoption regardless of demographic factors. To understand which data processing factors influence people's willingness to use corona apps, we conducted an online survey in Germany, the USA, and China between June and August 2020. At the core of our study, we presented participants with ten scenarios in the form of vignettes, each describing a hypothetical corona app, and asked them to assess each app according to a set of criteria. In the following, we describe our vignette design and the rest of our questionnaire, the data collection process including the corresponding state of the pandemic in each country, and the methods used for data analysis. Vignettes are "short stories about hypothetical characters in specified circumstances, to whose situation the interviewee is invited to respond" [22] and have been used in previous work studying contextual privacy [7, 20, 35] . The vignettes at the heart of our study are composed of different factors of data processing practices, inspired by the contextual integrity framework. Each factor can be assigned one of multiple factor levels we determined by examining existing corona apps. To ensure our study is firmly rooted in existing corona apps from around the world, three researchers investigated the space of apps and their data processing practices by systematically examining 43 apps from Wikipedia's list of government-endorsed corona apps as of April 27, 2020 1 . For each app, we analyzed publicly available resources: listings in app stores, the app's official website, terms of service, privacy policies, and official press announcements. The retrieved information focused on the concept of data flows in the contextual integrity (CI) theory: actors (primary and secondary data recipients), information types (collected data), and transmission principles (what triggered a data transmission process, retention). We also noted potential technical and societal implications of using an app as they were discussed in app reviews and the public debate and could influence people's willingness to install and use an app. For systematization and documentation purposes we collected the following app metadata: name and country of the app, its development process and status, and the underlying technical mechanism(s) or protocol(s). We also identified the core purpose of each app and grouped apps with similar functionalities to categorize the landscape of government-backed corona apps. To reduce complexity for our study, we streamlined the CI-based aspects as follows: We did not differentiate between primary and secondary data receivers (respectively, the organization responsible for the data processing and third parties the data could possibly be shared with). Similarly, we chose not to consider multi-stage data transmissions (e. g., encounter information initially being sent to no one and only stored on the phone but transmitted to health authorities' servers after a positive test result had been registered). To reduce cognitive load for our participants, we differentiated between payload data and to what degree it allowed for identification of the app user. This left us with five CI-based data collection factors (2.-6. in the list below), to which we added the app's purpose and the aforementioned societal and technical implications. For each factor, we determined a set of concrete factor levels which we would later combine into scenarios of hypothetical yet realistic corona apps for our survey. The factor levels were derived from the respective information collected from real-world corona apps, with the goal of reflecting the range of real-world practices while keeping the number of factor levels as small as possible. For example, the observed data retention times could be classified as fixed short-term intervals (between 14 days, i. e., the typical duration of quarantine for COVID-19 patients, and several weeks), unspecified but identifiable points in time ("when the need for contact tracing is over"), and unspecified / indefinite. This spectrum is reflected in the final set of factor levels: one month (fixed shortterm interval), until the end of the current coronavirus regulations (unspecified but identifiable), unspecified. The final sets of factors and factor levels are as follows: In our survey a vignette, as shown in Figure 1 , is a short description of a hypothetical smartphone app, consisting of an immutable text template (the non-highlighted black text) with placeholders for the eight factors (colored boxes), each of which was assigned one out of multiple different factor levels (the text in the colored boxes) to create a specific scenario. Across different scenarios and participants, we systematically altered the factor levels in order to measure how the individual factors and factor levels affected our participants' assessment of the hypothetical apps. Starting from the set of all 15 5520 possible combinations of factor levels that could theoretically compose a scenario, we carefully defined dependencies between specific factor levels in order to exclude scenarios whose combinations of factor levels would not make sense. The specification of dependencies was the outcome of thorough discussions between three researchers and each feature dependency in the set required joint agreement. The following list describes the dependencies between different factor levels for the composition of vignettes. • Symptom check apps always required health or activity data. • Contact tracing apps always required the infection status and either encounter data, location data, or both. • Quarantine enforcement apps always required location data and unique identification of the individual user. • Health certificate apps always required the COVID-19 infection status and the societal implication of extended personal freedom of movement or travel. • Whenever the use of an app implied as societal implication extended personal freedom of movement or travel, it was required that the data collected by the app allowed for unique identification of the individual. • For data made available to the public, data retention was set to "unspecified". Applying these dependencies to our initial set of possible scenarios resulted in a final set of 50 625 unique vignettes, which were distributed across the 5 app purposes as follows: 14 850 for contact tracing, 9450 for symptom check, 3780 for quarantine enforcement, 21 600 for information, and 945 for health certificate. From this main set of unique vignettes, we composed individual sets of 10 vignettes for each questionnaire. For each participant, we (i) randomly selected two vignettes per app purpose under the condition that (ii) these two vignettes were different in every factor level (as long as this condition could be fulfilled). Within a participant's set, vignettes were always shown in random order. The vignettes constituted the core of our questionnaire, which we outline in the following. The full version can be found in Appendix A. At the beginning of the questionnaire, we introduced the purpose of the study, provided information about data collection and processing, and asked for the participants' consent to proceed. Section 4.4 provides further information how we protected participants' privacy. Possessing a smartphone is crucial to determine how the use of mobile apps is perceived by participants. Therefore, we asked if participants owned a smartphone (Q1) and, if yes, what operating system they used (Q2) and how satisfied they were with certain aspects (e. g., battery life) of their smartphone (Q3). Personal experience with the coronavirus was found to be a significant factor in the adoption of (hypothetical) contact tracing apps [69] . Hence, after defining key terms, we asked whether participants (Q4) or people in their social circles (Q5) had tested positive for coronavirus and if participants had been quarantined or quarantined themselves because of the virus (Q6). We further asked if they lived with a person at higher risk (Q7) and how concerned they were about someone close to them becoming infected with the coronavirus (Q8). As described in Section 4.1.2, we presented each participant with a unique set of ten (hypothetical) apps. For each app, we asked participants how likely they were to use the described app (Q9) and to estimate the expected amount of app users in their country (Q10). We further asked them about the perceived normative pressure Ajzen [3] in their social circles to use the app (Q11) and to assess the usefulness of the app to fight the global pandemic (Q12). Next, we asked participants if they were aware of existing corona apps in their country for any of the five purposes covered in this study (Q13). We further asked them to indicate if they were actively using such an app (Q14) and, if yes, which one (Q14a), or why they did not do so in the opposite case (Q14b). At the end of this section, participants were asked the open-ended questions of potential positive (Q15) and negative (Q16) aspects of corona apps. Imagine an app that provides information about your health and needs to be shown if you want to visit a certain place. • e app uses health or activity data, your COVID-19 infection status, and your current or past location(s). • In addition, the app collects data that could be used to uniquely identify you. • is data is sent to research institutions when you request your health report and it will be stored until the current coronavirus regulations end. • e app decreases your phone's baery life. • Using this app may increase your personal freedom of movement or travel. To assess participants' general attitude towards the institutions tasked with fighting the pandemic, we asked three questions: First, we asked participants to rate the measures applied in their region to counter the pandemic (Q17). We further asked them about their opinion of six public institutions: health authorities, law enforcement, research institutions, private companies, and federal and regional governments (Q18). This part concluded with a question about the acceptance of private companies' practice to share anonymized data, such as aggregated phone location data, with public authorities to help limit the spread of the pandemic (Q19), which is a practice used in several countries such as the US and Germany [14] . Concerns. Finally, we measured participants' individual privacy concerns using the Internet Users' Information Privacy Concerns (IUIPC) constructs for Control, Awareness (of privacy practices), and Collection [34] . We implemented an English-language preliminary version of our survey to ensure comprehensibility and estimate timings. The prestudy survey was distributed to experienced researchers and within our own social circles via snowball sampling. 33 participants completed the survey between June 1 and June 5, 2020. Based on participants' feedback, we changed the presentation of the scenarios to improve readability and highlight differences between the different apps. In the period from June to August 2020, the online survey was distributed in three different countries: Germany, the United States, and China. These three countries were selected for their different approaches to corona apps and for their important roles in the global pandemic: China as the country which was struck first, the USA, which quickly became the most affected country in terms of confirmed cases, and Germany as a representative for a European country that handled the first wave of the pandemic relatively well. At the time of the survey all countries were in different states of the pandemic, which we outline in the following subsections to provide context for our results. We purchased the online panels as a full service from Lightspeed Research (Kantar), including survey implementation and translation, participant recruitment, and data quality assurance (cost was EUR 2500 per online panel plus EUR 4000 for implementation and translation). Representativity quotas were matched with an average discrepancy of 2.5 % (US), 2 % (Germany), and 2.9 % (China). Respondents faster than 40% of the median response time were directly discarded by Kantar. We created the German and English versions of the questionnaire ourselves. The translation of the English questionnaire into Mandarin and the translation of the Chinese open-ended answers into English were commissioned to a translation agency. With the help of a native speaker from our social circles, we followed the quality control process of back translation for the questionnaire and corrected a few minor errors. Back translation of the openended questions (Q14a, Q14b, Q15, Q16) was carried out on several random samples as the cost of a complete back translation did not seem to justify the expected benefit. 4.3.1 Germany. The study was conducted surveying a sample of 1003 participants representative for the German adult population by gender, age, region, and education from June 9 to June 11, shortly before the launch of the national contact tracing app, "Corona-Warn-App" [53] , on June 16. This app uses the Exposure Notification API [6] , which is influenced by the Decentralized Privacy-Preserving Proximity Tracing (DP-3T) [62] and the Temporary Contact Number (TCN) [59] protocols. At the time of the study, two other corona apps supported by the federal government were already available in Germany: "NINA" is the government's general emergency information app currently used to provide information about regional coronavirus regulations and about the state of and recommended behavior during the pandemic (available since June 1, 2015; coronavirus reports since March 2020). The "Corona-Datenspende" [50] app is a research project by the Robert Koch Institute (RKI, German federal government agency responsible for disease control and prevention), which collects and analyzes vital data recorded by fitness trackers to help assess the number of people with COVID-19 (available since April 7, 2020). Germany reported its first SARS-CoV-2 cases in February, with the highest number of new cases in late March and early April. The spread of the virus was primarily fought through strict contact restrictions, which were in effect from March 22 to early May. Public debate about apps for digital contact tracing started in April and received media attention over the following weeks including discussions about data protection and the underlying protocols. As of June 9, 2020, when the survey was distributed, Germany had 18 4543 confirmed cases of infected people, thereof 17 0200 estimated recoveries, 5632 estimated active cases, and 8711 deaths [51] . The national 7-day rolling average of daily new cases per 10 0000 residents was very low at 3.0, with thresholds of 35 and 50 on county level for tightening the measures to fight the pandemic. States. In the US, we surveyed a sample of 1003 participants representative for the US adult population by gender, age, region, and education from July 6 to July 14. At the time of the study, one corona app supported by the federal government was already available: The "COVID-19 Screening Tool" [5] is an app and web application made available on March 27, which recommends actions based on user-provided information such as symptoms, contacts, and travel. It was developed by Apple and the Centers for Disease Control and Prevention (CDC). While several public and private initiatives had been developing digital contact tracing apps for the US, no nation-wide rollout was expected for the near future. At the time of writing, six US states and Guam had released apps based on Apple's and Google's Exposure Notification API [55] . The United States were hit by the pandemic in mid-March and soon became the country with the highest number of officially confirmed cases worldwide. Stay-at-home orders came into effect in 44 states between March 20 and April 7, 2020 and were lifted between April 26 and June 11, 2020. However, the number of cases increased again during July and August. As of July 6, 2020, when the survey was distributed, the US had 2893083 officially confirmed cases of infections, thereof 13 24947 estimated recoveries, 14 48438 estimated active cases, and 11 9698 deaths [16] . The national 7-day rolling average of daily new cases per 10 0000 residents was at 103.5. In China, we surveyed a sample of 1019 participants representative for the Chinese adult online population 3 by gender and age from July 27 to August 6. In February, China was the first country to introduce various mandatory health code systems at the local and regional level. These systems use QR codes that need to be scanned with mobile applications to track and ultimately prevent the movement of potentially infected individuals based on basic health information and travel history [39] . The existing health code systems serve multiple purposes, such as providing general information about the coronavirus, calculating the risk of infection, contact tracing, and quarantine enforcement. In contrast to Germany and the US, most Chinese "corona apps" are integrated into widely used platform economies, e. g., WeChat or Alipay, which fostered their quick adoption. China's Hubei province was the epicenter of the worldwide SARS-CoV-2 outbreak in January and February 2020. The central government reacted with several strict regional lockdowns, effectively quarantining more than 60 million people (e. g., Wuhan, Hubei, January 23 to April 8). The exponential growth of officially confirmed cases in China ended in early March. As of July 27, 2020, China had 83 891 officially confirmed cases of infected people, thereof 78 918 estimated recoveries, 339 estimated active cases, and 4634 deaths [42] . The national 7-day rolling average of daily new cases per 10 0000 residents was at 0.02 with only 209 new cases all over China between July 21 and July 27. Our department does not have an institutional review board. Instead, our study followed best practices of human subject research and data protection guidelines, including the rules of the European GDPR. All data protection measures were reviewed and approved by our institution's data protection office. Kantar, our panel provider, has commited itself to follow the ICC/ESOMAR code of conduct [30] . 4.5.1 Statistical Analysis. To understand which factors influence participants' decisions to use an app (Q9 = outcome variable), we performed a regression analysis for the data utilizing the cumulative link models module of the ordinal R package [17] . In line with best practice [71] , we first calculated a model containing all factors available in our data set and successively removed nonsignificant factors based on the Akaike information criterion (AIC) of the resulting model to determine the model that best fit the data. We conducted this analysis for each country individually as the circumstances and timing of the data collection in each country varied (see Section 4.3). For each factor we chose as a baseline the level that we expected to have the least effect (e. g., the "information" purpose or the middle choice for Likert-scale questions). For some of the Likertscale questions we grouped the answers to reduce the number of factor levels in the model, e. g., the assessments of the government response (Q17) "too lenient" and "way too lenient" were combined into "too lenient". We also excluded all responses that chose "prefer not to answer". To analyze the open-ended answers to the questions why participants did not use a corona app (Q14a) and what they perceived to be positive (Q15) and negative (Q16) aspects of corona apps, we used an iterative open coding procedure. We used a mixed-methods approach with qualitative and quantitative elements, as suggested by Mayring [37] . We first assigned codes to the text (inductive categorization) and analyzed the frequency of the codes afterwards. Coding was performed by two researchers with interdisciplinary backgrounds in psychology and information security. In a first step, the two coders independently coded the first 300 open responses from each country to derive common themes and create an initial coding frame for each question. This process consisted of closely examining participants' answers to identify and conceptualize categories. Each item could be assigned one or multiple codes. The coders then discussed their codes and agreed on a final coding frame for each question. The frame was validated by both coders coding answers 301-500 for each question (20 % of the data, which is in the typical 10-25 % range to determine coder agreement [46] ). As a measure for inter-coder reliability, ReCal2 [23] was used to compute Krippendorff's alpha for each code, of which we report a weighted mean that takes into account the frequency of each code. Finally, the remaining sets of 500 answers for each question and country were coded by a single coder. In this section, we first describe our samples based on demographic data and participants' survey responses. We then compare the responses to the four questions asked for each scenario and analyze the effect sizes of several factors that impact users' willingness to use corona apps across the three countries. Finally, we look in detail at participants' individual perceptions of corona apps. In Table 1 , we provide demographic information (gender, age, and education) about our participants as delivered by our panel provider and additional information collected in our survey. For all three countries, we observe higher smartphone prevalence than reported in recent data [58] , but our numbers are comparable to those of smartphones and feature phones combined. The high prevalence (99 %) of smartphone use in China reflects that our sample is representative for the more technophile online population (see Section 4.3.3). Although participants seemed to be rather satisfied with their current phones, they were, across all countries, significantly less satisfied with their phones' battery life than with other properties. Between 1.3 % and 2.2 % of participants reported that they had tested positive for coronavirus. While these numbers are higher than those of officially confirmed cases for each country (see Section 4.3), they fall within the margin of error of 3 %. In all countries, about 10 % of participants reported that a person in their social circles had been infected with the virus. Between countries, we observe differences in the number of participants who had been under quarantine since the beginning of the pandemic, with the US reaching the highest rate (37 %) and Germany the lowest (15 %). Despite different states of the pandemic in the surveyed countries, similar numbers of participants (about 10 %) were concerned about becoming infected with coronavirus. Table 1 also provides information about participants' opinions of institutions tasked with measures to counter the pandemic, what types of corona apps participants already knew to exist, and their attitude towards online privacy using three IUIPC dimensions. Next, we compare the responses to the four questions asked for each hypothetical app scenario (Q9 to Q12) across the three countries. Table 2 shows mean response values per country along with standard deviations across all app scenarios. Questions were answered on numeric 7-point scales with a higher number representing a more positive response, i. e., in the case of Q9, higher willingness to use the presented app. Participants in China were generally more willing to use the apps presented in the scenarios, with Germany ranked in the middle and US participants expressing the lowest average willingness to use an app. With a one-way analysis of variance (ANOVA) we found statistically significant differences ( < .05) for Q9 between all three countries. Post-hoc -tests of independence also showed that individual differences between all pairs of countries were significant ( < .05 equivalent, values Bonferronicorrected for multiple testing). Expected adoption (Q10), perceived pressure (Q11), and perceived utility (Q12) of corona apps were significantly higher in China than in Germany and the US. We found no significant differences for Q10, Q11, and Q12 between Germany and the US. Table 3 takes a closer look at participants' willingness to use corona apps (Q9) by country and app purpose. The figures indicate how many participants tended towards a positive answer (above the medium response value, i. e., 4) regarding their willingness to use the presented app. Within countries, we observe only small differences in the numbers for different app purposes, while a crosscountry comparison yields the general willingness to use corona apps for any purpose to be much higher in China compared to Germany and the US. Across all countries, we observe the highest willingness to use for contact tracing apps and the lowest for quarantine enforcement. However, these values can only provide a first impression since they represent averages per app type and country and contain interfering effects between all factors that constitute a scenario. Section 5.3 studies the individual effects in more detail. Table 4 lists the data collection factors and factor levels in our app scenarios that influence participants' reported willingness to use a corona app, along with their respective effect sizes and -values. Responses collected in the non-scenario parts of our survey that we found to impact participants' willingness to use a corona app are listed in Appendix B, Tables 5 and 6. Statistically significant factor levels and answers ( < .05) are printed in bold in all tables. Positive estimate values indicate a positive influence on the willingness to use an app, negative estimates indicate tendencies to not use an app. During the model optimization process several factors were excluded in some countries while remaining in the model for the other countries (see Section 4.5.1 and B). For example, the societal benefit on the regional level (see Table 4 ) is a significant predicting factor in the US and Germany but did not make it into the final model for China. In the following, we report for each country which factor levels and non-scenario answers positively or negatively influenced participants' decision to use an app and touch upon the differences between the three countries. In Germany, being male was the only demographic factor with a significant positive influence on participants' willingness to use a corona app, while education level and age were excluded from the model for not helping explain the decision to use an app. Higher privacy concern with regard to data collection practices (IUIPC: Collection) had a significant negative influence on the decision to use an app. Strong opinions on the location accuracy of the phone (Q3), both positive and negative, had a significant positive influence on the willingness to use any of the apps. Previous use of corona apps and knowing apps for symptom checks or health certificates had a significant positive impact on the willingness to use a corona app (Q13). Conversely, knowing apps for contact tracing had a significant negative impact (Q14). Additionally, rating the practice of companies sharing customers' data with authorities to help fight the pandemic as acceptable (Q19) had a significant positive impact on the willingness to use an app in any scenario. The level of concern about becoming infected with coronavirus (Q8) had a significant (Q17) had a significant positive impact on the willingness to use an app. The results further suggest that a favorable rating of institutions (health authorities and state government) had a significant and positive impact on the decision to use any of the apps, whereas rating them unfavorably (federal government) had a negative impact (Q18). Within the app scenarios, contact tracing was the only app purpose with a significant positive influence on participants' willingness to use a corona app. Technical implications often negatively impacted participants' willingness to use the described app, and did so significantly in the case of increased battery consumption as well as malfunctions in contact tracing, quarantine enforcement, and health certificate apps. This supports our descriptive results of participants being least satisfied with their smartphones' battery life. Scenarios with the societal implication of a more timely adjustment of local coronavirus regulations also had a significant positive impact on the willingness to use an app. Regarding the specific types of data used by the fictitious apps, encounter data significantly positively influenced participants' decisions to use an app while the collection of demographic data and data that could be used to uniquely identify the user was opposed. German participants also had a strong opinion about who should be the data receiver. When scenarios described data transfers to private companies, law enforcement, or the general public, participants were significantly less likely to use the app. In the United States, male gender had a significant positive influence on the willingness to use any of the presented apps, as did higher age, although to a lesser degree. Similar to the German data, participants' education level had little to no impact. Participants with higher privacy concern regarding control of their personal information (IUIPC: Control) were significantly less likely to use an app. In contrast to the model for the German data set, the suspected coronavirus infection had a significant positive impact on the decision to use any of the apps (Q4) in the US. As for the German sample, rating as acceptable the practice of companies sharing customers' data with authorities to help fight the pandemic (Q19) had a significant positive impact on the willingness to use an app. Similarly, the results show that favorably rating some institutions (research institutions and state governments) had a significant and positive impact on app adoption, while, interestingly, unfavorable ratings of law enforcement also had a significant positive impact on the willingness to use an app (Q18). Concern about becoming infected with coronavirus (Q8) was a significant influence on the decision to use any of the presented apps: Higher levels of concern about an infection positively influenced the willingness to use an app while lower levels had a significant negative impact. Similar to the German model, prior use of any corona app, as well as knowledge of health certificate apps, had a significantly positive impact on the willingness to use the apps (Q13, 14) . Regarding the attitude towards certain properties of one's phone, satisfaction with the phone's location accuracy and dissatisfaction with its battery life had significant positive and negative impacts, respectively, on US participants' willingness to use an app, the former being similar to the German sample. Looking at the influence of the factor levels in the app scenarios, we found the app purpose of contact tracing to have a significant positive influence on US participants' willingness to use an app, as in the German sample. However, in the US a positive influence, to a lesser degree but still significant, was also found for the app purposes of symptom checks and health certificates. When scenarios described manual data transmission, participants were slightly but significantly more willing to use the app compared to scenarios with automatic data transmission. The societal implication of a more timely adjustment of local coronavirus regulations also had a significant positive influence on the willingness to use the app, while the other societal implications did not have any impact. Compared to scenarios that did not mention the retention period, if an app's data storage was limited to the end of the coronavirus pandemic, participants were significantly more willing to use it. Similar to the German model, malfunctions in contact tracing, quarantine enforcement, and health certificate apps, as well as increased battery consumption, had a significant negative impact on the willingness to use a corona app. US participants had a similar opinion as Germans about who should be the data receiver: Scenarios with data being sent to private companies or law enforcement significantly negatively influenced the willingness to use an app compared to scenarios that did not mention who would receive the data. In contrast to the model for the German data set, specific types of payload data did not significantly impact participants' willingness to use an app, while participants from both countries share the negative attitude towards corona apps that collect demographic data or data that allows for the unique identification of the individual. In China, demographic information was no good predictor for participants' willingness to use any type of corona app: Age and gender were not part of the final model, and similar to the US model, education had no significant impact. Participants with higher privacy concern (IUIPC: Control and Awareness) were found to be significantly more likely to use corona apps. An individual's infection status was not part of the final model for the Chinese data. Individual infection concerns (Q8) did not have any significant impact on app use. However, living with a person at higher risk (Q7) significantly positively influenced the willingness to use an app. Similar to the other models, prior usage of any corona app (Q14), as well as knowledge of apps for symptom checks, quarantine enforcement, and contact tracing (Q13), positively influenced the willingness to use an app. As in the US, dissatisfaction with the battery life of one's phone (Q3) had a significant negative impact on the willingness to use any of the presented apps. Additionally, as for the German and the US samples, rating as acceptable that companies share customers' data with authorities to help fight the pandemic (Q19) had a significant positive impact on the willingness to use the app in any of the scenarios, as did a favorable opinion of private companies (Q18). Scenario-based factors were also influential: In the Chinese model, the app purposes of quarantine enforcement and symptom check had a significant negative influence on the willingness to use an app. The effect size for quarantine enforcement was larger than in the other countries, where it was also not significant. Regarding the types of payload data only scenarios where the data type was not specified had a significant negative influence on the decision to use the app. In stark contrast to the results from the US and Germany, Chinese participants were significantly more willing to use the presented app if it collected data that could be used to uniquely identify the person. Regarding potential receivers of the data we Table 1 , the number of participants who reported to already use a corona app (DE: 42 / 4.2 %, US: 66 / 6.6 %, CN: 614 / 60.3 %) reflects whether government-recommended apps already existed at the time of the study. Those who reported to use an app were asked in Q14b which app they used. In Germany, 25 participants provided insightful answers. Two mentioned using a specific app but could not remember "division into good and evil", "stigmatization" 2 2 0 9 9 2 disinformation "more fake news", "government may hide the truth" 0 0 0 1 7 39 anxiety "would make me more nervous", "freaks people out" Other don't want "I just don't want to", "no", "stupid" 23 36 5 --generic negative "everything", "yes", "many" ---6 21 4 other "too much information", "I do not trust them" 14 20 3 17 24 25 none "I don't see any", "nothing really" ---87 72 232 Non-answers don't know "don't know", "not sure", "hard to tell" the name, one mentioned an app for general news, five a non-app news source, another five Germany's official disaster information app, NINA, that has been extended to provide coronavirus-related news (see Section 4.3.1), one a non-corona-specific health app, and 11 named coronavirus-related apps, 9 of which we could map to "Corona-Datenspende", the data donation app launched by German health authorities [50] . In the US, we received 21 answers. Seven participants named COVID-19-specific apps (Apple's COVID-19 app, C Spire Health, Healthy Together, and How We Feel), two disaster information apps, four general health apps, another four a non-health-related app or service (such as "Facebook"), and two non-app news sources. In China, 153 participants reported to use health QR code apps issued by various local or regional authorities, which are often WeChat or Alipay plugins, and 108 specifically stated using (plugins for) WeChat or Alipay. 15 participants mentioned to use other platform economies, e. g., Weibo or Tencent, in a COVID-19-related context. An additional 49 participants named Availability availability "everyone has a smartphone", "convenient" 27 31 22 Psychological sense of protection "makes one feel safer", "relieve stress" 8 3 12 awareness "remind us", "take it more seriously" Other generic positive "very good", "it helps", "many" 57 56 100 other "big data", "publicity", "no more home office" 18 10 35 none "none", "not really", "nothing" 212 170 16 Non-answers don't know "don't know", "hard to say", "not sure" 27 64 13 negative "virus gets on phone", "invasion of privacy" 63 69 17 unclear "Ues it impacts", "Japanese style", "ccorona" 25 32 49 no answer "jhgfkjfkuz", "Tv", "na", "??" 14 17 4 further COVID-specific apps, and 27 reported using non-coronaspecific health apps. During the coding process of the open-ended answers, we observed a large overlap between the reasons not to use a corona app (Q14a) and perceived negative aspects of such apps (Q16). This led us to devise a common coding frame for both questions. Our combined codebook for Q14a and Q16 contained 34 codes. Inter-coder reliability as determined by Krippendorff's alpha was in the (0.66, 1) range for individual codes, with the rather generic "unclear" code scoring lowest and a weighted mean of 0.91. Q14a was only displayed to participants who had indicated in Q14 that they did not use a corona app, numbers shown in the first data row of Table 7 , while Q16 was displayed to all participants. Across all three countries, the most popular reason not to use a corona app (Q14a) was that one was (presumed) not to be available (yet) ("no app", DE: 214, US: 222, CN: 73) or that there were only ones that did not suit participants' particular needs ("no suitable app", DE: 61, US: 18, CN: 13), such as not having been thoroughly tested or officially recommended by authorities. Another common sentiment was that the app was simply perceived as unnecessary, either in a general way (DE: 96, US: 103, CN: 56) or for more specific reasons, such as the worst phase of the pandemic being over ("state of the pandemic", DE: 8, US: 5, CN: 18). Unique to China (32) was the observation that there was no need for a standalone app since coronavirus-related functionality was already offered by plugins for widespread multi-purpose apps like Alipay or WeChat. A similarly distinct reason for Chinese participants not to use a corona app was the fact that the use of such an app was not mandated by the government ("not mandatory", DE: 0, US: 1, CN: 5), while only participants in Germany and the US questioned the severity of the COVID-19 pandemic in general ("coronaskeptic", DE: 12, US: 16, CN: 0). Reasons related to personal phone use, such as not carrying the phone at all times, were more frequently mentioned in Germany and the US ("phone use", DE: 21, US: 29, US: 1). The latter could be rooted in the Chinese sample being only representative for the Chinese online population. When we more broadly asked for negative aspects of corona apps (Q16), participants in all countries prominently voiced privacy concerns (DE: 292, US: 337, CN: 179), but German and US participants much more prominently worried about government surveillance (DE: 174, US: 70, CN: 1), their personal autonomy or rights being infringed (DE: 36, US: 38, CN: 5), or discrimination rooted in (non-) use of an app (DE: 9, US: 9, CN: 2). In turn, in the Chinese sample, in which a majority reported to use coronavirusrelated functionality on their smartphones, one prominent negative sentiment was anxiety that the phone could potentially display coronavirus-related warnings at any given time (DE: 12, US: 20, CN: 69). Still, overall satisfaction with these apps was reported to be high, with 232 of Chinese participants stating that there were no negative aspects at all and 45 even mentioning positive aspects as an answer to this question. Our coding frame for perceived positive aspects of corona apps consisted of 20 codes (Krippendorff's alpha: range (0.45, 1), weighted mean 0.82) as depicted in Table 8 . The three lowest-performing codes, all in the (0.45, 0.47) range, originate from rather unspecific categories ("other", "unclear") and the fact that one code ("symptom check") was rather rare in the dual-coded segment of the data. The answers provide additional hints that people seem to prefer what they are already familiar with, either through public debates or actual use of an app: 40 Chinese participants perceived the health certificate functionality to be a positive aspect of corona apps, compared to none in Germany and only one in the US. Another 87 responses from China specifically pointed out the use of apps to keep track of people's travel history. While we had not identified this as a separate app purpose in our analysis of existing apps, which included the Chinese health QR code system, the frequency of answers referring to this aspect of the system (rather than the "health certificate" part) prompted us to introduce "movement" as a distinct code. In Germany and the US, where public discussions of smartphone apps against the pandemic had centered on contact tracing, this purpose was the second most often named positive aspect of corona apps (DE: 106, US: 103) -directly after "none" (DE: 212, US: 170), which was only stated 16 times in China. In contrast, almost twice as many Chinese participants (100) voiced an unspecific but positive opinion of coronavirus-related apps as participants from Germany (57) or the US (56) . This provides another hint that corona apps being in actual use has a positive impact on how people perceive them. Our research identified factors that impact people's willingness to adopt mobile apps designed to help fight the COVID-19 pandemic and provides insights into how these apps are perceived. The results have implications not only for the design of mobile apps developed to help fight the COVID-19 pandemic but also for the design of health-related mobile apps and for apps released in the public interest whose efficiency relies on widespread voluntary adoption. The theory of privacy as contextual integrity states that the appropriateness of information flows depends on contextual informational norms governed by actors, transmission principles, and information types. Our study confirms that these factors -although not all different levels -play a role in people's decisions to use a corona app. We measured the importance of each factor as the effect on the willingness to use an app and found that different combinations of these factors in fact violate informational norms that differ between countries. For example, sharing any corona-related app data with law enforcement agencies violates informational norms in Germany and the US. Moreover, when the collected data and data sharing are limited and purposes are less invasive, the willingness to use apps increases. Quite contrary to the idea of CI we also find that the specific information types and transmission principlesat least in the way they were modeled in our survey -only play a subordinate role. Contrary to theories that see informational privacy primarily as a means to limit disclosure [28] , our data supports findings from IoT- [20] and health-related privacy research [9] : participants are willing to share data when it supports a common good (i. e., "regional releases of lockdown measures") over individual benefits, although participants still expect that informational norms are upheld. Familiar is Subject to Change Our analyses indicate that people favor data processing practices and are more willing to adopt technologies they are already familiar with, such as apps for digital contact tracing in the US and Germany, where the use of smartphone apps for this purpose has been subject of the public debate. In China, a prominently reported positive aspect of corona apps was movement control (Table 8) , which had already been put in place there at the time of the survey via the Health Code systems. Chinese participants also favored apps that allowed for unique identification of the individual, reflecting that it is "standard practice in China" [65] to send personal data linked to one's national ID to government servers. This supports prior research that found people to be more comfortable with allowing data collection in IoT scenarios they perceived to be realistic and "happen today" rather than at a later point in the future, and they were more likely to allow data collection for specific "greater goods" such as video surveillance for crime prevention [20] . German and US participants' favorable stance towards corona apps that had been positively discussed in the media backs up previous findings that a positive rhetoric around the associated technology can increase people's willingness to share personal data [25] . This reaffirms that privacy norms evolve [40] and raises the question how people's stance towards corona apps -and apps that collect data for a common cause in general -will change once the COVID-19 pandemic is over. In all surveyed countries, aspects regarding pandemic control were among the most frequently mentioned positive aspects of corona apps. Thus, many citizens seem to be generally open to the idea of using mobile apps to help limiting the spread of a virus. Privacy concerns were the most frequently mentioned negative aspects of corona apps in all countries. A rigorous approach towards privacyfriendly technologies, which prevent privacy violations a priori, e. g.privacy-by-design, seems vital for the success of such apps. Somewhat surprisingly, the type of payload data did not have any significant negative influence on the willingness to use a corona app in our study. This implies that users may be willing to share additional data if other conditions are met. Citizens of Germany and the US seem to be willing to use apps for contact tracing without technical malfunctions which ensure anonymity and are administered by the health authorities. Such apps can be further developed to be ready for deployment in potential future pandemics. In China, apps facilitating individual contact tracing seem to be less relevant. This might be due to the strict regional measures implemented by the authorities as soon as infections are detected and due to the fact that authorities in China already have access to data enabling the tracking of individuals. Instead, Chinese participants expressed an increased need for apps informing about the current (regional or local) regulations and the state of the pandemic as indicated by our results. Our study was conducted under the impression of a global pandemic and the necessity for apps specifically designed to mitigate a pandemic in the future is unclear. However, we believe that our results also offer insights for health-related apps outside the specific context of a pandemic. First, designers and developers of apps that collect sensitive health data should keep in mind the factor levels that positively influence user acceptance (e. g., avoid technical malfunctions, provide data only to health authorities or research institutions, do not collect data that could be used to uniquely identify the user (US and DE)). Second, many factors (e. g., purpose, identification data, data receiver) showed significant estimates when compared to the baseline, indicating that users would like to be informed about these aspects. They should be clearly communicated to enable informed decisions for or against installation and use of a health-related mobile app. Our findings also provide insights into the question whether people are willing to share personal data with mobile apps developed to serve public interest. In our study the prospect of regional corona restrictions being lifted positively influenced people's willingness to use an app in Germany and the US. This was even valued higher than individual freedoms, as represented by the factor level "the freedom of personal movement or travel, " and confirms prior findings about people willing to share data if they believe it benefits a good cause [9] . However, our findings also imply that many participants will not support extended use of corona apps beyond the pandemic. In China, many participants expressed worries that prolonged use of corona apps may increase anxiety due to being in a constant state of alert. In the US and Germany, where we saw more skepticism towards the governments, almost one third of participants voiced privacy and security concerns (see Table 7 ) and many of them were especially worried about surveillance, confirming previous work about apps for COVID-19 contact tracing [4] . These comments are supported by the negative estimate in our model for scenarios where the data was sent to law enforcement. These negative sentiments can be alleviated via privacy-preserving approaches in the implementation of "apps for a greater good" and transparency about their data processing practices that were found to foster people's trust and increase adoption of COVID-19 contact tracing apps [4, 31, 56, 69] . Still, in all countries, we observed a base of participants who reported that they would never use any kind of corona app, regardless of its data processing practices. This group may contain people who think that apps are unnecessary to combat the pandemic, fear surveillance, or do not take the threats of coronavirus seriously. While previous work [61] has found a group of critics to be open to arguments especially about privacy, our data shows that a non-negligible number of participants, when prompted to indicate their willingness to use an app, always responded with "very unlikely". This group is largest in the US ( = 212), followed by Germany (151), and is rather small in China (8) . In the case of contact tracing apps, whose efficiency requires a large adoption rate, this base of 15 to 21 % of non-users needs to be taken into consideration when estimating the potential user base of an app, in addition to people who are not able to use any app for other reasons. Similarly, the development process for future apps collecting data to support a public cause needs to take into account that there will always be a base of users unwilling to support any given cause. In this work we present qualitative and quantitative data allowing detailed insight into the privacy implications and user acceptance of COVID-19-related smartphone apps in three countries. Our approach has the following limitations. In our survey, we only collect self-reported data, which does not necessarily reflect actual behavior. This phenomenon (referred to as "privacy paradox" [45] ) may have been further amplified because all scenarios were hypothetical and participants were asked to imagine themselves in the situation to decide whether or not to use the described app. By deriving the factor levels used in the scenarios from real-world apps, we aimed to represent the realistic design space for both existing and potential future apps. Future work may complement ours by conducting field studies that observe participants' actual behavior regarding apps designed to help contain a pandemic. Four out of five factor levels for the factor "app purpose" required specific factor levels for payload data (see Section 4.1.2). This led to a high correlation between app purpose and payload data, which blurs the boundaries between both factors and may have contributed to less relevant and significant results regarding payload data. 7 For representativity, we focused on age, gender, region, and education. Ethnicity representation in our US sample is skewed towards the white population (Distribution: 77.7 % White, 8.9 % Black or African American, 6.4 % Hispanic or Latino, 4.3 % Asian, 2.7 % Other or no answer). However, our analysis did not indicate significant effects of ethnicity on the willingness to use a corona app (see Appendix B). It is a general problem to reach older, more rural populations in China via online surveys; thus, our panel provider could only provide us with a sample representative for the online rather than the general population. This leads to the Chinese sample being skewed towards younger age and higher urbanization, which explains the very high rate of smartphone users. We commissioned the translation of the Chinese questionnaire and Chinese open-ended answers to a translation agency and followed the quality assurance process of back translation to minimize errors. However, we cannot completely exclude the possibility that the translations from and into Chinese may contain small inaccuracies. Questions asking for already known corona apps (Q13) and individual use of corona apps (Q14) may have been misleading in China as coronavirus-related functionality has been integrated into the established platform economies. This is indicated by participants responding that they did not use a (dedicated) corona app because there were "mini programs on WeChat or Alipay" (participant . While integration into existing platforms can further contribute to app acceptance, we do not expect this potential misunderstanding to have influenced our vignette study as the scenarios for standalone apps were hypothetical. The COVID-19 pandemic continues to pose significant challenges to societies around the world. As measures are developed to slow and eventually contain the spread, governments, private companies, and individuals have turned to technology and smartphone apps specifically developed to support these measures. To unfold the potential of technological strategies, the population has to support and voluntarily use them instead of rejecting or purposefully work around them because they disagree with the underlying regulations or data collection practices. We conducted a study to better understand how privacy factors impact the adoption of coronavirusrelated smartphone apps. Based on a vignette design describing various app use cases and scenarios we show that many aspects of the "contextual privacy" approach have an actual influence on people's willingness to use a corona app. While in general the willingness to use an already known type of app is high, we found evidence that developers should take additional steps to ensure that apps work correctly, collect as few personal data as possible, and make it transparent when the data will be deleted. Policymakers need to ensure that apps do not share data with private companies, the police, or the public. Our study identified widespread concerns that corona apps could be the start of a new era of government surveillance -to counter these concerns, strong privacy and security paradigms should be adopted. We hope that our results can inform the development of novel technology that can help limit the negative impact of COVID-19 and future diseases while respecting users' privacy and autonomy. In the following, you will be shown different apps to find out what kind of corona apps you would prefer to use. The presented apps are fictional and have different purposes and implement different functionalities. For each app, you will be asked a few questions. Please consider the app's purpose and functionalities while answering the questions. Always assume that you are free to choose whether or not you install and use the app. [This question group was displayed 10 times, only with different scenarios.] Tables 4, 5 , and 6 were computed using the following cumulative link mixed model fitted with the Laplace approximation using following call in R: Listing 1: Function call in R used to fit the cumulative link mixed model. Note that the "Ethnicity" variable was only available for the US responses. clmm ( Q9~p u r p o s e + t e c h n i c a l + s o c i e t a l + d1 _ e n c o u n t e r + d1 _ l o c a t i o n + d1 _ h e a l t h + d1 _ i n f e c t i o n + d1 _ u n s p e c + d1 _ none + d2 + r e c e i v e r + r e t e n t i o n + t r a n s m i s s i o n + Q2 + Q3r1 + Q3r2 + Q3r3 + Q3r4 + Q4 + Q5 + Q6 + Q7 + Q8 + Q13r1 + Q13r2 + Q13r3 + Q13r4 + Q13r5 + Q14 + Q17 + Q18r1 + Q18r2 + Q18r3 + Q18r4 + Q18r5 + Q18r6 + Q19 + Gender + MainRegionName + E d u c a t i o n _ G e n e r a l + Age + E t h n i c i t y + i u i p c _ c o l + i u i p c _awa + i u i p c _ con + ( 1 | s c e n a r i o _ i n d e x ) , l i n k = " p r o b i t " , data = r e s p o n s e s , Hess = TRUE) Each round we compared the current best model ( ) with models were each factor (F) was individually removed ( ℎ ) and compared the AIC of these models to decide which factor to remove for the next Factors were removed in the following order: Mobile health apps and recovery after surgery: What are patients willing to do? The Theory of Planned Behavior Constructing a Theory of Planned Behavior Questionnaire Acceptability of App-Based Contact Tracing for COVID-19: Cross-Country Survey Study COVID-19 Screening Tool Privacy-Preserving Contact Tracing Evaluating the Contextual Integrity of Privacy Regulation: Parents' IoT Toy Privacy Norms Versus COPPA Australian Government Department of Health. 2020. Coronavirus Australia app. Australian Government Department of Health I'm hoping they're an ethical company that won't do anything that I'll regret": Users Perceptions of At-home DNA Testing Companies The Mismeasurement of Privacy: Using Contextual Integrity to Reconsider Privacy in HCI Here's my location, for your information: The impact of trust, benefits, and social influence on location sharing application use among Indonesian university students Expanding the Technology Acceptance Model with the Inclusion of Trust, Social Influence, and Health Valuation to Determine the Predictors of German Users' Willingness to Continue using a Fitness App: A Structural Equation Modeling Approach Contextual Integrity through the Lens of Computer Science. Foundations and Trends in Privacy and Security Corona prediction: Telekom supports RKI. Deutsche Telekom AG. Retrieved October Privacy and Communication Cumulative Link Models for Ordinal Regression with the R Package ordinal Coronavirus contact-tracing: World split between two types of app Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology Privacy Expectations and Preferences in an IoT World Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing The Vignette Technique in Survey Research ReCal: Intercoder Reliability Calculation as a Web Service Explaining the privacy paradox: A systematic review of literature investigating privacy attitude and behavior Sharing Steps in the Workplace: Changing Privacy Concerns Over Time Privacy concerns for mobile app download: An elaboration likelihood model perspective PETs under Surveillance: A critical review of the potentials and limitations of the privacy as confidentiality paradigm Acceptance of blog usage: The roles of technology acceptance, social influence and knowledge sharing motivation International Chamber of Commerce and European Society for Opinion and Marketing Research How good is good enough for COVID19 apps? The influence of benefits, accuracy, and privacy on willingness to adopt The new normal': China's excessive coronavirus public monitoring could be here to stay. The Guardian Decentralized is not risk-free: Understanding public perceptions of privacy-utility trade-offs in COVID-19 contact-tracing apps Internet Users' Information Privacy Concerns (IUIPC): The Construct, the Scale, and a Causal Model Privacy Interests in Public Records: An Empirical Investigation Patient Willingness to Consent to Mobile Phone Data Collection for Mental Health Apps: Structured Questionnaire Qualitative Content Analysis: Theoretical Foundation, Basic Procedures and Software Solution Will you need an 'immunity passport' to travel? In Coronavirus Fight, China Gives Citizens a Color Code, With Red Flags. The New York Times Privacy is an essentially contested concept: a multi-dimensional analytic for mapping privacy Mobile Health Apps for Self-Management of Rheumatic and Musculoskeletal Diseases: Systematic Literature Review Daily briefing on novel coronavirus cases in China. National Health Commission of the People's Republic of China The Role of Data Type and Recipient in Individuals' Perspectives on Sharing Passively Collected Smartphone Data for Mental Health: Cross-Sectional Questionnaire Study Privacy as Contextual Integrity The Privacy Paradox: Personal Information Disclosure Intentions versus Behaviors Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines Contextual Expectations of Privacy in Self-Generated Health Information Flows A qualitative study of user perceptions of mobile health apps Being (In)Visible: Privacy, Transparency, and Disclosure in the Self-Management of Bipolar Disorder Corona Data Donation -Scientific Analysis COVID-19 Dashboard New Ways of Thinking about Privacy Open-Source Project Corona-Warn-App Poland's coronavirus app offers playbook for other governments COVID tracing app roundup: All of the countries and US states that currently offer exposure notification apps COVID-19 Contact Tracing and Privacy: Studying Opinion and Preferences Mobile Self-Diagnosis Guide. South Korea Ministry of Health and Welfare Smartphone ownership rate by TCN Coalition. 2020. Temporary Contact Numbers Protocol. TCN Coalition. Retrieved The Government of the Hong Kong Special Administrative Region One app to trace them all? Examining app specifications for mass acceptance of contact-tracing apps DP3T: Decentralized Privacy-Preserving Proximity Tracing. École polytechnique fédérale de Lausanne and ETH Zurich User Acceptance of Information Technology: Toward a Unified View More Than Just Privacy: Using Contextual Integrity to Evaluate the Long-Term Risks from COVID-19 Surveillance Technologies Tracing. Testing. Tweaking. Approaches to data-driven Covid-19 management in China. MERICS -Mercator Institute for China Studies Signal Appropriation of Explicit HIV Status Disclosure Fields in Sex-Social Apps used by Gay and Bisexual Men Brandeis. 1890. The Right to Privacy The privacy trade-off for mobile app downloads: The roles of app value, intrusiveness, and privacy concerns Americans' Perceptions of Privacy and Surveillance in the COVID-19 Pandemic Barriers to and Facilitators of the Use of Mobile Health Apps From a Security Perspective: Mixed-Methods Study Mixed Effects Modelling for Nested Data Corona App Study Welcome Text The current situation with the novel coronavirus (SARS-CoV-2) and the disease it causes (COVID-19) has sparked an intense debate about the use of smartphone apps to better understand and contain the spread of the virus Yes • No • Prefer not to answer Q2: What is your phone's operating system? [single choice] • Android/Google • iOS/Apple • Other (please specify:) • Don't know • Prefer not to answer Q3: How satisfied are you with the following aspects of your smartphone? [array of single-choice questions; answer options for each: Very satisfied, Satisfied, Neither satisfied nor dissatisfied, Dissatisfied, Prefer not to answer] • Battery life • Location accuracy (GPS) • Camera quality • Speed Coronavirus Experience Now we would like to ask you some questions about your experience with the novel coronavirus. This study uses the following terminology: • "coronavirus": the novel coronavirus (SARS-CoV-2) that has caused a global pandemic COVID-19": coronavirus disease 19, the respiratory disease caused by this virus Q4: Are you or have you been infected with the novel coronavirus? • I was tested for coronavirus and at least one of the results was positive • I was tested for coronavirus and all results were negative • I was not tested for coronavirus and I do not think I have been infected • I was not tested for coronavirus, but I suspect that I might have been infected Yes • No • Prefer not to answer Q6: Have you been quarantined or did you quarantine yourself because of coronavirus? [single choice] • Yes • No • Prefer not to answer Q7: To the best of your knowledge, is there a person at higher risk in your household, i. e., an older adult or a person of any age who has a serious underlying medical condition? China} do you expect to use this app on their smartphones Q11: Please complete the following statement: Most people who are important to me think that I ... [7-point scale with end points "should not use this app" and "should use this app Q12: How useful do you rate this app in helping contain the spread of the COVID-19 pandemic? [7-point scale with end points "Not at all useful" and "Very useful Use of Corona Apps Q13: Do you know of any app recommended by the public authorities in the United States that can be used to ... [array of single-choice questions enforce quarantine? • ... identify people you have been in close contact with and alert them in case you tested positive for coronavirus? • ... provide information about your health and needs to be shown if you want to visit a certain place? Q14: Do you use any kind of corona app on your smartphone? Q14b: If yes: Which corona app(s) do you use? [free text] Q15: In general, what do you consider positive aspects of smartphone apps to help limit the spread of the COVID-19 pandemic? Q16: In general, what do you consider negative aspects of smartphone apps to help limit the spread of the COVID-19 pandemic? The authors would like to thank Kangning Zhan for her help with the Chinese translations. This research is funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy -EXC 2092 CASA -390781972 and the MKW-NRW Research Training Groups SecHuman and NERD.NRW. Sample scenario. Imagine an app that provides information about your health and needs to be shown if you want to visit a certain place.• The app uses health or activity data, your COVID-19 infection status, and your current or past location(s). • In addition, the app collects data that could be used to uniquely identify you. • This data is sent to research institutions when you request your health report and it will be stored until the current coronavirus regulations end. • The app decreases your phone's battery life. Using this app may increase your personal freedom of movement or travel.