key: cord-0938573-bcefm4i1 authors: Mazza*, Clara; Girardi*, Daniela; Gentile, Leandro; Gaeta, Maddalena; Signorelli, Carlo; Odone, Anna title: Public health effectiveness of digital contact tracing in the COVID-19 pandemic: A systematic review of available data date: 2021-10-01 journal: Acta Biomed DOI: 10.23750/abm.v92is6.12237 sha: b661272be321724fb6f93dd068e6f91de115c9fe doc_id: 938573 cord_uid: bcefm4i1 BACKGROUND AND AIM: Contact tracing is a key element of epidemiologic investigation and active surveillance during communicable infectious diseases outbreaks. Digital contact tracing (DCT) are new technologies that have been increasingly adopted in different countries to support conventional contact tracing efforts to control the COVID-19 pandemic. However, scant evidence is available on its effectiveness. We applied the Indicator Framework issued in 2021 jointly by the World Health Organization (WHO) and the European Centre for Disease Prevention and Control (ECDC) to assess the available evidence on DCT adoption and impact in the context of the COVID-19 pandemic. METHODS: We carried out a systematic review following the PRISMA guidelines (Prospero registration number: CRD42021253662) to retrieve, pool, and critically appraise studies published in English from November 2019 to April 2021. We excluded mathematical models of effectiveness. Only studies representative of the general population or specific populations were included. In line with the WHO-ECDC indicator framework, outcomes of interest were grouped in indicators of: i) DCT use, ii) DCT success, and iii) DCT performance. RESULTS: We identified 1.201 citations searching PubMed, Embase, Web of Science and The Cochrane Library. After screening, 10 studies were included. All included studies reported measures of DCT use, varying widely by study population and setting (percentage of DCT apps download from 0.01% to 58.3% in included studies). Only one reported measures of DCT success (ratio of exposure notifications received to positive test results entered), while no studies were retrieved reporting measures of DCT performance. CONCLUSIONS: DCT is a promising technology in the field of epidemics control. Its adoption is hindered by several normative, technical and acceptance barriers in different regions and countries. Our review shows that while some evidence is available on its adoption and use in selected settings, very scant data is available on its effectiveness in the fight against COVID-19. As digitalization provides new tools for infection control at the population level, solid research is needed to quantify the public health effects of their application. (www.actabiomedica.it) When it comes to COVID-19, governments worldwide have applied strict physical distancing measures to control transmission. These policies have reduced case numbers, but have significant social and economic implications leading to the research of alternative integrate control strategies (1, 2) . In this respect, contact tracing represents an important part of epidemiologic investigation and active surveillance. Its ability to reduce disease transmission is premised on timely detection and prompt isolation of cases (3) . In particular contact tracing is a public health measure composed by three basic elements, namely, contact identification, contact listing and contact follow-up (4) . The first step of this process is meant to identify people, or contacts, who have been exposed to a person, or index case, infected with a pathogen or another hazard. This stage is followed by assessing and managing the identified contacts to prevent onward transmission, referring them to therapeutic or preventative treatment, which may include isolation, quarantine, or other behavioral interventions (4, 5) . Traditionally, contacts are traced by asking people identified as index cases to recall their close contacts during a recent interval associated with a high probability of infection (1, 5) . However, contact tracing effectiveness in breaking the chain of transmission depends on the proportion of contacts who are actually traced. In this regard, the main limit of manual contact tracing is determined by the quality of information provided, often incomplete or incorrect; other limitations include the time spent to notify contacts manually, which can delay quarantine, and the large amount of human resources engaged (1, 5) . This being the case, contact tracing becomes quickly complicated and time-consuming, posing a public health issue particularly in the context of COVID-19, as the virus can be transmitted between people without even manifesting symptoms (6) . Technology can be used to address some of these limitations, by automating the processing of test results or symptom reports and by use of DCT (1). Before COVID-19 pandemics, DCT has already been used to manage Ebola outbreaks in Africa, as an example with the help of Go.Data, that has also been used in 55 projects worldwide (6) . At present, considering the penetration of digital tools and the current global pandemic, it is worth collecting data in order to estimate use and effectiveness of DCT. In this respect the World Health Organization (WHO), in collaboration with the European Centre for Disease Prevention and Control (ECDC), have realized an evaluation framework for DCT technologies in order to establish the effectiveness of DCT applications created worldwide by national governments (7) . Despite strong government advocacy, DCT adoption rates have generally fallen short of what public health officials would hope. Indeed, while studies have shown that a high percentage of people accept and intend to download these apps, some evidence indicates that actual download rates are probably lower than predicted by positive attitudes (8) . In this context the aim of this systematic review is to understand the global employment of DCT tools among the general population and subsequently to define the impact of DCT on the prevention and control of the COVID-19 pandemic. The WHO and ECDC framework has been used to assess and comment on the available data. The review's methods were defined in advance following the Prepared Items for Systematic Reviews and Meta-Analysis (PRISMA 2020) guidelines. Studies were identified by searching the electronic databases PubMed, Embase, Web of Science and The Cochrane Library. The search strategy was first developed in PubMed using a combination of free text and Mesh terms identifying: i) the concept of DCT, and ii) its involvement in the COVID-19 pandemic, and then adapted for use in the other databases. Complete search strategies are available in the Appendix. Studies published in English were included. Studies from November 2019 and April 2021 were included. We only considered for inclusion studies reporting original data from quantitative analysis. Only representative studies both of the general population or of specific populations were included. Both observational and experimental study designs were considered. We excluded opinion papers, (i.e. editorials, commentaries and letters to the Editor) not providing original data. Systematic reviews and other reviews were excluded. Mathematical models of effectiveness were excluded. We aim to assess the effectiveness of DCT mobile applications, using the ECDC and WHO framework indicators as keys of interpretation. The indicators available are listed in Box 1. In line with the ECDC-WHO framework, we categorized indicators of interest under three main categories: DCT "Use", "Success" and "Performance" (Box 1). All the retrieved studies were independently reviewed by two researchers (CM and DG), a first screening was performed based on title and abstract while full texts were retrieved for the second screening. At both stages disagreements by reviewers were resolved by consensus and consultation with senior authors. Data from selected articles were extracted and tabulated independently by two researchers (CM and DG). Any disagreements have been resolved through discussion with a third researcher. A standardized, pre-piloted form has been used to extract data from the included studies for assessment of study quality and evidence synthesis. Extracted data were analysed and summarized in Excel (Microsoft Corporation, Redmond, California) spreadsheets. The following data were extracted from included studies: country of study implementation, study design, study period, study population, sample size, response rate (if applicable) and outcomes of interest (DCT use, success and performance indicators). Quality appraisal of included studies was carried out using The National Institutes of Health (NIH) Study Quality Assessment Tools. We identified 1201 records by searching the selected databases. After removing duplicates, 789 abstracts were retrieved. Studies were screened and selected as illustrated in Figure. 1, resulting in 316 full text articles assessed for eligibility and 10 studies that were included in the systematic review. The characteristics of the included studies are reported in Table 1 . Half of the studies were conducted in Australia (30%) or Switzerland (20%); 1 study was conducted in the United Kingdom, 1 in France, 1 in India and 1 in Japan. One study was conducted transversally through different countries (USA, Italy, Norway, Singapore, South Korea, Pakistan, Australia, New Zealand, Switzerland Georgia). The majority of the studies were cross-sectional, 2 were prospective cohort studies, 1 was a custom original study and 1 was a content analysis. Study periods ranged from 4 days (9) to 78 days (16) and the most recent data were collected between August and October 2020 (40% of the papers included), whereas the oldest study started on April 2020 (16) . The majority of the studies were conducted on the general adult population, only two studies were conducted on specific population settings: one on University students (13) , the other on full time employees (17) . The largest sample sizes were reported in the Swiss study as it considered the whole Swiss population (8.6 million people) (11) , and in the Content analysis by Elkhodr M et al. (15) , as it considered a major amount of countries. With reference to cross -sectional studies, the largest sample size was reported in the Indian study, in which in two different moments were interviewed 13292 and 14954 people (14) . Included surveys' response rate was reported in all but three studies and ranged from 53.9% to 90.6%. Quality appraisal of included studies is reported in Table 1 . Overall, 5 out of 13 (38.5%) of the indicators of interest were measured in included studies. In particular, all studies measured DCT 'use' indicators, only one 'success' indicators (11) and none reported on 'performance' indicators. In details, measured DCT "use indicators" were 4. 'Proportion of total population who have downloaded the app' (A.1) was reported in all the 10 included studies (8) (9) (10) (11) (12) (13) (14) (15) (16) (17) ; 'Proportion of total population that actively uses the app' (A.2) was reported in 40% of the articles (10, 11, 13, 14) ; 'Proportion of all positive tests that occur among app users' (A.3) and 'Proportion of positive tests among app users that are entered into the app (positive tests uploaded)' (A.4) were reported in 1 article out of 10 (11). Table 2 reports quantitative data on DCT indicators of interest extracted from included studies. The proportion of population that have downloaded the app (A.1 indicator) is over the 50% (58.3% in August 2020 and 55.6% in September 2020) in one study (14) . In the majority of the studies (70%) it has been assessed to be between the 20.4% (17) and 46.5% (10) . Under this standard there is the data from French study by Montagni et al (11.3%) (13) . In the study by Elkhodr et al (15) are showed the data available by local news at the time of July 2020 about ten applications in 9 different countries: the download proportion is lower than in the other papers. It appears to be over the 20% for three apps (TraceTogether in Singapore 35.89%, Smittestopp in Norway 26.32% and COVIDSafe in Australia 24.03%) and under 5% in the half of the apps investigated. Considering the proportion of total population that actively uses the app (A.2 indicator) there are four available data 4.7% (13), 18.9% (11), 38.8% (10) and 51.4% in September and 54.2% in August in the Indian study (14) . It can be noticed that in all the four studies the A.2 indicator shows a lower percentage value in comparison with A.1 indicator. No comparison is possible between the articles about A.3, A.4 and B.1 indicators as they are only reported by one paper (11) . In particular A.3 value is reported as 19.6%, the A.4 as 67.2% and B.1 as 94.8 (this data has been computed by the authors). Rapid identification and notification of all exposed contacts is the cornerstone of an effective contact tracing strategy. COVID-19 promoted new digital solutions to mitigate the pandemic impact on individuals and health systems. DCT is an emerging new technology, but we report scientific evidence on its effectiveness is supported by insufficient data. The indicators proposed by the WHO and ECDC framework are suggested to be viewed as a list of alternatives from which public health authorities can choose, while considering the local implementation environment (7) . From our data analysis the "DCT use indicators" and, more in particular, rate of DCT app download and rate of DCT app use, are those most frequently measured: we observed a variable but low level of use percentage (A.1 indicator), ranging from 0.01% to 58.3%. This is more evident in some Countries such as Italy and Switzerland. The correlation between rate of DCT use and absolute infection case reduction is hard to be assessed, but several studies on automated contact tracing for COVID-19 found out that a very high uptake is required to substantially suppress transmission. A systematic review by Grekousis and Liu (18) reports that, according to mathematical modelling, to reduce effective reproductive number (R eff ) to less than 1, the population uptake of DCT apps needs to be around 90%. However, some studies are more optimistic: Abueg et al. estimate a high reduction in infection rate (73-79%) and deaths (69-78%) also with a lower DCT uptake, around 75% (19); Currie et al. estimate that the number of new infections could be reduced by more than a half with an adoption rate of 61% (20) . According to the available literature it is clear that the app uptake emerged by the studies analysed in our review is not sufficient to obtain a substantial reduction of R eff . Our study has to be interpreted in light of both strengths and limitations. The strength of this review is that it is among the first, to our knowledge, assessing the effectiveness of the DCT applications currently in use worldwide. More importantly, we pooled, analysed and assessed available data on DCT effectiveness applying the conceptual framework produced by international health authorities (7) . Study limitations reflect the innovative nature of this systematic review. As a matter of fact the Indicator framework to evaluate the public health effectiveness of digital proximity tracing solutions edited by WHO and ECDC has been published on 28 June 2021 (7), whereas the oldest paper reviewed has been published on April 2021. The direct consequence of this fact is that of the three dimensions analysed (use, success and performance), only "use" has a satisfactory amount of reported outcomes. "Success" has only one paper by Salathé M, et al. (11) , with clear results and the "Performance" dimension has not been appraised by any of the papers. Other limitations are linked to the characteristics and quality of included studies. All data came from observational studies, which are more vulnerable to biases. One of the most cited bias is the so-called "Digital divide" reported by the cross-sectional studies that included online questionnaires. It consisted in the overestimation of app users, as the populations recruited had access to the internet and so were more likely to have a smartphone (8, 10, 14, 16) . However, the study population was representative in all the papers included. Finally, we limited our research to articles written in English. This systematic review is conducted in an era where the debate on the usefulness of DCT is still ongoing and can lead researchers to the fill the gaps of literature. As also evidenced by the framework authors, one of the most preeminent obstacles in the global impact assessment of DCT on health, social and economic aspects, consists of the organizational discrepancies for the epidemiological surveillance due to a different characterization of regional health systems local arrangements. Many countries acknowledge the benefit of location data and centralized management, as it allows public health authorities to pursue more extensive investigations. Unfortunately, such features do so at the expense of privacy protection (7) . Even if this approach could be helpful, it must be discouraged for ethical implications and to promote general population acceptance. Actually privacy concerns have emerged to be a relevant driver of acceptance of DCT solutions (10, 21) . The results of this systematic review show that COVID-19 pandemic has induced a process of implementation of already existing digital tools through the definition of varied and heterogeneous apps that allow user data to be shared using GPS or Bluetooth technologies (22) (23) (24) (25) ; however any implementation of DCT should include national or international legislation to protect personal data and privacy of users also in order to increase perceived security. Hopefully this would boost the download percentages, as well as effectiveness, according with WHO definitions (7) . In conclusion DCT could be one of the keys for countering the spread of SARS-CoV-2 but more specific evaluations are requested. The WHO-ECDC Indicator framework to evaluate the public health effectiveness of digital proximity tracing solutions should guide the planning and conduction of future research, which is needed to evaluate and quantify the effectiveness of different DCT solutions to control epidemics and inform successful infection control strategies. Automated and partly automated contact tracing: a systematic review to inform the control of COVID-19. Lancet Digit Health COVID-19 in Italy: impact of containment measures and prevalence estimates of infection in the general population Contact tracing Contact tracing Contact tracing: A memory task with consequences for public health Contact Tracing in the Digital Age World Health Organization (WHO), ECDC. Indicator framework to evaluate the public health effectiveness of digital proximity tracing solutions Profiling adopters (and nonadopters) of a contact tracing mobile application: Insights from Australia Concerns and Misconceptions About the Australian Government's COVIDSafe App: Cross-Sectional Survey Study Drivers of Acceptance of COVID-19 Proximity Tracing Apps in Switzerland: Panel Survey Analysis Early evidence of effectiveness of digital contact tracing for SARS-CoV-2 in Switzerland Epidemiological changes on the Isle of Wight after the launch of the NHS Test and Trace programme: a preliminary analysis Health Care Students' Knowledge of and Attitudes, Beliefs, and Practices Toward the French COVID-19 App: Cross-sectional Questionnaire Study Sociodemographic determinants of the adoption of a contact tracing application during the COVID-19 epidemic in Delhi, India. Health Policy and Technology Privacy, and User Opinions of COVID-19 Mobile Apps for Contact Tracing: Systematic Search and Content Analysis The acceptability and uptake of smartphone tracking for COVID-19 in Australia The Effects of Downloading a Government-Issued COVID-19 Contact Tracing App on Psychological Distress During the Pandemic Among Employed Adults: Prospective Study Digital contact tracing, community uptake, and proximity awareness technology to fight COVID-19: a systematic review. Sustainable Cities and Society Modeling the effect of exposure notification and non-pharmaceutical interventions on COVID-19 transmission in Washington state. npj Digital Med Stemming the flow: how much can the Australian smartphone app help to control COVID-19? Public Health Res Pract Who does or does not use the "Corona-Warn-App" and why? Effectiveness of email-based reminders to increase vaccine uptake: a systematic review. Vaccine Public health digitalization in Europe Does the use of personal electronic health records increase vaccine uptake? A systematic review. Vaccine Digitalization: potentials and pitfalls from a public health perspective APPENDIX Search strategy The reported search strategy was launched on PubMed on 8 Mobile Applications Each author declares that he or she has no commercial associations (e.g. consultancies, stock ownership, equity interest, patent/licensing arrangement etc.) that might pose a conflict of interest in connection with the submitted article