key: cord-0914364-zz2gp3kx authors: Rathmes, Giulia; Rumisha, Susan F.; Lucas, Tim C. D.; Twohig, Katherine A.; Python, Andre; Nguyen, Michele; Nandi, Anita K.; Keddie, Suzanne H.; Collins, Emma L.; Rozier, Jennifer A.; Gibson, Harry S.; Chestnutt, Elisabeth G.; Battle, Katherine E.; Humphreys, Georgina S.; Amratia, Punam; Arambepola, Rohan; Bertozzi-Villa, Amelia; Hancock, Penelope; Millar, Justin J.; Symons, Tasmin L.; Bhatt, Samir; Cameron, Ewan; Guerin, Philippe J.; Gething, Peter W.; Weiss, Daniel J. title: Global estimation of anti-malarial drug effectiveness for the treatment of uncomplicated Plasmodium falciparum malaria 1991–2019 date: 2020-10-20 journal: Malar J DOI: 10.1186/s12936-020-03446-8 sha: 4bd83c2ae867a16d9d8ce6809a45d2ea56a544d5 doc_id: 914364 cord_uid: zz2gp3kx BACKGROUND: Anti-malarial drugs play a critical role in reducing malaria morbidity and mortality, but their role is mediated by their effectiveness. Effectiveness is defined as the probability that an anti-malarial drug will successfully treat an individual infected with malaria parasites under routine health care delivery system. Anti-malarial drug effectiveness (AmE) is influenced by drug resistance, drug quality, health system quality, and patient adherence to drug use; its influence on malaria burden varies through space and time. METHODS: This study uses data from 232 efficacy trials comprised of 86,776 infected individuals to estimate the artemisinin-based and non-artemisinin-based AmE for treating falciparum malaria between 1991 and 2019. Bayesian spatiotemporal models were fitted and used to predict effectiveness at the pixel-level (5 km × 5 km). The median and interquartile ranges (IQR) of AmE are presented for all malaria-endemic countries. RESULTS: The global effectiveness of artemisinin-based drugs was 67.4% (IQR: 33.3–75.8), 70.1% (43.6–76.0) and 71.8% (46.9–76.4) for the 1991–2000, 2006–2010, and 2016–2019 periods, respectively. Countries in central Africa, a few in South America, and in the Asian region faced the challenge of lower effectiveness of artemisinin-based anti-malarials. However, improvements were seen after 2016, leaving only a few hotspots in Southeast Asia where resistance to artemisinin and partner drugs is currently problematic and in the central Africa where socio-demographic challenges limit effectiveness. The use of artemisinin-based combination therapy (ACT) with a competent partner drug and having multiple ACT as first-line treatment choice sustained high levels of effectiveness. High levels of access to healthcare, human resource capacity, education, and proximity to cities were associated with increased effectiveness. Effectiveness of non-artemisinin-based drugs was much lower than that of artemisinin-based with no improvement over time: 52.3% (17.9–74.9) for 1991–2000 and 55.5% (27.1–73.4) for 2011–2015. Overall, AmE for artemisinin-based and non-artemisinin-based drugs were, respectively, 29.6 and 36% below clinical efficacy as measured in anti-malarial drug trials. CONCLUSIONS: This study provides evidence that health system performance, drug quality and patient adherence influence the effectiveness of anti-malarials used in treating uncomplicated falciparum malaria. These results provide guidance to countries’ treatment practises and are critical inputs for malaria prevalence and incidence models used to estimate national level malaria burden. The Global Burden of Disease (GBD) study estimated that 619,800 (95% uncertainty intervals: 440,100-839,500) malaria deaths occurred worldwide in 2017 [1] , with over 80% of deaths occurring in sub-Saharan Africa [2] . Malaria mortality has decreased substantially over the last two decades through increased investment in the availability of effective treatments, such as artemisinin-based combination therapy (ACT) and preventive measures such as long-lasting insecticidal nets [3] [4] [5] . Anti-malarial treatments are key to curbing malaria burden and mortality as they reduce the individual's risk of severe disease and death in incident cases [6, 7] while also decreasing the infectious reservoir of individuals from where mosquitoes can acquire a blood meal. Reaching global malaria reduction targets requires a detailed understanding of current treatment coverage levels as well as factors limiting their effectiveness. Coverage of anti-malarial effectiveness in the population necessitates that: (i) all patients with confirmed malaria infection access an anti-malarial treatment; (ii) the provided drug is of high efficacy and good quality; and, (iii) all patients receive an optimal dosing and adhere to the treatment regimen. This covers all relevant providers involved in managing malaria patients, including private sector, both formal and informal. Whilst efficacy, which drives most of the drug policy decisions, is primarily dictated by the evolution of drug-resistant parasite phenotypes, anti-malarial drug effectiveness (AmE) is a composite measure that encompasses clinical efficacy (the performance of the medicine under controlled conditions) and other real-world clinical practice limitations. AmE is influenced by: (i) patient-specific responses to the treatment, including absorption, genetics, co-morbidities, special conditions such as pregnancy, very young age, or drug-drug interactions; (ii) patient adherence to the drug's use instructions; (iii) healthcare providers' skill, knowledge and prescription practises; (iv) health system performance; (v) access to the healthcare system; (vi) healthcare expenditure; and, (vii) other sociodemographic characteristics that limit the appropriate use of anti-malarial drugs. The World Health Organization (WHO) recommends the use of ACT for treatment of uncomplicated falciparum malaria [8] , as this species causes the most severe forms of malaria and subsequently death. Currently, ACT is used by most malaria-endemic countries and territories [9, 10] as first-line treatment for falciparum malaria (Additional file 1: Section 1), and its use has been widespread. For example, 82% of febrile children treated with an anti-malarial received an ACT medicine in public health facilities within sub-Saharan Africa between 2015 and 2018 [11] . High efficacy of ACT for Plasmodium falciparum infection has been reported in sub-Saharan Africa, with no artemisinin resistance confirmed in this region [12] . Historically, anti-malarial resistance has been a major obstacle in the fight against malaria [3, [12] [13] [14] [15] . Chloroquine (CQ) resistance was first observed in Southeast Asia and in South America in the late 1950s, and later spread to Africa. It was replaced by sulfadoxinepyrimethamine (SP), to which resistance quickly emerged and spread from Southeast Asia to most endemic areas, and the drug became ineffective [16] . Evidence supporting the high efficacy and safety of artemisinin derivatives when paired with a partner drug became available in the late 1990s [17] [18] [19] . However, the emerging artemisinin resistance reported since the mid-2000s poses a significant threat to the recent gains in malaria control. Resistance to artemisinin was first identified in the Greater Mekong Sub-region (GMS), and there are concerns that it has spread to densely populated countries like India and recently to parts of sub-Saharan Africa [3, 14, [20] [21] [22] [23] [24] [25] [26] [27] [28] [29] [30] . The historical use of artemisinin as a monotherapy [12, 14, 15] , or the use of partner drugs with similar modes of action and cross-resistance [31, 32] , are among the primary factors fuelling the development of resistance. Other potential factors include the use of sub-standard and falsified medicines, high prevalence of self-treatment, poor adherence to drug use protocols, weak healthcare systems, and unmonitored treated cases [33] [34] [35] [36] [37] . All these underscore the need for a full understanding of the spatiotemporal pattern of ACT effectiveness in all P. falciparum endemic countries. Likewise, the effectiveness of non-artemisinin anti-malarials remains important as they are still first-line treatments for falciparum malaria in some countries [11] and widely used in many areas despite adaptation of WHO recommendations [12] . Together the ACT and non-ACT results from this research will provide crucial information for assessing the impact of effectiveness on falciparum malaria burden, monitoring emerging resistance (including multi-drug resistance), and better characterizing anti-malarial drug distribution, quality, access, and use [17, [37] [38] [39] [40] . When it comes to saving lives, effectiveness of drugs used for treatment is a key control intervention, and the need to characterize changing patterns of AmE is evident [41] . A global assessment of anti-malarial drug efficacy was published in 2010; existence of recently conducted and published anti-malarial efficacy trials [42] emphasizes the rationale for deriving updated global AmE estimates that will inform researchers, stakeholders and countries' malaria control programmes [14, 20, [43] [44] [45] [46] . To precisely monitor and compare AmE over space and time, and at a global scale, standardized data and methodologies are required. Clinical efficacy data are a key input for such analyses, and several databases cataloguing this metric have been established. As the databases were created for differing research purposes, they have inconsistent structures and varying foci, including specific drugs, regions or time periods [44, [47] [48] [49] [50] [51] [52] [53] [54] [55] [56] (Additional file 1: Section 1). Most of these databases do not provide patient-specific data to support further statistical analysis, and contain location-based drug efficacy estimates derived using different methodologies, in both design and analysis [48] . The WorldWide Anti-malarial Resistance Network (WWARN) responded to the challenge of comparing varying anti-malarial drug efficacy estimates by: (i) acquiring individual-patient-level data from efficacy trials conducted and published since 1960 [57] ; (ii) re-analysing the patient-level data using a consistent methodology (modified Intention-To-Treat analysis); and, (iii) using standardized indicator definitions to produce comparable drug efficacy estimates [58, 59] . The result of WWARN's work is the most comprehensive, standardized and accessible anti-malarial drug efficacy database yet created. Critically, WWARN dataset provides comparable results within and between countries, and over time thus supporting a spatiotemporal analysis. Clinical drug efficacy trials suffer from various complications, including non-compliance, protocol withdrawals and deviations (e.g., co-morbidity, exposure to new infections and health worker mistakes) that may result in participants being dropped during the analysis phase. The Intention-To-Treat analytical approach is advantageous because it includes all study participants according to the initial randomization, regardless of deviations from the protocol, such as participant withdrawals from the study or re-infection [59] [60] [61] . This method gives more conservative and unbiased efficacy estimates that are closer to what would happen in clinical practice and are proxy for effectiveness [62] [63] [64] (study endpoints by WHO and WWARN-Additional file 1: Section 1). There are deficiencies in existing routine health information systems for adequately monitoring responses to malaria treatment, and few studies have assessed effectiveness of anti-malarials globally. As such, analysing WWARN estimates within geospatial models that (i) include health system, socio-demographic and environmental factors, while (ii) adjusting for adherence and quality of drugs, provides a reasonable basis for deriving measures of AmE [65] . Furthermore, the covariates introduce information linked to effectiveness rather than efficacy, thereby allowing the model to amplify or reduce the gap between efficacy and effectiveness based on local conditions. This analysis generates fine-scale, global temporally dynamic maps of AmE for uncomplicated falciparum malaria. This metric defines the treatment success rate of an anti-malarial drug when administered to P. falciparum-infected individuals under typical use conditions (e.g., drugs obtained from facilities or pharmacies). This considers all individuals with parasitological-or clinically confirmed malaria infections that subsequently received an anti-malarial drug for treatment, regardless of whether they had a malaria-attributable fever, a fever attributable to a co-infection, or no fever. Effectiveness is estimated for both artemisinin-based and non-artemisinin-based treatment in all malaria-endemic countries from 1991 to 2019. The AmE models include covariates for health system factors, climate and environmental variables, sociodemographic, malaria transmission risks, and population. The estimates are adjusted for quality of anti-malarial drugs and adherence to dosage regimens [33, 66] . The rationale for modelling AmE rather than clinical efficacy is threefold: (i) effectiveness is a more relevant metric for assessing anti-malarial impacts when administered within a real-world clinical setting (i.e., after it becomes a front-line treatment for malaria within a country); (ii) modelling effectiveness allows use of spatially varying covariates that can feasibly be related to effectiveness but are unlikely to influence efficacy; and, (iii) effectiveness is an essential input for calculating malaria mortality in the GBD study. The GBD study includes annual, nationallevel estimates of morbidity and mortality attributed to malaria, with accompanying high-spatial-resolution (5 × 5 km) maps produced by the Malaria Atlas Project (MAP) [67, 68] . Prior to use in modelling malaria burden, the results of this research (AmE) are combined with proportional anti-malarial use and treatment-seeking rates to generate estimates of effective treatment with anti-malarials, which are then used for modelling P. falciparum prevalence and estimating the proportion of cases that are not successfully treated. The response data used in this research consisted of 232 anti-malarial drug efficacy studies conducted between 1991 and 2016, comprising 756 treatment arms, and information on 86,776 individuals. Among the studies used for analysis, 203 were extracted from the WWARN database, and comparable metrics were extracted from additional studies (n = 29) obtained through a review of articles assembled in the WWARN clinical trials publication library [61] . For consistency, these additional studies were selected using the same criteria applied when generating the WWARN dataset (i.e., additional studies focused on treatment of falciparum malaria, did not include pregnant women, and used a modified Intention-To-Treat approach). The WWARN database consists of publicly available aggregated results harmonized and summarized from anti-malarial drug efficacy studies, including both artemisinin-based (including artesunate monotherapy) and non-artemisinin-based therapy (Additional file 1: Section 1). Information of the trials included in the analysis is presented in Table 1 . Additional file 1: Section 2 illustrates distribution and number of studies by treatment type, country and year. Covariates used for modelling were identified from several procedures. First, publications describing factors influencing treatment failure, effectiveness of antimalarials, quality of anti-malarials, anti-malarial usage, and adherence, were identified with a literature review that followed an established methodology [69] . Second, a comprehensive search of the WWARN clinical trials publication library, which includes all available and published anti-malarial efficacy studies, was performed. Papers were considered if they studied P. falciparum only, did not include pregnant women, used a modified Intention-To-Treat statistical analysis approach, and had a follow-up time of at least 28 days. A total of 733 out of 1178 publications that reported efficacy matched these criteria, and all these were reviewed to extract information on covariates related to anti-malarial efficacy. Third, using similar criteria, an additional 47 papers focusing on malaria risk mapping were identified from publication databases and included for review. This literature review identified factors related to malaria infection, transmission and risk that are relevant when assessing the performance of anti-malarial drugs in real-world settings. Finally, grey literature, including WHO Malaria reports, was examined. The databases searched were PubMed, Embase, the Web of Science library, and Google Scholar. All covariates mentioned as having an influence on antimalarial drug efficacy, malaria treatment effectiveness or malaria infection in the compiled literature were identified. Additional file 1: Section 3- Table S3 .1 presents some of literature reviewed, identified factors and their importance to this analysis. The Institute for Health Metrics and Evaluation (IHME) [70] and MAP [71] provided the covariates used in this analysis [69, 72] . IHME collates and produces country-and annual-level variables, including health system access and metrics characterizing socio-economic status. MAP compiles, maintains and generates gridded global covariates characterizing environmental and climatic conditions, which are primarily derived from temporally dynamic and high-resolution satellite images and include temperature, rainfall, vegetation indices, population, night-time lights, and accessibility to cities [69, [72] [73] [74] [75] . Data were obtained for 69 factors (Additional file 1: Section 3-Tables S3.2 and S3.3). Six transformations (natural logarithm, reciprocal, squared, cubed, exponential) were applied to all continuous variables to incorporate potential non-linear relationships with the response. Following assessment of the collated covariates, 38 out of 53 IHME covariates were dropped as they were unavailable for all countries (e.g., they were only modelled for Africa and not globally). Similarly, 3 out of the 16 MAP covariates were excluded due to incomplete geographical coverage. The selection of the remaining variables was performed separately for artemisinin-based and non-artemisinin effectiveness by fitting generalized linear models with study site-specific random effects. The artemisinin-based and non-artemisinin anti-malarials were modelled separately because (i) the performance of the drug classes had markedly different temporal effectiveness patterns, and (ii) trials on non-artemisininbased drugs were clustered in Africa, whereas trials on artemisinin-based drugs were performed worldwide. The non-artemisinin-based anti-malarials were combined because too few efficacy studies were available to model them independently. Bivariate analyses relating each response variable with all covariates were performed, and the estimated odds ratios (with associated confidence intervals) and Wald's p-values were used to assess the significance of the association. This initial process was performed to remove non-significant variables, as the final variable selection was completed later while fitting the geostatistical model. Pearson's correlation coefficient was used to detect highly correlated covariates. Collinear covariates (r > 0.6) were excluded by ranking them based on their goodness-of-fit, assessed through Akaike Information Criteria (AIC), as well as the residual deviance [76] , and removing the less predictive covariates of collinear pairs. Further, multicollinearity was checked by assessing the Variance Inflation Factor (VIF) and performing the Farrar-Glauber test [77] . The selected set of covariates was used in the next steps of model development (Additional file 1: Section 3- Table S3 .4). The analysis utilized a modelling approach that characterized the spatial process and temporal patterns explicitly to derive predictions and estimate uncertainties [4] . The AmE, for location k and year j , Y kj , was assumed to follow a binomial distribution denoted Y kj ∼ Binomial n kj , θ kj where n kj was the sample size (the number of patients involved) and θ kj was the probability of treatment success. The relation between the estimates of AmE, covariates, and random effects was modelled via the logit link function: where η kj was the linear predictor, β 0 the intercept, x ⊤ kj was the matrix of covariates and β = β 1 , β 2 , . . . , β p was the vector of regression coefficients assumed to follow a zero mean Gaussian distribution,µ β = 0 , and a variance β . ψ = (ψ 1 , . . . ψ k ) T which denotes the spatial random effect which accounted for the spatial dependence. This was assumed to follow a multivariate normal distribution with Matérn covariance function and zero mean (i.e.,ψ ∼ MVN (0, ) ). With this specification, the distance at which the spatial correlation is close to 0.1, the spatial range,r , and the spatial variance σ 2 were estimated. ξ j ∼ N ρξ j−1 , τ 2 , j > 1 represent the auto-correlated temporal error terms, whileξ 1 ∼ N 0, τ 2 ; τ and ρ are the precision and correlation parameters, respectively. This was a stationary autoregressive process of order one (i.e., AR1), with a Markovian temporal structure, in which the AmE of year j − 1 influenced the AmE in year j . Inclusion of the independent and identically distributed (i.i.d.) site-specific random effects was tested in all model formulations and assessed to see if it improved the fit. The described model was used to predict AmE, defined as the proportion of individuals with falciparum malaria infection effectively treated with the anti-malarial drug at different places and periods in the context of the actual clinical setting, while accounting for the health system, climate, environment, and socio-demographic factors. Models were fitted in a Bayesian framework using R-INLA [78, 79] . The Bayesian model formulation was completed by assigning a prior distribution to all unknown parameters and hyperparameters. The initial model assumed non-informative priors [78] and was further refined to include weakly informative priors if doing so improved model performance. A sensitivity analysis was done to examine the choice of priors for the hyperparameters, the likelihood of the outcome and inclusion of space-time interaction. For the temporal component, i.i.d., first-order random walk (RW1), second-order random walk (RW2), and firstorder autoregressive (AR1) models were tested [80] . For the spatial components, range and variance, the effect of a non-informative prior was compared to penalized complexity (PC) priors [81] , and a fixed range. Both beta and binomial distributions were considered for the outcome variable. Furthermore, a model with an overall temporal trend common to all spatial units and an overall spatial effect common to all time periods was compared against a model that allowed variation over space and time. Watanabe Akaike information criterion (WAIC), β ∼ N µ β , � β root mean squared errors (RMSE), and the correlation between the observed data and the predicted values, the R 2 , were used to compare the model fits. Using the variables retained from the first selection process, the spacetime geostatistical model was built sequentially, starting with Model 1 containing no covariates; Model 2 with national level covariates; Model 3 with environmental and climate covariates; and, Model 4 with a combination of environmental, climate and national level covariates. All models included an annual time variable. Models were subjected to validation and calibration procedures using conditional predictive ordinate (CPO) and probability integral transform (PIT) to assess predictive performance [82] [83] [84] [85] [86] [87] . Additional out-of-sample prediction was performed using a threefold cross-validation (~ 30/70 rule) in which the response data were split randomly into 3 non-overlapping subsets. Two sub-sets were used for model training, while the third sub-set was used for validation. This process was repeated 12 times for 4 different splits of the data. Through this method each observation was used in a test and training set. RMSE and R 2 , calculated between the observed and predicted data are used to assess model performance. Furthermore, in-sample and out-of-sample estimates of the RMSE were compared to assess overor under-fitting. The statistics for model comparisons, together with results of validation/calibration and predictive ability, were used to select the best model. The models were fitted using 1991-2016 data. To forecast AmE for 2017, 2018 and 2019, the spatial pattern was assumed to be constant after 2016 and thus the pixel-level temporal trends in AmE were interpolated linearly from the time series models. The modelling framework is further explained in Additional file 1: Section 3- Figure S3 .1. The estimates obtained from the model were then adjusted for drug quality and patients' adherence. Due to very limited available information on these important factors, uniform values were used for all regions and all time periods. First, based on the review by Ozawa et al., a penalty of 19.1% was applied to account for the prevalence of sub-standard or falsified antimalarials [88] . Then a 5.0% penalization was used to account for the imperfect adherence to treatment [66] . Non-artemisinin-based anti-malarial effectiveness was not considered for the period after 2015 due to few non-artemisinin clinical efficacy trials being conducted after 2010. The resulting maps present the average AmE levels for the stated periods. Median and interquartile ranges (IQR) are used to report due to the asymmetric distribution of the AmE estimates. To capture uncertainty and spatial heterogeneity in the predicted AmE levels, stochastic realisations from the models' posterior distributions were generated and then summarized to obtain mean and uncertainty estimates for national and sub-national administrative units. The observed data covered the period 1991-2016. Trials on artemisinin-based anti-malarials (ACT + monotherapy) accounted for 88% of the studies included in this analysis. Most studies were performed in Africa (69.4%) and the most commonly tested anti-malarial was artemether-lumefantrine (n = 169) ( Table 1) The final specification of the model, with binomial likelihood and variation over space and time, used noninformative priors for the regression coefficients, PC priors for spatial effects and an AR1 structure for the temporal effects. The in-sample validation and model calibration indicated good performance of the models. Similar findings were obtained for the threefold crossvalidation. The RMSE of the training set did not differ much from that of the validation set indicating that overfitting was not an issue. The R 2 between observed and predicted ranged between 0.86 and 0.89 (artemisininbased) and 0.63 and 0.66 (non-artemisinin), depending on the set of covariates used. Model 4 had the best fit, as indicated by the lowest WAIC, and high predictive ability as indicated by high R 2 ( Table 2 ). Performance metrics for the final geostatistical models fitted for both drug types are shown in Table 2 . The AmE of artemisinin-based and non-artemisinin antimalarial drugs was predicted annually for the period 1991-2019 for all malaria-endemic countries then aggregated into multi-year categories as indicated above. High-resolution maps (5 × 5 km) of AmE, adjusted for the drug quality and adherence, show the global spatial distribution and country-to-country variations (Figs. 1 and 2). Maps of the corresponding uncertainty measure, the IQR, are shown in Additional file 1: Section 4. The global AmE of artemisinin-based drugs was 67.4% relatively stable estimates over time indicated that AmE of artemisinin-based drugs remained high and increased by 6.5% from the years before 2000 to those after 2016 (Fig. 1) . In the years before 2000, countries in sub-Saharan Africa, South America, India, and on the islands of the Indonesian archipelago were predicted to have lower AmE levels (< 60%) (Fig. 1) . 1) . AmE levels often remained stable in countries where multiple ACT medicine was used as the first-line drug of choice, a practice which became more widespread in the mid-2000s. Noteworthy examples include Ghana, Nigeria, Senegal, Angola, and India. Factors positively related to ACT effectiveness in the analysis include access to health care, human resource capacity (skilled birth attendants as a proxy), education levels, and accessibility to cities. In contrast, AmE dropped in countries including Indonesia, Thailand and Vietnam where Dihydroartemisinin piperaquine (DHAP) was the sole first-line treatment and resistance emerged to either artesunate or the partner drug (Fig. 1) . The global AmE of non-artemisinin-based drugs was much lower than the AmE of artemisinin-based drugs, and these estimates also had higher associated levels of uncertainty. Predicted AmE levels were 52.3% Figure S4 .2). The predicted AmE levels were approximately 36% lower than the mean values of measured effectiveness in a controlled trial setting. For all periods, the AmE estimates were lowest in sub-Saharan Africa and in Asia with a few countries observed to regain slight increases in effectiveness after 2011 (Fig. 2) . In contrast to patterns elsewhere, the AmE of non-artemisinin-based drugs in Central and South America remained moderate and stable (Fig. 2) . National level covariates strongly affected the predicted effectiveness of non-artemisinin-based antimalarial drugs. Health system and infrastructure factors, including coverage of skilled human resources, universal coverage, health care access, and accessibility to cities, were associated with increasing effectiveness. Factors negatively correlated with effectiveness included high levels of out of pocket expenditure and urbanization. This study is the first attempt to produce high-resolution maps of spatiotemporal patterns of AmE, while accounting for the prevalence of sub-standard and falsified antimalarials and patient adherence in all malaria-endemic countries. The resulting temporal patterns highlight changes in AmE from 1991 to 2019 while the spatial patterns illustrate heterogeneity between and within countries. Effectiveness of anti-malarial drugs used for treatment has a direct link to the progress of impact indicators, such as rates of malaria incidence and mortality in the population, which makes knowledge of this metric essential to control programmes. These findings provide additional evidence on practical considerations for implementing malaria treatment policies to ensure adequate anti-malarial effectiveness, including highlighting the roles that drug quality, adherence and health system quality play in AmE. Despite high clinical efficacy levels obtained under controlled conditions, AmE in artemisinin-based drugs dropped by at least a third when applied in the routine care delivery system. The drop was higher for the non-artemisinin-based drugs, likely due to increased level of resistance to those treatments. Overall, the results show that artemisinin-based anti-malarials have higher and more stable AmE compared to non-artemisinin-based drugs. For artemisininbased anti-malarials, areas of lower AmE include the central and eastern part of sub-Saharan Africa, remote areas of South America, and Southeast Asia. The findings from this analysis suggest that non-artemisinin drugs remained effective for uncomplicated falciparum malaria in the South and Central American regions through 2015, but performed poorly elsewhere. However, this finding is associated with high levels of uncertainty due to little clinical efficacy data within the Americas. As such, this result should be viewed cautiously, and careful monitoring of both anti-malarial drug efficacy and health system performance metrics associated with effectiveness should accompany the continued use of non-ACT as front-line treatment in Central American countries. Resistance to non-artemisinin-based drugs has been observed in Africa since the 1980s [89] and inspired treatment policy changes to ACT since 2003 [90]. The WHO critical threshold for clinical efficacy is set at > 90%, but no documented threshold is set for AmE. Further investigation is needed in areas with low predicted effectiveness levels to determine factors driving the gap between the two metrics. Nevertheless, these findings suggest that, despite the availability of efficacious anti-malarials and over 80% of endemic countries adopting them as first line treatments, policy implementation gaps and challenges remain and impact malaria incidence and mortality. The emergence of resistance of artemisinin derivatives in Southeast Asia and its possible extension in other endemic regions may very negatively impact AmE, repeating patterns observed for non-artemisinin-based drugs in the past. Time was an important parameter for modelling patterns of artemisinin-based AmE. In the early 2000s ACT was introduced, proved to be highly effective at treating malaria, and thus was adopted by many countries as a first-line drug to treat falciparum malaria. Prior to this period, artemisinin-based monotherapy was widely used, but this approach has since fallen out of favour as it is believed to promote emergence of drug resistance [14, 16] . In some regions, despite ACT being adopted as first-line treatment policy, their implementation has faced a number of challenges. Demographic and health survey and malaria indicators survey and other literature have shown that health workers still prescribe other anti-malarials for a range of reasons including patient preference, provider perception on specific types of antimalarials, ACT stock-outs, costs including those incurred when accessing care, and higher availability and access to non-recommended anti-malarials. These multifaceted drivers of AmE have been reported across Africa, including in Kenya [91] , Cameroon [92] , Democratic Republic of Congo (DRC) [93] , and Madagascar, and have slowed progress towards increasing AmE and reducing malaria burden [94] . The long term use of single anti-malarial drugs results in high drug-based selective pressure, which has been proven to decrease parasite sensitivity [95] , and could explain the decreasing AmE patterns observed in some settings. Some countries introduced multiple ACT as first-line treatment options, which appears to have maintained the high AmE of ACT by reducing drug pressure. These policies also provided treatment choices to patients, which may have increased adherence. Countries adopting this strategy include Angola, Brazil, Burkina Faso, Nigeria, Senegal, Togo, Sierra Leone, China, and Myanmar [12, 96, 97] ; countries with low ACT AmE could potentially use this as a mechanism for improving treatment success. With the exception of Central America, where nonartemisinin-based AmE was higher in 2011-2015 than in 1991-2000, non-artemisinin drugs had reducing effectiveness in most areas and their efficacy changed less over time. This result is supported by the continued use of chloroquine as first-line treatment in several Central American countries [11] . For example, in Belize, Costa Rica, and El Salvador, first-line falciparum malaria treatment consists of chloroquine combined with primaquine (one-day dose) [11] . Using non-artemisinin-based drugs in combination and short-term dosing requirements may have slowed the development of drug resistance, increase patient adherence, efficacy and effectiveness, and led to the patterns observed in the findings (Additional file 1: Section 1) [11] . However, these findings are somewhat speculative as very few datasets on performance of anti-malarial drugs were available from Central and South America, resulting in more uncertain estimates. An unexpected finding of this work was a resurgence in non-ACT AmE in places where they have been banned, such as in Malawi [98] . However, as very few clinical trials on non-ACT have been conducted since the widespread adoption of ACT, this finding is driven by model covariates (e.g., improvements in health systems) rather than response data, and should be interpreted cautiously. By aggregating all ACT within a single analysis, direct assessment of known AmE limitations related to the efficacy of the partner drug (e.g., Artesunate-sulfadoxine-pyrimethamine) were not possible. These limitations include administration aspects, such as duration of treatment and the number of tablets in the dose regimens of the partner drugs [99, 100] . This could be a possible explanation for the lower drug effectiveness observed in Djibouti, Ecuador, India, Pakistan, and Sudan. Some of these countries changed their treatment policies to other ACT, such as Artemether-lumefantrine or DHAP, to increase effectiveness. However, even the most recently developed ACT, DHAP, faces a threat of resistance in some parts of the Greater Mekong Region [101] . Current efforts to sustain effective treatment of falciparum malaria in such areas include introduction of the triple artemisinin-based combination therapy (TACT) [99] . Lack of data on drug resistance prevented this important parameter from being included within the AmE models. Health system factors are associated with anti-malarial AmE. Access to health care and human resource capacity influence how and which drugs are prescribed and used. With low access to health care, a significant number of cases will not reach the health care system. Such cases will either not receive any treatment or obtain treatment through other sources, the latter of which may result in the use of a non-first-line treatment and failure to record the type, quality and dosage of the drug within official statistics. In areas where drug monitoring is not effective, irrational provision and unregulated use of anti-malarials might be high, including sub-optimal dosage and increased use of falsified, sub-standard, or nonrecommended medicines, all of which may lead to low effectiveness. Health workers' skills and compliance with treatment guidelines, along with drug availability, determine which drugs are provided to patients and whether the treatments are properly managed, both of which are linked to an effective response to drugs [102] . Sociodemographic factors, including education and accessibility to cities, may have effects similar to those of access to health care and the knowledge of both the patient and health care provider. Political and economic upheaval are also likely to impact treatment AmE. For example, since the mid-1990s, the DRC and Central Republic of Africa have experienced high levels of violence, population displacement, and destruction of infrastructure, including health facilities. These factors reduced access to care, increased rates of infection, and led to poorer management [103] . Similarly, outbreaks of Ebola virus and SARS-CoV-2 (COVID-19) have shown the ability to devastate or overwhelm health care systems, which may disrupt access to core malaria interventions [41, 104] . The poor state of the health care systems within low-resource settings could explain low estimates of AmE in areas facing political instability despite the adoption of ACT as firstline treatment in these locations. In the Greater Mekong Region, malaria transmission patterns are rapidly evolving and there is vast spatial heterogeneity. International borders where transmission remains high are of particular concern, as these areas have poorer access to health care facilities and malaria surveillance measures [105] . Furthermore, malaria control measures are very hard to establish and implement effectively within highly mobile migrant populations [106] [107] [108] [109] . This analysis has several noteworthy limitations that should be considered when evaluating estimates. First, the sparsity of efficacy trial data, particularly outside sub-Saharan Africa, led to high levels of uncertainty within the AmE result. This outcome stems from the challenges of conducting efficacy trials, which are costly in terms of money, time and effort, and are rarely conducted in regions with no evidence of treatment failure. Results of efficacy trials conducted by countries or the WHO are not systematically published or made available to stakeholders, nor is individual patient data shared which limits standardization of drug efficacy outcomes. Regional circumstances that are known to affect anti-malarial intervention programmes may also prevent clinical trials from being conducted (e.g., chronic warfare has hampered the implementation of malaria control interventions in South Sudan [110] ). To mitigate these important data limitations, countries are urged to explore potential mechanisms to utilize routine surveillance systems for continuous assessment of anti-malarial drugs performance. Future analysis utilizing these estimates may benefit from including country-specific primary data related to utilization of health services and anti-malarials. Routine data from countries provides opportunities to refine this estimate iteratively. A second noteworthy limitation is that this study did not utilize patient-level or pharmacokinetic/pharmacodynamic (PK/PD) data. Such data would provide patient and drug information (e.g., parasitaemia levels, status of fever, genetics, drug concentration, and biological processes) that could be used to refine estimates [111] . Third, individuals are included in clinical trials only if they meet eligibility criteria, which may result in under-representation of the segments of the population most affected by malaria. This could occur, for example, if clinical trials over-represent adults when children under five years represent the majority of cases. As a result, trial results may not be generalizable to the real-world population. Fourth, due to non-availability of data on adherence and quality of anti-malarials medicine used for treatment, a constant adjustment was applied uniformly over space and time. These metrics are likely to vary, therefore this scaling may over-or underestimate AmE. Fifth, the socio-demographic covariates used in this analysis were modelled using a limited set of predictor variables and are somewhat collinear despite a variable selection process conducted. This could hinder the interpretation of results by producing circularity within downstream assessments of causal relationships between AmE and metrics of national development. While this is worth noting, this is not a critical limitation to the study, but should be considered if these results are used in an analysis with other GBD covariates. Sixth, most of the covariates are modelled products that are associated with uncertainty, which is difficult to fully propagate within modelling frameworks. The noise inherited in the efficacy estimates from the WWARN database is expected to be the largest contributor of uncertainty in the AmE estimates, as suggested by the random effects, and thus uncertainty in the covariates was comparatively minor but could still lead to underestimated uncertainty in the final results. Finally, the uncertainty related to AmE estimates varies across space and time, which is characterized by producing multiple realisations of AmE for each year. By summarizing these realisations, mean and uncertainty maps are produced and made available for download so that other researchers can propagate these uncertainties through their analyses appropriately. This work utilized data from clinical efficacy trials to produce global-scale predictions of anti-malarial drug effectiveness, while also incorporating information on drug quality and patient adherence. Triangulating modelling and policy decision thresholds, these predictions provide new insights and help characterize spatial patterns in effectiveness, which provide evidence-based and geographically explicit guidelines for optimal medication-based malaria control worldwide. Most malariaendemic countries are progressing towards elimination, with anti-malarial drugs playing a key role in driving down malaria burden. Prompt diagnosis and effective treatment of cases remain an important strategy in the management and control of malaria in all endemic countries. As such, understanding the state of anti-malarial drug effectiveness becomes a crucial component. Findings from this study provide evidence that ACT remains highly effective as first-line treatment for uncomplicated falciparum malaria compared to non-artemisinin based anti-malarials. However, the drug efficacy levels reported in clinical settings are unlikely to reflect real-world efficacy. Results obtained from this analysis suggest that strategies used in different countries to sustain the effectiveness of these drugs are working, including the use of multiple options for first-line treatment and combining artemisinin with other anti-malarial drugs that remain effective locally. These findings are relevant for guiding policy decisions on targeted interventions towards malaria and contribute to global malaria burden estimates in the World Malaria Report and the GBD study. Supplementary information accompanies this paper at https ://doi. org/10.1186/s1293 6-020-03446 -8. Additional file 1. Supplementary information on methods, data and findings. ACT : Artemisinin-based combination therapy; AL: Artemether-lumefantrine; AmE: Anti-malarial drug effectiveness; ASAQ: Artesunate-amodiaquine; ASMQ: Artesunate-mefloquine; ASSP: Artesunate-sulfadoxine-pyrimethamine; DHAP: Dihydroartemisinin-piperaquine; GBD: Global burden of disease; IHME: Institute for Health Metrics and Evaluation; IQR: Interquartile range; MAP: Malaria Atlas Project; PC: Penalized complexity; WHO: World Health Organization; WWARN: Worldwide Anti-malarial Resistance Network. Global, regional, and national agesex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study Global, regional, and national age-sex specific mortality for 264 causes of death, 1980-2016: a systematic analysis for the Global Burden of Disease Study Geneva: World Health Organization The changing risk of Plasmodium falciparum malaria infection in Africa: 2000-10: a spatial and temporal analysis of transmission intensity Key points: World malaria report. Geneva: World Health Organization Report of a WHO scientific group. Geneva: World Health Organization Chemotherapy of malaria. Geneva: Wolrd Health Organization Guidelines for the treatment of malaria WHO certifies Paraguay malaria-free. Geneva: World Health Organization Geneva: World Health Organization Geneva: World Health Organization Countries race to contain resistance to key anti-malarial Evidence of artemisinin-resistant malaria in western Cambodia Emergence and spread of artemisinin resistance calls for intensified efforts to withdraw oral artemisinin-based monotherapy from the market. Geneva: World Health Organization Drug resistance in malaria. Geneva: World Health Organization Anti-malarial drug efficacy and drug resistance. Geneva: World Health Organization Preventing anti-malarial drug resistance through combinations Antimalarial drug resistance, artemisinin-based combination therapy, and the contribution of modeling to elucidating policy choices Emergence of artemisinin-resistant malaria on the western border of Thailand: a longitudinal study Artemisinin resistance in Plasmodium falciparum malaria Efficacy of dihydroartemisinin-piperaquine for treatment of uncomplicated Plasmodium falciparum and Plasmodium vivax in Cambodia Reduced susceptibility of Plasmodium falciparum to artesunate in southern Myanmar Spread of artemisinin resistance in Plasmodium falciparum malaria Spread of artemisinin-resistant Plasmodium falciparum in Myanmar: a cross-sectional survey of the K13 molecular marker The challenge of artemisinin resistance can only be met by eliminating Plasmodium falciparum malaria across the Greater Mekong subregion Antimalarial drug resistance of Plasmodium falciparum in India: changes over time and space Efficacy and safety of artemether-lumefantrine, artesunate-amodiaquine, and dihydroartemisinin-piperaquine for the treatment of uncomplicated Plasmodium falciparum malaria in three provinces in Angola Absence of kelch13 artemisinin resistance markers but strong selection for lumefantrine-tolerance molecular markers following 18 years of artemisinin-based combination therapy use in Mpumalanga Province Emergence and clonal expansion of in vitro artemisinin-resistant Plasmodium falciparum kelch13 R561H mutant parasites in Rwanda Evolution of resistance to sulfadoxinepyrimethamine in Plasmodium falciparum Amodiaquine resistant Plasmodium falciparum malaria in vivo is associated with selection of pfcrt 76T and pfmdr1 86Y A study on the public health and socioeconomic impact of substandard and falsified medical products. Geneva: World Health Organization In vitro evaluation of the quality of essential drugs on the Tanzanian market Epidemic of Plasmodium falciparum malaria involving substandard antimalarial drugs Substandard drugs: a potential crisis for public health A link between poor quality antimalarials and malaria drug resistance? Methods for surveillance of anti-malarial drug efficacy. Geneva: World Health Organization Clinical determinants of early parasitological response to ACTs in African patients with uncomplicated falciparum malaria: a literature review and meta-analysis of individual patient data How to contain artemisinin-and multidrug-resistant falciparum malaria Global Technical strategy for malaria 2016-2030. Geneva: World Health Organization The WWARN Clinical Trials Publication Library: a live, open-access database of Plasmodium treatment efficacy trials Report on anti-malarial drug efficacy and drug resistance: 2000-2010. Geneva: World Health Organization Evidence of Plasmodium falciparum malaria multidrug resistance to artemisinin and piperaquine in western Cambodia: dihydroartemisininpiperaquine open-label multicenter clinical assessment Efficacy of quinine, artemether-lumefantrine and dihydroartemisinin-piperaquine as rescue treatment for uncomplicated malaria in Ugandan children Efficacy and safety of re-treatment with the same artemisinin-based combination treatment (ACT) compared with an alternative ACT and quinine plus clindamycin after failure of first-line recommended ACT (QUINACT): a bicentre, open-label, phase 3, randomised controlled trial Report of a WHO Technical Consultation. Geneva: World Health Organization A database of anti-malarial drug resistance WHO. Parasite drug resistance. Geneva: World Health Organization Global anti-malarial drug policy database Africa. Geneva: World Health Organization Routine delivery of artemisinin-based combination treatment at fixed health facilities reduces malaria prevalence in Tanzania: an observational study East African Network for Monitoring Anti-malarial Treatment. The efficacy of anti-malarial monotherapies, sulphadoxine-pyrimethamine and amodiaquine in East Africa: implications for sub-regional policy East African Network for Monitoring Anti-malarial Treatment. Monitoring anti-malarial drug resistance within National Malaria Control Programmes: the EANMAT experience Amazon malaria initiative/Amazon network for surveillance of anti-malarial drug resistance. Ten years of malaria prevention and control in the region. Panama City: Pan American Health Organization Fifth meeting of the Greater Mekong Subregion (GMS) therapeutic efficacy studies (TES) network. Vietnam: World Health Organization The race against drug resistance. Center for Global Development's Drug Resistance Working Group Sharing individual patient and parasite-level data through the WorldWide Anti-malarial Resistance Network platform: a qualitative case study World Anti-malarial Resistance Network I: clinical efficacy of anti-malarial drugs Clinical module: data management and statistical analysis plan version 1.2 Statistical methods to derive efficacy estimates of anti-malarials for uncomplicated Plasmodium falciparum malaria: pitfalls and challenges Intention-to-treat concept: a review Understanding the intention-to-treat principle in randomized controlled trials Some considerations in the design and interpretation of anti-malarial drug trials in uncomplicated falciparum malaria A primer on effectiveness and efficacy trials Assessing the impact of imperfect adherence to artemether-lumefantrine on malaria treatment outcomes using within-host modelling Mapping Plasmodium falciparum mortality in Africa between 1990 and 2015 High resolution interactive maps Re-examining environmental correlates of Plasmodium falciparum malaria endemicity: a data-intensive variable selection approach Institute of Health Metrics and Evaluation Data 2020 Malaria Covariates Oxford: Malaria Atlas Project Air temperature suitability for Plasmodium falciparum malaria transmission in Africa 2000-2012: a high-resolution spatiotemporal prediction A world malaria map: Plasmodium falciparum endemicity in 2007 Malaria mapping: understanding the global endemicity of falciparum and vivax malaria An effective approach for gap-filling continental scale remotely sensed time-series Bayesian geostatistical modelling of malaria and lymphatic filariasis infections in Uganda: predictors of risk and geographical patterns of co-endemicity Multicollinearity in regression analysis: the problem revisited Approximate Bayesian inference for latent Gaussian models using integrated nested Laplace approximations Gaussian predictive process models for large spatial data sets Spatial and spatiotemporal models with R-INLA Penalising model component complexity: a principled, practical approach to constructing priors Bayesian measures of model complexity and fit Predictive model assessment for count data Advances in mapping malaria for elimination: fine resolution modelling of Plasmodium falciparum incidence The conditional predictive ordinate for the normal distribution Model determination using predictive distirbutions with the implementation via sampling-based methods Statistical theory: the prequential approach Prevalence and estimated economic burden of substandard and falsified medicines in low-and middle-income countries: a systematic review and meta-analysis research data, including large and complex data types • gold Open Access which fosters wider collaboration and increased citations maximum visibility for your research: over 100M website views per year Ready to submit your research ? Choose BMC and benefit from: 90. WHO. Position of WHO's Roll Back Malaria Department on malaria treatment policy. Geneva: World Health Organization Why don't health workers prescribe ACT? A qualitative study of factors affecting the prescription of artemether-lumefantrine Treatment of malaria from monotherapy to artemisinin-based combination therapy by health professionals in rural health facilities in southern Cameroon Drug use in the management of uncomplicated malaria in public health facilities in the Democratic Republic of the Congo Anti-malarial drug prescribing by healthcare workers when malaria testing is negative: a qualitative study in Madagascar Longitudinal in vitro surveillance of Plasmodium falciparum sensitivity to common anti-malarials in Thailand between 1994 and 2010 Geneva: World Health Organization Geneva: World Health Organization A longitudinal trial comparing chloroquine as monotherapy or in combination with artesunate, azithromycin or atovaquone-proguanil to treat malaria Investigating the efficacy of triple artemisinin-based combination therapies for treating Plasmodium falciparum malaria patients using mathematical modeling Resistance to artemisinin combination therapies (ACTs): do not forget the partner drug Origins of the current outbreak of multidrug-resistant malaria in southeast Asia: a retrospective genetic study Effective coverage and systems effectiveness for malaria case management in sub-Saharan African countries Sustainability and equity: a better future for all The potential impact of health service disruptions on the burden of malaria. Geneva: World Health Organization Malaria elimination in the Greater Mekong Subregion: challenges and prospects. Towards malaria elimination-a leap forward Malaria in the Greater Mekong Subregion: heterogeneity and complexity Malaria situation in the Greater Mekong Subregion Malaria ecology along the Thailand-Myanmar border The challenges of malaria elimination in Yunnan Province, People's Republic of China strategies, progress and challenges Combination therapy in recent onset rheumatoid arthritis: a randomized double blind trial of the addition of low dose cyclosporine to patients treated with low dose chloroquine Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations The WorldWide Anti-malarial Resistance Network (WWARN) is thanked for the data provision and technical support to all issues related to the aggregated database. Authors' contributions DJW, PWG and GR designed the original study; GR conducted the literature review; SFR, DJW revised the study design and the analysis plan. KAT, GR, GSH, PJG, HSG ensure the availability of data for analysis; SFR and GR conducted the analysis with technical inputs from DJW, TCDL, AN, AP, MN. SFR and GR drafted the initial version of the manuscript; SHK, JAR and ELC created the visualisations; SFR, GR, PJG, DJW interpreted the findings. All authors read and approved the final manuscript. The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request. Not applicable. Not applicable.