key: cord-0016362-ubtdtrg1 authors: Shankar, Hari; Singh, Mrigendra Pal; Phookan, Sobhan; Singh, Kuldeep; Mishra, Neelima title: Diagnostic performance of rapid diagnostic test, light microscopy and polymerase chain reaction during mass survey conducted in low and high malaria-endemic areas from two North-Eastern states of India date: 2021-03-27 journal: Parasitol Res DOI: 10.1007/s00436-021-07125-8 sha: 3c389ff5fd9448bb9e9ee43605757b735943b109 doc_id: 16362 cord_uid: ubtdtrg1 An early and accurate diagnosis followed by prompt treatment is pre-requisite for the management of any disease. Malaria diagnosis is routinely performed by microscopy and rapid diagnostic tests (RDTs) in the field settings; however, their performance may vary across regions, age and asymptomatic status. Owing to this, we assessed the diagnostic performance of conventional and advanced molecular tools for malaria detection in low and high malaria-endemic settings. We performed mass blood surveys in low and high endemic regions of two North-Eastern districts from the states of Assam and Meghalaya. A total of 3322 individuals were screened for malaria using RDT, microscopy and PCR and measures of diagnostic accuracy were estimated. Out of 3322 individuals, 649 (19.5%) were detected with malaria parasite. Asymptomatic were 86.4% (2872/3322), of which 19.4% (557/2872) had Plasmodium infection. The sensitivity and specificity of microscopy were 42.7% and 99.3%, and RDT showed 49.9% and 90.4%, respectively, considering PCR as standard. RDT (AUC: 0.65 vs 0.74; p = 0.001) and microscopy (AUC: 0.64 vs 0.76; p < 0.0001) performances were significantly lower in low compared to high endemic areas. True positive rate was lower in asymptomatics but true negative rate was found similar to symptomatic individuals. The conventional diagnostic tools (RDT and microscopy) had detected malaria in children with nearly twofold greater sensitivity than in the adults (p < 0.05). To conclude, asymptomatics, adults and low malaria-endemic regions require major attention due to mediocre performance of conventional diagnostic tools in malaria detection. According to World Malaria Report 2019, WHO estimated 228 million malaria cases in 2018 and 231 million cases in 2017 worldwide and reported that nineteen countries in sub-Saharan Africa and India accounted for nearly 85% of the global malaria cases in 2018 (WHO World Malaria Report 2019). Despite the achievements in reducing the malaria burden, there are still substantial numbers of malaria cases across the globe causing morbidity and mortality. In recent years, due to the pace of malaria elimination programme in India, a downfall trend in number of malaria cases and deaths has been observed (National Vector Borne Disease Control Programme 2019). To maintain this pace, accurate diagnosis and prompt treatment of malaria cases is of utmost priority so that even the last parasite circulating in the community can be detected and eliminated. In the current scenario, microscopy and rapid diagnostic tests (RDTs) are being used for malaria diagnosis (WHO World Malaria Report 2019), where microscopy is considered gold standard. Indeed, remote tribal areas and low resource settings are more inclined towards using RDTs in comparison to microscopy, due to its user-friendly operations, quick results and no requirements of any equipment, electricity or technical speciality whatsoever (McMorrow et al. 2011) . Recent evidence suggests the presence of sub-microscopic infections (van Eijk et al. 2019) , low-density Plasmodium infection and asymptomatic parasitaemia in Indian community (van Eijk et al. 2020; Shankar et al. 2021) , even in low transmission settings (Kaura et al. 2019) . The presence of such hidden reservoir of infectiousness may pose a challenge to the malaria elimination programme and therefore must be curtailed to achieve the elimination goal. Nevertheless, India has shown its strong commitment by developing the National Framework for Malaria Elimination, in which the states as well as districts are categorised based on annual parasite incidence and district wise malaria confinement and elimination strategies have been devised (Ministry of Health, and Family Welfare, Government of India 2016). These strategies however would be more effective if should be applied in conjunction with more sensitive and accurate diagnostic methods especially in area-specific manner, i.e. using advanced molecular tools in areas reported to have low-density Plasmodium infections. Malaria diagnosis always remains a grey area of research despite knowing its importance in disease management. Thus in addition to antimalarial drug and vaccine development research, there is a need to invest and focus on improving the utility of existing diagnostics and developing new methods for accurate detection of parasites (Wongsrichanalai et al. 2007 ). This would not only prevent misdiagnosis leading to the widespread overtreatment with antimalarials, which is one of the factors responsible for the development of drug resistance in Plasmodium, but will also reduce the cost incurred on antimalarial drug treatment. Moreover, related deaths can be averted if the patients receive accurate malaria diagnosis and correct treatment (Chanda et al. 2009; Uzochukwu et al. 2009 ). It is obvious that a reliable diagnostic test with high sensitivity and specificity can avert malaria-related deaths, increasing drug resistance, unnecessary treatments and rising drug costs (Rafael et al. 2006) . Therefore, field evaluation of diagnostic accuracy of currently used malaria detection methods (microscopy and RDT) should be performed. In this study, we performed mass surveys in high and low malaria-endemic areas to evaluate the diagnostic performance of microscopy, RDT and PCR among different age groups and asymptomatic individuals from two North-Eastern districts of India. The present study is derived from a subset of data obtained by conducting mass blood surveys during dry season, i.e. between February to April 2017, in two North-Eastern districts from the states of Assam and Meghalaya of India. During the surveys, a total of 9118 individuals were screened for malaria by on-spot diagnosis using SD Bioline malaria Ag pf/pv RDT which detects histidine-rich protein 2 (HRP2) antigen specific to Plasmodium falciparum and Plasmodium lactate dehydrogenase (pLDH) specific to Plasmodium vivax and light microscopy in the field laboratory. Based on the RDT results, the individuals were given antimalarial treatment as per the National guidelines for the treatment of malaria in India. Dried blood spot (DBS) on Whatman filter paper, grade 3 CHR (Merck, Germany, UK) was prepared for performing parasite genotyping using polymerase chain reaction (PCR) in the test laboratory. The individuals of all age groups and gender irrespective of any clinical sign and symptoms of malaria were included in the study. Out of total dataset of 9118 samples, 3500 were drawn randomly for diagnosis using PCR, of which 43 samples could not be amplified for PCR analysis. By doing this random selection, each sample had equal chances of being selected for PCR diagnosis. Furthermore, we performed power analysis by considering 90% power and 5% alpha and found that the sample size of subset was large enough to generalise the findings. A subset of samples (n = 3322) diagnosed with all three methods, i.e. RDT, microscopy and PCR, were included in this study to estimate their diagnostic accuracy stratified by endemicity, symptoms and age of the participants. The flow diagram showing population screening and diagnosis performed is shown in Fig. 1 . Study districts were categorised in low and high malariaendemic regions based on the reported malaria incidence rate during the last 5 years preceding the survey. Asymptomatic cases were defined as participants who have neither reported history of a fever during 2 weeks preceding the survey nor having body temperature ≥ 37·5°C at the time of examination. Axillary body temperature was recorded using a digital thermometer at the time of sample collection. The participants were categorised as child who were 14 or less years of age. Thick and thin blood smears were prepared at the study site and transported daily to the local laboratory, where fixation of thin blood smears was performed with methanol followed by staining of both thick and thin smears with 3% Giemsa stain solution for 30 min. All the slides were examined under oil emersion (10 × 100 magnification) by experienced microscopists. Thick films were used to identify the presence of parasites, whereas thin films were used to identify species of malaria parasites. A blood slide was considered negative if no parasites were found after examining 100 microscopic fields. For all positive slides, malaria species identification was done. All the microscopists were blinded for RDT results, and later the discordant results (RDT +ve Microscopy −ve and RDT −ve Microscopy +ve ) were re-examined by another experienced microscopist and/or a WHO certified microscopist who was not aware of previous microscopy/RDT results. The final microscopy results were considered positive or negative depending upon the quality check results of the microscopy. Genomic DNA was isolated from DBS using the QIAamp Blood Mini Kit (QIAGEN, USA) according to the manufacturer's protocol. Three punched-out circles (3 mm each) from DBS were placed in a 1.5-ml microcentrifuge tube and incubated overnight at room temperature with 180 μl buffer. The subsequent genomic DNA extraction steps were followed as mentioned in the instruction leaflet (Qiagen 2020). The PCR protocol followed in this study to identify Plasmodium species using PCR is described elsewhere (Snounou et al. 1993) , which was based on targeting coding sequences of the small subunit of ribosomal RNA specific to the parasite species with the detection limit ranged between 1 and 10 parasite per microliter of blood. The primers used in this study were detailed below: Briefly, 25 μl reaction mixtures consisted of 12·5 μl DreamTaq Green PCR mix, 0·4 μM of each primer (10 uM stock), 2 μl of DNA and added sterile water up to 25 μl. All PCR amplifications were carried-out in Applied Biosystem thermocycler as follows: 5 min at 95°C, followed by 35 cycles of 30 s at 95°C, 30 s at 56°C and 1 min at 72°C, with a final extension of 7 min at 72°C. PCR amplifications were analysed on 2% agarose gels prepared with 0·5X Tris-Borateethylenediaminetetraacetic acid buffer in the presence of ethidium bromide. After obtaining the PCR results, the discordant samples (RDT +ve Microscopic +ve PCR −ve and RDT −ve Microscopic −ve PCR +ve ) were re-confirmed using light microscopy and PCR. The data were entered into Microsoft Excel 2007 worksheet and cross-checked for typographical errors. Furthermore, lists of quality checks have been applied in order to ensure quality of data. Data was analysed using R 3.4.3 for Windows (R Project for Statistical Computing). Diagnostic performance of RDT, microscopy and PCR was expressed in terms of sensitivity, specificity, positive and negative predictive values (PPV and NPV, respectively). The epi.tests module of epiR package (Package epiR version 1.0-14, available at: https:// cran.r-project.org/web/packages/epiR/epiR.pdf) was used to calculate diagnostic performance. Receiver operating characteristic (ROC) curve tool was used for diagnostic test evaluation. A p-value <0·05 was considered statistically significant. A total of 3322 individuals were screened for malaria using RDT, microscopy and PCR, of which 1889 (56.9%) were from high and 1433 (43.1%) from low endemic regions. Mean age of participants was 17.2 ± 15.7 years; 63.4% were children (14 years or below age group) and 86.4% (2872/3322) were asymptomatic of which 19.4% (557/2872) had Plasmodium infection irrespective of the diagnostic method used in this study. The estimates of sensitivity, specificity, PPV, NPV, accuracy, Youden's J index of microscopy and RDT were 42.7, 99.3, 87.6, 93.4, 93.1, 0.42 and 49.9, 90.4, 38.9, 93.6, 86 .0, 0.40, respectively, when PCR was considered a reference standard (Table 1 ). When adopting microscopy as a reference, such measures of RDT and PCR were 78.0, 89.6, 29.7, 98.6, 89.0, 0.68 and 87.6, 93.4, 42.7, 99.3, 93 .1, 0.81, respectively. (Table 1) . Measures used to check the performance of malaria diagnostic tools in low and high endemic regions revealed drastically lower performance of microscopy in low endemic regions (Youden's J index: 0.28 vs 0.52) but PCR performance differs slightly between low and high endemic regions (Youden's J index: 0.74 vs 0.85). Though, RDT showed lower sensitivity (37.8% vs 58.9%), Youden's J index (0.31 vs 0.47) and higher specificity (92.8% vs 88.6%) in low compared to high endemic regions while using PCR as a reference, but a reverse scenario was observed when microscopy was adopted as a reference standard ( Table 2 ). The results suggest improved malaria detection ability of diagnostic tools in symptomatic patients compared to asymptomatic individuals, and PCR was highly efficient in malaria detection followed by RDT, irrespective of symptomatic status (Table 3) . Measures of sensitivity, specificity, PPV, NPV, accuracy and Youden's J index demonstrated better case detection ability of all three malaria diagnostic tools, viz. RDT, microscopy and PCR in children compared to adults (Table 4) . ROC curve analysis revealed that area under curve (AUC) for RDT and microscopy did not differ significantly against PCR as a reference standard. Furthermore, plotting of AUC for RDT and microscopy by endemicity, symptoms and age group showed improved performance of RDT (AUC: 0.74 vs 0.65; p = 0.001) and microscopy (AUC: 0.76 vs 0.64; p < 0.0001) in high compared to PPV, positive predictive value; NPV, negative predictive value; +ve, positive; −ve, negative low endemic regions (Fig. 2 a and b) . Malaria detection ability of RDT (AUC: 0.68 vs 0.80; p = 0.001) and microscopy (AUC: 0.70 vs 0.78; p = 0.029) was lower in asymptomatic than symptomatic participants (Fig. 2 c and d) , but found higher in children (AUC: 0.74 vs 0.61; p < 0.0001) in comparison to adults (AUC: 0.76 vs 0.61; p < 0.0001) (Fig. 2 e and f) . A total of 118 samples were observed to be positive by all three diagnostic methods. However, 145 samples were positive only by PCR, 2 by microscopy and 264 by RDT. The possible reasons of higher RDT positivity than PCR might be attributed to the persistence of Plasmodium falciparum-encoded HRP2 in the blood even after parasite clearance, which is the target of RDTs (Fig. 3 ). The present study highlights the possible setbacks in correctly identifying malaria infection by RDT and microscopy in low and high endemic regions of two North-Eastern districts of India. The study also exemplified the role of possible factors such as age, asymptomatic/symptomatic status of population and malaria-endemic regions in affecting the diagnostic performance of RDT, microscopy and PCR. Most of the crosssectional surveys use microscopy as a comparator to check the diagnostic accuracy of RDTs, due to non-availability of resources and expertise in the field conditions to deploy molecular tools. The present study however is the first large-scale mass blood survey to use molecular diagnosis along with Here we report that RDT in comparison to microscopy had higher sensitivity but substantially lower specificity and PPV when PCR was used as a reference standard. These observations suggest that RDT despite having better performance than microscopy may not be useful in accurately determining the proportion of individuals without malaria as malaria negative (due to low specificity). Furthermore, there was very low probability of correctly identifying people as RDT positives among those who had malaria, as reflected by its low PPV. These explanations limit the usefulness of RDTs in mass blood surveys (Parker et al. 2016 ) conducted in nontransmission season; nevertheless, such measures depend upon the comparator or reference standard used while doing the analysis (Bell et al. 2005) . Low density of parasites in individuals might be the plausible reasons for low PPV of RDT. For instance, PCR, like RDT, also showed lower specificity and PPV than microscopy because of inherent inaccuracies associated with RDTs to be used as a reference standard. In low endemic regions, the performance of diagnostic tools found lower than it was observed in high endemic regions. Most of the scientific reports evidenced low parasite density as the prime cause of low performance of standard diagnostic tools (Abeku et al. 2008) . Also, it is known that measures such as sensitivity and PPV are proportionate to the disease prevalence (Trevethan 2017 ) as seen in this study where sensitivity and PPV was higher in high endemic regions. We found high false positive rate (FPR) in RDT than microscopy irrespective of endemic regions. Especially, FPR was much more in high PPV, positive predictive value; NPV, negative predictive value; +ve, positive; −ve, negative compared to low endemic regions (Abeku et al. 2008 ) when PCR was used as reference standard. Contrary to this, false negative rate (FNR) was found to be higher in microscopy than RDT irrespective of endemic regions and even higher in low compared to high endemic regions. FPR and FNR both are the major concerns for public health as FPR on one hand exposes healthy individual by unnecessary administration of drugs and creates drug pressure on parasites, thereby could result in drug resistance. While on the other hand, high FNR renders a certain proportion of population to devoid of accurate diagnosis and correct treatment. High FNR observed in our study might be associated with the presence of deletion in Pfhrp2/3 gene of Plasmodium falciparum, which is reported near to 25% in Indian settings (Bharti et al. 2016 ). This could have serious implications in disease transmission that may also result in mortality (Berzosa et al. 2018) . Interestingly, RDT performance was at par with PCR in low endemic regions, when data were analysed using microscopy as a reference standard; nevertheless, this was not the case in high endemic regions. These observations suggest promising use of RDTs in low transmission settings, but caution should be taken in deploying these RDTs to precisely detect malaria infection, due to the variabilities associated with its sensitivity and specificity between different areas, seasons and age groups (Abeku et al. 2008) . Our data suggest better malaria detection ability of microscopy and RDT in symptomatic compared to asymptomatic individuals. In comparison to symptomatic where standard diagnostic tools are losing nearly 30-40% malaria cases, approximately 60% malaria positive cases were missed among asymptomatic individuals. On the other hand, only 9% symptomatic and 13% asymptomatic cases could not be detected by PCR when microscopy was used as a reference. These results are in agreement to the view that microscopy and RDT are able to detect nearly all symptomatic infections but advanced molecular techniques are needed for the detection of asymptomatic infections in low transmission settings (Turki et al. 2015) thus limit the use of RDTs in population level surveillance for estimating true malaria burden. The fraction of low-density parasitaemia in patent and sub-patent infections is associated with the parasite as well as host factors, and investigations also suggest that high proportion of low-density infections that remained undetected by microscopy and RDT in low malaria-endemic region is asymptomatic (Nicastri et al. 2009; Harris et al. 2010) . Nevertheless, the density of parasites in asymptomatic individuals never remains fixed; therefore, it needs to be checked periodically to optimise the utility of RDT in varying transmission settings (McMorrow et al. 2011 ). We found a dramatic change in sensitivity of microscopy and RDT when used for malaria screening between children and adults. Children have lower immunity than adults, which may be attributable to higher sensitivity of conventional malaria diagnostic methods in children than adults, as observed in our study. A recent meta-analysis on assessing the ability of RDTs in malaria diagnosis supports our findings about high accuracy of RDT in children, especially in those children residing in high transmission regions (Zhu et al. 2020 ). The adults encounter higher number of infection episodes in their life and therefore present low-density infections due to higher interference of antibodies developed against encountered pathogen (Osei-Yeboah et al. 2016 ). The ROC curve analysis was used to calculate AUC that ranged between 0.5 and 1, where 0.5 is unacceptable test and 1 is outstanding. AUC values of RDT and microscopy in the range of 0.74 to 0.76 suggest carefully using these conventional diagnostic methods in mass blood surveys. AUC data suggest that RDT and microscopy in comparison to PCR were not much effective in discriminating malaria-positive and -negative individuals in low malaria-endemic areas, adults and asymptomatic cases. Precisely, RDT positivity reflects the plasmodium antigenaemia, not parasitaemia. Therefore, proportion of RDT positive population reflects presence of malaria antigen in their blood. It does not reflect the prevalence of parasite, which can be estimated by microscopy and PCR. In our study, out of total positive cases detected with either diagnostic method (N = 649), more than 40% (264/649) were detected exclusively by RDT and not by higher sensitive technique like PCR. This might be due to the persistence of plasmodium antigenaemia such as ongoing HRP2 circulation in recently treated infections, sub-microscopic infection in the community and human errors related to the interpretation or recording of RDT results (McMorrow et al. 2011 ). Our results suggest that RDT in comparison to microscopy has high sensitivity but low specificity and PPV. Areaspecific usage of standard diagnostic tools along with advanced malaria detection methods should be envisaged. Nevertheless, active case detection using RDT in mass blood surveys may be used, specifically in low endemic regions. Thus, low endemic regions, asymptomatic malaria cases and adult age group are to be dealt with extra caution while using standard malaria diagnosis tools. Fig. 3 Venn diagram showing positive results using three different malaria diagnostic methods. A total of 118 samples are showing concordance in overlapping section, when detected using three different techniques NIMR for being a coordinator of the study. The authors also wish to extend their thanks to the experienced technicians of our institute for performing rigorous quality check of microscopy results. Author contribution SP was the principal investigator of the study. SP and NM conceived and designed the study. HS and MPS contributed substantially in data collection, data analysis and interpretation of the results. HS, SP and MPS executed the field and laboratory work. KS and NM coordinated the field operations and logistic arrangements. HS drafted the first version of the manuscript. MPS and NM critically reviewed the manuscript and all authors provided intellectual inputs, reviewed and approved this manuscript. Determinants of the accuracy of rapid diagnostic tests in malaria case management: evidence from low and moderate transmission settings in the East African highlands False-positive results of a Plasmodium falciparum histidine-rich protein 2-detecting malaria rapid diagnostic test due to high sensitivity in a community with fluctuating low parasite density Comparison of three diagnostic methods (microscopy, RDT, and PCR) for the detection of malaria parasites in representative samples from Equatorial Guinea Prevalence of pfhrp2 and/or pfhrp3 gene deletion in plasmodium falciparum population in eight highly endemic states in India Cost-effectiveness analysis of the available strategies for diagnosing malaria in outpatient clinics in Zambia A large proportion of asymptomatic Plasmodium infections with low and sub-microscopic parasite densities in the low transmission setting of Temotu Province, Solomon Islands: challenges for malaria diagnostics in an elimination setting Prevalence of submicroscopic malaria in low transmission state of Punjab: a potential threat to malaria elimination Ministry of Health & Family Welfare, Government of India (2016) National framework for malaria elimination In India National Vector Borne Disease Control Programme (2019) Magnitude of the problem Accuracy of malaria diagnosis by microscopy, rapid diagnostic test, and PCR methods and evidence of antimalarial overprescription in nonsevere febrile patients in two Tanzanian hospitals Limitations of malaria reactive case detection in an area of low and unstable transmission on the Myanmar-Thailand border QIAGEN (2020) QIAamp DNA Mini and Blood Mini Handbook Reducing the burden of childhood malaria in Africa: the role of improved Asymptomatic low-density Plasmodium infection during non-transmission season: a community-based cross-sectional study in two districts of North Eastern Region Identification of the four human malaria parasite species in field samples by the polymerase chain reaction and detection of a high prevalence of mixed infections Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice Efficiency of nested-PCR in detecting asymptomatic cases toward malaria elimination program in an endemic area of Iran Costeffectiveness analysis of rapid diagnostic test, microscopy and syndromic approach in the diagnosis of malaria in Nigeria: implications for scaling-up deployment of ACT The burden of submicroscopic and asymptomatic malaria in India revealed from epidemiology studies at three varied transmission sites in India A review of malaria diagnostic tools: microscopy and rapid diagnostic test (RDT) World malaria report High value of rapid diagnostic tests to diagnose malaria within children: A systematic review and meta-analysis Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations Acknowledgements The guidance and support provided by Dr. William Layam, Sr. Regional Director Meghalaya, Dr. Parthajyoti Gogoi, Sr. Regional Director Assam, Dr. H. P. Gupta and Dr. Vas Dev, Ex-Officer-in-Charge, NIMR field unit, Guwahati is highly acknowledged. We thank State Health Programme and Dr. Neena Valecha, Director, The authors declare/s no competing interests.