key: cord-0929647-851j6jop
authors: LeGoff, Jérôme; Kernéis, Solen; Elie, Caroline; Mercier-Delarue, Séverine; Gastli, Nabil; Choupeaux, Laure; Fourgeaud, Jacques; Alby, Marie-Laure; Quentin, Pierre; Pavie, Juliette; Brazille, Patricia; Néré, Marie Laure; Minier, Marine; Gabassi, Audrey; Leroy, Chrystel; Parfait, Béatrice; Tréluyer, Jean-Marc; Delaugerre, Constance
title: Evaluation of a saliva molecular point of care for the detection of SARS-CoV-2 in ambulatory care
date: 2021-10-26
journal: Sci Rep
DOI: 10.1038/s41598-021-00560-8
sha: 7e4ec2414c15f5992b80cab6f8bafb126e5e0605
doc_id: 929647
cord_uid: 851j6jop

Rapid identification of SARS-CoV-2-infected individuals is a cornerstone for the control of virus spread. The sensitivity of SARS-CoV-2 RNA detection by RT-PCR is similar in saliva and nasopharyngeal swabs. Rapid molecular point-of-care tests in saliva could facilitate, broaden and speed up the diagnosis. We conducted a prospective study in two community COVID-19 screening centers to evaluate the performances of a CE-marked RT-LAMP assay (EasyCoV) designed for the detection of SARS-CoV2 RNA from fresh saliva samples, compared to nasopharyngeal RT-PCR, to saliva RT-PCR and to nasopharyngeal antigen testing. Overall, 117 of the 1718 participants (7%) tested positive with nasopharyngeal RT-PCR. Compared to nasopharyngeal RT-PCR, the sensitivity and specificity of the RT-LAMP assay in saliva were 34% and 97%, respectively. The Ct values of nasopharyngeal RT-PCR were significantly lower in the 40 true positive subjects with saliva RT-LAMP (Ct 25.9) than in the 48 false negative subjects with saliva RT-LAMP (Ct 28.4) (p = 0.028). Considering six alternate criteria for reference tests, including saliva RT-PCR and nasopharyngeal antigen, the sensitivity of saliva RT-LAMP ranged between 27 and 44%. The detection of SARS-CoV-2 in crude saliva samples with an RT-LAMP assay had a lower sensitivity than nasopharyngeal RT-PCR, saliva RT-PCR and nasopharyngeal antigen testing. Registration number: NCT04578509.

The coronavirus disease 2019 (COVID-19) pandemic has had a significant impact on the healthcare system and socioeconomic activity. Early diagnosis is critical for prompt actions regarding patient management, infection control and public health control measures 1 . Since transmission can occur from asymptomatic or pre-symptomatic patients, mass testing, together with rigorous contact tracing and isolation, has been recommended to control the pandemic [2] [3] [4] . This strategy implies rapid and reliable testing methods. Although molecular detection of SARS-CoV-2 RNA in nasopharyngeal swabs is considered the "gold standard" for identifying infected individuals 1, 5 , nasopharyngeal sampling requires specific sampling equipment and trained personnel and may be difficult in some patients. Mass RT-PCR testing is carried out in specialized laboratories and requires several hours before results are released. Altogether, these constraints limit access to massive testing, increase time-toresult and consequently delay the isolation of contagious individuals 6 8 Plateforme Covid IDF, AP-HP Centre, 75014 Paris, France. 9 Virologie, AP-HP, Hôpital Necker-Enfants Malades, 75015 Paris, France. 10 www.nature.com/scientificreports/ Rapid antigen point-of-care (Ag) testing allows the drawback of RT-PCR time-to-result to be overcome but still requires nasopharyngeal sampling. The sensitivity of Ag tests was estimated at 50%-90% and specificity at 90-100% compared to nasopharyngeal RT-PCR 7,8 . Recently, anterior nasal self-sampling has been tested to reduce patient discomfort and avoid requirements for nasopharyngeal swabbing 9,10 .

Self-collected saliva is non-invasive and easy to collect and thus more suitable for mass screening than nasopharyngeal sampling [11] [12] [13] [14] . Recent meta-analyses assessed the performances of saliva RT-PCR tests for the diagnosis of COVID-19 [15] [16] [17] [18] , and we recently confirmed in a large prospective study the excellent sensitivity of saliva RT-PCR, as compared to nasopharyngeal RT-PCR, for the detection of SARS-CoV-2 in community screening centers 19 .

The combination of saliva sampling with rapid point-of-care testing could facilitate screening and the isolation of infected individuals. Rapid single-use RT-PCR assays for SARS-CoV-2 RNA detection are available but were validated mainly on nasopharyngeal samples 20, 21 and rarely in saliva 22 ; furthermore, they require sophisticated equipment and remain expensive. Nucleic acid detection based on isothermal amplification, such as loopmediated isothermal amplification (LAMP), are interesting approaches, as they simplify analytical processes, reduce costs and enable faster diagnoses. The sensitivity of RT-LAMP directly from nasopharyngeal swabs (NPS) samples varies from 65 to 87% compared to RT-PCR. A few studies have tested RT-LAMP on self-collected saliva without RNA extraction. Sensitivities ranged from 45% to 85%, results being better after RNA purification than from crude samples [23] [24] [25] [26] . No studies have estimated the performances of RT-LAMP on saliva samples as pointof-care systems directly in screening centers.

We conducted a prospective study in two community COVID-19 screening centers to evaluate the performances of a CE-marked RT-LAMP assay specifically designed for the detection of SARS-CoV-2 RNA from fresh saliva samples compared to nasopharyngeal RT-PCR, saliva RT-PCR and nasopharyngeal Ag tests.

Participants. Between November 4, 2020, and February 15, 2021, 1718 participants were enrolled with nasopagryngeal sampling for RT-PCR and saliva sampling for RT-LAMP assay. Details of the samples collected and tests performed for the nasopharyngeal antigen assay and saliva RT-PCR are presented in Fig. 1 . The median age of study participants was 37 years and 55% were females (Table 1) . Indications for testing and clinical symptoms reported on the day of inclusion are detailed in Table 1 . One to three symptoms were observed in 530/1712 (31%) participants. (Table 2) . Detection rates were 2%, 9% and 7% for saliva RT-LAMP, saliva RT-PCR and nasopharyngeal Ag test, respectively.

The diagnostic accuracy of the two methods on saliva and the nasopharyngeal Ag test are presented in Table 3 . Compared to RT-PCR on NPS, the sensitivity of saliva RT-LAMP was 34% (95% Confidence Interval (95%CI): 26-44). The sensitivity of saliva RT-PCR was 

In this large prospective controlled study, the performance of a rapid RT-LAMP assay performed with crude saliva samples directly after saliva collection was analyzed. We used a CE-marked assay specifically designed for saliva samples and for point-of-care use. The test was authorized in France in November 2020 in symptomatic individuals for whom nasopharyngeal sampling was impossible or difficult. Our results demonstrated, in a rigorous real-life evaluation, a low sensitivity of this method (34%) compared to nasopharyngeal RT-PCR. Its sensitivity remained low regardless of the reference test considered (saliva RT-PCR, nasopharyngeal Ag test) and with or without symptoms, ranging between 27 and 44%. Our results differed greatly from the sensitivity of 86% (95CI 78%-94%) reported in Santos Schneider et al. 's study 27 , and regardless of the reference test used, nasopharyngeal RT-PCR or any other composite reference test including saliva RT-PCR and antigen test. In Santos Schneider et al. 's study, the authors evaluated the EasyCOV® assay in a central laboratory and tested each sample in triplicate. A sample was considered positive if at least two replicates out of three were positive. In our study, we tested all samples once directly in screening centers and according to manufacturer instructions, and according to its expected use in routine conditions.

No difference in RT-LAMP sensitivity was reported between symptomatic and asymptomatic participants. The median time of testing was 3 days after symptom onset or 6 days after last contact of confirmed case. In 103 subjects already diagnosed for COVID-19, Nagura-Ikeda et al. reported, with another RT-LAMP assay, sensitivity results on saliva that differed according to the clinical state 23 . The RT-LAMP assay was performed with nucleic acid saliva extracts instead of crude saliva. Overall sensitivity was 71% compared to the nasopharyngeal RT-PCR, with a higher sensitivity (85%) in patients tested within 9 days of symptom onset than after 9 days (44%). In asymptomatic individuals, the sensitivity was 60%.

According to other studies evaluating RT-LAMP tests, the critical step for sensitivity seemed to be RNA extraction 13, 23, 25, 28 . A high level of concordance between RT-PCR on nasopharyngeal samples and RT-LAMP on saliva was observed when an automated extraction step was used. In a limited series of 34 positive samples (17 nasopharyngeal swabs and 17 saliva) tested by RT-PCR, Taki et al. reported the sensitivity of an RT-fluorescence LAMP assay performed with nucleic acid extracts as being 97% and 100% in nasopharyngeal and saliva samples, respectively 25 . Without RNA extraction on the same samples, sensitivities decreased to 71% and 47%, respectively, suggesting that the RNA extraction process may be critical for SARS-CoV-2 RNA detection by RT-LAMP, especially for saliva samples. In our study, the RT-LAMP assay is an extraction-free test with 10 min of heating at 80 °C for virus inactivation and viral RNA release. This quick step suitable for a point-of-care test might be not optimal for RT-LAMP reactions with saliva samples, and results may depend on miscellaneous factors depending on the quality of saliva (volume, pH, viscosity, food by-products). The participants did not drink, eat or smoke within 30 min of saliva sampling. In addition, we did not find any significant effect of cigarettes or alcohol consumption within 2 or 24 h. Another hypothesis is the impact of viral load. As we showed, the Ct values of nasopharyngeal RT-PCR were lower in true positive RT-LAMP samples than in false negative RT-LAMP samples (26 vs. 28) , suggesting an impact of viral load on saliva RT-LAMP efficacy. However, when considering only high or significant SARS-CoV-2 loads in nasopharyngeal samples, saliva RT-LAMP sensitivity remained low. Thus, the viral load per se does not explain the weak performance of the assay.

We found that saliva RT-PCR identified more SARS-CoV-2 infections (9%) than nasopharyngeal RT-PCR (7%) and thus confirmed previous results suggesting that saliva RT-PCR could outperform nasopharyngeal RT-PCR. We recently showed that nasopharyngeal NAAT might be an imperfect reference method, which may contribute to increased estimates of sensitivity (and decreased specificity) for alternative tests 19 . When compared to a composite reference standard (including the results of nasopharyngeal RT-PCR and different RT-PCR tests on saliva), the sensitivity of saliva RT-PCR was higher than nasopharyngeal RT-PCR 19 .

Finally, our study confirmed the good performance of saliva RT-PCR and nasopharyngeal antigen testing as reliable alternative strategies to detect SARS-CoV-2 in both symptomatic and asymptomatic individuals in the ambulatory setting. Further work is needed to optimize an assay combining collected saliva and rapid point-ofcare isothermal detection of SARS-CoV-2 RNA.

PERSONNES IDF 3 approved the study protocol prior to data collection (approval number 3840-NI) and all subsequent amendments. All stages of the study were carried out in accordance with relevant guidelines and regulations. Informed consent was obtained from all subjects or, if subjects were under 18, from a parent and/or parent or legal guardian . All adults and children, symptomatic or asymptomatic, referred to the two participating COVISAN centers in Paris, France were eligible, as described previously 19 . In accordance with the EasyCoV® assay (SkillCell-Alcen, Jarry, France) manufacturer instructions, the performances of saliva RT-LAMP were estimated on saliva tested in screening centers, immediately after collection (< 5 min) or stored immediately at 4 °C and then tested within an interval of no more than 90 min after collection. In addition, patients should have a valid nasopharyngeal SARS-CoV-2 RT-PCR test. Eligible persons received detailed oral and written information, adapted to their age. Data on sociodemographics, past medical history, presence of symptoms, consumption of alcohol, coffee, food, smoking and tooth brushing in the hours before testing were collected. NPS samples were sent to the Assistance Publique Hôpitaux de Paris APHP high throughput platform for RT-PCR testing as part of routine care (reference method). Participants were asked to self-collect saliva samples after after swishing saliva around in their mouths for 30 s. Saliva samples were tested directly in the screening center (see below) and then centralized for RT-PCR testing and frozen at -80 °C within 24 h. 29 . Ct values greater than or equal to 32 corresponded to low viral loads.

Saliva RT-PCR. Saliva samples were tested at the APHP high throughput platform with RT-PCR on MGI instruments as described above 19 (appendix). A 300 µl aliquot of saliva was mixed with 300 µl of NucliSENS® lysis buffer (Biomerieux, Marcy l'Etoile, France). Nucleic acid extraction and SARS-CoV-2 RNA amplification were performed with the same procedure used for nasopharyngeal RT-PCR.

Saliva RT-LAMP. Statistical analysis. Sample size was calculated assuming that the sensitivity of the index tests was greater than or equal to 60%. To allow sufficient precision (± 10%), 93 subjects with positive nasopharyngeal RT-PCR were needed in each of the two subgroups (symptomatic and asymptomatic participants). As preliminary results indicate that viral loads were not different between symptomatic and asymptomatic patients, the scientific committee of the study, during a planned meeting on December 16, 2020, recommended performing the analysis as soon as 93 subjects with positive nasopharyngeal RT-PCR were included, whether symptomatic or asymptomatic. RT-PCR results were considered positive if at least one gene was detected. Analyses of tests results were carried out blind to the result of the others and ti the participant's clinical data. For the RT-PCR technique, the Ct values reported are those for the ORF1a gene, and if not amplified, of the N gene (and of the S gene if the N gene was not amplified).

Quantitative data were expressed as medians [interquartile range], and qualitative data as numbers (percentages). The diagnostic accuracy of the index tests was evaluated by calculating sensitivity and specificity. Confidence intervals were calculated by the exact binomial method. Subgroup analyses were performed according to (1) the presence of symptoms on the day of testing, (2) the Ct value of the nasopharyngeal RT-PCR, expressed as low (at least one of the 3 targets with Ct ≤ 28, i.e. high viral shedding), or high (all 3 targets with Ct > 28, i.e. low viral shedding) and (3) the consumption of alcohol, coffee, food and smoking or tooth brushing before sample collection.

Sensitivity analyses were performed considering 6 alternate criteria for positivity for the reference standard: (1) ≥ 2 positive targets with nasopharyngeal RT-PCR, (2) ≥ 1 positive target with nasopharyngeal RT-PCR and at least one of the 3 targets with Ct < 32, (3) ≥ 1 positive target with saliva RT-PCR, (4) ≥ 1 positive target with either the nasopharyngeal or saliva RT-PCR, (5) ≥ 1 positive target with either the nasopharyngeal or saliva RT-PCR and at least one of the 3 targets with Ct < 32, and (6) NPS antigen test.

Quantitative variables were compared with Wilcoxon's test, with a significance level of 5%. The statistical analysis was performed using R software (http:// cran.r-proje ct. org/). The reporting of results followed the Standards for Reporting Diagnostic accuracy studies (STARD 2015) guideline 30 

Diagnostic testing for the novel coronavirus

Clinical and economic effects of widespread rapid testing to decrease SARS-CoV-2 transmission

Impact of mass testing during an epidemic rebound of SARS-CoV-2: A modelling study using the example of France

Comparative cost-effectiveness of SARS-CoV-2 testing strategies in the USA: A modelling study

Infectious Diseases Society of America guidelines on the diagnosis of COVID-19

Quantifying the potential value of antigen-detection rapid diagnostic tests for COVID-19: A modelling analysis

Scaling up COVID-19 rapid antigen tests: Promises and challenges

Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection

Diagnostic performance and characteristics of anterior nasal collection for the SARS-CoV-2 antigen test: A prospective study

Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with professional-collected nasal versus nasopharyngeal swab

Consistent detection of 2019 novel coronavirus in saliva

Saliva is a reliable tool to detect SARS-CoV-2

Comparison of SARS-CoV-2 detection in nasopharyngeal swab and saliva

Swabs collected by patients or health care workers for SARS-CoV-2 testing

Performance of saliva, oropharyngeal swabs, and nasal swabs for SARS-CoV-2 molecular detection: A systematic review and meta-analysis

Comparison of saliva and nasopharyngeal swab nucleic acid amplification testing for detection of SARS-CoV-2: A systematic review and meta-analysis

The Sensitivity and costs of testing for SARS-CoV-2 infection with saliva versus nasopharyngeal swabs: A systematic review and meta-analysis

Performance of saliva specimens for the molecular detection of SARS-CoV-2 in the community setting: does sample collection method matter

Accuracy of antigen and nucleic acid amplification testing on saliva and naopharyngeal samples for detection of SARS-CoV-2 in ambulatory care

Multi-center evaluation of cepheid xpert® xpress SARS-CoV-2 point-of-care test during the SARS-CoV-2 pandemic

The diagnostic accuracy of isothermal nucleic acid point-of-care tests for human coronaviruses: A systematic review and meta-analysis

Evaluating the use of posterior oropharyngeal saliva in a point-of-care assay for the detection of SARS-CoV-2

Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19

Development of a point-of-care test to detect SARS-CoV-2 from saliva which combines a simple RNA extraction method with colorimetric reverse transcription loop-mediated isothermal amplification detection

SARS-CoV-2 detection by fluorescence loop-mediated isothermal amplification with and without RNA extraction

EasyCOV: LAMP based rapid detection of SARS-CoV-2 in saliva

Comparative Evaluation of Rapid Salivary RT-LAMP Assay for Screening of SARS-CoV-2 Infection

A novel strategy for SARS-CoV-2 mass screening with quantitative antigen testing of saliva: A diagnostic accuracy study

Interpretation of SARS-CoV-2 replication according to RT-PCR crossing threshold value

STARD 2015: Updated reporting guidelines for all diagnostic accuracy studies

Constance Delaugerre reports to be member of a scientific board for MSD and Gilead ViiV, and a research grant from Gilead ViiV

The authors thank the following members of the scientific committee for insightful comments on the study protocol and results: 

French Ministry of Health and the Assistance Publique-Hôpitaux de Paris Foundation.

All authors and persons listed in the Acknowledgments declare no conflict of interest for the submitted work. Outside the submitted work, Solen Kernéis reports consulting fees, a research grant, honoraria for a lecture and

Supplementary Information The online version contains supplementary material available at https:// doi. org/ 10. 1038/ s41598-021-00560-8.Correspondence and requests for materials should be addressed to J.L.Reprints and permissions information is available at www.nature.com/reprints.Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.