key: cord-0966907-ud3vvsde authors: Vilela, Ana Carolina Serafim; Costa, Camila Alves; Oliveira, Suzane Aparecida; Souza, Menira Borges Lima Dias; Fiaccadori, Fabiola Souza; Leles, Cláudio Rodrigues; Costa, Nádia Lago title: Validity and reliability of immunochromatographic IgM/IgG rapid tests for COVID‐19 salivary diagnosis date: 2021-11-03 journal: Oral Dis DOI: 10.1111/odi.14059 sha: 4aa9699dd6e7366e28553c6bda9486124944c5bf doc_id: 966907 cord_uid: ud3vvsde OBJECTIVES: To assess the accuracy of three immunochromatographic rapid tests for salivary detection of immunoglobulin M (IgM) and immunoglobulin G (IgG) antibodies against severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) antigens and the reliability of these tests comparing saliva with plasma samples. MATERIALS AND METHODS: Plasma and saliva samples from 62 patients diagnosed with coronavirus disease 2019 (COVID‐19) and 20 healthy volunteers were assayed. IgM/IgG antibody against SARS‐COV‐2 was detected using three immunochromatographic rapid tests and compared with real‐time reverse transcription‐polymerase chain reaction (qRT‐PCR). RESULTS: The tests’ overall accuracy for detecting anti‐SARS‐CoV‐2 antibodies ranged from 75.6 to 79.3 for saliva and 86.6–87.8 for plasma tests. The sensitivity of saliva and plasma tests increased with the severity of COVID‐19 signs and symptoms. The chance of a positive plasma test in participants with a positive qRT‐PCR test was 2.27 greater than a positive saliva test. CONCLUSIONS: Although rapid immunochromatographic tests are more accurate using plasma than saliva, which was expected considering its original use, our findings support the use of saliva as a straightforward supplementary method to assess seroconversion in patients with COVID‐19, with important sensitivity and sensibility, especially in severe and critical cases. Viral genetic sequencing using real-time reverse transcriptionpolymerase chain reaction (qRT-PCR) is the most widely used technique for diagnosing coronavirus disease 2019 (COVID-19) due to its high sensitivity and specificity in cases of acute infection . However, qRT-PCR tests can be labor-intensive, requiring specialized equipment and a centralized laboratory, which increases the wait time for the results and the costs (Dinnes et al., 2021) . In a systematic review, Mallet et al. (2020) demonstrated that the rate of qRT-PCR test false-negative results increases in nasopharyngeal samples collected 10 days after symptom onset. In this way, rapid immunochromatographic tests present a complementary diagnostic method, helping to identify infected patients (Dinnes et al., 2021; Zhao et al., 2020) . Available rapid tests benefit from screening larger populations, with and without symptoms, in locations other than healthcare settings and would provide a faster diagnosis to allow early prevention of COVID-19 spread (Dinnes et al., 2021) . Rapid tests based on immunochromatographic analysis can detect immunoglobulin M (IgM) and immunoglobulin G (IgG) antibodies to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in patients with current or past infection. The estimated median times for seroconversion were 11 days for total antibodies, 12 days for IgM, and 14 days for IgG. However, patients tested within a week after the onset of symptoms showed a high proportion of falsenegative results in rapid antibody tests (Zhao et al., 2020) . All these diagnostic tests require close contact with the patient, increasing the risk of transmission to the healthcare professional during collection. Moreover, collecting blood samples and swabs from the nasopharynx or oropharynx are invasive and uncomfortable for the patient . Therefore, salivary tests have been proposed as an alternative biological fluid for diagnosing respiratory viral infections, including COVID-19; saliva is easily collected in sterile flasks or Salivette ® kits (Fernandes et al., 2020; Khurshid et al., 2020) . Saliva tests are simple to perform and more comfortable than nasal swabs. In the pandemic context, they are inexpensive, scalable, and sustainable strategies that allow easily repeatable and widely available testing over time (Fernandes et al., 2020; Tan et al., 2021) . The salivary glands are among the first organs in the body to be infected by the SARS-CoV-2 virus (Xu et al., 2020) , and viral ribonucleic acid (RNA) can be detected in saliva before the appearance of lung lesions (Liu et al., 2011) . The salivary glands are an essential viral reservoir, and the rates of identifying the SARS-CoV-2 virus in saliva can exceed 91% . The qRT-PCR test using saliva as a potential specimen had a substantial discriminative and diagnostic ability for SARS-CoV-2 detection, with high sensitivity and specificity (Atieh et al., 2021) . Therefore, it was suggested that the spread of COVID-19 by asymptomatic infected subjects might be traced to contaminated saliva. The local immune system of the salivary glands produces immunoglobulin A (IgA), IgM, and IgG in oral fluids, and these antibodies are transferred from the circulation to the saliva by transcellular passive intracellular diffusion or active transport in the salivary glands or crevicular fluid (Khurshid et al., 2020) . There is little evidence of the utility of rapid tests using saliva samples based on immunochromatography to detect IgG and IgM. Because rapid tests are less costly, easier to perform, have better tolerability, and pose less risk to health professionals, we hypothesized that saliva could be an alternative to whole blood and serum samples to detect SARS-CoV-2 IgG/IgM antibodies using rapid tests. Therefore, we aimed to measure the accuracy of immunochromatographic rapid tests using salivary detection of IgM/IgG antibodies against SARS-CoV2 viral antigens and assess the reliability of rapid tests using saliva samples compared to plasma. This study was conducted in Goiânia, Goias, Brazil. A convenience sample of 82 participants was enrolled, including 62 subjects with infection confirmed by qRT-PCR (20 with asymptomatic-mild disease, 20 with moderate disease, and 22 with severe-critical disease), and 20 disease-free subjects with negative qRT-PCR tests (negative controls All participants were over 18 years of age and were tested for SARS-CoV-2 infection using a qRT-PCR test. Subjects who could not undergo blood collection due to hematologic problems and patients with xerostomia or lesions in the salivary glands that compromise salivary flow were excluded. Control individuals (disease-free subjects) were healthcare professionals responsible for treating COVID-19 patients at the University Hospital of the Federal University of Goias. These participants were monitored weekly with qRT-PCR tests or screened for signs and symptoms of the disease. Infected patients were invited to enroll in the study after having had a positive qRT-PCR test performed by professionals of the Laboratory of Virology and Cell Culture of the Institute of Tropical Pathology and Public Health at the Federal University of Goias. A nasopharyngeal swab was collected from both nostrils for the qRT-PCR test. Saliva collection was performed using the Salivette ® collector (Sarstedt) equipped with a tube containing collector cotton. The cotton was placed on the floor of the participant's mouth for approximately 2 min and then returned to the tube. After collection, the saliva sample was centrifuged for 10 min at 1903.67 g at 4°C. The peripheral blood was harvested with ethylenediaminetetraacetic acid anticoagulant (2 ml, BD Vacutainer). The blood samples were centrifuged for 10 min at 349.65 g at 25°C to obtain the plasm and perform the rapid tests according to the manufacturers' guidelines. The saliva and blood samples collection occurred from the 15th to the 30th day after positive findings on the qRT-PCR tests in infected patients and the same day after negative qRT-PCR test results in the healthy participants. swabs were collected and processed in 24-48 h. Viral RNA was isolated using a commercial QIAamp Viral RNA Mini Kit (Qiagen). For SARS-CoV-2 RNA detection, we used qRT-PCR assay with probes and primers targeting two coronavirus regions (N1 and N2) and the human RNase P gene (internal control) (IDT) (Centers for Disease Control and Prevention. CDC-2019-Novel Coronavirus [2019-nCoV] Real-Time RT-PCR. 2020). The reaction system and amplification conditions were performed according to the manufacturer's specifications in a 7500 Fast Dx Real-Time PCR System (Life Technologies). The result was considered valid only when the reference gene's cycle threshold (Ct) value was 38 or less. The result was considered positive when the Ct value of the viral genes was 38 or less and negative when it was >38. Three lateral-flow immunochromatographic assay rapid tests for the qualitative detection of SARS-CoV-2 IgG/IgM antibodies were analyzed. COVID-19 specific rapid test kits were approved by the Brazilian health surveillance agency (ANVISA) using whole blood or serum, or plasma samples in the Instructions for Use or Product User Manual. The immunochromatographic tests detect the presence of IgG and IgM anti-SARS-CoV-2 antibodies in human whole blood or serum to identify current or past infection. Table 1 shows the characteristics of the rapid tests used in this study, as provided by the manufacturers. The sample volume adopted for serum was 10 µl, as recommended by the manufacturers. For saliva, a volume of 20 µl was used ( Figure 1 ). Each test can give a result for IgG and IgM alone or in combination. Positive results were considered with only IgG, only IgM, or both, considering the entire evaluation period. Repeatability was assessed by taking replicates of samples known to be reagents and non-reagents for SARS-CoV-2 and testing simultaneously and independently for two research participants. Reproducibility (inter-test) was assessed by repeating the same protocol on different days. The evaluation was carried out for the three rapid test kits to detect IgG and IgM anti-SARS-CoV-2 in five serum and saliva samples. Descriptive analysis included the frequency of positive tests and the chi-square test to assess differences according to the level of symptoms of the participants. The Kappa coefficient was used to measure the level of agreement between tests using blood and TA B L E 1 Rapid tests for detection of IgG and IgM anti-SARS-CoV-2 antibodies that use the methodology by immunochromatography approved by ANVISA until March 2030 and severe-critical cases were considered (Figure 2 ). The regression model in Table 5 We compared the performance of three recently approved immunochromatographic IgM/IgG rapid tests using plasma and saliva and found accuracy values >75% for the three kits of rapid test using both biological samples. We also demonstrated that the sensitivity of the tests for both saliva and plasma increased with the worsening of COVID-19 symptoms. Although the values of accuracy and chance of positive diagnosis confirmed by qRT-PCR were higher using plasma than saliva, the values were close, especially in the most severe cases. The molecular detection of SARS-CoV-2 RNA in nasopharyngeal swabs is the reference method for identifying symptomatic or asymptomatic individuals and is indicated for the primary stage of the disease when the virus is present in the lower or upper respiratory tract (Mallett et al., 2020) . It has been demonstrated that samples collected 10 days after symptom onset significantly increased the chance of a negative test result (Mallett et al., 2020) . In this context, anti-SARS-CoV-2 antibody tests are valuable for monitoring the population and can play an essential role in confirmation and late diagnostic of COVID-19 and managing viral infection (Ahn et al., 2020; Fujigaki et al., 2020; Guedez-López et al., 2020) . In the present study, the overall accuracy ranged from 75.6 to 87.8 for all evaluated rapid tests, demonstrating the considerable capacity of plasma and saliva to detect true-positive cases confirmed by qRT-PCR. This finding highlights the significance of point-of-care testing, such as the rapid immunochromatographic test we used, as an alternative to laboratory tests such as enzyme-linked immunosorbent assay (ELISA) format and chemiluminescence (Pegoraro et al., 2021) . Immunochromatographic IgM/IgG rapid tests are rapid, simple, easy to perform, and practical as monitoring tools for COVID-19 infection (Khurshid et al., 2020) . The sample indicated by the manufacturer should be plasma, serum, or whole blood, which provides higher specificity and sensitivity values (Table 1) . Like the plasma, saliva contains a local immune system that includes IgA, IgM, and IgG production, predominant in oral fluid. These antibodies are transferred from the circulating blood for saliva by transcellular passive diffusion, active transport in the salivary glands, or crevicular fluid (Khurshid et al., 2020) . We adapted rapid tests for use in saliva and obtained compelling results with overall sensitivities between 67.7% and 72.6% and specificity between 95% and 100%. A systematic review demonstrated excellent performance of saliva for detecting SARS-CoV-2 in qRT-PCR tests, with high sensitivity and specificity (Atieh et al., 2021) . However, to date, few studies have analyzed the performance of rapid tests using saliva. Test Colloidal Gold Immunochromatography. salivary collection used was inadequate, which could explain the better accuracy of rapid tests with saliva samples found in the present study. infection is 15 days (Zhao et al., 2020) . Patients tested within a week after the onset of symptoms showed a high proportion of false-negative results on rapid antibody tests (Zhao et al., 2020) . Moreover, Ong et al. (2020) reported that the sensitivity of these tests improved after at least 7 days of symptoms in hospitalized patients. Corroborating these data, Zhao et al. (2020) The authors observed that the median of the antibody detection time was between 8 and 10 days, with a sensitivity of 60%-80% on day 10 and 100% on day 15. In contrast, Pegoraro et al. (2021) compared the diagnostic performances of three rapid immunochromatographic tests using automated ELISA and CLIA immunoassays in 159 hospitalized patients, demonstrating 41%-45% of diagnostic sensitivities and 91%-98% of specificities, with a substantial agreement (89.3%-91.2%). These studies explain our decision to wait at least 15 days after a positive qRT-PCR result to carry out the rapid tests. Despite the satisfactory accomplishment of saliva compared to previous studies, we found that the chance of a positive patient being confirmed by qRT-PCR to be positive in a rapid test using plasma was 2.27-fold higher than using saliva. These results can be explained by the fact that these tests are developed to be performed with plasma samples (Demey et al., 2020; Pegoraro et al., 2021) . Because saliva tests have lower specificity, the performance of the test is worse when disease-free individuals are excluded from the analysis. Although the blood tests were superior, the 95% confidence intervals of the accuracy values suggest that the saliva and blood tests could be used interchangeably, especially when the rapid test aims to confirm the presence of F I G U R E 2 Overall agreement of the combined blood and salivary tests, according to the classification of symptoms. Data included the three kits of rapid tests performed: 60 tests in 20 participants with asymptomatic or mild symptoms; 60 tests in 20 participants with moderate symptoms; 66 tests in 22 participants with severe-critical symptoms Generalized estimating equation regression estimates for the chance of a positive test using different rapid test kits and fluid samples the antibodies in severely ill patients. Therefore, our findings reinforce the importance of using saliva as an alternative sample for extensive population-level screening of COVID-19 due to its easy collection, handling (Fernandes et al., 2020) , and antibody detection capacity. Nevertheless, adding a band to detect IgA in rapid tests indicated for using saliva would be interesting. Future studies testing saliva with rapid tests with IgA bands should be encouraged to verify the better performance of this biological medium, especially for early detection. Another point to be highlighted is that the sensitivity of the tests with serum and saliva increased when COVID-19 symptoms worsened. Furthermore, the agreement between plasma and saliva was higher in patients with severe-critical symptoms than in patients with moderate and asymptomatic/mild symptoms. In the asymptomatic/mild symptoms group, the chance of false-negative tests was higher. Similar conclusions were presented by Hiki et al. (2021) using an anti-SARS-CoV-2 rapid test to determine IgG and IgM antibodies in symptomatic COVID-19 patients; they observed that, in several critical cases, the positive IgM and IgG detection was higher than in mild/moderate cases; mild cases were seronegative at least 10 days after symptoms, while severe/critical cases became positive at 0-6 days (40%) and 7-13 days (87.5%) after onset. Finally, all tests we analyzed presented high specificity but sensitivity lower than those described by the manufacturer. In summary, we adapted commercially available immunochromatographic IgM/IgG rapid tests (commercially available in Brazil) to be used with saliva samples collected at least 15 days after symptom onset in patients with COVID-19. Within the limitations, although rapid tests are more accurate using plasma, which was its original indication, our study findings provide evidence supporting the use of these tests for saliva to assess seroconversion in patients with COVID-19, especially those with severe presentations. None declared. The Ethics Committee approved this study of Universidade Federal de Goias (CAEE 30804220.2.0000.5078 / 38088920.9.3001.5078). All the participants were informed about this study's objectives, risks, and benefits, and those who agreed to participate signed the free, informed consent form. The peer review history for this article is available at https://publo ns.com/publo n/10.1111/odi.14059. The data sets used and/or analyzed during the current study are available from the corresponding author on reasonable request. Current status of epidemiology, diagnosis, therapeutics, and vaccines for novel coronavirus disease 2019 (COVID-19) The diagnostic accuracy of saliva testing for SARS-CoV-2: A systematic review and meta-analysis Salivary SARS-CoV-2 antigen rapid detection: A prospective cohort study Dynamic profile for the detection of anti-SARS-CoV-2 antibodies using four immunochromatographic assays Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection Saliva in the diagnosis of COVID-19: A review and new research directions Reliability of serological tests for COVID-19: Comparison of three immunochromatography test kits for SARS-CoV-2 antibodies Evaluation of three immunochromatographic tests for rapid detection of antibodies against SARS-CoV-2 Seroprevalence of anti-SARS-CoV-2 antibodies in Japanese COVID-19 patients Human saliva: Non-invasive fluid for detecting novel coronavirus (2019-nCoV) Epithelial cells lining salivary gland ducts are early target cells of severe acute respiratory syndrome coronavirus infection in the upper respiratory tracts of rhesus macaques At what times during infection is SARS-CoV-2 detectable and no longer detectable using RT-PCR-based tests? A systematic review of individual participant data Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19 Comparison of diagnostic accuracies of rapid serological tests and ELISA to molecular diagnostics in patients with suspected coronavirus disease 2019 presenting to the hospital Evaluation of three immunochromatographic tests in COVID-19 serologic diagnosis and their clinical usefulness Saliva as a gold-standard sample for SARS-CoV-2 detection. The Lancet Respiratory Medicine Consistent detection of 2019 novel coronavirus in saliva A novel coronavirus outbreak of global health concern Clinical management of COVID-19: Interim guidance Saliva: Potential diagnostic value and transmission of 2019-nCoV Antibody responses to SARSCoV-2 in patients of novel coronavirus disease 2019 Validity and reliability of immunochromatographic IgM/IgG rapid tests for COVID-19 salivary diagnosis