key: cord-0805050-662jaqlw
authors: Naito, Asami; Kiyasu, Yoshihiko; Akashi, Yusaku; Sugiyama, Akio; Michibuchi, Masashi; Takeuchi, Yuto; Notake, Shigeyuki; Nakamura, Koji; Ishikawa, Hiroichi; Suzuki, Hiromichi
title: The evaluation of the utility of the GENECUBE HQ SARS-CoV-2 for anterior nasal samples and saliva samples with a new rapid examination protocol
date: 2021-12-31
journal: PLoS One
DOI: 10.1371/journal.pone.0262159
sha: 403685abeef781adfe7a3458edfb92035b5bb157
doc_id: 805050
cord_uid: 662jaqlw

INTRODUCTION: GENECUBE(®) is a rapid molecular identification system, and previous studies demonstrated that GENECUBE(®) HQ SARS-CoV-2 showed excellent analytical performance for the detection of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) with nasopharyngeal samples. However, other respiratory samples have not been evaluated. METHODS: This prospective comparison between GENECUBE(®) HQ SARS-CoV-2 and reference real-time reverse transcriptase polymerase chain reaction (RT-PCR) was performed for the detection of SARS-CoV-2 using anterior nasal samples and saliva samples. Additionally, we evaluated a new rapid examination protocol using GENECUBE(®) HQ SARS-CoV-2 for the detection of SARS-CoV-2 with saliva samples. For the rapid protocol, in the preparation of saliva samples, purification and extraction processes were adjusted, and the total process time was shortened to approximately 35 minutes. RESULTS: For 359 anterior nasal samples, the total-, positive-, and negative concordance of the two assays was 99.7% (358/359), 98.1% (51/52), and 100% (307/307), respectively. For saliva samples, the total-, positive-, and negative concordance of the two assays was 99.6% (239/240), 100% (56/56), and 99.5% (183/184), respectively. With the new protocol, total-, positive-, and negative concordance of the two assays was 98.8% (237/240), 100% (56/56), and 98.4% (181/184), respectively. In all discordance cases, SARS-CoV-2 was detected by additional molecular examinations. CONCLUSION: GENECUBE(®) HQ SARS-CoV-2 provided high analytical performance for the detection of SARS-CoV-2 in anterior nasal samples and saliva samples.

GENECUBE ® is a rapid molecular identification system, and previous studies demonstrated that GENECUBE ® HQ SARS-CoV-2 showed excellent analytical performance for the detection of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) with nasopharyngeal samples. However, other respiratory samples have not been evaluated.

This prospective comparison between GENECUBE ® HQ SARS-CoV-2 and reference realtime reverse transcriptase polymerase chain reaction (RT-PCR) was performed for the detection of SARS-CoV-2 using anterior nasal samples and saliva samples. Additionally, we evaluated a new rapid examination protocol using GENECUBE ® HQ SARS-CoV-2 for the detection of SARS-CoV-2 with saliva samples. For the rapid protocol, in the preparation of saliva samples, purification and extraction processes were adjusted, and the total process time was shortened to approximately 35 minutes.

For 359 anterior nasal samples, the total-, positive-, and negative concordance of the two assays was 99.7% (358/359), 98.1% (51/52), and 100% (307/307), respectively. For saliva samples, the total-, positive-, and negative concordance of the two assays was 99.6% (239/ 240), 100% (56/56), and 99.5% (183/184), respectively. With the new protocol, total-, positive-, and negative concordance of the two assays was 98.8% (237/240), 100% (56/56), and 

For the diagnosis of coronavirus disease 2019 (COVID- 19) , accurate and rapid laboratory testing is essential. Molecular examination using real-time reverse transcriptase polymerase chain reaction (RT-PCR) has been considered the gold standard for the identification of SARS-CoV-2 [1] , and nasopharyngeal samples have been commonly used for the sample examination, which requires high-level personal protective equipment [2] . For COVID-19 testing, anterior nasal samples and saliva samples have been proposed as alternative samples [3] , which can be easily obtained from patients. GENECUBE 1 (TOYOBO Co., Ltd., Osaka, Japan) is a Qprobe-PCR-based automated rapid molecular identification system that can detect target genes in a short time and simultaneously analyze up to 12 samples and 4 assays in a single examination [4] [5] [6] [7] [8] [9] . The system automatically performs molecular examination directly, including preparation of the reaction mixtures, and amplification and detection of target genes, in 30 minutes. GENECUBE 1 HQ SARS-CoV-2 (TOYOBO Co., Ltd.) is the GENECUBE 1 reagent for detecting the SARS-CoV-2 gene in clinical samples. This reagent was currently approved by the Ministry of Health, Labour and Welfare in Japan in October 2020. We previously evaluated the performance of the assay using 1065 nasopharyngeal samples [10] . Compared with the reference RT-PCR assay, the overall positive-and negative concordance rates were 99.7% (95% confidence interval [CI]: 99.2%-99.9%), 100.0% (95% CI: 93.4%-100.0%) and 99.7% (95% CI: 99.1%-99.9%), respectively. All discordant samples were GENECUBE 1 HQ SARS-CoV-2-positive and reference RT-PCR-negative, and SARS-CoV-2 was detected by another molecular assay [10] . During the previous evaluation, samples other than nasopharyngeal samples were not used.

In the present study, we evaluated the diagnostic performance of the GENECUBE 1 HQ SARS-CoV-2 using anterior nasal samples and saliva samples. Additionally, we evaluated a new rapid examination protocol using GENECUBE 1 HQ SARS-CoV-2 for the detection of SARS-CoV-2.

The current study was performed at a drive-through PCR center in Tsukuba Medical Center Hospital (TMCH) in Tsukuba, Ibaraki Prefecture, Japan, which intensively performed sample collecting and PCR analysis with nasopharyngeal samples in the Tsukuba district [10, 11] . Patients with and without symptoms were referred from nearby clinics and a local public health center. All of the asymptomatic patients had known contact histories with COVID-19 confirmed/suspected patients.

Anterior nasal samples were prospectively collected from COVID-19-suspected or COVID-19-confirmed patients in addition to nasopharyngeal samples between 11 May 2021 and 5 July 2021, as previously performed [12] . Saliva samples were also prospectively collected in addition to nasopharyngeal samples from COVID-19-confirmed patients between 21 April 2021 and 13 May 2021. All of anterior nasal samples and saliva samples from COVID-19-confirmed patients were obtained on the same day of nasopharyngeal sample collection. Anterior nasal samples and saliva samples were simultaneously examined using GENE-CUBE 1 HQ SARS-CoV-2 (GENECUBE examination) and reference RT-PCR, and the concordance of the two methods was evaluated.

Informed consent was verbally obtained from patients for their participation in the respective part of the current research, and participant consent was documented in the electronic chart of each participant. Written informed consent was not obtained in order to avoid infection transmission through the consent forms. The ethics committee of Tsukuba Medical Center Hospital approved the present study (approval number: 2020-066) with the current protocol, including the method of obtaining informed consent.

This study was performed in line with the principles of the Declaration of Helsinki and adheres to the STARD reporting guidelines.

For negative saliva samples, residual frozen saliva samples collected during SARS-CoV-2 active screening at hospitalization in Tsukuba Medical Center Hospital were used for the current research after anonymization.

For anterior nasal samples, a nasopharyngeal-type flocked swab (Copan Italia SpA, Brescia, Italy) was inserted to a 2 cm depth in one nasal cavity, rotated five times, and held in place for 5 seconds. The swab samples were then diluted in 3 mL of UTM™ (Copan Italia SpA) immediately after sampling, and the UTM™ was then transferred to a microbiology laboratory located next to the drive-through sampling facility of the PCR center.

After arrival, purification, and ribonucleic acid (RNA) extraction were performed with magLEAD (Precision System Science Co., Ltd., Chiba, Japan) with 200 μL of fresh anterior nasal samples. RNA was eluted in 100 μL, which was used for the GENECUBE 1 examination and the reference RT-PCR examination. All saliva samples were stored at −80˚C and were purified with magLEAD after preparation (Fig 1) . All of the GENECUBE 1 examinations and reference RT-PCR examinations were performed simultaneously on the same day.

The sample used for the GENECUBE 1 examination analysis of SARS-CoV-2 was also used for the RT-PCR assays. All assays were performed with the previously described magLEAD conditions [10] (Fig 1) . In addition to the standard protocol with magLEAD purification, a rapid protocol created by Hiromichi Suzuki, TOYOBO Co., Ltd. and Precision System Science Co., Ltd. were evaluated for saliva samples and samples for limit of detection (LOD) analysis. For the rapid protocol, in the preparation of saliva samples, purification and extraction processes were adjusted, and the total process time was shortened to approximately 10 minutes. The comparison of the standard protocol and the rapid protocol for each magLEAD purification processes is summarized in Table 1 . The rapid protocol is commercially available in Japan as MagDEA Dx SV 200 for GENECUBE 1 .

If discordance was recognized between GENECUBE 1 and the reference RT-PCR, an additional evaluation was performed with Xpert 1 Xpress SARS-CoV-2 and GeneXpert 1 (Cepheid Inc., Sunnyvale, CA, USA) [15] analyses for anterior nasal samples according to the manufacturer's instructions documented in the package insert, and with an RT-PCR with LightMix 1 Modular SARS-CoV (COVID19) E-gene (Roche Diagnostics KK) [16] for saliva samples along with re-evaluation with the NIID RT-PCR method.

Reference RT-PCR examinations were performed with purified samples using a method developed by the National Institute of Infectious Diseases (NIID), Japan, for SARS-CoV-2 [17, 18] , which was used Briefly, 5 μL of the extracted RNA was used for one-step quantitative RT-PCR with the THUNDERBIRD 1 Probe One-step qRT-PCR kit (TOYOBO Co., Ltd.) and the Light-Cycler 1 96 Real-time PCR System (Roche Diagnostics KK, Basel, Switzerland). A duplicate analysis for N2 genes was performed for the evaluation of SARS-CoV-2. EDX SARS-CoV-2 Standard (Bio-Rad Laboratories, Inc., Hercules, CA, USA) and sterile purified water (Merck & Co., Inc., Kenilworth, NJ, USA) were used as positive and negative controls, respectively. The calibration curves were generated with 5, 50 and 500 copies/reaction of EDX SARS-CoV-2 Standard.

To estimate the LOD for GENECUBE 1 HQ SARS-CoV-2, we made four different concentrations of samples (2500 copies/mL, 1000 copies/mL, 500 copies/mL, 250 copies/mL) with SARS-CoV-2 reference material (AccuPlex™ SARS-CoV-2 Reference Material Kit, SeraCare; SeraCare Life Sciences, Inc., Milford, MA, USA) and matrix (UTM™; three pooled nasopharyngeal samples and two pooled saliva samples). In total, six samples were made at each concentration. The GENECUBE 1 examination was performed four times, and the reference RT-PCR was performed twice for each sample.

The positive-, negative-, and total concordance rates of the GENECUBE 1 examinations compared with the reference RT-PCR were calculated using the Clopper and Pearson methods with 95% confidence intervals. All calculations were conducted using the R 3.3.1 software program (The R Foundation, Vienna, Austria).

The details of the results of the LOD evaluation for the three SARS-CoV-2 detection methods with SARS-CoV-2 reference material and pooled negative samples are listed in Table 2 , summarized in Table 3 and S1 Fig.

The reference NIID real-time RT-PCR method showed positive results for all UTM-based samples (range: 250-5000 copies/mL), while the detection rate was 100% down to 1000 copies/ mL for pooled nasopharyngeal samples and down to 2500 copies/mL for pooled saliva-based samples. None of the 500 copies/mL of pooled saliva-based samples and 250 copies/mL of pooled saliva-based samples were detected by the NIID real-time RT-PCR method. The standard protocols with magLEAD and GENECUBE 1 showed positive results for all UTM-based samples. The detection rate was 100% down to 1000 copies/mL for pooled nasopharyngeal-based samples and down to 500 copies/mL for pooled saliva-based samples. The detection rate of 500 copies/mL pooled nasopharyngeal-based samples was 91.7% (11/12) .

For the rapid protocol with magLEAD and GENECUBE 1 , the method showed positive results for all UTM-based samples. The detection rate was 100% down to 500 copies/mL for pooled nasopharyngeal-based samples and pooled saliva-based samples.

In this study, we prospectively evaluated 359 fresh anterior nasal samples, including 59 samples with positive SARS-CoV-2 results for simultaneously collected nasopharyngeal samples (cycle threshold (Ct) < 20, n = 40; Ct � 20 to < 30, n = 16; Ct � 30, n = 3) (S1 Table) . Of the 359 anterior nasal samples, 298 (83.0%) were obtained from asymptomatic patients.

The comparison of the reference RT-PCR and GENECUBE 1 (standard protocol) for the detection of SARS-CoV-2 with anterior nasal samples is summarized in Tables 4-6. For anterior nasal samples prospectively obtained from suspected COVID-19 patients (Table 4) , the total, positive and negative concordance of the 2 assays were 100% (320/320), 100% (18/18) and 100% (302/302), respectively. With the addition of the enriched positive patients, the total, positive and negative concordance of the 2 assays were 99.7% (358/359), 98.1% (51/52) and 

For the comparison between the reference RT-PCR and GENECUBE 1 for the detection of SARS-CoV-2, 60 frozen samples (symptomatic patients, 32; asymptomatic patients, 28) obtained from confirmed COVID-19 patients by nasopharyngeal samples and 180 frozen negative saliva samples were examined. The evaluation of the standard protocol with magLEAD and GENECUBE 1 is described in Table 7 , and the evaluation of the rapid protocol with magLEAD and GENECUBE 1 is described in Table 8 . The result of one sample was invalid initially by both GENECUBE 1 examinations, and the sample required four-fold dilution with lysis buffer for the GENE-CUBE 1 examinations.

For the evaluation of the standard protocol with magLEAD and GENECUBE 1 (Table 7) , the total-, positive-, and negative concordance of the two assays was 99.6% (239/240), 100% (56/56), and 99.5% (183/184), respectively. Table 5 . Concordance rate of the GENECUBE 1 HQ SARS-CoV-2 with real-time RT-PCR for anterior nasal samples obtained from suspected or confirmed COVID-19 patients.

Standard method with magLEAD extraction for GENECUBE 1 NIID National Institute of Infectious Diseases, RT-PCR reverse transcription polymerase chain reaction Data in parentheses are 95% confidence intervals. � The discordant sample was tested by Xpert 1 Xpress SARS-CoV-2 and GeneXpert 1 and was positive.

https://doi.org/10.1371/journal.pone.0262159.t005 Table 6 . Concordance rate between the GENECUBE 1 HQ SARS-CoV-2 with anterior nasal samples and real-time RT-PCR with nasopharyngeal samples, both of which were simultaneously obtained from suspected or confirmed COVID-19 patients.

Standard method with magLEAD extraction for GENECUBE 1 For the evaluation of the rapid protocol with magLEAD and GENECUBE 1 (Table 8) , the total-, positive-, and negative concordance of the two assays was 98.8% (237/240), 100% (56/56), and 98.4% (181/184), respectively.

During the analytical evaluation with 359 anterior nasal samples and 240 saliva samples, the GENECUBE 1 evaluation with GENECUBE 1 HQ SARS-CoV-2 showed high concordance rates compared with the reference RT-PCR. The estimated LoDs study indicated that the GENECUBE 1 evaluation conducted with GENECUBE 1 HQ SARS-CoV-2 maintained a high analytical performance for nasopharyngeal samples and saliva samples, with detection successful for as little as 1000 copies/mL for both types of samples.

In the current study concerning the GENECUBE examination, the rapid method with magLEAD extraction showed equivalent analytical performance to the standard method, both in the estimated LOD study and the comparative study with reference via real-time RT-PCR. Of note, two saliva samples obtained from COVID-19-confirmed patients were positive with the rapid protocol and negative with the standard protocol. This slight difference might be due to differences in the centrifugation condition (Fig 1) and number of washes performed (Table 1) , which can result in the loss of virus and RNA; however, the difference was not proven in the estimated LOD study, and the superiority with respect to the analytical performance cannot be concluded based on the present findings. Table 7 . Concordance rate of the standard method with magLEAD extraction for GENECUBE 1 with real-time RT-PCR for saliva samples � .

Rapid method with magLEAD extraction for GENECUBE �� The discordant samples were tested by real-time RT-PCR with Roche LightMix Modular SARS and Wuhan CoV E-gene and all were positive (S3 Table) .

https://doi.org/10.1371/journal.pone.0262159.t007 Table 8 . Concordance rate of the rapid method with magLEAD extraction for GENECUBE 1 with real-time RT-PCR for saliva samples � .

Rapid method with magLEAD extraction for GENECUBE Table) .

https://doi.org/10.1371/journal.pone.0262159.t008

Saliva has been considered a good alternative for the detection of SARS-CoV-2 in COVID-19 patients [3] and has been widely used in COVID-19 practice. Among rapid molecular identification systems, GeneXpert 1 showed good analytical performance for the detection of SARS-CoV-2 with saliva samples [19] ; however, the application of saliva to rapid molecular identification systems remains a challenge owing to saliva's viscosity and RT-PCR inhibition. In our current study, we used 60 saliva samples with positive nasopharyngeal sample results for SARS-CoV-2 (S2 Table) , and the rapid protocol detected SARS-CoV-2 in most samples (98.3%; 59/60). The rapid protocol can detect SARS-CoV-2 with high performance in approximately 35 minutes with saliva samples, and the protocol is expected to have clinical utility, especially for the rapid accurate identification of SARS-CoV-2-infected patients with collecting nasopharyngeal samples is considered difficult. The current study used frozen saliva samples for validation. While the analytical performance for the detection of SARS-CoV-2 has been reported to be equal between fresh and frozen saliva samples [20] , the freeze-thaw method has been known as one of the RNA/DNA extraction methods [21] which might influence the sensitivity [22] . Therefore, a further evaluation should be performed with fresh samples.

Anterior nasal samples are also a good alternative method for COVID-19 sampling [3] . The method has been reported as less painful and induced fewer coughs or sneezes compared with nasopharyngeal sampling [12] . The application of self-collected anterior nasal sampling has also been reported [23] . In the current study, the analytical performance of the GENECUBE 1 examination was almost identical to the reference RT-PCR. However, there were seven negative results using anterior nasal samples, which were obtained from patients with positive nasopharyngeal samples (S1 Table) . The detection rate was 88.1% (52/59), which was inferior to that with saliva samples; however, saliva samples were not simultaneously collected with anterior nasal samples in the present study, so we cannot compare the sensitivity. In addition, we obtained anterior nasal samples from a single nasal cavity; however, the viral loads obtained with nasal sampling differ between nares [24] , so sampling from both nasal cavities is preferable [25] .

There are several limitations in this study that should be mentioned. First, reference real-time RT-PCR was used for the comparison, and a discrepant analysis was used for the validation, which can cause bias unless a composite reference standard is used as a reference [26] [27] [28] [29] [30] [31] [32] . While the current study evaluated the concordance with the reference real-time RT-PCR findings, the sensitivity and specificity of the GENECUBE 1 examination were not accurately confirmed. Second, the current research was performed at a PCR center in Japan. The influence of LODs of the GENECUBE 1 evaluation for genetic variants of SARS-CoV-2 was not evaluated in this study. Third, the current evaluated rapid protocol showed excellent performance for the detection of SARS-CoV-2; however, the sample size was insufficient to conclude that the protocol can be used in clinical practice; additional evaluation in studies with large samples is required. Fourth, the current GENECUBE 1 examination can analyze only 12 samples at a single run, and the amplification curve is not displayed. The system must be improved for better examination. Fourth, for the evaluation of the GENECUBE 1 examination using anterior nasal samples, the proportion of low viral load samples (Ct � 30) was small, which could have improved thus concordance rates of the current study.

In conclusion, the GENECUBE 1 examination with GENECUBE 1 HQ SARS-CoV-2 provided high analytical performance for the detection of SARS-CoV-2 in anterior nasal samples and saliva samples. Table. Detailed data for the three cases with discordant findings among the three SARS-CoV-2 detection methods for saliva samples. (DOCX) 

The Infectious Diseases Society of America Guidelines on the Diagnosis of COVID-19: Antigen Testing

How to obtain a nasopharyngeal swab specimen

Diagnostic performance of different sampling approaches for SARS-CoV-2 RT-PCR testing: a systematic review and meta-analysis

Clinical evaluation of a non-purified direct molecular assay for the detection of Clostridioides difficile toxin genes in stool specimens

Rapid detection of the Mycobacterium tuberculosis complex by use of quenching probe PCR (geneCube)

Evaluation of performance of the GENECUBE ® assay for rapid molecular identification of Staphylococcus aureus and methicillin resistance in positive blood culture medium

Rapid detection of the macrolide sensitivity of pneumonia-causing Mycoplasma pneumoniae using quenching probe polymerase chain reaction (GENECUBE®)

Evaluation of rapid measurement of Chlamydia trachomatis and Neisseria gonorrhoeae by using automatic gene analyzer " GENECUBE®"

Evaluation of GENECUBE Mycoplasma for the detection of macrolide-resistant Mycoplasma pneumoniae

A prospective evaluation of the analytical performance of GENECUBE ® HQ SARS-CoV-2 and GENECUBE ® FLU A/B

Prospective analytical performance evaluation of the QuickNavi™-COVID19 Ag for asymptomatic individuals

Diagnostic performance and characteristics of anterior nasal collection for the SARS-CoV-2 antigen test: a prospective study

magLEAD 6gC & magLEAD 12gC High-Quality, Low Cost, Automated Nucleic Acid Extraction System

Fully Automated Gene Analyzer GENECUBE ® (model C)

Multicenter evaluation of the Cepheid Xpert Xpress SARS-CoV-2 test

Comparative performance and cycle threshold values of 10 nucleic acid amplification tests for SARS-CoV-2 on clinical samples

Development of genetic diagnostic methods for detection for novel coronavirus 2019(nCoV-2019) in Japan

Clinical Evaluation of Self-Collected Saliva by Quantitative Reverse Transcription-PCR (RT-qPCR), Direct RT-qPCR, Reverse Transcription-Loop-Mediated Isothermal Amplification, and a Rapid Antigen Test To Diagnose COVID-19

Saliva as an alternate specimen source for detection of SARS-CoV-2 in symptomatic patients using Cepheid Xpert Xpress SARS-CoV-2

Efficacy of a novel SARS-CoV-2 detection kit without RNA extraction and purification

A simplified SARS-CoV-2 detection protocol for research laboratories

Simply saliva: stability of SARS-CoV-2 detection negates the need for expensive collection devices. madRxiv: 20165233v1

SARS-CoV-2 detection on self-collected saliva or anterior nasal specimens compared with healthcare personnel-collected nasopharyngeal specimens

Sampling variability between two mid-turbinate swabs of the same patient has implications for influenza viral load monitoring

Nasal (Anterior Nasal) Specimen Collection for SARS-CoV-2 Diagnostic Testing

Bias in discrepant analysis: When two wrongs don't make a right

Discrepant analysis: A biased and an unscientific method for estimating test sensitivity and specificity

The discrepancy in discrepant analysis

Discrepant analysis and bias: A micro-comic strip

Discrepant analysis is an inappropriate and unscientific method

Clinical infectious diseases: an official publication of the Infectious Diseases Society of America

Evaluation of bias in diagnostic-test sensitivity and specificity estimates computed by discrepant analysis

For their thorough support of this study, we are very grateful to Mrs. Yoko Ueda, Mrs. Mio Matsumoto, Mrs. Asami Nakayama, and the staff in the Department of the Clinical Laboratory of Tsukuba Medical Center Hospital. We thank all of the medical institutions for providing their patients' clinical information.