key: cord-0950227-vh8szcja authors: Miranda, J. P.; Osorio, J.; Videla, M.; Angel, G.; Camponovo, R.; Henriquez-Henriquez, M. title: Analytical and Clinical Validation for RT-qPCR detection of SARS-CoV-2 without RNA extraction date: 2020-06-26 journal: nan DOI: 10.1101/2020.06.24.20134783 sha: fa9d8fdccfb54f8edebe35d88fb2217ed151fa3c doc_id: 950227 cord_uid: vh8szcja Background: The recent COVID-19 pandemic has posed an unprecedented challenge to laboratory diagnosis, based on the amplification of SARS-CoV-2 RNA. With global contagion figures exceeding 4 million persons, the shortage of reagents for RNA extraction represents a bottleneck for testing globally. We present the validation results for a RT-qPCR protocol without prior RNA extraction. Because of its simplicity, this protocol is suitable for widespread application in resource-limited settings. Methods: Optimal protocol was selected by comparing RT-qPCR performance under a set of thermal (65{degrees}C, 70{degrees}C, and 95{degrees}C for 5, 10, and 30 minutes) and amplification conditions (3 or 3,5 uL loading volume; 2 commercial RT-qPCR kits with limit of detection below 10 copies/sample) in nasopharyngeal swabs stored at 4{degrees}C in sterile Weise buffer pH 7.2. The selected protocol was evaluated for classification concordance with the standard protocol (automated RNA extraction) in 130 routine samples and in 50 historical samples with Cq values near to the clinical decision limit. Results: Optimal selected conditions were: Thermal shock at 70{degrees}C for 10 minutes, loading 3.5 ul in the RT-qPCR. Prospective evaluation in 130 routine samples showed 100% classification concordance with the standard protocol. The evaluation in historical samples, selected because their Cqs were at the clinical decision limit, showed 94% concordance with our confirmatory-gold standard which includes manual RNA extraction. Conclusions: These results validate the use of this direct RT-qPCR protocol as a safe alternative for SARS CoV-2 diagnosis in case of a shortage of reagents for RNA extraction, with minimal clinical impact. laboratory serves annually to 1million patients, with more than 12 million total tests, and corresponds to the biggest private laboratory provider in Chile. Sampling was performed using nasopharyngeal swabs in symptomatic patients and then stored at 4º C in tubes containing sterile potassium sodium phosphate buffer (Weise´s buffer) pH 7.2 (Merck, Cat. No.109468), until analysis. All procedures followed were in accordance with the Helsinki Declaration. Prior to sampling, all patients requesting COVID-19 PCR testing were asked to approve and sign consent forms allowing the use of their anonymized samples and clinical information for epidemiological vigilance and research. For the standard protocol, routinely used in the laboratory for the detection of SARS-CoV-2, an aliquot of 180 ul of sample from the primary sample (nasopharyngeal swab or nasopharyngeal aspirates) including 10 ul of extraction control was used to extract RNA with the MagNA Pure 96 DNA and Viral NA LV Kit (Roche Diagnostics, Cat. No. 06374891001) in the MagNA Pure 96 System (Roche Diagnostics). Then, 10 ul of the extracted RNA was used for amplification by RT-qPCR using the LightMix ® Modular Wuhan CoV RdRP-gene kit (Roche, in a Cobas z 480 system (Roche Diagnostics). This protocol allows the amplification of a 100 bp fragment from a conserved region of the RNA-dependent RNA polymerase (RdRP) gene and was used as a reference for standardization, validation, and final evaluation in problematic samples. Positive, negative, and blank controls (no template or no RT enzyme) were included in all the amplification procedures. Automatic analysis was performed using LightCycler ® 480 Software, Version 1.5. For the standardization of the direct SARS-CoV-2 detection protocol without RNA extraction steps, 50 ul aliquots from the primary sample (nasopharyngeal swabs or nasopharyngeal aspirates) of 5 anonymized patients were subjected to heat shock (65º, 70º or 95º C) during different incubation times (5, 10 or 30 minutes), and then were quickly placed at 4º C until the moment of amplification. From the sample subjected to heat shock, 2 different loading volumes were used for the RT-qPCR (3 or 3.5 ul of the sample). The later sample-treatment was evaluated using the LightMix ® Modular Wuhan CoV RdRP-gene and the SARS-CoV-2/SARS-CoV Multiplex REAL-TIME PCR Detection Kit (DNA-Technology, Cat. No. R3-P436-23/9EU R3-P436-S3/9EU), using the respective controls, following the manufacturer's instructions, and loaded in a Roche Cobas z 480 or in a DTlite thermal cycler (DNA-Technology), respectively. Multiplex of DNA-Technology kit amplifies 3 targets, the first is general to SARS-CoV-like coronaviruses (CoV-like), the other 2 targets are specific to SARS-CoV-2, for E gene (CoV-2 E) and N gene (CoV-2 N). Automatic analysis was performed using the DTmaster software for DNA-Technology kit, included in the DTlite system. Quantification cycle (Cq) values obtained with each kit and condition were compared with those obtained with the standard protocol for the same samples. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 26, 2020 . . https://doi.org/10.1101 For the validation stage, results obtained for the described sample-treatment conditions and amplification conditions were evaluated by an expert board in the laboratory to select the set of conditions (direct RT-qPCR protocol) with the best performance, considering Cq-value for positive samples and clinical/analytical classification concordance. The following Direct RT-qPCR protocol was selected for further validation: heat shock at 70º C for 10 minutes and then quickly placed at 4º C, loading 3.5 ul of the sample for RT-qPCR amplification with the SARS-CoV-2/SARS-CoV Multiplex REAL-TIME PCR Detection Kit. This protocol was further evaluated for a) repeatability and analytical variability of Cqs, using an abbreviated protocol that included 4 anonymized clinical samples run in triplicates, b) Statistical and clinical equivalence of the obtained Cqs for positive samples in comparison with the standard protocol already in use (n=27) and c) Clinical classification concordance with the standard protocol already in use (n=130). To test the performance of the direct RT-qPCR protocol in samples with Cqs near or bellow to the discriminatory value (Cq ≥40) as by our standard protocol (denominated "problematic samples" in this text for simplicity), we analyzed 50 historical samples with this condition in parallel by the direct and standard RT-qPCR protocols. In our laboratory routine, we set a confirmation algorithm for these samples, where RNA is manually extracted using RNeasy Mini Kit (Qiagen, Cat. No. 74106) and RT-qPCR amplification is re-run for samples with 1 ng/ul of RNA or more after manual RNA extraction, to establish a final classification. For samples with less than 1 ng/ul RNA after Manual RNA extraction, patients are contacted to take a new sample. Results for the comparison between the Direct RT-qPCR protocol, the standard laboratory protocol (with automatic RNA extraction), and the confirmatory protocol (with manual RNA extraction) are presented. Descriptive statistics, statistical analyzes, and Bland-Altman graphs for the comparison of the different protocols were performed using Stata MP 14.2. Results from the standardization experiment are shown in Table 1 . Based on these results and expert laboratory board (MHH, MV, GA, JO), we established the following direct RT-qPCR protocol as optimal for further validation: 1) Obtain an aliquot of 50 ul from the primary sample, stored at 4°C in Weise´s buffer 2) Thermal shock at 70º C for 10 minutes 3) Store at 4º C until loading the sample into a plate 4) Perform the RT-qPCR using 3.5 ul of sample with the SARS-CoV-2/SARS-CoV Multiplex REAL-TIME PCR Detection Kit (high sensibility kit). A summary of this procedure and a comparison with the standard protocol is detailed in Figure 1 . . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10. 1101 Using the direct protocol saved about 40% of the analysis time compared to the standard, which allows enhancing daily processing capability. Table 2 resumes the results of a brief repeatability assay to roughly characterize the variability of the Cqs. Note that Cqs present a very low intra-assay variability, therefore we proceeded to the validation stage. Diagnostic classification concordance was then evaluated in 130 routine samples, run prospectively using the direct RT-qPCR protocol and the standard protocol. We found full concordance with 27 positive patients for SARS-CoV-2 (Table 3) . Moreover, the same was found for the other 103 patients, with negative confirmation by both methods. Based on these results, we established that the performance of the direct protocol was very high, with neither false positive nor false negative results in the 130 samples analyzed, thus yielding to 100% concordance for the 130 samples (Table 5) . Additionally, we found that Cqs for positive samples were significantly lower when using the direct protocol and DNA-Technology kit. The median Cq for the standard protocol was 34.1, while for the direct protocol it was 30.4 (CoVlike), 30.6 (CoV-2 E gene), and 30.7 (CoV-2 N gene) (P <0.0009 for each, Wilcoxon signedrank test) (Table 3 ). In order to compare this difference, a Bland-Altman graph was made using the standard protocol as a reference (RdRP gene) ( Figure 2 ). With the purpose of evaluating the performance of direct RT-qPCR protocol in samples with Cq close to the discriminatory value, a total of 50 historical samples analyzed with the standard protocol and confirmed by manual extraction according to our current quality assurance algorithm were re-analyzed by direct RT-qPCR (Table 4 ). As observed, there is a high classification agreement with the confirmatory protocol that reaches 94% (Table 5) , which is also observed in terms of Cq (Table 4 ). The only discordance is 2 samples classified as positive with the direct RT-qPCR protocol (possibly false positive), while they showed amplification over cycle 40 when they were processed by automatic and manual RNA extraction. We also obtained a sample with amplification after cycle 40 with the direct method, previously classified as positive according to the standard method (possibly false negative). In every case, direct RT-qPCR presents amplification close to cycle 40, so it is plausible that the sample corresponded to patients with a viral load very close to the detection limit for both protocols. The evidence presented allows validating the direct RT-qPCR protocol as a comparable alternative to the standard protocol in routine for detection of SARS-CoV-2. Consequently, the clinical impact of replacing the standard protocol currently in use in our laboratory with the new direct RT-qPCR protocol is estimated to be minimal, given the high classification agreement between both techniques, without false negatives and false positives in a total of 130 samples analyzed by both methods as part of the described validation stage. In a small number of samples using the standard protocol in our laboratory routine, clear amplification is obtained after cycle 40. We have denominated these samples as "problematic" because it is difficult to establish whether it is a true or a false negative. In our experience with the routine use of the Roche LightMix ® Modular Wuhan CoV RdRP-gene kit associated with automatic nucleic acid extraction in the MagNA Pure 96 system, approximately 64% of the abovementioned samples (which should be reported as negative using the standard protocol) changed their classification when repeated by manual extraction . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint (Table 4) , evidencing the loss of sensitivity in cases with low viral load when performing nucleic acid extraction on an automatic platform. Consequently, we evaluated the direct protocol in 50 samples in this situation and found 94% of concordance with the confirmatory protocol (manual extraction followed by amplification using LightMix ® Modular Wuhan CoV RdRP-gene kit) as the gold standard, with only 2 false positive results and 1 false negative result for the direct RT-qPCR. Even when these results are far superior to results obtained by our standard protocol, we conclude that the direct protocol should be evaluated with caution when there is amplification near to the detection limit and thus we decided to set a confirmatory protocol for samples with Cqs ≥37 by the direct method and to re-analyzed these samples using manual RNA extraction and a different RT-qPCR kit. The demand for tests for the detection of SARS-CoV-2 by RT-qPCR grows every day around the world to allow the management of COVID-19 disease. Despite the high number of commercially available NAA tests, the process requires various reagents and supplies that have become the bottleneck for rapid analysis. Among these reagents, undoubtedly the most scarce have been those related to the extraction of genetic material from the coronavirus. In order to cope with this problem, many research laboratories have joined in the duty of analyzing clinical samples from patients in several countries, playing a fundamental role in maintaining the diagnostic process and containing the spread of the coronavirus, notwithstanding the stocks that are reserved in these centers are also limited and do not allow the long-term diagnostic process. Taking this background into account, we believe that it is vitally important that clinical laboratories take an active role in generating knowledge to maintain the diagnostic process and to share this knowledge, so that others can also implement it. In the present work, we successfully validated a protocol for performing RT-qPCR bypassing the initial nucleic acid extraction step with a high classification agreement with our standard protocol. So far, a protocol with similar conditions for sample treatment can be found in the literature (Alcoba-Florez et al., 2020), nonetheless, researchers have found that its use required on average 6.1 (± 1.6) more cycles to reach the diagnosis, which is not optimal for the use in clinical laboratory due to the susceptibility of false negatives near to the detection limit. The amplification kit used in their protocol was the LightMix ® Modular Wuhan CoV Egene (Roche Diagnostics), which has a reported analytic sensibility of 10 copies or fewer, performance confirmed by another independent laboratory (Okamaoto et al., 2020) . Considering these authors also used a high sensitivity kit, we believe therefore that components of the medium used for swab storage (VTM) could have influenced the displacement of the number of cycles required for the diagnosis. In our protocol, samples were stored in Weise´s buffer, allowing low interference with RT-qPCR. Moreover, our selected amplification kit was manufactured by DNA-Technology and also reports an analytical sensitivity of 10 copies, which agrees with the high classification performance we obtained. Finally, we consider whether our protocol is extendable to other kits, including those with intermediate sensitivity. With this question in mind, we used the Genesig ® kit (Cat No. Z-Path-2019-nCoV, analytical sensitivity <100 copies) on 58 samples. The optimal conditions for direct RT-qPCR protocol in this case were different, with heat shock at 95º C for 5 minutes and loading 6.5 ul of sample. With this protocol, we obtained 23 positive and 35 negative samples, all with a correct diagnostic classification when compared with our Roche standard. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint The median value for Cq obtained by Roche was 27.2 (IQR 24.3-33.8), while for the Genesig ® kit this value was significantly lower, with a median of 25.0 (IQR 24.0-30.8), P = 0.002, Wilcoxon signed-rank test (Data not shown). Considering these data, it is possible to conclude that the most important factor for the success of a direct protocol is to use a sample storage buffer that does not interfere with the RT-qPCR reaction. Furthermore, it strongly suggests that the optimal conditions for use with the direct protocol must be previously tested for each kit. Despite the fact that this protocol allows to considerably reduce the processing time, we believe that its implementation should be restricted only to those clinical laboratories in which the lack of RNA extraction reagents is a limiting factor to comply with the diagnostic process. This is because the most important object is to ensure the quality of analysis in the diagnosis of patients. Consequently, we hope that the use of this protocol will contribute to ensuring the diagnostic process both in Chile and in other countries. All procedures followed were in accordance with the Helsinki Declaration. Clinical samples were anonymized and all patients signed out Informed Consent allowing the use of their samples for research. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020 . . https://doi.org/10.1101 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint Table 2 . Repeatability and pre-validation of selected RT-qPCR protocol conditions in 4 clinical samples. Incubation time 10 minutes, temperature 70º C, sample volume 3.5 ul using DNA-Technology kit. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020. . . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 26, 2020 . . https://doi.org/10.1101 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint Figure 1 . Schematic representation of the direct RT-qPCR protocol without RNA extrac steps, compared to the standard protocol. action . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10.1101/2020.06.24.20134783 doi: medRxiv preprint Figure 2 . Bland-Altman comparisons between Cq values obtained for RdRP gene un standard protocol and A) CoV-like, B) Cov-2 E-gene and C) CoV-2 N-gene using DN Technology kit. under DNA-. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted June 26, 2020. . https://doi.org/10. 1101 Overcoming the bottleneck to widespread testing: A rapid review of nucleic acid testing approaches for COVID-19 detection A Novel Coronavirus Associated with Severe Acute Respiratory Syndrome An assessment of real-time RT-PCR kits for SARS-CoV-2 detection Coronavirus as a possible cause of severe acute respiratory syndrome Summary of probable SARS cases with onset of illness from 1 Laboratory testing for 2019 novel coronavirus (2019-nCoV) in suspected human cases WHO Director-General's opening remarks at the media briefing on COVID-19 -11 A new coronavirus associated with human respiratory disease in China A novel coronavirus from patients with pneumonia in China