key: cord-0765818-dm1ec557
authors: Lim, Ho-Jae; Jung, Hye-Soo; Park, Min-Young; Baek, Young-Hyun; Kannappan, Balaji; Park, Jin-Young; Yang, Jae-Hyun; Seol, Ja-Hwan; Lee, Min-Woo; Jung, Sun-Kyung; Lee, Sun-Hwa; Park, Jung-Eun; Yang, Yong-Jin
title: Evaluation of Three Automated Extraction Systems for the Detection of SARS-CoV-2 from Clinical Respiratory Specimens
date: 2022-01-04
journal: Life (Basel)
DOI: 10.3390/life12010068
sha: 90857849cfa341d286cb7ac533bb9319927f653e
doc_id: 765818
cord_uid: dm1ec557

Severe acute respiratory syndrome coronavirus (SARS-CoV-2) is highly contagious and causes coronavirus disease 2019 (COVID-19). Reverse transcription quantitative polymerase chain reaction (RT-qPCR) is the most accurate and reliable molecular assay to detect active SARS-CoV-2 infection. However, a rapid increase in test subjects has created a global bottleneck in testing capacity. Given that efficient nucleic acid extraction greatly affects reliable and accurate testing results, we compared three extraction platforms: MagNA Pure 96 DNA and Viral NA Small Volume kit on MagNA Pure 96 (Roche, Basel, Switzerland), careGENE(TM) Viral/Pathogen HiFi Nucleic Acid Isolation kit (WELLS BIO Inc., Seoul, Korea) on KingFisher Flex (Thermo Fisher Scientific, Rocklin, CA, USA), and SGRespi(TM) Pure kit (Seegene Inc., Seoul, Korea) on Maelstrom 9600 (Taiwan Advanced Nanotech Inc., Taoyuan, Taiwan). RNA was extracted from 245 residual respiratory specimens from the different types of samples (i.e., NPS, sputum, and saliva) using three different kits. The 95% limits of detection of median tissue culture infectious dose per milliliter (TCID(50)/mL) for the MagNA Pure 96, KingFisher Flex, and Maelstrom 9600 were 0.37–3.15 × 10(1), 0.41–3.62 × 10(1), and 0.33–1.98 × 10(1), respectively. The KingFisher Flex platform exhibited 99.2% sensitivity and 100% specificity, whereas Maelstrom 9600 exhibited 98.3–100% sensitivity and 100% specificity. Bland–Altman analysis revealed a 95.2% concordance between MagNA Pure 96 and KingFisher Flex and 95.4% concordance between MagNA Pure 96 and Maelstrom 9600, indicating that all three platforms provided statistically reliable results. This suggests that two modifying platforms, KingFisher Flex and Maelstrom 9600, are accurate and scalable extraction platforms for large-scale SARS-CoV-2 clinical detection and could help the management of COVID-19 patients.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the causative agent of coronavirus disease 2019 . The COVID-19 outbreak began in December 2019 [1] and was declared a global pandemic on 11 March 2020 by the World Health Organization (WHO) [2] . As of 21 December 2021, more than 274 million confirmed Life 2022, 12, 68 2 of 12 cases and 5.3 million deaths due to COVID-19 had been reported [3] . SARS-CoV-2 is predominantly transmitted by exposure to respiratory droplets and aerosol particles [4] . As SARS-CoV-2 is easily transmitted through the air and has a relatively long incubation time, several types and grades of measures, including travel restrictions, social distancing, and limitations on movement, have been adopted by the governments to prevent the spread of this virus [5] [6] [7] .

The United States Centers for Disease Control and Prevention (CDC) has established a decision tree for four indications and a standard assay for COVID-19 testing. Briefly, these include individuals with symptoms of COVID-19, those who have been in close contact with a person confirmed as having COVID-19, unvaccinated people who have attended a large social gathering or been in poorly ventilated indoor settings, and subjects referred for testing by the associated health department [8] . The CDC recommends a standard assay that includes RNA extraction from a nasopharyngeal swab (NPS), followed by a reverse transcription quantitative polymerase chain reaction (RT-qPCR) to detect purified SARS-CoV-2 RNA [9] .

The CDC recommended a list of automated technology commercial extraction kits (Roche, QIAGEN, and bioMérieux) for sample preparation upstream of the emergency use authorization COVID-19 RT-PCR diagnostic test [10] . One of the QIAGEN kits, QI-Aamp DSP Viral RNA (QIAGEN, Hilden, Germany), involves column-based purification, whereas the other QIAGEN kits, such as the EZ1 DSP Virus kit, involve magnetic particlebased purification, as do the Roche kits, including the Total Nucleic Acid, Nucleic Acid Isolation I, and MagNA Pure 96 DNA and Viral NA Small Volume kit (Roche, Basel, Switzerland) [10] . All of these kits have been used for nucleic acid extraction from respiratory tract specimens. However, the high demand for these kits has created a global bottleneck in testing capacity [11] . The modification of resources and methods, including extraction-free methods, may enable us to process a large number of multiplex RT-qPCR samples for detecting SARS-CoV-2 RNA [12] . However, the protocols for extraction-free methods differ among specimen types, as the ability to efficiently detect viral RNA is affected by media concentration and inhibitors, resulting in potentially insufficient sensitivity [13, 14] .

Thus far, the MagNA Pure96 platform (Roche, Basel, Switzerland) verified by previous studies is an accurate standard protocol [15] . However, careGENE TM Viral/Pathogen HiFi Nucleic Acid Isolation kit (WELLS BIO Inc., Seoul, Korea) on the KingFisher Flex platform (Thermo Fisher Scientific, Rocklin, CA, USA) and the SGRespi TM Pure kit (Seegene Inc., Seoul, Korea) on the Maelstrom 9600 platform (Taiwan Advanced Nanotech Inc., Taoyuan, Taiwan) have been recently developed; it is suggested that these novel extraction systems and platforms may extract nucleic acids as accurately as, but more rapidly than, the existing MagNA Pure96 platform [16] [17] [18] . Therefore, herein, the efficiency and extraction performance of these new extraction systems and platforms were evaluated and compared with those of the MagNA Pure 96 platform for the detect of SARS-CoV-2 in 245 respiratory specimens (NPS, sputum, and saliva).

Anonymized residual respiratory specimens from 245 patients, including 82 NPS, 79 sputum, and 84 saliva samples, were obtained from February to June 2021 as part of the routine procedure for SARS-CoV-2 testing. These archived samples included 57 NPS, 45 sputum, and 18 saliva samples positive for SARS-CoV-2, and 25 NPS, 34 sputum, and 66 saliva samples negative for the virus. All procedures were approved by the institutional review boards at the Seegene Medical Foundation (SMF-IRB-2021-005). Sputum and saliva specimens were each completely homogenized in 3 mL of 1x phosphate-buffered saline (PBS, pH 7.2). Three 200 µL aliquots were obtained from each sample, including NPS samples, for simultaneous nucleic acid extraction on three platforms: the MagNA Pure 96 DNA and Viral NA Small Volume kit (Roche, Basel, Switzerland) on the MagNA Pure 96 platform (Roche, Basel, Switzerland), the careGENE TM Viral/Pathogen HiFi Nucleic Acid Isolation kit (WELLS BIO Inc., Seoul, Korea) on the KingFisher Flex platform (Thermo Fisher Scientific, Rocklin, CA, USA), and the SGRespi TM Pure kit (Seegene Inc., Seoul, Korea) on the Maelstrom 9600 platform (Taiwan Advanced Nanotech Inc., Taoyuan, Taiwan). The main characteristics of these platforms that are compared in this study, such as the platform manufacturer, properties, measurement, extraction reagent, number of samples, extraction technique, duration of extraction, sample loading, nucleic acid collection, and identification reader, are summarized in Table 1 . 

Nucleic acids were simultaneously extracted from the samples using the automated MagNA Pure 96 platform, KingFisher Flex platform, and Maelstrom 9600 platform. For extraction using the MagNA Pure 96 platform, the MagNA Pure 96 DNA and Viral NA Small Volume kit was used and the extraction was performed following the manufacturers' instructions [19] . Briefly, 200 µL of sample was transferred to the processing cartridge, which was loaded on the instrument along with two additional empty cartridges, two reagent trays, pipette tips on holders, elution plates, and glass magnetic particles. Following the "Pathogen Universal 200" protocol, the sample was mixed with 250 µL lysis/binding buffer and magnetic particles. Subsequently, the nucleic acids bound to the beads were separated using a magnetic separator and washed twice to remove any residual contaminants. Pure nucleic acids were then eluted in 100 µL of elution buffer.

For extraction using the KingFisher Flex platform, the careGENE TM Viral/Pathogen HiFi Nucleic Acid Isolation kit was used as per the manufacturers' "MVP Flex" protocol. Briefly, 200 µL of sample was transferred to 300 µL of lysis buffer cartridge containing glass magnetic particles, which was loaded on the instrument along with three washing reagent cartridges, pipette tips on holders, and elution plates. Extraction was performed under the following conditions: 70 • C for 9 min (lysis/binding), followed by washing of cartridge 1 for 3 min, cartridge 2 for 2 min, and cartridge 3 for 0.5 min. After washing thrice, the nucleic acid bound magnetic beads were dried for 2 min. Pure nucleic acid was eluted at 70 • C in 80 µL of elution buffer for 6 min.

For extraction using the Maelstrom 9600 platform, the SGRespi TM Pure kit (Seegene Inc., Seoul, Korea) was used following the manufacturer's "SG-RESPI" protocol. Briefly, 200 µL of sample was transferred to the lysis buffer cartridge, which was loaded on the instrument along with three washing reagent cartridges, pipette tips on holders, and elution plates. The third washing cartridge contained the glass magnetic particles. Extraction was performed under the following conditions: the glass magnetic particles were transferred from the washing buffer cartridge 3 to the lysis buffer cartridge for 1 min, 94 • C for 4 min (lysis/binding), followed by an initial washing for 0.3 min and a second washing for 0.6 min. After washing twice, the nucleic acid bound magnetic beads were dried for 4 min and then eluted at 80 • C in 100 µL of elution buffer for 5 min. After successful extraction, the elution plate was sealed and removed for PCR usage. A maximum of 96 specimens can be processed by the three platforms in each run.

The multiplex RT-qPCR (mRT-qPCR) was performed using Allplex™ SARS-CoV-2 Assay kits (Seegene Inc., Seoul, Korea) to detect SARS-CoV-2 RNA following the manufacturers' instructions under the following cycling conditions: 50 • C for 20 min (reverse transcription), followed by 95 • C for 15 min (initial denaturation), and 45 cycles of 95 • C for 10 s (denaturation), 60 • C for 15 s (annealing), and 72 • C for 10 s (extension) [20, 21] . A sample was considered positive if more than one cycle threshold (Ct) value was under 36, regardless of the results of the internal control [22] .

The efficiencies of the three extraction systems were compared using the commercially available heat-inactivated viral culture fluids of the SARS-CoV-2 isolate 0810587CFHI obtained from Zeptometrix (Buffalo, NY, USA). Five replicates with four different concentrations of the viral isolate were used for this assessment. The viral culture was serially diluted (10 −4 -10 −7 ) using Gene Transport Medium (GeneTM; SG Medical Inc., Seoul, Korea). RNA was extracted from the serially diluted viral stock using the three extraction systems. mRT-qPCR assay was performed using Allplex™ SARS-CoV-2 Assay kit following the manufacturer's protocol. Ct values above 36 were not considered for evaluating extraction efficiency.

The analytical sensitivities of the three extraction systems were compared using two SARS-CoV-2 strains, 0810589CFHI and 0810590CFHI, both obtained from Zeptometrix (Buffalo, NY, USA). These strains were used as median tissue culture infectious doses per milliliter (TCID 50 /mL), as provided by the supplier. The strains were serially diluted (10 −1 -10 −9 ) using GeneTM (SG Medical Inc., Seoul, Korea). RNA was simultaneously extracted from 13 mL of serially diluted viral stocks of each strain using the three extraction systems. mRT-qPCR assay was performed using Allplex™ SARS-CoV-2 Assay kits. Ct values above 36 were not considered for evaluating analytical sensitivity.

Statistical analyses were performed using SPSS version 26.0 (IBM Corp., Armonk, NY, USA) for Mac and R-studio (Rstudio, Boston, MA, USA) for Windows. The coefficient of variation (CV) was determined to evaluate the extraction performance using measurements obtained from triplicate runs and presented as means and standard deviations; CV values < 4% were acceptable [23] . The extraction efficiency was calculated from the slope of the linear regression using the following formula: E value = 100 × (−1 + 10 −1/slope ) [24] . The LOD of mRT-qPCR assays and the concentrations of the sample detected as positive with 95% confidence were estimated to fit the probit regression model [25] . The sensitivity and specificity of each diagnostic test for SARS-CoV-2 using each system were compared with those of the MagNA Pure 96 platform. The Bland-Altman analysis was performed us-ing all three platforms by positive matching for each variable. The presence of proportional bias was determined by testing the slope of the regression line fitted to the Bland-Altman plot [26] .

The three extraction systems exhibited similar characteristics (Table 1) , including the sample loading requirements, use of magnetic beads, maximum processing ability of a single cartridge, and system automation. By contrast, when compared with the running time of MagNA Pure (60 min), both KingFisher Flex and Maelstrom 9600 had running times of only 30 min. Furthermore, given the machine measurements, the installation space occupied by one MagNA Pure 96 was equivalent to that of six KingFisher Flex instruments or three Maelstrom 9600. Compared with that of KingFisher Flex, the identification method for MagNA Pure 96 involved barcode detection to discriminate the reagent and sample, whereas that for Maelstrom 9600 involved inputting sample information. These differences suggest that both KingFisher and Maelstrom 9600 systems allow using modified reagents as open systems and for a more rapid extraction of nucleic acids in a relatively limited amount of space.

Ct values of SARS-CoV-2 using the MagNA Pure 96, KingFisher Flex, and Maelstrom 9600 platforms were analyzed in 245 samples. Among these, 120 samples were determined as SARS-CoV-2-positive, based on the Ct values. The inter-assay CVs using these three platforms were 1.58-3.28%, 1.32-3.81%, and 1.18-2.48%, for NPS samples; 2.53-3.21%, 1.78-2.16%, and 1.92-2.21%, for sputum samples; and 2.52-3.87%, 1.45-1.76%, and 1.10-1.62%, for saliva samples. These inter-assay CVs were all <3.7%, indicating that the variability was acceptable ( Table 2 ). The analytical performance of the three systems was compared using the 245 samples. Compared with the KingFisher Flex system, the MagNA Pure 96 system had sensitivities of 98.2-100% for NPS, 100% for sputum, and 94.4-100% for saliva samples. By contrast, when compared to the Maelstrom 9600 system, the MagNA Pure 96 system had sensitivities of 100% for NPS and saliva and 97.8-100% for sputum samples; however, specificity levels were 100% for all samples. These results indicated that the performances of the KingFisher Flex and Maelstrom 9600 systems were comparable with those of the MagNA Pure 96 system (Table 3) . Nucleic acid was efficiently extracted by each platform from all types of samples, without inhibition by other constituents of these samples. 

Extraction efficiencies of the MagNA Pure 96, KingFisher Flex, and Maelstrom 9600 platforms were analyzed (Figure 2) . The E value of the MagNA Pure 96 platform was 94-96% for the detection of the E, RdRP, S, and N genes. Similarly, the E values of the KingFisher Flex and Maelstrom 9600 platforms were 89-102% and 91-95%, respectively, for the abovementioned genes. The R 2 values for the MagNA Pure 96, KingFisher Flex, and Maelstrom 9600 platforms were 0.975-0.999, 0.974-0.992, and 0.964-0.992, respectively. Therefore, the extraction efficiency of the KingFisher Flex and Maelstrom 9600 platforms was similar to that of the MagNA Pure 96 platform. 

The analytical sensitivity and LOD were estimated with 16 replicates of two positive strains at six different concentrations; the dilutions of a standard solution ranged from 10 −4 to 10 −9 ( Table 4 ). The 95% LOD for the Zeptometrix-0810589CFHI strain was approximately 13.4-31.5 TCID 50 /mL for MagNA Pure 96, 9.7-36.2 TCID 50 /mL for KingFisher Flex, and 11.6-19.8 TCID 50 /mL for Maelstrom 9600. However, the 95% LODs for the Zeptometrix-0810590CFHI strain was 0.37-0.53 TCID 50 /mL for MagNA Pure 96, 0.41-0.65 TCID 50 /mL for KingFisher Flex, and 0.33-0.88 TCID 50 /mL for Maelstrom 9600 ( Table 4 ). The assay results showed a 100% reproducibility for all target genes, except for the Maelstrom 9600 N gene, at concentrations as low as 1.4 TCID 50 /mL, but showed similar ranges of LOD thresholds for all three platforms. 

The ongoing COVID-19 pandemic requires the testing of increasing numbers of clinical specimens, both to detect infected individuals and prevent the global spread of the virus [27] . The emergence of highly contagious strains has demonstrated that the rapid and highly sensitive detection of SARS-CoV-2 is critical to minimize transmission [28, 29] . The high global demand for testing has led to shortages in consumables and reagents required for the extraction and molecular detection of SARS-CoV-2 RNA in samples derived from the respiratory system [11] . Currently, the bottleneck of nucleic acid extraction kits will become more severe due to the spread of the SARS-CoV-2 lineage BA.1 (the Omicron variant). Various approaches, including reagent-free testing and modification of resources, are currently being developed to overcome these shortages and increase the ability to test for SARS-CoV-2 [11, 13] . Monitoring the emergence and spread of SARS-CoV-2, using platforms with performances similar to those of the existing platforms, is essential for implementing effective public health strategies [12] .

In this study, three extraction platforms were evaluated using the resources of original (MagNA Pure 96) and modified platforms (KingFisher Flex and Maelstrom 9600) from the standard to detect the most frequently examined strains of SARS-CoV-2. All three automated extraction systems (MagNA Pure 96, KingFisher Flex, and Maelstrom 9600) exhibited high extraction efficiencies ( Figure 2) and similar LOD for the tested SARS-CoV-2 strains (Table 4 ). Although the platforms yielded minor differences in LOD, particularly between dilutions of 10 −7 and 10 −8 , the Poisson distribution and the PCR gray region have shown that the virus in highly diluted samples is typically undetected, as the viral load is very low [30] . These results suggest that the performance of the KingFisher Flex and Maelstrom 9600 extraction platforms are very similar to that of the standardized platform, MagNA Pure 96.

A comparison of the results obtained from the analysis of the clinical samples across different platforms is crucial for determining the effectiveness of nucleic acid extraction and removal of enzymatic inhibitors, which have a direct impact on qPCR results [14, 31] . The present study evaluated the clinical reliability and reproducibility of the three abovementioned platforms. These clinical assessments revealed that the performances of both the KingFisher Flex and Maelstrom 9600 platforms were highly comparable with that of the MagNA Pure 96 platform in detecting SARS-CoV-2. Indeed, for all target genes, the KingFisher Flex and Maelstrom 9600 had sensitivities of 99.2% and 98.3%, respectively, with both having specificities of 100% when compared with the MagNA Pure 96 platform. The extraction performances of the three platforms were consistent regardless of the specimens (Table 3) and variant, such as SARS-CoV-2 lineage BA.1 (Table S1 ).

The evaluation of the technical properties of the two platforms (KingFisher Flex and Maelstrom 9600) revealed that the modified reagent had an open system, with components such as binding, washing, and an elution buffer similar to that of the original reagent. Both required only 30 min to extract nucleic acids, compared to the MagNA Pure 96 system, which required 60 min (Table 1) . Under these conditions, the KingFisher Flex and Maelstrom 9600 provide an advantage when extracting DNA from a large number of clinical specimens, including NPS, saliva, and sputum.

This study had a few limitations. First, the three platforms were compared in terms of their ability to extract and analyze nucleic acids from specimens with possible SARS-CoV-2 infection, followed by mRT-qPCR analysis; other respiratory viruses and bacteria were not considered. Second, other types of respiratory samples, such as bronchoalveolar lavage and throat swabs, were not evaluated. Thus, studies are needed to determine the ability and performance of these platforms with regard to the analysis and extraction of other viruses and bacteria, as well as SARS-CoV-2 in the infected specimens not considered in the present study.

To the best of our knowledge, this is the first study to compare the performance of two newly launched kits (careGENE TM Viral/Pathogen HiFi Nucleic Acid Isolation kit and SGRespi TM Pure kit), which use open platforms such as KingFisher Flex and Maelstrom 9600, with that of the established MagNA Pure 96 platform. The KingFisher Flex and Maelstrom 9600 platforms were highly efficient in extracting SARS-CoV-2 RNA from clinical samples. Thus, these platforms can serve as highly useful alternatives to the MagNA Pure 96 system and can extract nucleic acids stably and rapidly, contributing to the quick control of pathogen transmission in the population.

Supplementary Materials: The following are available online at https://www.mdpi.com/article/ 10.3390/life12010068/s1, Table S1 : Five nasopharyngeal swab specimens used to evaluate the extraction performance of the three kits for the detection of SARS-CoV-2. Informed Consent Statement: Patient consent was waived per Article 16 Clause 3 of the Bioethics and Safety Act, which states that a research project may be exempted from obtaining written consent of a human subject of research, subject to approval from the competent IRB that includes the present cases. Law abidance of this study was reviewed and approved by the Institutional Review Board of the Seegene Medical Foundation.

Guidelines for Laboratory Diagnosis of Coronavirus Disease 2019 (COVID-19) in Korea

Cutaneous manifestations of SARS-CoV-2 infection: A clinical update

World Health Organization. WHO Coronavirus (COVID-19) Dashboard

Evaluation of Residual Infectivity after SARS-CoV-2 Aerosol Transmission in a Controlled Laboratory Setting

Insights into the Mobility Pattern of Australians during COVID-19

Halved Incidence of Scrub Typhus after Travel Restrictions to Confine a Surge of COVID-19 in Taiwan

Investigating Dynamics of COVID-19 Spread and Containment with Agent-Based Modeling

COVID-19 Laboratory Testing/CDC Guidelines

Direct RT-qPCR detection of SARS-CoV-2 RNA from patient nasopharyngeal swabs without an RNA extraction step

Diagnostics for SARS-CoV-2 detection: A comprehensive review of the FDA-EUA COVID-19 testing landscape

Automated SARS-COV-2 RNA extraction from patient nasopharyngeal samples using a modified DNA extraction kit for high throughput testing

Overcoming the bottleneck to widespread testing: A rapid review of nucleic acid testing approaches for COVID-19 detection

Extraction-free SARS-CoV-2 detection by rapid RT-qPCR universal for all primary respiratory materials

A Saliva-Based RNA Extraction-Free Workflow Integrated with Cas13a for SARS-CoV-2 Detection

Performance of the MagNA Pure 96 system for cytomegalovirus nucleic acid amplification testing in clinical samples

Comparison of the new fully automated extraction platform eMAG to the MagNA PURE 96 and the well-established easyMAG for detection of common human respiratory viruses

Comparison of IMS Platforms for detecting and recovering Escherichia coli O157 and Shigella flexneri in foods

Summary of the Available Molecular Methods for Detection of SARS-CoV-2 during the Ongoing Pandemic

Prospective evaluation of a new automated nucleic acid extraction system using routine clinical respiratory specimens

Evaluation of extraction-free RT-PCR methods for faster and cheaper detection of SARS-CoV-2 using two commercial systems

Variant Prediction by Analyzing RdRp/S Gene Double or Low Amplification Pattern in Allplex SARS-CoV-2 Assay

Assay System for Simultaneous Detection of SARS-CoV-2 and Other Respiratory Viruses

Comparison of nested PCR and qPCR for the detection and quantitation of BoHV6 DNA

Comparison of seven commercial RT-PCR diagnostic kits for COVID-19

A computer program analysis

Statistical methods for assessing agreement between two methods of clinical measurement

Diagnostic Testing for Severe Acute Respiratory Syndrome-Related Coronavirus 2: A Narrative Review

Structural and Functional Analysis of the D614G SARS-CoV-2 Spike Protein Variant

Improved Molecular Diagnosis of COVID-19 by the Novel, Highly Sensitive and Specific COVID-19-RdRp/Hel Real-Time Reverse Transcription-PCR Assay Validated In Vitro and with Clinical Specimens

A novel poisson distribution-based approach for testing boundaries of real-time PCR assays for food pathogen quantification

Rapid Direct Nucleic Acid Amplification Test without RNA Extraction for SARS-CoV-2 Using a Portable PCR Thermocycler

Data Availability Statement: All data are available within the article.

The authors declare no conflict of interest.