key: cord-0978730-q0voqbsg authors: Kim, Hanah; Hur, Mina; Moon, Hee‐Won; Yun, Yeo‐Min; Cho, Hyun Chan title: Comparison of two multiplex PCR assays for the detection of respiratory viral infections date: 2014-01-10 journal: Clin Respir J DOI: 10.1111/crj.12083 sha: 8e9a2f6f32bb7e726b0d0cb1b61b44870e8a1846 doc_id: 978730 cord_uid: q0voqbsg INTRODUCTION: Respiratory viruses are the main causes of upper and lower respiratory tract diseases. Rapid and accurate detection of respiratory viruses is crucial for appropriate patient treatment and prevention of endemic spread. OBJECTIVES: We compared two multiplex polymerase chain reaction (PCR) assays for the detection of respiratory viral pathogens. METHODS: A total of 245 respiratory specimens (229 sputum samples, 14 bronchoalveolar lavage samples, 6 nasal swabs, 3 throat swabs, 7 unknown) were analyzed using two multiplex assays: One‐step RV real‐time PCR (BioSewoom, Seoul, Korea) and Seeplex RV 12 Detection kit (Seegene, Seoul, Korea). The results were further confirmed using sequencing as a reference. RESULTS: Among 245 samples (265 identifications including co‐infections), the identification of respiratory viruses was 44.9% (119/265), 44.2% (117/265) and 45.3% (120/265) by One‐step RV assay, Seeplex RV assay and sequencing, respectively. The concordance rate between One‐step RV assay and sequencing was 95.5% (253/265), and that between Seeplex RV assay and sequencing was 89.8% (238/265) (P = 0.0189). The sensitivities of One‐step RV and Seeplex RV assays were 94.1% [95% confidential interval (CI), 88.3%–97.6%] and 83.3% (95% CI, 75.4%–89.5%), respectively (P = 0.0002). The specificities of One‐step RV and Seeplex RV assays were 96.6% (95% CI, 92.2%–98.9%) and 95.2% (95% CI, 90.3%–98.0%), respectively. CONCLUSION: Although the performances of One‐step RV and Seeplex RV assays were overall comparable, One‐step RV assay showed better sensitivity and concordance with sequencing. One‐step RV assay can be a useful option for respiratory virus testing in clinical laboratories. Respiratory viral infections are the major causes of upper and lower respiratory tract diseases. They are associated with significant morbidity and mortality in infants, children, the elderly and immunocompromised patients. The disease severity varies according to the host and viral predisposing factors, such as affect-ing age, immune status of patient, combined infection and infection mechanism of viral pathogen (1, 2) . Respiratory infections caused by virus or bacteria are often indistinguishable, and rapid and accurate detection is crucial for appropriate patient treatment and prevention of endemic spread; therefore, selecting an appropriate diagnostic test is indispensable (3) . The common respiratory viruses causing respiratory infections include adenovirus (AdV), coronaviruses (CoV), human metapneumovirus (hMPV), influenza virus type A and B, parainfluenza virus type 1 (PIV 1), PIV 2, PIV 3, respiratory syncytial virus type A (RSV A), RSV B, rhinoviruses, enteroviruses and bocaviruses (4) (5) (6) . Although conventional techniques including viral isolation in cell culture and serology have been used to diagnose respiratory virus infections, their clinical value is limited because of weak sensitivity and slow turn-around time (6, 7) . Recently, rapid antigen tests are used widely in clinical laboratories, but they are known to be less sensitive and less specific for the detection of respiratory viruses (8, 9) . Molecular assay, especially polymerase chain reaction (PCR), is increasingly used for the diagnosis of viral infections. PCR is more sensitive and rapid, can be largely automated, and can detect and quantify viruses not amenable to routine cultures (9, 10) . Moreover, a simultaneous detection of several viruses using multiplex PCR assay is advantageous to differentiate diagnosis of viral respiratory infections in one assay and facilitate costeffectiveness in the clinical field (4, 6, 7, (11) (12) (13) . In this study, we compared two commercially available multiplex PCR assays: One-step RV real-time PCR (BioSewoom Inc., Seoul, Korea) and Seeplex RV 12 Detection kit (Seegene Inc., Seoul, Korea). Seeplex RV assay is one of the representative multiplex PCR platforms, and its performances have been evaluated in previous studies (14) (15) (16) (17) (18) (19) . We wanted to evaluate the diagnostic performance of a novel multiplex PCR assay, One-step RV assay, in comparison with that of Seeplex RV assay. Both assays were compared for the detection of the following pathogenic respiratory viruses: AdV, CoV, hMPV, human flu A (H1N1), human flu A (H3N2), influenza virus type A and B, PIV 1, PIV 2, PIV 3, rhinovirus A, RSV A and RSV B. All specimens positive for respiratory viruses by the two multiplex PCR assays were further sequenced to confirm the pathogens. This study was approved by the Institutional Review Board of the Konkuk University Medical Center, a tertiary referral hospital with 900 beds. From July to September 2012, a total of 245 specimens (229 sputum samples, 14 bronchoalveolar lavage samples, 6 nasal swabs, 3 throat swabs, and 7 unknown) were consecutively collected from the 239 patients (134 males and 105 females) with respiratory symptoms, regardless of hospitalization. The patients consisted of 52 adults and 187 children, and their median age was 68 years and 3 years, respectively (range, 0-87 years). Bacteriological investigations (smear and culture) revealed the absence of bacterial co-infections. A total of 0.5-1 mL of specimen was added to viral transport medium [minimal essential medium with 2% fetal bovine serum, penicillin (100 U/mL), amphotericin B (20 ug/mL), neomycin (40 ug/mL), NaHCO 3 buffer], and an aliquot from the mixture of each sample was stored at -70°C for the analysis. Viral nucleic acid was extracted using the QiaAmp MinElute Virus spin kit (Qiagen, Valencia, CA, USA), according to the manufacturer's instructions. In brief, 25 uL of protease was added to 200 uL of specimen, and then a buffer AL solution was added to specimen/ protease mixture. The mixture was incubated at 56°C for 15 min, and 250 uL of ethanol was added. The entire volume of sample was then transferred to a QiaAmp MinElute column and centrifuged for 1 min at 6000× g. A series of washes were performed. Extracted nucleic acid was amplified by both Onestep RV assay and Seeplex RV assay, according to the manufacturers' instructions. One-step RV real-time PCR was conducted in a final reaction volume of 35 uL, containing 5 uL of sample RNA, 5 uL of positive control, 5 uL of negative control, 3 uL of RV probeprimer mixture and 17 uL of 2× master mixture. PCR thermal cycling conditions were optimized to the following protocol: 30 min at 50°C, 15 min at 95°C and 45 cycles at 95°C for 15 s, followed by 62°C for 45 s. PCR was performed using Bio-Rad CFX96 real-time detection PCR system (Bio-Rad, Hercules, CA, USA). Seeplex RV assay is an end-point reverse transcriptase PCR using dual specific oligonucleotide technology. After the cDNA synthesis using cDNA synthesis kit (Seegene Inc.), PCR was conducted in a final reaction volume of 20 uL containing 6 uL of cDNA, 4 uL of 5× RV primer and 10 uL of 2× master mix. PCR thermal cycling conditions were optimized to the following protocol: 15 min at 94°C for reverse transcription, 40 cycles at 94°C for 30 s, followed by 60°C for 1.5 min and 72°C for 1.5 min, and then final extension at 72°C for 10 min. PCR was performed using GeneAmp PCR system 9700 (Applied Biosystems, Foster City, CA, USA). The amplified PCR products were separated on 2% agarose gels. Seeplex RV assay included a size marker that has the same lengths as those of amplicons for internal control and viruses. If a specimen showed an amplicon of the same size as one of a marker band, it was indicated as positive. The limits of detection for target viruses were 4-273 copies/uL for One-step RV assay and 100 copies/uL for Seeplex RV assay. Each assay included an internal control to rule out PCR inhibition. The positive results by multiplex PCR assays were further confirmed using sequencing. At the end of PCR reaction, 6 uL of an enzymatic purification mixture cocktail containing Escherichia coli exonuclease I and shrimp alkaline phosphatase was added to the PCR product. The mixture was incubated at 37°C for 30 min, followed by 85°C for 15 min, and then the mixture was kept at 4°C. The kept mixture was directly sequenced using the BigDye Terminator Cycle Sequencing Kit (Applied Biosystems) in ABI PRISM 3730XL Autosequencer (Applied Biosystems). Sequences were analyzed using the Basic Local Alignment Search Tool (BLAST) provided from The National Center for Biotechnology Information (http://www.ncbi.nlm.nih .gov/BLAST). The concordance rates between each multiplex PCR assay and sequencing were obtained. For each assay, sensitivity and specificity were calculated with their 95% confidence intervals (CI). The proportions between the two multiplex assays were compared using chi-squared test. Statistical analysis was performed using Analyse-it Software (Analyse-it Software, Ltd, Leeds, UK) and MedCalc Software (version 12.1.4, MedCalc Software, Mariakerke, Belgium). P values of equal to or less than 0.05 were considered statistically significant. A total of 265 results were obtained from 245 specimens. In 265 results, 120 results (45.3%) were positive by sequencing, 119 (44.9%) by One-step RV assay and 117 (44.2%) by Seeplex RV assay (Table 1) . Coronavirus 229E, human flu A (H1N1) and human flu A (H3N2) were not detected in any specimens. Among the 11 types of viruses identified, rhinovirus A, hMPV and PIV 3 were the most frequently detected viruses. Overall concordance rates among the methods were: 87.9% (233/265) between One-step RV and Seeplex RV assays; 95.5% (253/265) between One-step RV assay and sequencing; and 89.8% (238/265) between Seeplex RV assay and sequencing. The concordance rate of each multiplex assay with sequencing showed a significant difference [5.7% (95% CI, 1.03%-10.5%), P = 0.0189]. Co-infections were detected in 16 out of 245 (6.5%) specimens ( Table 2 ). The two multiplex assays showed discrepant results in 68.8% (11/16) of coinfected specimens, compared with 11.4% (28/245) of discrepant results in total specimens. The proportion of discrepancy was significantly higher in co-infected specimens than in total specimens [difference of 57.4% (95% CI, 29.6%-78.0%), P < 0.0001]. The diagnostic performance of both multiplex assays was compared with sequencing ( Table 3 ). The sensitivity and specificity of One-step RV assay were 94.1% (95% CI, 88.3%-97.6%) and 96.6% (95% CI, 92.2%-98.9%), respectively. In Seeplex RV assay, the sensitivity and specificity were 83.3% (95% CI, 75.4%-89.5%) and 95.2% (95% CI, 90.3%-98.0%), respectively. The sensitivity of One-step RV assay was significantly higher than that of Seeplex RV assay (94.1% vs 83.3%, P = 0.0002), although the specificities were comparable in both assays. One-step RV assay showed excellent sensitivity (100%) for most of the viruses, but the sensitivity was lower for the detection of rhinovirus A, PIV 2 and PIV 3 (84.4%-92.0%). In Seeplex RV 12 assay, excellent sensitivity (100%) was observed only for influenza virus type B and RSV A. For the other viruses, the sensitivity varied widely, ranging from 62.5% to This study showed the diagnostic performances of two multiplex PCR assays for the detection of respiratory viruses: One-step RV and Seeplex RV assays. Compared with sequencing, the overall concordance rate of One-step RV assay was significantly better than that of Seeplex RV assay (95.5% vs 89.8%, P = 0.0189) ( Table 1 ). For influenza virus type B and RSV A, both assays showed 100% of concordance with sequencing. For all the other viruses, except for these two viruses, the concordance rate in One-step RV assay was superior to that in Seeplex RV assay. The specificities of both assays were comparable and satisfactory, showing 96.6% in One-step RV assay and 95.2% in Seeplex RV assay (Table 3) . Such a high performance was observed constantly for each virus, showing the lowest value of 98.3% for PIV 3 in Seeplex RV assay. However, the sensitivity of One-step RV assay was significantly better than that of Seeplex RV assay (94.1% vs 83.3%, P = 0.0002). Moreover, the sensitivity for each virus was more variable in Seeplex RV assay (62.5%-100%) than in One-step RV assay (84.4%-100%). Accurate and rapid diagnosis of respiratory virus infection is essential for the initiation of early treatment and the prevention of viral spread (6, 14) . An early start of proper anti-viral management can avoid unnecessary exposure to antibacterial agents, and some respiratory viral infections caused by influenza virus or AdV may benefit from specific anti-viral treatment. Knowing the subtype of influenza virus may be important predicting the efficacy of adamantanes and neuraminidase inhibitors as anti-viral agents (20) (21) (22) . Viral culture is technically demanding and easily affected by specimen quality or virus type. Although shell vial culture and subsequent immunostaining has been widely used, it is not easy for routine testing in clinical laboratories (6, 7, 14, 23) . The nucleic acid amplification test including PCR is a powerful alternative for the respiratory virus detection. It is faster and more sensitive than virus culture, and some viruses that grow poorly in cell cultures can be also detected (24, 25) . Multiplex PCR assay is advantageous for detecting common respiratory viruses simultaneously and is now widely used in clinical laboratories (7) . According to our data, the overall performance of One-step RV assay was superior to that of Seeplex RV assay. These two assays showed significant difference in terms of sensitivity and concordance rate with sequencing. Among the 11 respiratory virus targets, six viruses showed 100% of sensitivities in One-step RV assay, compared with variable performances (62.5%-100%) in Seeplex RV assay. Of note, the proportion of discrepancy between the two multiplex assays was significantly higher in co-infected specimens than in total specimens [68.8% vs 11.4%, difference of 57.4% (95% CI, 29.6%-78.0%), P < 0.0001] ( Table 2 ). In the present study, the proportion of co-infections (6.5%) was relatively low compared with the previous data (8-11%) (6) . We assume that the overall performance and concordance between the two assays would have shown a bigger difference, if we could enroll more co-infected specimens in this study. Further studies are awaited to clarify this assumption. The hands-on time of Seeplex RV assay was at least 6 h: 2 h for RNA extraction and cDNA synthesis and additional 4 h for multiplex PCR and visualization by gel electrophoresis (6) . On the contrary, the hands-on time of One-step real-time RV assay was reduced to approximately 3 h, without the steps of cDNA synthesis and gel electrophoresis. Although the cost per each case may be similar ($35-40) in both assays, the improved turnaround time of One-step RV assay would be beneficial for saving the overall hospital cost and for the timely reports. Our study is limited in that the enrolled sample size was small: we analyzed only 265 results from 245 clinical specimens. Because these two assays are commercially available, we compared them only with clinical samples, without testing of known positive controls for each of the target viruses. Although 14 viruses can be identified using One-step RV assay, our analyses were confined to only 11 viruses because we could not enroll the clinical specimens with coronavirus 229E, human flu A (H1N1) or human flu A (H3N2). Moreover, the panel of both assays did not include some common respiratory viruses, such as enteroviruses and bocaviruses: the absence of these viruses might explain the relatively low number of positive samples in this set of clinical specimens. Another study would be needed to fully evaluate the diagnostic performances of One-step RV assay for such viruses. Another limitation is that the results of multiplex PCR assays were confirmed by sequencing only, without virus culture being performed. However, sequencing is generally used to confirm the culture negative but PCR positive results or to detect some poorly growing viruses in culture (14, 25) . In conclusion, a novel real-time multiplex PCR platform, One-step RV assay, showed satisfactory diagnostic performances in comparison with Seeplex RV assay. With its excellent specificity and sensitivity, One-step RV assay can be one of the useful options for respiratory virus testing in clinical viral laboratories. Acute respiratory infections in children. A global public-health problem The burden of respiratory syncytial virus infection in young children Comparison of the Idaho technology FilmArray system to real-time PCR for detection of respiratory pathogens in children Clinical evaluation of multiplex real-time PCR panels for rapid detection of respiratory viral infections Rapid and sensitive method using multiplex real-time PCR for diagnosis of infections by influenza a and influenza B viruses, respiratory syncytial virus, and parainfluenza viruses 1, 2, 3, and 4 Molecular diagnosis of respiratory virus infections Cost analysis of multiplex PCR testing for diagnosing respiratory virus infections Diagnostic capacity of rapid influenza antigen test: reappraisal with experience from the 2009 H1N1 pandemic Lack of sensitivity of rapid antigen tests for the diagnosis of respiratory syncytial virus infection in adults Real-time PCR in clinical microbiology: applications for routine laboratory testing Clinical applications of molecular biology for infectious diseases Evaluation of multiple commercial molecular and conventional diagnostic assays for the detection of respiratory viruses in children Comparison of a multiplex reverse transcription-PCR-enzyme hybridization assay with conventional viral culture and immunofluorescence techniques for the detection of seven viral respiratory pathogens Identification of adenovirus, influenza virus, parainfluenza virus, and respiratory syncytial virus by two kinds of multiplex polymerase chain reaction (PCR) and a shell vial culture in pediatric patients with viral pneumonia Use of the Seeplex RV Detection kit for surveillance of respiratory viral outbreaks in Evaluation of a novel real-time RT-PCR using TOCE technology compared with culture and Seeplex RV15 for simultaneous detection of respiratory viruses Comparison of Anyplex II RV16 with the xTAG respiratory viral panel and Seeplex RV15 for detection of respiratory viruses High rates of detection of respiratory viruses in the nasal washes and mucosae of patients with chronic rhinosinusitis Comparative evaluation of six commercialized multiplex PCR kits for the diagnosis of respiratory infections Surveillance of resistance to adamantanes among influenza A(H3N2) and A(H1N1) viruses isolated worldwide Influenza virus neuraminidase inhibitors Effectiveness of neuraminidase inhibitors in treatment and prevention of influenza A and B: systematic review and meta-analyses of randomised controlled trials Evaluation of the Hexaplex assay for detection of respiratory viruses in children New Vaccine Surveillance Network Study Group. Superiority of reverse-transcription polymerase chain reaction to conventional viral culture in the diagnosis of acute respiratory tract infections in children Clinical impact and diagnosis of human metapneumovirus infection This study was supported by Konkuk University.