key: cord-0765685-ptyw4hqw authors: Babady, N. Esther; England, Matthew R.; Jurcic Smith, Kristen L.; He, Taojun; Wijetunge, Dona Saumya; Tang, Yi-Wei; Chamberland, Robin R.; Menegus, Marilyn; Swierkosz, Ella M.; Jerris, Robert C.; Greene, Wallace title: Multicenter Evaluation of the ePlex Respiratory Pathogen Panel for the Detection of Viral and Bacterial Respiratory Tract Pathogens in Nasopharyngeal Swabs date: 2018-01-24 journal: J Clin Microbiol DOI: 10.1128/jcm.01658-17 sha: 137c77a97b865b5d85e90b50782a1bdf78539ec4 doc_id: 765685 cord_uid: ptyw4hqw The performance of the new ePlex Respiratory Pathogen (RP) panel (GenMark Diagnostics) for the simultaneous detection of 19 viruses (influenza A virus; influenza A H1 virus; influenza A 2009 H1 virus; influenza A H3 virus; influenza B virus; adenovirus; coronaviruses [HKU1, OC43, NL63, and 229E]; human rhinovirus/enterovirus; human metapneumovirus; parainfluenza viruses 1, 2, 3, and 4; and respiratory syncytial virus [RSV] [RSV subtype A and RSV subtype B]) and 2 bacteria (Mycoplasma pneumoniae and Chlamydia pneumoniae) was evaluated. Prospectively and retrospectively collected nasopharyngeal swab (NPS) specimens (n = 2,908) were evaluated by using the ePlex RP panel, with the bioMérieux/BioFire FilmArray Respiratory Panel (BioFire RP) as the comparator method. Discordance analysis was performed by using target-specific PCRs and bidirectional sequencing. The reproducibility of the assay was evaluated by using reproducibility panels comprised of 6 pathogens. The overall agreement between the ePlex RP and BioFire RP results was >95% for all targets. Positive percent agreement with the BioFire RP result for viruses ranged from 85.1% (95% confidence interval [CI], 80.2% to 88.9%) to 95.1% (95% CI, 89.0% to 97.9%), while negative percent agreement values ranged from 99.5% (95% CI, 99.1% to 99.7%) to 99.8% (95% CI, 99.5% to 99.9%). Additional testing of discordant targets (12%; 349/2,908) confirmed the results of ePlex RP for 38% (131/349) of samples tested. Reproducibility was 100% for all targets tested, with the exception of adenovirus, for which reproducibilities were 91.6% at low virus concentrations and 100% at moderate virus concentrations. The ePlex RP panel offers a new, rapid, and sensitive “sample-to-answer” multiplex panel for the detection of the most common viral and bacterial respiratory pathogens. R espiratory tract infections are a significant contributor to the global burden of respiratory tract illnesses, with up to 4 million deaths worldwide in 2013 (1) . Several pathogens, including viruses and bacteria, can cause respiratory tract infections. As clinical presentations often overlap, identification of the underlying pathogen based solely on clinical criteria is challenging (2) . Even though most respiratory tract infections are self-limited in immunocompetent hosts, many are treated, as shown in a recent study highlighting the increase in unnecessary antibiotic use in this group (3) . In other patient groups, including immunocompromised patients, elderly patients, and critically ill patients, complications from respiratory tract infections often occur, with poor outcomes including increased morbidity and mortality (4) (5) (6) . Thus, the ability to rapidly and accurately diagnose respiratory tract infections is critical for optimal patient care. Additionally, rapid and accurate diagnosis is essential for the timely administration of antiviral therapy, when available, and the institution of contact and droplet precautions to prevent health care-associated transmission (7, 8) . Several instruments and multiplexed molecular panels are currently approved by the U.S. Food and Drug Administration (FDA) for the rapid and sensitive detection of viral and bacterial respiratory pathogens in nasopharyngeal swab (NPS) specimens. These methods differ based on several criteria, including the degree of multiplexing (4 to 22 targets), complexity of the method (moderate to high), throughput (low to high), and turnaround time (TAT) (ϳ1 h to 8 h) (9) . In general, performance characteristics of these multiplex panels are significantly better than those of conventional methods, including viral culture and antigen tests, and have replaced these methods in many laboratories. On the other hand, the increased cost of multiplexed molecular panels compared to the cost of conventional methods has raised questions on their cost/benefit ratio, particularly as many viral targets on these panels have no specific treatments. However, given their utility in the rapid diagnosis of infections (especially in immunocompromised patients), infection control and prevention practices, and antibiotic stewardship, the interest in multiplexed PCRs remains high. The GenMark Respiratory Pathogen (RP) panel is a qualitative nucleic acid multiplex test that recently received U.S. FDA clearance for use on GenMark's new ePlex instrument. The ePlex RP panel detects 21 of the most common respiratory pathogens in NPS specimens. Viral targets identified are adenovirus, coronavirus (229E, HKU1, NL63, and OC43), human metapneumovirus (hMPV), human rhinovirus/enterovirus (HRV/EV), influenza A virus, influenza A H1 virus, influenza A 2009 H1 virus, influenza A H3 virus, influenza B virus, parainfluenza virus 1 (PIV1), PIV2, PIV3, PIV4, respiratory syncytial virus subtype A (RSV-A), and RSV-B. Bacterial targets identified are Chlamydia pneumoniae and Mycoplasma pneumoniae (10) . The ePlex RP panel is a sample-to-answer multiplex assay that runs on a single-use cartridge that automates all aspects of nucleic acid testing, including extraction, amplification, and detection. It combines electrowetting microfluidics and GenMark's eSensor technology, which is based on the principles of competitive DNA hybridization and electrochemical detection, as previously described for the GenMark XT-8 Respiratory Viral panel (11) . In this multicenter clinical trial study, the performance characteristics of the investigational-use-only (IUO) ePlex RP panel were evaluated by using NPS specimens collected at 13 sites across the United States and Canada. Reproducibility was evaluated at 3 sites. In addition to assay performance, other characteristics, including assay workflow and turnaround time, were evaluated. Study population. The study population included patients of all ages and both genders presenting with signs and/or symptoms of upper respiratory tract infection at 13 clinical sites located in the United States and Canada. Residual NPS specimens were prospectively collected from March 2013 through August 2014 from 5 sites and frozen at Ϫ80°C for future testing and were prospectively collected from September through October 2016 from 4 sites and tested fresh. To supplement the results of the prospective collection, NPS samples positive for low-prevalence pathogens were retrospectively collected and frozen. Frozen samples were thawed, pipetted into separate aliquots, and frozen at Ϫ80°C until they were tested by ePlex RP, the BioFire RP, and/or target-specific PCR/bidirectional sequencing as needed. Also, for low-prevalence pathogens, additional contrived samples were used to evaluate assay performance. Overall study design. NPS specimens were prospectively and retrospectively collected in viral transport medium, handled, and processed according to the NPS kit manufacturer's instructions. Either samples were collected specifically for this study, separately from a standard-of-care (SOC) purpose, or the residual sample was deidentified and provided after SOC was completed. The study was approved by a central quorum review institutional review board and/or individual clinical testing site institutional review board. Samples were tested with the ePlex RP panel at 1 of 5 sites and compared to results of testing with BioFire FilmArray respiratory panel version 1.7 (bioMérieux, Durham, NC) and an analytically validated PCR amplification assay(s) followed by bidirectional sequencing, if necessary (e.g., for resolution of discordant results or virus subtyping) (Laboratory Corporation of America, Morrisville, NC). GenMark ePlex RP panel testing. Testing with the ePlex RP panel was performed according to the manufacturer's instructions, using the materials in the kit. Briefly, after vortexing, 200 l of the primary NPS sample was aspirated into the sample delivery device (SDD) provided with the ePlex RP panel kit and vortexed. The entire volume of the SDD was dispensed into the sample loading port of the ePlex RP panel cartridge, and the cap was depressed to close the port. Each cartridge was bar-coded and scanned with the ePlex instrument and inserted into an available bay (Fig. 1) . Upon the completion of the assay run, the ePlex instrument ejected the cartridge for disposal, and an ePlex RP panel report was generated. Comparator method and method for resolution of discordant results. The comparator method was BioFire FilmArray respiratory panel version 1.7. All collected samples were tested with the BioFire RP, which detects all the respiratory viral and bacterial targets included on the ePlex RP panel but does not differentiate between RSV subtypes A and B (12) . Samples with RSV detected by the BioFire RP were additionally tested with an analytically validated PCR amplification assay(s) followed by confirmation by bidirectional sequencing to determine the subtype (Laboratory Corporation of America, Morrisville, NC). Results from collected samples that were discordant between the ePlex RP panel and the comparator method (i.e., false negative [FN] or false positive [FP]) were tested with an analytically validated PCR amplification assay(s) followed by bidirectional sequencing as described above. For coronaviruses, additional repeat testing by the BioFire RP and ePlex RP panel was also conducted as part of discordantresult resolution. Reproducibility study. Three reproducibility panels, each with 6 pathogens (influenza A H3 virus, RSV-A, PIV1, hMPV, coronavirus OC43, and adenovirus species B) at 3 different concentrations (moderate [3ϫ the limit of detection {LOD}]), low [1ϫ LOD], and negative) in NPS specimens, were tested at 3 sites. LOD studies were performed by the manufacturer (data not shown). Reproducibility testing was performed by 2 operators at each of 3 sites, and each operator tested the reproducibility panels in triplicate over 6 days (including 5 nonconsecutive days) by using 3 different cartridge lots, resulting in 2 days of testing for each of the 3 lots. Statistical methods. Positive percent agreement (PPA), negative percent agreement (NPA), and overall percent agreement (OPA) with the comparator method results or expected results were determined for each target detected by the ePlex RP panel. The PPA was calculated as 100 ϫ no. of TP/(no. of TP ϩ no. of FN), the NPA was calculated as 100 ϫ no. of TN/(no. of TN ϩ no. of FP), and OPA was calculated as 100 ϫ (no. of TP ϩ no. of TN)/(no. of TP ϩ no. of TN ϩ no. of FP ϩ no. of FN), where TP is true-positive results, FN is false-negative results, TN is true-negative results, and FP is false-positive results. The two-sided 95% score confidence interval (CI) was calculated for PPA, NPA, and OPA. Statistical analysis was performed by using SAS version 9.4. Workflow and turnaround time study. A time study was performed to determine the time needed to perform the ePlex RP panel test. Data were averaged from 20 samples tested by 2 operators. Each step of the process from sample preparation to unloading of the instrument was recorded and timed, and an average TAT was determined. Patient demographics. A total of 2,462 prospectively collected, 446 retrospectively collected, and 327 contrived samples were eligible for testing with the ePlex RP panel. Approximately 67% of samples were collected with Copan-manufactured UTM (universal transport medium), and 33% were collected with Remel M4 or M5 medium. Demographic information for the evaluable prospectively and retrospectively collected subject samples is provided in Table 1 . Approximately 50% of the subjects were male, with median ages of 33 years for subjects with prospectively collected samples and 5 years for subjects with retrospectively collected samples. The prevalences of ePlex RP panel targets by age group during the two phases of prospective collection are provided in Tables S1 and S2 in the supplemental material. Assay performance. (i) Accuracy. Of the 3,235 samples eligible for testing with the ePlex RP panel, 154 had invalid results (4.8%). After repeat testing, 8 samples were not evaluable due to final, invalid results (7 prospective samples and 1 contrived sample). The final validity rate was 99.8% (95% CI, 99.5% to 99.9%). The ePlex RP panel detected a potential respiratory pathogen in 1,212 of 2,462 prospectively collected NPS specimens tested, for a positivity rate of 49%. The PPAs and NPAs with 95% CIs of the ePlex RP panel targets with comparator methods are provided in Tables 2 to 4 separately for retrospectively collected samples and prospectively collected samples and with all samples combined. Additional data for fresh and frozen prospectively collected samples are presented in Table S3 in the supplemental material. The overall percent agreement between the ePlex RP and BioFire RP results was Ͼ95% for all targets tested. target but positive for either the 2009 H1 (n ϭ 5) or H3 (n ϭ 1) subtype, and 9 samples were positive for the influenza A virus target without a subtype being identified. Of note, influenza A H1 virus was not detected, and very few Chlamydia pneumoniae (n ϭ 4) isolates were detected during the study period. For these targets, at least 50 specimens with the pathogen spiked into negative NPS specimens were contrived; all were detected by ePlex RP (data not shown). Discordance resolution results (Table 5 ) demonstrate that while ePlex RP had a high level of agreement with the BioFire RP and detected the same targets in nearly all samples, each assay detected targets that the other did not. In Table 5 , samples with targets that were detected by ePlex RP but not detected by BioFire RP (FP) are counted as true-positive samples if the target was detected by discordance testing (TPd). Samples with targets not detected by ePlex RP but detected by the BioFire RP (FN) are counted as true-negative samples if the target was not detected by discordance testing (TNd). Given the number of discordant samples between the two panels for coronavirus detection, additional repeat testing by both the BioFire RP and ePlex RP was performed as part of the discordance analysis. This additional testing demonstrated evidence of Of the 2,462 prospectively collected samples, 164 had codetections by at least one of the assays (data not shown). The ePlex RP panel identified a total of 135 prospective samples with multiple pathogens detected, or 5.5% of all prospectively collected samples, while the BioFire RP detected a total of 116 samples with multiple pathogens, or 4.7% of all prospectively collected samples. Of the 135 samples with multiple pathogens detected by ePlex RP, 118 (4.8%) had two pathogens, 14 (0.6%) had three pathogens, and 3 (0.1%) had four pathogens detected. Of the 135 samples with codetections, 57 samples (2.3%) included one or more pathogens that were not detected by the BioFire RP method. The comparator method identified a total of 32 (1.3%) codetections with one or more pathogens not identified by the ePlex RP panel. Discordance resolution results are included in the analysis presented in Table 5 . (ii) Reproducibility. Each of 3 sites performing the reproducibility study collected 35 to 36 results for each target at each concentration, for a total of 107 to 108 samples per site. For the moderately positive and the negative panels, the percent agreement was 100% (95% CI, 96.6% to 100%) for all 7 panel targets. For the low-positive panel, the percent agreement was 100% (95% CI, 96.5% to 100%) for 6 of the 7 panel targets. For the remaining adenovirus panel target, the percent agreement in the low-positive panel was 91.6% (95% CI, 84.8% to 95.5%). Agreement results are shown in Table 6 . A total of 315/324 (97.2%) samples yielded a valid result upon initial testing. Upon repeat testing, all but one specimen yielded a valid result, for a final validity rate of 99.7% (95% CI: 98.3% to 99.9%). No significant sources of variability were found for any of the targets on the panel across cartridge lots, operation days, technologists/operators, or sites (data not shown). Workflow and turnaround time study. The time to identification from receipt to result was determined to be 1 h 45 min and 57 s, with hands-on times (HOTs) per sample of 1 min and 35 s. In this multicenter clinical study, the performance characteristics of the new ePlex Respiratory Pathogen panel on the GenMark ePlex instrument were estimated by measuring agreement with the results of the BioFire RP, a commercially available multiplex respiratory panel. The ePlex RP panel was recently FDA cleared and expands the available options for laboratories interested in the rapid diagnosis of respiratory tract infections using broadly multiplexed molecular assay on NPS specimens. Similar to the BioFire RP, ePlex RP offers a large panel of both viral and bacterial respiratory pathogens in a simple, sample-to-answer format with minimal hands-on time and a rapid turnaround time to results. As with all molecular diagnostic test methods, both the BioFire RP and ePlex RP have the potential to generate false-positive and false-negative results, as confirmed in this study by additional testing with target-specific PCRs with bidirectional sequencing. The unavailability of an established gold standard prevents a true measure of correctness, requiring the use of agreement measures with a nonreference standard instead to establish the performance characteristics of a new test (13) . Thus, data presented in this study reflect only the agreement between the results of the two platforms. In spite of these limitations, the overall performance of ePlex RP was comparable to that of the BioFire RP, with an overall percent agreement (true-positive and true-negative results) of Ͼ95% for all available targets tested. In line with our results, a recent study by Nijhuis and colleagues evaluating the performance of the ePlex research-use-only (RUO) RP panel compared to laboratory-developed assays found an overall agreement of 97.4%, with discordant results occurring primarily for samples with low pathogen loads, as estimated by using cycle threshold (C T ) values (i.e., high C T value, Ͼ35) (10). The highest numbers of discordant results were observed for adenovirus, coronavirus, and rhinovirus/enterovirus targets. This finding may be explained by the large diversity of genotypes present within each of these groups of pathogens or the prevalence of these pathogens in the population tested. For adenovirus, the performance of diagnostic tests is particularly important for young children and immuno- compromised hosts. However, the detection of adenovirus can be challenging. In this study, ePlex RP detected more adenoviruses than did the BioFire RP. A recent report on the performance of BioFire RP v1.7 for the detection of adenovirus highlighted the decreased sensitivity of the assay for samples with low viral loads or those positive for species A, D, and F (14) . Although the ePlex RP panel detects 4 genotypes of coronaviruses (HKU1, OC43, 229E, and NL63), results are reported without the genotyping information. There are currently no treatments for coronaviruses, and the utility of the genotyping information may lie in its value for epidemiological studies. Reports of severe coronavirus infections have been reported for immunocompromised hosts, but there has not been any indication that severity is associated with a particular genotype (15) . Similar to the BioFire RP, ePlex RP detects a wide range of rhinovirus and enteroviruses genotypes, but given their high degree of genetic similarity, it does not reliably differentiate between these two species. Based on discordance analysis performed by PCR and bidirectional sequencing, most samples were positive for rhinovirus, a trend that is expected given that rhinoviruses are the most common cause of the common cold (16) . The overall agreement for influenza viruses was high. As the prospective collection periods for this clinical study occurred during the 2013 and 2016 respiratory seasons, there was an expected lack of clinical specimens positive for influenza A H1 virus (17) . Most of the influenza virus infections during that time period were due to the 2009 H1 and H3 viruses. Hence, the evaluation of the influenza virus A H1 target was performed entirely by using contrived NPS samples. Similar to the BioFire RP results, instances of samples positive for influenza A virus without subtypes or positive for an influenza A virus subtype only were identified. Such results may be caused by low virus titers or a novel influenza virus subtype and thus require additional testing. Only a limited number of samples were positive for Chlamydia pneumoniae, and the evaluation was conducted primarily with contrived samples. The performance for C. pneumoniae was similar to that reported in the BioFire RP clinical study, which was also conducted by using primarily contrived samples (12) . Both Chlamydia pneumoniae and Mycoplasma pneumoniae are associated with atypical, community-acquired pneumonia (CAP), with no seasonality and nonspecific symptoms (18) . Therefore, the inclusion of both bacteria in large multiplex panels has the potential to significantly improve the diagnosis of CAP. A notable difference between the ePlex RP panel and the BioFire RP is the absence of Bordetella pertussis-Bordetella parapertussis targets among the bacterial targets. It is noteworthy that unlike other bacterial targets on the panel, infection with Bordetella pertussis-B. parapertussis has a relatively specific epidemiology, with higher incidences typically being reported for children less than 2 months old and, more recently, for unvaccinated populations or vaccinated patients with waning immunity (19) . Thus, exclusion from a highly multiplexed respiratory panel may be warranted. In addition, the utilization of the single-copy pertussis toxin promoter target (ptxP) in some multiplex panels has been shown to be less sensitive for the detection of B. pertussis than PCR tests targeted to the multicopy IS481 insertion sequence (20) . As a result, when B. pertussis infection is suspected, an FDA-cleared B. pertussis molecular test may be more appropriate. Similar to other broadly multiplexed respiratory panels, the ePlex RP panel allows the detection of coinfections. In this study, coinfections were identified in 5.5% of samples, with human rhinovirus/enterovirus being the most common virus detected in coinfected specimens. The importance of detecting coinfections was highlighted in a recent study showing that viral-bacterial coinfection during severe CAP in adults resulted in a more complicated disease course and was associated with complications (21) . In other studies, human rhinoviruses were frequently detected in association with bacterial pathogens in a hematopoietic stem cell transplant population, suggesting that this commonly detected virus may be a significant cause of severe pneumonia in immunocompromised patients (22, 23) . The initial rate of invalid results with ePlex RP was 4.8%, with repeat testing resulting in a final rate of invalid results of 0.2%. This value falls in the range of rates of invalid results reported for other multiplexed respiratory panels, including Nanosphere Verigene RV (9.7%), xTAG RVP (1 to 2%), and the BioFire RP (1 to 3%) (24) (25) (26) (27) . The ePlex instrument consists of a stand-alone system, with no additional accessories (e.g., computer) and a touch screen, making it a great option for space-constrained laboratories. The ePlex instrument is available in configurations ranging from one to four towers, with each tower containing six random-access testing bays. This supports single-shift (8 h) testing volumes ranging from 24 samples to 96 samples, with a TAT of less than 2 h and an HOT of less than 2 min, providing a flexible capacity for laboratories of all sizes. Additional features available on the system include the ability to generate customized reports (e.g., statistical and trending reports) and the potential for a bidirectional interface with laboratory information systems. In conclusion, the ePlex RP panel provides a rapid, sensitive, broadly multiplexed, sample-to-results option with minimal hands-on time. The assay performance was equivalent to that of the BioFire FilmArray RP for all targets. This new, fully integrated instrument is easily expandable and offers a great option for the implementation of a multiplex assay in larger-volume laboratories. Supplemental material for this article may be found at https://doi.org/10.1128/JCM .01658-17. SUPPLEMENTAL FILE 1, PDF file, 0.1 MB. The global burden of respiratory disease Respiratory viruses other than influenza virus: impact and therapeutic advances Unnecessary antibiotics for acute respiratory tract infections: association with care setting and patient demographics The challenge of respiratory virus infections in hematopoietic cell transplant recipients The diagnosis of viral respiratory disease in older adults Severe respiratory viral infections: new evidence and changing paradigms Guideline for isolation precautions: preventing transmission of infectious agents in health care settings Multiplexed molecular diagnostics for respiratory, gastrointestinal, and central nervous system infections Comparison of ePlex respiratory pathogen panel with laboratory-developed real-time PCR assays for detection of respiratory pathogens Comparison of the GenMark Diagnostics eSensor respiratory viral panel to real-time PCR for detection of respiratory viruses in children FilmArray Respiratory Panel (RP): instruction booklet. Bio-Fire Statistical guidance on reporting results from studies evaluating diagnostic tests. Food and Drug Administration Performance characteristics of FilmArray Respiratory Panel v1.7 for detection of adenovirus in a large cohort of pediatric nasopharyngeal samples: one test may not fit all High incidence but low burden of coronaviruses and preferential associations between respiratory viruses Rhinoviruses and respiratory enteroviruses: not as simple as ABC Influenza activity-United States, 2015-16 season and composition of the 2016-17 influenza vaccine Mycoplasma pneumoniae and Chlamydia pneumoniae infections in children with pneumonia. Mowgli Study Group Pertussis: a reemerging infection Testing implications of varying targets for Bordetella pertussis: comparison of the FilmArray Respiratory Panel and the Focus B. pertussis PCR assay Viral-bacterial coinfection affects the presentation and alters the prognosis of severe community-acquired pneumonia Human rhinovirus infections of the lower respiratory tract in hematopoietic stem cell transplant recipients Human rhinovirus detection in the lower respiratory tract of hematopoietic cell transplant recipients: association with mortality Comparison of three commercial RT-PCR systems for the detection of respiratory viruses Multicenter clinical evaluation of the Luminex Aries Flu A/B & RSV assay for pediatric and adult respiratory tract specimens Comparison of the FilmArray Respiratory Panel and Prodesse real-time PCR assays for detection of respiratory pathogens Comparison of two multiplex methods for detection of respiratory viruses: FilmArray RP and xTAG RVP This study was designed and funded by GenMark Diagnostics. All authors have received research funding from GenMark Diagnostics for this study. This research was funded in part through NIH/NCI Cancer Center support grant P30 CA008748 to N.E.B. and Y.-W.T.We thank all the medical technologists and research staff across all the study sites for their important contribution to this work, with special thanks to Sam Kaplan, Tracy McMillen, and Janet Sun. We thank GenMark employees (Jennifer Reid, Astrid Schroeder, Deirdre Trainor, and Adam Thornberg) for their contribution to Materials and Methods in the manuscript.All other authors edited the manuscript and provided input on the data presented.