key: cord-0745742-p6f62dmb
authors: Henrickson, K. J.; Kraft, A. J.; Canter, D.; Shaw, J.
title: Comparison of electronic microarray to enzyme hybridization assay for multiplex reverse-transcriptase PCR detection of common respiratory viruses in children
date: 2007-08-01
journal: Clinical Microbiology Newsletter
DOI: 10.1016/j.clinmicnews.2007.07.001
sha: f5cbe68a40f6a8ffdb173b0aa8d0bc5ac47577e8
doc_id: 745742
cord_uid: p6f62dmb

Abstract A new assay, composed of the NGEN RVA (Nanogen, Inc., San Diego, CA; Prodesse, Inc., Waukesha, WI), which is a pair of analyte-specific reagents that allow the multiplex reverse transcriptase polymerase chain reaction (RT-PCR) and electronic microarray detection of influenza virus A and B, respiratory syncytial virus A and B, and human parainfluenza virus types 1, 2, and 3, was evaluated in comparison with the Hexaplex (Prodesse), a multiplex RT-PCR–enzyme hybridization assay. Comparisons included the detection of respiratory viruses from whole-virus stocks (ATCC) and from frozen pediatric respiratory specimens collected at Children's Hospital of Wisconsin between 1991 and October 1998. After the retesting of six indeterminants and 20 discrepants, overall agreement improved to 96% on the positives and 100% on negatives, with only eight specimens still discrepant. The RVA reagents allow a rapid, sensitive, and specific assay for detecting seven of the most common respiratory viruses in children.

Many microbial agents cause upper and lower respiratory infections (LRI) (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16) (17) (18) , including a growing list of viruses. However, the majority of identified causes of LRI in children and viral LRI in adults are caused by 8 to 10 viruses. The seven most common viruses are: influenza virus A and B, respiratory syncytial virus (RSV) A and B, and human parainfluenza virus (HPIV) types 1, 2, and 3 (8, 9, 15, 17) . Human metapneumovirus (A and B), adenoviruses (51 serotypes, subspecies A to F), human coronaviruses (229E, OC43, NL63, and others), and rhinoviruses (>100 serotypes) also cause LRI in children and adults, but their exact proportion of illness is still being determined (9) (10) (11) (12) (13) (15) (16) (17) (18) (19) .

Molecular detection of common community-acquired respiratory viruses has been widely accepted as the "gold standard" in terms of sensitivity and specificity compared to cell culture and rapid antigen methods (4, 8, 13, 15, (18) (19) (20) (21) (22) (23) (24) (25) (26) (27) (28) (29) (30) (31) . One of the barriers to acceptance of molecular tests has been their high costs, in terms of both reagents and technician time. In addition, LRI caused by these different respiratory viruses cannot be differentiated reliably by clinical examination (1) (2) (3) (4) 8, 9, 15, 32, 33) . Multiplex RT-PCR-enzyme hybridization assay (EHA) detection of the seven most common respiratory viruses (Hexaplex; Prodesse, Inc., Waukesha, WI) has been used widely for accurate, rapid, and cost-effective diagnosis of hospitalized children, adults, and immunocompromised patients (8, 15, (20) (21) (22) (23) (24) (25) (26) (27) .

Analyte-specific reagents (ASRs) are reagents that laboratories can use to develop and validate their own assays. We used the NGEN RVA ASRs (Nanogen, Inc., San Diego, CA) and an electronic microarray (NanoChip 400) as an assay method in our laboratory to detect and differentiate the amplified products from the same primer sequences in the field-tested multiplex RT-PCR primer mixture used in the Hexaplex assay. This microarray detection platform may offer advantages to midand high-throughput laboratories by decreasing technician time and overall assay time. We compared the RVA chip (and NanoChip 400 machine) to EHA as detection methods for multiplex RT-PCR in the detection of influenza virus A and B, RSV A and B, and HPIV-1, -2, and -3.

Respiratory specimens were collected from patients admitted to Children's Hospital of Wisconsin from 1991 through October 1998 and have been described previously (8, 20, 33, 34) . Cell culture, enzyme immunosorbent assay, direct-immunofluorescence assay, and Hexaplex testing for respiratory viruses were previously carried out and have been partially reported (8, 20, 33) .

Two-step RT-PCR was carried out following the manufacturer's directions (Prodesse). The cDNA product of this reaction was split and used in two separate multiplex PCRs. One reaction used the Hexaplex "supermix" for the assay, while the other used a similar RVA primer mix with the 3' primers lacking biotinylation.

Following amplification, 50 µl of material (amplified with Hexaplex supermix) underwent post-PCR purification using the QIAquick DNA purification kit (Qiagen, Chatsworth, CA) (23). Following purification, 5 µl of amplified material was used in an EHA using 96-well neutravidin-coated microtiter plates.

Following amplification, 9 µl of the amplified material was diluted in 63 µl of CAP down sample buffer A and placed on the NanoChip 400 instrument; no post-PCR processing (desalting or denaturing) was required. The automated detection of the respiratory viruses was carried out on the NanoChip electronic microarray in three distinct steps, which are depicted in Fig. 1 .

Serial dilutions of ATCC strains of the seven respiratory viruses were tested in both the Hexaplex and RVA assays to determine the limits of detection (LOD) using whole virus ( Table 1) . The Hexaplex demonstrated better overall analytical sensitivity for virus detection than the RVA. The two assays were within 1 log unit of each other for five of the seven viruses. The assays appeared equal at 10 -2 50% tissue culture infective dose (TCID 50 )/ml for HPIV-2, while the RVA assay was more sensitive for influenza virus B at 10 -1 TCID 50 /ml compared to 10 0 for the Hexaplex. The Capture oligonucleotides are electronically deposited on four pads. On a fifth pad, an unrelated capture oligonucleotide is deposited (to be used for background subtraction).

Discriminators and reporters are allowed to passively hybridize.

Amplicon is electronically addressed to all five pads simultaneously.

Following several washes, the cartridge is scanned. biggest difference in analytical sensitivity was observed with HPIV-3, where the Hexaplex was 3 log units more sensitive.

A total of 424 respiratory specimens (212 patients) were tested, with nasopharyngeal swab specimens (312 samples) accounting for 73%. Other specimens tested included 16 bronchoalveolar lavage, 6 tracheal, 4 sputum, 4 throat, 9 nasal wash, and 17 miscellaneous respiratory samples. There were 169 samples that tested positive by both assays and 20 samples that were positive by only one assay. There were 113 samples originally reported to be positive by Hexaplex that were negative by both Hexaplex and RVA on retesting, and these were called negative. They were presumed to be low-copy-number samples where the RNA had degraded over time. Three samples that were previously negative by Hexaplex and upon retesting were positive by Hexaplex and negative by RVA were defined as negatives (false positives on Hexaplex). Finally, four samples that were previously positive for one virus by Hexaplex were positive on retesting for a different virus by Hexaplex and were negative by RVA. These samples were not evaluated further and were not included in the calculations.

The agreement between the Hexaplex and RVA can be seen in Table 2 . Overall agreement was high (90%; 95% confidence interval [CI], 85-94) and was nearly 100% for the negative samples.

The lowest agreement was 69% for HPIV-2-positive samples. This did not correlate with the analytical sensitivity ( ). Repeat testing of the amplified PCR product because of positive control failure on one run resulted in three RVA negative samples being determined to be two positives and one indeterminate for HPIV-2. Out of 2,520 analytes tested with the RVA, there were 5 indeterminants (0.2%) and 1 indeterminant Hexaplex out of 2,940 (0.03%) tested. Repeat testing of these samples demonstrated 3 out of 5 RVA indeterminants and the one Hexaplex indeterminant were positive (Tables 2  and 3 ). An influenza virus B RVA indeterminate became discrepant and went from 2.3 to 2.0 signal-to-noise (SN) ratio, and an HPIV-2 sample went from 2.3 to 1.8 SN ratio on retesting, while the Hexaplex results remained positive and went from optical density (OD) readings of 1.2 to 1.6 and 1.6 to 0.9, respectively. The RSV Hexaplexindeterminate sample was positive on Hexaplex retesting, while the RVA result remained negative. Thus, retesting of the indeterminants resulted in three new discrepants, which were not further tested. There were 20 samples with originally discrepant results (18 negative RVA; 2 negative Hexaplex). However, on repeat amplification of frozen RNA from each sample using either the standard Hexaplex primer mix or the RVA primer mix, one sample was resolved to be a Hexaplex false positive, 13 of the remaining 19 were now positive, 1 was indeterminate, and 5 were negative. Of the 13 positives, 2 were now positive on Hexaplex and 11 on RVA. Three (9%) out of 33 experimental runs of the RVA assay accounted for 12 of 18 (67%) RVA discrepants, suggesting a specific technical error, not a pervasive one. After repeat testing, 12 of 18 RVA false negatives and 2 of 2 of the Hexaplex false negatives were resolved. No further analysis was done on the remaining five unresolved discrepant results because of their low number. Testing of reagents and machinery did not elucidate the reason for the above-mentioned technical error. The agreement between the two assays is shown in Table 3 after retesting (discrepant analysis). Now the agreement between the two assays on all seven viruses was very high (96% [95% CI, 92-98] and 100% [95% CI, 99-100]).

Comparison of the number of hours of technician time and reagents needed to test 6, 14, and 30 clinical samples, including 2 positive controls (i.e., 8, 16, and 32 samples), in the two multiplex RT-PCR assays (Hexaplex [EHA] and RVA) is shown in Table 4 . Costs for RNA isolation were kept the same for the two assays (manual spin columns), and all reagent costs were the same, except for the detection chemistry. The cost of equipment is not included (e.g., NanoChip 400). Although automated extraction would save considerably on technician time, it adds to start-up costs and reagent costs. The costs for automated NA extraction (not including the extractor) was estimated for each assay.

The Hexaplex assay was slightly less expensive over all three sample number scenarios. This difference was small, if manufacturer's retail costs were used for all reagents. The costs ranged from $7 to 9 per analyte tested for both the EHA and electronic microarray formats. As the number of samples increased, the cost decreased by a small amount for both detection methods. However, the RVA assay needed significantly less technician time than the Hexaplex. At higher sample numbers, this was almost half as much time (4.65 h versus 8 h). Estimates comparing manual extraction to automated extraction demonstrated significant reductions in technician time without significant decreases in cost to run the assays. The time to run each assay was cut in almost half, with the RVA assay being able to test 32 samples with only 1.45 h of technician time compared to 4.4 h for the Hexaplex. It is possible that at higher sample numbers (e.g., 80), the electronic microarray could demonstrate higher cost savings.

Common community-acquired respiratory viruses cause significant morbidity and mortality in all demographic subsets of our population. The groups at highest risk include preschool age children, the elderly, those with chronic diseases, and the immunocompromised (1-17,36-38). Rapid, accurate, inexpensive point-of-care testing that is able to The molecular diagnosis of viral respiratory infections has become commonplace and widely accepted in major medical centers (8, 9, 15, 18, 19, (24) (25) (26) (28) (29) (30) . This acceptance has been partly due to significant evidence of dramatic improvements in sensitivity compared to older methods. The majority of this is based on PCR and RT-PCR technology with different endpoint detection strategies (15, 23, 30, (47) (48) (49) (50) (51) (52) . Although other amplification methods have been explored (e.g., nucleic acid sequencebased amplification), none are widely used in clinical diagnostic laboratories for the detection of respiratory viruses at this time (29,50). Medium to large multiplex detection strategies for six or more pathogens have been reported, employing the EHA in 96-well plates using Hexaplex (23) , capillary electrophoresis (30), mass spectrometry (47), Luminex beads (48,52), flowthrough microarrays (49), and now, an electronic microarray. There are currently no FDAcleared molecular amplification methods for detecting the majority of common respiratory viruses, and all methods represent in-house-developed assays or ASRs. This technology only allows fairly expensive testing in medium to high complexity laboratories.

The Hexaplex assay, the first large multiplex clinical assay of its kind, was introduced almost a decade ago (8, 23) . This assay, targeting seven common respiratory viruses (influenza virus A and B, RSV A and B, HPIV-1, -2, and -3), has been widely used and has demonstrated excellent sensitivity and specificity, exceeding older methods (8, 15, (20) (21) (22) (23) (24) (25) (26) (27) . The Hexaplex uses EHA in 96-well plates for PCR product detection. This becomes more timeconsuming and costly as the number of clinical samples increases above 16 samples. One solution to this would be to automate the PCR product detection part of the assay. Nanogen has developed an electronic-microarray system capable of such automated multiplex PCR product detection (53). The microarray can be used to analyze 80 samples across 1 to 10 runs (data not shown). Prodesse and Nanogen co-developed reagents suitable for use on this platform.

This study was undertaken to demonstrate the agreement between multiplex RT-PCR-EHA (Hexaplex) and the RVA ASRs used with the NanoChip 400 system as an assay method in our laboratory in detecting seven common respiratory viruses in children. Other goals included demonstrating LOD using whole virus and comparing costs and work flows of both assays at different levels of utilization (e.g., high-volume laboratories).

The RVA demonstrated good overall LOD using ATCC organisms, but not as good as the standard Hexaplex. Typically, with single-primer-pair PCR assays, the LOD is 1 TCID 50 /ml or lower, and five of seven viruses demonstrated this on RVA. The overall agreement with firstpass testing (typical clinical laboratory testing) between the two assays was excellent at 90%, and the pattern of discrepant results suggests that it may be much higher (>96%) if the RVA reagents are used on a regular basis. This was best demonstrated by HPIV-3, where the biggest loss of analytical sensitivity was observed. This did not translate into decreased clinical sensitivity after three of the clinical runs were retested. After retesting, the agreement between the two assays went to 100%. The majority of discrepancy between the two assays was in the detection of HPIV-2. Interestingly, the RVA had good agreement in the analytical studies with the Hexaplex and very low LOD. There did appear to be a correlation between low-positive Hexaplex samples (OD ~1.00 or lower) and negative RVA readings (SN < 2.2), but there were too few samples like this and we were unable to do statistical analysis. At this time, it is unclear why for HPIV-2 the RVA ultimately only had 75% agreement with the Hexaplex, but further clinical testing may clarify this issue.

More importantly, agreement on the negatives was almost 100%. This lack of RVA false positives and subsequent high probability that any RVA positives are true positives allows high confidence in a clinical setting. It is unclear why the majority of discrepant RVA samples were in three experimental runs (not counting the HPIV-2 discrepants). The same lots of reagents were used in all runs, and no specific technical error in either the NanoChip 400 instrument or any of the other equipment could be identified. The same reagents and equipment were used to retest the samples that now yielded positive results. After the retesting, there were only 8 out of 420 samples still discrepant between the Hexaplex and the RVA, and 4 of them were HPIV-2.

The cost-benefit and time utilization study demonstrated that the Hexaplex was the least expensive assay to run, even with up to 32 samples per day. This did not change with automated extraction. In addition, there are higher start-up costs associated with the electronic-microarray detection. However, the RVA assay (automated detection) with or without automated extraction demonstrated significant technician time savings, and if the reagents become less expensive, this methodology would have a clear advantage in higher-volume laboratories. With the current pricing structure, whether "cost" or "technician time" is more important would help determine which assay would be most useful.

Clearly, until FDA-cleared pointof-care testing devices are available to detect large numbers of pathogens simultaneously with great speed, and accuracy and at low cost (final goal), we must use current technology for the greatest benefit of patients and society. This includes using in-house-developed tests and ASRs. Technological improvements by academia and industry in three major areas are important stepping stones en route to our final goal. These are (i) improved sample preparation methods (e.g., automation of nucleic acid extraction, miniaturization, and use of microfluidics), (ii) improved amplification methods (e.g., multiplex PCR, and microfluidic directed simultaneous multiple single-target amplification with post-PCR pooling of product prior to detection), and (iii) improved detection of amplified targets (e.g., automation of large multiplex detecting and reporting of results). Currently, PCR-based nucleic acid amplification technology is farthest down this road. However, that does not mean that other amplification methods or even proteomic solutions might not be developed in the future. To be most effective in the detection of respiratory viruses, these methods should use a small clinical sample (<500 µl) and be able to detect many pathogens from that same sample at a concentration of ≤1 TCID 50 / ml, with reporting times in a few hours.

In this paper, we report the first comparison of two "in-house" assays where the major difference was in their PCR product detection strategies (manual versus automated). Our Hexaplex and RVA "in-house" assays for seven common community-acquired respiratory viruses represent older and newer steps in improving laboratory diagnosis for mostly hospitalized or severely ill patients with LRI or illness caused by these viruses. The Hexaplex was less expensive for small to medium sample numbers and had slightly better analytical and clinical sensitivity. The RVA assay offered increasing cost savings as the number of clinical samples increased or in situations with limited technician time. This automated detection assay demonstrated a high level of agreement with the Hexaplex. The RVA assay needs to be further optimized and validated in clinical situations and with fresh specimens to better establish its performance characteristics, especially for the detection of HPIV-2. However, in this initial clinical trial, it performed very well. Further improvement in its analytical LOD for HPIV-3 may be clinically useful in samples with low copy numbers, as in elderly and immunocompromised patients. 

Acute lower respiratory infections in nonhospitallized children

The Tucson children's respiratory study. II. Lower respiratory tract illness in the first year of life

Viral pneumonia

Parainfluenza viruses

Weekly returns service report for 1998

Respiratory syncytial virus is an important cause of community-acquired lower respiratory infection among hospitalized adults

Community respiratory viral infections in the immunocompromised host. Proceedings of a symposium

National disease burden of respiratory viruses detected in children using PCR

Communityacquired pneumonia in adult and elderly populations

Human metapneumovirus in the community

Human metapneumovirus infections in young and elderly adults

SARS -looking back over the first 100 days

Adenovirus DNA in serum of children hospitalized due to an acute respiratory adenovirus infection

Twenty years of outpatient respiratory syncytial virus infection: a framework for vaccine efficacy trials

Superiority of reverse-transcription polymerase chain reaction to conventional viral culture in the diagnosis of acute respiratory tract infections in children

Rhinovirus and the lower respiratory tract

Incidence of community-acquired pneumonia requiring hospitalization. Results of a population-based active surveillance study in Ohio

Human metapneumovirus and lower respiratory tract disease in otherwise healthy infants and children

Croup is associated with the novel coronavirus NL63

Evaluation of the hexaplex assay for detection of respiratory viruses in children

Comparison of four clinical specimen types for detection of influenza A and B viruses by optical immunoassay (FLU OIA Test) and cell culture methods

Evaluation of the new Directigen Flu A and B membrane immunoassay for rapid diagnosis of influenza A and B infections. Presented at the Infectious Disease Society of

Rapid simultaneous diagnosis of infections with respiratory syncytial viruses A and B, influenza viruses A and B, and human parainfluenza virus types 1, 2, and 3 by multiplex quantitative reverse transcription-polymerase chain reaction-enzyme hybridization assay (Hexaplex)

Evaluation of the Prodesse Hexaplex multiplex PCR assay for direct detection of seven respiratory viruses in clinical specimens

Comparison of a multiplex reverse transcription-PCR-enzyme hybridization assay with conventional viral culture and immunofluorescence techniques for the detection of seven viral respiratory pathogens

Comparison of hexaplex (multiplex-RT-PCR) and tissue culture (TC) to detect common respiratory viruses in children in Germany during

Cost effective utilization of a Multiplex RT-PCR assay (Hexaplex ® ) for respiratory virus detection at a Children's Hospital. Presented at the 2nd International Symposium for Influenza and Other Respiratory Viruses

Comparison of an immunochromatography test with multiplex reverse transcription-PCR for rapid diagnosis of respiratory syncytial virus infections