About the Author(s)


Howard Newman Email symbol
National Health Laboratory Service, Virology, Port Elizabeth, South Africa

Department of Pathology, Division of Medical Virology, Stellenbosch University, Cape Town, South Africa

Faculty of Health Sciences, Nelson Mandela University, Port Elizabeth, South Africa

Donald Tshabalala symbol
Department of Paediatrics, Nelson Mandela Academic Hospital, Mthatha, South Africa

Department of Paediatrics, Walter Sisulu University, Mthatha, South Africa

Sikhumbuzo Mabunda symbol
Department of Public Health, Walter Sisulu University, Mthatha, South Africa

Mpumalanga Department of Health, Nelspruit, South Africa

Nokwazi Nkosi symbol
Department of Pathology, Division of Medical Virology, Stellenbosch University, Cape Town, South Africa

National Health Laboratory Service, Tygerberg Academic Hospital, Cape Town, South Africa

Candice Carelson symbol
National Health Laboratory Service, Virology, Port Elizabeth, South Africa

Citation


Newman H, Tshabalala D, Mabunda S, et al. Rapid testing for respiratory syncytial virus in a resource-limited paediatric intensive care setting. Afr J Lab Med. 2020;9(1), a1084. https://doi.org/10.4102/ajlm.v9i1.1084

Brief Report

Rapid testing for respiratory syncytial virus in a resource-limited paediatric intensive care setting

Howard Newman, Donald Tshabalala, Sikhumbuzo Mabunda, Nokwazi Nkosi, Candice Carelson

Received: 27 Aug. 2019; Accepted: 12 Aug. 2020; Published: 08 Dec. 2020

Copyright: © 2020. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

We analysed the performance characteristics of the respiratory syncytial virus lateral flow rapid antigen assay in use when compared to a multiplex polymerase chain reaction for detection of respiratory viruses. The study was conducted at a tertiary paediatric hospital in Port Elizabeth, South Africa, from 01 January 2017 to 31 December 2018. We found the clinical sensitivity (36.8%) of the rapid test to be too low for routine diagnostic use. Knowledge of assay performance characteristics of rapid tests are important for appropriate interpretation of rapid test results.

Keywords: respiratory syncytial virus; rapid antigen tests; respiratory viruses; respiratory multiplex polymerase chain reaction; assay performance characteristics.

Introduction

Respiratory syncytial virus (RSV) infection is a common cause of casualty visits and hospital admissions in infants.1,2,3,4 In 2005, a meta-analysis reported that between 66 000 and 160 000 children under age 5 years died of RSV infection worldwide.4

During the South African RSV season, 50% – 60% of all respiratory admissions in children are due to RSV.5 Data from the 2016 pneumonia surveillance programme in South Africa showed that 17% of enrolled patients tested positive for RSV, with a case fatality rate of less than 1%.6

RSV is highly contagious and numerous hospital outbreaks have been reported in multiple age groups,7 thus necessitating appropriate infection prevention and control measures. For timeous initiation of appropriate infection prevention and control measures, rapid laboratory confirmation of RSV is essential.

Options for laboratory testing include virus isolation, rapid antigen tests, direct fluorescent antibody tests and molecular methods such as polymerase chain reaction (PCR).8,9 Rapid assays utilising antigen capture technology, that can be performed in less than 30 min, are available.10 Numerous commercial assays exist, ranging in sensitivity from approximately 50% to 96% in children, while the majority of assays have specificity above 97%.1,11,12,13,14,15,16 The sensitivity of rapid antigen assays for RSV is affected by several factors; decreased sensitivity was noted in patients with a prolonged duration of symptoms at the time of testing, infection with subtype B, and older age.13,14,15,16

Nucleic acid amplification tests have been shown to be superior to classical methods such as virus isolation and direct fluorescent antibody testing.17,18 Not only is PCR more sensitive and specific than conventional methods, but it is also more amenable to ‘multiplexing’, thus allowing for the simultaneous detection of a panel of common respiratory viruses.19 One limitation of molecular testing is its potentially prohibitive cost. This is of particular concern in resource-limited settings. In addition, the laboratory turn-around time may not be rapid enough to aid clinical decision making, especially when samples have to be referred to distant laboratories.20

The commercial rapid antigen RSV assay used in the virology laboratory of the National Health Laboratory Service in Port Elizabeth, South Africa, is the RSV Respi-Strip by Coris BioConcept (Gembloux, Belgium). It has a reported sensitivity of approximately 80%, with a specificity of greater than 95%.16 When compared to direct fluorescent antibody tests, the RSV Respi-Strip was found to be 92% sensitive and 98% specific.21 If the reported sensitivity of the assay of 80% is accurate, while not ideal, this may still be a clinically useful test in resource-limited settings, since positive cases would be detected 80% of the time, allowing for patient cohorting and isolation, and thereby limiting nosocomial transmission.7

For respiratory multiplex PCR testing, the virology laboratory in Port Elizabeth refers specimens to another National Health Laboratory Service virology laboratory at Tygerberg Hospital in Cape Town, South Africa. This laboratory makes use of the Seeplex® RV16 assay by Seegene (Seoul, South Korea). The sensitivity and specificity for the individual viruses varies. For RSV, the sensitivity and specificity is reported to be above 90% when compared with singleplex or duplex PCR.17

Since patients admitted to our paediatric intensive care unit (ICU) for suspected lower respiratory tract infection are all tested for RSV with a rapid antigen assay, in addition to testing for a panel of common respiratory viruses (including RSV subtypes A and B) by PCR, we compared the two assays to determine the sensitivity and specificity of the RSV Respi-Strip assay. We additionally sought to describe the common respiratory viruses detected in our ICU setting.

Methods

Ethical considerations

This study received ethical clearance from the Human Research Committee of the Faculty of Health Sciences, Walter Sisulu University (reference 043/2018).

Study design

This was a descriptive, retrospective cross-sectional study analysing laboratory reports for RSV rapid antigen and multiplex PCR tests for respiratory viruses. Results from the RSV rapid antigen assay were compared to results from the multiplex PCR assay, thus allowing for the calculation of performance characteristics of the rapid antigen assay. Factors associated with false-negative RSV rapid antigen results were analysed.

Sample selection

The study population comprised all paediatric patients admitted to ICU at Dora Nginza Hospital in Port Elizabeth, Eastern Cape Province, South Africa, who had respiratory samples taken for laboratory investigation of viral infections from 1 January 2017 to 31 December 2018. Rapid testing for RSV is performed locally by the virology laboratory of the National Health Laboratory Service in Port Elizabeth, South Africa, with the nasopharyngeal aspirates being the specimen matrix. In addition, remnant specimen is referred to another virology laboratory (Cape Town, South Africa) within the National Health Laboratory Service, for multiplex PCR. This allowed for retrospective analysis of laboratory data.

Data analysis

All variables were captured and coded in Microsoft Excel 2013 (Microsoft Corporation, Seattle, Washington, United States) and exported to Stata 14.1 for analysis (Stata Corp LP, College Station, Texas, United States). The distribution of age in days (numerical variable) was explored using the Shapiro Wilk test, and age was further converted into a categorical variable in months.

Clinical sensitivity and specificity of the RSV Respi-Strip rapid antigen assay was calculated by comparison against the multiplex PCR (Seeplex® RV16).

Categorical variables are presented using frequency tables, percentages and graphs. Bivariate logistic regression models were used to determine associations of false RSV rapid antigen results with risk factors such as age, sex, HIV co-infection, RSV subtype, and co-infections with other viruses or bacteria. The odds ratio was the relative measure of association used. The 95% confidence interval was used to estimate the precision of estimates. The level of statistical significance was set at 5% (p-value ≤ 0.05).

Results

Test reports from a total of 152 participants were obtained and included in the study. Eighty-one of the participants (53.3%) were female, and 121 were under the age of one year. Table 1 shows all the demographic characteristics considered during this study.

TABLE 1: Demographic characteristics of the study population from Dora Nginza Hospital, Port Elizabeth, South Africa, 2017–2018.

Results from the multiplex PCR assay show that rhinovirus was the most common virus detected (n = 55), followed by adenovirus (n = 30), RSV (n = 19) and enterovirus (n = 17), with the remainder of the viruses occurring less commonly (Figure 1). Respiratory syncytial virus subtype A was detected much more frequently than subtype B.

FIGURE 1: Prevalence of the various respiratory viruses detected in paediatric patients from Dora Nginza Hospital, Port Elizabeth, South Africa, 2017–2018.

When comparing the RSV rapid antigen assay to the multiplex PCR assay, the former was found to be 36.8% sensitive (Table 2).

TABLE 2: Retrospective analysis of laboratory data from Doran Nginza Hospital, Port Elizabeth, South Africa, 2017–2018.

When analysing factors associated with false-negative RSV rapid antigen results, only viral–viral co-infection and infection with RSV subtype A were statistically significant associations (Table 3).

TABLE 3: Factors associated with false-negative respiratory syncytial virus rapid antigen results from paediatric patients at Dora Nginza Hospital, Port Elizabeth, South Africa, 2017–2018.

Discussion

To the best of our knowledge, this is the first study comparing a RSV rapid antigen assay to a multiplex PCR assay that includes RSV as a target. In addition, it is also the first study to report on the prevalence of the common respiratory viruses found in our local paediatric ICU. We found the clinical sensitivity of the RSV rapid antigen assay (RSV Respi-Strip by Coris BioConcept) to be 36.84%; rhinovirus was the most commonly detected virus on the respiratory multiplex PCR assay. Although the majority of respiratory admissions worldwide are due to RSV,5 the most common viruses detected in our setting were rhinovirus (n = 55) and adenovirus (n = 30), followed by RSV (n = 19) and enterovirus (n = 17).

The main aim of this study was to determine the performance characteristics of the RSV rapid antigen assay in use (RSV Respi-Strip) by comparison to the respiratory multiplex PCR assay (Seeplex® RV16 assay), which includes RSV as a target. The sensitivity of the RSV rapid antigen assay was found to be 36.84% (confidence interval: 16.29% – 61.64%). Even at the upper end of the confidence interval, this sensitivity is too low for routine diagnostic use. While the specificity of above 90% may be sufficient for a rapid antigen assay, the low sensitivity would have resulted in many cases being undiagnosed, thus defeating the main purpose of using a rapid test, which is to allow for early institution of infection prevention and control measures to mitigate against the well-known nosocomial outbreak risk.7 Potential reasons for the discrepancy in performance of this rapid test in our setting compared to the manufacturer’s claims are manifold. Rapid antigen assays are generally less sensitive than PCR. This can be compounded by low viral loads in the clinical samples, as may be the case with upper respiratory tract infections only. It was beyond the scope of this study to differentiate patients based on severity of disease. The relatively small sample size may also account for the discrepancy in clinical sensitivity.

The bivariate logistic regression analysis revealed a statistically significant association between false-negative RSV rapid antigen tests and viral co-infection, and infection with RSV subtype A. In contrast, a previous study showed that infection with RSV subtype B was associated with decreased sensitivity of rapid antigen assays.15

Cytomegalovirus and HIV positivity were more likely to be associated with false RSV rapid antigen results, as well as more likely to be associated with false-negative results specifically. Neither of these associations was statistically significant.

Limitations

The main limitation of this study is the small sample size as a result of resource constraints, resulting in wider-than-ideal confidence intervals in the calculation of clinical sensitivity of the RSV rapid antigen test. However, even at the upper limit of the confidence intervals, the main conclusion that the sensitivity and positive predictive value are not acceptable for routine diagnostic use, still holds.

Conclusion

This study highlights the importance of ongoing monitoring of newly introduced assays, as verification experiments may not always determine whether an assay will perform optimally in real-world conditions. Based on the results of this study, the RSV rapid antigen assay in use (RSV Respi-Strip) was discontinued due to an unacceptably high rate of false results.

In conclusion, we have demonstrated the common respiratory viruses found in our local paediatric ICU setting. In addition, we report on the poor performance of the RSV rapid antigen assay in use and the potential factors associated with false results, with only viral co-infections and infection with RSV subtype A being statistically significant.

Clinicians should have an idea of the sensitivity and specificity of the rapid tests in use to allow for the appropriate interpretation of results.

Acknowledgements

We would like to express our gratitude to all the staff at the Virology Laboratory of the National Health Laboratory Service, Port Elizabeth, South Africa, who assisted in collection of data.

Competing interests

The authors have declared that no competing interests exist.

Authors’ contributions

H.N. initiated the study. D.T., S.M., N.N. and C.C. assisted in producing the protocol. D.T. oversaw the ethics application. C.C. and H.N. handled the data collection. S.M. performed the data analysis. H.N., D.T., S.M., N.N. and C.C. wrote and revised the manuscript.

Sources of support

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Data availability statement

Data sharing is not applicable to this article as no new data were created or analysed in this study.

Disclaimer

The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.

References

  1. Chartrand C, Tremblay N, Renaud C, Papenburg J. Diagnostic accuracy of rapid antigen detection tests for respiratory syncytial virus infection: Systematic review and meta-analysis. J Clin Microbiol. 2015;53(12):3738–3749. https://doi.org/10.1128/JCM.01816-15
  2. Green RJ, Zar HJ, Jeena PM, Madhi SA, Lewis H. South African guideline for the diagnosis, management and prevention of acute viral bronchiolitis in children. S Afr Med J. 2010;100(5):320–325. https://doi.org/10.7196/SAMJ.4016
  3. Madhi SA, Cutland CL, Downs S, et al. Burden of respiratory syncytial virus infection in South African human immunodeficiency virus (HIV)-infected and HIV-uninfected pregnant and postpartum women: A longitudinal cohort study. Clin Infect Dis. 2018;66(11):1658–1665. https://doi.org/10.1093/cid/cix1088
  4. Nair H, Nokes DJ, Gessner BD, et al. Global burden of acute lower respiratory infections due to respiratory syncytial virus in young children: A systematic review and meta-analysis. Lancet. 2010;375(9725):1545–1555. https://doi.org/10.1016/S0140-6736(10)60206-1
  5. Moyes J, Cohen C, Pretorius M, et al. Epidemiology of respiratory syncytial virus-associated acute lower respiratory tract infection hospitalizations among HIV-infected and HIV-uninfected South African children, 2010–2011. J Infect Dis. 2013;208(Suppl. 3):S217–S226. https://doi.org/10.1093/infdis/jit479
  6. Walaza S, Cohen C, Treurnicht F, et al. Epidemiology of respiratory pathogens from influenza-like illness and pneumonia surveillance programmes, South Africa, 2016. Commun Dis Surveill Bull NICD. 2017;15(1):9–25.
  7. French CE, McKenzie BC, Coope C, et al. Risk of nosocomial respiratory syncytial virus infection and effectiveness of control measures to prevent transmission events: A systematic review. Influ Other Respir Viruses. 2016;10(4):268–290. https://doi.org/10.1111/irv.12379
  8. Ahluwalia G, Embree J, McNicol P, Law B, Hammond GW. Comparison of nasopharyngeal aspirate and nasopharyngeal swab specimens for respiratory syncytial virus diagnosis by cell culture, indirect immunofluorescence assay, and enzyme-linked immunosorbent assay. J Clin Microbiol. 1987;25(5):763–767. https://doi.org/10.1128/JCM.25.5.763-767.1987
  9. Griffiths C, Drews SJ, Marchant DJ. Respiratory syncytial virus: Infection, detection, and new options for prevention and treatment. Clin Microbiol Rev. 2017;30(1):277–319. https://doi.org/10.1128/CMR.00010-16
  10. Aslanzadeh J, Zheng X, Li H, et al. Prospective evaluation of rapid antigen tests for diagnosis of respiratory syncytial virus and human metapneumovirus infections. J Clin Microbiol. 2008;46(5):1682–1685. https://doi.org/10.1128/JCM.00008-08
  11. Leonardi GP, Wilson AM, Dauz M, Zuretti AR. Evaluation of respiratory syncytial virus (RSV) direct antigen detection assays for use in point-of-care testing. J Virol Methods. 2015;213:131–134. https://doi.org/10.1016/j.jviromet.2014.11.016
  12. Cruz AT, Cazacu AC, Greer JM, Demmler GJ. Performance of a rapid assay (Binax NOW) for detection of respiratory syncytial virus at a children’s hospital over a 3-year period. J Clin Microbiol. 2007;45(6):1993–1995. https://doi.org/10.1128/JCM.00279-07
  13. Miernyk K, Bulkow L, DeByle C, et al. Performance of a rapid antigen test (Binax NOW® RSV) for diagnosis of respiratory syncytial virus compared with real-time polymerase chain reaction in a pediatric population. J Clin Virol. 2011;50(3):240–243. https://doi.org/10.1016/j.jcv.2010.11.011
  14. Schauer U, Ihorst G, Rohwedder A, et al. Evaluation of respiratory syncytial virus detection by rapid antigen tests in childhood. Klin Padiatr. 2007;219(4):212–216. https://doi.org/10.1055/s-2006-933530
  15. Papenburg J, Buckeridge DL, De Serres G, Boivin G. Host and viral factors affecting clinical performance of a rapid diagnostic test for respiratory syncytial virus in hospitalized children. J Pediatr. 2013;163(3):911–913. https://doi.org/10.1016/j.jpeds.2013.03.067
  16. Blyth CC, Booy R, Dwyer DE. Point of care testing: Diagnosis outside the virology laboratory. In: Stephenson JR, Warnes A, editors. Diagnostic virology protocols. Methods in molecular biology, Vol. 665. New Jersey: Humana Press, 2011; pp. 415–433. https://doi.org/10.1007/978-1-60761-817-1
  17. Pillet S, Lardeux M, Dina J, et al. Comparative evaluation of six commercialized multiplex PCR kits for the diagnosis of respiratory infections. PLoS One. 2013;8(8):e72174. https://doi.org/10.1371/journal.pone.0072174
  18. Gharabaghi F, Hawan A, Drews SJ, Richardson SE. Evaluation of multiple commercial molecular and conventional diagnostic assays for the detection of respiratory viruses in children. Clin Microbiol Infect. 2011;17(12):1900–1906. https://doi.org/10.1111/j.1469-0691.2011.03529.x
  19. Somerville LK, Ratnamohan VM, Dwyer DE, Kok J. Molecular diagnosis of respiratory viruses. Pathology. 2015;47(3):243–249. https://doi.org/10.1097/PAT.0000000000000240
  20. Mills JM, Harper J, Broomfield D, Templeton KE. Rapid testing for respiratory syncytial virus in a paediatric emergency department: Benefits for infection control and bed management. J Hosp Infect. 2011;77(3):248–251. https://doi.org/10.1016/j.jhin.2010.11.019
  21. Gregson D, Lloyd T, Buchan S, Church D. Comparison of the RSV respi-strip with direct fluorescent-antigen detection for diagnosis of respiratory syncytial virus infection in pediatric patients. J Clin Microbiol. 2005;43(11):5782–5783. https://doi.org/10.1128/JCM.43.11.5782-5783.2005