key: cord-0799403-pmc7rtgu authors: Ginocchio, Christine C.; Garcia-Mondragon, Carolina; Mauerhofer, Barbara; Rindlisbacher, Cory title: Multinational evaluation of the BioFire® FilmArray® Pneumonia plus Panel as compared to standard of care testing date: 2021-03-02 journal: Eur J Clin Microbiol Infect Dis DOI: 10.1007/s10096-021-04195-5 sha: 989dca74359497e7284cc3ed075cd201f8f4498e doc_id: 799403 cord_uid: pmc7rtgu This study compared standard of care testing (SOC) to BioFire® FilmArray® Pneumonia plus Panel (PNplus). PNplus detects 15 bacteria with semiquantitative log bin values, 7 antibiotic resistance markers, three atypical bacteria (AB), and eight viral classes directly from bronchoalveolar lavage-like specimens (BLS) and sputum-like specimens (SLS). Fifty-two laboratories from 13 European countries and Israel tested 1234 BLS and 1242 SLS with PNplus and SOC. Detection rates and number of pathogens/samples were compared for PNplus pathogens. PNplus bin values and SOC quantities were compared. Three thousand two hundred sixty-two bacteria in PNplus were detected by PNplus and/or SOC. SOC detected 57.1% compared to 95.8% for PNplus (p ≤ 0.0001). PNplus semiquantitative bin values were less than SOC, equal to SOC, or greater than SOC in 5.1%, 25.4%, and 69.6% of results, respectively. PNplus bin values were on average ≥ 1 log than SOC values (58.5% 1–2 logs; 11.0% 3–4 logs). PNplus identified 98.2% of MRSA and SOC 55.6%. SOC detected 73/103 AB (70.9%) and 134/631 viruses (21.2%). PNplus detected 93/103 AB (90.3%) and 618/631 viruses (97.9%) (p ≤ 0.0001). PNplus and SOC mean number of pathogens/samples were 1.99 and 1.44, respectively. All gram-negative resistance markers were detected. PNplus and SOC results were fully or partially concordant for 49.1% and 26.4% of specimens, respectively. PNplus was highly sensitive and detected more potential pneumonia pathogens than SOC. Semiquantification may assist in understanding pathogen significance. As PNplus generates results in approximately 1 h, PNplus has potential to direct antimicrobial therapy in near real time and improve antimicrobial stewardship and patient outcomes. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10096-021-04195-5. Determining the etiology of community-acquired pneumonia (CAP), hospital-associated pneumonia (HAP), and ventilatorassociated pneumonia (VAP) can be complicated [1] . Based on traditional test methods such as Gram stain and culture, diagnostic yield can be low [2] [3] [4] . Additionally, poor specimen quality may yield inconclusive or difficult to interpret results, sampling may require an invasive procedure, and/or patients may be on empiric therapy prior to specimen collection, reducing diagnostic yield [5] . Although international guidelines from the Infectious Diseases Society of America (IDSA)/American Thoracic Society (ATS) and the European Respiratory Society (ERS) recommend diagnostic testing for moderate to severe CAP [6, 7] , actual compliance with guidelines can be low (16.7% and 23.9%, respectively) and differs by geography and disease severity [8] . Aside from influenza A/B, often no viral testing is performed, despite evidence that other viruses are a significant cause of CAP in all age patients [9] [10] [11] . Consequently, broad use of empiric antibiotic treatment for undiagnosed viral infections has been associated with increased antibiotic resistance globally [12] [13] [14] . In HAP and VAP, empiric therapy often includes broadspectrum antibiotics for both gram-positive and gramnegative bacteria due to the risk of infection with multidrugresistant pathogens [15, 16] . Identification of specific pathogen(s) is of increasing importance to allow prompt initiation of Clinical sites, specimens, and SOC testing Forty-eight academic medical center laboratories and four independent medical laboratories from 13 countries (Austria, Belgium, Denmark, Israel, Italy, France, Germany, Netherlands, Portugal, Spain, Sweden, Switzerland, and the UK) tested 2476 unique specimens (1234 BLS; 1242 SLS) from adult and pediatric patients suspected of pneumonia (Supplemental Table 7 ). Specimen selection was at discretion of study site. SOC was performed per institutional policies and healthcare provider prescription. SOC varied by site and all included bacterial culture and phenotypic susceptibility testing when indicated. Additional test methods were at the discretion of the laboratory and may have included additional cultures (fungal, viral, mycobacterial cultures) as needed, urinary antigen testing (Streptococcus pneumoniae, L. pneumophila), immunofluorescence tests, and nucleic acid amplification tests (NAATs) for selected bacteria, viruses, and antibiotic resistance markers. Methicillinsusceptible Staphylococcus aureus (MSSA) was differentiated from methicillin-resistant S. aureus (MRSA) using phenotypic methods, mecA NAAT, and/or PBP2a latex agglutination at the discretion of the laboratory. The investigators were instructed to perform the BioFire PNplus Panel in accordance with the manufacturer's instruction for use. Specimens were split and BioFire PNplus Panel testing was performed using either fresh specimens or from a frozen aliquot. Data was deidentified, no protected health information was provided, and participation was in accordance with local institutional ethical guidelines. BioFire PNplus and SOC results were compared for the following: PNplus Panel and SOC: Results were evaluated for all specimens and by specimen types. SOC detected or not detected was determined in consideration of all test results reported. SOC C. pneumoniae, L. pneumophila, M. pneumoniae, and viral results were counted as not detected when a negative or no result was provided as patterns of testing varied extensively by institution. All SOC results were considered true positive. Results of BioFire PNplus Panel were considered true positive or true negative based on performance data established in US FDA clinical studies [20] . Mean Panel Excluding normal oral flora, 649 additional potential pathogens were detected by SOC including 230 gramnegative bacteria, the most prevalent being Stenotrophomonas maltophilia (n = 70), Citrobacter spp. (n = 31), Acinetobacter spp. (n = 28), Haemophilus parainfluenzae (n = 22), Morganella morganii (n = 15), and Hafnia alvei (n = 11). Another 28 gram-negative bacterial spp., representing 18 genera, were reported less than 10 times. Yeasts were reported for 283 specimens, Candida spp. (n = 123), Candida albicans (n = 113), C. glabrata (n = 27), C. parapsilosis (n = 6), C. krusei (n = 5), C. tropicalis (n = 5), C. kefyr (n = 2), and C. lusitaniae (n = 2). Pneumocystis sp. was reported for 11 specimens, molds for 28 specimens, including 11 Aspergillus fumigatus, and five anaerobes including three Fusobacterium spp. There were 42 gram-positive cocci of questionable significance including 24 Enterococcus spp. and seven Streptococcus C/G groups. There were 24 gram-positive rods, including 15 Corynebacterium spp. and 1 Nocardia sp. and four Mycobacterium (two M. tuberculosis, one M. avium, and one M. fortuitum). Additional viral targets (n = 22) included cytomegalovirus (n = 10), herpes simplex virus (n = 5), Epstein-Barr virus (n = 4), human herpes virus 6 (n = 2), and varicella zoster virus (n = 1). Including [26] . Similarly, a VAP study using a research use only version of BioFire PNplus Panel demonstrated for bacteria an 89.0% PPA and 95.9% NPA with SOC [27] . BioFire PNplus Panel reflects high performance compared to SOC, yielding additional clinically actionable results that may be missed by SOC. Prevalence of atypical pathogens in this specimen set was low (4.17%), with L. pneumophila the most frequently detected. Low SOC percent detections of M. pneumoniae (48.78%) and C. pneumoniae (57.14%) compared to BioFire PNplus Panel (90.24% and 100%, respectively) were mainly due to lack of testing and therefore a missed opportunity in CAP to either limit treatment to a macrolide or fluoroquinolone or stop treatment if tested negative. This missed opportunity for applying antimicrobial stewardship principles and streamlining therapy is of particular importance due to adverse effects of fluoroquinolones [28] . [30] . Virus detection in absence of a bacterial pathogen and in conjunction with clinical presentation, chest radiograph, and other diagnostic tests, such as a low procalcitonin, could support antimicrobial stewardship and discontinuation of antibiotics in the setting of CAP [31] . BioFire PNplus Panel identified more codetections (41.85%) compared to SOC (19.21%), which was mainly influenced by lack of SOC viral testing. Codetections were commonly identified by Webber [24] . All three studies found the majority of codetections contained 2 pathogens, but could rarely contain 5 to 6+ pathogens, similar to our results. In this study, BioFire PNplus Panel on average identified more potential pathogens (1.99) per specimen than SOC (1.44). Detection of multiple pathogens raises interpretation questions that need to be viewed in light of clinical parameters, pathogens detected, and abundances. Use of BioFire PNplus Panel has led to concerns that identification of more bacteria than SOC, which may be colonizers, could lead to antibiotic overtreatment. Specimen types should be considered. SLS are prone to more oropharyngeal contamination compared to BLS. H. influenzae, S. pneumoniae, and M. catarrhalis can be normal flora, and hospitalized or ventilated patients may be colonized with gram-negative bacilli and S. aureus. Although laboratory and reproducible within ± 0.5 log 10 copies/mL and correlated with another quantitative molecular method [20] . Despite low concordance with quantitative culture, particularly when values were < 10 6 (3.1-38.9%), concordance improved to 90.9-100% when quantitative culture values were > 10 6 . There were few instances when BioFire PN Panel did not detect a bacterium or reported values lower than quantitative culture, which is similar to what we report in this study. Lee et al. also demonstrated an overestimation of quantification by BioFire PN Panel [24] . Buchan et al. demonstrated that PN values were frequently higher than culture values, resulting in semiquantitative agreement (within the same log 10 value) of 43.6% [32] . Gastli Major limitations of this study were a lack of clinical information and comprehensive gram-negative phenotypic antibiotic susceptibility data, such as that described by Murphy et al. [20] , needed to better understand the relevance of resistance marker results and impact on patient care. Discordant analyses were not performed due to the large number of participating sites and the number of specimens tested. Discordant analyses would have required some type of confirmatory testing for 150 culture isolates (BioFire PNplus Panel negative) and 1898 individual PCRs or direct sample sequencing for the confirmation of pathogens only detected by BioFire PNplus Panel (SOC negative). However, this study therefore does highlight the need for microbiologists and clinicians to address issues relating to discordant results and test interpretation. Additionally, detailed information regarding testing for viral or atypical bacterial pathogens for each sample was not available so no direct performance comparison could be made. Gram stains were not systematically reported and it is not known if a quality score was a testing requirement. However, considering the high sensitivity and specificity of BioFire PNplus Panel as demonstrated in the US FDA clinical studies [20] , in combination with detection of key gram- [34] . This data provides an early indication that proper use and interpretation of BioFire PNplus Panel could lead to targeted therapy not an increase in inappropriate antimicrobial usage. Prospective interventional studies in progress will provide data on interpretation of bin values, detection of resistance genes, and clinical impact of a rapid diagnosis. Finally, the BioFire PNplus bin comparison to SOC reporting was difficult to standardize as culture reporting can vary from technologist to technologist and laboratory to laboratory, which could lead to interpretive error. However, despite using 3 different interpretative criteria, results did not significantly differ. Strengths of the study include the large specimen size, the even distribution of specimen types, and geographical diversity of testing sites with differences in both ordering practices and results reporting. The clinical laboratory plays a vital role in diagnosis of CAP, HAP, and VAP but faces numerous challenges due to testing complexity [1. 5, 8-10] . Often poor-quality sputum specimens are submitted and without quality rejection screening by Gram stain, culture results can be misleading or negative. HAP and VAP patients pose a different dilemma since these patients quickly become colonized with S. aureus and various gram-negative bacilli which may lead to pneumonia with multidrug-resistant strains [15, 16] . Specimens can contain a diversity of pathogens including bacteria, viruses, and fungi [4, [6] [7] [8] [9] [10] [34] [35] [36] [37] [38] . Time to traditional bacterial detection is 24-72 h and antibiotic susceptibility data takes an additional 24-48 h. Comprehensive viral diagnostics are often not performed aside from influenza A/B testing, may not be performed 24/7, or require referral to a reference laboratory delaying time to results. Urinary antigen tests for S. pneumoniae provide results in < 30 min but can be false negative and false positive, particularly in children [39] . Urinary antigen tests for L. pneumophila are restricted in serotype detection and can have sensitivities of < 50% [40, 41] . Serology can be difficult to interpret and may require an acute and convalescent serum collected weeks apart. NAATs are the gold standard for the detection of the atypical bacteria but may not be routinely performed. Consequently, testing imitations lead to empiric HAP/VAP treatment with broad-spectrum antibiotics, especially in regions with high antimicrobial resistance rates. The switch to targeted therapy can take days, increasing risk of antimicrobial resistance and adverse events such as acute kidney injury and C. difficile disease [18] . Finally, if specimens are obtained after the start of antibiotic treatment, results may be altered or negative, without identifying the etiologic agent [5] . In conclusion, the BioFire PNplus Panel meets the challenges associated with routine test methods including poor pathogen recovery, lack of diagnostic comprehensiveness, and delayed time to result [42] . However, several factors need to be considered including the lack of a specimen quality marker and the inability to report the presence or absence of normal flora [43] . Although a Gram stain is not required prior to testing, good laboratory practice should still be followed to insure sample quality [43] . Pretreatment or dilution of samples would affect both the sensitivity of the assay and semiquantitative results and therefore is not recommended in the manufacturer's instructions for use. Interpretation challenges include understanding the increased detection rates, significance of the bin value, the differentiation between colonization and infection, and the presence of gram-negative resistance markers without direct linkage to a specific pathogen. However, approved for use with BLS and SLS, BioFire PNplus allows for easy specimen testing for CAP [6, 7] and meets IDSA/ATS recommendations [13] for non-invasive diagnostic testing as a preferred method for VAP and ERS guidelines to test distal quantitative specimens [16] . Additionally, studies that used BioFire PNplus panels in COVID-19 patients demonstrated not only improved diagnosis of bacterial coinfections but enhanced options for appropriate therapy [35, 44, 45] . Verroken et al. demonstrated that BioFire PNplus Panel speeded up therapeutic changes in 46.9% of COVID-19 patients, five patients having antibiotics stopped and one third remained antibiotic free [35] . BioFire PNplus is rapid, simple to perform, and highly robust, with only 0.53% of the specimens in this study yielding invalid results. Detection of pathogens and antibiotic resistance markers can be used to inform immediate treatment decisions and improve patient outcomes. Funding BioFire Pneumonia plus Panels were provided free of charge by bioMérieux, France. No other compensation was provided to the test sites. Data availability The datasets generated during and/or analyzed during the current study are not publicly available due to restrictions by individual contributors but are available as composite data from the corresponding author on reasonable request. Competing interests Christine C. Ginocchio, Carolina Garcia-Mondragón, and Barbara Mauerhofer are employees of bioMérieux. Cory Rindlisbacher is an employee of BioFire Diagnostics. EME Evaluation Program Collaborative sites did not receive any other resources to perform this study other than the test panels. The study design, authors, data analysis, interpretation of data, and writing of report were performed by bioMérieux employees as per author contribution listed above. Data was reviewed and approved by the EME Evaluation Program Collaborative sites. Ethics approval Ethical approval was in accordance with individual institution requirements. Consent to participate Not applicable. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. Acknowledgements The members of the EME Evaluation Program Collaborative for their support and contribution to this study: Hospital Universitario Central de Asturias Kfar Saba, Israel, and Department of Clinical Microbiology and Immunology, Sackler Faculty of Medicine Operative Unit of Clinical Microbiology, Policlinico Sant'Orsola Malpighi Material preparation and data collection were performed by CCG, CG-M, BM, and the EME Evaluation Program Collaborative. All members of the EME Evaluation Program Collaborative contributed equally to the study. Data analysis was performed by CCG, CG-M, and CR. The manuscript was written by CCG and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript The clinical microbiology laboratory in the diagnosis of lower respiratory tract infections Diagnostic tests for agents of communityacquired pneumonia The enduring challenges of determining pneumonia etiology in children. Consideration for future research priorities Finelli L for the CDC EPIC Study Team (2015) Community-acquired pneumonia requiring hospitalization among U.S. adults Influence of antibiotics on the detection of bacteria by culture-based and culture-independent diagnostic tests in patients hospitalized with community-acquired pneumonia Diagnosis and treatment of adults with community-acquired pneumonia. An official clinical practice guideline of the Joint Taskforce of the European Respiratory Society and European Society for Clinical Microbiology and Infectious Diseases (2011) Guidelines for the management of adult lower respiratory tract infections-full version Microbiological testing of adults hospitalised with community-acquired pneumonia: an international study Drews SJ (2019) Practical guidance for clinical microbiology laboratories: viruses causing acute respiratory tract infections Comprehensive molecular testing for respiratory pathogens in community-acquired pneumonia Respiratory virus is a real pathogen in immunocompetent community-acquired pneumonia: comparing to influenza like illness and volunteer controls Department of Health and Human Services, CDC; 2019. www.cdc.gov/DrugResistance/ Biggest-Threats Antibiotic prescribing without documented indication in ambulatory care clinics: national cross sectional study Management of adults with hospital-acquired and ventilator-associated pneumonia: 2016 clinical practice guidelines by the Infectious Diseases Society of America and the International ERS/ ESICM/ESCMID/ALAT guidelines for the management of hospital-acquired pneumonia and ventilator-associated pneumonia: guidelines for the management of hospital-acquired pneumonia (HAP)/ventilator-associated pneumonia (VAP) of the Clostridium difficile infection Association of adverse events with antibiotic use in hospitalized patients Broad-spectrum antibiotic use and poor outcomes in communityonset pneumonia: a cohort study Multicenter evaluation of the BioFire FilmArray Pneumonia Panel for the detection and quantification of agents of lower respiratory tract infection Laboratory evaluation of the BioFire FilmArray Pneumonia plus panel compared to conventional methods for the identification of bacteria in lower respiratory tract specimens: a prospective cross-sectional study from South Africa Evaluation of the BioFire FilmArray Pneumonia Panel for rapid detection of respiratory bacterial pathogens and antibiotic resistance genes in sputum and endotracheal aspirate specimens Evaluation of the BioFire® FilmArray® Pneumonia Panel for detection of viral and bacterial pathogens in lower respiratory tract specimens in the setting of a tertiary care academic medical center Performance of a multiplex PCR pneumonia panel for the identification of respiratory pathogens and the main determinants of resistance from the lower respiratory tract specimens of adult patients in intensive care units Evaluation of the Biofire Filmarray Pneumonia panel plus for lower respiratory tract infections Multicentric evaluation of BioFire FilmArray Pneumonia Panel for rapid bacteriological documentation of pneumonia Evaluation of the BioFire® Pneumonia Panel in ICU patients with suspected ventilatorassociated pneumonia FDA Drug Safety Communication: FDA advises restricting fluoroquinolone antibiotic use for certain uncomplicated infections Mycoplasma pneumoniae from the respiratory tract and beyond Comparable detection of viral pathogens in lower respiratory tract specimens with the BioFire Respiratory Panel 2 and BioFire Pneumonia Panel Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections Practical comparison of the BioFire® FilmArray® Pneumonia Panel to routine diagnostic 1 methods and potential impact on antimicrobial stewardship in adult hospitalized patients with lower respiratory tract infections. Posted Online 29 Multicenter evaluation of a syndromic rapid multiplex PCR test for early adaptation of antimicrobial therapy in adult patients with pneumonia Co-infections in COVID-19 critically ill and antibiotic management: a prospective cohort analysis Bacterial complications of respiratory tract viral illness: a comprehensive evaluation Rapid molecular tests for influenza, respiratory syncytial virus, and other respiratory viruses: a systematic review of diagnostic accuracy and clinical impact studies Sensitivity, specificity, and positivity predictors of the pneumococcal urinary antigen test in community-acquired pneumonia Immunochromatic kits Xpect Legionella and BinaxNOW Legionella for detection of Legionella pneumophila urinary antigen have low sensitivities for the diagnosis of Legionnaires' disease Diagnostic testing for Legionnaires' disease The modern quest for the "holy grail" of pneumonia etiology Lower respiratory multiplex panels for the detection of bacterial and viral infections Organisms causing secondary pneumonias in COVID-19 patients at 5 UK ICUs as detected with the FilmArray test Argaud L (2020) Early bacterial co-infection in ARDS related to COVID-19 Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations