key: cord-0693327-1t980fvy authors: Schneider, Markus; Iftner, Thomas; Ganzenmueller, Tina title: Evaluation of the analytical performance and specificity of a SARS-CoV-2 transcription-mediated amplification assay date: 2021-05-10 journal: J Virol Methods DOI: 10.1016/j.jviromet.2021.114182 sha: 314fa270ad7990df9e07ccb5cabc44b236145135 doc_id: 693327 cord_uid: 1t980fvy The ongoing severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic requires fast and accurate high-throughput diagnostic tools. To evaluate the analytical performance of the Hologic Aptima transcription-mediated amplification (TMA) assay for detection of SARS-CoV-2 RNA from respiratory samples we analysed 103 clinical and proficiency panel samples pre-tested by real-time RT-PCR (Altona, RealStar) and found a positive percent agreement (sensitivity) of 95.7% and a negative percent agreement (specificity) of 100%. The limit of detection of the Aptima test was 150 copies/ml determined as 95% detection probability. To further assess the Aptima assay´s specificity we prospectively analysed 7545 clinical specimens from the upper and lower respiratory tract sent for the purpose of routine SARS-CoV-2 screening. SARS-CoV-2 RNA was detected in 16/7545 (0.2%) samples by the TMA assay and confirmed independently by the Xpert SARS-CoV-2 RT-PCR (Cepheid); in one case a previous discrepant result was confirmed as true SARS-CoV-2 infection in a subsequent sample from the same patient. Results from the Aptima SARS-CoV-2 TMA assay agreed well with RT-PCR and showed an excellent specificity in a large number of routine specimens despite the low prevalence at that time of the pandemic, indicating that this assay can be used even for screening purposes. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has spread as global pandemic (Dong, Du, and Gardner, 2020; Hu et al., 2020; Zhu et al., 2020) . SARS-CoV-2 infected persons occasionally present oligo-or asymptomatically and high viral loads can be shed before clinical signs occur, posing the risk of uncontrolled transmission (Arons et al., 2020; Hung et al., 2020; Lai et al., 2020; Rivett et al., 2020) . Therefore, fast and reliable detection of SARS-CoV-2, using highly sensitive and specific nucleic acid amplification testing (NAAT) for a large sample number has become a major challenge for laboratories to provide timely diagnosis and prevent (nosocomial) transmission especially in healthcare settings. The Aptima SARS-CoV-2 transcription-mediated amplification (TMA) assay on the J o u r n a l P r e -p r o o f automated, random access Panther system (Hologic) detects viral RNA with a turn-around-time of 3.5 hours and then up to 60 results per hour. Here we aim to describe validation data upon test introduction and to prospectively evaluate the clinical performance, especially specificity, of the Aptima SARS-CoV-2 assay for respiratory samples obtained mainly for routine screening at a large University Hospital in Southern Germany during the first eight weeks after test introduction in summer 2020. Test performance of the Aptima SARS-CoV-2 TMA (Hologic) assay was first evaluated by retrospective analysis of 94 respiratory specimens (n=86 nasopharyngeal swabs in ESwab™ (Copan) or Sigma Virocult® (Medical Wire & Equipment) media and n=8 tracheal aspirations) and 9 proficiency panel specimens (INSTAND) initially tested using real-time RT-PCR (RealStar SARS-CoV-2 RT-PCR Kit 1.0, Altona) amplifying conserved regions of the viral E-gene and S-gene. Retrospective specimens had been archived at -80°C and were pre-selected according to Ct (cycle threshold) values determined by the RealStar assay: n=25 with a Ct value < 25 (> 4 x 10 5 copies/ml), n=24 with a Ct value of 25-32, n=20 with a Ct value > 32 (< 2 x 10 3 copies/ml), and n=25 negative samples. To semi-quantitatively calculate viral copy numbers corresponding to the Ct values of the E-gene RT-PCR we used a dilution series of a standard sample (10 7 copies/ml, Ch07469-1-CoV-2, INSTAND). RealStar RT-PCR had been done after extraction of nucleic acids (MagNA Pure 96, Roche) on a Light Cycler 480 II (Roche) according to manufacturer´s instructions. The 95% Limit of Detection (LoD) of the Aptima assay was determined by testing serial dilution samples of the AccuPlex™ SARS-CoV-2 verification panel (SeraCare) containing recombinant virus particles with SARS-CoV-2 genome sequences (dilution in log steps starting at a concentration of 1 x 10 5 copies/ml) and subsequent Probit regression analysis (SPSS Statistics 27, IBM). For prospective assessment of assay specificity 7545 fresh respiratory specimens (7427 nasopharyngeal swabs, 96 tracheal aspirations, and 22 bronchoalveolar lavage specimens) sent for routine SARS-CoV-2 testing from patients at the University Hospital between July and September 2020 were analysed with the Aptima SARS-CoV-2 TMA assay. Positive results were confirmed independently J o u r n a l P r e -p r o o f by the Xpert SARS-CoV-2 test (Cepheid) that also determines Ct values. The majority of specimens were sent for the purpose of screening of patients without respiratory symptoms upon admission to hospital. The Aptima SARS-CoV-2 TMA assay (Hologic) and the cartridge based Xpert Xpress SARS-CoV-2 (Cepheid) real-time RT-PCR assay were done according to manufacturers' instructions on the Hologic Panther instrument or the Cepheid GeneXpert instrument, respectively. All 25 samples tested negative by the RealStar assay were concordantly tested negative by the Aptima assay (Table 1) Analytical sensitivity determined by replicate testing of the AccuPlex SARS-CoV-2 verification panel serial dilution samples in the Aptima assay yielded a 95% LoD of 150 (confidence interval 125-201) copies/ml (Table 2) . Table 3 ). The only exception was a sample from patient C that tested discordantly positive in the Aptima assay, but could initially not be confirmed by the Xpert assay. However, on the next day a subsequent sample of patient C tested positive in both assays (Table 3) of archived samples as well as differences in the amount of processed input volume for different assays occasionally may lead to non-reproducible results in particular in samples with low viral loads and can be considered as general limitations of these kind of retrospective evaluations (Kuo et al., 2021; Mostafa et al., 2020) . With a LoD of 150 copies/ml the 95% detection probability of the Aptima assay can be considered as sufficiently sensitive. This is consistent with data from others, who found a 100% LoD of 62.5 copies/ml (synthetic RNA ) and a 95% LoD of 288 copies/ml (AccuPlex SARS-CoV-2 Verification Panel (Cordes et al., 2020) ). Prospective This excellent specificity is remarkable for two reasons: First, prevalence of SARS-CoV-2 infections in Germany during that time of the pandemic was very low. Second, according to the hospital´s test strategy many samples were sent for the purpose of screening of asymptomatic individuals. This is also resembled by the SARS-CoV-2 RNA positivity rate of 0.20% in our cohort, which was even lower than the test positivity rate in Germany (0.81-1.16%) during that time (Böttcher et al., 2020) . A recently published comparable study analysed more than 19.000 samples and found a rather similar SARS-CoV-2 positivity rate of 0.47% (Skittrall et al., 2021) . SARS-CoV-2 RNA was detected in 43 samples for the first time (i.e. no previous result available) by the Aptima TMA assay, but only 29 out of these 43 (67%) could by confirmed by Skittrall and colleagues upon re-testing with 1 or 2 other assays (Aptima TMA J o u r n a l P r e -p r o o f or an in-house RT-PCR). In contrast, 15/16 (94%) positive results were confirmed in our study using the quite sensitive Xpert assay. We thus share the conclusion of Skittrall et al., that a confirmatory, ideally semi-quantitative test could be useful in certain settings. The major advantages of the Aptima SARS-CoV-2 TMA assay are an excellent test performance, good turn-around-time and high automation including random access. In particular, the last point turned out to be a big plus for the daily laboratory work-flow during the pandemic, as it allowed continuous and independent processing of incoming samples, which is not possible for RT-PCR assays run in a batch format. One drawback of the Aptima assay however, is the lack of information on viral loads in the respiratory samples. Ct values determined by quantitative NAATs can be useful for evaluation if an acute, rather beginning or past infection has been detected, which is known from other infections (Baier et al., 2018; Banerjee et al., 2018) and has been demonstrated in our cohort by the significantly lower median Ct values for patients with first detection compared to known infections. Moreover, assessment of SARS-CoV-2 loads by Ct values becomes increasingly important for patient management in terms of lifting quarantine measures or assessing potential infectivity (Cevik et al., 2021; Perera et al., 2020; Robert-Koch-Institut, 30.11.2020; Wolfel et al., 2020) . The problem of missing Ct values of course can be solved by subsequent re-testing positive samples using a SARS-CoV-2 real-time RT-PCR assay; however, this increases costs, hands-on and sample-to-answer time. In summary, the Aptima SARS-CoV-2 TMA assay reliably detected SARS-CoV-2 infections and exhibited an excellent specificity in a large number of prospectively tested routine specimens despite low SARS-CoV-2 prevalence. Therefore, the assay can -if required-even be utilized for screening purposes of asymptomatic individuals, e.g. upon hospital admission. The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The University Hospital Tuebingen (Thomas Iftner) received an unconditional research grant from Hologic for a longitudinal study on a comparison of HPV tests for cervical cancer screening in the past. The other authors report no conflict of interest. Hologic sponsored the first 250 tests of the evaluation study; otherwise the study was financed by institutional funds of the Virology Department of the University Hospital Tuebingen. Hologic did not have any influence on the scientific data interpretation or content of the submitted manuscript. The University Hospital Tuebingen (Thomas Iftner) received an unconditional research grant from Hologic for a longitudinal study on a comparison of HPV tests for cervical cancer screening in the past. The other authors report no conflict of interest. Hologic sponsored the first 250 tests of the evaluation study; otherwise the study was financed by institutional funds of the Virology Department of the University Hospital Tuebingen. Hologic did not have any influence on the scientific data interpretation or content of the submitted manuscript. Presymptomatic SARS-CoV-2 Infections and Transmission in a Skilled Nursing Facility Influenza and respiratory syncytial virus screening for the detection of asymptomatically infected patients in hematology and oncology Comparison of Six Sample-to-Answer Influenza A/B and Respiratory Syncytial Virus Nucleic Acid Amplification Assays Using Respiratory Specimens from Children Erfassung der SARS-CoV-2-Testzahlen in Deutschland SARS-CoV-2, SARS-CoV, and MERS-CoV viral load dynamics, duration of viral shedding, and infectiousness: a systematic review and meta-analysis Fully automated detection and differentiation of pandemic and endemic coronaviruses (NL63, 229E, HKU1, OC43 and SARS-CoV-2) on the Hologic Panther Fusion An interactive web-based dashboard to track COVID-19 in real time High-Throughput Transcription-mediated amplification on the Hologic Panther is a highly sensitive method of detection for SARS-CoV-2 Characteristics of SARS-CoV-2 and COVID-19 SARS-CoV-2 shedding and seroconversion among passengers quarantined after disembarking a cruise ship: a case series Comparison of two nucleic acid amplification tests (NAATs) and two antigen tests for detection of SARS-CoV-2 from upper respiratory specimens Asymptomatic carrier state, acute respiratory disease, and pneumonia due to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2): Facts and myths Comparison of the analytical sensitivity of seven commonly used commercial SARS-CoV-2 automated molecular assays SARS-CoV-2 Virus Culture and Subgenomic RNA for Respiratory Specimens from Patients with Mild Coronavirus Disease COVID-19: Entlassungskriterien aus der Isolierung Specificity and positive predictive value of SARS-CoV-2 nucleic acid amplification testing in a low-prevalence setting Analytical and Clinical Comparison of Three Nucleic Acid Amplification Tests for SARS Evaluation of the Aptima™ transcription-mediated amplification assay (Hologic®) for detecting SARS-CoV-2 in clinical specimens Virological assessment of hospitalized patients with COVID-2019 China Novel Coronavirus, I. and Research, T., 2020. A Novel Coronavirus from Patients with Pneumonia in China We thank Ina Beck, Tanja Lutz and the technicians of the diagnostic laboratory for excellent technical support.