key: cord-026099-97luq10a
authors: Kok, J; Rahman, H; Carter, I; Basile, K; Donovan, L; Kumar, S; Tran, T; Ko, D; Alderson, S; Sivaruban, T; Eden, J-S; Rockett, R; O’Sullivan, MV; Sintchenko, V; Chen, SC; Maddocks, S; Dwyer, DE
title: Response to correspondence received on our paper:Interpret with caution: an evaluation of the commercial AusDiagnostics versus in-house developed assays for the detection of SARS-CoV-2 virus
date: 2020-06-05
journal: J Clin Virol
DOI: 10.1016/j.jcv.2020.104484
sha: 
doc_id: 26099
cord_uid: 97luq10a

nan

using either in-house developed or commercial diagnostic assays. Prior to intended use, such assays should be validated to ensure they are fit for purpose, particularly when testing for novel pathogens with pandemic potential.

The AusDiagnostics RUO assay is a real-time, nested, intercalating-dye based PCR assay. Probe-based assays (such as our in-house developed, real-time PCR [RT-PCR] assays based on the WHO recommended targets) are more specific than intercalating dye-based assays as non-specific PCR products and primer dimers may generate fluorescent signals. Analysis of melting curves may help identify these non-specific amplicons, provided that the assay's target(s) are specific for SARS-CoV-2 and no other amplicons that are generated dissociate at the same temperature. As the primers used in the AusDiagnostics RUO assay are not publicly available, we were not able to verify the manufacturer's claims of the correct melting temperature. False positive results of other AusDiagnostics assays using the same methodology have been previously attributed to incorrectly calibrated equipment and poor quality power supply [Meunier] .

We reported that the sensitivity, specificity, positive predictive value (PPV) and negative predictive value of the AusDiagnostics RUO assay was 100%, 92.16%, 55.56% and 100%, respectively when compared to our RT-PCR assay. Even if the specificity of the AusDiagnostics RUO assay was 99% (i.e. a 1% false positive rate), given the current prevalence of COVID-19 infection in NSW of 0.84%, the calculated PPV of the assay would be 54.15%, which is concordant with our findings. Cohen et al also estimated false positive rates of up to 7% in commercial diagnostics assays detecting SARS-CoV-2 [Cohen] .

Whilst SARS-CoV-2 whole genome sequencing (WGS) may have resolved the issue of the four false positive samples, quality consensus sequences are often difficult to obtain from samples with RT-PCR cycle threshold values >30 [Rockett, Eden] . Partial sequencing of the SARS-CoV-2 genome was considered less informative without knowledge of the AusDiagnostics RUO assay's target(s) and not attempted as it may not be able to distinguish closely related coronaviruses compared to WGS. Furthermore, false positive RT-PCR results have also been reported from commercial kits that have been contaminated with SARS-CoV-2 sequences [Bustin] .

Since our manuscript was written, AusDiagnostics Pty Ltd now offer several diagnostic assays for the detection of SARS-CoV-2, including the AusDiagnostics SARS-CoV-2, influenza and RSV 8-well assay (catalogue number 20081). Of note, the reported sensitivity and specificity for this dual target assay is 100% and 100% for the "a" J o u r n a l P r e -p r o o f target and 97.7% and 99.4% for the "b" target, respectively [AusDiagnostics] . This suggests that during their evaluation, there were samples where the "a" but not "b" target was detected, despite the "b" target having a reported lower limit of detection (175 copies/mL vs 2150-4325 copies/mL). The reported specificity of 99.4% for the "b" target also implies that false positive results were encountered. The assay's instructions for use however, recommends that detection of either one of the two targets is sufficient to call a result positive.

As Stanley correctly points out, it is important that diagnostic assays have high sensitivity in order to detect all persons with suspected COVID-19 and limit further transmission of infection. However, it is equally important that 

No conflicts of interest declared

CoV-2, influenza and RSV 8-well Ref 20081 panel of assays instructions for use

RT-qPCR testing of SARS-CoV-2: a primer

False positives in reverse-transcription PCR testing for SARS-CoV-2. medRxiv 2020

Evaluation of the AusDiagnostics MT CRE EU assay for the detection of carbapenemase genes and transferable colistin resistance determinants mcr-1/-2 in MDR Gram negative bacteria

NSW COVID-19 case statistics by local health district

Interpret with caution: An evaluation of the commercial AusDiagnostics versus in-house developed assays for the detection of SARS-CoV-2 virus

Revealing COVID-19 transmission by SARS-CoV-2 genome sequencing and agent based modelling

World Health Organization. Molecular assays to diagnose COVID19: summary table of available protocols