key: cord-0735841-dlp7gub7 authors: Mulchandani, Ranya; Brown, Ben; Brooks, Tim; Semper, Amanda; Machin, Nicholas; Linley, Ezra; Borrow, Ray; Wyllie, David title: Use of dried blood spot samples for SARS-CoV-2 antibody detection using the Roche Elecsys ® high throughput immunoassay date: 2021-01-19 journal: J Clin Virol DOI: 10.1016/j.jcv.2021.104739 sha: 7a35c397e45e7279584c014a2e882cdf239dc7d2 doc_id: 735841 cord_uid: dlp7gub7 Dried blood spot samples (DBS) provide an alternative sample type to venous blood samples for antibody testing. DBS are used by NHS for diagnosing HCV and by PHE for large scale HIV and Hepatitis C serosurveillance; the applicability of DBS based approaches to SARS-CoV-2 antibody detection is uncertain. The study aimed to compare antibody detection in DBS eluates using the Roche Elecsys ® immunoassay (index test) with antibody detection in paired plasma samples, using the same assay (reference test). The study was in one Police and one Fire & Rescue facility in England; it comprised of 195 participants within a larger sample COVID-19 serodiagnostics study of keyworkers, EDSAB-HOME. Outcome measures were sensitivity and specificity of DBS (the index test) relative to plasma (the reference test), at an experimental cut-off; quality of DBS sample collected; estimates of relative sensitivity of DBS vs. plasma immunoassay in a larger population. 18/195 (9.2%) participants tested positive using plasma samples. DBS sample quality varied markedly by phlebotomist, and low sample volume significantly reduced immunoassay signals. Using an experimental cut-off, sensitivity and specificity of DBS were 89.0% (95% CI 67.2, 96.9%) and 100.0% (95% CI 97.9, 100%) respectively compared with using plasma. The limit of detection for DBS is about 30 times higher than for plasma. DBS use for SARS-CoV-2 serology, though feasible, is insensitive relative to immunoassays on plasma. Sample quality impacts on assay performance. Alternatives, including the collection of capillary blood samples, should be considered for screening programs. Testing for SARS-CoV-2 antibodies is important to understand how the infection has spread in the population. However, extensive population testing is not feasible using the currently available, highly sensitive immunoassays, due to the need to take venous blood samples. As such, serosurveillance using home sampling is currently limited to the use of lateral flow immunoassays (LFIAs), which often have limited sensitivity [1] - [5] . Dried blood spot (DBS) samples provide an alternative sample type to venous blood samples for antibody testing, and have been used extensively in screening for other viruses including Hepatitis B, Hepatitis C and HIV [6] . Recent studies have demonstrated the feasibility of using DBS for home blood collection for SARS-CoV-2 antibody screening, with or without virtual supervision [7] as well as in infants [8] . Small scale feasibility studies have evaluated DBS samples for SARS-CoV-2 antibody detection in high risk populations, using plate based enzyme immunoassays, with promising results [9] - [12] . Field studies indicate the DBS approach is likely to be acceptable [13] . Recently, laboratories, including those in the United Kingdom (UK)'s National Health Service (NHS), have put in place high-throughput immunoassays for SARS-CoV-2 antibodies, which have to date used venous blood samples [14] . However, when considering population screening or individual risk assessment using antibody tests, an approach offering the potential advantages of easy and safe collection [15] without the need for phlebotomy training and with the possibility for self-collection of samples [16] , stability of the sample at ambient temperature once dried [17] and simple transport to the testing laboratory exempt from UN 3373 transport regulations [18] would be attractive. The taking and transporting of DBS samples has proved successful in screening for other viruses [19] , and combined with testing on high throughput automated instrumentation could allow wider access to SARS-CoV-2 serology. Here we describe a pilot study evaluating the potential for using DBS for SARS-CoV-2 antibody testing using the Roche Elecsys ® Anti-SARS-CoV-2 immunoassay. We chose this platform because it is widely available across the UK's NHS, and has one of the best performance characteristics of existing assays, as evidenced by a large-scale study [20] . The protocol used is an adaptation of that currently used by the Public Health England (PHE) Manchester virology laboratory for high-throughput screening of Hepatitis C. Samples were collected from volunteers attending two study locations over 2 days (3 rd and 4 th June 2020): Site 1 -Lancashire Police Headquarters and Site 2 -Lancashire Fire and Rescue Service. This recruitment was part of a larger ethically-approved study of UK key workers, Evaluating Detection of SARS-CoV-2 AntiBodies at HOME (EDSAB-HOME); full recruitment methods are described [1] , [21] . In brief, volunteers were key workers who had been working on site during the pandemic, and who were neither experiencing any COVID-19 compatible symptoms, currently or within the former seven days. Eligibility was unaffected by any prior COVID-19 compatible symptoms or SARS-CoV-2 nasal and throat swabs, or antibody tests. The overall approach, details of ethical approvals, and analysis are pre-specified in the study protocol available at http://www.isrctn.com/ISRCTN56609224. All EDSAB-HOME participants consented to provide a venous blood sample. All of those who attended a study clinic at Site 1 or 2 on the 3 rd or 4 th June were asked whether they would like to provide an additional DBS sample (this pilot study was ethically approved within the larger EDSAB-HOME protocol); as such, they form a convenience sample. Sample collection was performed by 7 different phlebotomists, 5 at Site 1 and 2 at Site 2. The phlebotomists were experienced in the collection of venous blood samples but had no prior training in the collection of DBS samples, and a short on-site training session was provided. High flow BD Microtainer® lancets were used for puncturing fingertip skin. We aimed to collect 4 full size spots onto a custom designed collection card. The card comprised PerkinElmer 226 grade collection paper and circle outlines for the collection of 5 separate 25μL blood spots, 4 of which are on a strip of paper attached with a perforated edge ( Figure 2 ) to enable removal using a disposable set of tweezers. Samples were stored at room temperature in ziplock bags containing a dessicant pack, and transported to PHE Manchester virology laboratory overnight. Samples were processed for elution on the 11 th and 12 th June, and stored at -80°C until tested on 18 th June when reagents and machine time were available. This process is currently in use for analysis of Hepatitis C and HIV antibodies. Validation has been performed for antisera against both these agents showing that elution from dried blood and subsequent storage at -80°C for up to 2 weeks has minimal impact on immunoassay titres relative to immediate analysis, however we did not perform this validation for SARS-CoV-2 antibodies prior to this pilot study. Venous blood samples were collected in 6ml volumes in EDTA Vacutainer® tubes (Beckton Dickinson) at the same time as collection of DBS samples and were sent to the PHE Seroepidemiology unit (SEU) Manchester at the end of each day (3rd and 4 th June) at room temperature. Plasma samples were separated the following morning from the EDTA blood after centrifugation at 1200 g for 15 minutes, and stored at -80°C until sending to the PHE Rare and Imported Pathogens Laboratory (RIPL) Porton Down for testing (in ambient conditions overnight). All plasma samples were tested with the Roche Elecsys ® Anti-SARS-CoV-2 immunoassay run on the Roche cobas e 801 analytical unit, following the manufacturer's instructions (COI ≥ 1.0 was considered positive). The Roche Elecsys ® immunoassay uses a recombinant protein representing the nucleocapsid (N) antigen and provides detection of antibodies (including IgG) and is validated for use on human serum J o u r n a l P r e -p r o o f and plasma. Results from the venous blood analysis were treated as the reference standard in this study and was chosen as this assay is currently the most sensitive and specific approach available for SARS-CoV-2 serological testing at PHE [20] . Samples were sent from the PHE SEU in Manchester on 17 th June 2020; due to limited availability of the Roche machines, plasma samples were analysed at PHE, RIPL,Porton Down between 29 th June and 3 rd July (as part of a large batch of EDSAB-HOME study samples). Between receipt and analysis, all plasma samples were stored at 4°C. The size of the 4 spots collected on the card were assessed and recorded. A full-size spot filling the entire collection circle represents a DBS spot of 25μl in size. Samples were rated as "good" if 4 full size spots were collected on the card, see Figure 2a . Spots were considered "small" if on visual inspection one or more appeared to fill only 50% or more of the collection area, and "very small" if one or more appeared to fill less than 50%, see Figure 2b . A paper strip containing the 4 blood spots, the edges of which are pre-perforated, was removed using single use sterile forceps and placed in a 50ml skirted centrifuge tube (Eppendorff) containing 1 mL of PBS/Tween 0.05% (Sigma) elution buffer. Tubes were placed flat on an orbital shaker for overnight elution at room temperature. Eluates were aspirated and transferred to false bottom tubes (Roche Diagnostics) and 12 μL tested with the Roche Elecsys ® Anti-SARS-CoV-2 antibody immunoassay run on the Roche e801 analyzer. Apart from using eluate instead of plasma, the protocol followed that was recommended by the manufacturer. Removal of the strip is a rapid step (~30 seconds) and the whole process takes about 1 minute hands-on per sample. Index tests were performed before the reference tests; those performing the index tests were blind to the reference test results, and vice versa. No clinical information on the samples was available to those performing either the index or reference test. We described the quality of DBS samples overall, and by each individual phlebotomist. Quantitative results from index and reference assays were depicted graphically. Among cases positive on the reference test, linear models were fitted using the R glm function modelling log 10 (y) ~ log 10 (x) + c + error, where y is the Roche immunoassay signal in the DBS eluate, x is the Roche immunoassay signal in the paired plasma sample, and c is a categorical variable representing spot size, which is either 0 (if the spot size is 'good') vs. 1 if it is small or very small. For the index test, we derived an experimental cut-off, which is ten median absolute deviations about the median in samples negative by the reference test. An estimated limit of detection was computed from the regression model above as the most likely reference test value at which the index test values were at the experimental cut-off. Sensitivity and specificity were computed by comparing the results of the dichotomised index test, using the experimental cut-off, relative to the dichotomised reference test result, using the manufacturer's cut-off. All computations used R version 4.02. Receiver operating characteristic (ROC) analysis was performed using the pROC [22] package, linear modelling used the glm function, and confidence intervals around proportions were computed using Wilson's method with the Hmisc package binconf function. In a separate analysis, we examined the distribution of the reference test (Roche Elecsys ® assay on plasma) in 2,652 samples from the EDSAB-HOME study, computing the immunoassay cumulative frequency distribution, and comparing it with the predicted limit of detection of DBS samples. Overall, around two thirds of the DBS samples were rated as "good" (n = 121, 62.1%); 42 (21.6%) were "small" and 32 (16.3%) were "very small" (Figure 2 ). The quality of sample collected varied by phlebotomist collecting the samples (Figure 3 ) ranging from 27/27 samples rates as "good" size to 0/21 rated as a "good" size. When we applied the manufacturer's cutoff value, optimised for plasma, to the DBS eluates, the sensitivity relative to plasma was poor (44%, 95% CI 24.5, 66.2) ( Table 2) . We therefore considered whether the cutoff used for plasma was appropriate for our DBS eluates. The relationship between the immunoassay ratio from venous plasma vs. DBS is shown for the 195 samples in Figure 4A . Although samples with negative reference tests gave very similar immunoassay ratios in both index and reference tests (black dots), positive samples generated lower results (median 0.7 vs. 18 units). However, for every unit increase in immunoassay signal in the Roche assay performed on plasma (the reference test), the J o u r n a l P r e -p r o o f immunoassay signal increased linearly provided the results were above the limit of detection ( Figure 4A ). Linear modelling quantified both the relationship between the immunoassays signals in the two tests (the slope of the line in Figure 4A ) and the limit of detection (Table 4 ). The limit of detection of the immunoassay performed on DBS test was estimated as corresponding to 5.9 antibody index units in tests on plasma ( Figure 4A ). If we compute a limit of detection for the immunoassay on plasma in the same way we computed it for the immunoassay on DBS eluates, the cutoff is about 0.17, or about 33 fold lower. This limit of detection, derived from a regression model is based on "good" quality spots. Since index test ratios were 45% (95% CI 23, 82%) smaller in those with smaller spots vs. the 62% of "good" spots (Table 4) , the test will be even less sensitive if smaller spots are obtained. Nevertheless, in this data set, the high correlation between tests results (Fig. 4A ), the small number of test results with low reference test results, and a predominance of "good" size spots, generates a high area-under-curve in ROC analysis (c= 0.985, Fig. 4B ). Using the experimental cut-off derived above, of 18 positive samples using the reference test, 16 were positive in the index test giving a sensitivity estimate of 89.0% (95% CI 67.2, 96.9%), while maintaining a specificity of 100% (95% CI 97.9, 100%) ( Table 2 ). Demographics and clinical symptoms of those testing positive on both the index test and reference test can be found in Table 3 . To understand whether this sensitivity is likely to be applicable to other samples, we examined the reference test (Roche Elecsys ® assay on plasma) in 2,652 samples from the EDSAB-HOME study (Fig. 1) ; there is no overlap between these samples and those on whom DBS samples were taken. Of these, 595 (22%) were positive on the reference assay, of which 62/595 (10.4%) were below the predicted limit of detection of DBS assays (Fig. 4C ). In this study, we showed that the DBS based approach used is an insensitive approach relative to assays on venous plasma, with the limit of detection of the assay estimated to be about 30 times lower with DBS samples. This is not unexpected, because the DBS eluate is at best 10% plasma. In reality, elution will be incomplete, and (as we showed) smaller spots result in lower concentrations of antibody. Nevertheless, in the small sample tested, the sensitivity of DBS at our experimental cut-off relative to the reference test was 89%, with wide confidence intervals due to the small study size. This is compatible with an observation, in a much larger independent cohort of 595 seropositive individuals, that about 10% of the population studied have antibody concentrations which we estimate would not be detectable by DBS. This study has several important limitations. Firstly, DBS has only been tested on a relatively small sample set, only 18 of which were positive on the reference standard, and only four of whom had a previous PCR test and the majority of those testing positive reported having previously had COVID-19 compatible symptoms. Secondly, sensitivity and specificity estimates of the index test were based on cut-offs derived from the data, and so should be considered exploratory. Thirdly, we assessed samples taken by trained phlebotomist. Variation in performance was observed between phlebotomists (and presumably would also occur between self-taken samples); as such, usability studies to quantify the extent of this variation would be essential to understand how the tests perform when self-administered by the target population. In considering the generalisability of our study, the implications of the relative insensitivity of DBS approaches, and comparing our observations with those of others assessing DBS accuracy, there are some parallels with observations we made with another antibody detection technology (lateral flow testing) which is also insensitive relative to laboratory immunoassays [1] . In our recent work , we showed that the sensitivity of the lateral flow J o u r n a l P r e -p r o o f test appears higher if individuals with previous PCR positivity are examined, because these people have more severe disease and higher antibody levels which are not representative of antibody levels in the general population, leading to a so called spectrum bias [23] . Comparisons of DBS accuracy using approaches using pre-pandemic samples vs. samples from individuals who are PCR positive may also overinflate estimates of DBS accuracy. Put alternatively, the analytical sensitivity of the test depends on the distribution of antibody concentrations in the target population; here, we used sequential sampling in a key worker population to try to obtain samples with an antibody distribution representative of that population, but we note that if other cohorts are studied in which antibody concentrations have declined compared with the one we studied, DBS will perform worse than we observe here. Our sampling strategy, used in an attempt to minimise spectrum bias [1] , may explain the lower sensitivity we observed relative to (for example) the study by Karp et al, in which they observed a 100% sensitivity of DBS compared to plasma, however all their positive samples were taken in the spring and confirmed with PCR; as such, these individuals were more likely to have experienced more severe COVID-19 (as testing was limited to these individuals at the time) and had limited time for antibody levels to decline [24] . Similar considerations apply when comparing our results with those of Morley et al, who report DBS analytical performance to be comparable to matched serum samples, with a sensitivity of 98.1% and specificity of 100%, when compared to an in-house ELISA which detects Spike glycoprotein antibodies (using 87 samples from 80 volunteers, 37 who had had a previous PCR positive result) [25] . None of these concerns preclude the use of DBS for surveillance programs using the Roche Elecsys ® Nucleoprotein antibody assay, as long as the limits of detection (which will vary depending on elution efficiency and the dilution factor associated) are determined, verified and monitored and provided and the population antibody distribution is periodically monitored using plasma assays to allow correction for DBS insensitivity. When considering J o u r n a l P r e -p r o o f large-scale DBS testing programmes, additional factors which might impact on programme success include the more complex processing of DBS samples relative to plasma samples upon arrival in the testing laboratory. However, this may not be a substantial barrier as options for automation have been presented by Gaugler et al [26] . J o u r n a l P r e -p r o o f phlebotomists, including those from Mo Phlebotomy Plc, who took the venous and DBS samples. Finally, we would like to thank all those who volunteered to take part in this study. Public Health England. EL & RB perform contract research on behalf of PHE for GSK, Pfizer and Sanofi Pasteur. EL & RB perform contract research on behalf of PHE for GSK, Pfizer and Sanofi Pasteur outside of the submitted work. No other authors have any conflict of interests to declare. Completed an online questionnaire n = 3,087 Did not attend study clinic n= 220 Attended study clinic n=2,867 Requested removal from study prior to analysis n= 5 Accuracy of UK Rapid Test Consortium Rapid Test' for detection of previous SARS-CoV-2 infection in key workers: Test accuracy study Diagnostic performance of seven rapid IgG / IgM antibody tests and the Euroimmun IgA / IgG ELISA in COVID-19 patients Comparative assessment of multiple COVID-19 serological technologies supports continued evaluation of point-ofcare lateral flow assays in hospital and community healthcare settings Evaluation of Serological SARS-CoV-2 Lateral Flow Assays for Rapid Point of Care Testing Clinical and laboratory evaluation of SARS-CoV-2 lateral flow assays for use in a national COVID-19 seroprevalence survey Dried Blood Spot Tests for the Diagnosis and Therapeutic Monitoring of HIV and Viral Hepatitis B and C Suitability and Sufficiency of Telehealth Clinician-Observed, Participant-Collected Samples for SARS-CoV-2 Testing: The iCollect Cohort Pilot Study Newborn Dried Blood Spots for Serologic Surveys of COVID-19 Standardization of enzyme-linked immunosorbent assays for serosurveys of the SARS-CoV-2 pandemic using clinical and at-home blood sampling Carleen Can dried blood spots (DBS) contribute to conducting comprehensive SARS-CoV-2 antibody tests? Multiplexed detection and quantification of human antibody response to COVID-19 infection using a plasmon enhanced biosensor platform High seroprevalence for SARS-CoV-2 among household members of essential workers detected using a dried blood spot assay At-home self-collection of saliva, oropharyngeal swabs and dried blood spots for SARS-CoV-2 diagnosis and serology: Post-collection acceptability of specimen collection process and patient confidence in specimens Covid-19: Roll out of 10m antibody tests to begin next week, government announces What a drop can do: dried blood spots as a minimally invasive method for integrating biomarkers into population-based research Dried blood spot self-sampling at home is a feasible technique for hepatitis C RNA detection Stability of human immunodeficiency virus type 1 antibodies in whole on filter paper and stored under various tropical conditions in Kinshasa, Zaire World Health Organisation: Guidance on regulations for the Transport of Infectious Substances Summary report : National event for early lessons learnt from the opt-out blood-borne virus ( BBV ) testing policy in prisons Performance characteristics of five immunoassays for SARS-CoV-2: a head-to-head benchmark comparison Self assessment overestimates historical COVID-19 disease relative to sensitive serological assays : cross sectional study in UK key workers Authors pROC: an open-source package for R and S+ to analyze and compare ROC curves Problems of spectrum and bias in evaluating the efficacy of diagnostic tests A serological assay to detect SARS-CoV-2 antibodies in at-home collected finger-prick dried blood spots Sensitive Detection of SARS-CoV-2-Specific Antibodies in Dried Blood Spot Samples Fully automated dried blood The authors would like to thank key collaborators: Chief Inspector Julie Rawsthorne from the National Police Wellbeing Service and Simon Fryer, Area Manager, Lancashire Fire & Rescue Service for their support in running clinics on site. We would like to thank Megan Lamb and Melissa Murove for their on-site support. We would like to thank all the