key: cord-0873355-bkhyt2c2 authors: Bolotin, Shelly; Tran, Vanessa; Osman, Selma; Brown, Kevin A; Buchan, Sarah A; Joh, Eugene; Deeks, Shelley L; Allen, Vanessa G title: SARS-CoV-2 seroprevalence survey estimates are affected by anti-nucleocapsid antibody decline date: 2021-01-05 journal: J Infect Dis DOI: 10.1093/infdis/jiaa796 sha: 2ea02ee467f5965dea1e1105802c48e17267322d doc_id: 873355 cord_uid: bkhyt2c2 We analyzed 21,676 residual specimens from Ontario, Canada collected between March-August, 2020 to investigate the effect of antibody decline on SARS-CoV-2 seroprevalence estimates. Testing specimens orthogonally using the Abbott (anti-nucleocapsid) and then the Ortho (anti-spike) assays, seroprevalence estimates ranged from 0.4%-1.4%, despite ongoing disease activity. The geometric mean concentration (GMC) of antibody-positive specimens decreased over time (p=0.015), and the GMC of antibody-negative specimens increased over time (p=0.0018). The association between the two tests decreased each month (p<0.001), suggesting anti-N antibody decline. Lowering the Abbott antibody index cut-off from 1.4 to 0.7 resulted in a 16% increase in positive specimens. M a n u s c r i p t 3 Background Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease 2019 (COVID-19), emerged as a novel pathogen in late 2019. By mid-September, 2020 it has resulted in over 28 million cases and nearly one million deaths worldwide [1] . In Ontario, Canada, the first pandemic wave peaked in mid-April [2] . This was followed by lower but sustained disease activity between June and August, with elevated case counts in various hot-spots in the province. By September 22, 2020 there were approximately 48,000 cases reported provincially for a population of 14.8 million residents [2] . As part of Ontario's pandemic response, Public Health Ontario (PHO) initiated a SARS-CoV-2 serosurveillance program to estimate the proportion of the population that has been infected, identify demographic risk factors for infection, and enhance the pandemic response [3] . The program utilizes residual specimens submitted to the PHO Laboratory from March, 2020 onwards. We tested specimens using an orthogonal approach in order to minimize false positives, particularly when population prevalence is low, in line with a recommendation by the Centers for Disease Control and Prevention [4] . Despite ongoing disease activity [2] , we were surprised to discover that there were no substantial changes in Ontario seroprevalence estimates over the first five serosurveys conducted from March to August, 2020, with very low seroprevalence estimates throughout this period [3 and unpublished] . Recent studies by others have reported declining antibody levels in confirmed SARS-CoV-2 cases. However, these findings have generally been based on symptomatic, confirmed individuals or small groups of asymptomatic cases, with limited reporting of antibody decline at the population level [5] [6] [7] . We therefore investigated populationlevel antibody decline using Ontario serosurveillance data. A c c e p t e d M a n u s c r i p t 4 We conducted five cross-sectional SARS-CoV-2 serosurveys (March 27 -April 30; May 24 -31; June 5 -30; July 4 -31; August 1-21, 2020), using residual sera, plasma and blood specimens remaining after routine clinical testing at the PHO Laboratory. Specimens were selected to represent both sexes, all age groups and all geographic regions in Ontario. Using an orthogonal testing approach, we first tested specimens with the Abbott Architect SARS-CoV-2 IgG test (Abbott Laboratories, USA), which detects anti-nucleocapsid (N) antibodies, then tested positive samples with the Ortho-Clinical Diagnostics VITROS Anti-SARS-CoV-2 IgG test (Ortho-Clinical Diagnostics, Inc., USA), which detects anti-spike (S) antibodies [8] . We used the manufacturers' recommended antibody index (AI) value cut-off of 1.4 and 1.0 for the Abbott and Ortho assays, respectively. Specimens that were positive using both tests were considered positive for SARS-CoV-2 antibodies. To explore the effect of lowering the AI value on population seroprevalence, we analyzed a subset of specimens with an AI value of 0.7, otherwise maintaining the same orthogonal approach as above. To investigate changes in the average antibody concentration over time, we calculated the geometric mean concentration (GMC) of serology specimens for each collection period. Since GMC cannot be calculated with zero values, we first replaced zero AI values with a value of 0.01/ √2 [9] , with 0.01 being the lowest non-zero value reported by the Abbott instrument. We used linear regression to assess the trend in GMC across months and truncated linear regression to examine the association between the Abbott and Ortho AI values through time [10] . Truncation was used to account for potential bias introduced by using orthogonal testing since this analysis only includes A c c e p t e d M a n u s c r i p t 5 samples where the Abbott result was ≥1.4. We fit one model for the overall association as well as one model for each of the five monthly serosurveys. To investigate the relationship between the Abbott and Ortho results over time, we fit a regression model with the statistical interaction between date and the slope to measure the change in slope through time. Ethics approval for the serosurveys was granted by the PHO Ethics Review Board. We tested a total of 21,676 specimens over the five time periods. Of these, 3 (Table 1) . Overall, 318 specimens were positive for SARS-CoV-2 antibodies using the Abbott assay, of which 231 (72.6%) were also positive using the Ortho assay. To explore whether SARS-CoV-2 antibody decline could account for the lack of increase in seroprevalence estimates over time, we first compared the GMCs for each sampling period. GMCs of specimens that were positive by the Abbott assay (n=318), which was the only assay with which all specimens were tested, were relatively stable for our first three sampling periods. However, a decline was observed from 3.7 (95% CI 3.4, 4.1) in June to 3.3 (95% CI 3.0, 3.7) in July, and then to 3.1 (95% CI 2.8, 3.4) in August (linear regression p for all sampling periods =0.015) ( Table 1) . Conversely, the GMC of specimens that tested negative by the Abbott assay (n=21,358) increased incrementally from May to August (linear regression p for all sampling periods =0.0018). The statistically significant decrease and increase in GMCs over time for both Abbott positive and negative specimens, respectively, suggests that population-level SARS-CoV-2 antibodies has declined over time. The GMC of positive and negative specimens using the Ortho assay fluctuated over time A c c e p t e d M a n u s c r i p t 6 ( Table 1) , but changes were not statistically significant (linear regression p=0.29 and 0.35, respectively). To explore how antibody decline might impact our seroprevalence estimates, we examined the relationship between the Abbott and Ortho assay results over time for the 318 specimens that were tested using both assays. Overall, there was a strong association between the assays, such that each Ortho AI value increase of 10 was associated with an Abbott AI value increase of 1.4 (95% CI 1.2, 1.7). Additionally, we found that the magnitude of the association decreased over time (Figure 1 ). Specifically, we found that in April, each Ortho AI value increase of 10 was associated with an Abbott AI value increase of 2.5 (95% CI 0.005, 5.1), while in June the association was 1.5 (95% CI 1. Our observed trend of anti-N antibody decline using the Abbott assay has potential implications on seroprevalence estimates, because using our orthogonal approach specimens that test negative using the Abbott assay would not be subsequently tested using the Ortho assay, and would be deemed negative. To further explore this, we tested a subset of specimens collected in August, 2020 (N = 4,166) with the same orthogonal approach, but lowered the Abbott AI value to 0.7 to account for anti-N antibody decline. While using a cut-off of 1.4 resulted in 43/4,166 specimens (1.0%) that were positive by both assays, lowering the AI cut-off resulted in seven additional positive specimens, for a total of 50/4,166 (1.2%). anti-N antibodies detected by the Abbott Architect SARS-CoV-2 IgG assay, over a five month period. This finding has implications for serosurveys that use the Abbott Architect assay or other anti-N A c c e p t e d M a n u s c r i p t 7 assays, alone or as part of an orthogonal approach. Our results suggest that the anti-N antibody decline is substantial enough to affect the results of population seroprevalence surveys, especially in high prevalence settings. Due to overall low seroprevalence in Ontario, our observed antibody decline represented only a small change in estimates, from 1.0% to 1.2%. However, lowering the Abbott AI cut-off resulted in a 16% increase in positive specimens, which would make a substantial difference in jurisdictions where population seroprevalence was higher. Since seroprevalence data are often used to estimate the proportion of individuals infected, including those who are not captured as cases through RT-PCR testing, antibody decline may also result in an underestimate of SARS-CoV-2 infections at the population level. Others investigating SARS-CoV-2 antibody decline have reported conflicting results. Assessing individual immune responses, Long et al. [6] found decline in both anti-N and anti-S IgG antibody levels by eight weeks after hospital discharge. Conversely, Wu and colleagues reported stable anti-S and anti-N IgG activity six months post-infection [11] . Similarly, an analysis of >1,000 specimens from Icelandic patients using various assays directed against both anti-N and anti-S antibodies found durable IgG responses four months after diagnosis [5] . Exploration of antibody decline at the population level is less common. However, Public Health England recently reported an increase in equivocal serosurveillance results using an anti-S IgG assay [12] . It is likely that contrasting study results are related to differences between the populations sampled, time of sampling in relation to onset of infection, as well as the variety of assays used [5] . There are several modifications that can be made to SARS-CoV-2 serosurveillance testing protocols to address the issue of antibody decline, while still maintaining an orthogonal approach. We have shown here that lowering the AI value of the Abbott anti-N assay to increase sensitivity to account for potential antibody decline would result in a higher proportion of positive specimens. However, we recognize that this would change the test characteristics markedly. Using sera from SARS-CoV-2 RT-PCR positive patients, a study by Bryan and colleagues determined that lowering the Abbott A c c e p t e d M a n u s c r i p t 8 assay AI cut-off from 1.4 to 0.7 resulted in test sensitivity (≥7 days from symptom onset) rising from 84.2% to 88.0%, and test specificity decreasing from 100.0% to 99.6% [13] . However, retaining an orthogonal approach may mitigate the reduced specificity. Alternatively, switching to a different anti-N assay may alleviate the issue of antibody decline. Although anti-N antibodies have been shown to decline faster than anti-S antibodies, the magnitude of decline seems to be somewhat assay-specific, and therefore switching anti-N assays may result in more durable serology measures [14] . Consideration should be given to the portion of the N antigen that is used in serology assays, as this may impact the ability to detect a durable antibody response. Our analysis included >21,000 specimens over five months, representing SARS-CoV-2 unexposed individuals as well as infected individuals of all ages, who likely experienced a spectrum of SARS-CoV-2 disease symptoms and severity. This is a strength of our study, since many analyses of SARS-CoV-2 antibody decline to date have focused on individual humoral responses using specimens from symptomatic individuals who presented to medical care, or small groups of asymptomatic individuals [5] [6] [7] . While these studies are essential for characterizing individual immune responses to SARS-CoV-2, they have a limited ability to shed light on population-level antibody decline, which may have different kinetics than those observed in small groups of previously infected individuals [5] . However, our study was limited by the cross-sectional nature of our serosurveys. Since our specimens were de-identified, we could not follow individual antibody concentrations longitudinally to explore the determinants of antibody decline, such as disease severity, age or sex. This also limited our ability to explore the reasons behind the trend of increasing GMC in Abbott-negative specimens. While we suspect that the negative specimens included samples from infected individuals that declined into the non-reactive range of the test, our cross-sectional approach does not allow us to investigate this further. Lastly, due to our testing algorithm, only a subset of our specimens were tested using the Ortho assay. Changes in the Ortho GMC were not statistically significant, and we suspect this may be due to selection bias towards specimens with higher antibody concentrations in this group. Although we took this selection bias into account by using a A c c e p t e d M a n u s c r i p t 9 truncated regression model to compare our two assays, it still limited our ability to characterize anti-S antibody levels over time. As the COVID-19 pandemic progresses, it is becoming clear that although serology tests may not always correlate to virus neutralization [15], they are integral to understanding population exposure, since not every infected individual is tested and reported as a case. New solutions to mitigate the issue of antibody decline are a priority area of research. A c c e p t e d M a n u s c r i p t World Health Organization. Coronavirus disease (COVID-2019) situation reports Ontario Agency for Health Protection and Promotion (Public Health Ontario) Ontario Agency for Health Protection and Promotion (Public Health Ontario) Interim Guidelines for COVID-19 Antibody Testing Humoral Immune Response to SARS-CoV-2 in Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections Change in Antibodies to SARS-CoV-2 Over 60 Days Among Health Care Personnel in Nashville, Tennessee EUA Authorized Serology Test Performance Methods for Handling Left-Censored Data in Quantitative Microbial Risk Assessment Heteroscedastic Censored and Truncated Regression with crch SARS-CoV-2 infection induces sustained humoral immune responses in convalescent patients following symptomatic COVID-19. medRxiv Performance Characteristics of the Abbott Architect SARS-CoV-2 IgG Assay and Seroprevalence in Vaccine and Infectious Disease Division Longitudinal analysis of serology and neutralizing 95% CI) 22 Author contributions All authors have contributed to this work and have approved the final version of the manuscript. SB conceived the idea for the study. SB, KB, SO, EJ and VT analyzed the data, and all authors provided subject-matter expertise with interpreting the data. The authors have no conflicts of interest to declare A c c e p t e d M a n u s c r i p t 11 A c c e p t e d M a n u s c r i p t A c c e p t e d M a n u s c r i p t A c c e p t e d M a n u s c r i p t