key: cord-0894094-6i6rez6k
authors: See, I.; Paul, P.; Slayton, R.; Steele, M.; Stuckey, M.; Duca, L.; Srinivasan, A.; Stone, N.; Jernigan, J. A.; Reddy, S.
title: Modeling effectiveness of testing strategies to prevent COVID-19 in nursing homes--United States, 2020
date: 2020-12-22
journal: nan
DOI: 10.1101/2020.12.18.20248255
sha: 1f1d28b2ae9a7975d943309888dd33df6d016624
doc_id: 894094
cord_uid: 6i6rez6k

Background: SARS-CoV-2 outbreaks in nursing homes can be large with high case fatality. Identifying asymptomatic individuals early through serial testing is recommended to control COVID-19 in nursing homes, both in response to an outbreak ("outbreak testing" of residents and healthcare personnel) and in facilities without outbreaks ("non-outbreak testing" of healthcare personnel). The effectiveness of outbreak testing and isolation with or without non-outbreak testing was evaluated. Methods: Using published SARS-CoV-2 transmission parameters, the fraction of SARS-CoV-2 transmissions prevented through serial testing (weekly, every three days, or daily) and isolation of asymptomatic persons compared to symptom-based testing and isolation was evaluated through mathematical modeling using a Reed-Frost model to estimate the percentage of cases prevented through either outbreak testing alone or outbreak plus non-outbreak testing. The potential effect of simultaneous decreases (by 10%) in the effectiveness of isolating infected individuals when instituting testing strategies was also evaluated. Results: Modeling suggests that outbreak testing could prevent 54% (weekly testing with 48-hour test turnaround) to 92% (daily testing with immediate results and 50% relative sensitivity) of SARS-CoV-2 infections. Adding non-outbreak testing could prevent up to an additional 8% of SARS-CoV-2 infections (depending on test frequency and turnaround time). However, added benefits of non-outbreak testing were mostly negated if accompanied by decreases in infection control practice. Conclusions: When combined with high-quality infection control practices, outbreak testing could be an effective approach to preventing COVID-19 in nursing homes, particularly if optimized through increased test frequency and use of tests with rapid turnaround.

Coronavirus disease 2019 has affected the majority of nursing homes in the United States [1] ; outbreaks in this setting can rapidly spread to involve the majority of residents in a single facility, with case fatality rates >20% [2] . To prevent introduction and transmission of SARS-CoV-2, nursing homes have been recommended to implement a variety of precautions including instituting symptom monitoring of residents and healthcare personnel (HCP), testing symptomatic persons promptly, and instituting infection control practices including, but not limited to, isolating individuals with SARS-CoV-2 infection [3] . However, because SARS-CoV-2 transmission also occurs from asymptomatic and pre-symptomatic infected individuals, in addition to practices of universal mask-wearing of residents and HCP, identifying asymptomatic infected individuals early through testing is also recommended to control COVID-19 in nursing homes [4] . CDC guidance recommends that an outbreak response in a nursing home should be triggered when a single infection in a resident considered to have been acquired at the facility is discovered or a new infection in HCP is identified [5] . In this situation, CDC currently recommends testing all residents and HCP every 3-7 days until no new cases are identified. In addition, in facilities not experiencing an outbreak, serial testing of all HCP is currently recommended, at intervals dependent on the level of county transmission [6] .

Infection prevention and control strategies in nursing homes might be hampered by shortages of testing supplies [7] and the time-consuming effort needed to implement widespread testing strategies. The impact of various testing strategies for asymptomatic residents and HCP has not been well characterized and understanding the relative benefit of testing strategies may help prioritize resources. The objective of this manuscript is to provide estimates of the effectiveness of either outbreak testing or combining outbreak and nonoutbreak testing for preventing COVID-19 in nursing homes under different scenarios of test frequency and performance.

"Outbreak testing" was defined as serial testing (e.g., daily, every three days, weekly) of all residents and HCP immediately following recognition of an initial COVID-19 case. "Nonoutbreak testing" was defined as serial testing of HCP in the absence of a known COVID-19 case. Mathematical modeling was used to evaluate two paradigms for using testing to help control COVID-19 in nursing homes: (1) outbreak testing that begins immediately following recognition of an initial case, and (2) non-outbreak testing in facilities when outbreaks are not occurring combined with outbreak testing once cases are identified. Testing frequency, turnaround time, and sensitivity were varied to broadly reflect testing capabilities as of November 2020. The primary quantities of interest were the "effectiveness" of a testing strategy, defined as the percent of cases prevented; and the "efficiency" of a testing strategy, defined as the number of cases prevented divided by the number of tests used.

for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

The copyright holder for this this version posted December 22, 2020. ; https://doi.org/10.1101/2020. 12.18.20248255 doi: medRxiv preprint Evaluating these strategies for a "typical" nursing home, required estimating three quantities through modeling: first, the expected number of SARS-CoV-2 infections occurring in an outbreak without testing of asymptomatic persons, i.e., infection control is directed only by testing and isolating symptomatic residents and HCP. This quantity is considered the "baseline" outbreak size because, conceptually, our evaluation is for paradigms of testing asymptomatic persons. Second, the expected number of SARS-CoV-2 infections occurring per outbreak when outbreak testing is conducted. The difference between this quantity and the baseline outbreak size is considered to be the number of cases prevented by outbreak testing. Third, the expected percentage of SARS-CoV-2 outbreaks prevented by non-outbreak testing.

Parameters used for the model and estimates were set as follows: during the early months of the pandemic the mean number of residents from CMS-certified nursing homes was 86 [8] . The HCP per resident ratio was set at 1.5:1, yielding 129 HCP at the facility based on the following rationale: analysis of the payroll-based journal data from the Centers for Medicare and Medicaid Services (PBJ) suggest that on average 1.2 full-time equivalent HCP per resident are employed by each nursing home [9] . However, this likely represents a minimum estimate because some HCP work part-time, i.e., the number of HCP is expected to be greater than the number of full-time equivalent HCP. In some areas where facility-wide testing of and residents has been conducted, the HCP per resident ratio has been as high as 2:1 (CDC, unpublished data). A ratio of 1.5 HCP per resident was chosen as closer to the midpoint of these estimates. Although these estimates for number of HCP may include some workers who do not have direct resident contact, such HCP may still be at risk for acquiring COVID-19 in nursing homes or transmitting to others (e.g., HCP-to-HCP transmission). Estimates of infectivity from asymptomatic or pre-symptomatic persons [10] varied over the course of illness and were used to calculate the expected reduction of transmission occurring from detecting these people through testing and isolating them (supplemental methods). All scenarios model introductions of SARS-CoV-2 into the facility through HCP only, e.g., no visitors are permitted.

To estimate the expected size of an outbreak at baseline, a Reed-Frost model [11] was used to model the transmission of SARS-CoV-2 during a nursing home outbreak. The total population size is the number of residents plus the number of HCP. We estimated the reproductive number R0 for outbreaks under the following conditions: (1) the only testing occurring was of symptomatic persons, (2) isolation of symptomatic persons occurred, and (3) recommendations for other established infection control practices (e.g., isolating patients, universal facemasks and cloth face coverings) were in place (supplemental methods). This R0 is referred to as the "unmitigated" R0, and is used to generate the baseline outbreak size.

To determine the outbreak size when using outbreak testing, modeling based on viral dynamics of SARS-CoV-2 was used to estimate the reduction in transmission μ expected from the testing strategy (supplemental methods). The mitigated reproductive number R0' was calculated by multiplying the unmitigated R0 by the reduction in transmission μ expected from the testing strategy. This R0' generated the outbreak size using outbreak testing.

for use under a CC0 license.

This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

The copyright holder for this this version posted December 22, 2020. ; https://doi.org/10.1101/2020.12.18.20248255 doi: medRxiv preprint For calculations involving non-outbreak testing, the proportion of outbreaks prevented was set to equal μ. This corresponds to an assumption that an outbreak (at baseline) will typically be introduced by a single person so that the proportion of transmissions prevented equals the proportion of outbreaks averted. As outlined in the supplemental methods, this was combined with estimates of outbreak testing to determine the effectiveness and efficiency of using both outbreak and non-outbreak testing.

The "baseline" test sensitivity was modeled to vary during the course of illness with test sensitivity proportional to infectiousness early in the course of illness (supplemental methods). Peak sensitivity was set at 95% reflecting best understanding of reported reverse-transcriptase polymerase chain reaction (RT-PCR) test characteristics [12] . To mirror realistic and recommended tests available, outbreak and non-outbreak testing strategies were primarily evaluated with weekly and every-three-days testing intervals with either a 24-hour or 48-hour turnaround time and sensitivity corresponding to RT-PCR; or an estimated sensitivity of 85% (compared to RT-PCR tests), with immediate turnaround time, i.e., point-of-care test (supplemental methods). The lower sensitivity of 85% was chosen to match the lower end of the range of sensitivity reported for currently available point-of-care tests [13] . We also evaluated a hypothetical outbreak and non-outbreak testing strategy in which a point-of-care test with 50% sensitivity is used for daily testing. These testing scenarios with lower sensitivity were evaluated because some investigators have advocated for the development of and adoption of rapid tests with lower sensitivity [14] . We also evaluated weekly and every-threedays testing with a lower sensitivity (50%) point-of-care platform because of reports that existing point-of-care tests may have lower sensitivity for detecting asymptomatic individuals [15] .

The above analyses evaluated the impact of adding non-outbreak testing to outbreak testing with a 10% probability of SARS-CoV-2 introduction to a facility during the week that testing occurs, which corresponded to the overall national picture during July-September 2020 (supplemental methods). As a sensitivity analysis, this probability was increased to evaluate the potential impact of non-outbreak testing in areas with higher levels of community transmission.

We considered that implementing a more comprehensive testing strategy might place increased demands on staff time and require additional PPE resources. We postulated that these increases might have a deleterious effect on a facility's ability to control transmission through adherence to infection control protocols. To estimate this effect, we calculated the impact of a relatively small (i.e., 10%) decrease (from a default of 100%) in the effectiveness of preventing transmission by isolating infected persons when adding non-outbreak testing to outbreak testing.

Additional sensitivity analyses used adaptations of three alternate infectivity profiles from the literature to calculate the above quantities (supplemental methods; supplemental table S1).

for use under a CC0 license.

This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. 

At all currently recommended testing intervals with acceptable turnaround times (i.e., 48 hours or less), outbreak testing alone is estimated to prevent 54% (weekly testing with 48-hour turnaround time) to 90% of cases (point-of-care testing every three days) associated with a COVID-19 outbreak (Table 1) . Adding weekly or every-three-day non-outbreak testing to outbreak testing prevented up to 8% of additional cases. Combining outbreak and nonoutbreak testing every three days with a point-of-care test prevented 95% of cases. In addition, at a given testing frequency and turnaround time, increasing either the frequency of the testing or decreasing the turnaround time for outbreak testing was estimated to prevent more infections than adding non-outbreak testing with the same frequency and turnaround time. In an exploratory analysis, use of a daily POC test with 50% sensitivity was estimated to prevent 92% of cases using outbreak testing alone and 97% of cases using both outbreak and nonoutbreak testing.

Combining outbreak and non-outbreak testing in the setting of a 10% decrease in the effectiveness of isolating infected persons prevented fewer cases than outbreak testing alone with complete effectiveness of isolation for all testing frequencies, turnaround, and test sensitivity scenarios evaluated except when testing every three days with 24-hour turnaround time or POC testing with 85% sensitivity. In these scenarios, adding non-outbreak testing but decreasing effectiveness of isolating infected persons was estimated to prevent an additional 2-3% of cases compared to outbreak testing alone with complete effectiveness of isolation.

The number of tests needed to prevent a case through outbreak testing alone (range: 41-145 tests/case prevented) was lower than through combining outbreak and non-outbreak testing (range: 60-238).

When conducting outbreak and non-outbreak testing every three days with a point-ofcare test with 85% sensitivity, as the likelihood of SARS-CoV-2 introductions per week increased, the percent of cases prevented was estimated to remain unchanged at 95% (Figure) . However, as the likelihood of SARS-CoV-2 introductions increased, the number of tests needed to prevent a case was estimated to decrease from 90 tests/case prevented at a 10% likelihood of introductions to 9 tests/case prevented at a 100% likelihood of introductions when combining outbreak and non-outbreak testing (Figure) .

for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

The copyright holder for this this version posted December 22, 2020. ; https://doi.org/10.1101/2020.12.18.20248255 doi: medRxiv preprint As a sensitivity analysis when using alternative infectivity profiles (Table S1) , the magnitude of benefit of outbreak testing varied (Tables S2-S4) . For example, testing weekly with 48-hour turnaround prevented 31-74% of infections depending on the infectivity profile. However, in all of these sensitivity analyses adding non-outbreak testing added a relatively small percentage benefit to outbreak testing alone, not exceeding 8% for any test turnaround/frequency/sensitivity regardless of infectivity profile. In addition, for all but one infectivity profile (Table S4) , for the majority of testing scenarios modeled outbreak testing alone was superior to combining outbreak and non-outbreak testing if combined testing was associated with decreases in effectiveness of isolating patients.

Preventing COVID-19 in nursing homes is a high priority for the pandemic response [16] . In our analysis, serially testing asymptomatic residents and HCP in response to an outbreak to guide infection control response prevented the majority of SARS-CoV-2 infections in a hypothetical nursing home with 86 residents and 129 staff. In addition, optimizing and prioritizing outbreak testing to facilitate increased test frequency with rapid turnaround times while maintaining high-quality infection control practice is estimated to be an efficient strategy while also nearly maximizing number of infections prevented.

Ensuring robust symptom identification with prompt testing in response to a potential new SARS-CoV-2 infection, and subsequently eliminating transmission from persons with COVID-19 through isolation, is essential for responses using outbreak testing to be effective. Nursing homes with outbreaks frequently face staff shortages [17] , which may limit capacity to perform necessary patient care activities, infection prevention activities, or increased testing. If redirecting resources from recommended infection control practices to testing leads to small reductions in the effectiveness of infection control practices, then the combination of outbreak and non-outbreak testing could be less effective than just performing outbreak testing with high-quality infection control.

These findings also support current recommendations from CDC and CMS [6, 18] to prioritize testing of symptomatic residents and HCP first, followed by testing residents and staff in response to outbreaks, and finally non-outbreak testing of asymptomatic HCP. The addition of non-outbreak testing may provide a modest benefit, although it requires more testing resources to prevent each COVID-19 case. The testing resources required (per case prevented) did decrease as the likelihood of SARS-CoV-2 introductions (i.e., level of community transmission) increased. The impact is still only modest even when SARS-CoV-2 introductions are more frequent than observed in the United States in July-September 2020. The reason that non-outbreak testing only has a modest benefit is that the benefit of non-outbreak testing relies on the ability to identify infected persons at key times in the course of their illness: the pre-symptomatic infectious period and, for asymptomatic individuals, the period of peak for use under a CC0 license.

This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

The copyright holder for this this version posted December 22, 2020. ; https://doi.org/10.1101/2020. 12.18.20248255 doi: medRxiv preprint infectiousness. Both of these time periods are narrow (e.g., pre-symptomatic period of 2-3 days) and easily missed without very frequent (e.g., every three days or more often) testing [10, 14] . Furthermore, implementing high-quality outbreak response leads to smaller outbreaks, which then reduces the added benefit of non-outbreak testing because the outbreaks prevented through non-outbreak testing are smaller in size.

The results described in this paper also support current recommendations that performing outbreak testing every three days is the preferred frequency when initiating an outbreak response, if this does not detract from other important activities such as infection control procedures [18] . In general, testing strategies with better turnaround time and higher frequency were estimated to be more effective if other conditions (e.g., infection control practices) remained constant.

The federal government is providing nursing homes with point-of-care antigen testing platforms [19] . The analysis conducted in this manuscript suggests that the advantage of faster turnaround time from such platforms may outweigh the disadvantage of potential lower sensitivity. Practical considerations may still limit how frequently these tests can be performed through serial testing strategies. An exploratory analysis suggested that a hypothetical strategy using daily point-of-care testing with lower (e.g., 50%) sensitivity could be as effective as, or even more effective than, relying on more sensitive tests used less frequently. Daily testing is likely not currently feasible in all nursing homes and would need widespread availability of inexpensive, simple testing options that could be run on easy-to-collect specimen types. In addition, making a test with 50% sensitivity available (that might facilitate daily testing) would require changes to the current regulatory framework [20] [21] [22] [23] [24] .

These findings are subject to at least five limitations. First, the analysis used mathematical modeling rather than directly studying an implementation. However, the model parameters have been reviewed as suitable to use for pandemic planning scenarios and are based on observational data about SARS-CoV-2 transmission [10] . The patterns seen and comparisons made from results, therefore, are likely reasonable even if the absolute estimates themselves may lack precision. Second, outbreaks in facilities have been assumed to be independent. Since some HCP work in more than one facility [4] , the potential effectiveness of both testing strategies has been underestimated on a population level. Third, other unintended consequences of asymptomatic testing were not evaluated, such as identifying false positives during non-outbreak testing with population prevalence of COVID-19. Even if using a test with 99.4% specificity, most facilities without COVID-19 might expect at least one false positive result after testing all its staff. Fourth, the actual infectivity profile of SARS-CoV-2 infection is not known with certainty, although our main conclusions appear to be robust when evaluating several published infectivity profiles. Finally, if infection control practices, in general, are not optimal, then the benefits of testing strategies will be less than we have estimated. For example, we assume that outbreak testing occurs immediately after identification of a recognized case, while in practice delays could occur.

for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

The copyright holder for this this version posted December 22, 2020. ; https://doi.org/10.1101/2020. 12.18.20248255 doi: medRxiv preprint In summary, testing asymptomatic persons in response to an outbreak is an effective and efficient strategy to supplement optimized infection control practices to limit SARS-CoV-2 transmissions in nursing homes. The benefit of outbreak testing strategies may increase with more frequent outbreak testing with rapid turnaround times, but most importantly require careful effort to ensure that infection control measures are effectively implemented.

COVID-19 Nursing Home Data

Presymptomatic SARS-CoV-2 infections and transmission in a skilled nursing facility

Preparing for COVID-19 in Nursing Homes

COVID-19 in a Long-Term Care Facility

Testing Guidelines for Nursing Homes

Centers for Medicare & Medicaid services Center for Clinical Standards and Quality/Survey & Certification Group. QSO-20-38-NH. Available at

Supply Shortages Impacting COVID-19 and Non-COVID Testing

Nursing Home Compare datasets

Long-Term-Care-Facili/PBJ-Public-Use-Files-Data-Documentation/ygny-gzks

COVID-19 Pandemic Planning Scenarios

Design and Analysis of Vaccine Studies. Chapter 4: Binomial and Stochastic Transmission Models

Variation in False Negative Rate of RT-PCR Based SARS-CoV-2 Tests by Time Since Exposure

Centers for Disease Control and Prevention. Interim Guidance for Rapid Antigen Testing for SARS-CoV-2. Available at

Test sensitivity is secondary to frequency and turnaround time for COVID-19 surveillance

The New York Times

Trump Is Taking Strong Action to Further Protect Nursing Homes from the Coronavirus

Serial Testing for SARS-CoV-2 and Virus Whole Genome Sequencing Inform Infection Risk at Two Skilled Nursing Facilities with COVID-19 Outbreaks -Minnesota

Clinical Questions about COVID-19: Questions and Answers

Trump Administration Announces Initiative for More and Faster COVID-19 Testing in Nursing Homes

Food and Drug Administration (FDA)

Molecular Diagnostic Template for Commercial Manufacturers

Molecular Diagnostic Template for Laboratories

Antigen Template for Test Developers

Template for Manufacturers of Molecular and Antigen Diagnostic COVID-19 Tests for Non-Laboratory Use

The authors would like to thank Christopher Czaja, MD, DrPH (Colorado Department of Public Health and Environment) for discussions about nursing home outbreak response in Colorado early in the COVID-19 pandemic.

The findings and conclusions in this report are those of the authors and do not necessarily represent the views and the official position of the Centers for Disease Control and Prevention. 12 

Percent SARS-CoV-2 infections prevented and number of tests needed per case prevented when serially testing asymptomatic nursing home residents and staff in response to outbreaks ("outbreak testing"), combining this testing strategy with serial testing of asymptomatic staff in the absence of known cases ("outbreak+non-outbreak testing"), and conducting both outbreak and nonoutbreak testing with a concomitant 10% decrease in the effectiveness of halting SARS-CoV-2 transmission through isolating identified cases. Cases occurring using these strategies are compared to the number occurring with use of only symptom-based testing and isolation a .

Outbreak + non-outbreak testing b,c