Gray circles represent VCNs of 74 individual SARS-CoV-2–positive preprocedural screening samples (median [interquartile range] VCN, 2.90 [2.26-6.11] log10 RNA copies/mL). Blue squares represent VCNs of 2910 individual SARS-CoV-2-positive outpatient diagnostic samples (median [interquartile range] VCN, 6.11 [4.05-7.62] log10 RNA copies/mL).
The performance of single-sample testing is shown on the y-axis (pool size = 1) of each graph.
eAppendix. Additional Methods for Study Population, Laboratory Testing, COVID19 Pool Tool, and Virtual Diagnostic Study Analysis
eFigure 1. Screenshot of COVID19 Pool Tool User Interface
eFigure 2. Example COVID19 Pool Tool Results
Customize your JAMA Network experience by selecting one or more topics from the list below.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Polage CR, Lee MJ, Hubbard C, et al. Assessment of an Online Tool to Simulate the Effect of Pooled Testing for SARS-CoV-2 Detection in Asymptomatic and Symptomatic Populations. JAMA Netw Open. 2020;3(12):e2031517. doi:10.1001/jamanetworkopen.2020.31517
Policy makers are promoting pooled testing as a strategy to increase the number of people tested for the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) during the coronavirus disease 2019 (COVID-19) pandemic, especially for population screening.1,2 However, combining samples before testing brings trade-offs, such as decreasing the sensitivity and increasing the complexity of testing, that should be considered.3-6 We created an online tool using actual SARS-CoV-2 virus copy number (VCN) data—the COVID19 Pool Tool—to help policy makers understand how pooled testing compares with single-sample testing in different populations.
This diagnostic study was approved with a waiver of consent and Health Insurance Portability and Accountability Act authorization by the Duke Health institutional review board as part of retrospective SARS-CoV-2 test method comparison and validation studies. This study follows the 2015 Standards for Reporting of Diagnostic Accuracy (STARD) reporting guideline.
We used droplet digital polymerase chain reaction (PCR) to count SARS-CoV-2 copy numbers in patient samples and create quantitative curves for 3 US Food and Drug Administration Emergency Use Authorized SARS-CoV-2 reverse transcriptase–PCR qualitative tests. We used these curves to convert positive nasopharyngeal PCR cycle threshold (Ct) values to droplet digital PCR–harmonized VCNs for these tests. We created an online tool that allows users to define the sample size, pool size, positivity rate, and test characteristics and to compare pooled testing with single-sample testing using actual VCN data (the COVID19 Pool Tool; see the Additional Information at the end of the article for the URL). The tool uses VCNs from preprocedural screening samples (ie, no clinical suspicion for COVID-19) and outpatient diagnostic samples (ie, clinical suspicion for COVID-19) to simulate asymptomatic and symptomatic SARS-CoV-2–positive patients. The tool generates random virtual pools with positive samples pulled from VCN data mirroring the expected positivity rate and calculates pool VCNs with the expected dilution. The tool uses VCNs and user-defined test characteristics to predict which positive pools and samples are detected or missed, the sensitivity of pooled and single sample testing, and the number of tests performed. Additional details are shown in the eAppendix in the Supplement.
We used this tool to compare pooled testing with single-sample testing via a common reverse transcriptase–PCR assay (RealTime SARS-CoV-2 Assay; Abbott), with a 95% limit of detection of 100 VCNs/mL and an absolute limit of detection of 2 VCNs/mL, for detection of asymptomatic and symptomatic SARS-CoV-2–positive patients at various positivity rates. A screenshot of the COVID19 Pool Tool user interface is shown in eFigure 1 in the Supplement, and an example of COVID19 Pool Tool results is shown in eFigure 2 in the Supplement.
Calculation of VCNs from Ct values was performed using Excel software version 2016 (Microsoft). Figures were created in Prism software version 6.0c (GraphPad) and Excel. Data analysis was performed in August 2020 using data collected from March to July 2020.
Figure 1 shows the 74 preprocedural screening sample VCNs (median [interquartile range] VCN, 2.90 [2.26-6.11] log10 RNA copies/mL) and 2910 outpatient diagnostic sample VCNs (median [interquartile range] VCN, 6.11 [4.05-7.62] log10 RNA copies/mL) used to simulate asymptomatic and symptomatic SARS-CoV-2–positive patients in the tool. Figure 2 compares pooled testing with single-sample testing across positivity rates. Pooled testing increased the number of false-negative cases per 1000 patients and decreased the sensitivity of SARS-CoV-2 detection, especially for low-VCN samples and asymptomatic patients (Figure 2A and B). For example, the mean (SD) sensitivity of 5-sample pooled testing for detection of asymptomatic patients with a 10% positivity rate in the population was 77.57% (4.40%) vs 92.83% (8.38%) for single-sample testing. Figure 2C and D show that pooled testing decreased the number of tests needed to screen 1000 patients, but this effect was reduced by repeat testing to identify cases from positive pools for contract tracing, especially at high prevalence. Figure 2E and F show that pooled testing identified more positive patients per 1000 tests performed by testing more patients, but repeat testing reduced this benefit.
Pooled testing can extend SARS-CoV-2 test supplies and increase the number of patients tested and cases detected, making it useful for population screening and resource-constrained settings. The complicated workflow, lower sensitivity for low-VCN patients, and need to repeat tests for positive pools are drawbacks. Sequential 2-stage pooling could reduce the burden of retesting from positive large pools (see Additional Information at the end of the article for the 2-stage COVID19 Pool Tool URL). The lack of clinical data for laboratory samples is a potential limitation of this study. This tool offers policy makers an easy to use tool to inform regional and national decision-making about the pros and cons of pooled testing.
Accepted for Publication: November 5, 2020.
Published: December 10, 2020. doi:10.1001/jamanetworkopen.2020.31517
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Polage CR et al. JAMA Network Open.
Corresponding Author: Michael B. Datto, MD, PhD, Duke Health System Clinical Laboratories, DUMC Box 3712, Room 353M, Green Zone Duke South Hospital, Duke Medicine Circle, Durham, NC 27710 (firstname.lastname@example.org).
Author Contributions: Drs Polage and Datto had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Polage, Lee, Hubbard, Cardona, Datto.
Acquisition, analysis, or interpretation of data: Polage, Lee, Rehder, Denny, Datto.
Drafting of the manuscript: Polage, Hubbard, Datto.
Critical revision of the manuscript for important intellectual content: Polage, Lee, Rehder, Cardona, Denny, Datto.
Statistical analysis: Lee, Datto.
Obtained funding: Datto.
Administrative, technical, or material support: Hubbard, Rehder, Cardona, Denny, Datto.
Supervision: Polage, Denny, Datto.
Conflict of Interest Disclosures: Dr Lee reported receiving personal fees from Roche Diagnostics outside the submitted work. No other disclosures were reported.
Additional Contributions: We thank the staff of the Duke University Health System Clinical Laboratories and Duke Human Vaccine Institute for SARS-CoV-2 RT-PCR test validation and testing and processing of clinical samples; the staff was not compensated beyond their usual salaries.
Additional Information: The COVID19 Pool Tool is available at https://covid19pooltool.z13.web.core.windows.net/. An example of 2-stage pooling is shown at https://covid19pooltool2stage.z13.web.core.windows.net/.
Create a personal account or sign in to: