k indicates the number of patients in a pool; and k0 (circles), the optimal pool size at which maximal cost-savings was achieved for various prevalence levels. These examples assumed a test sensitivity of 70%.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Cherif A, Grobe N, Wang X, Kotanko P. Simulation of Pool Testing to Identify Patients With Coronavirus Disease 2019 Under Conditions of Limited Test Availability. JAMA Netw Open. 2020;3(6):e2013075. doi:10.1001/jamanetworkopen.2020.13075
Specimens from patients with suspected coronavirus disease 2019 (COVID-19) undergo real-time reverse transcriptase–polymerase chain reaction (RT-PCR) testing for qualitative severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) RNA detection. The high demand for SARS-CoV-2 RT-PCR tests during the COVID-19 pandemic has resulted in local shortages, prompting researchers to consider pool testing strategies.1
Pool testing strategies build on testing a pooled sample from several patients: if the results from the pool test are negative, all patients in the pooled sample are declared not to have COVID-19; if the results of the pool are positive, each patient sample is tested individually. The pooled testing strategy is appealing, particularly when test availability is limited. However, any test sensitivity less than 100% bears the risk of a false-negative result for the entire pool. To support informed decision-making regarding the implementation of pool testing for COVID-19, we have developed a probabilistic model to estimate the risk of false negatives considering 3 determining factors: COVID-19 prevalence, test sensitivity, and patient pool size.
This decision analytical model study did not require institutional review board review because it used simulation-based research, per Common Rule 45 CFR §102 (e). This study followed the Strengthening the Reporting of Empirical Simulation Studies (STRESS) reporting guideline.
We considered a 2-stage pool testing2,3 in the presence of imperfect testing, in which p is prevalence, Se is test sensitivity, and Sp is specificity. We assumed that the probability of a true-positive result pool test equals Se, the probability of a false-positive result equals 1 − Sp, test Se and Sp would be unaffected by the number of patients in a pool (k), and all tests are identically distributed. Let Z be a random variable denoting the number of tests needed to complete the pooling strategy. Let N be the total number of patients, then there are N/k subgroups, each with k members. Assuming independent Bernoulli trials, let Pk be the probability of having at least 1 positive test in k patients. If 1 patient of the subgroup has RT-PCR results positive for SARS-CoV-2, then there will be (k + 1) tests necessary; otherwise, only 1 test will be needed. The expected number of tests for each subgroup with k patients is (k + 1)Pk + (1 − Pk). Then, for N/k subgroups, the expected number of tests needed is E(Z) = (N/k)[(k + 1)Pk + (1 − Pk)] = (N/k)[kPk + 1], in which Pk = (1 − Sp)(1 − p)k + Se(1 − (1 − p)k), which incorporates the effects of test sensitivity and specificity. The optimal pool size is achieved for k that minimizes E(Z). To characterize the pooled test strategy, we define efficiency of the pool as Ef = E(Z)/N = [kPk + 1]/k and expected number of false negatives (ENFN) as kp(1 − S2e) This method does not include a dilution effect on the pooling strategy sensitivity, PS = S2e, as a function of pool size, where S2e provides the upper bound of the pooling sensitivity.
For demonstration purposes, we reported the results for a typical number of RT-PCR tests for 94 patients, a specificity of 100%, a prevalence from 0.001% to 40%, and sensitivities from 60% to 100% (Table). Mathematical simulations showed that a pool testing strategy was an improvement over individual testing for a prevalence less than 30% and that the optimal pool size, k0, was approximately 1 + 1/√(pSe),p ∈ (0.1%, 30%). For a realistic scenario, such as a sensitivity of 70% and prevalence of 1%, the optimal strategy required 13 patients per subgroup. With this optimal pool size, only 16% as many tests would be required by subgroup tests than by individual tests. The Figure shows test efficiency, cost savings, probability of false negatives, and the expected number of false negatives for k and p.
This decision analytical model study found that pool testing efficiency varied with prevalence, test sensitivity, and patient pool size. Therefore, pool testing may be considered as an alternative, especially in circumstances of limited SARS-CoV-2 test availability and a COVID-19 prevalence less 30%. One potential limitation of pool testing is that the false-negative rate may increase owing to dilution of positive samples. The mean viral load of more than 1.5 × 104 RNA copies per mL in nasal swabs4 spikes within the first week after clinical onset and reaches 1.5×107 RNA copies per mL.5 In our example with an optimal pool size of 13 patients, high-sensitivity RT-PCR assays with a lower detection limit of more than 1100 RNA copies per mL will detect SARS-CoV-2 in pooled samples. If sensitivity of the test at hand is a concern, test swabs can be collected and eluted into 1 virus transportation medium container, thereby increasing reliability. However, this requires re-collecting individual samples if a pool tests positive. The mathematical underpinning of the proposed method is generic and can be applied to other infectious diseases.6
Accepted for Publication: May 26, 2020.
Published: June 23, 2020. doi:10.1001/jamanetworkopen.2020.13075
Open Access: This is an open access article distributed under the terms of the CC-BY-NC-ND License. © 2020 Cherif A et al. JAMA Network Open.
Corresponding Author: Alhaji Cherif, PhD, Research Division, Renal Research Institute, 315 E 62nd St, 4th Floor, New York, NY 10065 (firstname.lastname@example.org).
Author Contributions: Dr Cherif had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Cherif, Grobe, Kotanko.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Cherif, Grobe, Kotanko.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Cherif.
Administrative, technical, or material support: Grobe, Kotanko.
Conflict of Interest Disclosures: All authors are employees of the Renal Research Institute, a wholly owned subsidiary of Fresenius Medical Care North America. Dr Kotanko reported owning stock in Fresenius Medical Care.
Create a personal account or sign in to: