[Skip to Navigation]
Sign In
Figure 1.  Diagram of Study Design
Diagram of Study Design

This figure shows the key elements of the study design. The study index date for each patient was the day of the patient’s first observed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibody test on or after January 8, 2020. Follow-up occurred in 30-day increments after the index date. COVID-19 indicates coronavirus disease 2019; NAAT indicates nucleic acid amplification test.

Figure 2.  Subsequent Diagnostic Nucleic Acid Amplification Test (NAAT) Results at 30-Day Intervals
Subsequent Diagnostic Nucleic Acid Amplification Test (NAAT) Results at 30-Day Intervals

This figure shows the results of diagnostic NAAT after initial antibody testing. A, The line shows the ratio of positive diagnostic tests among those who initially tested positive for antibodies vs those who initially tested negative. B, Over each time period, the dark blue bars show the percent of patients who tested positive for the diagnostic test among those who initially tested positive for antibodies with corresponding confidence intervals. The light blue bars show the percent of patients who tested positive for the diagnostic test among those who initially tested negative for antibodies with corresponding confidence intervals.

Figure 3.  Subsequent Antibody Testing Among Index Antibody-Positive Patients Over Time
Subsequent Antibody Testing Among Index Antibody-Positive Patients Over Time

This figure shows the results of subsequent antibody tests among the group of patients with an initial positive antibody test (n = 378 606). A, The line shows the percentage of patients who subsequently tested negative in each time period. B, Over the 4 time periods, light blue bars represent those who subsequently tested negative for antibodies, while dark blue bars show those who subsequently tested positive.

Table.  Baseline and Preindex Characteristics
Baseline and Preindex Characteristics
1.
Stadlbauer  D, Tan  J, Jiang  K,  et al.  Repeated cross-sectional sero-monitoring of SARS-CoV-2 in New York City.   Nature. 2020. Published online November 3, 2020. doi:10.1038/s41586-020-2912-6PubMedGoogle Scholar
2.
Wajnberg  A, Amanat  F, Firpo  A,  et al.  Robust neutralizing antibodies to SARS-CoV-2 infection persist for months.   Science. 2020;370(6521):1227-1230. Published online October 28, 2020. doi:10.1126/science.abd7728PubMedGoogle ScholarCrossref
3.
Gudbjartsson  DF, Norddahl  GL, Melsted  P,  et al.  Humoral immune response to SARS-CoV-2 in Iceland.   N Engl J Med. 2020;383(18):1724-1734. doi:10.1056/NEJMoa2026116PubMedGoogle ScholarCrossref
4.
Long  Q-X, Tang  X-J, Shi  Q-L,  et al.  Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections.   Nat Med. 2020;26(8):1200-1204. doi:10.1038/s41591-020-0965-6PubMedGoogle ScholarCrossref
5.
Ward  H, Atchison  CJ, Whitaker  M,  et al  Antibody prevalence for SARS-CoV-2 in England following first peak of the pandemic: REACT2 study in 100,000 adults.   medRxiv. Published online August 21, 2020. doi:10.1101/2020.08.12.20173690Google Scholar
6.
Zuo  J, Dowell  A, Pearce  H,  et al  Robust SARS-CoV-2-specific T-cell immunity is maintained at 6 months following primary infection.   bioRxiv. Published online January 1, 2020. doi:10.1101/2020.11.01.362319Google Scholar
7.
Ibarrondo  FJ, Fulcher  JA, Goodman-Meza  D,  et al.  Rapid decay of anti-SARS-CoV-2 antibodies in persons with mild Covid-19.   N Engl J Med. 2020;383(11):1085-1087. doi:10.1056/NEJMc2025179PubMedGoogle ScholarCrossref
8.
Pray  IW.  COVID-19 outbreak at an overnight summer school retreat—Wisconsin, July–August 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(43);1600–1604. doi:10.15585/mmwr.mm6943a4Google Scholar
9.
Addetia  A, Crawford  KH, Dingens  A,  et al  Neutralizing antibodies correlate with protection from SARS-CoV-2 in humans during a fishery vessel outbreak with high attack rate.   Journ Clin Microbiol. 2020;58(11):e02107-20. doi:10.1128/JCM.02107-20Google Scholar
10.
Jeremias  S.  First case of COVID-19 reinfection detected in the US.  American Journal of Managed Care. October 12, 2020. Accessed November 11, 2020. https://www.ajmc.com/view/first-case-of-covid-19-reinfection-detected-in-the-us
11.
Boomerang  JVL. Albany County resident reinfected with COVID-19 months after recovery. Casper Star-Tribune Online. October 29, 2020. Accessed November 11, 2020. https://trib.com/news/state-and-regional/health/albany-county-resident-reinfected-with-covid-19-months-after-recovery/article_b88aeff7-091e-5afb-9ee3-1b5715e9e219.html
12.
Tillett  RL, Sevinsky  JR, Hartley  PD,  et al.  Genomic evidence for reinfection with SARS-CoV-2: a case study.   Lancet Infect Dis. 2021;21(1):52-58. doi:10.1016/S1473-3099(20)30764-7PubMedGoogle ScholarCrossref
13.
Iwasaki  A.  What reinfections mean for COVID-19.   Lancet Infect Dis. 2021;21(1):3-5. doi:10.1016/S1473-3099(20)30783-0PubMedGoogle ScholarCrossref
14.
Hoang  VT, Dao  TL, Gautret  P.  Recurrence of positive SARS-CoV-2 in patients recovered from COVID-19.   J Med Virol. 2020;92(11):2366-2367. doi:10.1002/jmv.26056PubMedGoogle ScholarCrossref
15.
Li  N, Wang  X, Lv  T.  Prolonged SARS-CoV-2 RNA shedding: not a rare phenomenon.   J Med Virol. 2020;92(11):2286-2287. doi:10.1002/jmv.25952PubMedGoogle ScholarCrossref
16.
AlJishi  JM, Al-Tawfiq  JA.  Intermittent viral shedding in respiratory samples of patients with SARS-CoV-2: observational analysis with infection control implications.   J Hosp Infect. 2021;107:98-100. doi:10.1016/j.jhin.2020.09.011PubMedGoogle ScholarCrossref
17.
Lee  PH, Tay  WC, Sutjipto  S,  et al.  Associations of viral ribonucleic acid (RNA) shedding patterns with clinical illness and immune responses in severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection.   Clin Transl Immunology. 2020;9(7):e1160. doi:10.1002/cti2.1160PubMedGoogle Scholar
18.
Li  TZ, Cao  ZH, Chen  Y,  et al.  Duration of SARS-CoV-2 RNA shedding and factors associated with prolonged viral shedding in patients with COVID-19.   J Med Virol. Published online July 9, 2020.PubMedGoogle Scholar
19.
Morone  G, Palomba  A, Iosa  M,  et al.  Incidence and persistence of viral shedding in COVID-19 post-acute patients with negativized pharyngeal swab: a systematic review.   Front Med (Lausanne). 2020;7:562. doi:10.3389/fmed.2020.00562PubMedGoogle ScholarCrossref
20.
Surkova  E, Nikolayevskyy  V, Drobniewski  F.  False-positive COVID-19 results: hidden problems and costs.   Lancet Respir Med. 2020;8(12):1167-1168. doi:10.1016/S2213-2600(20)30453-7PubMedGoogle ScholarCrossref
21.
Agarwal  V, Venkatakrishnan  AJ, Puranik  A,  et al.  Long-term SARS-CoV-2 RNA shedding and its temporal association to IgG seropositivity.   Cell Death Discov. 2020;6(1):138. doi:10.1038/s41420-020-00375-yPubMedGoogle ScholarCrossref
22.
Meschi  S, Colavita  F, Bordi  L,  et al; INMICovid-19 laboratory team.  Performance evaluation of Abbott ARCHITECT SARS-CoV-2 IgG immunoassay in comparison with indirect immunofluorescence and virus microneutralization test.   J Clin Virol. 2020;129:104539. doi:10.1016/j.jcv.2020.104539PubMedGoogle Scholar
23.
US Food and Drug Administration. EUA authorized serology test performance. December 7, 2020. Accessed December 7, 2020. https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/eua-authorized-serology-test-performance
24.
US Food and Drug Administration. Real-world evidence. November 24, 2020. Accessed December 28, 2020. https://www.fda.gov/science-research/science-and-research-special-topics/real-world-evidence
25.
Sherman  RE, Anderson  SA, Dal Pan  GJ,  et al.  Real-world evidence—what is it and what can it tell us?   N Engl J Med. 2016;375(23):2293-2297. doi:10.1056/NEJMsb1609216PubMedGoogle ScholarCrossref
26.
von Elm  E, Altman  DG, Egger  M, Pocock  SJ, Gøtzsche  PC, Vandenbroucke  JP; STROBE Initiative.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.   Ann Intern Med. 2007;147(8):573-577. doi:10.7326/0003-4819-147-8-200710160-00010PubMedGoogle ScholarCrossref
27.
Sethuraman  N, Jeremiah  SS, Ryo  A.  Interpreting diagnostic tests for SARS-CoV-2.   JAMA. 2020;323(22):2249-2251. doi:10.1001/jama.2020.8259 PubMedGoogle ScholarCrossref
28.
Ainsworth  M, Andersson  M, Auckland  K,  et al; National SARS-CoV-2 Serology Assay Evaluation Group.  Performance characteristics of five immunoassays for SARS-CoV-2: a head-to-head benchmark comparison.   Lancet Infect Dis. 2020;20(12):1390-1400. doi:10.1016/S1473-3099(20)30634-4PubMedGoogle ScholarCrossref
29.
Theel  ES, Harring  J, Hilgart  H, Granger  D.  Performance characteristics of four high-throughput immunoassays for detection of IgG antibodies against SARS-CoV-2.   J Clin Microbiol. 2020;58(8):e01243-20. doi:10.1128/JCM.01243-20 PubMedGoogle Scholar
30.
Hopkins  JS. Pfizer’s Covid-19 vaccine proves 90% effective in latest trials. Wall Street Journal. November 9, 2020. Accessed November 9, 2020. https://www.wsj.com/articles/covid-19-vaccine-from-pfizer-and-biontech-works-better-than-expected-11604922300
31.
National Institutes of Health. Promising interim results from clinical trial of NIH-Moderna COVID-19 vaccine. November 15, 2020. Accessed December 11, 2020. https://www.nih.gov/news-events/news-releases/promising-interim-results-clinical-trial-nih-moderna-covid-19-vaccine
32.
Polack  FP, Thomas  SJ, Kitchin  N,  et al; C4591001 Clinical Trial Group.  Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine.   N Engl J Med. 2020;383(27):2603-2615. doi:10.1056/NEJMoa2034577PubMedGoogle ScholarCrossref
33.
Lumley  SF, O’Donnell  D, Stoesser  NE,  et al; Oxford University Hospitals Staff Testing Group.  Antibody status and incidence of SARS-CoV-2 infection in health care workers.   N Engl J Med. 2020. doi:10.1056/NEJMoa2034545PubMedGoogle Scholar
34.
Pottegård  A, Kurz  X, Moore  N, Christiansen  CF, Klungel  O.  Considerations for pharmacoepidemiological analyses in the SARS-CoV-2 pandemic.   Pharmacoepidemiol Drug Saf. 2020;29(8):825-831. doi:10.1002/pds.5029PubMedGoogle ScholarCrossref
35.
Camm  AJ, Fox  KAA.  Strengths and weaknesses of “real-world” studies involving non-vitamin K antagonist oral anticoagulants.   Open Heart. 2018;5(1):e000788. doi:10.1136/openhrt-2018-000788PubMedGoogle Scholar
36.
Makady  A, de Boer  A, Hillege  H, Klungel  O, Goettsch  W; (on behalf of GetReal Work Package 1).  What is real-world data? a review of definitions based on literature and stakeholder interviews.   Value Health. 2017;20(7):858-865. doi:10.1016/j.jval.2017.03.008PubMedGoogle ScholarCrossref
37.
Miksad  RA, Abernethy  AP.  Harnessing the power of real-world evidence (RWE): a checklist to ensure regulatory-grade data quality.   Clin Pharmacol Ther. 2018;103(2):202-205. doi:10.1002/cpt.946PubMedGoogle ScholarCrossref
2 Comments for this article
EXPAND ALL
Additional data that would be helpful
James Marzolf, MD MPH MSc | Whole Health Institute
Very intriguing study with encouraging results. It would have been helpful to know the cycle threshold (Ct) values for the nucleic acid amplification tests (NAATs) used.
CONFLICT OF INTEREST: None Reported
Insights from commercial laboratory data.
Elizabeth Jenny-Avital, MD | Jacobi Medical Center; Bronx, NY
What a valuable data set! I hope it can be followed up over more time so that we really have a sense of how much protection is afforded to COVID experienced individuals over time and during viral evolution. What would be incredibly useful is to see if vaccine information could be added to the data set. Placebo controlled vaccine trials that include sero-status at baseline, shed some light on this question when incidence rates are compared between seropositive and seronegative in the placebo group--but this type of study will likely soon be a thing of the past as effective vaccines make placebo unethical.
I am, however, disturbed that our nation's public health laboratory infrastructure is not at the helm of this task.

Thanks!
CONFLICT OF INTEREST: None Reported
READ MORE
Original Investigation
February 24, 2021

Association of SARS-CoV-2 Seropositive Antibody Test With Risk of Future Infection

Author Affiliations
  • 1Aetion, Inc, New York, New York
  • 2HealthVerity, Philadelphia, Pennsylvania
  • 3Quest Diagnostics, Secaucus, New Jersey
  • 4LabCorp, Burlington, North Carolina
  • 5National Cancer Institute, National Institutes of Health, Bethesda, Maryland
JAMA Intern Med. 2021;181(5):672-679. doi:10.1001/jamainternmed.2021.0366
Key Points

Question  Can observational clinical data from commercial laboratories be used to evaluate the comparative risk of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection for individuals who are antibody positive vs those who are antibody negative?

Finding  In this cohort study of more than 3.2 million US patients with a SARS-CoV-2 antibody test, 0.3% of those indexed with positive test results had evidence of a positive nucleic acid amplification test beyond 90 days after index, compared with 3.0% indexed with negative antibody test results.

Meaning  Individuals who are seropositive for SARS-CoV-2 based on commercial assays may be at decreased future risk of SARS-CoV-2 infection.

Abstract

Importance  Understanding the effect of serum antibodies to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on susceptibility to infection is important for identifying at-risk populations and could have implications for vaccine deployment.

Objective  The study purpose was to evaluate evidence of SARS-CoV-2 infection based on diagnostic nucleic acid amplification test (NAAT) among patients with positive vs negative test results for antibodies in an observational descriptive cohort study of clinical laboratory and linked claims data.

Design, Setting, and Participants  The study created cohorts from a deidentified data set composed of commercial laboratory tests, medical and pharmacy claims, electronic health records, and hospital chargemaster data. Patients were categorized as antibody-positive or antibody-negative according to their first SARS-CoV-2 antibody test in the database.

Main Outcomes and Measures  Primary end points were post-index diagnostic NAAT results, with infection defined as a positive diagnostic test post-index, measured in 30-day intervals (0-30, 31-60, 61-90, >90 days). Additional measures included demographic, geographic, and clinical characteristics at the time of the index antibody test, including recorded signs and symptoms or prior evidence of coronavirus 2019 (COVID) diagnoses or positive NAAT results and recorded comorbidities.

Results  The cohort included 3 257 478 unique patients with an index antibody test; 56% were female with a median (SD) age of 48 (20) years. Of these, 2 876 773 (88.3%) had a negative index antibody result, and 378 606 (11.6%) had a positive index antibody result. Patients with a negative antibody test result were older than those with a positive result (mean age 48 vs 44 years). Of index-positive patients, 18.4% converted to seronegative over the follow-up period. During the follow-up periods, the ratio (95% CI) of positive NAAT results among individuals who had a positive antibody test at index vs those with a negative antibody test at index was 2.85 (95% CI, 2.73-2.97) at 0 to 30 days, 0.67 (95% CI, 0.6-0.74) at 31 to 60 days, 0.29 (95% CI, 0.24-0.35) at 61 to 90 days, and 0.10 (95% CI, 0.05-0.19) at more than 90 days.

Conclusions and Relevance  In this cohort study, patients with positive antibody test results were initially more likely to have positive NAAT results, consistent with prolonged RNA shedding, but became markedly less likely to have positive NAAT results over time, suggesting that seropositivity is associated with protection from infection. The duration of protection is unknown, and protection may wane over time.

Introduction

Since the emergence of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in late 2019, limited research has shown that the majority of patients who clear their infections develop serum antibodies against the virus that last for at least several months1-6 but may decline over time.7 Although it has been speculated that the development of antibodies may be associated with a decreased risk of reinfection, the evidence for this hypothesis is limited and often anecdotal.8,9 Furthermore, documented reports of reinfection in patients with SARS-CoV-2 antibodies have raised the possibility that seropositivity might be associated with limited protection against different viral strains.10-14 Individuals infected with SARS-CoV-2 may also shed viral RNA without producing live virus for 12 weeks or more after resolution of symptoms,15-20 making it challenging to distinguish reinfection from prolonged RNA shedding. As the coronavirus disease 2019 (COVID-19) pandemic continues, understanding the role of serostatus on the potential for infection is critical, as it may drive choices of personal behavior and expectations about herd immunity. It might also help inform the challenging policy decisions surrounding the prioritization of vaccine supplies.

Commercially available antibody assays, with their high sensitivity and low false-positive rates,21-23 serve as a useful marker of prior SARS-CoV-2 infection, but to date, their ability to predict the risk of future infection is unknown. Given the critical lack of data in this area, the US Centers for Disease Control currently recommend that individual serology results not be used for any decision-making regarding personal behavior (such as return to work, use of personal protective equipment, and social distancing). These gaps highlight the clear need for generalizable data that can elucidate the effect of seropositivity on risk of future infection. This type of observational data, often referred to as real-world data,24,25 represents an opportunity as they are available longitudinally at the individual level and make it possible to study the experiences of a seropositive population with COVID-19 in near-real time, while maximizing sample size and observability over time.

In this article, we employ an approach leveraging a large set of clinical laboratory data linked to other clinical information such as claims and chargemaster information to investigate the relationship between SARS-CoV-2 antibody status and subsequent nucleic acid amplification test (NAAT) results, in an effort to understand how serostatus may predict risk of reinfection.

Methods

Quiz Ref IDIn this retrospective observational descriptive cohort study, we used deidentified individual-level laboratory testing data provided by HealthVerity (Philadelphia, PA), a for-profit data aggregator that provides access to linked data from 70 different commercial health data sources. Data available for this study included results from several national and regional clinical commercial laboratories, representing more than 50% of commercial antibody and diagnostic testing in the US (see eFigure 1 and eFigure 2 in the Supplement). These longitudinally linked commercial laboratory data were the primary data sources for this study’s analyses. In addition, longitudinal data on each individual were captured from open and closed medical and pharmacy claims, electronic health records, and hospital billing records from multiple vendors (see details in eAppendix in the Supplement). These data were used to assess the availability of data to characterize patient-level comorbid conditions and other risk factors that might affect infection risk and outcome. The data derived from laboratories, medical record systems, and insurance claims cover the US but may under-sample the Midwest region. To create the consolidated, deidentified data set with longitudinal patient views, all data partners used the HealthVerity technology within their system to create a unique, secure, encrypted, and nonidentifiable patient token from identifiable information. This token was then employed as a consistent linkage key across data sets, and enabled follow-up of patients who, for example, used multiple laboratory providers. No protected health information or personal identifying information left the data owner’s possession, and all research data were certified by expert determination to be compliant with the Health Insurance Portability and Accountability Act rules. As part of this process, race and ethnicity were removed from the files. To maintain nonidentifiability of patients, race and ethnicity information was not available in the research data set.

Study reporting follows the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for observational studies.26 The study was approved under exemption by the New England Institutional Review Board (#1-9757-1).

The antibody testing performed by commercial laboratories includes a limited set of high-throughput antibody tests with validation against a known standard providing between 98% and 100% agreement with both known antibody-positive and antibody-negative specimens, with a 95% CI of 99% to 100% agreement. An evaluation of the US Food and Drug Administration emergency use authorization documents shows that the composite negative validation data demonstrate a 95% confidence interval range of 99% to 100%.22,23 Tests performed in these commercial laboratories are those specific for immunoglobulin (Ig) G, IgA, or IgM, as well as those that detect multiple immunoglobulin types, although most tests performed during the study period were IgG (>91%).

We examined records from December 1, 2018, through August 26, 2020, and identified individuals with a recorded SARS-CoV-2 antibody test on or after January 2020. Each patient entered the cohort on the day of their first recorded antibody test, which was defined as the index date (see Figure 1). Individuals who had more than 1 antibody test with discordant results on the index day were excluded. Using our linked longitudinal data set, we assessed demographic and geographic characteristics at index, as well as evidence of prior SARS-CoV-2 infection and key associated clinical characteristics and comorbidities. These characteristics were measured as recorded in the EHR, administrative claims, and hospital records.

We characterized patients’ initial antibody test results as positive, negative, or inconclusive, and created 3 associated groups. We then followed patients to the end of available data (August 26, 2020) to identify further antibody testing and/or NAAT diagnostic testing, looking in 30-day intervals (0-30, 31-60, 61-90, >90 days). Within each interval and for each of the 3 index antibody groups, we assessed both the frequency of subsequent antibody or NAAT diagnostic testing and the test results. An individual was characterized as testing positive for an antibody or NAAT during a time period if they had at least 1 positive test during that period. Patients were counted uniquely within each time period and could have been included in multiple time periods. All analyses were done on the Aetion Evidence Platform (Aetion, Inc, New York, NY), version R4.11. Confidence intervals around the ratio of proportions were estimated using the natural logarithm method for the rate ratios presented in Figure 2.

Results

A total of 3 257 478 unique patients with an index antibody test were identified after excluding 132 patients with discordant antibody tests on the index day. Of these, 2 876 773 (88.3%) had a negative index antibody result (seronegatives), 378 606 (11.6%) had a positive index antibody result (seropositives), and 2099 (0.1%) had an inconclusive index antibody result (sero-uncertain) (Table). As the sero-uncertain group was a small fraction of the study population, further reported results focus only on the seropositive and seronegative groups. Approximately 55% in each group were female. The index seronegative group was somewhat older than the index seropositive group (mean [SD] of 48 [17.6] vs 44 [18.1] years). A higher proportion of index seropositive individuals resided in the Northeast United States, with fewer in the rest of the country (eFigure 1 in the Supplement). The seropositive and seronegative groups each had a median of 396 days of observable person-time prior to the index date. Over that time, most COVID-19 signs and symptoms were similar between the seropositive and seronegative groups, although the seropositive groups had higher proportions of recorded fever (6.3% among seropositives vs 3.5% among seronegatives), acute respiratory failure (1.2% vs 0.4%), and viral infection (4.3% vs 2.0%). Other comorbidities were largely comparable between the seropositive and seronegative groups, with the exceptions of obesity (19.5% vs 16.8%) and vitamin D deficiency (14.5% vs 12.3%), which were slightly higher among individuals who were seropositive than seronegative (Table). As expected, evidence of prior COVID-19 diagnosis varied across the 3 groups. Evidence of prior disease based on laboratory, claims, and/or chargemaster diagnostic codes was 0.7% for the seronegative group, 18.4% for the seropositive group, and 6.7% for the sero-uncertain group. These results indicate that seropositive individuals were more likely to have had symptoms of and/or a diagnosis of COVID-19 than seronegative individuals, although the majority of subjects in both groups lacked evidence of prior infection in the observable data.

The linked data permitted individual longitudinal follow-up for a median of 47 days (interquartile range [IQR], 8 to 88 days) for the seronegative group and a median of 54 days (IQR, 17 to 92 days) for the seropositive group. Over the available follow-up time, we examined the duration of seropositivity in the index positive cohort. Quiz Ref IDAmong the 378 606 patients with a positive antibody test at index, 9895 (2.6%) had at least one subsequent antibody test during follow-up. For the index seropositive patients who were retested, 12.4% tested negative when retested within 0 to 30 days, increasing to 18.4% testing seronegative when the subsequent antibody test occurred more than 90 days after the index antibody test (Figure 3). These findings are consistent with prior studies suggesting that antibody levels wane in a modest fraction of individuals over a period of months after initial detection.1-3

We next considered the relationship between index serostatus and future NAAT testing patterns. Among the seropositive patients, 41 587 (11.0%) had 1 or more NAAT during follow-up, while among seronegative patients, 273 735 (9.5%) did so. Patients may have had multiple NAATs during follow-up; seropositive patients had a mean of 3.3 NAATs over the follow-up period, while seronegative patients had 2.3 tests on average. Sero-uncertain patients were tested less frequently, with 1.5 tests per patient performed on average.

Quiz Ref IDAmong patients with a positive index antibody result, 3226 (11.3%) had a positive diagnostic NAAT during follow-up that occurred within 30 days of index, decreasing consistently to 2.7% from 31 to 60 days, 1.1% from 61 to 90 days, and 0.3% at more than 90 days (Figure 2). For the seronegative patients, 5638 (3.9%) showed a positive NAAT result within 30 days. That proportion remained relatively consistent at approximately 3.0% over all subsequent periods of observation, including after 90 days (Figure 3). The ratio of positive NAAT results among patients who had a positive antibody test at index vs those with a negative antibody test at index declined from 2.85 (95% CI, 2.73-2.97) at 0 to 30 days; to 0.67 (95% CI, 0.6-0.74) at 31 to 60 days; to 0.29 (95% CI, 0.24-0.35) at 60 to 90 days; and to 0.10 (95% CI, 0.05-0.19) at more than 90 days.

Discussion

Early in the observation period, particularly in the first 30 days, positive NAAT results among seropositive patients are likely attributable to prolonged shedding of viral RNA, which is expected to decrease through the following weeks. The increased rate of NAAT result positivity observed within the first 30 days of a positive antibody test is consistent with persistent shedding of viral RNA.15-20 Beyond 90 days, the vast majority of viral shedding is expected to have ceased, so positive NAAT results seen at a later interval from the index antibody test may represent new infections. False positives are expected to be rare given the high specificity of NAAT, and they are thought to generally reflect technical errors or reagent contamination (the latter is less likely due to internal controls).27-29 Under the assumptions that positive diagnostic tests among seronegative patients represent infections and that positive diagnostic tests among patients who first tested seropositive more than 90 days prior also represent infections, we observed 2 notable results. Quiz Ref IDFirst, the relatively steady approximately 3.0% proportion of positive NAATs among index seronegative patients suggests a stable background infection rate over the study period.

Quiz Ref IDSecond, while our study was not appropriate for estimating a relative risk, the ratio of positive NAAT results among index seropositive individuals compared with index seronegative individuals was substantially lower—an approximately 10-fold decrease—suggesting a protective effect of antibodies. While some patients may have ongoing viral RNA shedding for weeks after infection, the sharp decline in NAAT-positive results over time in the antibody-positive cohort vs antibody-negative cohort suggests that seropositive individuals are at decreased risk for future SARS-CoV-2 infection. As the pandemic infection rates varied both over time and by geographic area, we performed a preliminary stratified analysis that evaluated the risk of subsequent infection by geographic region in the United States. Although the numbers were small for some regions, the results showed a consistent decline in the ratio of NAAT positivity among seropositive vs seronegative patients in all regions over the 4 study intervals, similar to the overall analysis. This consistency supports the same level of reduction in future risk and is unlikely to be attributable to pandemic patterns of testing and/or spread (data shown in eTable in the Supplement). The degree of protection (10-fold) associated with seropositivity appears to be comparable to that observed in the initial reports of the efficacy of mRNA vaccines in large clinical trials.30-32 Of course, protection induced by a safe vaccine is clearly preferable, as the population-wide risk of a serious outcome from an authorized or approved vaccine is expected to be orders of magnitude lower than that from natural infection. Additionally, this study corroborates the findings reported by Lumley et al33; however, the cohort in this study is larger and more generalizable to the general population as it extends beyond health care workers.

Limitations

Quiz Ref IDGiven the observational nature of the study, it is possible that antibody test results affected individual behavior, potentially confounding the results. We do not, however, think that behavior differences are likely to explain the observed protection. For example, if individuals with evidence of prior infection (seropositive individuals) were more likely to believe they possessed immunity to SARS-CoV-2, then they would be expected to engage in social behavior that placed them at greater, not less, risk for infection. Likewise, it is possible that seropositive individuals might be less likely to seek evaluation for subsequent symptoms of COVID-19, but, in fact, we observed that antibody-positive individuals were more likely to have follow-up NAAT than antibody-negative individuals (3.3 vs 2.3 subsequent tests).

We do not have insight into the clinical characteristics of the seropositive individuals who appeared to develop new infections after the index time point, nor could we specifically assess the clinical course of these possible infections compared with infections among the seronegative group in this study. However, some of the individuals who had NAAT-positive results more than 60 days after an index seropositive test may represent true infections, as reinfection has been described in a small number of cases.8-11 Therefore, on a population-wide basis, protection against reinfection is likely relative rather than complete. Factors that influence reinfection risk—such as varying viral strains, patients’ immune status, or other patient-level characteristics—should be evaluated in subsequent studies that include follow-up beyond 90 days. There is limited but consistent evidence from two SARS-CoV-2 outbreaks suggesting that seropositivity is associated with protection from infection. In an outbreak on a fishing vessel, an attack rate of 85% was observed among the 122 individuals. Only 3 individuals aboard were known to have serum neutralizing antibodies prior to the outbreak, and none of them became infected.9 In another outbreak, at a children’s summer camp, 116 out of 156 total (76%) campers, counselors, and staff became infected, but all 24 of the individuals who were seropositive when the camp began tested negative for infection soon after the epidemic had subsided.8 The current findings extend those anecdotal series onto a much larger sample size based on commercially available assays used in settings outside clinical trials.

While there are acknowledged limitations to observational clinical data, these data do provide a means to complement and supplement data from clinical trials in order to formulate hypotheses and provide information on patients or clinical scenarios that are not well represented in trials.34-37 It is particularly well suited to situations such as an emerging pandemic, where urgent questions require rapid, near real-time answers.

To be clear, however, this analysis based on nonrandomized observational data from commercial laboratories and claims has significant limitations compared with a classical prospective seroprotection trial. First, it is not known whether the rate of SARS-CoV-2 exposure or pattern of longitudinal follow-up were comparable between the 2 groups. It is also not known whether the positive NAAT results in either group were associated with clinical signs of infection. Perhaps most importantly, it is not known how long any protective effect of serostatus may last beyond the studied days. These questions remain to be addressed by further research. That research can also shed light on whether a seropositive individual who subsequently becomes seronegative may have reduced protection and the degree to which protection associated with seropositivity may be mediated by antibodies vs other forms (eg, T-cell based) of immunity.6

Conclusions

In this cohort study, deidentified data from commercial laboratories suggest that the presence of antibodies to SARS-CoV-2 is associated with a reduced risk of having a subsequent positive NAAT results, which may be a proxy representing a new infection or may represent continued viral shedding depending on the context and timing. While this risk reduction was not seen in the first 30 days after an initial antibody test, it became pronounced after 30 days and progressively strengthened through the 90-day observation period and beyond.

Back to top
Article Information

Accepted for Publication: January 28, 2021.

Published Online: February 24, 2021. doi:10.1001/jamainternmed.2021.0366

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2021 Harvey RA et al. JAMA Internal Medicine.

Corresponding Author: Lynne T. Penberthy, MD, MPH, National Cancer Institute, National Institutes of Health, 9609 Medical Center Dr, Rockville, MD 20850 (lynne.penberthy@nih.gov).

Author Contributions: Mr Harvey and Dr Rassen had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Harvey, Rassen, Turenne, Leonard, Klesh, Kaufman, Cohen, Petkov, Cronin, Van Dyke, Lowy, Sharpless, Penberthy.

Acquisition, analysis, or interpretation of data: Harvey, Rassen, Kabelac, Turenne, Leonard, Klesh, Meyer, Kaufman, Anderson, Cohen, Petkov, Lowy, Sharpless, Penberthy.

Drafting of the manuscript: Harvey, Rassen, Kabelac, Kaufman, Anderson, Sharpless, Penberthy.

Critical revision of the manuscript for important intellectual content: Harvey, Rassen, Turenne, Leonard, Klesh, Meyer, Kaufman, Anderson, Cohen, Petkov, Cronin, Van Dyke, Lowy, Sharpless, Penberthy.

Statistical analysis: Harvey, Rassen, Kabelac, Turenne.

Obtained funding: Harvey, Leonard, Klesh, Cohen.

Administrative, technical, or material support: Harvey, Rassen, Kabelac, Turenne, Leonard, Klesh, Meyer, Kaufman, Cohen, Petkov, Sharpless.

Supervision: Harvey, Rassen, Turenne, Leonard, Klesh, Petkov, Cronin, Van Dyke, Sharpless, Penberthy.

Other - engagement of laboratory collaboration partners: Leonard, Klesh.

Conflict of Interest Disclosures: Mr Harvey is an employee of Aetion, Inc, which received payment for services for the submitted work. Dr Rassen reported other from the National Institutes of Health during the conduct of the study, and is an employee of and has an ownership stake in Aetion, Inc. Ms Kabelac is an employee of Aetion, which received payment for services for the submitted work during the conduct of the study. Ms Turenne is an employee of Aetion, which received payment for services for the submitted work. Ms Leonard reported other from the National Cancer Institute, payment made to HealthVerity for data license and analytics during the conduct of the study; request for proposal from National Cancer Institute; and nonfinancial support from the US Food and Drug Administration outside the submitted work. Ms Klesh reported other from the National Cancer Institute, payment made to HealthVerity for data license and analytics during the conduct of the study; request for proposal from National Cancer Institute and nonfinancial support from the US Food and Drug Administration outside the submitted work. Dr Kaufman is an employee of and owns stock in Quest Diagnostics. Dr Anderson was senior vice president of LabCorp during the conduct of the study, and is on advisory boards for OmniSeq, GeneCentric, Emulate, Kiatech, and Johnson & Johnson. Dr Cohen is an employee and shareholder of Covance (LabCorp) during the conduct of the study. No other disclosures were reported.

Funding/Support: This work was funded by the National Cancer Institute, Office of the Director.

Role of the Funder/Sponsor: The National Cancer Institute had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Additional Contributions: We would like to thank Tony Fauci, MD, and Cliff Lane, MD, for comments on the manuscript; both are associated with the National Institute of Allergy and Infectious Diseases of the National Institutes of Health and neither received any compensation for their assistance with this article.

References
1.
Stadlbauer  D, Tan  J, Jiang  K,  et al.  Repeated cross-sectional sero-monitoring of SARS-CoV-2 in New York City.   Nature. 2020. Published online November 3, 2020. doi:10.1038/s41586-020-2912-6PubMedGoogle Scholar
2.
Wajnberg  A, Amanat  F, Firpo  A,  et al.  Robust neutralizing antibodies to SARS-CoV-2 infection persist for months.   Science. 2020;370(6521):1227-1230. Published online October 28, 2020. doi:10.1126/science.abd7728PubMedGoogle ScholarCrossref
3.
Gudbjartsson  DF, Norddahl  GL, Melsted  P,  et al.  Humoral immune response to SARS-CoV-2 in Iceland.   N Engl J Med. 2020;383(18):1724-1734. doi:10.1056/NEJMoa2026116PubMedGoogle ScholarCrossref
4.
Long  Q-X, Tang  X-J, Shi  Q-L,  et al.  Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections.   Nat Med. 2020;26(8):1200-1204. doi:10.1038/s41591-020-0965-6PubMedGoogle ScholarCrossref
5.
Ward  H, Atchison  CJ, Whitaker  M,  et al  Antibody prevalence for SARS-CoV-2 in England following first peak of the pandemic: REACT2 study in 100,000 adults.   medRxiv. Published online August 21, 2020. doi:10.1101/2020.08.12.20173690Google Scholar
6.
Zuo  J, Dowell  A, Pearce  H,  et al  Robust SARS-CoV-2-specific T-cell immunity is maintained at 6 months following primary infection.   bioRxiv. Published online January 1, 2020. doi:10.1101/2020.11.01.362319Google Scholar
7.
Ibarrondo  FJ, Fulcher  JA, Goodman-Meza  D,  et al.  Rapid decay of anti-SARS-CoV-2 antibodies in persons with mild Covid-19.   N Engl J Med. 2020;383(11):1085-1087. doi:10.1056/NEJMc2025179PubMedGoogle ScholarCrossref
8.
Pray  IW.  COVID-19 outbreak at an overnight summer school retreat—Wisconsin, July–August 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(43);1600–1604. doi:10.15585/mmwr.mm6943a4Google Scholar
9.
Addetia  A, Crawford  KH, Dingens  A,  et al  Neutralizing antibodies correlate with protection from SARS-CoV-2 in humans during a fishery vessel outbreak with high attack rate.   Journ Clin Microbiol. 2020;58(11):e02107-20. doi:10.1128/JCM.02107-20Google Scholar
10.
Jeremias  S.  First case of COVID-19 reinfection detected in the US.  American Journal of Managed Care. October 12, 2020. Accessed November 11, 2020. https://www.ajmc.com/view/first-case-of-covid-19-reinfection-detected-in-the-us
11.
Boomerang  JVL. Albany County resident reinfected with COVID-19 months after recovery. Casper Star-Tribune Online. October 29, 2020. Accessed November 11, 2020. https://trib.com/news/state-and-regional/health/albany-county-resident-reinfected-with-covid-19-months-after-recovery/article_b88aeff7-091e-5afb-9ee3-1b5715e9e219.html
12.
Tillett  RL, Sevinsky  JR, Hartley  PD,  et al.  Genomic evidence for reinfection with SARS-CoV-2: a case study.   Lancet Infect Dis. 2021;21(1):52-58. doi:10.1016/S1473-3099(20)30764-7PubMedGoogle ScholarCrossref
13.
Iwasaki  A.  What reinfections mean for COVID-19.   Lancet Infect Dis. 2021;21(1):3-5. doi:10.1016/S1473-3099(20)30783-0PubMedGoogle ScholarCrossref
14.
Hoang  VT, Dao  TL, Gautret  P.  Recurrence of positive SARS-CoV-2 in patients recovered from COVID-19.   J Med Virol. 2020;92(11):2366-2367. doi:10.1002/jmv.26056PubMedGoogle ScholarCrossref
15.
Li  N, Wang  X, Lv  T.  Prolonged SARS-CoV-2 RNA shedding: not a rare phenomenon.   J Med Virol. 2020;92(11):2286-2287. doi:10.1002/jmv.25952PubMedGoogle ScholarCrossref
16.
AlJishi  JM, Al-Tawfiq  JA.  Intermittent viral shedding in respiratory samples of patients with SARS-CoV-2: observational analysis with infection control implications.   J Hosp Infect. 2021;107:98-100. doi:10.1016/j.jhin.2020.09.011PubMedGoogle ScholarCrossref
17.
Lee  PH, Tay  WC, Sutjipto  S,  et al.  Associations of viral ribonucleic acid (RNA) shedding patterns with clinical illness and immune responses in severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection.   Clin Transl Immunology. 2020;9(7):e1160. doi:10.1002/cti2.1160PubMedGoogle Scholar
18.
Li  TZ, Cao  ZH, Chen  Y,  et al.  Duration of SARS-CoV-2 RNA shedding and factors associated with prolonged viral shedding in patients with COVID-19.   J Med Virol. Published online July 9, 2020.PubMedGoogle Scholar
19.
Morone  G, Palomba  A, Iosa  M,  et al.  Incidence and persistence of viral shedding in COVID-19 post-acute patients with negativized pharyngeal swab: a systematic review.   Front Med (Lausanne). 2020;7:562. doi:10.3389/fmed.2020.00562PubMedGoogle ScholarCrossref
20.
Surkova  E, Nikolayevskyy  V, Drobniewski  F.  False-positive COVID-19 results: hidden problems and costs.   Lancet Respir Med. 2020;8(12):1167-1168. doi:10.1016/S2213-2600(20)30453-7PubMedGoogle ScholarCrossref
21.
Agarwal  V, Venkatakrishnan  AJ, Puranik  A,  et al.  Long-term SARS-CoV-2 RNA shedding and its temporal association to IgG seropositivity.   Cell Death Discov. 2020;6(1):138. doi:10.1038/s41420-020-00375-yPubMedGoogle ScholarCrossref
22.
Meschi  S, Colavita  F, Bordi  L,  et al; INMICovid-19 laboratory team.  Performance evaluation of Abbott ARCHITECT SARS-CoV-2 IgG immunoassay in comparison with indirect immunofluorescence and virus microneutralization test.   J Clin Virol. 2020;129:104539. doi:10.1016/j.jcv.2020.104539PubMedGoogle Scholar
23.
US Food and Drug Administration. EUA authorized serology test performance. December 7, 2020. Accessed December 7, 2020. https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/eua-authorized-serology-test-performance
24.
US Food and Drug Administration. Real-world evidence. November 24, 2020. Accessed December 28, 2020. https://www.fda.gov/science-research/science-and-research-special-topics/real-world-evidence
25.
Sherman  RE, Anderson  SA, Dal Pan  GJ,  et al.  Real-world evidence—what is it and what can it tell us?   N Engl J Med. 2016;375(23):2293-2297. doi:10.1056/NEJMsb1609216PubMedGoogle ScholarCrossref
26.
von Elm  E, Altman  DG, Egger  M, Pocock  SJ, Gøtzsche  PC, Vandenbroucke  JP; STROBE Initiative.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.   Ann Intern Med. 2007;147(8):573-577. doi:10.7326/0003-4819-147-8-200710160-00010PubMedGoogle ScholarCrossref
27.
Sethuraman  N, Jeremiah  SS, Ryo  A.  Interpreting diagnostic tests for SARS-CoV-2.   JAMA. 2020;323(22):2249-2251. doi:10.1001/jama.2020.8259 PubMedGoogle ScholarCrossref
28.
Ainsworth  M, Andersson  M, Auckland  K,  et al; National SARS-CoV-2 Serology Assay Evaluation Group.  Performance characteristics of five immunoassays for SARS-CoV-2: a head-to-head benchmark comparison.   Lancet Infect Dis. 2020;20(12):1390-1400. doi:10.1016/S1473-3099(20)30634-4PubMedGoogle ScholarCrossref
29.
Theel  ES, Harring  J, Hilgart  H, Granger  D.  Performance characteristics of four high-throughput immunoassays for detection of IgG antibodies against SARS-CoV-2.   J Clin Microbiol. 2020;58(8):e01243-20. doi:10.1128/JCM.01243-20 PubMedGoogle Scholar
30.
Hopkins  JS. Pfizer’s Covid-19 vaccine proves 90% effective in latest trials. Wall Street Journal. November 9, 2020. Accessed November 9, 2020. https://www.wsj.com/articles/covid-19-vaccine-from-pfizer-and-biontech-works-better-than-expected-11604922300
31.
National Institutes of Health. Promising interim results from clinical trial of NIH-Moderna COVID-19 vaccine. November 15, 2020. Accessed December 11, 2020. https://www.nih.gov/news-events/news-releases/promising-interim-results-clinical-trial-nih-moderna-covid-19-vaccine
32.
Polack  FP, Thomas  SJ, Kitchin  N,  et al; C4591001 Clinical Trial Group.  Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine.   N Engl J Med. 2020;383(27):2603-2615. doi:10.1056/NEJMoa2034577PubMedGoogle ScholarCrossref
33.
Lumley  SF, O’Donnell  D, Stoesser  NE,  et al; Oxford University Hospitals Staff Testing Group.  Antibody status and incidence of SARS-CoV-2 infection in health care workers.   N Engl J Med. 2020. doi:10.1056/NEJMoa2034545PubMedGoogle Scholar
34.
Pottegård  A, Kurz  X, Moore  N, Christiansen  CF, Klungel  O.  Considerations for pharmacoepidemiological analyses in the SARS-CoV-2 pandemic.   Pharmacoepidemiol Drug Saf. 2020;29(8):825-831. doi:10.1002/pds.5029PubMedGoogle ScholarCrossref
35.
Camm  AJ, Fox  KAA.  Strengths and weaknesses of “real-world” studies involving non-vitamin K antagonist oral anticoagulants.   Open Heart. 2018;5(1):e000788. doi:10.1136/openhrt-2018-000788PubMedGoogle Scholar
36.
Makady  A, de Boer  A, Hillege  H, Klungel  O, Goettsch  W; (on behalf of GetReal Work Package 1).  What is real-world data? a review of definitions based on literature and stakeholder interviews.   Value Health. 2017;20(7):858-865. doi:10.1016/j.jval.2017.03.008PubMedGoogle ScholarCrossref
37.
Miksad  RA, Abernethy  AP.  Harnessing the power of real-world evidence (RWE): a checklist to ensure regulatory-grade data quality.   Clin Pharmacol Ther. 2018;103(2):202-205. doi:10.1002/cpt.946PubMedGoogle ScholarCrossref
×