Original Investigation
Innovations in Health Care Delivery
June 21, 2016

Development and Validation of a Protein-Based Risk Score for Cardiovascular Outcomes Among Patients With Stable Coronary Heart Disease

Author Affiliations
  • 1Department of Medicine, University of California-San Francisco
  • 2Division of Cardiology, San Francisco General Hospital
  • 3Division of Cardiology, University of Zurich, Zurich, Switzerland
  • 4HUNT Research Center, Department of Public Health, NTNU, Levanger, Norway
  • 5NEC Corporation of America, Irving, Texas
  • 6Department of Epidemiology and Biostatistics, University of California-San Francisco
  • 7SomaLogic, Boulder, Colorado

Copyright 2016 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.

JAMA. 2016;315(23):2532-2541. doi:10.1001/jama.2016.5951

Importance  Precise stratification of cardiovascular risk in patients with coronary heart disease (CHD) is needed to inform treatment decisions.

Objective  To derive and validate a score to predict risk of cardiovascular outcomes among patients with CHD, using large-scale analysis of circulating proteins.

Design, Setting, and Participants  Prospective cohort study of participants with stable CHD. For the derivation cohort (Heart and Soul study), outpatients from San Francisco were enrolled from 2000 through 2002 and followed up through November 2011 (≤11.1 years). For the validation cohort (HUNT3, a Norwegian population-based study), participants were enrolled from 2006 through 2008 and followed up through April 2012 (5.6 years).

Exposures  Using modified aptamers, 1130 proteins were measured in plasma samples.

Main Outcomes and Measures  A 9-protein risk score was derived and validated for 4-year probability of myocardial infarction, stroke, heart failure, and all-cause death. Tests, including the C statistic, were used to assess performance of the 9-protein risk score, which was compared with the Framingham secondary event model, refit to the cohorts in this study. Within-person change in the 9-protein risk score was evaluated in the Heart and Soul study from paired samples collected 4.8 years apart.

Results  From the derivation cohort, 938 samples were analyzed, participants’ median age at enrollment was 67.0 years, and 82% were men. From the validation cohort, 971 samples were analyzed, participants’ median age at enrollment was 70.2 years, and 72% were men. In the derivation cohort, C statistics were 0.66 for refit Framingham, 0.74 for 9-protein, and 0.75 for refit Framingham plus 9-protein models. In the validation cohort, C statistics were 0.64 for refit Framingham, 0.70 for 9-protein, and 0.71 for refit Framingham plus 9-protein models. Adding the 9-protein risk score to the refit Framingham model increased the C statistic by 0.09 (95% CI, 0.06-0.12) in the derivation cohort, and in the validation cohort, the C statistic was increased by 0.05 (95% CI, 0.02-0.09). Compared with the refit Framingham model, the integrated discrimination index for the 9-protein model was 0.12 (95% CI, 0.08-0.16) in the derivation cohort and 0.08 (95% CI, 0.05-0.10) in the validation cohort. In analysis of paired samples among 139 participants with cardiovascular events after the second sample, absolute within-person annualized risk increased more for the 9-protein model (median, 1.86% [95% CI, 1.15%-2.54%]) than for the refit Framingham model (median, 1.00% [95% CI, 0.87%-1.19%]) (P = .002), while among 375 participants without cardiovascular events, both scores changed less and similarly (P = .30).

Conclusions and Relevance  Among patients with stable CHD, a risk score based on 9 proteins performed better than the refit Framingham secondary event risk score in predicting cardiovascular events, but still provided only modest discriminative accuracy. Further research is needed to assess whether the score is more accurate in a lower-risk population.