[Skip to Navigation]
Sign In
Figure. Receiver Operator Characteristic Curves Showing Area Under the Curve for Incident Coronary Heart Disease and Incident Cardiovascular Disease in Intermediate-Risk MESA Participants
Figure. Receiver Operator Characteristic Curves Showing Area Under the Curve for Incident Coronary Heart Disease and Incident Cardiovascular Disease in Intermediate-Risk MESA Participants

A, Receiver operator characteristic curves showing area under the curve for FRS alone, 0.623; FRS plus coronary artery calcium, 0.784 (P <.001); FRS plus intima-media thickness, 0.652 (P =.01); FRS plus flow-mediated dilation, 0.639 (P =.06); FRS plus high-sensitivity C-reactive protein, 0.640 (P =.03); FRS plus family history, 0.675 (P =.001); and FRS plus ankle-brachial index, 0.650 (P =.01). B, Receiver operator characteristic curves showing area under the curve for FRS alone, 0.623; FRS plus coronary artery calcium, 0.784 (P <.001); FRS plus intima-media thickness, 0.652 (P =.01); FRS plus flow-mediated dilation, 0.639 (P =.06); FRS plus high-sensitivity C-reactive protein, 0.640 (P =.03); FRS plus family history, 0.675 (P =.001); and FRS plus ankle-brachial index, 0.650 (P =.01). MESA indicates Multi-Ethnic Study of Atherosclerosis.

Table 1. Baseline Characteristics of Participants in the Multi-Ethnic Study of Atherosclerosis at Intermediate Framingham Risk (N = 1330)a
Table 1. Baseline Characteristics of Participants in the Multi-Ethnic Study of Atherosclerosis at Intermediate Framingham Risk (N = 1330)a
Table 2. Association of Several Novel Risk Markers With Incident Coronary Heart Disease (No. of Events = 94)a
Table 2. Association of Several Novel Risk Markers With Incident Coronary Heart Disease (No. of Events = 94)a
Table 3. Net Reclassification Improvement (NRI) for Incident Coronary Heart Disease Events With Addition of Novel Risk Markers to the Framingham Risk Score in Intermediate-Risk MESA Participants (N = 1330)
Table 3. Net Reclassification Improvement (NRI) for Incident Coronary Heart Disease Events With Addition of Novel Risk Markers to the Framingham Risk Score in Intermediate-Risk MESA Participants (N = 1330)
Table 4. Net Reclassification Improvement (NRI) for Incident Cardiovascular Disease Events With Addition of Novel Risk Markers to the Framingham Risk Score in Intermediate-Risk MESA Participants (N = 1330)
Table 4. Net Reclassification Improvement (NRI) for Incident Cardiovascular Disease Events With Addition of Novel Risk Markers to the Framingham Risk Score in Intermediate-Risk MESA Participants (N = 1330)
1.
Hayward RA, Krumholz HM, Zulman DM, Timbie JW, Vijan S. Optimizing statin treatment for primary prevention of coronary artery disease.  Ann Intern Med. 2010;152(2):69-7720083825PubMedGoogle ScholarCrossref
2.
Collins GS, Altman DG. An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study.  BMJ. 2009;339:b258419584409PubMedGoogle ScholarCrossref
3.
Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults.  Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III).  JAMA. 2001;285(19):2486-249711368702PubMedGoogle ScholarCrossref
4.
Nambi V, Chambless L, Folsom AR,  et al.  Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC study.  J Am Coll Cardiol. 2010;55:1600-160720378078PubMedGoogle ScholarCrossref
5.
Polonsky TS, McClelland RL, Jorgensen NW,  et al.  Coronary artery calcium score and risk classification for coronary heart disease prediction.  JAMA. 2010;303(16):1610-161620424251PubMedGoogle ScholarCrossref
6.
Ridker PM, Paynter NP, Rifai N, Gaziano JM, Cook NR. C-reactive protein and parental history improve global cardiovascular risk prediction: the Reynolds Risk Score for men.  Circulation. 2008;118(22):2243-2251, 4p, 225118997194PubMedGoogle ScholarCrossref
7.
Sivapalaratnam S, Boekholdt SM, Trip MD,  et al.  Family history of premature coronary heart disease and risk prediction in the EPIC-Norfolk prospective population study.  Heart. 2010;96(24):1985-198920962344PubMedGoogle ScholarCrossref
8.
Yeboah J, Folsom AR, Burke GL,  et al.  Predictive value of brachial flow-mediated dilation for incident cardiovascular events in a population-based study: the multi-ethnic study of atherosclerosis.  Circulation. 2009;120(6):502-50919635967PubMedGoogle ScholarCrossref
9.
Criqui MH, McClelland RL, McDermott MM,  et al.  The ankle-brachial index and incident cardiovascular events in the MESA (Multi-Ethnic Study of Atherosclerosis).  J Am Coll Cardiol. 2010;56(18):1506-151220951328PubMedGoogle ScholarCrossref
10.
Greenland P, Alpert JS, Beller GA,  et al; American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.  2010 ACCF/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.  Circulation. 2010;122(25):e584-e63621098428PubMedGoogle ScholarCrossref
11.
Bild DE, Bluemke DA, Burke GL,  et al.  Multi-ethnic study of atherosclerosis: objectives and design.  Am J Epidemiol. 2002;156(9):871-88112397006PubMedGoogle ScholarCrossref
12.
Friedewald WT, Levy RI, Fredrickson DS. Estimation of the concentration of low-density lipoprotein cholesterol in plasma, without use of the preparative ultracentrifuge.  Clin Chem. 1972;18(6):499-5024337382PubMedGoogle Scholar
13.
Carr JJ, Nelson JC, Wong ND,  et al.  Calcified coronary artery plaque measurement with cardiac CT in population-based studies: standardized protocol of Multi-Ethnic Study of Atherosclerosis (MESA) and Coronary Artery Risk Development in Young Adults (CARDIA) study.  Radiology. 2005;234(1):35-4315618373PubMedGoogle ScholarCrossref
14.
Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M Jr, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography.  J Am Coll Cardiol. 1990;15(4):827-8322407762PubMedGoogle ScholarCrossref
15.
Polak JF, Pencina MJ, O’Leary DH, D’Agostino RB. Common carotid artery intima-media thickness progression as a predictor of stroke in multi-ethnic study of atherosclerosis.  Stroke. 2011;42(11):3017-302121885840PubMedGoogle ScholarCrossref
16.
Delong ER, Delong DM, Clarke-Pearson DL. Comparing the area under two or more correlated receiver operating characteristic curves. a non-parametric approach.  Biometrics. 1988;44:837-8453202132PubMedGoogle ScholarCrossref
17.
Pencina MJ, D’Agostino RB, Vasan RS. Statistical methods for assessment of added usefulness of new biomarkers.  Clin Chem Lab Med. 2010;48(12):1703-171120716010PubMedGoogle ScholarCrossref
18.
Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score.  JAMA. 2007;297(6):611-61917299196PubMedGoogle ScholarCrossref
19.
Fowkes FG, Murray GD, Butcher I,  et al; Ankle Brachial Index Collaboration.  Ankle brachial index combined with Framingham Risk Score to predict cardiovascular events and mortality: a meta-analysis.  JAMA. 2008;300(2):197-20818612117PubMedGoogle ScholarCrossref
20.
Wilson PW, Pencina M, Jacques P, Selhub J, D’Agostino R Sr, O’Donnell CJ. C-reactive protein and reclassification of cardiovascular risk in the Framingham Heart Study.  Circ Cardiovasc Qual Outcomes. 2008;1(2):92-9720031795PubMedGoogle ScholarCrossref
21.
Kavousi M, Elias-Smale S, Rutten JH,  et al.  Evaluation of newer risk markers for coronary heart disease risk classification: a cohort study.  Ann Intern Med. 2012;156(6):438-44422431676PubMedGoogle ScholarCrossref
22.
Voros S, Rivera JJ, Berman DS,  et al; Society for Atherosclerosis Imaging and Prevention Tomographic Imaging and Prevention Councils; Society of Cardiovascular Computed Tomography.  Guideline for minimizing radiation exposure during acquisition of coronary artery calcium scans with the use of multidetector computed tomography: a report by the Society for Atherosclerosis Imaging and Prevention Tomographic Imaging and Prevention Councils in collaboration with the Society of Cardiovascular Computed Tomography.  J Cardiovasc Comput Tomogr. 2011;5(2):75-8321398199PubMedGoogle ScholarCrossref
23.
Kim KP, Einstein AJ, Berrington de González A. Coronary artery calcification screening: estimated radiation dose and cancer risk.  Arch Intern Med. 2009;169(13):1188-119419597067PubMedGoogle ScholarCrossref
24.
Berrington de González A, Mahesh M, Kim KP,  et al.  Projected cancer risks from computed tomographic scans performed in the United States in 2007.  Arch Intern Med. 2009;169(22):2071-207720008689PubMedGoogle ScholarCrossref
25.
Ford ES, Giles WH, Mokdad AH. The distribution of 10-Year risk for coronary heart disease among US adults: findings from the National Health and Nutrition Examination Survey III.  J Am Coll Cardiol. 2004;43(10):1791-179615145101PubMedGoogle ScholarCrossref
26.
Hlatky MA, Greenland P, Arnett DK,  et al; American Heart Association Expert Panel on Subclinical Atherosclerotic Diseases and Emerging Risk Factors and the Stroke Council.  Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association.  Circulation. 2009;119(17):2408-241619364974PubMedGoogle ScholarCrossref
Original Contribution
August 22/29, 2012

Comparison of Novel Risk Markers for Improvement in Cardiovascular Risk Assessment in Intermediate-Risk Individuals

Author Affiliations

Author Affiliations: Departments of Internal Medicine/Cardiology (Drs Yeboah and Herrington), and Radiology (Dr Carr), and Division of Public Health Sciences (Drs Burke and Carr), Wake Forest University School of Medicine, Winston-Salem, North Carolina; Department of Biostatistics, University of Washington, Seattle (Dr McClelland); Section of Cardiology, Department of Internal Medicine, University of Chicago, Chicago, Illinois (Dr Polonsky); National Institutes of Health, Bethesda, Maryland (Dr Sibley); Tufts Medical Center, Brookline, Massachusetts (Dr O’Leary); University of Colorado School of Public Health, Aurora (Dr Goff); and Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois (Dr Greenland).

JAMA. 2012;308(8):788-795. doi:10.1001/jama.2012.9624
Abstract

Context Risk markers including coronary artery calcium, carotid intima–media thickness, ankle-brachial index, brachial flow–mediated dilation, high-sensitivity C-reactive protein (CRP), and family history of coronary heart disease (CHD) have been reported to improve on the Framingham Risk Score (FRS) for prediction of CHD, but there are no direct comparisons of these markers for risk prediction in a single cohort.

Objective We compared improvement in prediction of incident CHD/cardiovascular disease (CVD) of these 6 risk markers within intermediate-risk participants (FRS >5%-<20%) in the Multi-Ethnic Study of Atherosclerosis (MESA).

Design, Setting, and Participants Of 6814 MESA participants from 6 US field centers, 1330 were intermediate risk, without diabetes mellitus, and had complete data on all 6 markers. Recruitment spanned July 2000 to September 2002, with follow-up through May 2011. Probability-weighted Cox proportional hazard models were used to estimate hazard ratios (HRs). Area under the receiver operator characteristic curve (AUC) and net reclassification improvement were used to compare incremental contributions of each marker when added to the FRS, plus race/ethnicity.

Main Outcome Measures Incident CHD defined as myocardial infarction, angina followed by revascularization, resuscitated cardiac arrest, or CHD death. Incident CVD additionally included stroke or CVD death.

Results After 7.6-year median follow-up (IQR, 7.3-7.8), 94 CHD and 123 CVD events occurred. Coronary artery calcium, ankle-brachial index, high-sensitivity CRP, and family history were independently associated with incident CHD in multivariable analyses (HR, 2.60 [95% CI, 1.94-3.50]; HR, 0.79 [95% CI, 0.66-0.95]; HR, 1.28 [95% CI, 1.00-1.64]; and HR, 2.18 [95% CI, 1.38-3.42], respectively). Carotid intima–media thickness and brachial flow–mediated dilation were not associated with incident CHD in multivariable analyses (HR, 1.17 [95% CI, 0.95-1.45] and HR, 0.95 [95% CI, 0.78-1.14]). Although addition of the markers individually to the FRS plus race/ethnicity improved AUC, coronary artery calcium afforded the highest increment (0.623 vs 0.784), while brachial flow–mediated dilation had the least (0.623 vs 0.639). For incident CHD, the net reclassification improvement with coronary artery calcium was 0.659, brachial flow–mediated dilation was 0.024, ankle-brachial index was 0.036, carotid intima–media thickness was 0.102, family history was 0.160 and high-sensitivity CRP was 0.079. Similar results were obtained for incident CVD.

Conclusions Coronary artery calcium, ankle-brachial index, high-sensitivity CRP, and family history were independent predictors of incident CHD/CVD in intermediate-risk individuals. Coronary artery calcium provided superior discrimination and risk reclassification compared with other risk markers.

Current trends in primary prevention of cardiovascular disease (CVD) emphasize the need to treat individuals based on their global cardiovascular risk.1 Accordingly, practice guidelines recommend approaches to classify individuals as high, intermediate, or low risk using the Framingham Risk Score (FRS) or other similar CVD risk prediction models.2,3 However, there is increasing recognition of the imprecision of these classifications such that the intermediate-risk group actually represents a composite of higher-risk individuals for whom more aggressive (ie, drug) therapy might be indicated. The intermediate-risk group also contains lower-risk individuals in whom CVD might be managed with lifestyle measures alone. This recognition has motivated researchers to identify markers that could offer greater discrimination of higher- and lower-risk patients within the intermediate-risk group.

Risk markers that have shown promise in improving risk discrimination include carotid intima–media thickness (CIMT), coronary artery calcium (CAC) scores, brachial flow–mediated dilation (FMD), ankle-brachial index (ABI), high-sensitivity C-reactive protein (CRP), and family history of coronary heart disease (CHD).4-9 A recent American College of Cardiology Foundation/American Heart Association statement on the use of markers to improve cardiovascular risk prediction beyond the FRS gave family history a class I recommendation; CIMT, CAC, ABI, and high-sensitivity CRP received class II recommendations, while the American College of Cardiology Foundation/American Heart Association recommended against the use of brachial FMD (class III).10 However, these recommendations were limited by the relative paucity of published data and the fact that the published studies of individual risk markers were performed in different cohorts with different composite outcomes, analytic methodologies, and inadequate statistical power to detect improvements of risk prediction beyond commonly used risk-prediction algorithms. Moreover, there are no comprehensive head-to-head comparisons of these risk markers in a single population cohort similar to the US population. Determining the relative improvements in prediction afforded by various risk markers, especially when considering intermediate-risk individuals as classified by the FRS, could help determine the most efficient strategy for identifying select, intermediate-risk participants for more aggressive primary prevention interventions, including the use of aspirin and lower targets for drug treatments of low-density lipoprotein (LDL) cholesterol and blood pressure.

In this report, we assess the improvements in prediction accuracy and reclassification to high- and low-risk categories using CIMT, CAC, FMD, ABI, high-sensitivity CRP, and family history of CHD in asymptomatic adults classified as intermediate risk (FRS standards) who participated in the Multi-Ethnic Study of Atherosclerosis (MESA).

Methods
Study Population and Data Collection

The study design for the MESA study has been published elsewhere.11 In brief, MESA is a prospective cohort study to investigate the prevalence, correlates, and progression of subclinical CVD in individuals without known CVD at baseline.

The full cohort includes 6814 women and men aged 45 to 84 years without known CVD, recruited from 6 US communities (Baltimore, Maryland; Chicago, Illinois; Forsyth County, North Carolina; Los Angeles County, California; northern New York City, New York; and St Paul, Minnesota). Self-reported race/ethnicity was collected to explore the possible racial/ethnic differences in the development and progression of atherosclerosis. The race/ethnic breakdown of MESA participants was 38% white, 28% black, 22% Hispanic, and 12% Chinese adults. Participants with diabetes were excluded because it is considered to be a CHD risk equivalent. Diabetes was defined as self-reported history of diabetes mellitus, diabetes medication use, or a fasting glucose level of 126 mg/dL or greater (for mmol/L, multiply by 0.0555). Demographics, medical history, and anthropometric and laboratory data for the present study were taken from the first examination (July 2000 to August 2002). Current smoking was defined as having smoked a cigarette in the last 30 days. Use of antihypertensive and other medications was based on review of prescribed medication containers. Resting blood pressure was measured 3 times in the seated position and the average of the second and third readings was recorded. Hypertension was defined as a systolic blood pressure of at least 140 mm Hg, diastolic blood pressure of at least 90 mm Hg, or use of medication prescribed for hypertension. Body mass index was calculated as weight in kilograms divided by height in meters squared. Total cholesterol and high-density lipoprotein (HDL) cholesterol were measured from blood samples obtained after a 12-hour fast. LDL cholesterol was estimated using the Friedewald equation.12 High-sensitivity CRP was measured using the BNII nephelometer (N High Sensitivity CRP; Dade Behring Inc) at the Laboratory for Clinical Biochemistry Research (University of Vermont, Burlington). Analytical intra-assay coefficient of variations ranged from 2.3% to 4.4%, and interassay coefficient of variation ranged from 2.1% to 5.7% with a detection level of 0.18 mg/L. Family history of CHD was obtained by asking participants whether any member in their immediate family (parents, siblings, and children) experienced fatal or nonfatal myocardial infarction. The MESA study was approved by the institutional review boards of each study site and written informed consent was obtained from all participants.

Measurement of ABI

Protocol for ankle-brachial index measurement in MESA was reported by Criqui et al.9 Briefly, systolic blood pressure measurements in the bilateral brachial, dorsalis pedis, and posterior tibial arteries were obtained in the supine position using a handheld Doppler instrument with a 5-mHz probe. To avoid potential bias from subclavian stenosis, the higher of the brachial artery pressures was used as the denominator. For each lower extremity, the ABI numerator used was the highest pressure (dorsalis pedis or posterior tibial) from that leg. Reproducibility of ABI was evaluated using measurements of 43 participants by 2 technicians. The interreader and intrareader correlation coefficients were 0.845 and 0.937, with the intrareader and interreader coefficients of variation being 5.14% and 3.27%.

Measurement of the CAC Score

CT scanning and interpretation methods in MESA have were reported by Carr et al.13 Scanning centers assessed CAC by chest computed tomography (CT) with either a cardiac-gated electron-beam CT scanner (Chicago, Los Angeles County, and New York City field centers) or a multidetector CT system (Baltimore, Forsyth County, and St Paul field centers). Certified technologists scanned all participants twice over phantoms of known physical calcium concentration. A radiologist or cardiologist read all CT scans at a central reading center (Los Angeles Biomedical Research Institute at Harbor–UCLA, Torrance, California). We used the mean Agatston score for the 2 scans in all analyses14 Intraobserver and interobserver agreements were excellent (κ=0.93 and κ=0.90).

Measurement of Brachial FMD

Methods for measuring and interpreting brachial FMD in MESA were reported by Yeboah et al.8 Intrareader reproducibility for baseline diameter, maximum diameter, and percent FMD was evaluated by comparing an original and a blinded quality control reread of ultrasounds from 40 MESA participants. The intraclass correlation coefficients were 0.99, 0.99, and 0.93, respectively. Intraparticipant variability was evaluated by comparing results from repeated examinations of 19 participants on 2 days, 1 week apart. The intraclass correlation coefficients for baseline diameter, maximum diameter, and percent FMD were 0.90, 0.90, and 0.54, respectively. Percent technical error of measurement was 1.39% for baseline diameter measurement, 1.47% for maximum diameter measurement, and 28.4% for percent FMD measurement.

Measurement of CIMT

Methods for measuring and interpreting CIMT were reported by Polak et al.15 The mean of maximum intima-media thickness of the common carotid artery was used. Reproducibility was assessed by blinded replicate readings of CIMT performed by 2 readers. One reader reread 66 studies for a between-reader correlation coefficient of 0.84 (n=66), and a second reader reread 48 studies for a correlation coefficient of 0.86. The rescan and the reread coefficients of variation were 7.07% and 3.48%.

Ascertainment of Incident CHD and CVD

Follow-up took place through May 2011. CVD events were adjudicated by a MESA study committee that included cardiologists, physician epidemiologists, and neurologists. A detailed description of the adjudication process was previously reported.8 For the purposes of this study, we define incident CHD as myocardial infarction, CHD death, resuscitated cardiac arrest, or definite or probable angina if followed by coronary revascularization. Incident CVD additionally included stroke or CVD death as defined by the MESA protocol (available at http:www.mesa-nhlbi.org). Thus CHD is a subset of CVD.

Statistical Analysis

The study population was limited to MESA participants classified as intermediate risk (estimated 10-y CHD risk of >5%-<20%) based on the Framingham risk equation.3 The intermediate-risk range was chosen to make our results comparable to other studies that have reported data on intermediate-risk participants using some of the risk markers under consideration.4-6 Descriptive data are presented as mean (SD) for continuous variables or frequencies of participants for categorical variables. CAC scores were expressed as In (CAC+1). Family history was entered into models as a categorical variable (yes/no), high-sensitivity CRP had a highly skewed distribution and was log transformed; all other variables were expressed as continuous variables. Weighted analyses were done to reflect the sampling from the overall MESA cohort. Probability-weighted Cox proportional hazard analysis with robust variance estimates was used to assess the association between each of the markers (CAC, FMD, CIMT, ABI, high-sensitivity CRP, and family history of CHD) and incident CHD or CVD in univariable and multivariable models while adjusting for age, sex, race/ethnicity, total and HDL cholesterol, cigarette smoking status, body mass index, blood pressure medication use, and hydroxmethyl glutaryl coenzyme A–reductase inhibitor use. These confounders were chosen based on their association with the outcomes of interest (incident CHD/CVD) in the current analysis and prior published data.

We assessed the improvement in discrimination by comparing the area under the receiver operator characteristic curves (AUC) in models with and without each novel risk marker, using the method of DeLong et al.16 The FRS (derived using age, sex, total cholesterol, HDL cholesterol, smoking status, systolic blood pressure, and blood pressure medication use), a general clinical practice tool, plus race/ethnicity, served as the baseline model. ROC curves were developed using a probability-weighted Cox model. We assessed the classification of risk using the net reclassification improvement (NRI):

NRI=[Prob (being correctly reclassified to a higher-risk category/event)

Prob (being incorrectly reclassified to a lower-risk category/event)]

+[Prob (being correctly reclassified to a lower-risk category/nonevent)

Prob (being incorrectly classified to a higher-risk category/nonevent)].17

The NRI captures the relative improvement in classification associated with the additional predictive variable, while explicitly balancing trade off between changes in sensitivity and specificity. NRI is the sum of 2 percentages with different denominators and hence, is reported as a proportion (possible range, −2.0 to 2.0). At the time of these analyses, the mean observed follow-up in MESA was 7.5 years (maximum follow-up, 9 y). To account for the fact that actual follow-up was less than 10 years, we redefined the risk in terms of 7.5-year risk when calculating the NRI, using a logistic regression model with probability weighting to reflect the sampling from the overall cohort. Based on the new model, intermediate 7.5-year risk categories for CHD and CVD were defined as 2.0% to 15.4% and 3.4% to 21.1%. With the addition of each novel risk marker to the base model, participants were considered to be reclassified to high risk if their estimated risks for CHD and CVD were greater than 15.4% and 21.1%, and reclassified to low risk if their estimated risks were lower than 2.0% and 3.4% for CHD and CVD. As a sensitivity analysis, we repeated our evaluation of ABI and the imaging markers using the Reynolds score (RS, calculated separately for men and women)6,18 instead of the FRS to define these risk groups. This score incorporates family history and log-transformed high-sensitivity CRP in addition to other risk factors. A 2-tailed P value of less than .05 was considered significant. All statistical analyses were performed using SAS version 9.2 (SAS Institute).

Results
Study Cohort

The final study population included 1330 participants without diabetes mellitus, with an FRS of more than 5% to less than 20%, and with complete data on all 6 of the novel risk markers. The median (IQR) for the FRS of the cohort at baseline was 8.8% (6.5%-12.2%). The baseline characteristics of the study population are shown in Table 1.

After a median follow-up of 7.6 years (IQR, 7.3-7.8; maximum follow-up, 9 y), 94 participants (7.1%) experienced a CHD event and 123 (9.2%) experienced a CVD event. Specific events were: 43 with myocardial infarction, 3 with resuscitated cardiac arrest, 14 with CHD death, 44 with angina followed by revascularization, and 31 participants with stroke.

Association of Risk Markers With Incident CHD and CVD

In the univariable probability-weighted Cox proportional hazard analyses, each of the novel risk markers was associated with incident CHD; however, after adjusting for confounders, the associations with CIMT and FMD were no longer significant (Table 2). Among all of the risk markers, CAC had the strongest association. Similarly, for incident CVD in univariable analyses, each of the novel risk markers was associated with events except high-sensitivity CRP. However, after adjusting for confounders, the associations between CIMT and FMD were no longer significant (eTable 1). CAC also had the strongest association in the multivariable models for CVD.

Improvement of Discrimination by Addition of Novel Risk Markers to the FRS

For CHD/CVD events, the addition of each of the 6 risk markers to the baseline model improved the AUC. CAC showed the highest increment while FMD showed the least increment (Figure) for incident CHD. CAC also showed the highest increment while high-sensitivity CRP showed the least increment for incident CVD (Figure).

Classification of Risk

Using Table 3 (FRS+CAC variable) as an example, 51.1% of participants who had CHD (events) and 54.9% of those who did not have CHD (nonevents) during follow-up period were reclassified either to low or high risk by the addition of CAC to the FRS(+race/ethnicity). Applying the NRI formula that considers both those correctly reclassified as well as those incorrectly reclassified, a net 25.5% of the events group were reclassified to high risk appropriately, while a net 40.4% of the nonevents group were appropriately reclassified into the low-risk group by the addition of CAC to FRS(+race/ethnicity). The NRI for the addition of CAC to FRS (+race/ethnicity) is therefore calculated by adding 0.255 to 0.404 (0.255+0.405=0.659).

The addition of CAC to the FRS (+race/ethnicity) resulted in the highest NRI (0.659) and the greatest absolute number of correctly reclassified participants (n=625) (Table 3), while the addition of FMD resulted in the lowest NRI (0.024) and the fewest total number of correctly reclassified individuals. Carotid IMT, ABI, CRP, and family history afforded modest NRIs for CHD events (Table 3). CAC also provided the greatest NRI and total number of correctly reclassified participants for CVD events (Figure and Table 4). Among the non-CAC risk markers, family history performed the best for CHD risk reclassification (NRI=0.160), while ABI performed the best for CVD risk reclassification (NRI=0.068).

The respective AUCs were 0.642 for the RS alone, 0.766 for RS plus CAC, 0.643 for RS plus CIMT, 0.648 for RS plus ABI, and 0.642 for RS plus FMD for incident CHD in the present cohort. The NRIs were 0.528 for RS plus CAC, 0.003 for RS plus CIMT, 0.002 for RS plus ABI, and 0 for RS plus FMD over RS alone for incident CHD. Similarly the AUCs were 0.645 for FRS alone, 0.742 for RS plus CAC, 0.645 for RS plus CIMT, 0.656 for RS plus ABI, and 0.646 fpr RS plus FMD for incident CVD. The NRIs were 0.415 for RS plus CAC, 0 for RS plus CIMT, 0.008 for RS plus ABI, and 0.007 for RS plus FMD over RS alone for incident CVD.

Comment

The current study shows that among 6 of the most promising novel risk markers, CAC provides the highest improvement in discrimination over the FRS and RS in individuals classified as intermediate risk. The present study provides additional support for the use of CAC as a tool for refining cardiovascular risk prediction in individuals classified as intermediate risk by the FRS or the RS. To our knowledge, this is the first study to compare directly the improvement in risk prediction provided by the novel markers included in the present study in a multiethnic cohort with intermediate Framingham or Reynolds risk.

Previous studies showed that CIMT, CAC, brachial FMD, ABI, high-sensitivity CRP and family history of CHD improve the classification of risk over the FRS, but to varying degrees. Direct comparisons between studies should be made with caution because they were conducted in different cohorts, did not have uniform definitions of the primary outcome, and had varying duration of follow-up. Nambi et al4 showed in the Atherosclerosis Risk In Communities study that CIMT improved the AUC from 0.742 to 0.750, and had a net clinical NRI of 0.167. Polonsky et al5 showed in a larger subset of the MESA study that CAC is an independent predictor of CHD, improved the AUC from 0.76 to 0.81, and has a net clinical NRI of 0.55 in the intermediate-risk stratum. Yeboah et al8 showed that brachial FMD is an independent predictor of incident CVD, and that it did not improve the AUC of the FRS (0.74) but has a net clinical NRI, defined using the 10% to 20% Framingham risk, of 0.28. Fowkes et al19 showed in a meta-analysis that ABI is an independent predictor of incident CVD, and improves the AUC from 0.646 to 0.655 and reclassification of the risk category and modification of treatment recommendations in approximately 19% of men and 36% of women. Wilson et al20 showed in the Framingham Heart Study that high-sensitivity CRP is an independent predictor of incident CHD/CVD, it improved AUC from 0.795 to 0.865 and to 0.799, and it had an NRI of 0.118 and 0.056, respectively. Sivapalaratnam et al7 showed in the EPIC-Norfolk study that family history of CHD is an independent predictor of incident CHD with a net clinical NRI of 0.021.

Recently, investigators from the Rotterdam study also performed a direct comparison of several novel risk markers, and also found that CAC provided the most robust improvement in risk prediction. Kavousi et al21 compared the N-terminal fragment of prohormone B-type natriuretic peptide, Von Willebrand factor antigen, fibrinogen levels, homocysteine levels, uric acid levels, high-sensitivity CRP, leukocyte count, chronic kidney disease, CAC, CIMT, peripheral artery disease, and pulse wave velocity to the FRS using a similar definition of CHD and statistical approach to the current study. The authors found that CAC provided the highest increment in AUC and NRI over the FRS. It is noteworthy that the Rotterdam investigators found similar results to the current study, despite differences in the 2 study populations. All of the Rotterdam Study participants were white and approximately 13% of the cohort had diabetes mellitus.

Even though our study indicates considerable superiority of CAC over several risk markers for risk prediction of CHD and CVD, several other factors should be considered before making broad recommendations about incorporation of CAC into primary prevention screening strategies. One notable concern is that measurement of CAC exposes individuals to a small but nontrivial amount of ionizing radiation (approximately 0.9-1.1 mSv). Recent efforts have been made to standardize equipment and imaging protocols to reduce radiation exposure during CAC imaging22; however, the extent to which these recommendations have been implemented in general medical practice is not known. Previous studies suggest wide variations in radiation dose during CAC imaging by region/type of institution/protocol.23 Even with the lowest possible radiation dose, there remains uncertainty about the magnitude of long-term cancer risks.24 A small risk associated with the lowest possible radiation dose during CAC imaging could translate into a large number of avoidable cancers if CAC were to be uniformly applied to the estimated 23 million people in the United States currently classified as intermediate risk by the FRS.25 Similarly, the benefits and risks associated with incidental findings detected during CAC imaging remain unclear. These indirect costs, in addition to the direct financial costs of CAC imaging, need to be weighed against the presumed benefits from better discrimination of participants at high risk for CHD and CVD events to best determine the role of CAC screening of patients with an intermediate risk for a CHD/CVD event. Thus, the ultimate decision regarding the optimum test to order should not be based solely on improvement in risk prediction afforded by a test but also cost effectiveness, acceptability to patients, and the potential risk and benefits associated with the test.26

The current study has limitations. We limited our analysis to the subset of MESA participants with complete data on all 6 risk markers, which decreased our sample size. Nevertheless, there were sufficient numbers of events to demonstrate clearly the superiority of CAC over the other measures in head-to-head ROC and NRI analyses. Finally, in MESA we did not specifically define family history of CHD as premature (ie, before the age of 55 for men and 65 for women). This may have influenced the association of family history with CHD and CVD.

Conclusions

CAC, ABI, high-sensitivity CRP, and family history were independent predictors of incident CHD/CVD beyond traditional risk factors, but had varying degrees of improvement in discrimination and classification of risk within intermediate-risk individuals. CAC had the highest improvement in both AUC and NRI when added to the FRS/RS. Additional research is warranted to explore further both the costs and benefits of CAC screening in intermediate-risk individuals.

Back to top
Article Information

Corresponding Author: Joseph Yeboah, MD, MS, Department of Internal Medicine/Cardiology, Wake Forest Baptist Health, Medical Center Boulevard, Winston-Salem, NC 27157 (jyeboah@wakehealth.edu).

Author Contributions: Dr Yeboah had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Yeboah, Burke, O’Leary, Carr, Herrington.

Acquisition of data: Burke, O’Leary, Carr, Greenland.

Analysis and interpretation of data: Yeboah, McClelland, Polonsky, Sibley, Carr, Goff, Greenland, Herrington.

Drafting of the manuscript: Yeboah.

Critical revision of the manuscript for important intellectual content: Yeboah, McClelland, Polonsky, Burke, Sibley, O’Leary, Carr, Goff, Greenland, Herrington.

Statistical analysis: Yeboah, McClelland, Herrington.

Obtained funding: Burke, O’Leary, Carr, Greenland.

Administrative, technical, or material support: Polonsky, Burke, O’Leary, Carr.

Study supervision: O’Leary, Carr, Greenland, Herrington.

Conflict of Interest Disclosures: Dr McClelland reports receipt of an institutional grant or pending grant from the National Institutes of Health (NIH) for contracts that fund the Multi-Ethnic Study of Atherosclerosis (MESA) study. Dr Burke reports receipt of an institutional grant from the National Heart, Lung, and Blood Institute (NHLBI). Dr O’Leary reports receipt of an institutional grant and support (to the institution) for travel to meetings for the study or other purposes from NIH. Dr Carr reports receiptof an institutional grant from NIH/NHLBI and receipt of consultancy fees from Merck & Co. Dr Goff reports receipt of an institutional grant and support (to the institution) for travel to meetings for the study or other purposes from NHLBI, board membership on the data and safety monitoring committee for a clinical trial from Takeda, and receipt of consultancy (operations committee member for a clinical trial) fees from Merck & Co. Dr Greenland reports receipt of an institutional grant and support (to the institution) for travel to meetings for the study or other purposes) from NHLBI, receipt of a grant or pending grant from NIH, and payment for lectures including service on speakers bureaus from univeristies and NIH, Dr Herrington reports receipt of an institutional grant from NIH. Drs Yeboah, Polonsky, and Sibley report no disclosures. All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest.

Funding/Support: This research was supported by contracts N01-HC-95159. 60, 61, 62, 63, 64, 65, 66, and N01-HC-95167 and Diversity Supplement R01HL098445 (primary investigator, Dr Carr). A full list of participating MESA investigators and institutions can be found at http://www.mesa-nhlbi.org.

Role of the Sponsor: The NHLBI participated in the design and conduct of MESA. A member of the NHLBI staff served as a coauthor and had input into the collection, management, analysis, and interpretation of the data and in preparation of the manuscript, as did the other coauthors. Although additional members of the NHLBI staff were able to view the manuscript prior to submission, they did not participate in the decision to submit the manuscript or approve it prior to publication. The National Center for Research Resources had no role in the design and conduct of the study, in the collection, analysis, and interpretation of the data, or in the preparation, review, or approval of the manuscript.

Additional Contributions: We thank the investigators, the staff, and the participants of MESA for their valuable contributions.

References
1.
Hayward RA, Krumholz HM, Zulman DM, Timbie JW, Vijan S. Optimizing statin treatment for primary prevention of coronary artery disease.  Ann Intern Med. 2010;152(2):69-7720083825PubMedGoogle ScholarCrossref
2.
Collins GS, Altman DG. An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study.  BMJ. 2009;339:b258419584409PubMedGoogle ScholarCrossref
3.
Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults.  Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III).  JAMA. 2001;285(19):2486-249711368702PubMedGoogle ScholarCrossref
4.
Nambi V, Chambless L, Folsom AR,  et al.  Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC study.  J Am Coll Cardiol. 2010;55:1600-160720378078PubMedGoogle ScholarCrossref
5.
Polonsky TS, McClelland RL, Jorgensen NW,  et al.  Coronary artery calcium score and risk classification for coronary heart disease prediction.  JAMA. 2010;303(16):1610-161620424251PubMedGoogle ScholarCrossref
6.
Ridker PM, Paynter NP, Rifai N, Gaziano JM, Cook NR. C-reactive protein and parental history improve global cardiovascular risk prediction: the Reynolds Risk Score for men.  Circulation. 2008;118(22):2243-2251, 4p, 225118997194PubMedGoogle ScholarCrossref
7.
Sivapalaratnam S, Boekholdt SM, Trip MD,  et al.  Family history of premature coronary heart disease and risk prediction in the EPIC-Norfolk prospective population study.  Heart. 2010;96(24):1985-198920962344PubMedGoogle ScholarCrossref
8.
Yeboah J, Folsom AR, Burke GL,  et al.  Predictive value of brachial flow-mediated dilation for incident cardiovascular events in a population-based study: the multi-ethnic study of atherosclerosis.  Circulation. 2009;120(6):502-50919635967PubMedGoogle ScholarCrossref
9.
Criqui MH, McClelland RL, McDermott MM,  et al.  The ankle-brachial index and incident cardiovascular events in the MESA (Multi-Ethnic Study of Atherosclerosis).  J Am Coll Cardiol. 2010;56(18):1506-151220951328PubMedGoogle ScholarCrossref
10.
Greenland P, Alpert JS, Beller GA,  et al; American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.  2010 ACCF/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.  Circulation. 2010;122(25):e584-e63621098428PubMedGoogle ScholarCrossref
11.
Bild DE, Bluemke DA, Burke GL,  et al.  Multi-ethnic study of atherosclerosis: objectives and design.  Am J Epidemiol. 2002;156(9):871-88112397006PubMedGoogle ScholarCrossref
12.
Friedewald WT, Levy RI, Fredrickson DS. Estimation of the concentration of low-density lipoprotein cholesterol in plasma, without use of the preparative ultracentrifuge.  Clin Chem. 1972;18(6):499-5024337382PubMedGoogle Scholar
13.
Carr JJ, Nelson JC, Wong ND,  et al.  Calcified coronary artery plaque measurement with cardiac CT in population-based studies: standardized protocol of Multi-Ethnic Study of Atherosclerosis (MESA) and Coronary Artery Risk Development in Young Adults (CARDIA) study.  Radiology. 2005;234(1):35-4315618373PubMedGoogle ScholarCrossref
14.
Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M Jr, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography.  J Am Coll Cardiol. 1990;15(4):827-8322407762PubMedGoogle ScholarCrossref
15.
Polak JF, Pencina MJ, O’Leary DH, D’Agostino RB. Common carotid artery intima-media thickness progression as a predictor of stroke in multi-ethnic study of atherosclerosis.  Stroke. 2011;42(11):3017-302121885840PubMedGoogle ScholarCrossref
16.
Delong ER, Delong DM, Clarke-Pearson DL. Comparing the area under two or more correlated receiver operating characteristic curves. a non-parametric approach.  Biometrics. 1988;44:837-8453202132PubMedGoogle ScholarCrossref
17.
Pencina MJ, D’Agostino RB, Vasan RS. Statistical methods for assessment of added usefulness of new biomarkers.  Clin Chem Lab Med. 2010;48(12):1703-171120716010PubMedGoogle ScholarCrossref
18.
Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score.  JAMA. 2007;297(6):611-61917299196PubMedGoogle ScholarCrossref
19.
Fowkes FG, Murray GD, Butcher I,  et al; Ankle Brachial Index Collaboration.  Ankle brachial index combined with Framingham Risk Score to predict cardiovascular events and mortality: a meta-analysis.  JAMA. 2008;300(2):197-20818612117PubMedGoogle ScholarCrossref
20.
Wilson PW, Pencina M, Jacques P, Selhub J, D’Agostino R Sr, O’Donnell CJ. C-reactive protein and reclassification of cardiovascular risk in the Framingham Heart Study.  Circ Cardiovasc Qual Outcomes. 2008;1(2):92-9720031795PubMedGoogle ScholarCrossref
21.
Kavousi M, Elias-Smale S, Rutten JH,  et al.  Evaluation of newer risk markers for coronary heart disease risk classification: a cohort study.  Ann Intern Med. 2012;156(6):438-44422431676PubMedGoogle ScholarCrossref
22.
Voros S, Rivera JJ, Berman DS,  et al; Society for Atherosclerosis Imaging and Prevention Tomographic Imaging and Prevention Councils; Society of Cardiovascular Computed Tomography.  Guideline for minimizing radiation exposure during acquisition of coronary artery calcium scans with the use of multidetector computed tomography: a report by the Society for Atherosclerosis Imaging and Prevention Tomographic Imaging and Prevention Councils in collaboration with the Society of Cardiovascular Computed Tomography.  J Cardiovasc Comput Tomogr. 2011;5(2):75-8321398199PubMedGoogle ScholarCrossref
23.
Kim KP, Einstein AJ, Berrington de González A. Coronary artery calcification screening: estimated radiation dose and cancer risk.  Arch Intern Med. 2009;169(13):1188-119419597067PubMedGoogle ScholarCrossref
24.
Berrington de González A, Mahesh M, Kim KP,  et al.  Projected cancer risks from computed tomographic scans performed in the United States in 2007.  Arch Intern Med. 2009;169(22):2071-207720008689PubMedGoogle ScholarCrossref
25.
Ford ES, Giles WH, Mokdad AH. The distribution of 10-Year risk for coronary heart disease among US adults: findings from the National Health and Nutrition Examination Survey III.  J Am Coll Cardiol. 2004;43(10):1791-179615145101PubMedGoogle ScholarCrossref
26.
Hlatky MA, Greenland P, Arnett DK,  et al; American Heart Association Expert Panel on Subclinical Atherosclerotic Diseases and Emerging Risk Factors and the Stroke Council.  Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association.  Circulation. 2009;119(17):2408-241619364974PubMedGoogle ScholarCrossref
×