Key PointsQuestion
Does modification of the 2013 pooled cohort equations to include former smoking status, pack-years, and years since quitting smoking improve atherosclerotic cardiovascular disease (ASCVD) risk prediction?
Findings
In this cohort study of 3908 individuals, including these smoking variables in the 2013 pooled cohort equations improves ASCVD risk prediction in White individuals. Overall, 14% of men and 15% of women who developed ASCVD were reclassified into higher risk groups compared with the base model; this would translate to the correct reclassification of ASCVD risk in nearly 3 million individuals in the US.
Meaning
If results are replicated in cohorts of race and ethnicity groups other than non-Hispanic White, these factors could be considered for inclusion in clinical ASCVD risk prediction tools.
Importance
Former heavy smokers (ie, those with ≥20 pack-years of smoking) may have higher atherosclerotic cardiovascular disease (ASCVD) risk than never smokers for up to 16 years after smoking cessation. However, the 2013 pooled cohort equations (PCE) do not account for pack-years of smoking and only consider current vs noncurrent smoking status without distinguishing former smokers from never smokers.
Objective
To assess the predictive utility of smoking history when added to the PCE using data from 18 400 person examinations among Framingham offspring participants.
Design, Setting, and Participants
This is a retrospective analysis of prospectively collected data from the Framingham Heart Study, a community-based cohort. Framingham Heart Study offspring cohort participants attending their first examination (1971-1975) who were followed-up through December 2016 were included.
Exposures
Self-reported current/former/never smoking status, pack-years smoked, and years since quitting.
Main Outcomes and Measures
Incident ASCVD (myocardial infarction, fatal/nonfatal ischemic stroke, coronary heart disease death).
Results
Of 3908 patients, there were 358 and 197 events among 1895 men and 2013 women, respectively, with a mean (SD) age of 55 (9.5) years. Ever smoking prevalence was high (6474 men [77%] and 7760 women [78%]), as were median pack-years (men: 39; women: 32 overall person examinations). Four sex-specific ASCVD risk prediction models were built using pooled-repeated Cox proportional hazards regression. The PCEs were was fit in this sample with continuous predictors on their natural scale (ie, not logarithmically transformed) as well as polynomials accounting for nonlinearity and then cumulatively adjusted for former smoking, pack-years, and years since quitting. Models were compared via change in C statistic, continuous net reclassification improvement (NRI[>0]), and relative integrated discrimination improvement (rIDI). Including former smoking status, pack-years, and years since quitting had significant but modest NRI(>0) and rIDI values compared with the PCE with continuous variables on their natural scale in both sexes (men: NRI[>0] = 0.23; rIDI = 0.19; women: NRI[>0] = 0.34, rIDI = 0.11; change in C statistic = 0.01 for both).
Conclusions and Relevance
Former smoking, pack-years, and years since quitting significantly improved ASCVD risk prediction in this sample. The Framingham Heart Study offspring cohort is largely composed of non-Hispanic White participants of European ancestry. If results are validated in cohorts of race and ethnicity groups other than White, these variables could be considered for inclusion in future ASCVD risk prediction models.
The cornerstone of atherosclerotic cardiovascular disease (ASCVD) prevention is assessing risk prior to an event and implementing lifestyle and drug interventions accordingly; the current criterion standard risk assessment tool is the ASCVD Risk Estimator Plus.1,2 This calculator considers former smokers, for the first 5 years after cessation, to be at excess ASCVD risk compared with never smokers and does not incorporate pack-years smoked. However, we recently demonstrated that excess ASCVD risk among former heavy (≥20 pack-years) smokers vs never smokers can remain for up to 16 years postcessation.3 Thus, years since quitting (YSQ) and pack-years smoked may play an important role in ASCVD risk estimation.
The ASCVD Risk Estimator Plus is based on the 2013 American College of Cardiology/American Heart Association Guideline on the Assessment of Cardiovascular Risk and its corresponding sex- and race-specific pooled cohort equations (2013 PCE) for estimation of 10-year ASCVD risk.4 The 2013 PCE were developed to expand on prior cardiovascular disease risk prediction equations5-7 in a racially and geographically diverse sample.4 Although up to 25% of ASCVD deaths are attributable to cigarette smoking,8,9 former smoking status, pack-years smoked, and YSQ were not considered for inclusion owing to lack of available data in all cohorts used to develop the 2013 PCE. There are currently more than 55 million individuals in the US who have quit smoking10; this number grows as smoking cessation increases.11 Furthermore, the 2015 National Health Interview Survey estimates that 29% of former and 33% of current smokers have accumulated at least 20 pack-years smoked.12 Because ASCVD risk increases with greater pack-years smoked and decreases with sustained cessation,3 ASCVD risk may be misestimated in individuals who have ever smoked heavily.
In this context, we fit a series of ASCVD risk prediction models using Framingham Heart Study (FHS) data. By assessing a variety of model fit metrics spanning goodness of fit, discrimination, calibration, and reclassification, we evaluated the predictive utility of adding former smoking status, pack-years smoked, and YSQ to the 2013 PCE for more accurate ASCVD risk prediction.
This investigation included more than 40 years of data on FHS offspring13 cohort participants attending their first (1971-1975) examination cycle with at least 1 subsequent contact with study staff. Participants presented for quadrennial examination cycles beginning in 1979 (up to 8 examination cycles in this analysis). Each person examination and the ensuing 10 years served as an independent ASCVD risk prediction window, yielding up to 8 data records per individual (eFigure 1 in the Supplement).
The analysis data set was constructed in 2 phases. First, we excluded participants from the base sample if, at examination 1, they had a history of myocardial infarction (MI), ischemic stroke (IS), heart failure (HF), coronary artery bypass graft (CABG), percutaneous coronary intervention (PCI), or atrial fibrillation (AF) or were missing data that would prevent us from quantifying lifetime smoking history. In the second phase of data set construction, we applied exclusion criteria at the person examination level since these served as individual baselines for 10-year ASCVD risk prediction. Person examinations were excluded for the following reasons: age younger than 40 years or older than 79 years; history of MI, IS, HF, CABG, PCI, or AF; or missing data on predictors. Following exclusions, our final sample for analysis contained 18 400 person examinations on 3908 individuals (Figure). This study was approved by institutional review boards at Boston University Medical Center, Vanderbilt University Medical Center, and University of Kentucky; FHS participants provided written informed consent.
FHS participants are under continuous surveillance for development of ASCVD events. In this investigation, participants were surveilled until December 31, 2016, for development of ASCVD events including MI, fatal or nonfatal IS, and coronary heart disease death. For suspected ASCVD events, medical records were obtained with permission; events were adjudicated by 3 physicians as previously detailed.3,14-16
ASCVD Risk Factor Definitions
Our risk factor definitions were the same as those in the sex-specific 2013 PCE4 models (age, total cholesterol, high-density lipoprotein [HDL] cholesterol, systolic blood pressure [SBP], antihypertensive use, current smoking status, and diabetes). Statin therapy was not included in the development of the 2013 PCE, so we did not include it either to facilitate direct comparison. Further risk factor definitions are provided in the eMethods in the Supplement.
Quantification of Smoking Status and Intensity
At baseline examination, participants were categorized as current, former, or never smokers based on their responses to questions regarding current and prior smoking habits. From responses given for age at which the participant starting smoking, usual cigarettes smoked per day in the past, age at quitting (former smokers), and current number of cigarettes smoked per day (current smokers), we calculated ever smokers’ pack-years and former smokers’ YSQ. For this analysis, our smoking measures included 3-level (current/former/never) smoking status, pack-years, and YSQ. Additional details are provided in the eMethods in the Supplement.
Summary statistics were stratified by sex; within sex, statistics were pooled over all person examinations. We calculated means and standard deviations for normally distributed variables and medians along with the interquartile range for variables with skewed distributions. Counts and percentages were calculated for categorical variables.
We performed a series of sex-specific pooled repeated Cox proportional hazards regressions to predict ASCVD incidence.17,18 In all models, the Huber-White sandwich covariance estimator19,20 was used to account for correlation among repeated observations in the same individuals with overlapping follow-up intervals; this methodology is consistent with prior investigations of overlapping follow-up intervals.21
We first fit sex-specific models, which were similar to the 2013 PCE but with 3 changes: (1) inclusion of continuous variables on their natural scale (ie, not logarithmically transformed); (2) up to third-order polynomials on continuous variables (and their interactions) to account for nonlinearity; and (3) adjustment for antihypertensive use and measured SBP rather than including separate terms for treated/untreated SBP. Reasons for these alterations, as well as the polynomial terms on continuous variables, are provided in the eMethods in the Supplement. This reference model included age, total cholesterol, HDL cholesterol, SBP, antihypertensive use, current smoking status, and diabetes status as risk factors; total cholesterol, HDL cholesterol, and current smoking status interacted with age and antihypertensive use interacted with SBP. Subsequent models cumulatively adjusted for former smoking status, pack-years smoked, and YSQ; each of these smoking variables interacted with age.
To determine whether former smoking status, pack-years smoked, and/or YSQ should be added to the 2013 PCE, we evaluated whether these variables possess incremental value and clinical utility.22 We assessed incremental value via change in Harrell C statistic23 and continuous net reclassification improvement (NRI[>0]).24-27 In the setting of risk prediction, clinical utility of a variable refers to its ability to sufficiently move an individual across the risk spectrum when added to a model22; we quantified clinical utility using the relative integrated discrimination improvement (rIDI).27 rIDI is considered clinically meaningful when it is larger than 1/p where p is the number of degrees of freedom in the reference model.27 Since our reference model included 23 degrees of freedom, an rIDI more than 0.043 was considered clinically meaningful. Statistical significance of all 3 metrics was evaluated via bootstrapped 95% CIs. Since models must be well calibrated to assess NRI(>0) and rIDI, we also calculated the D’Agostino and Nam extension of the Hosmer-Lemeshow calibration test.28
To visually assess risk reclassification, we created reclassification plots for each model under consideration. To be thorough in our assessment of former smoking status, pack-years, and YSQ, we evaluated goodness of fit via likelihood ratio and Nagelkerke R2.29,30
Secondary analyses examined the predictive ability of smoking variables compared with other ASCVD risk factors included in the PCE. In these analyses, we fit 4 models in each sex: 1 for each group of risk factors (lipids [total and HDL cholesterol], blood pressure [SBP and antihypertensive use], diabetes [indicator of fasting plasma glucose >126 mg/dL (to convert to millimoles per liter, multiply by 0.0555) or usage of antidiabetic medications], and smoking [3-level smoking status, pack-years, and YSQ]); each model also included age and any interactions with age included in our final model. The predictive ability was quantified by Harrell C statistic and Nagelkerke R2.
Exploratory analyses compared risk category classification under the 2013 PCE vs our final model (model with 2013 PCE variables plus former smoking, pack-years, and YSQ) in events and nonevents separately within each sex. Categories were defined as low, borderline, intermediate, and high using the same cutoffs described above to maintain consistency with the 2013 PCE1,4 and also by deciles of risk to provide more detailed results. We then used the number of current and former US smokers10,31 in conjunction with the proportion of ever smokers with 20 or more pack-years estimated by the National Health Interview Survey12 and our reclassification results to estimate the number of US heavy ever smokers who would be correctly reclassified under our final model compared with the 2013 PCE.
Finally, we performed a preliminary validation analysis to determine whether our results would replicate in a contemporary sample with lower smoking prevalence. Using the same inclusion/exclusion criteria as the derivation sample, we pooled data from the first (2002-2005) and second (2008-2011) examinations of the FHS generation 3 cohort32 with that from the ninth examination of the FHS offspring cohort (2011-2014). All models were refit in this validation sample to determine whether model form, rather than the estimated effect sizes, improved ASCVD risk prediction.
Approximately 1% of person examinations were missing covariate data. Since the proportion of missingness was small, we assumed that values were missing completely at random. Under this assumption, a complete case analysis would not bias our results. A 2-sided P value less than .05 was considered statistically significant. All analyses were performed in SAS statistical software version 9.4 (SAS Institute). Analysis took place from October 2019 to September 2021.
We analyzed data from 18 400 person examinations on 3908 individuals (8395 person examinations on 1895 men [48.5%] and 10 005 person examinations on 2013 women [51.5%]). Most characteristics were similar between men and women (Table 1). Nearly a quarter of the sample were never smokers, but more men were former smokers (3790 [45%]) than women (3573 [36%]). Correspondingly, a larger proportion of women than men were current smokers (4187 women [42%] and 2684 men [32%]). However, men who had ever smoked tended to smoke more heavily than their female counterparts (Table 1).
Throughout a total of 169 484 person-years, 555 incident ASCVD events occurred: 358 (64.5%) in men and 197 (35.5%) in women. Results of the model fitting procedure in men and women are displayed in Table 2. All models were well calibrated (Table 2; eFigures 2-5 in the Supplement).
We began by fitting the reference model with 2013 PCE variables and then added an indicator of former smoking status. This change improved goodness of fit (likelihood ratio and R2) and clinical utility (rIDI), but NRI(>0) was small, and change in Harrell C statistic was not statistically significant. Further adjustment for pack-years proved significant on all metrics, producing a clinically meaningful rIDI and a moderate NRI(>0). Addition of YSQ was also significant on all metrics (Table 2).
Overall, the model with 2013 PCE variables with additional adjustment for former smoking, pack-years, and YSQ (our final model) was the best fit to the data, featuring the highest likelihood, R2, and Harrell C statistic; moderate NRI(>0); and a statistically significant and clinically meaningful rIDI. Compared with the reference model with 2013 PCE variables, change in predicted probability of 10-year ASCVD incidence was greatest on addition of all 3 smoking variables as shown in eFigure 6 in the Supplement.
Model fitting in women progressed as in men (Table 2). Adding an indicator of former smoking status did not improve model fit. Addition of pack-years smoked improved goodness of fit, produced a moderate NRI(>0) and a clinically meaningful rIDI but did not improve the C statistic. When YSQ was added, the likelihood ratio test and change in Harrell C statistic were not significant, but R2 increased, the NRI(>0) was moderate, and rIDI was both statistically significant and clinically meaningful (Table 2). Compared with the reference model with 2013 PCE variables, change in predicted probability of 10-year ASCVD incidence was greatest on addition of all 3 smoking variables, but the change was less pronounced than in men (eFigure 7 in the Supplement).
Secondary Analyses: Predictive Ability of Smoking Variables Compared With Other Risk Factors
In men and women, models that included age, smoking variables, and their interactions produced the highest Harrell C statistic and Nagelkerke R2 compared with models with age and lipids, blood pressure, or diabetes alone (Table 3).
Exploratory Analyses: Reclassification Tables
The majority of individuals remained in the same risk category under the PCE and our final model (Table 4). Among men, similar proportions of nonevents were correctly reclassified at lower risk (570 [7.1%]) and incorrectly reclassified as higher risk (485 [6.0%]) under our final model compared with the PCE (Table 4). However, 14% of men (n = 50) who experienced ASCVD events within 10 years were classified as higher risk under our final model compared with the PCE while only 6.7% (n = 24) were incorrectly reclassified into a lower-risk category (Table 4). Although the proportion of women who were reclassified under our final model compared with the PCE was different than in men, the trend was similar (Table 4). Reclassification results in individuals who ever heavily smoked were similar to those of the full sample (eTables 1 and 2 in the Supplement). Using the number of former and current US smokers10,31 and the proportion of these ever smokers with at least 20 pack-years from the 2015 National Health Interview Survey,12 we estimate that approximately 3 million individuals in the US with 20 or more pack-years smoked would be correctly reclassified under models capturing details of smoking exposure compared with the 2013 PCE.
Our validation sample included 1905 men (44.4%; 2715 person examinations, 91 incident ASCVDs) and 2388 women (55.6%; 3318 person examinations, 47 incident ASCVDs). In this sample, 2159 (50%) were never smokers, 1615 (38%) were former smokers, and 519 (12%) were current smokers at their baseline examination. For men, results were similar to those observed in the derivation cohort: the Nagelkerke R2 improved, C statistic increased (although not significantly), NRI(>0) was moderate, and rIDI was clinically meaningful when adding former smoking status, pack-years, and YSQ to the reference model with 2013 PCE variables (eTable 3 in the Supplement). In women, results roughly followed a similar pattern as men, but the estimates had wide confidence intervals yielding only a clinically meaningful rIDI (eTable 3 in the Supplement).
Inclusion of former smoking status, pack-years, and YSQ improved ASCVD risk prediction over the reference model with 2013 PCE variables. Specifically, adding these variables produced moderate NRI(>0) values of 0.23 and 0.34 in men and women, respectively, and clinically meaningful rIDI values of 0.19 and 0.11 in men and women, respectively. Furthermore, when included in a model with age, smoking variables produced a higher Harrell C statistic and Nagelkerke R2 than lipids, blood pressure, or diabetes, and their inclusion could correctly reclassify the ASCVD risk of as many as 3 million individuals in the US who have ever heavily smoked.
To our knowledge, this is the first investigation to demonstrate that pack-years and YSQ improve ASCVD risk prediction vs current tools. These findings are consistent with earlier work demonstrating that cardiovascular disease risk of those who formerly heavily smoked (>20 pack-years) compared with those who never smoked remains significantly elevated beyond 5 years after smoking cessation.3 These findings also build on the work by Lloyd-Jones et al,1,2 which distinguished risk between former and never smokers during the first 5 years of cessation.2 Here, we extended the time for which former smokers are at elevated risk compared with never smokers and incorporated pack-years. The inclusion of both pack-years smoked and YSQ in ASCVD risk estimation is necessary because they contribute different information: pack-years distinguish risk among ever smokers, while former smokers’ YSQ quantifies the amount of ASCVD risk attributable to smoking remaining at a given assessment. Results from our preliminary validation analysis demonstrate consistency of our findings in men in a contemporary cohort; this was not the case among women, but our final model contained many predictors and few events, so this model was likely underpowered and overfit.
These findings have important implications for patients and health care professionals. As of 2018, there were 55 million former smokers and 34.2 million current smokers in the United States.10,31 Our prior work demonstrates that those who ever heavily smoked carry excess ASCVD risk that is not currently captured with quantitative risk assessment tools, which only consider current and noncurrent smoking status.3 Reclassification tables in the current analysis show that including more comprehensive smoking history in risk estimation could correctly reclassify ASCVD risk for nearly 3 million individuals in the US with 20 or more pack-years smoked compared with the 2013 PCE. On an individual level, more accurate risk prediction may motivate smokers to quit smoking or encourage former smokers to discuss additional ways to lower their ASCVD risk with their health care professional. For clinicians, creating a more accurate risk prediction tool may identify high-risk patients requiring additional attention such as monitoring, or even early detection for ASCVD, akin to lung cancer screening in high-risk current and former smokers.33
Strengths and Limitations
The current investigation possesses several strengths, including FHS offspring cohort data, which spans 45 years. Furthermore, FHS participants are under continuous surveillance for ASCVD development, allowing near-complete event ascertainment. The regular assessment of these individuals enabled us to update smoking status, pack-years, and YSQ throughout follow-up to accurately reflect the added value of these predictors on ASCVD risk prediction. Finally, rather than relying on 1 method, we assessed various facets of model prediction including goodness of fit, discrimination, and calibration.
Although the data source is a strength of this investigation, the FHS offspring cohort is community-based and smoking patterns (notably the high proportion of current smokers) and sociodemographics of participants may not reflect those of the US population. However, our results remained consistent among men in a contemporary cohort in which more than 50% of participants were never smokers and 11% were current smokers. Furthermore, evidence suggests that while the design and composition of cigarettes (eg, ventilated filters, higher levels of tobacco-specific nitrosamines in smoke) have changed over time, and prevalence of smoking has decreased, the effect of smoking on cardiovascular health outcomes has remained relatively stable.8 In addition, FHS offspring cohort participants are almost exclusively middle class White individuals of European ancestry (>99% non-Hispanic White), limiting generalizability. However, cigarette smoking is more prevalent and cessation rates are lower in low socioeconomic groups compared with higher ones34-36; current ASCVD risk assessment tools also tend to underestimate risk in these individuals.37,38 Thus, including pack-years smoked in ASCVD risk calculators may help minimize this underestimation. For these reasons, future research should validate these findings in a large, contemporary, and sociodemographically diverse sample. Finally, our model expansions did not markedly increase the C statistic. However, comparison of 2 C statistics via change in Harrell C statistic is a low-power procedure when many observations are censored.39
In the FHS offspring cohort, including former smoking status, pack-years smoked, and YSQ improved ASCVD risk prediction, 15% of women and 14% of men who experienced ASCVD events in our sample were classified into a higher-risk group under our model compared with the 2013 PCE. Furthermore, smoking variables discriminated ASCVD risk better than lipids, blood pressure, or diabetes. The number of former smokers is growing, and such individuals remain at excess ASCVD risk compared with never smokers for up to 16 years after quitting. If validated in individuals of other races and ethnicities and socioeconomic groups, modification of the PCEs to include these variables could mitigate underestimation of risk among current and former smokers.
Corresponding Author: Meredith S. Duncan, PhD, University of Kentucky, Ste 460A, Healthy Kentucky Research Building, 760 Press Ave, Lexington, KY 40536-0679 (meredith.duncan@uky.edu).
Accepted for Publication: October 14, 2021.
Published Online: December 8, 2021. doi:10.1001/jamacardio.2021.4990
Author Contributions: Drs Duncan and Freiberg had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Duncan, Greevy, Tindle, Aldrich, Lloyd-Jones, Freiberg.
Acquisition, analysis, or interpretation of data: Duncan, Greevy, Tindle, Ramachandran, Lipworth, Lloyd-Jones, Freiberg.
Drafting of the manuscript: Duncan, Greevy, Lloyd-Jones, Freiberg.
Critical revision of the manuscript for important intellectual content: Duncan, Greevy, Tindle, Ramachandran, Lipworth, Aldrich, Lloyd-Jones.
Statistical analysis: Duncan, Greevy.
Obtained funding: Lloyd-Jones.
Administrative, technical, or material support: Tindle, Ramachandran.
Supervision: Greevy, Lipworth, Aldrich, Lloyd-Jones, Freiberg.
Conflict of Interest Disclosures: Dr Tindle has volunteered input on design for a phase 3 trial of the smoking cessation medication cytisine proposed by Achieve Life Sciences and is a principal investigator of National Institutes of Health (NIH)–sponsored studies for smoking cessation that include medications donated by the manufacturers. Dr Ramachandran reported grants from the NIH during the conduct of the study. Dr Aldrich reported grants from NIH/National Cancer Institute during the conduct of the study. Dr Lloyd-Jones reported grants from NIH during the conduct of the study. No other disclosures were reported.
Funding/Support: Dr Tindle acknowledges the support of the William Anderson Spickard, Jr, Chair in Medicine and the National Cancer Institute Moonshot Initiative (3P30CA068485-22S3). Dr Freiberg acknowledges support of the Dorothy and Laurence Grossman Chair in Cardiology. Dr Vasan is supported in part by the Evans Medical Foundation and the Jay and Louis Coffman Endowment from the Department of Medicine, Boston University School of Medicine. Dr Aldrich acknowledges the support of contract U01-CA253560 from the National Cancer Institute and the Lung Cancer Research Foundation. The Framingham Heart Study acknowledges the support of contracts NO1-HC-25195, HHSN268201500001I, and 75N92019D00031 from the National Heart, Lung and Blood Institute for this research.
Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Additional Contributions: We thank Sean Coady, MA, of the National Heart, Lung, and Blood Institute for his guidance regarding the statistical methods implemented in development of the American College of Cardiology/American Heart Association 2013 Pooled Cohort Equations. Mr Coady was not compensated. SAS macros for calculating change in C statistic, net reclassification improvement(>0), relative integrated discrimination improvement, and their corresponding 95% CIs were obtained from https://ncook.bwh.harvard.edu. We also acknowledge the dedication of the Framingham Heart Study participants and staff, without whom this research would not be possible.
1.Lloyd-Jones
DM, Huffman
MD, Karmali
KN,
et al. Estimating longitudinal risks and benefits from cardiovascular preventive therapies among medicare patients: the Million Hearts Longitudinal ASCVD Risk Assessment Tool: a special report from the American Heart Association and American College of Cardiology.
Circulation. 2017;135(13):e793-e813. doi:
10.1161/CIR.0000000000000467PubMedGoogle ScholarCrossref 4.Goff
DC
Jr, Lloyd-Jones
DM, Bennett
G,
et al. 2013 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guideline.
J Am Coll Cardiol. 2014;63(25 pt B):2935-2959. doi:
10.1016/j.jacc.2013.11.005PubMedGoogle Scholar 6.National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). Third Report of the National Cholesterol Education Program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (adult treatment panel III) final report.
Circulation. 2002;106(25):3143-3421. doi:
10.1161/circ.106.25.3143PubMedGoogle ScholarCrossref 9.National Center for Chronic Disease Prevention and Health Promotion (US) Office on Smoking and Health. The Health Consequences of Smoking—50 Years of Progress: A Report of the Surgeon General. Centers for Disease Control and Prevention; 2014.
12.Landy
R, Cheung
LC, Berg
CD, Chaturvedi
AK, Robbins
HA, Katki
HA. Contemporary implications of US Preventive Services Task Force and risk-based guidelines for lung cancer screening eligibility in the United States.
Ann Intern Med. 2019;171(5):384-386. doi:
10.7326/M18-3617PubMedGoogle ScholarCrossref 17.Ngwa
JS, Cabral
HJ, Cheng
DM,
et al. A comparison of time dependent Cox regression, pooled logistic regression and cross sectional pooling with simulations and an application to the Framingham Heart Study.
BMC Med Res Methodol. 2016;16(1):148. doi:
10.1186/s12874-016-0248-6PubMedGoogle ScholarCrossref 18.D’Agostino
RB, Lee
M-L, Belanger
AJ, Cupples
LA, Anderson
K, Kannel
WB. Relation of pooled logistic regression to time dependent Cox regression analysis: the Framingham Heart Study.
Stat Med. 1990;9(12):1501-1515. doi:
10.1002/sim.4780091214PubMedGoogle ScholarCrossref 22.Hlatky
MA, Greenland
P, Arnett
DK,
et al; American Heart Association Expert Panel on Subclinical Atherosclerotic Diseases and Emerging Risk Factors and the Stroke Council. Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association.
Circulation. 2009;119(17):2408-2416. doi:
10.1161/CIRCULATIONAHA.109.192278PubMedGoogle ScholarCrossref 23.Harrell
FE. The PHGLM procedure. In: SUGI Supplemental Library Guide. 5th ed. SAS Institute; 1986.
26.Pencina
MJ, D’Agostino
RB
Sr, D’Agostino
RB
Jr, Vasan
RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.
Stat Med. 2008;27(2):157-172. doi:
10.1002/sim.2929PubMedGoogle ScholarCrossref 27.Pencina
MJ, D’Agostino
RB, Pencina
KM, Janssens
AC, Greenland
P, Greenland
P. Interpreting incremental value of markers added to risk prediction models.
Am J Epidemiol. 2012;176(6):473-481. doi:
10.1093/aje/kws207PubMedGoogle ScholarCrossref 28.D’Agostino
RB, Nam
BH. Evaluation of the performance of survival analysis models: discrimination and calibration measures.
Handbook Stat. 2004;23:1-25.
Google Scholar 29.Maddala
G.
Limited-Dependent and Qualitative Variables in Econometrics. Cambridge University Press; 1983. doi:
10.1017/CBO9780511810176 32.Splansky
GL, Corey
D, Yang
Q,
et al. The Third generation cohort of the National Heart, Lung, and Blood Institute’s Framingham Heart Study: design, recruitment, and initial examination.
Am J Epidemiol. 2007;165(11):1328-1335. doi:
10.1093/aje/kwm021PubMedGoogle ScholarCrossref 37.Colantonio
LD, Richman
JS, Carson
AP,
et al. Performance of the atherosclerotic cardiovascular disease pooled cohort risk equations by social deprivation status.
J Am Heart Assoc. 2017;6(3):e005676. doi:
10.1161/JAHA.117.005676PubMedGoogle Scholar 38.Dalton
JE, Perzynski
AT, Zidar
DA,
et al. Accuracy of cardiovascular risk prediction varies by neighborhood socioeconomic position: a retrospective cohort study.
Ann Intern Med. 2017;167(7):456-464. doi:
10.7326/M16-2543PubMedGoogle ScholarCrossref