Assessing the Validity of National Quality Measures for Coronary Artery Disease Using an Electronic Health Record | Cardiology | JAMA Internal Medicine | JAMA Network
[Skip to Navigation]
Access to paid content on this site is currently suspended due to excessive activity being detected from your IP address Please contact the publisher to request reinstatement.
[Skip to Navigation Landing]
Original Investigation
November 13, 2006

Assessing the Validity of National Quality Measures for Coronary Artery Disease Using an Electronic Health Record

Author Affiliations

Author Affiliations: Division of General Internal Medicine, Feinberg School of Medicine, Northwestern University (Drs Persell, Wright, and Baker and Mr Thompson), and American Medical Association (Dr Kmetik), Chicago, Ill.

Arch Intern Med. 2006;166(20):2272-2277. doi:10.1001/archinte.166.20.2272

Background  Nationally endorsed, clinical performance measures are available that allow for quality reporting using electronic health records (EHRs). To our knowledge, how well they reflect actual quality of care has not been studied. We sought to evaluate the validity of performance measures for coronary artery disease (CAD) using an ambulatory EHR.

Methods  We performed a retrospective electronic medical chart review comparing automated measurement with a 2-step process of automated measurement supplemented by review of free-text notes for apparent quality failures for all patients with CAD from a large internal medicine practice using a commercial EHR. The 7 performance measures included the following: antiplatelet drug, lipid-lowering drug, β-blocker following myocardial infarction, blood pressure measurement, lipid measurement, low-density lipoprotein cholesterol control, and angiotensin-converting enzyme inhibitor or angiotensin receptor blocker for patients with diabetes mellitus or left ventricular systolic dysfunction.

Results  Performance varied from 81.6% for lipid measurement to 97.6% for blood pressure measurement based on automated measurement. A review of free-text notes for cases failing an automated measure revealed that misclassification was common and that 15% to 81% of apparent quality failures either satisfied the performance measure or met valid exclusion criteria. After including free-text data, the adherence rate ranged from 87.5% for lipid measurement and low-density lipoprotein cholesterol control to 99.2% for blood pressure measurement.

Conclusions  Profiling the quality of outpatient CAD care using data from an EHR has significant limitations. Changes in how data are routinely recorded in an EHR are needed to improve the accuracy of this type of quality measurement. Validity testing in different settings is required.