Effect of the interventions on health care provider behavior, measured as did anything, at baseline and during subsequent 6-month periods when random capillary glucose level at a visit was higher than 150 mg/dL (8.33 mmol/L). Asterisk indicates P<.001 for feedback groups vs other groups.
Effect of the interventions on health care provider behavior, measured as did enough, at baseline and during subsequent 6-month periods when random capillary glucose level at a visit was higher than 150 mg/dL (8.33 mmol/L). Asterisk indicates P<.001 for feedback groups vs other groups.
Effect of the interventions on health care provider behavior, measured as did anything, at baseline and at the end of each subsequent year, when random capillary glucose level at a visit fell within the following ranges: 151 to 200, 201 to 250, 251 to 300, and over 300 mg/dL (8.38-11.04, 11.10-13.82, 13.88-16.65, and >16.65 mmol/L). The y-axis indicates the ordinal logistical regression model–predicted percentage of health care provider behavior after adjustment for patient age, body mass index, duration of diabetes, sex, race, and health care provider post-graduate year and length of exposure to the intervention as well as clustering.
Effect of the interventions on health care provider behavior, measured as did enough, at baseline and at the end of each subsequent year, when random capillary glucose level at a visit fell within the following ranges: 151 to 200, 201 to 250, 251 to 300, and over 300 mg/dL (8.38-11.04, 11.10-13.82, 13.88-16.65, and >16.65 mmol/L). The y-axis indicates the ordinal logistical regression model–predicted percentage of health care provider behavior after adjustment for patient age, body mass index, duration of diabetes, sex, race, and health care provider post-graduate year and length of exposure to the intervention as well as clustering.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Ziemer DC, Doyle JP, Barnes CS, et al. An Intervention to Overcome Clinical Inertia and Improve Diabetes Mellitus Control in a Primary Care Setting: Improving Primary Care of African Americans With Diabetes (IPCAAD) 8. Arch Intern Med. 2006;166(5):507–513. doi:10.1001/archinte.166.5.507
Copyright 2006 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.2006
Although clinical trials have shown that proper management of diabetes can improve outcomes, and treatment guidelines are widespread, glycated hemoglobin (HbA1c) levels in the United States are rising. Since process measures are improving, poor glycemic control may reflect the failure of health care providers to intensify diabetes therapy when indicated—clinical inertia. We asked whether interventions aimed at health care provider behavior could overcome this barrier and improve glycemic control.
In a 3-year trial, 345 internal medicine residents were randomized to be controls or to receive computerized reminders providing patient-specific recommendations at each visit and/or feedback on performance every 2 weeks. When glucose levels exceeded 150 mg/dL (8.33 mmol/L) during visits of 4038 patients, health care provider behavior was characterized as did nothing, did anything (any intensification of therapy), or did enough (if intensification met recommendations).
At baseline, residents did anything for 35% of visits and did enough for 21% of visits when changes in therapy were indicated, and there were no differences among intervention groups. During the trial, intensification increased most during the first year and then declined. However, intensification increased more in the feedback alone and feedback plus reminders groups than for reminders alone and control groups (P<.001). After 3 years, health care provider behavior in the reminders alone and control groups returned to baseline, whereas improvement with feedback alone and feedback plus reminders groups was sustained: 52% did anything, and 30% did enough (P<.001 for both vs the reminders alone and control groups). Multivariable analysis showed that feedback on performance contributed independently to intensification and that intensification contributed independently to fall in HbA1c (P<.001 for both).
Feedback on performance given to medical resident primary care providers improved provider behavior and lowered HbA1c levels. Similar approaches may aid health care provider behavior and improve diabetes outcomes in other primary care settings.
Type 2 diabetes mellitus is a major public health problem. The lifetime risk of diabetes has recently been projected at 33% and 38% for American men and women born in 2000,1 with accompanying decrease in life expectancy.1,2 Diabetes is now the sixth leading cause of death in the United States,3 and accounted for about 11% of total US health care expenditures in 2002.4 Although better metabolic control can reduce costs,5 recent analyses indicate that glycated hemoglobin (HbA1c) levels are getting worse rather than better; in the NHANES surveys,6 the average HbA1c level in patients with diagnosed diabetes mellitus rose from 7.8% in 1988-1994 to 8.1% in 1999-2000.
Despite the persistence of inadequate metabolic control, how best to rectify the problem is not well understood. Glycemic control is clearly affected by poor patient adherence to treatment regimens, such as failure to keep appointments or to take medications as recommended,7,8 but such measures of patient engagement have been relatively constant in our large diabetes specialty care site over the past 12 years.9 Moreover, the rise in HbA1c level is occurring despite improvement in process measures.10,11 Accordingly, it is more likely that poor glycemic control reflects contributions from the failure of health care providers to initiate or intensify therapy appropriately—clinical inertia.12 Clinical inertia appears to hinder control of hypertension13 and dyslipidemia14 as well as diabetes15-19 but may be less of a problem for diabetes specialists than for primary care physicians.17,19 To the extent that clinical inertia is a limiting problem, interventions aimed at improving health care provider behavior—reducing clinical inertia—might lead to better diabetes management in the primary care setting.
This hypothesis has been tested in the Improving Primary Care of African Americans with Diabetes (IPCAAD) study,20 a controlled trial in which primary care physicians (internal medicine residents) were randomized either to be controls or to receive interventions aimed at reducing clinical inertia. We now report the impact of these interventions on health care provider behavior and its relation to changes in HbA1c levels over the 3-year period of the study.
The IPCAAD study20 was approved by the Emory University institutional review board for conduct without consent forms and was based in the Grady Medical Clinic, the largest site of primary care in the Grady Health System. The patients were predominantly African American and economically disadvantaged.21 The Grady Medical Clinic has roughly 60 000 patient visits per year and is staffed by residents, nurse practitioners, physician assistants, and attending physicians, with support from pharmacists, nutritionists, health educators, and social workers. The IPCAAD study focused on patients with type 2 diabetes mellitus treated by internal medicine residents who were supervised by Emory Division of General Medicine faculty members.
The IPCAAD study has been described in detail elsewhere.20 Briefly, beginning in July 1999, the visits of all patients with type 2 diabetes mellitus included interactions with study personnel who measured capillary glucose levels and blood pressure and recorded the incoming and outgoing medications. From January 1, 2000, through December 31, 2002, residents were randomized either to be controls (usual care) or to receive interventions thought to be capable of changing health care provider behavior (ie, computerized reminders, feedback on performance, or both reminders and feedback).22-29 Whenever patients were seen by control residents, those residents did not receive either reminders or feedback on performance. For logistical reasons, residents within each half-day clinic received only a single intervention.
As described previously,30 the reminders included both a flowsheet section to show laboratory values, weight, blood pressure, and use of medications over a period of 6 to 18 months and a recommendations section. Underlying the recommendations were individualized algorithms for management, which took into account each patient's prescribed outgoing medications from the previous visit and the most recent laboratory and/or clinical values and advised changes in dosage of current medications and/or dosage of new medications to be added to the regimen. Feedback sessions were face-to-face, one-on-one between one of the endocrinologist investigators and a resident, approximately 5 minutes in duration, and were scheduled every 2 weeks. The sessions included review of individual health care provider actions or outcomes specific to the patients seen by that provider. Emphasis was placed on achieving American Diabetes Association goals31 and on acting appropriately when values were abnormal during patient visits (eg, when random capillary glucose level exceeded 150 mg/dL [8.33 mmol/L]). We have found that such glucose values are highly predictive of HbA1c levels higher than 7%32 and that intensification of therapy based on such values is associated with very little risk of severe hypoglycemia.33
Clinical and laboratory data from all visits were captured manually and via electronic transfer and maintained in a relational database (Oracle, Redwood City, Calif). Hemoglobin A1c was measured with the Hitachi 717 analyzer (Boehringer Mannheim, Indianapolis, Ind) and capillary glucose with the MediSense Precision PCx Point-of-Care System (Abbott Laboratories, Bedford, Mass). Capillary glucose measurements were defined as random if they occurred less than 5 hours after the last meal and fasting otherwise. To simplify the analysis, 25 mg/dL (1.39 mmol/L) was added to fasting glucose levels to render them comparable to random glucose levels; the relationship between HbA1c and random glucose levels is almost identical to the relationship between HbA1c and the following quantity: fasting glucose level + 25mg/dL (1.39 mmol/L).34
Based on publications in the literature, we used a glucose algorithm35 to transform changes in therapy made by the residents into “steps”; one step was intended to reduce the HbA1c level by approximately 1%. Since a random glucose level of 150 mg/dL (8.33 mmol/L) corresponds to an HbA1c level of about 7%, and a difference of 50 mg/dL (2.78 mmol/L) corresponds to a difference in HbA1c level of about 1%,32 steps of therapy needed to reduce HbA1c level to about 7% at a given visit were arbitrarily expressed, using milligrams per deciliter, as (random glucose level − 150)/50. For visits in which the random glucose level was higher than 150 mg/dL (8.33 mmol/L), management was categorized as did nothing (no steps taken), did anything (some steps taken), or did enough (steps taken ≥ steps needed). Management was also assessed for visits in which random glucose level was stratified as 151 to 199, 200 to 249, 250 to 300, and higher than 300 mg/dL (8.38-11.04, 11.10-13.82, 13.88-16.65, and >16.65 mmol/L).
The analysis of the impact of the interventions on health care provider behavior and the impact on change in HbA1c levels was hierarchical, or multilevel, in that providers were the unit of randomization to interventions, but the data were patient-level. Thus, “patients nested within providers” was included as a random effect in all models. Analysis of the impact of the interventions on health care provider behavior used ordinal logistical regression in which provider behavior was categorized as an ordinal outcome: 0, did nothing; 1, did anything; 2, did enough. Analysis included the patient's age, body mass index (BMI) (calculated as weight in kilograms divided by the square of height in meters), sex, race, random glucose levels, and duration of diabetes as well as the resident's postgraduate year (PGY) (1, 2, or 3) and length of exposure to the intervention (follow-up time) as covariates in the models. Patients within residents within half-day clinic modules (2 geographically contiguous units with separate waiting areas, examination rooms, rooms, equipment, and staff) was also included as a random effect in the regression models to account for potential clustering effects due to exposure to different endocrinologists and medical clinic faculty members. Based on the logistical regression models, a predicted percentage of health care provider behaviors when random glucose level exceeded 150 mg/dL (8.33 mmol/L) was calculated at baseline and at the end of each of the next 6 successive 6-month intervals during the 3 years of the active intervention. A predicted percentage of health care provider behaviors for the various categories of elevated glucose level was also calculated at baseline and at the end of the first, second, and third (last) year of the active intervention. Adjusted percentages of health care provider actions were calculated for a “typical” patient, ie, the mean of the patient characteristics and resident's PGY level.
The impact of the interventions and health care provider intensification behavior on change in HbA1c levels over the study period was analyzed by linear mixed effects models for repeated measures data. This analysis also accounted for clustering, the multilevel nature of the data (patients nested within residents within half-day clinics with different but overlapping groups of attending physicians), and the behavior of the patients (who did not always have laboratory tests as scheduled, dropped out, and/or returned on days when their assigned intervention was not being conducted). Although 95% of the study patient visits were with residents and 70% of study visits were within the assigned intervention arm, only 42% of patients saw only their assigned resident at all of their visits. Accordingly, the analysis used all available patient data for which there were at least 2 visits, and the data were structured such that patient outcomes at a given time were associated with the previous visit (resident [intervention assignment] and the behavior of that resident) because health care provider actions at a given visit could only affect outcomes following the visit. The regression model included as covariates (1) patient characteristics of age, sex, race, BMI, duration of diabetes, number of medical clinic visits, and number of diabetes clinic visits and (2) resident characteristics of duration of exposure to the intervention and intensification of treatment. For this analysis, intensification was defined simply as either did enough or not.
Analysis of health care provider behavior used the ologit routine in Stata, version 7 (StataCorp, College Station, Tex). Analysis of HbA1c level used the lme routine in S-Plus, version 6 (Insightful Inc, Seattle, Wash). Both models included a random effects component to account for the nested (multilevel) design of the study, and in addition, both models accounted for the longitudinal aspect of the study—resident participation from 1 to 3 years.
As reported previously,30 the mean ± SD age of the 345 residents who participated in the study was 27 ± 3 years; 35% were women, 58% were non-Hispanic white, and 8% were African American; there was no difference in PGY distribution among the intervention arms (P>.90, data not shown). The mean age of entire group of 4038 patients who were seen during the study was 59 years; 67% were women, and 94% were African American. Mean duration of diabetes was 10 years; BMI, 33; baseline systolic blood pressure, 141 mm Hg; HbA1c level, 8.0%; and low-density lipoprotein cholesterol, 116 mg/dL (3.00 mmol/L). There were no significant differences among the patients assigned to residents in the different intervention arms (P>.25 for all).
The period of patient accrual prior to initiation of the intervention was July 2, 1999, through December 31, 2000. At baseline, when random capillary glucose level exceeded 150 mg/dL (8.33 mmol/L) in 663 patient visits, residents did nothing (no increase in dosage or addition of a new antidiabetic drugs to regimen) in 65% of the visits, did anything in 35% of visits, and did enough in 21% of visits. There were no significant differences in the tendency to intensify therapy according to race, sex, or PGY of the residents (P>.20 for all).
The initiation of the active interventions was followed by a significant increase in the tendency to intensify therapy during visits (Figure 1 and Figure 2). However, throughout the 3-year period of the study, health care provider behavior improved significantly more for both of the feedback intervention groups for each 6-month time period than for either the reminders-only or the control groups (P<.001 for all). The improvements in health care provider behavior were greatest during the first 6 to 12 months of the study, and then they decreased. During the last 6 months, intensification of therapy remained above baseline levels for both of the feedback groups (P<.02 for both groups) but was no longer above baseline for either the reminders-only or the control groups (P>.20 for both). Beginning approximately 1 year after the intervention was initiated, intensification of therapy was significantly higher in both feedback groups than in the reminders-only and control groups (P<.001).
To illustrate the impact of the interventions, Figure 3 and Figure 4 show the model-predicted behavior of the health care providers when patients exhibited progressive elevation in glucose levels. All results were adjusted for differences in age, race, sex, BMI, duration of diabetes, and duration of follow-up. Throughout the study, whether measured as did anything or did enough, health care providers tended to intensify more often when random capillary glucose level rose from the 151 to 200 mg/dL range to 201 to 250, 251 to 300, and 300 mg/dL or higher (from the 8.38-11.04 mmol/L range to 11.10-13.82, 13.88-16.59, and ≥16.65 mmol/L) (P<.001). At baseline, there were no significant differences in health care provider behavior among the intervention groups (P>.70). After 1 year of the intervention, intensification of therapy increased in all 4 groups. However, the increases were significantly greater in both the feedback-only and feedback + reminders groups than among controls (P<.001 for both), but not in the reminders-only group compared with controls (P = .06). By the end of the 3-year intervention, the behavior of the health care providers in the control and reminders-only groups had returned to baseline levels. While there was also a reduction in intensification of therapy for both the feedback-only and feedback + reminders groups, their behavior remained significantly above both baseline levels (P<.005 for both) and the control and reminders-only groups (P<.02 for all).
During the intervention period, residents with more experience tended to intensify therapy more (P = .005 for PGY). Residents also intensified therapy more with younger patients (P<.001) and patients with higher BMI (P = .01). However, after adjusting for other factors, the feedback intervention significantly and independently increased the likelihood of intensification of therapy (Table 1); in contrast, reminders had no significant independent impact and did not affect the impact of feedback (interaction term nonsignificant).
A multivariable linear mixed effects analysis was used to determine whether intensification by health care providers contributed independently to lower HbA1c levels. For this analysis, we examined health care provider behavior only as did enough, since such an assessment includes an inherent adjustment for glucose and HbA1c levels, and the analysis is not confounded because of the tendency of providers to intensify more often when patients have poor control. As summarized in Table 2, BMI, sex, race, and the number of medical clinic visits had no independent impact on HbA1c level. Levels of HbA1c tended to be higher in patients who had longer duration of disease and higher baseline HbA1c levels and lower in patients who had more visits to the diabetes clinic. (In this “real-world” study, it would have been inappropriate to prevent visits to the diabetes clinic.) After adjustment for covariates, intensification by health care providers was independently associated with a reduction in HbA1c levels. However, the effect of assignment to a feedback intervention also remained significant (P = .003), indicating that the benefit of the feedback intervention cannot be attributed solely to improvement of health care provider behavior as measured by the tendency to do enough when glucose levels are elevated.
In the present study, a feedback on performance intervention given by endocrinologists to physicians in training improved health care provider behavior and levels of HbA1c in patients with type 2 diabetes mellitus. When patients' glucose levels were elevated, intensification of therapy improved in all groups during the first year of the study, presumably due in part to contamination, the Hawthorne effect—altered behavior from recognition of being monitored36—and recommendations for aggressive management, which may have been perceived as “new.” Over the next 2 years, management in the control and reminders-only groups returned to baseline levels. Health care provider behavior improved significantly more in the feedback on performance groups than in the other intervention arms during the first year, and improvements persisted above baseline levels for the duration of the study. Interestingly, the change in behavior in the feedback groups was apparent at both higher (>200 mg/dL [>13.88 mmol/L]) and lower (151-199 mg/dL [8.38-11.04 mmol/L]) glucose levels—a change in both responsiveness and sensitivity.37 The impact of the feedback on performance intervention on health care provider behavior withstood adjustment for demographic and other patient-related factors, and this intervention contributed independently to improvement in HbA1c levels.
Assessment of doing enough includes an intrinsic adjustment for glucose levels (intensification at least as great as that recommended by a “glucose algorithm,” [see the “Methods” section]), and our evaluation of intensification by this criterion, summarized in Table 2, showed that both intensification per se and the feedback on performance intervention had independent effects to lower HbA1c level. However, comparison of Figure 4 with Figure 3 shows that health care providers often intensified therapy less than recommended (did anything in 25%-65% of visits vs did enough in 10%-35% of visits). Apparent suboptimal performance might be due in part to a variety of clinical contraindications, but the frequency of both did anything and did enough findings in our study remained less than those in our diabetes clinic (data not shown). To the extent that feedback on performance might improve HbA1c levels independent of changes in intensification, the mechanism could involve a change in health care provider attitudes (since we have shown that perceived barriers to management were reduced significantly by this feedback intervention, but not in the control or reminders-only groups).38
In the present study, feedback on performance altered health care provider behavior (intensifed diabetes therapy), and it is reasonable to conclude that the altered behavior improved clinical outcomes (HbA1c levels). It is well recognized that health care providers often do not adhere to medical guidelines15-19,39-42—although diabetes specialists may do somewhat better than generalists17,19—but changing provider behavior is difficult, and providers are poorly responsive to traditional continuing medical education lectures.43 The interventions tested in the present study—reminders and feedback on performance—were selected because such approaches have improved health care provider adherence to guidelines in other settings.22-29 However, most previous studies have focused mainly on process measures (eg, ordering laboratory tests, immunizations, or recommended antibiotics44) rather than complex clinical decision making. It is possible that process measures might be easier to influence than diabetes management, which might explain the limited impact of reminders in our study; in fully-adjusted models (Table 1 and Table 2, Figure 3 and Figure 4), the reminders had mildly positive effects on both behavior and change in HbA1c level, although the trends were not significant. Alternatively, the reminders might have been more effective if the health care providers had been “forced” to respond to them45; in our paradigm, providers were free to ignore the reminders, but they could not ignore the feedback on their performance.
Our study has several limitations. Contamination was unavoidable both from resident-resident discussions and presentation of the “message” in lectures, but such contamination should only have decreased the between-group differences, which remained significant. It is possible that the residents would have intensified therapy more often if the criterion for action had been elevated HbA1c rather than glucose level. However, provision of rapid turnaround results for HbA1c levels had only modest impact on behavior and HbA1c levels in another Grady Health Systems primary care setting,46 and most of the patients in the present study had HbA1c levels that were often over 7%. We also do not know whether feedback would be as effective if provided by individuals who are not endocrinologists. In this study, feedback also improved health care provider attitudes,38 which might not be comparably affected by other feedback strategies. Finally, we do not know whether the impact of feedback is fully generalizable and would have been similar with recipients who had completed training in other settings. Further studies will be required to resolve these issues, but our results should at least be generalizable to the large number of municipal teaching hospitals serving the minority populations, which are at high risk of receiving less health care and having worse health outcomes than nonminority populations.
Our study demonstrates (1) that individualized feedback on performance given face-to-face by endocrinologists to internal medicine physicians in training improves health care provider behavior as measured by the tendency to intensify therapy for patients with type 2 diabetes mellitus who have high glucose levels and (2) that such improvements in provider behavior are associated independently with a reduction in levels of HbA1c. To the extent that limitations in health care provider behavior—clinical inertia—constitute a major barrier to diabetes management, our model may have broad application to improve patient outcomes and to decrease the clinical and economic impact of diabetes in the primary care setting.
Correspondence: Lawrence S. Phillips, MD, General Clinical Research Center, Emory University Hospital, Room GG-23, 1364 Clifton Rd, Atlanta, GA 30322 (email@example.com).
Accepted for Publication: September 29, 2005.
Financial Disclosure: None.
Funding/Support: This work was supported in part by National Institutes of Health awards HS-07922 and DK-066204 (Dr Phillips), RR-00039 (Drs Phillips and Kolm), and DK-07298, DK-062668 and RR-017643 (Dr Rhee).
Previous Presentation: This work was presented in part at the Annual Meeting of the American Diabetes Association; June, 2004; Orlando, Fla.
Create a personal account or sign in to: