[Skip to Navigation]
Sign In
Figure. 
Laboratory monitoring at initiation of drug therapy. An asterisk indicates P<.001; dagger, P  =  .02; double dagger, P  =  .01.

Laboratory monitoring at initiation of drug therapy. An asterisk indicates P<.001; dagger, =  .02; double dagger, =  .01.

Table 1. 
Laboratory Monitoring at Initiation of Therapy
Laboratory Monitoring at Initiation of Therapy
Table 2. 
Examples of Action Taken if Laboratory Test Result Was Abnormal
Examples of Action Taken if Laboratory Test Result Was Abnormal
Table 3. 
Characteristics of Patients in Intervention and Usual-Care Groups*
Characteristics of Patients in Intervention and Usual-Care Groups*
Table 4. 
Laboratory Monitoring of Patients by Specific Drug*
Laboratory Monitoring of Patients by Specific Drug*
1.
Kennedy  AGMacLean  CD Clinical inertia: errors of omission in drug therapy.  Am J Health Syst Pharm 2004;61401- 404PubMedGoogle Scholar
2.
Leape  LLLawthers  AGBrennan  TAJohnson  WG Preventing medical injury.  QRB Qual Rev Bull 1993;19144- 149PubMedGoogle Scholar
3.
Beach  JEFaich  GBormel  GSasinowski  FJ Black box warnings in prescription drug labeling: results of a survey of 206 drugs.  Food Drug Law J 1998;53403- 411PubMedGoogle Scholar
4.
Schoenenberger  RATanasijevic  MJJha  ABates  DW Appropriateness of antiepileptic drug level monitoring.  JAMA 1995;2741622- 1626PubMedGoogle ScholarCrossref
5.
Hande  KRNoone  RMStone  WJ Severe allopurinol toxicity: description and guidelines for prevention in patients with renal insufficiency.  Am J Med 1984;7647- 56PubMedGoogle ScholarCrossref
6.
Graham  DJDrinkard  DRShatin  DTsong  YBurgess  MJ Liver enzyme monitoring in patients receiving troglitazone.  JAMA 2001;286831- 833Google ScholarCrossref
7.
Raebel  MALyons  EEAndrade  SE  et al.  Laboratory monitoring of high risk drugs at initiation of therapy in ambulatory care.  J Gen Intern Med In pressGoogle Scholar
8.
Calabrese  ATColey  KCDaPos  SVSwanson  DRao  H Evaluation of prescribing practices: risk of lactic acidosis with metformin therapy.  Arch Intern Med 2002;162434- 437PubMedGoogle ScholarCrossref
9.
Roblin  DWNielsen  DM Assessment of quality in adult primary care: developing process measures from administrative data.  Clin Perform Qual Health Care 1994;2200- 208Google Scholar
10.
Emslie-Smith  AMBoyle  DIEvans  JMSullivan  FMorris  AD Contraindications to metformin therapy in patients with type 2 diabetes: a population-based study of adherence to prescribing guidelines.  Diabet Med 2001;18483- 488PubMedGoogle ScholarCrossref
11.
Abookire  SAKarson  ASFiskio  JBates  DW Use and monitoring of “statin” lipid-lowering drugs compared with guidelines.  Arch Intern Med 2001;16153- 58PubMedGoogle ScholarCrossref
12.
Tegeder  ILevy  MMuth-Selbach  U  et al.  Retrospective analysis of the frequency and recognition of adverse drug reactions by means of automatically recorded laboratory signals.  Br J Clin Pharmacol 1999;47557- 564PubMedGoogle ScholarCrossref
13.
Selby  JVEttinger  BSwain  BE First 20 months’ experience with use of metformin for type 2 diabetes in a large HMO.  Diabetes Care 1999;2238- 44PubMedGoogle ScholarCrossref
14.
Stelfox  HTAhmed  SBFiskio  JBates  DW Monitoring amiodarone's toxicities: recommendations, evidence, and clinical practice.  Clin Pharmacol Ther 2004;75110- 122PubMedGoogle ScholarCrossref
15.
Murff  HJBates  DW Notifying patients of abnormal results. Shojania  KGDuncan  BWMcDonald  KMWachter  RBMarkowitz  AJ Making Health Care Safer A Critical Analysis of Patient Safety Practices Rockville, Md Agency for Healthcare Research and Quality2001;Google Scholar
16.
Poon  EGGandhi  TKSequist  TDMurff  HJKarson  ASBates  DW “I wish I had seen this test result earlier!”  Arch Intern Med 2004;1642223- 2228PubMedGoogle ScholarCrossref
17.
 Physician’s Desk Reference 54th ed.  Montvale, NJ Medical Economics Co Inc2000;
18.
 US Food and Drug Administration [Medwatch Web site]. Available at: http://www.fda.gov/medwatch/safety/2000/safety00.htm. Accessed June 10, 2002
19.
Baker  DWChin  MHCinquegrani  MP  et al.  ACC/AHA guidelines for the evaluation and management of chronic heart failure in the adult: executive summary.  J Am Coll Cardiol 2001;382101- 2113PubMedGoogle ScholarCrossref
20.
Generali  JA Black box drug warnings: analgesics, anticonvulsants and anti-infectives.  Hosp Pharm 2002;371006- 1023Google Scholar
21.
Generali  JA Black box drug warnings: antineoplastics, vitamins and miscellaneous agents.  Hosp Pharm 2002;371228- 1246Google Scholar
22.
McEvoy  GKed AHFS Drug Information 1999.  Bethesda, Md American Society of Health-System Pharmacists1999;
23.
 Micromedex Healthcare Series. [Micromedex Web site]. Greenwood Village, Colo: Thomson Micromedex. Subscription series; edition expired 06/2002. Available at www.thomsonhc.com. Accessed June 10, 2002
24.
Wilson  JSPodrid  PJ Side effects from amiodarone.  Am Heart J 1991;121158- 171PubMedGoogle ScholarCrossref
25.
Goldschlager  NEpstein  AENaccarelli  GOlshansky  BSingh  B Practical guidelines for clinicians who treat patients with amiodarone.  Arch Intern Med 2000;1601741- 1748PubMedGoogle ScholarCrossref
26.
Hilleman  DMiller  MAParker  RDoering  PPieper  JA Optimal management of amiodarone therapy: efficacy and side effects.  Pharmacotherapy 1998;18138S- 145SPubMedGoogle Scholar
27.
US Food and Drug and Administration, Withdrawal of troglitazone and cisapride.  JAMA 2000;2832228PubMedGoogle ScholarCrossref
28.
 Actos tablets (Pioglitazone) [package insert].  Lincolnshire, Ill Takeda Pharmaceuticals America Inc2004;
29.
Majumdar  SRSoumerai  SB Why most interventions to improve physician prescribing do not seem to work.  CMAJ 2003;16930- 31PubMedGoogle Scholar
30.
Soumerai  SBMajumdar  SRLipton  HL Evaluating and improving physician prescribing. Strom  B Pharmacoepidemiology 3rd ed. Toronto, Ontario John Wiley & Sons2000;483- 503Google Scholar
31.
Grimshaw  JMShirran  LThomas  R  et al.  Changing provider behavior: an overview of systematic reviews of interventions.  Med Care 2001;39 ((8, suppl 2)) II2- 45Google ScholarCrossref
32.
Koppel  RMetlay  JPCohen  A  et al.  Role of computerized physician order entry systems in facilitating medication errors.  JAMA 2005;2931197- 1203PubMedGoogle ScholarCrossref
33.
Nebeker  JRHoffman  JMWeir  CR  et al.  High rates of adverse drug events in a highly computerized hospital.  Arch Intern Med 2005;1651111- 1116PubMedGoogle ScholarCrossref
34.
Leape  LLBerwick  DM Five years after To Err Is Human: what have we learned?  JAMA 2005;2932384- 2390PubMedGoogle ScholarCrossref
Original Investigation
November 14, 2005

Improving Laboratory Monitoring at Initiation of Drug Therapy in Ambulatory Care: A Randomized Trial

Author Affiliations

Author Affiliations: Clinical Research Unit (Drs Raebel, Long, and Magid, Ms Lyons, and Mr Bodily) and Pharmacy Department (Drs Chester and Kelleher and Mr Miller), Kaiser Permanente of Colorado, Denver; and Schools of Pharmacy (Drs Raebel, Chester, and Kelleher) and Medicine (Dr Magid), University of Colorado and Health Sciences Center, Denver. Dr Long is now with Medical Affairs, Allergan Inc, Lakeville, Mass.

Arch Intern Med. 2005;165(20):2395-2401. doi:10.1001/archinte.165.20.2395
Abstract

Background  The importance of laboratory monitoring for drugs is reflected in product labeling and published guidelines, but monitoring recommendations are followed inconsistently. Opportunity exists to improve monitoring, with the potential to decrease therapy complications.

Methods  The objective of this randomized trial was to determine whether computerized alerts were effective at increasing the percentage of ambulatory patients with laboratory monitoring at initiation of drug therapy. Physicians and pharmacists teamed up to develop organization-specific guidelines for monitoring selected drugs. In collaboration with physicians, pharmacists were alerted to missing laboratory test results, ordered missing tests, reminded patients to obtain tests, assessed test completion, reviewed test results, and managed abnormal results. Eligible individuals included patients with therapy initiated for any of 15 drugs among 400 000 health plan members.

Results  In the intervention group, 79.1% (n = 4076; 95% confidence interval [CI], 78.0%-80.2%) of dispensings were monitored compared with 70.2% (n = 3522; 95% CI, 68.9%-71.5%) in the usual-care group (P<.001). For example, 78.6% of amiodarone (95% CI, 73.1%-83.5%) dispensing was monitored in the intervention group vs 51.4% (95% CI, 44.4%-58.4%) in the group receiving usual care (P<.001).

Conclusions  This study demonstrates the effectiveness of a computerized tool plus collaboration among health care professionals at increasing the percentage of patients receiving laboratory monitoring at initiation of therapy. Coupling data available from information systems with the knowledge and skills of physicians and pharmacists can result in improved patient monitoring.

Drug-specific laboratory monitoring is important for certain drugs that carry a risk of organ system toxic effects or electrolyte imbalance, or that require dosage adjustment in the presence of organ dysfunction.1,2 Laboratory monitoring errors occur when there is failure to conduct indicated tests and when there is inadequate follow-up or an avoidable delay in responding to abnormal test results.1,2 The importance of laboratory monitoring for drugs such as divalproex sodium, isotretinoin, lithium, metformin hydrochloride, amiodarone, carbamazepine, and allopurinol is reflected in product labeling and in published guidelines.3-5 Studies document that laboratory monitoring recommendations for drugs are variably followed,4,6-14 that delays in reviewing laboratory test results are common,15 and that physicians are not satisfied with how they manage laboratory test results.16

Opportunity exists to improve laboratory monitoring of patients receiving high-risk drug therapy, with the potential to decrease complications and costs of therapy.4,6-15 We undertook a randomized trial to determine whether a computerized tool that alerts pharmacists to missing laboratory results was effective in increasing the percentage of patients receiving appropriate laboratory monitoring at the initiation of drug therapy, that is, baseline monitoring. The primary outcome was the percentage of drug dispensings with baseline laboratory monitoring. We hypothesized that patients in the intervention group would have an increased percentage of drug dispensings that were monitored compared with the control group receiving usual care (usual-care group).

Methods
Study setting, design, and population

This study was conducted at Kaiser Permanente of Colorado (KPCO), a group model health maintenance organization. In 2003, KPCO provided health care for a diverse population of approximately 375 000 members in the Denver-Boulder-Longmont metropolitan area; about 56 000 of these individuals were Medicare beneficiaries. The Kaiser Permanente institutional review board approved this study and waived the requirement for informed consent.

This prospective randomized trial was conducted in the ambulatory care environment and included all KPCO members 18 years or older. At study initiation, 340 000 individuals were randomized (using the uniform distribution function in the statistical software program SAS [version 8.4; SAS Inc, Cary, NC] to either the intervention or usual-care group). Each month, new health maintenance organization members were randomized. By study completion, 400 000 individuals had been randomized.

For the primary outcome of the percentage of drug dispensings with baseline laboratory monitoring, the time frame for baseline laboratory monitoring was defined as from 180 days (6 months) prior to drug dispensing until 14 days after drug dispensing. This starting time was chosen because, for ambulatory patients, clinicians can consider results of “recently conducted” laboratory tests to be sufficient for baseline monitoring. We defined “recently conducted” as within 180 days. Although baseline laboratory monitoring should be conducted prior to drug dispensing, we considered baseline laboratory monitoring up to 14 days after dispensing because the intervention could not occur until the drug dispensing and missing laboratory monitoring test(s) information had been linked and sent to the pharmacist (and this could only occur after the drug was dispensed). Furthermore, because patients can be provided both the drug prescription and the request for laboratory testing at 1 office visit, the 14-day window accommodated patients who had a 1- or 2-day gap between the drug prescription and the laboratory test. Completion of baseline laboratory monitoring was defined as the presence of a claim for the laboratory test(s). Drug dispensing was defined as the date the prescription was sold to the patient.

When a patient randomized to the intervention group was dispensed a targeted medication, the laboratory test(s) was electronically assessed as completed or not completed. Information about laboratory tests identified as not completed was sent electronically each day to the Clinical Pharmacy Call Center, a centralized team of KPCO clinical pharmacists who work with patients via telephone on medication-related issues. On receipt of the daily report, the call center pharmacists contacted the patients and reminded them to obtain the laboratory tests if their physicians had previously ordered the tests or ordered tests according to the intervention guideline if they had not been previously ordered. Results for laboratory tests ordered by pharmacists were returned to pharmacists for evaluation. These processes were designed to lessen the burden of the intervention on physicians.

Physicians, patients, and pharmacists were blinded as to study group assignment. Pharmacists were alerted to missing laboratory test information only for intervention patients. Pharmacists were not provided information about laboratory monitoring for patients in the usual-care group. Physicians were contacted for intervention patients only.

Patients in the usual-care group received laboratory testing according to each provider’s (clinician’s) usual clinical practice (eg, when patients’ providers ordered tests and patients obtained the tests). When laboratory tests were completed, the results were reported and patients treated according to the prescriber’s usual procedures.

Developing and implementing the intervention

Fifteen drugs and drug classes were included in the intervention (Table 1). Using a sequential process, drugs and laboratory tests were selected based on the presence of US Food and Drug Administration black box warnings, published clinical guidelines, and the potential for adverse clinical consequences related to lack of monitoring. Black box warnings are typically used for drugs that carry the potential for life-threatening adverse events.17 In the sequential process, first the Physicians Desk Reference19 was reviewed to identify drugs prescribed in ambulatory care that had black box warnings for baseline laboratory monitoring. The information gleaned from this review was supplemented with information from the Food and Drug Administration Web site.18 Next, nationally available published guidelines and internal clinical guidelines were searched for other medication-related laboratory monitoring recommendations (eg, American College of Cardiology/American Heart Association Guidelines; Kaiser Permanente National Evidence-Based Guidelines).19-23 A draft list of recommended drug-laboratory monitoring pairs was compiled from these sources and circulated to practicing physicians, clinical pharmacists, and clinician-leaders in the health plan. Their feedback was incorporated into the final list of drugs requiring laboratory monitoring. The drugs and laboratory tests ultimately included in the study therefore reflected not only drugs with laboratory testing recommended in product labeling but also clinician-physician, pharmacist, and researcher consensus. For statins and gemfibrozil, the intervention occurred only for patients who were receiving the drugs concomitantly.

An organization-specific guideline for managing abnormal laboratory results was developed (a portion of this guideline is presented in Table 2). Prior to implementation, this guideline was reviewed and agreed on by primary care administration, key clinician-physicians, physician leaders, the pharmacy department, and researchers. Abnormal laboratory result notifications from pharmacists to prescribing clinicians were communicated in writing or, if urgent action was needed, by telephone (Table 2).

Statistical analysis

The unit of analysis for the primary outcome, that is, the percentage of drug dispensings with baseline laboratory monitoring, was each unique drug dispensing–laboratory test event that occurred between September 9, 2002, and December 31, 2003. Demographic characteristics between groups were compared using descriptive statistics, χ2 and Wilcoxon signed-rank tests. For each drug or drug class, the percentage of patients who received the recommended laboratory test was compared between groups using the χ2 test. In addition, for the subset of intervention patients between September 16, 2002, and September 12, 2003, the percentage of patients who had the test ordered by the physician but not completed by the patient, the percentage of patients who completed the laboratory test after pharmacist intervention, and the percentage of pharmacist recommendations accepted by the provider when an abnormal laboratory result occurred were tabulated. All analyses were conducted using SAS software.

Results

During the study, there were 10 169 initial dispensings of study drugs. Characteristics of patients receiving these dispensings are shown in Table 3. No differences existed between the intervention and usual-care groups in the age (P = .06) or sex (P = .92) distributions of patients (Table 3). The median age of patients with laboratory monitoring was 55 years, whereas the median age for patients who were not monitored was 49 years (P<.001).

Recommended laboratory monitoring was completed in 74.7% (n = 7598) of dispensings at initiation of therapy. In the intervention group, 79.1% (n = 4076; 95% confidence interval [CI], 78.0%-80.2%) of patient drug dispensings received laboratory monitoring, whereas in the usual-care group, 70.2% (n = 3522; 95% CI, 68.9%-71.5%) of patient drug dispensings were monitored (P<.001). The difference between groups persisted for each age subgroup (P<.001).

The greatest absolute difference in monitoring between groups was with amiodarone; 78.6% (95% CI, 73.1%-83.5%) of intervention group patients received laboratory monitoring compared with 51.4% (95% CI, 44.4%-58.4%) of usual-care group patients (P<.001) (Table 4; Figure). Other drugs for which the absolute percentage of intervention group patients monitored was more than 10% greater than the percentage of usual-care group patients monitored include allopurinol, carbamazepine, and lithium (Table 4; Figure). Additional drugs with a statistically significantly higher percentage of patients monitored in the intervention group compared with the usual-care group include metformin, divalproex, and the combination of a statin with gemfibrozil (Table 4; Figure). No statistical difference was observed in monitoring between groups for azathioprine, isotretinoin, methotrexate, nefazodone hydrochloride, pioglitazone hydrochloride, and ticlopidine, although an increase in monitoring occurred in the intervention group vs the usual-care group for all drugs except isotretinoin (Table 4; Figure).

More than 1000 patients (n = 1010) in the intervention group had baseline laboratory tests ordered by the pharmacists for intervention drugs between September 16, 2002, and September 12, 2003. For 194 patients, the provider had ordered recommended laboratory tests, and the patient was reminded to have the laboratory test conducted. For 28 patients, the provider had ordered some, but not all, recommended tests. No tests had been ordered for 788 patients. Noncompliance with obtaining the laboratory tests was higher (91 of 194; 47%) for patients for whom the provider had previously ordered the tests than for the group overall (331 of 1010; 32.8%).

Approximately 7% (n = 68) of laboratory tests obtained as a result of the intervention yielded abnormal results. Patients started on a regimen of allopurinol had the highest percentage of abnormal test results; serum creatinine levels were elevated in 18 (15.7%) of 115 patients. Eleven (12.8%) of 86 patients started on a regimen of amiodarone also had abnormal results for liver or thyroid tests; another 3% to 7% of patients who had abnormal baseline laboratory test results were taking other drugs, including lithium, carbamazepine, divalproex sodium, metformin, methotrexate, nefazodone, and the combination of a statin with gemfibrozil.

For those patients with abnormal laboratory test results, the prescriber took 91% of the guideline-based recommendation provided by the pharmacist. Recommendations included, among others, repeating the laboratory test within a few weeks (40% of recommendations), notifying the prescriber with no recommended change in therapy or monitoring (33%), changing the drug dosage (11%), and stopping the drug (5%).

The most common intervention was obtaining a serum creatinine level for patients initiating metformin therapy (24.8% of interventions). Obtaining liver enzyme tests or complete blood cell counts for patients started on carbamazepine (16.2%) or valproate (15%) therapy; obtaining serum creatinine levels for patients started on allopurinol therapy (11.4%); obtaining thyroid and/or liver tests for patients started on amiodarone therapy (8.5%); and obtaining serum creatinine, liver, and/or thyroid tests for patients started on lithium therapy (11.1%) were also frequent.

Comment

Our study demonstrates that a multistage intervention based on physician-pharmacist collaboration and comprising linked laboratory and drug-dispensing information to identify gaps in laboratory monitoring, providing that information to pharmacists, and having them intervene on missing laboratory test results was effective in increasing the percentage of patients receiving recommended laboratory monitoring at initiation of drug therapy. This intervention design minimized the burden on physicians in the busy outpatient office setting. Nearly 700 (n = 679) patients received recommended monitoring as a result of the intervention—monitoring that likely would not have occurred otherwise. A low but potentially clinically important percentage of patients had abnormal laboratory test results (6.7%).

Previous publications4,6-14 have documented that laboratory monitoring of drugs with potential toxicity related to lack of monitoring is not consistently conducted. This can be true even when multiple educational interventions and/or prescriber notifications are available.6 Little is known about why monitoring is not conducted (eg, the contribution of lack of knowledge, patient nonadherence, and communication gaps). Compounding these issues, specific recommendations for type of laboratory test (eg, the recommendation is to “monitor liver enzymes” rather than to “monitor alanine aminotransferase/aspartate aminotransferase”) and monitoring frequency often do not exist, even when the approved drug labeling indicates that organ system toxic effects can be lessened or avoided with appropriate monitoring and clinical action.14

We developed drug-laboratory monitoring recommendations that were agreed on by researchers, physicians, and pharmacists and applied to patients. The result was improved consistency in patient drug specific–laboratory monitoring. Our intervention was effective at enhancing prescriber and patient adherence to recommended monitoring and in treating patients with abnormal laboratory test results. Obtaining the laboratory test results also served the purpose of establishing patients’ baseline values, thus aiding in interpreting results of future laboratory tests. The overall benefit of this intervention was to enhance patient safety.

One example of improved patient safety is our intervention with amiodarone, an effective cardiac drug that has serious potential for toxic effects in a variety of organs including the liver, lung, heart, and thyroid. Better monitoring of amiodarone increases the drug’s safety.14,24-26 Stelfox and colleagues14 evaluated the evidence supporting amiodarone monitoring. Although they found numerous monitoring recommendations, they also found that most patients received only minimum testing and that monitoring practices varied. Our intervention was effective in improving the relative rate of amiodarone monitoring by 56%. In contrast, our intervention did not increase alanine aminotransferase/aspartate aminotransferase monitoring for pioglitazone, a thiazolidinedione related to troglitazone (an agent removed from the US market after reported cases of acute liver failure).27,28 At our health plan, pioglitazone use requires prior authorization, with one criterion being to obtain a baseline alanine aminotransferase level, which is likely the explanation for the lack of difference in monitoring between groups.

A challenge of research that documents suboptimal medication use, including laboratory monitoring, is in developing systems that are safe and effective at translating research results into improved practice.29-34 Major focus areas in developing and implementing our drug-laboratory monitoring system were getting institutional support, agreement and stakeholder commitment during project development, solving operational problems between physicians and pharmacists in a cooperative manner, and seeking feedback throughout the project. We believe that the strengths of this approach are demonstrated by impressions of physicians and pharmacists. Physicians commented that they appreciated the collaboration and assistance in monitoring amiodarone, for example. Pharmacists enjoyed both the patient contact and the opportunity to use their knowledge of laboratory tests. Ongoing communication between providers, pharmacists, and the study team was, we believe, partly responsible for the success of this intervention.

This study indicates the usefulness of merging pharmacy and laboratory data in providing information that can improve the quality and safety of care given to ambulatory patients. A barrier to pharmacists’ involvement in patient safety initiatives is that clinical patient data are not readily available to pharmacists in many care settings. However, the system we developed and implemented overcomes that barrier because it can be developed and implemented in essentially any health care setting where pharmacy dispensing information and laboratory claims data are available and can be linked.

Another strength of our study is that we randomized the entire health plan membership to the intervention group or usual-care group. We included every patient who was initiated on a regimen of 1 of 15 drugs of interest. We addressed patient compliance by reminding patients to obtain laboratory tests and physician adherence by ordering the test according to the intervention guideline. Furthermore, analysis of the administrative data set was enhanced by the additional information we obtained for the intervention group regarding patients who had laboratory tests ordered but not completed and regarding patients with abnormal test results. An additional strength is that no separate “translation step” is necessary to implement this program. The study design ensured that this program was translated into practice from the first day of the intervention. The only translation at study completion was to remove the randomization criterion, therefore providing the intervention to the entire membership. We believe the communication and collaboration efforts throughout the study maximized the likelihood that this intervention could continue for these or other drug-specific laboratory monitoring combinations.

A limitation to our work is the use of health plan prescription and laboratory results reporting data to assess laboratory monitoring and drug dispensing. We could not identify drug dispensing or laboratory testing that occurred outside of our health care system. Although this probably occurred rarely because 98% of KPCO members have a drug benefit, it likely accounted for at least some of the lack of difference we observed between groups for patients who were prescribed isotretinoin. Because isotretinoin prescriptions are not included in the drug benefit, individuals who were prescribed isotretinoin likely obtained some of these prescriptions at pharmacies outside the health plan.

This study was not designed to evaluate the clinical or economic outcomes associated with laboratory monitoring or lack of monitoring. Research is needed to evaluate both the effectiveness and the cost of this type of intervention in reducing adverse outcomes related to drug toxicity.

This study demonstrates that coupling data available from information systems with physician and pharmacist knowledge and skills can result in improved patient medication monitoring. The system developed for this study was already translated into practice and could be fully implemented immediately on demonstration of improved monitoring. In addition, this system can be implemented in any health care environment where laboratory and pharmacy data can be linked.

Back to top
Article Information

Correspondence: Marsha A. Raebel, PharmD, Kaiser Permanente of Colorado, Clinical Research Unit, PO Box 378066, Denver, CO 80237-8066 (Marsha.A.Raebel@kp.org).

Accepted for Publication: August 10, 2005.

Author Contributions: The authors had access to study data, take responsibility for the accuracy of the analysis, and had authority over manuscript preparation and the decision to submit the manuscript for publication. Dr Raebel had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Financial Disclosure: None.

Funding/Support: This work was supported by the Agency for Healthcare Research and Quality, Rockville, Md (grant 1UC1HS014249), the Garfield Memorial Fund, Oakland, Calif (grant 101-9501), and Kaiser Permanente of Colorado, Denver.

Role of the Sponsor: The funding sources had no involvement in study design, collection, analysis, or interpretation of the data, and they did not review or approve this article.

Previous Presentation: Portions of this work were presented at the HMO Research Network 2004 Annual Meeting; May 5, 2004; Dearborn, Mich.

Acknowledgment: We acknowledge the clinical pharmacists at the Clinical Pharmacy Call Center who initially implemented this intervention: Troy Stubbings, RPh, Josie McGrory, RPh, and Jim Balmer, RPh. We thank the associate medical director for quality, Michael Chase, MD, for his tireless support of our work and Capp F. Luckett for his programming expertise. We thank the pharmacy department personnel and leadership who supported and/or contributed programming, operational, or clinical skills to this initiative: Bob Rocho, RPh, Silvia Maranian, RPh, and the late Kent M. Nelson, PharmD. Finally, we thank Paul Barrett, MD, MSPH, for his editorial review of the draft manuscript.

References
1.
Kennedy  AGMacLean  CD Clinical inertia: errors of omission in drug therapy.  Am J Health Syst Pharm 2004;61401- 404PubMedGoogle Scholar
2.
Leape  LLLawthers  AGBrennan  TAJohnson  WG Preventing medical injury.  QRB Qual Rev Bull 1993;19144- 149PubMedGoogle Scholar
3.
Beach  JEFaich  GBormel  GSasinowski  FJ Black box warnings in prescription drug labeling: results of a survey of 206 drugs.  Food Drug Law J 1998;53403- 411PubMedGoogle Scholar
4.
Schoenenberger  RATanasijevic  MJJha  ABates  DW Appropriateness of antiepileptic drug level monitoring.  JAMA 1995;2741622- 1626PubMedGoogle ScholarCrossref
5.
Hande  KRNoone  RMStone  WJ Severe allopurinol toxicity: description and guidelines for prevention in patients with renal insufficiency.  Am J Med 1984;7647- 56PubMedGoogle ScholarCrossref
6.
Graham  DJDrinkard  DRShatin  DTsong  YBurgess  MJ Liver enzyme monitoring in patients receiving troglitazone.  JAMA 2001;286831- 833Google ScholarCrossref
7.
Raebel  MALyons  EEAndrade  SE  et al.  Laboratory monitoring of high risk drugs at initiation of therapy in ambulatory care.  J Gen Intern Med In pressGoogle Scholar
8.
Calabrese  ATColey  KCDaPos  SVSwanson  DRao  H Evaluation of prescribing practices: risk of lactic acidosis with metformin therapy.  Arch Intern Med 2002;162434- 437PubMedGoogle ScholarCrossref
9.
Roblin  DWNielsen  DM Assessment of quality in adult primary care: developing process measures from administrative data.  Clin Perform Qual Health Care 1994;2200- 208Google Scholar
10.
Emslie-Smith  AMBoyle  DIEvans  JMSullivan  FMorris  AD Contraindications to metformin therapy in patients with type 2 diabetes: a population-based study of adherence to prescribing guidelines.  Diabet Med 2001;18483- 488PubMedGoogle ScholarCrossref
11.
Abookire  SAKarson  ASFiskio  JBates  DW Use and monitoring of “statin” lipid-lowering drugs compared with guidelines.  Arch Intern Med 2001;16153- 58PubMedGoogle ScholarCrossref
12.
Tegeder  ILevy  MMuth-Selbach  U  et al.  Retrospective analysis of the frequency and recognition of adverse drug reactions by means of automatically recorded laboratory signals.  Br J Clin Pharmacol 1999;47557- 564PubMedGoogle ScholarCrossref
13.
Selby  JVEttinger  BSwain  BE First 20 months’ experience with use of metformin for type 2 diabetes in a large HMO.  Diabetes Care 1999;2238- 44PubMedGoogle ScholarCrossref
14.
Stelfox  HTAhmed  SBFiskio  JBates  DW Monitoring amiodarone's toxicities: recommendations, evidence, and clinical practice.  Clin Pharmacol Ther 2004;75110- 122PubMedGoogle ScholarCrossref
15.
Murff  HJBates  DW Notifying patients of abnormal results. Shojania  KGDuncan  BWMcDonald  KMWachter  RBMarkowitz  AJ Making Health Care Safer A Critical Analysis of Patient Safety Practices Rockville, Md Agency for Healthcare Research and Quality2001;Google Scholar
16.
Poon  EGGandhi  TKSequist  TDMurff  HJKarson  ASBates  DW “I wish I had seen this test result earlier!”  Arch Intern Med 2004;1642223- 2228PubMedGoogle ScholarCrossref
17.
 Physician’s Desk Reference 54th ed.  Montvale, NJ Medical Economics Co Inc2000;
18.
 US Food and Drug Administration [Medwatch Web site]. Available at: http://www.fda.gov/medwatch/safety/2000/safety00.htm. Accessed June 10, 2002
19.
Baker  DWChin  MHCinquegrani  MP  et al.  ACC/AHA guidelines for the evaluation and management of chronic heart failure in the adult: executive summary.  J Am Coll Cardiol 2001;382101- 2113PubMedGoogle ScholarCrossref
20.
Generali  JA Black box drug warnings: analgesics, anticonvulsants and anti-infectives.  Hosp Pharm 2002;371006- 1023Google Scholar
21.
Generali  JA Black box drug warnings: antineoplastics, vitamins and miscellaneous agents.  Hosp Pharm 2002;371228- 1246Google Scholar
22.
McEvoy  GKed AHFS Drug Information 1999.  Bethesda, Md American Society of Health-System Pharmacists1999;
23.
 Micromedex Healthcare Series. [Micromedex Web site]. Greenwood Village, Colo: Thomson Micromedex. Subscription series; edition expired 06/2002. Available at www.thomsonhc.com. Accessed June 10, 2002
24.
Wilson  JSPodrid  PJ Side effects from amiodarone.  Am Heart J 1991;121158- 171PubMedGoogle ScholarCrossref
25.
Goldschlager  NEpstein  AENaccarelli  GOlshansky  BSingh  B Practical guidelines for clinicians who treat patients with amiodarone.  Arch Intern Med 2000;1601741- 1748PubMedGoogle ScholarCrossref
26.
Hilleman  DMiller  MAParker  RDoering  PPieper  JA Optimal management of amiodarone therapy: efficacy and side effects.  Pharmacotherapy 1998;18138S- 145SPubMedGoogle Scholar
27.
US Food and Drug and Administration, Withdrawal of troglitazone and cisapride.  JAMA 2000;2832228PubMedGoogle ScholarCrossref
28.
 Actos tablets (Pioglitazone) [package insert].  Lincolnshire, Ill Takeda Pharmaceuticals America Inc2004;
29.
Majumdar  SRSoumerai  SB Why most interventions to improve physician prescribing do not seem to work.  CMAJ 2003;16930- 31PubMedGoogle Scholar
30.
Soumerai  SBMajumdar  SRLipton  HL Evaluating and improving physician prescribing. Strom  B Pharmacoepidemiology 3rd ed. Toronto, Ontario John Wiley & Sons2000;483- 503Google Scholar
31.
Grimshaw  JMShirran  LThomas  R  et al.  Changing provider behavior: an overview of systematic reviews of interventions.  Med Care 2001;39 ((8, suppl 2)) II2- 45Google ScholarCrossref
32.
Koppel  RMetlay  JPCohen  A  et al.  Role of computerized physician order entry systems in facilitating medication errors.  JAMA 2005;2931197- 1203PubMedGoogle ScholarCrossref
33.
Nebeker  JRHoffman  JMWeir  CR  et al.  High rates of adverse drug events in a highly computerized hospital.  Arch Intern Med 2005;1651111- 1116PubMedGoogle ScholarCrossref
34.
Leape  LLBerwick  DM Five years after To Err Is Human: what have we learned?  JAMA 2005;2932384- 2390PubMedGoogle ScholarCrossref
×