Wasser EJ, Prevedello LM, Sodickson A, Mar W, Khorasani R. Impact of a Real-Time Computerized Duplicate Alert System on the Utilization of Computed Tomography. JAMA Intern Med. 2013;173(11):1024-1026. doi:10.1001/jamainternmed.2013.543
Author Affiliations: Center for Evidence-Based Imaging, Brookline, Massachusetts (Drs Wasser, Prevedello, Sodickson, and Khorasani and Ms Mar); Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts (Drs Wasser, Prevedello, Sodickson, and Khorasani); and Harvard Medical School, Boston (Drs Wasser, Prevedello, Sodickson, and Khorasani).
The use of high-cost imaging modalities is rising rapidly. From 1995 through 2007, use of computed tomographic (CT) scans in the United States increased more than 4-fold1,2; by 2006, CT and magnetic resonance imaging examinations were the fastest-growing physician-directed Medicare expenditure.3,4 An uncertain proportion of these examinations represent overuse.5
There are little published data on the frequency of duplicated high-cost imaging examinations,6 but economic modeling suggests that cost savings from reducing redundant radiologic testing would be substantial.7 Because unnecessary duplication of CT examinations contributes to an increasingly strained medical payment system and exposes patients to unnecessary potential risks of radiation and intravenous contrast,2,8,9 we sought to determine whether alerting an ordering health care provider to the presence of a potentially redundant recent CT examination via decision support in a computerized physician order entry system (CPOE) can reduce repeated testing.
Institutional review board approval was obtained for this prospective controlled trial, performed at Brigham and Women's Hospital, a 752-bed urban tertiary academic medical center in Boston, Massachusetts. We entered all CT orders initiated in the CPOE system (Percipio; Medicalis Corp) from January 1, 2010, through May 31, 2010, that resulted in display of an intravenous contrast risk questionnaire at the time of order entry (approximately 98% of all CT orders placed during the period). Duplicate decision support (DDS) alerts the ordering provider to a potentially redundant recent CT (one performed on the same body part within 90 days of the index CT order). Links to images and radiology reports for these prior CT examinations are displayed. Following the alert, the user may proceed with, cancel, or abandon the order.
Information regarding orders and ordering health care providers was collected via the order entry system including patient age and sex, the clinical setting, examination type, and body part imaged. User cancellation events were recorded by the CPOE system. In addition, 200 CT orders were randomly selected: half that had triggered the DDS logic and half that had not. The appropriateness of DDS triggering was assessed by manually comparing these with the record of prior CT examinations in the electronic medical record.
The intervention group included CT orders for which both the DDS and contrast questionnaire were presented; the control group included those CT orders displaying the contrast questionnaire only. The primary outcome measure was the proportion of CT orders cancelled following DDS presentation. True cancellations were those cancelled or abandoned by the user at the time of entry and not reordered within 24 hours. Cancellation rates were defined as the ratio of true cancellation events to the total number of CT orders.
The DDS algorithm was assessed by calculation of sensitivity, specificity, accuracy, and positive and negative predictive value. We estimated 95% confidence intervals using the Wilson score method and statistical significance by practice setting using a χ2 analysis. Statistical analyses were performed using JMP9 software (SAS Institute).
Compared with manual medical chart review, the DDS alert was 96.9% sensitive (95% CI, 0.91-0.99) and 93.3% specific (95% CI, 0.87-0.97) with a positive predictive value of 93.0% (95% CI, 0.89-0.97), negative predictive value of 97.0% (95% CI, 0.92-0.99), and accuracy of 95.0% (95% CI, 0.92-0.98).
A total of 34 625 CT orders were initiated during the study period. After eliminating scans for research or administrative purposes, 33 523 clinical CT orders remained. Approximately one-third of these (33.6%) had a recent potentially redundant CT examination, triggering the DDS alert. The intervention group comprised the 11 074 orders activating both the DDS and contrast safety questionnaire. Within the remaining 24 596 CT orders, 21 784 (65.0%) activated the questionnaire alone and comprised the control group. Patient age and sex were similar across the intervention and control groups.
Presenting an alert at the time of order entry resulted in a significantly higher proportion of canceled CT orders compared with CT orders not triggering the alert (6.0% [661 of 11 074] vs 0.9% [194 of 22 281], or a greater than 6-fold increase; P < .001) across all practice settings (Table 1 and Table 2). The odds ratio of order cancellation differed by practice setting, ranging from 19.3 (95% CI, 10.3-36.1) in the primary care clinic to 4.0 (95% CI, 2.8-5.9) in the outpatient surgical clinics.
In our study, for nearly one-third of CT orders attempted, a CT examination had been performed on the same body part in the prior 90 days. A CPOE-embedded DDS notifying ordering health care providers of these potentially redundant examinations resulted in a 5.1% CT order cancellation rate attributable to DDS. The net effect was cancellation of 1.7% of all CT orders placed during the study period (33.6% × 5.1%). Given the large number of CT studies performed in the United States, even small reductions in unnecessary duplication could prove beneficial. If our findings are confirmed by others, using decision support to notify providers to the presence of recent similar imaging studies may be an effective tool to reduce waste while improving patient safety.
Correspondence: Dr Wasser, Center for Evidence-Based Imaging, 20 Kent St, Second Floor, Brookline, MA 02445 (email@example.com).
Published Online: April 22, 2013. doi:10.1001/jamainternmed.2013.543
Author Contributions: Dr Wasser and Ms Mar had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Wasser, Prevedello, Sodickson, and Khorasani. Acquisition of data: Wasser and Mar. Analysis and interpretation of data: Wasser, Sodickson, Mar, and Khorasani. Drafting of the manuscript: Wasser. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Wasser and Mar. Obtained funding: Khorasani. Administrative, technical, and material support: Khorasani. Study supervision: Prevedello and Sodickson.
Conflict of Interest Disclosures: Dr Khorasani is named on US patent No. 6 029138 held by Brigham and Women's Hospital and licensed to Medicalis Corp. He has been a consultant for Medicalis Corp and has received royalties from and has stock or stock options from Medicalis, and his institution has received royalties from Medicalis and has stock or stock options from Medicalis.
Funding/Support: This study was funded in part by grant 1UC4EB012952-01 from the National Institute of Biomedical Imaging and Bioengineering.
Additional Contributions: Shelley Hurwitz, PhD, and the Harvard Catalyst Center provided statistical support. Dana Marchello, RT, and Richard Hanson, BA, provided database assistance, Cameron Farkas, BA, participated in algorithm verification, and Louise Scheider, MD, provided editorial support.