March 9, 2005

Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient OutcomesA Systematic Review

Author Affiliations

Author Affiliations: Division of Nephrology (Drs Garg and Rosas-Arellano) and Department of Epidemiology and Biostatistics (Dr Garg), University of Western Ontario, London; Departments of Clinical Epidemiology and Biostatistics (Drs Garg, Adhikari, Devereaux, and Haynes and Ms McDonald) and Medicine (Drs Devereaux and Haynes), McMaster University, Hamilton, Ontario; Department of Critical Care Medicine, Sunnybrook and Women’s College Health Sciences Centre and Interdepartmental Division of Critical Care (Dr Adhikari), Population Health Sciences, Hospital for Sick Children (Dr Beyene), and Faculty of Medicine (Ms Sam), University of Toronto, Toronto, Ontario.

JAMA. 2005;293(10):1223-1238. doi:10.1001/jama.293.10.1223

Context Developers of health care software have attributed improvements in patient care to these applications. As with any health care intervention, such claims require confirmation in clinical trials.

Objectives To review controlled trials assessing the effects of computerized clinical decision support systems (CDSSs) and to identify study characteristics predicting benefit.

Data Sources We updated our earlier reviews by searching the MEDLINE, EMBASE, Cochrane Library, Inspec, and ISI databases and consulting reference lists through September 2004. Authors of 64 primary studies confirmed data or provided additional information.

Study Selection We included randomized and nonrandomized controlled trials that evaluated the effect of a CDSS compared with care provided without a CDSS on practitioner performance or patient outcomes.

Data Extraction Teams of 2 reviewers independently abstracted data on methods, setting, CDSS and patient characteristics, and outcomes.

Data Synthesis One hundred studies met our inclusion criteria. The number and methodologic quality of studies improved over time. The CDSS improved practitioner performance in 62 (64%) of the 97 studies assessing this outcome, including 4 (40%) of 10 diagnostic systems, 16 (76%) of 21 reminder systems, 23 (62%) of 37 disease management systems, and 19 (66%) of 29 drug-dosing or prescribing systems. Fifty-two trials assessed 1 or more patient outcomes, of which 7 trials (13%) reported improvements. Improved practitioner performance was associated with CDSSs that automatically prompted users compared with requiring users to activate the system (success in 73% of trials vs 47%; P = .02) and studies in which the authors also developed the CDSS software compared with studies in which the authors were not the developers (74% success vs 28%; respectively, P = .001).

Conclusions Many CDSSs improve practitioner performance. To date, the effects on patient outcomes remain understudied and, when studied, inconsistent.