[Skip to Navigation]
Sign In
Figure 1.  Effect of Interdisciplinary Team Care Interventions on Length of Stay
Effect of Interdisciplinary Team Care Interventions on Length of Stay

The figure's exploratory analysis indicates no significant effect of interdisciplinary team care interventions on length of stay. This was the case for each of the 2 subcategories: interventions altering interdisciplinary team composition (ITC-C; weighted mean difference, 0.087; 95% CI, −0.083 to 0.257) and interventions altering interdisciplinary team practice (ITC-P; weighted mean difference, 0.001; 95% CI, −0.035 to 0.037).

Figure 2.  Effect of Interdisciplinary Team Care Interventions on Early Readmissions
Effect of Interdisciplinary Team Care Interventions on Early Readmissions

The figure's exploratory analysis indicates no consistent effect of interdisciplinary team care interventions on early readmissions. Interdisciplinary team composition interventions (ITC-C) tended to increase early readmissions, albeit with important confounding factors in the included studies as described in the text (weighted risk ratio [RR], 1.341; 95% CI, 1.120-1.607). Interdisciplinary team practice interventions (ITC-P) did not significantly reduce early readmissions (weighted RR, 0.995; 95% CI, 0.912-1.085).

Figure 3.  Effect of Interdisciplinary Team Care Interventions on Early Mortality
Effect of Interdisciplinary Team Care Interventions on Early Mortality

The figure’s exploratory analysis indicates no significant reduction in early mortality with interdisciplinary team composition interventions (ITC-C; weighted risk ratio [RR], 0.925; 95% CI, 0.816-1.049). The 2 interdisciplinary team practice interventions (ITC-P) tended to reduce early mortality (weighted RR, 0.665; 95% CI, 0.449-0.986). The data marker with arrow for the study by Webster et al33 indicates that the 95% CI for the RR (2.167) was out of the range of the plot.

Table.  Characteristics of Included Studies
Characteristics of Included Studies
1.
Future Hospital Commission.  Future Hospital: Caring for Medical Patients: A Report From the Future Hospital Commission to the Royal College of Physicians. London, England: Royal College of Physicians; 2013.
2.
O'Leary  KJ, Sehgal  NL, Terrell  G, Williams  MV; High Performance Teams and the Hospital of the Future Project Team.  Interdisciplinary teamwork in hospitals: a review and practical recommendations for improvement.  J Hosp Med.2012;7(1):48-54.PubMedGoogle ScholarCrossref
3.
Huang  C, Loewen  P, Pelletier  T, Slater  J, Chung  M.  Implementation of proven interventions in general medical inpatients: development and evaluation of a new quality indicator for drug therapy.  Qual Saf Health Care. 2008;17(4):269-274.PubMedGoogle ScholarCrossref
4.
Hogan  H, Healey  F, Neale  G, Thomson  R, Vincent  C, Black  N.  Preventable deaths due to problems in care in English acute hospitals: a retrospective case record review study.  BMJ Qual Saf. 2012;21(9):737-745.PubMedGoogle ScholarCrossref
5.
Pannick  S, Beveridge  I, Wachter  RM, Sevdalis  N.  Improving the quality and safety of care on the medical ward: a review and synthesis of the evidence base.  Eur J Intern Med. 2014;25(10):874-887.PubMedGoogle ScholarCrossref
6.
Donabedian  A.  The quality of care: how can it be assessed?  JAMA. 1988;260(12):1743-1748.PubMedGoogle ScholarCrossref
7.
Lilford  R, Mohammed  MA, Spiegelhalter  D, Thomson  R.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma.  Lancet. 2004;363(9415):1147-1154.PubMedGoogle ScholarCrossref
8.
Haugen  AS, Søfteland  E, Almeland  SK,  et al.  Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial.  Ann Surg. 2015;261(5):821-828.PubMedGoogle ScholarCrossref
9.
Bergs  J, Hellings  J, Cleemput  I,  et al.  Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications.  Br J Surg. 2014;101(3):150-158.PubMedGoogle ScholarCrossref
10.
Gillespie  BM, Chaboyer  W, Thalib  L, John  M, Fairweather  N, Slater  K.  Effect of using a safety checklist on patient complications after surgery: a systematic review and meta-analysis.  Anesthesiology. 2014;120(6):1380-1389.PubMedGoogle ScholarCrossref
11.
Pronovost  P, Needham  D, Berenholtz  S,  et al.  An intervention to decrease catheter-related bloodstream infections in the ICU.  N Engl J Med. 2006;355(26):2725-2732.PubMedGoogle ScholarCrossref
12.
Bosk  CL, Dixon-Woods  M, Goeschel  CA, Pronovost  PJ.  Reality check for checklists.  Lancet. 2009;374(9688):444-445.PubMedGoogle ScholarCrossref
13.
Effective Practice and Organisation of Care (EPOC).  What study designs should be included in an EPOC review and what should they be called? EPOC resources for review authors. http://epocoslo.cochrane.org/epoc-specific-resources-review-authors. Updated February 17, 2015. Accessed August 3, 2014.
14.
Effective Practice and Organisation of Care (EPOC).  Suggested risk of bias criteria for EPOC reviews: EPOC resources for review authors. http://epocoslo.cochrane.org/epoc-specific-resources-review-authors. Updated February 17, 2015. Accessed August 13, 2014.
15.
Davey  P, Brown  E, Charani  E,  et al.  Interventions to improve antibiotic prescribing practices for hospital inpatients.  Cochrane Database Syst Rev. 2013;4:CD003543.PubMedGoogle Scholar
16.
Cole  MG, McCusker  J, Bellavance  F,  et al.  Systematic detection and multidisciplinary care of delirium in older medical inpatients: a randomized trial.  CMAJ. 2002;167(7):753-759.PubMedGoogle Scholar
17.
Pitkälä  KH, Laurila  JV, Strandberg  TE, Tilvis  RS.  Multicomponent geriatric intervention for elderly inpatients with delirium: a randomized, controlled trial.  J Gerontol A Biol Sci Med Sci. 2006;61(2):176-181.PubMedGoogle ScholarCrossref
18.
Lai  JC, Montero  A, Lebwohl  B, Brown  RS  Jr.  A novel housestaff educational model for quaternary-care patients at an academic health center.  Acad Med.2009;84(2):206-211.PubMedGoogle ScholarCrossref
19.
Solomon  DH, Van Houten  L, Glynn  RJ,  et al.  Academic detailing to improve use of broad-spectrum antibiotics at an academic medical center.  Arch Intern Med. 2001;161(15):1897-1902.PubMedGoogle ScholarCrossref
20.
Desan  PH, Zimbrean  PC, Weinstein  AJ, Bozzo  JE, Sledge  WH.  Proactive psychiatric consultation services reduce length of stay for admissions to an inpatient medical team.  Psychosomatics. 2011;52(6):513-520.PubMedGoogle ScholarCrossref
21.
Korbkitjaroen  M, Vaithayapichet  S, Kachintorn  K, Jintanothaitavorn  D, Wiruchkul  N, Thamlikitkul  V.  Effectiveness of comprehensive implementation of individualized bundling infection control measures for prevention of health care–associated infections in general medical wards.  Am J Infect Control. 2011;39(6):471-476.PubMedGoogle ScholarCrossref
22.
Curley  C, McEachern  JE, Speroff  T.  A firm trial of interdisciplinary rounds on the inpatient medical wards: an intervention designed using continuous quality improvement.  Med Care. 1998;36(8)(suppl):AS4-AS12.PubMedGoogle Scholar
23.
Mudge  A, Laracy  S, Richter  K, Denaro  C.  Controlled trial of multidisciplinary care teams for acutely ill medical inpatients: enhanced multidisciplinary care.  Intern Med J. 2006;36(9):558-563.PubMedGoogle ScholarCrossref
24.
O’Leary  KJ, Wayne  DB, Haviley  C, Slade  ME, Lee  J, Williams  MV.  Improving teamwork: impact of structured interdisciplinary rounds on a medical teaching unit.  J Gen Intern Med. 2010;25(8):826-832.PubMedGoogle ScholarCrossref
25.
O’Leary  KJ, Haviley  C, Slade  ME, Shah  HM, Lee  J, Williams  MV.  Improving teamwork: impact of structured interdisciplinary rounds on a hospitalist unit.  J Hosp Med. 2011;6(2):88-93.PubMedGoogle ScholarCrossref
26.
Wald  HL, Glasheen  JJ, Guerrasio  J, Youngwerth  JM, Cumbler  EU.  Evaluation of a hospitalist-run acute care for the elderly service.  J Hosp Med. 2011;6(6):313-321.PubMedGoogle ScholarCrossref
27.
Auerbach  AD, Sehgal  NL, Blegen  MA,  et al.  Effects of a multicentre teamwork and communication programme on patient outcomes: results from the Triad for Optimal Patient Safety (TOPS) project.  BMJ Qual Saf. 2012;21(2):118-126.PubMedGoogle ScholarCrossref
28.
Saint  S, Fowler  KE, Krein  SL,  et al.  An academic hospitalist model to improve healthcare worker communication and learner education: results from a quasi-experimental study at a Veterans Affairs medical center.  J Hosp Med. 2013;8(12):702-710.PubMedGoogle ScholarCrossref
29.
Fine  MJ, Stone  RA, Lave  JR,  et al.  Implementation of an evidence-based guideline to reduce duration of intravenous antibiotic therapy and length of stay for patients hospitalized with community-acquired pneumonia: a randomized controlled trial.  Am J Med. 2003;115(5):343-351.PubMedGoogle ScholarCrossref
30.
Esparza  JM, Shi  R, McLarty  J, Comegys  M, Banks  DE.  The effect of a clinical medical librarian on in-patient care outcomes.  J Med Libr Assoc. 2013;101(3):185-191.PubMedGoogle ScholarCrossref
31.
Singh  S, Tarima  S, Rana  V,  et al.  Impact of localizing general medical teams to a single nursing unit.  J Hosp Med. 2012;7(7):551-556.PubMedGoogle ScholarCrossref
32.
Thanarajasingam  U, McDonald  FS, Halvorsen  AJ,  et al.  Service census caps and unit-based admissions: resident workload, conference attendance, duty hour compliance, and patient safety.  Mayo Clin Proc. 2012;87(4):320-327.PubMedGoogle ScholarCrossref
33.
Webster  JR, Chew  RB, Mailliard  L, Moran  MB.  Improving clinical and cost outcomes in delirium: use of practice guidelines and a delirium care team.  Ann Long-Term Care. 1999;7(4):128-134.Google Scholar
34.
Camins  BC, King  MD, Wells  JB,  et al.  Impact of an antimicrobial utilization program on antimicrobial use at a large teaching hospital: a randomized controlled trial.  Infect Control Hosp Epidemiol. 2009;30(10):931-938.PubMedGoogle ScholarCrossref
35.
Manuel  O, Burnand  B, Bady  P,  et al.  Impact of standardised review of intravenous antibiotic therapy 72 hours after prescription in two internal medicine wards.  J Hosp Infect. 2010;74(4):326-331.PubMedGoogle ScholarCrossref
36.
Lesprit  P, Landelle  C, Brun-Buisson  C.  Clinical impact of unsolicited post-prescription antibiotic review in surgical and medical wards: a randomized controlled trial.  Clin Microbiol Infect. 2013;19(2):E91-E97.PubMedGoogle ScholarCrossref
37.
Kircher  TT, Wormstall  H, Müller  PH,  et al.  A randomised trial of a geriatric evaluation and management consultation services in frail hospitalised patients.  Age Ageing. 2007;36(1):36-42.PubMedGoogle ScholarCrossref
38.
Soifer  NE, Borzak  S, Edlin  BR, Weinstein  RA.  Prevention of peripheral venous catheter complications with an intravenous therapy team: a randomized controlled trial.  Arch Intern Med. 1998;158(5):473-477.PubMedGoogle ScholarCrossref
39.
Dey  P, Woodman  M, Gibbs  A,  et al.  Early assessment by a mobile stroke team: a randomised controlled trial.  Age Ageing. 2005;34(4):331-338.PubMedGoogle ScholarCrossref
40.
Kucukarslan  SN, Peters  M, Mlynarek  M, Nafziger  DA.  Pharmacists on rounding teams reduce preventable adverse drug events in hospital general medicine units.  Arch Intern Med. 2003;163(17):2014-2018.PubMedGoogle ScholarCrossref
41.
Mannheimer  B, Ulfvarson  J, Eklöf  S,  et al.  Drug-related problems and pharmacotherapeutic advisory intervention at a medicine clinic.  Eur J Clin Pharmacol. 2006;62(12):1075-1081.PubMedGoogle ScholarCrossref
42.
Makowsky  MJ, Koshman  SL, Midodzi  WK, Tsuyuki  RT.  Capturing outcomes of clinical activities performed by a rounding pharmacist practicing in a team environment: the COLLABORATE study [NCT00351676].  Med Care. 2009;47(6):642-650.PubMedGoogle ScholarCrossref
43.
Lisby  M, Thomsen  A, Nielsen  LP,  et al.  The effect of systematic medication review in elderly patients admitted to an acute ward of internal medicine.  Basic Clin Pharmacol Toxicol. 2010;106(5):422-427.PubMedGoogle Scholar
44.
Schillig  J, Kaatz  S, Hudson  M, Krol  GD, Szandzik  EG, Kalus  JS.  Clinical and safety impact of an inpatient pharmacist-directed anticoagulation service.  J Hosp Med. 2011;6(6):322-328.PubMedGoogle ScholarCrossref
45.
O’Leary  KJ, Buck  R, Fligiel  HM,  et al.  Structured interdisciplinary rounds in a medical teaching unit: improving patient safety.  Arch Intern Med. 2011;171(7):678-684.PubMedGoogle ScholarCrossref
46.
Zwarenstein  M, Goldman  J, Reeves  S.  Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes.  Cochrane Database Syst Rev. 2009;(3):CD000072.PubMedGoogle Scholar
47.
van de Ven  J.  Effectiveness of multidisciplinary team training in obstetric emergencies: a randomized controlled trial.  Am J Obstet Gynecol. 2012;206(1)(suppl):S68.Google ScholarCrossref
48.
Nielsen  PE, Goldman  MB, Mann  S,  et al.  Effects of teamwork training on adverse outcomes and process of care in labor and delivery: a randomized controlled trial.  Obstet Gynecol. 2007;109(1):48-55.PubMedGoogle ScholarCrossref
49.
Reames  BN, Scally  CP, Thumma  JR, Dimick  JB.  Evaluation of the effectiveness of a surgical checklist in Medicare patients.  Med Care. 2015;53(1):87-94.PubMedGoogle ScholarCrossref
50.
Weaver  SJ, Lubomksi  LH, Wilson  RF, Pfoh  ER, Martinez  KA, Dy  SM.  Promoting a culture of safety as a patient safety strategy: a systematic review.  Ann Intern Med. 2013;158(5, pt 2):369-374.PubMedGoogle ScholarCrossref
51.
Koroshetz  W.  A core set of trial outcomes for every medical discipline?  BMJ. 2015;350:h85.PubMedGoogle ScholarCrossref
52.
Burke  LG, Jha  AK.  Patients’ functional status and hospital readmissions: remembering what matters.  JAMA Intern Med. 2015;175(4):565-566.PubMedGoogle ScholarCrossref
53.
Joynt  KE, Jha  AK.  Thirty-day readmissions—truth and consequences.  N Engl J Med. 2012;366(15):1366-1369.PubMedGoogle ScholarCrossref
54.
McGlynn  EA, Schneider  EC, Kerr  EA.  Reimagining quality measurement.  N Engl J Med. 2014;371(23):2150-2153.PubMedGoogle ScholarCrossref
55.
Mant  J, Hicks  N.  Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction.  BMJ. 1995;311(7008):793-796.PubMedGoogle ScholarCrossref
56.
Lilford  R, Pronovost  P.  Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away.  BMJ.2010;340:c2016. PubMedGoogle ScholarCrossref
57.
Jeffs  L, Law  MP, Straus  S, Cardoso  R, Lyons  RF, Bell  C.  Defining quality outcomes for complex-care patients transitioning across the continuum using a structured panel process.  BMJ Qual Saf. 2013;22(12):1014-1024.PubMedGoogle ScholarCrossref
58.
Wenger  NS, Roth  CP, Shekelle  P; ACOVE Investigators.  Introduction to the Assessing Care of Vulnerable Elders-3 quality indicator measurement set.  J Am Geriatr Soc. 2007;55(suppl 2):S247-S252.PubMedGoogle ScholarCrossref
59.
Doyle  C, Lennox  L, Bell  D.  A systematic review of evidence on the links between patient experience and clinical safety and effectiveness.  BMJ Open. 2013;3(1):e001570.PubMedGoogle ScholarCrossref
60.
Kötter  T, Blozik  E, Scherer  M.  Methods for the guideline-based development of quality indicators—a systematic review.  Implement Sci. 2012;7:21.PubMedGoogle ScholarCrossref
61.
Deschodt  M, Flamaing  J, Haentjens  P, Boonen  S, Milisen  K.  Impact of geriatric consultation teams on clinical outcome in acute hospitals: a systematic review and meta-analysis.  BMC Med. 2013;11:48.PubMedGoogle ScholarCrossref
62.
Kaboli  PJ, Hoth  AB, McClimon  BJ, Schnipper  JL.  Clinical pharmacists and inpatient medical care: a systematic review.  Arch Intern Med. 2006;166(9):955-964.PubMedGoogle ScholarCrossref
63.
Shojania  KG.  Conventional evaluations of improvement interventions: more trials or just more tribulations?  BMJ Qual Saf. 2013;22(11):881-884.PubMedGoogle ScholarCrossref
64.
Hasson  H.  Systematic evaluation of implementation fidelity of complex interventions in health and social care.  Implement Sci. 2010;5:67.PubMedGoogle ScholarCrossref
65.
Campion  EW.  The value of geriatric interventions.  N Engl J Med. 1995;332(20):1376-1378.PubMedGoogle ScholarCrossref
Original Investigation
August 2015

Effects of Interdisciplinary Team Care Interventions on General Medical Wards: A Systematic Review

Author Affiliations
  • 1Imperial Patient Safety Translational Research Center, National Institute for Health Research and Imperial College London, London, England
  • 2West Middlesex University Hospital National Health Service Trust, Middlesex, England
  • 3Department of Surgery and Cancer, Imperial College London, London, England
  • 4Division of Hospital Medicine, University of California, San Francisco
  • 5Center for Implementation Science, Health Service & Population Research Department, King’s College London, London, England
JAMA Intern Med. 2015;175(8):1288-1298. doi:10.1001/jamainternmed.2015.2421
Abstract

Importance  Improving the quality of health care for general medical patients is a priority, but the organization of general medical ward care receives less scrutiny than the management of specific diseases. Optimizing teams’ performance improves patient outcomes in other settings, and interdisciplinary practice is a major target for improvement efforts. However, the effect of interdisciplinary team interventions on general medical ward care has not been systematically reviewed.

Objectives  To describe the range of objective patient outcomes used in studies of general medical ward interdisciplinary team care, and to evaluate the performance of interdisciplinary interventions against them.

Evidence Review  We searched EMBASE, MEDLINE, and PsycINFO from January 1, 1998, through December 31, 2013, for interdisciplinary team care interventions in adult general medical wards using an objective patient outcome measure. Reference lists of included articles were also searched. The last search was conducted on January 29, 2014, and the narrative and statistical analysis was conducted through December 1, 2014. Study quality was assessed using the Cochrane Effective Practice and Organization of Care group’s tool.

Findings  Thirty of 6934 articles met the selection criteria. The studies included 66 548 patients, with a mean age of 63 years. Nineteen of 30 (63%) studies reported length of stay, readmission, or mortality rate as their primary outcome, or did not specify the primacy of their outcomes. The most commonly reported objective patient outcomes were length of stay (23 of 30 [77%]), complications of care (10 of 30 [33%]), in-hospital mortality rate (8 of 30 [27%]), and 30-day readmission rate (8 of 30 [27%]). Of 23 interventions, 16 (70%) had no effect on length of stay, 12 of 15 (80%) did not reduce readmissions, and 14 of 15 (93%) did not affect mortality. Five of 10 (50%) interventions reduced complications of care. In an exploratory quantitative analysis, the interventions did not consistently reduce the relative risk of early readmission or early mortality, or the weighted mean difference in length of stay. All studies had a medium or high risk of bias.

Conclusions and Relevance  Current evidence suggests that interdisciplinary team care interventions on general medical wards have little effect on traditional measures of health care quality. Complications of care or preventable adverse events may merit inclusion as quality indicators for general medical wards. Future study should clarify how best to implement interdisciplinary team care interventions and establish quality metrics that are credible to both health care professionals and patients in this setting.

Introduction

Understanding how to better organize health care for general medical patients is an international priority for safety improvement.1,2 Despite this need, we know relatively little about how to improve processes and outcomes for these patients. Missed opportunities to provide necessary health care are more common3 than technical procedural failings.4 More than any other health care setting, general medical wards generate the errors that lead to preventable deaths4; yet, the fundamental organization of ward-based care receives less attention than the management of specific diseases. Systems of general medical ward care are usually unchanged across successive generations of health care professionals, in contrast to the dynamic developments in the treatment of individual pathological conditions.

We identified 5 paths by which organizations may seek to improve the quality and safety of health care on the general medical ward: staffing levels and team composition; staff communication and collaboration; standardization of the processes of health care; early treatment of deteriorating patients; and changes in the local safety climate.5 We focus here on interdisciplinary communication and collaboration. Physicians are increasingly required to formalize their interdisciplinary practice, which is a measure widely believed to improve efficiency; yet, to our knowledge, a systematic assessment of interdisciplinary care specific to the general medical ward setting has not been published.

Defining the measures on which to base that assessment is difficult; there is no consensus as to the metrics that best reflect the quality of general medical ward care. Quality can relate to structures, processes, or outcomes.6 Interpretation of outcome data can be contentious, although debate largely focuses on the inappropriate use of outcomes (rather than processes) to rank institutions’ comparative performance.7 In research, outcome data are of more use7; they are also directly meaningful for patients and potentially influenced by interdisciplinary interventions. Interdisciplinary operating room safety checklists, for example, reduce surgical morbidity and possibly mortality,8-10 and complex cultural interventions in the intensive care unit (ICU) reduce catheter-associated bloodstream infections.11,12 We therefore conducted a systematic review to describe the range of objective patient outcomes used in studies of the general medical ward environment, and to evaluate the performance of interdisciplinary team care interventions against them. Interdisciplinary team care can be defined as the structured working practices that dictate which different health care practitioners interact together to contribute to patient care, as well as when and how they do so. This definition incorporates staff who are routinely expected to attend to the patient (eg, nurses and ward physicians) as well as those who intermittently provide specialist review and advice.

Methods
Data Sources and Searches

We searched the EMBASE, MEDLINE, and PsycINFO databases for English-language studies published from January 1, 1998, through December 31, 2013 (see eMethods in the Supplement for the full search strategy). We also manually searched the reference lists of included studies. Ethics approval was not required because the study was conducted using existing published data.

Eligibility Criteria

We included primary reports of interdisciplinary team care interventions on adult general medical wards in which the interventions were evaluated against an objective patient outcome (eTable 1 in the Supplement). Interventions that relied solely on a staff member taking on a dedicated coordinating or facilitating role (eg, case management) were excluded, as were interventions that targeted the continuation of care by a similar group during the following shift (eg, handoff processes). Interventions focused on the period of inpatient hospitalization. Randomized controlled trials (RCTs), studies with an appropriate comparison group, and interrupted time series were included. We used the criteria and terminology of the Cochrane Effective Practice and Organization of Care13 review group to define study type.

Study Selection

One investigator (S.P.) reviewed each title and abstract to determine the study’s eligibility. A second reviewer (R.D.) independently screened 15% of the titles and abstracts to assess the reliability of the inclusion and exclusion criteria. Studies that met the criteria were examined in full by both reviewers, and the final set of studies was confirmed after discussion with a third reviewer (N.S.).

Data Extraction and Risk of Bias Assessment

Two reviewers (H.A. and S.P.) extracted data from each study. When required information was not initially available, authors were contacted for further data or clarification. Two reviewers (B.E.B. and S.P.) independently assessed the risk of bias for each study, with disagreements resolved by consensus. We used predefined criteria based on the Cochrane Effective Practice and Organization of Care group’s guidance,14 to rate studies as having low, medium, or high risk of bias. Other systematic reviews of heterogeneous health care interventions use a similar approach.15 Interventions were classified as low, medium, or high intensity. No single measure of intensity could adequately be applied to such heterogeneous studies, but factors taken into account included the frequency of the mandated use of the intervention; autonomy of the individuals on the interdisciplinary team to enact recommendations; resource provision; and follow-up.

Statistical Analysis

We categorized interventions based on their focus on interdisciplinary team composition or practice, and subcategorized interdisciplinary composition interventions by the type of specialist input they delineated. We describe the studies’ outcome measures and the adjustment methods used to account for their patient case mix. For meaningful analysis, outcomes were grouped into early (occurring within 30 days of receiving the intervention) or late outcomes (31 days to 12 months). When appropriate, we assessed the correlation between the studies’ intensity ratings and the likelihood of a statistically significant effect on the given outcome (χ2 analysis; differences were considered significant at P < .05). The studies were too heterogeneous for summary effect statistics to be wholly reliable. Instead, we present the available data as an exploratory analysis in weighted bubble charts, with pooled values and 95% CIs (Figures 1, 2, and 3).16-36 The relative risk of outcomes or weighted mean difference (for length-of-stay data) was calculated with DerSimonian and Laird random-effects modeling. Between-study and within-study variances contributed to study weighting. Analyses were performed using Stata, version 12 (StataCorp LP).

Results
Study Characteristics
Trial Designs

A total of 6934 potentially relevant citations were identified. After excluding abstracts from conferences, there was 100% agreement between 2 reviewers (S.P. and R.D.) on the initial inclusion of a 15% sample of abstracts (1040 citations). After full text review, 30 studies met the inclusion criteria,16-45 26 of which were identified from the initial database search and 4 from hand-searching reference lists (eFigure in the Supplement). These studies comprised 8 RCTs,16,17,36-39,41,43 9 cluster RCTs,19,21,24,25,29,34,42,44,45 8 nonrandomized cluster trials,22,23,26,30,31,33,35,40 4 controlled before-after studies,18,20,28,32 and 1 interrupted time series.27

Types of Intervention and Context

Study characteristics are summarized in the Table, with more complete descriptions in eTable 2 in the Supplement. Other than 1 example,29 studies compared an interdisciplinary team care intervention with usual care. Interventions were grouped into 2 categories. The first group of interventions altered the composition of the interdisciplinary team who routinely attended to the patient, such as by requiring additional specialists or professionals to provide advice. The second group addressed team practice—the logistics of when, where, and how team members would work together.

The 30 studies included 66 548 patients with a mean age of 63 years and a variety of primary diagnoses. Six studies targeted patients with specific diagnoses (delirium,16,17,33 community-acquired pneumonia,29 acute stroke,39 and advanced liver disease18), although they were treated on general medical rather than specialist wards. One study evaluated a service for patients taking anticoagulant medication.44 Twenty-one studies were conducted in North America, 8 in other developed countries, and 1 in an upper-middle-income country. Trials were conducted in a range of settings, including community and urban teaching hospitals, quaternary academic facilities, and Veterans Affairs hospitals. Five were multicenter studies.

Of the 20 studies that addressed interdisciplinary team composition, 15 investigated proactive, unsolicited consultations from a specialist or specialist team.16,17,19-21,29,33-38,41,43,44 Consulting professionals specialized in geriatrics,16,17,33,37 infectious diseases,19,21,29,34-36 intravenous therapy,38 stroke,39 pharmacotherapy,41,43,44 or psychiatry.20 Four studies assessed the effect of embedding additional health care professionals in rounding teams, incorporating pharmacists40,42 or medical librarians,30 or supervising medical subspecialists.18

Ten studies investigated interdisciplinary team practice, often using interdisciplinary rounds22,24,25,45 or a package of interventions including interdisciplinary rounds.23,26,28 Two studies assessed team localization,31,32 with medical and nursing staff copositioned in the same geographic area in the hospital. One study described an interdisciplinary teamwork and communication program.27

Reported Objective Patient Outcome Measures

Of the 30 studies, 19 (63%) reported length of stay, readmission, or mortality rate as their primary outcome measure or did not specify the primacy of their outcome measures.17,18,20-24,28-33,36-39,41,43 The most commonly reported objective patient outcome measures were length of stay (23 of 30 [77%]), complications of care (10 of 30 [33%]), in-hospital mortality rate (8 of 30 [27%]), and 30-day readmission rate (8 of 30 [27%]). Seven of 9 studies (78%) that reported mortality rate after discharge used time points later than 30 days.16,17,23,37,39,41,43 Seven of 30 studies (23%) reported requirements for institutional care either at discharge or subsequently.16,17,23,26,33,37,39 One of 30 studies (3%) reported patients’ use of community health care services following discharge,43 and 1 of 30 studies (3%) reported objective assessments of functional status.37 Studies reported a mean of 3.1 objective patient outcome measures.

Several studies did not seek improvements in these outcomes per se, targeting a different aspect of care. Interventions involving infectious disease specialists, for example, were often restrictive in nature, advocating narrower-spectrum antibiotic choices or oral rather than intravenous therapy.19,29,34,36 Those studies sought only to show that their intervention had no detrimental effect on patient outcomes, aiming instead to demonstrate improvements in processes of care.19,29,36

Risk of Bias and Intervention Intensity

No study had a low risk of bias; 7 (23%) had a medium risk of bias,16,17,27,28,36,39,43 and 23 (77%) had a high risk of bias.18-26,29-35,37,38,40-42,44,45 Eight studies (27%) involved low-intensity interventions17,30,34-36,39,41,43; the remainder were of medium or high intensity.

Outcome Risk Adjustment and Analysis

Of the 30 studies, 16 (53%) did not adjust their results for their patient case mix.16,17,19-21,23,26,30,34-36,39-41,43,44 Eleven of 30 studies (37%) used patient characteristics as independent variables in a multivariate analysis to isolate the effect of their intervention.18,22,24,25,27,28,31,37,38,42,45 Two of 30 studies (7%) adjusted results for predicted outcomes based on diagnosis-related groups,32,33 and 1 of 30 studies (3%) used a disease-specific severity index.29 Only 7 of 30 studies (23%) accounted for autocorrelated outcomes, in which patients treated by the same physician (or team) are more likely to have similar results than those who are not.

Complications of Care and Discharge Location

Of 10 interdisciplinary team care interventions, 5 (50%) reduced complications of care.21,29,38,40,45 Three of those 5 harnessed input from infectious diseases specialists21,29 or specialist nurses in reducing infective complications of peripheral intravenous catheters.38 Both studies that reported preventable adverse events suggested improvement, either through embedding pharmacists in the clinical team40 or formalizing interdisciplinary rounds.45 Four of the 5 interventions that showed reduced complications of care were rated high intensity,21,38,40,45 but there was no apparent relationship between high-intensity categorization and reduced complications (χ2 = 0.476; P = .49). Zero of 7 interventions successfully reduced the need for institutional care after discharge; 4 of those 7 were rated high intensity.16,23,26,33

Length of Stay

Saint et al28 documented significant secular reductions in length of stay. In this context, 16 of 23 interventions (70%) had no effect on the length of stay16,17,19,21,23-29,31,35,36,40,43; 5 of 23 (22%) reduced the length of stay18,20,22,33,34; and 1 (4%) may have increased the length of stay.42 A study by Esparza et al30 that associated clinical librarian input with increased length of stay was too heavily confounded by patient group differences to support this conclusion, as acknowledged by its authors. Four of 5 effective interventions (80%) incorporated subspecialist input to the primary general medical ward team.18,20,33,34 Again, 4 of 5 effective interventions were of high intensity,18,20,22,33 without a significant overall correlation between intensity and effect on length of stay (χ2 = 1.433; P = .49).

Of the studies that failed to demonstrate a statistically significant change in length of stay, 9 of 16 (56%) reported increased length of stay with their intervention.16,17,24-26,28,31,35,43 Singh et al31 explained how this result could be an unintended consequence of localization interventions. However, the exploratory quantitative summary did not detect a significant change in length of stay overall. The weighted mean difference in length of stay for interdisciplinary team composition interventions was 0.087 (95% CI, −0.083 to 0.257). For interdisciplinary team practice interventions, the weighted mean difference in length of stay was 0.001 (95% CI, −0.035 to 0.037) (Figure 1).

Readmissions and Use of Outpatient Care

Twelve of 15 interventions (80%) did not reduce readmissions. One study (7%) reported readmissions at 7 days,28 8 studies (53%) reported readmissions at 30 days,19,26-32 5 studies (33%) reported readmissions at points between 60 days and 6 months,23,36,41-43 and 1 study (7%) reported readmissions at 1 year.37 One study reported both 3- and 6-month readmissions.42

One of 3 infectious disease interventions (33%) reduced 60-day readmissions related to relapsing infection36; the other 2 similar interventions did not affect readmissions, albeit when measured at 30 days.19,29 One of 440-43 pharmacy interventions reduced admissions (at 3 months), although the effect had dissipated by 6 months.42 Zero of 6 interdisciplinary team practice interventions reduced readmissions.23,26-28,31,32 One study suggested reduced readmissions after localizing teams and introducing service census limits, but the results did not meet the predefined statistical threshold allowing for multiple comparisons.32 Increased readmissions in the study by Esparza et al30 were again attributed to confounding factors. Of the 2 interventions that reduced readmissions, one was of low intensity36 and the other was of high intensity.42An exploratory analysis showed interdisciplinary team care interventions had an inconsistent effect on early readmissions. Team composition interventions tended to increase early readmissions, albeit with important confounding factors in the included studies: weighted risk ratio (RR), 1.341 (95% CI, 1.120-1.607). Team practice interventions did not significantly reduce early readmissions: weighted RR, 0.995 (95% CI, 0.912-1.085) (Figure 2).

Last, 1 study reported contact with primary health care (ambulatory visits to medical specialists, family physicians, and the emergency department)43 and 1 reported objective functional measures at 12 months.37 The interdisciplinary team interventions had no effect on these outcomes.

Mortality Rates

Only 1 of 15 (7%) studies that reported mortality rate showed a significant effect at any time point23 (Figure 3). Mudge et al23 were the only group, to our knowledge, to describe a sustained increase in allied health care professional resourcing (physiotherapy, occupational therapy, social work, dietetics, and speech therapy) alongside an interdisciplinary structure to make use of those staff. The intervention was rated high intensity. However, the observed reduction in in-hospital mortality did not persist at 6 months.23 Team practice interventions tended to reduce early mortality, although only 2 studies contributed data: weighted RR, 0.665 (95% CI, 0.449-0.986). Interdisciplinary team composition interventions did not significantly reduce early mortality: weighted RR, 0.925 (95% CI, 0.816-1.049) (Figure 3).

Discussion

Studies of interdisciplinary team care interventions on general medical wards most commonly choose length of stay, complications, readmission, or mortality rates as their primary outcome measures. In this setting, we found that most interdisciplinary interventions do not affect these outcomes, although there is some evidence that improvements in interdisciplinary collaboration may reduce complications of care. Significant contemporaneous secular reductions in length of stay are reported,28 which these interventions did not reduce further. Interdisciplinary interventions confined to the inpatient setting are unlikely to reduce readmissions, the need for institutional care after discharge, or mortality rates—although simultaneous investments in staffing and team structures may reduce mortality rates in the short term. Limited reports of success suggest that high-intensity delivery is necessary, but not sufficient, for an intervention to have the desired effect on any of these outcomes.

The included studies took place in a variety of settings, from safety-net hospitals to large academic facilities, and across numerous countries with disparate health care systems. In contrast to many trials, the studies included here had relatively few exclusion criteria. These findings are therefore generally applicable to a broad range of medical inpatients internationally, although the evidence on which they draw is limited in both quantity and quality.

Our results broadly correlate with earlier work evaluating nontechnical interventions. A Cochrane review46 of RCTs could only label collaborative interprofessional interventions as “promising” rather than “proven.” Multidisciplinary team training in obstetrics does not improve clinical outcomes,47,48 nor did an interdisciplinary safety program for surgical ward teams.49 Similarly, interventions with the primary aim of promoting a culture of patient safety do not have a clear effect on patient outcomes.50 The evidence that interdisciplinary interventions can improve patient outcomes appears limited to the operating room and the ICU.8-11 Outside these structured units, we may need a more considered approach to the assessment and improvement of interdisciplinary team care.

Every medical discipline now requires an updated set of core trial outcomes—a key data set to which each new study should contribute—in addition to its specific findings.51 Interdisciplinary care in internal medicine may need this set of outcomes more than most; it is striking that both the systems of care, and our favored parameters for evaluating them, have gone unchanged for decades.28,51 Meaningful collaboration is increasingly seen as the bellwether for a high-performing ward, but our findings suggest that changes in interdisciplinary team care are not well captured by the objective patient measures currently used in this setting. There is little apparent consensus on the essential outcomes that general medical ward interventions should report, nor how to adjust them to reflect the ward’s case mix. Other authors have also suggested that the focus on length of stay, readmissions, and mortality rate misses the point.52-54 Good interdisciplinary team care may prolong admissions, perhaps by fostering an environment in which the patient’s medical and social needs before discharge are better identified. Thirty-day readmission rates may be largely determined by the provision of services in the community,53 and mortality rates correlate poorly with quality of care.7,55,56

In contrast, a Delphi expert consensus57 identified the 72-hour readmission rate as a valid quality indicator for hospitalized patients with complex needs. This rate was the only preferred patient outcome among several process measures57; other consensus panels addressing complexity have focused solely on processes as quality indicators.58 Our analysis suggests that complications of care or preventable adverse events may also have promise as clinically meaningful outcomes reflecting the quality of general medical ward care. These outcomes, together with selected process data, merit consideration in a core data set. Too few studies reported postdischarge use of outpatient services or objective measures of patients’ functional performance to judge whether these too may be useful. We believe that patients themselves should also be invited to tell health care professionals which objective outcomes they hold most important. Whether their individual experiences of health care correlate with its technical quality remains unclear59; nonetheless, as a group, patients are too rarely asked to participate in defining what matters.57,58,60

With relevant outcomes better established, future studies should evaluate how best to implement interdisciplinary team care interventions. Interdisciplinary care is not a panacea; understanding the preconditions for its success (eg, adequate staffing levels or strong leadership support) and whether it potentiates other safety initiatives should be a priority. New interventions should also capitalize on 3 important phenomena. First, interdisciplinary teams become more effective as their members develop personal autonomy to enact recommendations.61 Second, practical changes that facilitate better teamwork may be more effective than simply investing in teamwork training per se.5,27 Third, clinical and managerial engagement are crucial if successful changes are to persist after a study, and authors should describe the implementation model accompanying any intervention alongside its objective evaluation.

To our knowledge, this review is the first systematic attempt to assess interventions targeted specifically at the organization of care on general medical wards. Our definition of interdisciplinary team care establishes a meaningful class of intervention. We identified a focused collection of work that is relevant to modern practice. Previous reviews of interdisciplinary interventions brought together distinctly different contexts—for example, internal medicine and orthopedic surgery61 or psychiatry and the ICU.62 However, general medical wards face different challenges than other areas of the hospital, including more frequent transitions of care, geographic team dispersion, and heterogeneous patient populations for whom there is no single best pathway for diagnosis or treatment.5 We believe these differences argue for a specific analysis of general medical wards rather than extrapolating from other clinical departments to this unique setting. Including a range of study designs, as we have done here, facilitates a deeper understanding of context-specific improvement strategies than reviews that rely on RCTs alone.46,63 Last, our definition of intervention intensity mirrored an updated conceptual framework for understanding implementation fidelity.64

Nonetheless, the heterogeneous studies described here could be categorized differently. We were unable to search for unpublished trials, precluding assessment of publication bias or selective reporting. Included studies used a variety of different designs; even allowing for this fact, most have severe methodological limitations that constrain the strength of our conclusions. The absence of any studies with a low risk of bias is noteworthy, and we included controlled before-after studies with only 1 intervention or control site, which are particularly prone to confounding.13 We aggregated results reported at different times; our distinction between early and late outcomes is arbitrary but mimics that used in clinical practice. Although we sought to contact study authors for clarification or additional data,21,23,26,28,33,40,43 only some replied.21,23,28,43 The heterogeneity of the included studies limited quantitative analysis, and the search strategy may not have been fully sensitive to all relevant articles. Our search identified only the articles with objective patient outcomes, so we have not described process measures, subjective outcomes, or patient-reported outcomes; these too are valuable.

Conclusions

To date, most general medical ward interdisciplinary team care interventions have not improved the objective patient outcomes used to assess them. Outside the operating room and ICU, more sensitive measures are required to evaluate interdisciplinary care. In 1995, Campion65(p1377) argued that “bedside consultations are not a form of technology, and we should not be as severe in judging them as we are in evaluating a surgical procedure.” We propose that equally careful consideration of interdisciplinary care is merited, although we need new objective measures of its effectiveness.

Back to top
Article Information

Accepted for Publication: February 27, 2015.

Corresponding Author: Samuel Pannick, MA, MBBS, MRCP, Imperial Patient Safety Translational Research Center, National Institute for Health Research and Imperial College London, Room 503, Wright Fleming Building, Norfolk Place, London W2 1PG, England (s.pannick@imperial.ac.uk).

Published Online: June 15, 2015. doi:10.1001/jamainternmed.2015.2421.

Author Contributions: Dr Pannick had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Pannick, Ashrafian, Beveridge, Wachter, Sevdalis.

Acquisition, analysis, or interpretation of data: Pannick, Davis, Ashrafian, Byrne, Athanasiou, Sevdalis.

Drafting of the manuscript: Pannick.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Pannick, Ashrafian, Athanasiou.

Obtained funding: Sevdalis.

Study supervision: Davis, Ashrafian, Beveridge, Wachter, Athanasiou, Sevdalis.

Conflict of Interest Disclosures: Dr Sevdalis reports delivering team-based assessment and training interventions to hospitals in England and the United States on a consultancy basis through London Safety and Training Solutions Ltd and, in the past, holding a consultancy agreement with Green Cross Medical Ltd for the development of training materials for cancer tumor boards. Dr Wachter reports serving as the immediate past-chair of the American Board of Internal Medicine (ABIM) (for which he received a stipend) and a current member of the ABIM Foundation board; receiving a contract to UCSF from the Agency for Healthcare Research and Quality for editing 2 patient-safety websites; receiving compensation from John Wiley and Sons for writing a blog; receiving royalties from Lippincott Williams & Wilkins and McGraw-Hill for writing/editing several books; receiving a stipend and stock options for serving on the Board of Directors of IPC Healthcare; serving on the scientific advisory boards for Amino.com, PatientSafe Solutions, CRISI, QPID, and EarlySense (for which he receives stock options); and holding the Benioff endowed chair in hospital medicine from Marc and Lynne Benioff. No other disclosures were reported.

Funding/Support: This study was supported by the National Institute for Health Research via the Imperial Patient Safety Translational Research Center (http://www.cpssq.org) (Drs Pannick, Davis, Byrne, and Sevdalis); from January 2015, the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care South London at King’s College Hospital National Health Service Foundation Trust (Dr Sevdalis); the West Middlesex University Hospital National Health Service Trust (Drs Pannick and Beveridge); and the Department of Surgery and Cancer at Imperial College London (Drs Ashrafian and Athanasiou).

Role of the Funder/Sponsor: The authors were fully independent of their funding institutions, which took no part in the design or conduct of the study; the collection, management, analysis, and interpretation of the data; the preparation, review, or approval of the manuscript; or the decision to submit the manuscript for publication.

Disclaimer: The views expressed are those of the authors and not necessarily those of the National Health Service, National Institute for Health Research, or Department of Health.

References
1.
Future Hospital Commission.  Future Hospital: Caring for Medical Patients: A Report From the Future Hospital Commission to the Royal College of Physicians. London, England: Royal College of Physicians; 2013.
2.
O'Leary  KJ, Sehgal  NL, Terrell  G, Williams  MV; High Performance Teams and the Hospital of the Future Project Team.  Interdisciplinary teamwork in hospitals: a review and practical recommendations for improvement.  J Hosp Med.2012;7(1):48-54.PubMedGoogle ScholarCrossref
3.
Huang  C, Loewen  P, Pelletier  T, Slater  J, Chung  M.  Implementation of proven interventions in general medical inpatients: development and evaluation of a new quality indicator for drug therapy.  Qual Saf Health Care. 2008;17(4):269-274.PubMedGoogle ScholarCrossref
4.
Hogan  H, Healey  F, Neale  G, Thomson  R, Vincent  C, Black  N.  Preventable deaths due to problems in care in English acute hospitals: a retrospective case record review study.  BMJ Qual Saf. 2012;21(9):737-745.PubMedGoogle ScholarCrossref
5.
Pannick  S, Beveridge  I, Wachter  RM, Sevdalis  N.  Improving the quality and safety of care on the medical ward: a review and synthesis of the evidence base.  Eur J Intern Med. 2014;25(10):874-887.PubMedGoogle ScholarCrossref
6.
Donabedian  A.  The quality of care: how can it be assessed?  JAMA. 1988;260(12):1743-1748.PubMedGoogle ScholarCrossref
7.
Lilford  R, Mohammed  MA, Spiegelhalter  D, Thomson  R.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma.  Lancet. 2004;363(9415):1147-1154.PubMedGoogle ScholarCrossref
8.
Haugen  AS, Søfteland  E, Almeland  SK,  et al.  Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial.  Ann Surg. 2015;261(5):821-828.PubMedGoogle ScholarCrossref
9.
Bergs  J, Hellings  J, Cleemput  I,  et al.  Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications.  Br J Surg. 2014;101(3):150-158.PubMedGoogle ScholarCrossref
10.
Gillespie  BM, Chaboyer  W, Thalib  L, John  M, Fairweather  N, Slater  K.  Effect of using a safety checklist on patient complications after surgery: a systematic review and meta-analysis.  Anesthesiology. 2014;120(6):1380-1389.PubMedGoogle ScholarCrossref
11.
Pronovost  P, Needham  D, Berenholtz  S,  et al.  An intervention to decrease catheter-related bloodstream infections in the ICU.  N Engl J Med. 2006;355(26):2725-2732.PubMedGoogle ScholarCrossref
12.
Bosk  CL, Dixon-Woods  M, Goeschel  CA, Pronovost  PJ.  Reality check for checklists.  Lancet. 2009;374(9688):444-445.PubMedGoogle ScholarCrossref
13.
Effective Practice and Organisation of Care (EPOC).  What study designs should be included in an EPOC review and what should they be called? EPOC resources for review authors. http://epocoslo.cochrane.org/epoc-specific-resources-review-authors. Updated February 17, 2015. Accessed August 3, 2014.
14.
Effective Practice and Organisation of Care (EPOC).  Suggested risk of bias criteria for EPOC reviews: EPOC resources for review authors. http://epocoslo.cochrane.org/epoc-specific-resources-review-authors. Updated February 17, 2015. Accessed August 13, 2014.
15.
Davey  P, Brown  E, Charani  E,  et al.  Interventions to improve antibiotic prescribing practices for hospital inpatients.  Cochrane Database Syst Rev. 2013;4:CD003543.PubMedGoogle Scholar
16.
Cole  MG, McCusker  J, Bellavance  F,  et al.  Systematic detection and multidisciplinary care of delirium in older medical inpatients: a randomized trial.  CMAJ. 2002;167(7):753-759.PubMedGoogle Scholar
17.
Pitkälä  KH, Laurila  JV, Strandberg  TE, Tilvis  RS.  Multicomponent geriatric intervention for elderly inpatients with delirium: a randomized, controlled trial.  J Gerontol A Biol Sci Med Sci. 2006;61(2):176-181.PubMedGoogle ScholarCrossref
18.
Lai  JC, Montero  A, Lebwohl  B, Brown  RS  Jr.  A novel housestaff educational model for quaternary-care patients at an academic health center.  Acad Med.2009;84(2):206-211.PubMedGoogle ScholarCrossref
19.
Solomon  DH, Van Houten  L, Glynn  RJ,  et al.  Academic detailing to improve use of broad-spectrum antibiotics at an academic medical center.  Arch Intern Med. 2001;161(15):1897-1902.PubMedGoogle ScholarCrossref
20.
Desan  PH, Zimbrean  PC, Weinstein  AJ, Bozzo  JE, Sledge  WH.  Proactive psychiatric consultation services reduce length of stay for admissions to an inpatient medical team.  Psychosomatics. 2011;52(6):513-520.PubMedGoogle ScholarCrossref
21.
Korbkitjaroen  M, Vaithayapichet  S, Kachintorn  K, Jintanothaitavorn  D, Wiruchkul  N, Thamlikitkul  V.  Effectiveness of comprehensive implementation of individualized bundling infection control measures for prevention of health care–associated infections in general medical wards.  Am J Infect Control. 2011;39(6):471-476.PubMedGoogle ScholarCrossref
22.
Curley  C, McEachern  JE, Speroff  T.  A firm trial of interdisciplinary rounds on the inpatient medical wards: an intervention designed using continuous quality improvement.  Med Care. 1998;36(8)(suppl):AS4-AS12.PubMedGoogle Scholar
23.
Mudge  A, Laracy  S, Richter  K, Denaro  C.  Controlled trial of multidisciplinary care teams for acutely ill medical inpatients: enhanced multidisciplinary care.  Intern Med J. 2006;36(9):558-563.PubMedGoogle ScholarCrossref
24.
O’Leary  KJ, Wayne  DB, Haviley  C, Slade  ME, Lee  J, Williams  MV.  Improving teamwork: impact of structured interdisciplinary rounds on a medical teaching unit.  J Gen Intern Med. 2010;25(8):826-832.PubMedGoogle ScholarCrossref
25.
O’Leary  KJ, Haviley  C, Slade  ME, Shah  HM, Lee  J, Williams  MV.  Improving teamwork: impact of structured interdisciplinary rounds on a hospitalist unit.  J Hosp Med. 2011;6(2):88-93.PubMedGoogle ScholarCrossref
26.
Wald  HL, Glasheen  JJ, Guerrasio  J, Youngwerth  JM, Cumbler  EU.  Evaluation of a hospitalist-run acute care for the elderly service.  J Hosp Med. 2011;6(6):313-321.PubMedGoogle ScholarCrossref
27.
Auerbach  AD, Sehgal  NL, Blegen  MA,  et al.  Effects of a multicentre teamwork and communication programme on patient outcomes: results from the Triad for Optimal Patient Safety (TOPS) project.  BMJ Qual Saf. 2012;21(2):118-126.PubMedGoogle ScholarCrossref
28.
Saint  S, Fowler  KE, Krein  SL,  et al.  An academic hospitalist model to improve healthcare worker communication and learner education: results from a quasi-experimental study at a Veterans Affairs medical center.  J Hosp Med. 2013;8(12):702-710.PubMedGoogle ScholarCrossref
29.
Fine  MJ, Stone  RA, Lave  JR,  et al.  Implementation of an evidence-based guideline to reduce duration of intravenous antibiotic therapy and length of stay for patients hospitalized with community-acquired pneumonia: a randomized controlled trial.  Am J Med. 2003;115(5):343-351.PubMedGoogle ScholarCrossref
30.
Esparza  JM, Shi  R, McLarty  J, Comegys  M, Banks  DE.  The effect of a clinical medical librarian on in-patient care outcomes.  J Med Libr Assoc. 2013;101(3):185-191.PubMedGoogle ScholarCrossref
31.
Singh  S, Tarima  S, Rana  V,  et al.  Impact of localizing general medical teams to a single nursing unit.  J Hosp Med. 2012;7(7):551-556.PubMedGoogle ScholarCrossref
32.
Thanarajasingam  U, McDonald  FS, Halvorsen  AJ,  et al.  Service census caps and unit-based admissions: resident workload, conference attendance, duty hour compliance, and patient safety.  Mayo Clin Proc. 2012;87(4):320-327.PubMedGoogle ScholarCrossref
33.
Webster  JR, Chew  RB, Mailliard  L, Moran  MB.  Improving clinical and cost outcomes in delirium: use of practice guidelines and a delirium care team.  Ann Long-Term Care. 1999;7(4):128-134.Google Scholar
34.
Camins  BC, King  MD, Wells  JB,  et al.  Impact of an antimicrobial utilization program on antimicrobial use at a large teaching hospital: a randomized controlled trial.  Infect Control Hosp Epidemiol. 2009;30(10):931-938.PubMedGoogle ScholarCrossref
35.
Manuel  O, Burnand  B, Bady  P,  et al.  Impact of standardised review of intravenous antibiotic therapy 72 hours after prescription in two internal medicine wards.  J Hosp Infect. 2010;74(4):326-331.PubMedGoogle ScholarCrossref
36.
Lesprit  P, Landelle  C, Brun-Buisson  C.  Clinical impact of unsolicited post-prescription antibiotic review in surgical and medical wards: a randomized controlled trial.  Clin Microbiol Infect. 2013;19(2):E91-E97.PubMedGoogle ScholarCrossref
37.
Kircher  TT, Wormstall  H, Müller  PH,  et al.  A randomised trial of a geriatric evaluation and management consultation services in frail hospitalised patients.  Age Ageing. 2007;36(1):36-42.PubMedGoogle ScholarCrossref
38.
Soifer  NE, Borzak  S, Edlin  BR, Weinstein  RA.  Prevention of peripheral venous catheter complications with an intravenous therapy team: a randomized controlled trial.  Arch Intern Med. 1998;158(5):473-477.PubMedGoogle ScholarCrossref
39.
Dey  P, Woodman  M, Gibbs  A,  et al.  Early assessment by a mobile stroke team: a randomised controlled trial.  Age Ageing. 2005;34(4):331-338.PubMedGoogle ScholarCrossref
40.
Kucukarslan  SN, Peters  M, Mlynarek  M, Nafziger  DA.  Pharmacists on rounding teams reduce preventable adverse drug events in hospital general medicine units.  Arch Intern Med. 2003;163(17):2014-2018.PubMedGoogle ScholarCrossref
41.
Mannheimer  B, Ulfvarson  J, Eklöf  S,  et al.  Drug-related problems and pharmacotherapeutic advisory intervention at a medicine clinic.  Eur J Clin Pharmacol. 2006;62(12):1075-1081.PubMedGoogle ScholarCrossref
42.
Makowsky  MJ, Koshman  SL, Midodzi  WK, Tsuyuki  RT.  Capturing outcomes of clinical activities performed by a rounding pharmacist practicing in a team environment: the COLLABORATE study [NCT00351676].  Med Care. 2009;47(6):642-650.PubMedGoogle ScholarCrossref
43.
Lisby  M, Thomsen  A, Nielsen  LP,  et al.  The effect of systematic medication review in elderly patients admitted to an acute ward of internal medicine.  Basic Clin Pharmacol Toxicol. 2010;106(5):422-427.PubMedGoogle Scholar
44.
Schillig  J, Kaatz  S, Hudson  M, Krol  GD, Szandzik  EG, Kalus  JS.  Clinical and safety impact of an inpatient pharmacist-directed anticoagulation service.  J Hosp Med. 2011;6(6):322-328.PubMedGoogle ScholarCrossref
45.
O’Leary  KJ, Buck  R, Fligiel  HM,  et al.  Structured interdisciplinary rounds in a medical teaching unit: improving patient safety.  Arch Intern Med. 2011;171(7):678-684.PubMedGoogle ScholarCrossref
46.
Zwarenstein  M, Goldman  J, Reeves  S.  Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes.  Cochrane Database Syst Rev. 2009;(3):CD000072.PubMedGoogle Scholar
47.
van de Ven  J.  Effectiveness of multidisciplinary team training in obstetric emergencies: a randomized controlled trial.  Am J Obstet Gynecol. 2012;206(1)(suppl):S68.Google ScholarCrossref
48.
Nielsen  PE, Goldman  MB, Mann  S,  et al.  Effects of teamwork training on adverse outcomes and process of care in labor and delivery: a randomized controlled trial.  Obstet Gynecol. 2007;109(1):48-55.PubMedGoogle ScholarCrossref
49.
Reames  BN, Scally  CP, Thumma  JR, Dimick  JB.  Evaluation of the effectiveness of a surgical checklist in Medicare patients.  Med Care. 2015;53(1):87-94.PubMedGoogle ScholarCrossref
50.
Weaver  SJ, Lubomksi  LH, Wilson  RF, Pfoh  ER, Martinez  KA, Dy  SM.  Promoting a culture of safety as a patient safety strategy: a systematic review.  Ann Intern Med. 2013;158(5, pt 2):369-374.PubMedGoogle ScholarCrossref
51.
Koroshetz  W.  A core set of trial outcomes for every medical discipline?  BMJ. 2015;350:h85.PubMedGoogle ScholarCrossref
52.
Burke  LG, Jha  AK.  Patients’ functional status and hospital readmissions: remembering what matters.  JAMA Intern Med. 2015;175(4):565-566.PubMedGoogle ScholarCrossref
53.
Joynt  KE, Jha  AK.  Thirty-day readmissions—truth and consequences.  N Engl J Med. 2012;366(15):1366-1369.PubMedGoogle ScholarCrossref
54.
McGlynn  EA, Schneider  EC, Kerr  EA.  Reimagining quality measurement.  N Engl J Med. 2014;371(23):2150-2153.PubMedGoogle ScholarCrossref
55.
Mant  J, Hicks  N.  Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction.  BMJ. 1995;311(7008):793-796.PubMedGoogle ScholarCrossref
56.
Lilford  R, Pronovost  P.  Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away.  BMJ.2010;340:c2016. PubMedGoogle ScholarCrossref
57.
Jeffs  L, Law  MP, Straus  S, Cardoso  R, Lyons  RF, Bell  C.  Defining quality outcomes for complex-care patients transitioning across the continuum using a structured panel process.  BMJ Qual Saf. 2013;22(12):1014-1024.PubMedGoogle ScholarCrossref
58.
Wenger  NS, Roth  CP, Shekelle  P; ACOVE Investigators.  Introduction to the Assessing Care of Vulnerable Elders-3 quality indicator measurement set.  J Am Geriatr Soc. 2007;55(suppl 2):S247-S252.PubMedGoogle ScholarCrossref
59.
Doyle  C, Lennox  L, Bell  D.  A systematic review of evidence on the links between patient experience and clinical safety and effectiveness.  BMJ Open. 2013;3(1):e001570.PubMedGoogle ScholarCrossref
60.
Kötter  T, Blozik  E, Scherer  M.  Methods for the guideline-based development of quality indicators—a systematic review.  Implement Sci. 2012;7:21.PubMedGoogle ScholarCrossref
61.
Deschodt  M, Flamaing  J, Haentjens  P, Boonen  S, Milisen  K.  Impact of geriatric consultation teams on clinical outcome in acute hospitals: a systematic review and meta-analysis.  BMC Med. 2013;11:48.PubMedGoogle ScholarCrossref
62.
Kaboli  PJ, Hoth  AB, McClimon  BJ, Schnipper  JL.  Clinical pharmacists and inpatient medical care: a systematic review.  Arch Intern Med. 2006;166(9):955-964.PubMedGoogle ScholarCrossref
63.
Shojania  KG.  Conventional evaluations of improvement interventions: more trials or just more tribulations?  BMJ Qual Saf. 2013;22(11):881-884.PubMedGoogle ScholarCrossref
64.
Hasson  H.  Systematic evaluation of implementation fidelity of complex interventions in health and social care.  Implement Sci. 2010;5:67.PubMedGoogle ScholarCrossref
65.
Campion  EW.  The value of geriatric interventions.  N Engl J Med. 1995;332(20):1376-1378.PubMedGoogle ScholarCrossref
×