Association Between Implementation of a Medical Team Training Program and Surgical Mortality | Surgery | JAMA | JAMA Network
[Skip to Navigation]
Access to paid content on this site is currently suspended due to excessive activity being detected from your IP address 35.175.212.130. Please contact the publisher to request reinstatement.
1.
Joint Commission.  Joint Commission Sentinel Event. http://www.jointcommission.org/NR/rdonlyres/377FF7E7-F565-4D61-9FD2-593CA688135B/0/Statswithallfieldshidden31March2010.pdf. March 31, 2010. Accessed May 23, 2010
2.
Lingard L, Regehr G, Orser B,  et al.  Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication.  Arch Surg. 2008;143(1):12-1718209148PubMedGoogle ScholarCrossref
3.
Davenport DL, Henderson WG, Mosca CL, Khuri SF, Mentzer RM Jr. Risk-adjusted morbidity in teaching hospitals correlates with reported levels of communication and collaboration on surgical teams but not with scale measures of teamwork climate, safety climate, or working conditions.  J Am Coll Surg. 2007;205(6):778-78418035261PubMedGoogle ScholarCrossref
4.
Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care.  Qual Saf Health Care. 2004;13:(suppl 1)  i85-i9015465961PubMedGoogle ScholarCrossref
5.
Awad SS, Fagan SP, Bellows C,  et al.  Bridging the communication gap in the operating room with medical team training.  Am J Surg. 2005;190(5):770-77416226956PubMedGoogle ScholarCrossref
6.
Haynes AB, Weiser TG, Berry WR,  et al; Safe Surgery Saves Lives Study Group.  A surgical safety checklist to reduce morbidity and mortality in a global population.  N Engl J Med. 2009;360(5):491-49919144931PubMedGoogle ScholarCrossref
7.
Sorbero M, Farley D, Mattke S, Lovejoy S. Outcome Measures for Effective Teamwork in Inpatient CareSanta Monica, CA: Rand Corp; 2008. http://www.rand.org/pubs/technical_reports/TR462. Accessed May 23, 2010
8.
Dunn EJ, Mills PD, Neily J, Crittenden MD, Carmack AL, Bagian JP. Medical team training: applying crew resource management in the Veterans Health Administration.  Jt Comm J Qual Patient Saf. 2007;33(6):317-32517566541PubMedGoogle Scholar
9.
Paull DE, Mazzia LM, Izu BS, Neily J, Mills PD, Bagian JP. Predictors of successful implementation of preoperative briefings and postoperative debriefings after medical team training.  Am J Surg. 2009;198(5):675-67819887198PubMedGoogle ScholarCrossref
10.
Musson D, Helmreich RL. Team training and resource management in health care: current issues and future directions. Harvard Health Policy Review. 2004;5(1):25-35. http://www1.va.gov/vhapublications/ViewPublication.asp?pub_ID=1398. Accessed August 2, 2010
11.
Neily J, Mills PD, Lee P,  et al.  Medical Team Training and coaching in the Veterans Health Administration: assessment and impact on the first 32 facilities in the programme.  Qual Saf Health Care. 2010;19(4):360-36420693225PubMedGoogle ScholarCrossref
12.
Khuri SF, Henderson WG, Daley J,  et al; Principal Site Investigators of the Patient Safety in Surgery Study.  The patient safety in surgery study: background, study design, and patient populations.  J Am Coll Surg. 2007;204(6):1089-110217544068PubMedGoogle ScholarCrossref
13.
Khuri SF, Daley J, Henderson W,  et al.  The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care.  J Am Coll Surg. 1995;180(5):519-5317749526PubMedGoogle Scholar
14.
Khuri SF, Daley J, Henderson W,  et al; National VA Surgical Quality Improvement Program.  The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care.  Ann Surg. 1998;228(4):491-5079790339PubMedGoogle ScholarCrossref
15.
Khuri SF. The NSQIP: a new frontier in surgery.  Surgery. 2005;138(5):837-84316291383PubMedGoogle ScholarCrossref
16.
The American College of Surgeons, National Surgical Quality Improvement Program.  About ACS NSQIP: history of the ACS NSQIP. https://acsnsqip.org/main/about_history.asp. Accessed December 23, 2009
17.
Daley J, Khuri SF, Henderson W,  et al.  Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study.  J Am Coll Surg. 1997;185(4):328-3409328381PubMedGoogle Scholar
18.
Szabo CR.Veterans Healthcare Administration National Leadership Board Human Resources Committee. 2005 Facility Complexity Model 2005; August 9, 2005. http://www1.va.gov/vhapublications/ViewPublication.asp?pub_ID=1398. Accessed May 23, 2010
19.
West AN, Lee RE, Shambaugh-Miller MD,  et al.  Defining “rural” for veterans' healthcare planning [published online ahead of print June 17, 2010].  J Rural Healthhttp://onlinelibrary.wiley.com/doi/10.1111/j.1748-0361.2010.00298.x/abstract. Accessed September 27, 201016441331PubMedGoogle Scholar
20.
Diggle PJ, Liang KY, Zeger SL. Analysis of Longitudinal Data. Oxford, England: Clarendon Press; 1996
21.
McCullagh P, Nelder JA. Generalized Linear Models. 2nd ed. London, UK: Chapman & Hall; 1989
22.
Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects.  Biometrika. 1983;70(1):41-55Google ScholarCrossref
23.
Rubin DB. Estimating causal effects from large data sets using propensity scores.  Ann Intern Med. 1997;127(8 pt 2):757-7639382394PubMedGoogle ScholarCrossref
24.
Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score.  J Am Stat Assoc. 1984;79:516-524Google ScholarCrossref
25.
Rosenbaum PR, Rubin DB. Constructing a control group using multivariate matched sampling methods that incorporate the propensity score.  Am Stat. 1985;39:33-38Google Scholar
26.
Morey JC, Simon R, Jay GD,  et al.  Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project.  Health Serv Res. 2002;37(6):1553-158112546286PubMedGoogle ScholarCrossref
27.
Williams KA, Rose WD, Simon R. Teamwork in emergency medical services.  Air Med J. 1999;18(4):149-15310622851PubMedGoogle ScholarCrossref
28.
Grogan EL, Stiles RA, France DJ,  et al.  The impact of aviation-based teamwork training on the attitudes of health-care professionals.  J Am Coll Surg. 2004;199(6):843-84815555963PubMedGoogle ScholarCrossref
29.
DeFontes J, Subida S. Preoperative safety briefing project.  Permanente Journal. 2004;8(2):21-27http://xnet.kp.org/permanentejournal/spring04/awardwin.html. Accessed September 29, 2010Google Scholar
30.
Makary MA, Mukherjee A, Sexton JB,  et al.  Operating room briefings and wrong-site surgery.  J Am Coll Surg. 2007;204(2):236-24317254927PubMedGoogle ScholarCrossref
31.
Pratt SD, Mann S, Salisbury M,  et al.  Impact of CRM-based training on obstetric outcomes and clinicians' patient safety attitudes.  Jt Comm J Qual Patient Saf. 2007;33(12):720-72518200896PubMedGoogle Scholar
32.
Neily J, Mills PD, Eldridge N,  et al.  Incorrect surgical procedures within and outside of the operating room.  Arch Surg. 2009;144(11):1028-103419917939PubMedGoogle ScholarCrossref
Original Contribution
October 20, 2010

Association Between Implementation of a Medical Team Training Program and Surgical Mortality

Author Affiliations

Author Affiliations: National Center for Patient Safety, Department of Veterans Affairs (Mss Neily and West and Drs Mills, Young-Xu, Carney, Mazzia, Paull, and Bagian) and Department of Psychiatry, Dartmouth Medical School (Drs Mills and Young-Xu), Hanover, New Hampshire; Department of Surgery, Baylor College of Medicine, and Michael E. DeBakey Veterans Affairs Medical Center, Houston, Texas (Dr Berger); Preventive Medicine and Community Health at the University of Texas Medical Branch, Galveston, and Military and Emergency Medicine—Uniformed Services University of the Health Sciences, F. Edward Hebert School of Medicine, Bethesda, Maryland (Dr Bagian).

JAMA. 2010;304(15):1693-1700. doi:10.1001/jama.2010.1506
Abstract

Context There is insufficient information about the effectiveness of medical team training on surgical outcomes. The Veterans Health Administration (VHA) implemented a formalized medical team training program for operating room personnel on a national level.

Objective To determine whether an association existed between the VHA Medical Team Training program and surgical outcomes.

Design, Setting, and Participants A retrospective health services study with a contemporaneous control group was conducted. Outcome data were obtained from the VHA Surgical Quality Improvement Program (VASQIP) and from structured interviews in fiscal years 2006 to 2008. The analysis included 182 409 sampled procedures from 108 VHA facilities that provided care to veterans. The VHA's nationwide training program required briefings and debriefings in the operating room and included checklists as an integral part of this process. The training included 2 months of preparation, a 1-day conference, and 1 year of quarterly coaching interviews

Main Outcome Measure The rate of change in the mortality rate 1 year after facilities enrolled in the training program compared with the year before and with nontraining sites.

Results The 74 facilities in the training program experienced an 18% reduction in annual mortality (rate ratio [RR], 0.82; 95% confidence interval [CI], 0.76-0.91; P = .01) compared with a 7% decrease among the 34 facilities that had not yet undergone training (RR, 0.93; 95% CI, 0.80-1.06; P = .59). The risk-adjusted mortality rates at baseline were 17 per 1000 procedures per year for the trained facilities and 15 per 1000 procedures per year for the nontrained facilities. At the end of the study, the rates were 14 per 1000 procedures per year for both groups. Propensity matching of the trained and nontrained groups demonstrated that the decline in the risk-adjusted surgical mortality rate was about 50% greater in the training group (RR,1.49; 95% CI, 1.10-2.07; P = .01) than in the nontraining group. A dose-response relationship for additional quarters of the training program was also demonstrated: for every quarter of the training program, a reduction of 0.5 deaths per 1000 procedures occurred (95% CI, 0.2-1.0; P = .001).

Conclusion Participation in the VHA Medical Team Training program was associated with lower surgical mortality.

×