Objective
To describe incorrect surgical procedures reported from Veterans Health Administration (VHA) Medical Centers from 2001 to mid-2006 and provide proposed solutions for preventing such events.
Design
Descriptive study.
Setting
Veterans Health Administration Medical Centers.
Participants
Veterans of the US Armed Forces.
Interventions
The VHA instituted an initial directive, “Ensuring Correct Surgery and Invasive Procedures,” in January 2003. The directive was updated in 2004 to include non–operating room (OR) invasive procedures and incorporated requirements of The Joint Commission Universal Protocol for preventing wrong-site operations.
Main Outcome Measures
The categories included 5 incorrect event types (wrong patient, side, site, procedure, or implant), major or minor surgical procedures, location in or out of the OR, therapeutic or diagnostic events, adverse event or close call, inpatient or ambulatory events, specialty department, body segment, and severity and probability of harm.
Results
We reviewed 342 reported events (212 adverse events and 130 close calls). Of these, 108 adverse events (50.9%) occurred in an OR, and 104 (49.1%) occurred elsewhere. When examining adverse events only, ophthalmology and invasive radiology were the specialties associated with the most reports (45 [21.2%] each), whereas orthopedics was second to ophthalmology for number of reported adverse events occurring in the OR. Pulmonary medicine cases (such as wrong-side thoracentesis) and wrong-site cases (such as wrong spinal level) were associated with the most harm. The most common root cause of events was communication (21.0%).
Conclusions
Incorrect ophthalmic and orthopedic surgical procedures appear to be overrepresented among adverse events occurring in ORs. Outside the OR, adverse events by invasive radiology were most frequently reported. Incorrect surgical procedures are not only an OR challenge but also a challenge for events occurring outside of the OR. We support earlier communication based on crew resource management to prevent surgical adverse events.
Incorrect surgical procedures can be devastating. Some examples include wrong-site,1 wrong-side, wrong-procedure, or wrong-patient events.2 Based on the database analysis of Seiden and Barach,2 we estimated that 5 to 10 of these events occur daily in the United States. A report from Pennsylvania stated that some aspect of an actual or close-call wrong-site surgical procedure occurs every other day in that state.3 Kwaan et al1 examined a malpractice insurance database for wrong-site surgical procedures and estimated an incidence of 1 in 112 994 nonspine, wrong-site surgical procedures. That study did not include wrong-patient or wrong-procedure events and excluded non–operating room (OR) cases, so it is understandable that this rate appears lower than that reported by Seiden and Barach. The New York Patient Occurrence and Reporting Tracking System database, for which reporting is mandatory, indicated 100 or more wrong-patient, wrong-site, and wrong–invasive procedure events reported per year in that state for 2003-2005.4 Wrong-site surgical procedure was the sentinel event most frequently reported to The Joint Commission.5 The literature indicates that the true incidence of incorrect surgical procedures is not known with confidence. Despite efforts to eliminate incorrect surgical procedures, these events continue to occur.3,5-7
The Veterans Health Administration (VHA) developed and implemented a pilot program to reduce the risk of incorrect surgical events in April 2002, which resulted in the dissemination of a national directive in January 2003. Subsequently, The Joint Commission issued a Universal Protocol for Preventing Wrong Site, Wrong Procedure and Wrong Person Surgery, effective July 1, 2004.8 The VHA issued an updated version of its directive on Ensuring Correct Surgery and Invasive Procedures on June 24, 2004,9 to be fully consistent with the Universal Protocol and to address implementation questions.
In the VHA for catastrophic events, root cause analysis (RCA) teams examine what happened and why it occurred, and then recommend actions to prevent reoccurrence.10,11 The Joint Commission also requires an RCA for sentinel events.12 In addition, VHA staff members are required to use RCA for potentially catastrophic close-call events.13 The VHA staff submits RCAs and incident reports to a central database.14
In this study, we analyzed surgical adverse events and close calls from VHA RCAs and incident reports (termed safety reports in the VHA system). The purpose of this analysis is to provide information and proposed solutions regarding incorrect surgical events and to provide a unique perspective by summarizing reports from a large health care system over 5½ years.
We analyzed reported surgical adverse events in the VHA and described categories of events. We also describe reporting before and after dissemination of policies to ensure correct surgical procedures. The Research and Development Committee, Veterans Affairs Medical Center, White River Junction, Vermont, approved this project, and the Committee for the Protection of Human Subjects, Dartmouth College, considered this project exempt.
Of 153 major facilities in the VHA, 130 (85.0%) provide surgical services.15 Operating room reported events could have occurred at any of the 130 VHA facilities providing surgical services, whereas non-OR events could have occurred at any of the 153 VHA facilities.
We searched the VHA National Center for Patient Safety database for surgical adverse events occurring between January 1, 2001, and June 30, 2006. Events were not limited to the OR and included incidents in procedure rooms or radiology suites and at the bedside. These data were limited to RCAs and safety reports submitted to the National Center for Patient Safety and were not abstracted from medical records. Results were filtered to include only events pertaining to incorrect surgical procedures or incorrect invasive procedures. An additional search was conducted using a natural language processing search method that uses data and text mining (PolyAnalyst),16 which produced the final data set for this study.
Two independent teams of a surgeon and at least 1 nonclinical researcher coded each report. The teams reconciled differences to arrive at a consensus for a final categorization of each case.
After categorization was completed, two of us (J.N. and P.D.M.) coded the root causes of events into major categories such as education or communication. We coded 10 cases by consensus to develop draft categories of root causes and then independently coded 40 cases in groups of 10 and refined the codebook until we reached an agreement of 80.6% and κ of 0.79 for the last 10 cases. We then independently coded remaining cases, reaching consensus when the root causes did not clearly fit into any one category.
Major and Minor Surgical Procedures
Major surgical procedures were defined as “procedures performed under general, spinal, and epidural anesthesia, and all carotid endarterectomies and inguinal herniorrhaphies, regardless of anesthesia type.”17(p493) Minor surgical procedures were defined as any other invasive procedure. All major surgical procedures occur in the OR, but minor surgical procedures may or may not take place in the OR. Major or minor surgical procedures are performed on outpatients or inpatients.
Therapeutic procedures were defined as procedures to treat medical conditions, and diagnostic procedures were defined as procedures to establish a diagnosis. Inpatient procedures were defined as those performed on an inpatient hospitalized for at least 1 night before or after the procedure. Ambulatory procedures were those for which the preoperative plan called for same-day admission and discharge. Cases in which the patient needed admission solely because of the adverse event or close call were counted as ambulatory.
Event Location, OR vs Non-OR
An OR was defined as part of a suite in a hospital or in an outpatient ambulatory surgical center with dedicated staff, equipment, and space guidelines consistent with Joint Commission standards.18 Non-OR environments may be any setting where an invasive procedure is performed, eg, a procedure room in a clinic or emergency department, an interventional procedure room in a radiology department, or at the bedside.
Adverse Event vs Close Call
An adverse event was defined as an incident in which the patient had undergone a surgical procedure of any type unnecessarily, such as a procedure performed on the wrong patient or wrong site. This included any incision or puncture to the patient, including injections and administration of regional or general anesthetic not needed for the planned procedure. Topical applications to the skin or via eyedrops were considered close calls.
A close call was defined as an incident in which a recognizable step toward a surgical adverse event occurred without the patient being subjected to a surgical or invasive procedure as previously defined in our definition of adverse event. Some examples included the wrong patient was given a consent form, the wrong procedure was written on the consent form, the wrong surgical site was marked, and the wrong site or wrong patient was prepped. Solely omitting a required step in the VHA directive9 or Universal Protocol19 did not constitute a close call. For example, if a step was skipped, such as site marking, but the correct procedure was performed, this was considered a deviation from the directive but not a close call.
Service or specialty was coded as the surgical or medical service or specialty department that performed the procedure. Routine radiographs or magnetic resonance images did not meet the definition of invasive procedure and were not considered in this study; only invasive radiological procedures, such as those that required the injection of dye or catheterization, were included.
Anatomic body segment was coded as the site at which the surgical procedure occurred. In cases where multiple sites were identified, the body segment coded was the incision location. The parts of the body were developed based on this data set: head/neck, eye, mouth, arm/hand, thorax, abdomen, spine, pelvis, and leg/foot.
Event type included wrong patient, wrong side, wrong site, wrong procedure, and wrong implant. The algorithm used to categorize events must be followed in order, to correctly assign a category (Figure 1). Each event was categorized as only 1 type of event.
Adverse events reported within the VHA are rated by the patient safety manager for actual and potential harm using 2 criteria: harm (catastrophic to minor) and probability (frequent to remote). Harm and probability are combined for a score from 1 to 3 called the Safety Assessment Code (SAC), developed by the VHA to help staff prioritize adverse events and close calls11,14: 1 represents the lowest priority and 3 the highest priority. Events coded as an actual SAC 3 were analyzed with an RCA. Events coded as SAC 1 or 2 may receive an RCA if the facility chooses to do so but do require submission as a safety report.
The VHA required implementation of its initial directive, “Ensuring Correct Surgery and Invasive Procedures,” in January 2003. The VHA held nationwide briefings with Patient Safety and Quality Management staff about the directive and sent educational resources to all VHA medical centers.20 This directive was updated and reissued in mid-2004 to include invasive procedures not conducted in the OR,9 concurrent with the requirement to implement the Joint Commission's Universal Protocol for Preventing Wrong Site, Wrong Procedure, Wrong Person Surgery.19
We described characteristics of the events and used χ2 analysis to identify relationships between SAC scores, which, for analysis, were categorized as having medium or high harm or not, and other variables, such as specialty and type of adverse events, which were categorized as occurring or not occurring. We used analysis of variance to analyze mean differences in SAC scores over time. The dependent variable was SAC score, and the independent variable was time period. We used 3 time periods for analysis:
Before January 2003, or before the VHA directive “Ensuring Correct Surgery” was issued.
From January 1, 2003, to June 30, 2004, or when the VHA directive was in effect but there was no Joint Commission requirement and the directive was for OR cases only.
From July 1, 2004, to June 30, 2006, or after the VHA directive9 was rewritten to include procedures performed outside the OR and the Joint Commission Universal Protocol for Preventing Wrong Site, Wrong Procedure, Wrong Person Surgery was effective.19
We calculated a reported adverse event rate for the top 7 categories of OR reported adverse events. We placed the number of reported adverse events over the number of surgical cases for that specialty and multiplied this by 10 000 for a rate of reported adverse events per 10 000 cases. Reported adverse events were for 5½ years (January 1, 2001, to June 30, 2006) and the number of surgical cases was for 6 years (October 1, 2000, to September 30, 2006), so we multiplied the first and last year of fiscal year data on surgical cases by 0.75 to account for this time difference.
We received and analyzed 342 reports of surgical events: 212 actual adverse events (62.0%) and 130 close calls (38.0%). One hundred eight reported adverse events (50.9%) occurred in the OR, and 104 reported adverse events (49.1%) occurred elsewhere. Table 1 displays cases by category. Table 2 displays reported adverse events by specialty and event type. For reported adverse events only, ophthalmology and invasive radiology had the most reports, 45 each (21.2%). Figure 2 displays major root cause categories. The analysis of root causes revealed 672 total root causes, 76 (11.3%) of which were not discernible by our coders. Consequently, information is provided for 596 root causes (88.7%). The top root cause was communication problems (21.0%) and included examples such as informed consent issues and problematic communication of critical information between team members, such as handoffs between staff members in which information was missing. Root causes related to time-out problems (17.6%) included issues such as the patient was not properly identified during the time-out.
Ophthalmology had 1.8 reported adverse events for every 10 000 cases, whereas orthopedics had 1.2 reported adverse events per every 10 000 cases. None of the other top 7 specialties of OR adverse events had at least 1 adverse event per 10 000 cases. Data on reported adverse events came from the study database, and events were categorized into specialties by the research team. Data on the percentage of surgical cases were retrievedfrom the VHA Computerized Patient Record System “surgery package,” and not from the research team. Figure 3 displays reported adverse events by body segment and location. Figure 4 displays reported adverse event types and location. The 2 most commonly reported adverse events were wrong side (66 [31.1%]) and wrong patient (56 [26.4%]). Figure 5 displays the rate of reports per month for adverse events and close calls for the 3 time periods by location.
Most events (65%) were actual SAC 1, 23% were SAC 2, and 12% were actual SAC 3.1 Pulmonary medicine cases (such as wrong-side thoracentesis) (χ21, 12.45; P <.01) and wrong-site cases (such as wrong spinal level) (χ21, 4.81; P = .03) were associated with the most harm.
Analysis of variance of the mean actual SAC score for reported events across the 3 time points revealed significant change over time (F, 9.174; P ≤.01); mean SAC scores initially decreased then increased again after the updated directive.
This study reviewed 342 surgical events involving the wrong side, patient, implant, site, or procedure. The reported adverse events were almost evenly split between those occurring inside and outside the OR (108 and 104, respectively).
For reported adverse events by specialty, ophthalmology and invasive radiology had the most reports, 45 each (21.2%). When examining solely OR reported adverse events, ophthalmology exhibited the highest percentage of reports followed by orthopedics, even though these 2 specialties did not have the highest percentage of OR cases. Wrong implant was the category with the most reported adverse events for ophthalmology and orthopedics (48.9% and 46.2%, respectively), but the aspect varied. Ophthalmology events typically included a lens mix-up; for orthopedics, the event was often the unpleasant surprise that the desired-size implant was not available in the OR or elsewhere in the hospital. In a recent study, others found that wrong-lens implants constituted the highest percentage of “surgical confusions” in ophthalmologic cases.21 Preoperative briefings, including those specifying implant and assuring availability, could help with this problem. Briefings are part of the VHA Medical Team Training program.22
We need to work proactively to prevent incorrect surgical procedures; waiting until moments before “takeoff” (such as during the final time-out19) may, at times, be too late to correct the problem. This is consistent with the findings of Clarke et al.7 At moments before incision, the team may have already fixed in their mind the surgical procedure to be performed, and other factors (positioning, consent, OR schedule) may contribute to health care providers believing they are about to correctly perform the procedure.23 We propose communicating more clearly and earlier when preparing for surgical and invasive procedures. The VHA Medical Team Training program22 also promotes this kind of communication, and many facilities incorporate the patient into the preoperative briefing. This is also consistent with the findings of Clarke et al,7 that the patient and the nurse provide an effective defense against surgical adverse events.
It is clear that incorrect surgical events can occur in virtually any specialty where invasive procedures are performed and that all parts of the anatomy are vulnerable to adverse events; therefore, it is difficult to predict when and where these events will occur. It is also difficult to predict these events because our knowledge of surgical adverse events depends on reporting, which may not represent the true rate.
Our data regarding the number of adverse surgical events required those working in the surgical setting to report incidents to the hospital patient safety manager, and the patient safety manager to report them to the VHA National Center for Patient Safety. Although there have been more than 400 000 reports of all types of adverse events and close calls to the VHA National Center for Patient Safety, we know that not all incidents are reported. Therefore, it is difficult to determine whether the differences seen in adverse events by specialty or over time are owing to variability in the degree of reporting by specialty or during different time periods. It is also important to note that this study includes reports up to mid-2006; we plan to conduct a follow-up report with recent data that will reflect additional interventions and changes to our system.
Most reported events caused minor or no injury. However, pulmonary medicine cases and wrong-site cases were more likely to be related to harm. In 2 cases, patients with poor pulmonary reserve had wrong-sided thorocentesis, resulting in acute cardiopulmonary deterioration.
The cases described in this study were limited to those reported. We know our data did not encompass all incorrect surgical adverse events in the VHA because that would require 100% reporting of adverse events and close calls, which has not been achieved. It is also possible that non-OR events were even more likely to be underreported because they may have been less obvious. We believe that reports that describe the most harmful events more closely approximate the true incidence than those describing less harmful events, but we cannot be certain. Second, results are descriptive. Third, we were limited by the information contained in the RCAs and safety reports. Although some reports were detailed, others lacked the depth necessary for a detailed analysis. These reports are deliberately deidentified to protect patient and reporter confidentiality. Therefore, we could not describe patient demographic characteristics. Despite these limitations we believe this analysis of a large, detailed data set of reports is a reasonable description of the current situation and can provide insights for those inside and outside the VHA who seek to prevent incorrect surgical adverse events.
Adverse events and close calls related to surgical procedures continue to occur. In the VHA, reports of adverse events from OR and non-OR settings have been roughly equal. This indicates that events reported in non-OR settings may have been underappreciated in previous studies.
Time-out procedures alone have not been enough to prevent incorrect surgical and invasive procedures.5,7 We advocate earlier improved communication based on crew resource management principles.22 Through this initial analysis, we examined event types and specialties facing the biggest challenges, based on reported data. Ophthalmology, orthopedics, pulmonary medicine, and invasive radiology cases (with particular attention to issues involving correct implant and patient verification) represent areas of highest utility for corrective actions. It is important to recognize that surgical adverse events were reported for numerous specialties and in non-OR settings. We will continue to promote early and effective communication to prevent surgical and invasive adverse events.
Correspondence: Julia Neily, RN, MS, MPH, Veterans Health Administration, 215 N Main St, White River Junction, VT 05009 (julia.neily@va.gov).
Accepted for Publication: October 15, 2008.
Author Contributions: Ms Neily and Drs Mills, DePalma, and Bagian had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Neily, Eldridge, Dunn, and Bagian. Acquisition of data: Eldridge, Dunn, Samples, and Turner. Analysis and interpretation of data: Neily, Mills, Eldridge, Dunn, Samples, Turner, Revere, and DePalma.Drafting of the manuscript: Neily, Mills, Revere, and DePalma. Critical revision of the manuscript for important intellectual content: Neily, Eldridge, Dunn, Samples, Turner, DePalma, and Bagian. Statistical analysis: Mills, Eldridge, Dunn, and Turner. Administrative, technical, and material support: Neily, Eldridge, Dunn, Turner, Revere, and DePalma. Study supervision: Neily and Bagian.
Financial Disclosure: None reported.
Funding/Support: This material is the result of work supported with resources and the use of facilities at the Department of Veterans Affairs National Center for Patient Safety at Ann Arbor, Michigan, and the Veterans Affairs Medical Center, White River Junction, Vermont, and the Department of Veterans Affairs Central Office, Washington, DC.
Disclaimer: The views expressed in this article do not necessarily represent the views of the Department of Veterans Affairs or of the US government.
1.Kwaan
MRStuddert
DMZinner
MJGawande
AA Incidence, patterns, and prevention of wrong-site surgery.
Arch Surg 2006;141
(4)
353- 358
PubMedGoogle ScholarCrossref 2.Seiden
SCBarach
P Wrong-side/wrong-site, wrong-procedures, and wrong-patient adverse events: are they preventable?
Arch Surg 2006;141
(9)
931- 939
PubMedGoogle ScholarCrossref 11.Bagian
JP Patient safety: what is really at issue?
Front Health Serv Manage 2005;22
(1)
3- 16
PubMedGoogle Scholar 14.Bagian
JPLee
CGosbee
J
et al. Developing and deploying a patient safety program in a large health care delivery system: you can't fix what you don't know about.
Jt Comm J Qual Improv 2001;27
(10)
522- 532
PubMedGoogle Scholar 17.Khuri
SFDaley
JHenderson
W
et al. National VA Surgical Quality Improvement Program, The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care.
Ann Surg 1998;228
(4)
491- 507
PubMedGoogle ScholarCrossref 22.Dunn
EJMills
PDNeily
JCrittenden
MDCarmack
ALBagian
JP Medical team training: applying crew resource management in the Veterans Health Administration.
Jt Comm J Qual Patient Saf 2007;33
(6)
317- 325
PubMedGoogle Scholar 23.Reason
J Safety in the operating theatre, part 2: human error and organisational failure.
Qual Saf Health Care 2005;14
(1)
56- 60
PubMedGoogle ScholarCrossref