eTable 1. Examples of Standard, Intermediate, and Complex Procedures in the VA Surgical Complexity Matrix
eTable 2. Clinical Characteristics of Heart Failure Patients
eTable 3. Odds Ratios of 90-Day Post-Operative Mortality between Heart Failure and Non-Heart Failure Patients by Presence of Active Signs or Symptoms and Left Ventricular Ejection Fraction
eTable 4. Odds Ratios of 30-Day Post-Operative Mortality between Heart Failure and Non-Heart Failure Patients with Subset Analyses by Systolic Function and Presence of Symptoms
eTable 5. Odds Ratios of 1-Year Post-Operative Mortality between Heart Failure and Non-Heart Failure Patients with Subset Analyses by Systolic Function and Presence of Symptoms
eTable 6. 30-Day Post-Operative Complication Rates In Patients with and Without Heart Failure
eTable 7. Average Length of Stay Between Heart Failure and Non-Heart Failure Patients Among Inpatient Surgeries
eTable 8. Complete Case Sensitivity Analysis—Adjusted Odds Ratios and Risk Differences of 90-Day Post-Operative Mortality between Patients with and without Heart Failure
eTable 9. Propensity-Adjusted Sensitivity Analysis—Adjusted Odds Ratios and Risk Differences of 90-Day Post-Operative Mortality between Patients with and without Heart Failure
eTable 10. E-Values for Heart Failure and 90-Day Post-Operative Mortality with Selected Sub-Populations
eTable 11. Adjusted Odds Ratios for the Independent Association with 90-Day Post-Operative Mortality of Selected Additional Covariates Included in Table 2, Model 3
Customize your JAMA Network experience by selecting one or more topics from the list below.
Lerman BJ, Popat RA, Assimes TL, Heidenreich PA, Wren SM. Association of Left Ventricular Ejection Fraction and Symptoms With Mortality After Elective Noncardiac Surgery Among Patients With Heart Failure. JAMA. 2019;321(6):572–579. doi:10.1001/jama.2019.0156
What is the association between severity of heart failure and risk of postoperative mortality?
In this retrospective cohort study that included 609 735 patients undergoing noncardiac surgery, crude 90-day mortality for patients with heart failure and symptoms was 10.1%; for patients with heart failure and no symptoms, 4.9%; and for patients without heart failure, 1.2%. The adjusted differences between either group of patients with heart failure and those without heart failure were statistically significant.
Heart failure with or without symptoms was associated with increased risk of 90-day postoperative mortality.
Heart failure is an established risk factor for postoperative mortality, but how left ventricular ejection fraction and heart failure symptoms affect surgical outcomes is not fully described.
To determine the risk of postoperative mortality among patients with heart failure at various levels of echocardiographic (left ventricular systolic dysfunction) and clinical (symptoms) severity compared with those without heart failure and to evaluate how risk varies across levels of surgical complexity.
Design, Setting, and Participants
US multisite retrospective cohort study of all adult patients receiving elective, noncardiac surgery in the Veterans Affairs Surgical Quality Improvement Project database from 2009 through 2016. A total of 609 735 patient records were identified and analyzed with 1 year of follow-up after having surgery (final study follow-up: September 1, 2017).
Heart failure, left ventricular ejection fraction, and presence of signs or symptoms of heart failure within 30 days of surgery.
Main Outcome and Measure
The primary outcome was postoperative mortality at 90 days.
Outcome data from 47 997 patients with heart failure (7.9%; mean [SD] age, 68.6 [10.1] years; 1391 women [2.9%]) and 561 738 patients without heart failure (92.1%; mean [SD] age, 59.4 [13.4] years; 50 862 women [9.1%]) were analyzed. Compared with patients without heart failure, those with heart failure had a higher risk of 90-day postoperative mortality (2635 vs 6881 90-day deaths; crude mortality risk, 5.49% vs 1.22%; adjusted absolute risk difference [RD], 1.03% [95% CI, 0.91%-1.15%]; adjusted odds ratio [OR], 1.67 [95% CI, 1.57-1.76]). Compared with patients without heart failure, symptomatic patients with heart failure (n = 5906) had a higher risk (597 deaths [10.11%]; adjusted absolute RD, 2.37% [95% CI, 2.06%-2.57%]; adjusted OR, 2.37 [95% CI, 2.14-2.63]). Asymptomatic patients with heart failure (n = 42 091) (2038 deaths [crude risk, 4.84%]; adjusted absolute RD, 0.74% [95% CI, 0.63%-0.87%]; adjusted OR, 1.53 [95% CI, 1.44-1.63]), including the subset with preserved left ventricular systolic function (1144 deaths [4.42%]; adjusted absolute RD, 0.66% [95% CI, 0.54%-0.79%]; adjusted OR, 1.46 [95% CI, 1.35-1.57]), also experienced elevated risk.
Conclusions and Relevance
Among patients undergoing elective noncardiac surgery, heart failure with or without symptoms was significantly associated with 90-day postoperative mortality. These data may be helpful in preoperative discussions with patients with heart failure undergoing noncardiac surgery.
Heart failure results from inadequate cardiac output and can be associated with symptoms of dyspnea, edema, and fatigue. These symptoms may or may not be present and, more recently, attention has been drawn to 2 major subtypes of symptomatic heart failure: reduced ejection fraction heart failure and preserved ejection fraction heart failure. Heart failure has been long recognized as a risk factor for postoperative mortality.1,2 However, most prior studies examining the relationship between heart failure and postoperative mortality have not accounted for the various subtypes of this disease. Because of heart failure’s importance as a risk factor for adverse surgical outcomes, it is common to include heart failure in operative risk prediction models, but most of these models were developed without accounting for the different subtypes of heart failure.1,3-7
Both left ventricular ejection fraction (LVEF) and the presence of heart failure symptoms are associated with long-term mortality rates in patients with heart failure, but the degree to which these factors influence postoperative risk is not fully described.8-10 Previous studies evaluating the association between LVEF or symptoms and postoperative mortality were too small to fully describe the effects of LVEF or had focused on individual subpopulations of patients with heart failure, which limited their generalizability to the overall heart failure population.11-13 Furthermore, much of the literature relied on a clinical definition of heart failure, which only captured patients with signs or symptoms of heart failure. This excludes assessment of asymptomatic patients who may also have an increased risk of postoperative mortality. The purpose of this study was to determine the postoperative mortality risk of symptomatic and asymptomatic patients with heart failure, with and without preserved ejection fraction, compared with patients without heart failure.
This study was approved by the Stanford University Institutional Review Board (No. 42246) and Department of Veterans Affairs (RDIS No. WRE0013), and a waiver of informed consent was obtained. Two national Veterans Affairs (VA) databases were used to assemble the cohort. One was data obtained by the VA Surgical Quality Improvement Program (VASQIP), which has trained data extractors who sample a fraction of cases at individual facilities and enter detailed clinical information into a centralized database.14,15 For information not available from VASQIP, the VA Corporate Data Warehouse (CDW) was used, which extracts data directly from the VA electronic medical records system. Medical comorbidities for each participant were extracted from VASQIP (hypertension, stroke, chronic obstructive pulmonary disease, peripheral vascular disease, disseminated cancer) and from CDW diagnostic codes (atrial fibrillation, diabetes mellitus, asthma, aortic stenosis, mitral regurgitation, pulmonary hypertension). Left ventricular ejection fraction was obtained from echocardiogram reports using a previously validated natural language processing algorithm.16,17 Follow-up data were available for each participant for a minimum of 1 year.
All VASQIP-sampled procedures from fiscal years 2009 through 2016 were eligible for inclusion, with the final date of follow-up September 1, 2017. Cardiac procedures, emergent procedures, and nonsurgical procedures (ie, bronchoscopy, endoscopy) were excluded. All patients undergoing multiple eligible procedures within the study period contributed only their index procedure.
The classification of heart failure by diagnostic codes in the VA health care system is highly specific (>95%) and has good sensitivity (75%-90%).18-21 Patients were classified as having heart failure if they had at least 1 inpatient admission or at least 2 outpatient clinic visits with a diagnosis of heart failure by an International Classification of Diseases (ICD) code within 3 years of surgery.22 These criteria properly excluded patients with a single outpatient visit for whom heart failure was excluded following evaluation. Patients with heart failure were further subdivided by LVEF (if an echocardiogram within 5 years of surgery was available) and presence of heart failure signs and symptoms. The following established cutoffs were used for LVEF: preserved, 50% or more; mildly reduced, 40% through 49%; moderately reduced, 30% through 39%; and severely reduced, less than 30%.23 Patients were classified as having symptomatic heart failure by the American College of Surgeons–NSQIP definition: newly diagnosed or chronic heart failure with signs or symptoms in the 30 days prior to surgery.24
Procedures were classified by the VA Surgical Complexity Matrix, which the VA health care system uses to determine which facilities can safely perform certain surgical procedures.25,26 This system assigned a complexity level (standard, intermediate, or complex) to every Current Procedural Terminology code based on intraoperative and postoperative risk inherent to the procedure (eTable 1 in the Supplement). Surgical complexity was included as a covariate in the final multivariable models.
The primary outcome of this study was all-cause, 90-day, postoperative mortality. Secondary outcomes were 30-day and 1-year postoperative mortality. Post hoc analyses of 30-day postoperative complications (any), 30-day postoperative cardiac arrest, 30-day postoperative myocardial infarction, 30-day postoperative stroke, and a 72-hour postoperative bleeding event (defined as transfusion for any reason of >4 U of packed red blood cells or whole blood after the patient has left the operating room) were also conducted. Date of death was determined via Social Security Administration Death Master Files.
Demographic and clinical characteristics of patients with and without heart failure were compared with χ2 tests for categorical variables and unpaired t tests for continuous variables. Odds ratios (ORs) were generated using simple or multivariable logistic regression, and 95% confidence intervals computed with the Wald χ2. Potential confounders were assessed based on a priori knowledge and the literature.6,27 The following factors were considered: sex, race/ethnicity, age, body mass index, smoking, alcohol use, hypertension, atrial fibrillation, diabetes mellitus, coronary artery disease, history of stroke, asthma, chronic obstructive pulmonary disease, peripheral vascular disease, disseminated cancer, surgical complexity level, American Society of Anesthesiologists (ASA) class,28 aortic stenosis, mitral regurgitation, pulmonary hypertension, VA facility, and preoperative creatinine and preoperative hematocrit levels. Covariates were screened by individual addition to the univariable model, and those that altered the exposure estimate by 10% or more were included in the final model.
Race/ethnicity is associated with long-term survival in patients with heart failure and was thus included as a covariate.29 Race/ethnicity classification was determined by the participant and was based on a fixed-categories questionnaire.
The final analysis consisted of 3 multivariable mixed-effects logistic regression models with random intercepts to account for clustering by VA facility. The models adjusted for all other variables as fixed effects in an identical fashion to a traditional multivariable logistic regression model.30 Each model used patients without heart failure as the reference group but organized patients with heart failure using a different, preplanned classification scheme. The first model compared the postoperative mortality risk of all patients with and without heart failure. The second model classified patients with heart failure (the primary exposure) by their left ventricular ejection fraction (4 levels). The third model classified patients with heart failure by the presence of heart failure symptoms (2 levels). Propensity score-adjusted models were also built as a sensitivity analysis. Propensity scores for heart failure for each participant were built using the predicted probabilities resulting from a multivariable logistic regression model with heart failure as the outcome and all identified potential confounders identified (as described above) as variables in the model. As a sensitivity analysis to assess the potential influence of unmeasured confounders on the analysis, E-values were calculated.31 The E-value represents the minimum magnitude of association required between an unmeasured confounder and both the exposure and outcome, conditional on measured covariates, to fully attenuate the observed exposure-outcome relationship.31 An E-value was calculated for the observed overall heart failure postoperative mortality association using a publicly available online calculator.32
Stratified analyses were also conducted by surgical complexity level, and interactions were tested between the primary exposure (heart failure, yes or no) and the level of complexity of the surgery performed (standard, intermediate, or complex). P for interaction was calculated using the likelihood ratio test. All ORs and absolute risk differences (RDs) presented are adjusted unless explicitly identified as crude. Average adjusted predicted probabilities for each group were calculated using the above regression models, and adjusted absolute RDs between the exposed and unexposed groups were then calculated. Adjusted attributable risk fraction was calculated by the following formula: (adjusted OR –1)/(adjusted OR). Relevant P values for trend were calculated with the Wald χ2 after converting the categorical LVEF or symptom variables into a continuous variable.
Post hoc analyses of the association between heart failure and postoperative complications were conducted using multivariable logistic regression, and post hoc analysis of the association between heart failure and postoperative length of stay were conducted using multivariable linear regression adjusted for the confounders identified as above.
The proportion of missing nonlaboratory, nonimaging covariates was less than 1%. Missing observations were excluded from the analysis. Missing preoperative laboratory values (missing at 6%-7%) were imputed with a single conditional imputation approach using age- and sex-adjusted norms. Left ventricular ejection fraction, as measured by echocardiogram, was missing in 2.9% of patients with heart failure, and patients with missing LVEF were excluded from subset analyses pertaining to left ventricular systolic function.
Based on the sample size of the cohort included in this analysis (n = 609 735, 7.9% heart failure) this study had 99.9% power to detect ORs of more than 1.5 for the heart failure and postoperative mortality association at α = .05.3,12 SAS version 9.4 (SAS Institute Inc) was used for all analyses. All tests with 2-sided P values <.05 were considered statistically significant.
Of the 609 735 patients in this cohort, 47 997 (7.9%) had a clinical history of heart failure (Table 1). Patients with heart failure were more likely to be men (97.1% vs 91.0%), white (67.6% vs 64.5%), obese (44.4% vs 38.7%), and older (69 vs 59 years); had higher rates of medical comorbidities; and had higher ASA scores (mean, 3.3 vs 2.7) than patients without heart failure. At the time of surgery, patients with heart failure had higher creatinine levels (median, 1.10 mg/dL vs 0.97 mg/dL) and lower hematocrit levels (mean, 38.1% vs 41.6%). (To convert creatinine from mg/dL to μmol/L, multiply by 88.4.)
Left ventricular ejection fraction data were available for 97.1% of patients with heart failure (eTable 2 in the Supplement). A total of 28 742 patients (59.9%) had documented preserved systolic function (LVEF, ≥50%). Of these, 2851 (9.9%) had symptoms and 25 891 (90.1%) did not. A total of 7612 patients (15.9%) had mildly reduced systolic function (LVEF, 40%-49%; 1033 [13.6%] with symptoms, 6579 [86.4%] without symptoms), 6048 patients (12.6%) had moderately reduced systolic function (LVEF, 30%-39%; 1034 [17.1%] with symptoms, 5014 [82.9%] without symptoms), and 4185 patients (8.7%) had severely reduced systolic function (LVEF, <30%; 872 [20.8%] with symptoms, 3313 [79.2%] without symptoms). Echocardiograms were not available for 1410 patients (2.9%).
Review of pharmacy records suggested optimal medical management for the majority of patients with heart failure, with 91.7% receiving a β-blocker and 92.3% receiving an angiotensin-converting enzyme (ACE) inhibitor (eTable 2 in the Supplement). Of patients with heart failure, 34.6% received a potassium-sparing diuretic.
Patients with heart failure underwent more complex procedures than patients without heart failure (Table 1). Procedures performed on patients with heart failure were divided between standard (52.8%) and intermediate or complex (47.2%) levels, whereas patients without heart failure more commonly received standard level of complex procedures (60.8% standard, 39.2% intermediate or complex; P < .001). Patients with heart failure also underwent more inpatient procedures than those without heart failure (59.3% vs 40.0%; P < .001).
The crude 90-day postoperative mortality risk among patients with a history of heart failure was 5.49% (2635 90-day deaths) compared with 1.22% (6881 90-day deaths) among patients without heart failure. Heart failure was significantly associated with postoperative mortality after multivariable adjustment for clinical, demographic, and surgical factors (adjusted absolute RD, 1.03%; 95% CI, 0.91-1.15; adjusted OR, 1.67; 95% CI, 1.57-1.76; Table 2). The risk of postoperative mortality progressively increased with decreasing systolic function (P for trend <.001), with all ejection fraction groups having a higher risk of postoperative mortality than patients without heart failure. Compared with patients without heart failure, patients who had either asymptomatic (2038 deaths [4.84%]; adjusted absolute RD, 0.74%; 95% CI, 0.63%-0.87%; adjusted OR, 1.53; 95% CI, 1.44-1.63) or symptomatic (597 deaths [10.11%]; adjusted absolute RD, 2.37%, 95% CI, 2.06%-2.57%; adjusted OR, 2.37; 95% CI, 2.14-2.63) heart failure had a higher risk of postoperative mortality. The E-value sensitivity analysis for unmeasured confounding was calculated for the adjusted OR for patients with symptomatic heart failure (eTable 10 in the Supplement). The adjusted OR point estimate of 2.37 for the risk of postoperative mortality associated with symptomatic heart failure corresponds to an E-value of 4.17, and for the confidence interval value closest to the null, 2.14, the E-value was 3.70.
All patients with a history of heart failure, regardless of systolic function or presence of heart failure symptoms, had a higher risk of postoperative mortality compared with patients without heart failure (eTable 3 in the Supplement). Patients with a history of heart failure, without symptoms and with preserved LVEF (n = 25 891) had a crude 90-day post-operative mortality risk of 4.42% (adjusted absolute RD, 0.66%; 95% CI, 0.54%-0.79%; adjusted OR, 1.46, 95% CI, 1.35-1.57) and patients with heart failure, symptoms of heart failure, and severely reduced LVEF (n = 872) experienced a crude risk of 14.91% (adjusted absolute RD, 5.87%; 95% CI, 5.30%-6.44%; OR, 3.67; 95% CI, 2.98-4.52).
The association between heart failure and postoperative mortality was similar at 30-day, 90-day, and 1-year time points (eTables 4 and 5 in the Supplement).
Both crude mortality risks and the heart failure-mortality association differed significantly between levels of surgical complexity (P < .001 for the surgical complexity × heart failure interaction, Table 3). The crude 90-day postoperative mortality for patients with heart failure increased from 4.62% for standard complexity operations to 10.34% for complex procedures. For patients without heart failure, crude 90-day postoperative mortality increased from 0.66% to 6.19% (from standard to complex procedures). The adjusted absolute RD between patients with and without heart failure was 1.29% (95% CI, 1.22%-1.37%) for standard procedures, 1.69% (95% CI, 1.48%-1.94%) for intermediate procedures, and 1.80% (95% CI, 0.08%-3.60%) for complex procedures.
The attributable risk fraction of heart failure on 90-day postoperative mortality was highest among patients undergoing standard procedures (48%) and lowest among patients undergoing complex procedures (15%).
In a post hoc secondary analysis, patients with heart failure had a higher risk of postoperative complications (including cardiac arrest and major bleed) and longer length of stay than patients without heart failure (eTables 6 and 7 in the Supplement).
A sensitivity analysis replacing imputation of missing laboratory values with a complete case analysis did not significantly change the results (eTable 8 in the Supplement), nor did a propensity score-adjusted sensitivity analysis (eTable 9 in the Supplement).
In this retrospective cohort study of more than 600 000 veterans, patients with heart failure, including both those with symptoms and those with no symptoms and preserved systolic function, had a higher risk of 90-day postoperative mortality than did patients without heart failure.
Heart failure is an important marker for having a high risk of postoperative mortality. In general, symptomatic patients had a higher risk than did asymptomatic patients. Low ejection fraction was associated with greater postoperative mortality with the mortality risk increasing as the ejection fraction decreased. Multivariable regression greatly attenuated the apparent risk of heart failure on postoperative mortality suggesting that heart failure is a marker for a constellation of comorbidities that patients with heart failure tend to have, all of which contribute to the elevated risk. Heart failure itself has a relatively small effect as an independent risk factor of postoperative mortality.
One interpretation of these findings is that patients with heart failure, especially those with symptoms or very low ejection fractions, should be counseled regarding their higher risk of postoperative surgical mortality. Although optimizing their cardiac function should be pursued, all other associated modifiable risk factors that might contribute to postoperative mortality should also be optimized since heart failure by itself has a relatively small association with mortality.
A previous study of 174 patients11 showed that left ventricular systolic dysfunction was associated with greater postoperative mortality beyond the baseline risk associated with heart failure alone. However, this association was only observed for severely reduced LVEF (<30%). The current study, which was much larger, was able to demonstrate that the risk of postoperative mortality progressively increased with decreasing systolic function. Preoperative evaluation of a patient’s ejection fraction may be useful in decision-making for all patients with heart failure, not only those with severely reduced LVEF or heart failure symptoms. Left ventricular systolic dysfunction may also be useful if included in surgical risk prediction models, especially when evaluating asymptomatic patients.
Patients with heart failure in this study underwent more intermediate- and complex-level procedures and fewer standard-level procedures than those without heart failure. This pattern might be explained by 2 factors. First, the patients with heart failure were generally older and had more medical comorbidities than the patients without heart failure. These patients may have required more complex procedures (such as pancreaticoduodenectomy or kidney transplant) to address their comorbid conditions (such as cancer or renal failure). Fewer standard-level procedures were performed on patients with heart failure, and this may result from reluctance among clinicians to pursue surgery because of the risks associated with heart failure. Given the known risks of noncardiac surgery for patients with heart failure, clinicians may have recommended against simple, standard-level procedures that were more likely to be truly elective, such as a hernia, or treatable with nonsurgical options, such as an uncomplicated appendectomy, than an intermediate- or complex-level procedure, such as a colectomy or an esophagectomy.
Various perioperative factors may have contributed to the higher postoperative mortality observed for patients with heart failure even in low-complexity procedures. There may be risk associated with general anesthesia among patients with heart failure attributable to intraoperative or postoperative hypotension independent of surgical complexity level. With heart failure, even minor postoperative complications may be poorly tolerated reducing long-term survival.33
This study had several limitations. First, by the nature of the inclusion criteria, all patients in this study were deemed “fit for surgery” by a physician. Data about patients who were considered for but did not receive surgery were not available, potentially resulting in selection bias and limiting the generalizability of this study’s findings. Second, this analysis was not able to compare baseline mortality rates not attributable to surgery because all patients in this study received surgery. It is especially important in this patient population to acknowledge that immediate postoperative issues and complications affect long-term survival beyond the perioperative period.33
Third, as with any observational study, there is a risk of unmeasured confounding factors that may, if accounted for, negate the apparent contribution of heart failure as an independent risk factor for postoperative mortality. E-values were calculated as a sensitivity analysis to determine the likelihood that an unmeasured confounder could exist that would negate the observed relationship between heart failure and postoperative mortality. This seems unlikely because the range of point estimates for the ORs for all the known risk factors available in the data extended from 0.96 to 1.53 (eTable 11 in the Supplement). The E-values for the confidence intervals closest to the null for the adjusted ORs for the association between heart failure (overall), the presence of heart failure symptoms, and ejection fraction ranged from 2.04 to 3.70 (eTable 10 in the Supplement). An unmeasured confounder would necessarily have an OR exceeding these values, a possibility seemingly remote because the ORs for all measured, known risk factors for postoperative mortality fell short of the E-values found in eTable 10 in the Supplement.
Fourth, the generalizability of this study is limited because it was a VA population that was examined. There were relatively few women in the study cohort. However, although the percentage of women in this study was relatively small, the absolute number of female patients with heart failure included in this study was much larger than prior, similar studies.34
Among patients undergoing elective noncardiac surgery, heart failure with or without symptoms was significantly associated with 90-day postoperative mortality. These data may be helpful in preoperative discussions with patients with heart failure undergoing noncardiac surgery.
Accepted for Publication: January 10, 2019.
Corresponding Author: Sherry M. Wren, MD, Department of Surgery, Stanford University, G112 PAVAHCS, 3801 Miranda Ave, Palo Alto, CA 94304 (firstname.lastname@example.org).
Author Contributions: Mr Lerman and Dr Wren had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Lerman, Assimes, Heidenreich, Wren.
Acquisition, analysis, or interpretation of data: Lerman, Popat.
Drafting of the manuscript: Lerman.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Lerman, Popat.
Obtained funding: Lerman.
Administrative, technical, or material support: Assimes, Wren.
Supervision: Assimes, Wren.
Conflict of Interest Disclosures: None reported.
Funding/Support: Mr Lerman was supported by a National Institutes of Health, Center for Advancing Translational Science, Clinical and Translational Science Award (TL1TR001084 and UL1TR001085).
Role of the Funder/Sponsor: The sponsor had no role in the design and conduct of the study; management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication. The sponsor did not have the right to veto publication.
Disclaimer: The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the US government.
Additional Contributions: We thank Alexander Sox-Harris, PhD (Palo Alto Veterans Affairs Health Care System; Department of Surgery, Stanford School of Medicine), Laura Graham, PhD (Department of Surgery, Stanford School of Medicine), and Amber Trickey, PhD (Stanford Surgery Policy Improvement Research and Education Center) for contributions to the collection and management of the data and Robert Lerman, MD, for contributions to preparation and review of the manuscript. They did not receive compensation for their roles in the study.