End-of-life expenditure index (EOL-EI) ranges, in US dollars, are <$29 970 for the low EOL-EI category, $29 970-$34 965 for the medium EOL-EI category, and >$34 965 for the high EOL-EI category. AMI indicates acute myocardial infarction; CHF, congestive heart failure. Error bars indicate 95% confidence intervals.
End-of-life expenditure index (EOL-EI) ranges, in Canadian dollars, are <$30 000 (US $29 970) for the low EOL-EI category, $30 000 to $35 000 (US $29 970-$34 965) for the medium EOL-EI category, and >$35 000 (US $34 965) for the high EOL-EI category. AMI indicates acute myocardial infarction; CHF, congestive heart failure.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Stukel TA, Fisher ES, Alter DA, et al. Association of Hospital Spending Intensity With Mortality and Readmission Rates in Ontario Hospitals. JAMA. 2012;307(10):1037–1045. doi:10.1001/jama.2012.265
Author Affiliations: Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada (Drs Stukel, Alter, Guttmann, Ko, Wodchis, Baxter, Earle, and Lee and Ms Fung); Department of Health Policy, Management and Evaluation (Drs Stukel, Alter, Guttmann, Ko, Wodchis, and Baxter), Clinical Epidemiology Unit, Sunnybrook Health Sciences Centre (Dr Stukel), Division of Paediatric Medicine, Hospital for Sick Children (Dr Guttmann), and Division of Cardiology, Schulich Heart Centre, Sunnybrook Health Sciences Centre (Dr Ko), University of Toronto, Toronto; Center for Population Health, Dartmouth Institute for Health Policy and Clinical Practice and Dartmouth Medical School, Lebanon, New Hampshire (Drs Stukel and Fisher); Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto (Drs Alter and Baxter); Toronto Rehabilitation Institute, Toronto (Drs Alter and Wodchis); and University Health Network, Toronto General Hospital, Toronto (Dr Lee).
Context The extent to which better spending produces higher-quality care and better patient outcomes in a universal health care system with selective access to medical technology is unknown.
Objective To assess whether acute care patients admitted to higher-spending hospitals have lower mortality and readmissions.
Design, Setting, and Patients The study population comprised adults (>18 years) in Ontario, Canada, with a first admission for acute myocardial infarction (AMI) (n = 179 139), congestive heart failure (CHF) (n = 92 377), hip fracture (n = 90 046), or colon cancer (n = 26 195) during 1998-2008, with follow-up to 1 year. The exposure measure was the index hospital's end-of-life expenditure index for hospital, physician, and emergency department services.
Main Outcome Measures The primary outcomes were 30-day and 1-year mortality and readmissions and major cardiac events (readmissions for AMI, angina, CHF, or death) for AMI and CHF.
Results Patients' baseline health status was similar across hospital expenditure groups. Patients admitted to hospitals in the highest- vs lowest-spending intensity terciles had lower rates of all adverse outcomes. In the highest- vs lowest-spending hospitals, respectively, the age- and sex-adjusted 30-day mortality rate was 12.7% vs 12.8% for AMI, 10.2% vs 12.4% for CHF, 7.7% vs 9.7% for hip fracture, and 3.3% vs 3.9% for CHF; fully adjusted relative 30-day mortality rates were 0.93 (95% CI, 0.89-0.98) for AMI, 0.81 (95% CI, 0.76-0.86) for CHF, 0.74 (95% CI, 0.68-0.80) for hip fracture, and 0.78 (95% CI, 0.66-0.91) for colon cancer. Results for 1-year mortality, readmissions, and major cardiac events were similar. Higher-spending hospitals had higher nursing staff ratios, and their patients received more inpatient medical specialist visits, interventional (AMI cohort) and medical (AMI and CHF cohorts) cardiac therapies, preoperative specialty care (colon cancer cohort), and postdischarge collaborative care with a cardiologist and primary care physician (AMI and CHF cohorts).
Conclusion Among Ontario hospitals, higher spending intensity was associated with lower mortality, readmissions, and cardiac event rates.
Numerous studies have investigated whether higher health care spending produces better patient outcomes and higher quality of care. Evidence from the United States and other countries has been conflicting.1-12 Several studies focusing on short-term outcomes within a given state found that being treated in higher-spending hospitals was associated with better in-hospital3 or 30-day4,5 mortality. In contrast, a national study found that regional differences in spending intensity were largely attributable to use of the hospital as a site of care and greater overall use of specialists, imaging, and diagnostic testing but that patients treated in regions with higher spending intensity did not have better survival or quality of care.1,2 Whether these findings would hold true in a country with universal access to health care but a far lower supply of specialists and more selective access to medical technology is unknown.
Our objective was to assess whether acute care patients admitted to Canadian hospitals that treat patients more intensively (and at higher cost) have lower mortality and readmissions and higher quality of care.
We undertook a longitudinal cohort study of patients hospitalized with selected acute clinical conditions in Ontario, Canada, and assessed the content, quality, and outcomes with respect to “exposure” to the index hospital's medical spending intensity. Medical intensity is defined as the quantity of medical care provided overall to similarly ill patients and is a marker of a hospital's propensity to treat similarly ill patients more (or less) intensively. It reflects the component of spending variation attributable to practice style rather than to differences in illness or price.
Because sicker patients use more services, higher-spending hospitals may appear to have worse outcomes, in part because patients are more severely ill. We used several techniques to remove this potential “reverse causality,” as in previous work.1-4 First, we studied patients with selected acute conditions who were likely to present with similar mean illness severity, rather than all admissions, to remove differences in case mix across hospitals.1,2 Second, the exposure of interest was spending at the hospital level rather than the patient level to study the effects of exposure to a system of care; this also removed potential survival bias resulting from analyzing patient-level spending.13 Last, estimates of a hospital's spending intensity, the exposure variable, were based on individuals in their last year of life, a different group of patients, to further remove potential reverse causality between study cohort illness and spending1-4; hospital spending intensity for study patients was used as an exposure in a secondary analysis. The study was approved by the research ethics board of Sunnybrook Health Sciences Centre
We studied 4 common conditions that have moderate to high incidence and mortality, that can be validly ascertained using health administrative data, and for which treatment follows relatively standard protocols.
Study patients comprised Ontario residents hospitalized with first (index) admission for acute myocardial infarction (AMI) (n = 179 139), congestive heartfailure (CHF) (n = 92 377), hip fracture (n = 90 046), or colon cancer with surgical resection (n = 26 195)1,2,14 to Ontario acute care hospitals between April 1, 1998, and March 31, 2008, restricting to adults aged 18 to 105 years. To capture incident admissions, we excluded patients with AMI and hip fracture admitted for these conditions during the previous year and patients with CHF having a CHF admission in the previous 3 years. We included patients with a first diagnosis of colon cancer undergoing potentially curative resection within 6 months, excluding those who presented with metastatic cancer or who were diagnosed with any other cancer within the previous 5 years. We excluded patients with AMI having a stay of less than 3 days.
Patients were assigned to the cohort corresponding to their earliest admission and underwent follow-up for 1 year after the index admission date. We created an index episode of care beginning at initial admission and ending at the final discharge, incorporating transfers. To ensure stability of the hospital-specific measures, we restricted to 129 hospitals with more than 10 study condition admissions per year, resulting in exclusion of 27% of hospitals but only 3% of patients.
The primary exposure measure was the hospital end-of-life expenditure index (EOL-EI), calculated as the mean adjusted spending on hospital, emergency department (ED), and physician services provided to decedents in their last year of life, similar to previous work.1,2 Costs for hospital admissions and ED visits were based on standardized provincial prices and reflected resources used. Costs for physician services for inpatient and outpatient visits as well as diagnostic tests and procedures were based on the fees paid on the physician claims. Details on Ontario costing algorithms are provided in the eAppendix.
We first assigned all Ontario decedents during 1998-2008 to the study hospital where they had the most admissions during the last 2 years of life, as in previous work.1,2 Those who were not hospitalized or were primarily hospitalized to nonstudy hospitals were not assigned. Costs were computed for individuals and aggregated to the hospital level across all decedents assigned to the hospital. A hospital's EOL-EI was estimated as adjusted spending per capita for decedents assigned to that hospital and was indirectly adjusted for age and sex using the entire cohort as the standard. All spending was attributed to the assigned hospital even if the patient received services elsewhere, because this hospital and its associated medical staff was deemed to represent the “system” within which the patient received care.15
We also calculated each hospital's acute care expenditure index (AC-EI) as the mean adjusted spending for study patients admitted to that hospital for hospital, ED, and physician services during 1 year following date of admission. Costs were determined similarly to the above and reported as adjusted spending per capita for study patients admitted to each hospital.
Although EOL-EI measures hospital practice intensity at the end of life whereas AC-EI measures hospital practice intensity during acute illness, they were highly correlated (r = 0.81), implying that medical intensity, however measured, is a hospital “signature” and reflects the intensity of care provided to sick patients. EOL-EI was used as the primary exposure because it was considered a more exogenous measure of hospital intensity for several reasons. First, it was measured on a different group than the actual study cohort. Second, it was less related to underlying illness severity, because decedents were similarly ill in one respect: their life expectancy was identical. It would thus be more reflective of hospital resource capacity and physician practice style to all patients admitted to that hospital. We used EOL-EI as a “look-back” hospital intensity measure to look forward to assess outcomes in the study cohorts.
Study patients were assigned the EOL-EI and AC-EI expenditure indexes of their hospital of admission and categorized into approximate terciles of low, medium, and high intensity.
The primary outcomes were 30-day and 1-year mortality as well as 30-day and 1-year readmissions, a marker of general complications.16 For cardiac cohorts, we assessed major cardiac events, defined as readmission for AMI, CHF, or angina.17-19 Readmissions were analyzed as a combined outcome with mortality, because the factors causing mortality were likely an exacerbation of those causing readmission so that these events were not independent, making it inappropriate to censor for mortality.
The following quality measures were examined: preoperative visit with a surgeon and anesthetist (colon cancer cohort); surgery within 2 days of admission (hip fracture cohort),20 inpatient rehabilitation (hip fracture cohort), same-day percutaneous coronary intervention (PCI) (AMI cohort),18,19 and number of medical specialist visits during the index episode.21
The following procedures were examined among patients in the AMI and CHF cohorts who survived 30 days after admission: cardiac catheterization, coronary revascularization (coronary artery bypass graft surgery or PCI), prescriptions of angiotensin-converting enzyme inhibitors/angiotensin II receptor blockers and statins (patients 65 years or older in the AMI and CHF cohorts),17-19 and for CHF, prescription of β-blockers and contraindicated medications (nonsteroidal anti-inflammatory drugs or class I antiarrhythmics). We examined collaborative care, defined as an ambulatory visit with a primary care physician and a cardiologist within 4 weeks of discharge, and ambulatory visits with a cardiologist (AMI and CHF cohorts).22,23
Hospital volume was computed as mean number of cases admitted to the hospital per year over the study period, specific to each study condition.24-26 Attending physician volume was computed as mean number of cases per year based on claims for services rendered on the admission date, by condition.24
Patient records were linked using unique, anonymized, encrypted identifiers across multiple Ontario health administrative databases containing information on all publicly insured, medically necessary hospital and physician services. These databases included the Discharge Abstract Database for hospital admissions, intensive care unit admissions (after 2002), procedures, and transfers, which includes the most responsible diagnosis for length of stay, secondary diagnosis codes, comorbidities present at admission, complications occurring during the hospital stay, and attending physician identifier; the National Ambulatory Care Reporting System for ED visits; the Ontario Health Insurance Plan for physician billings, which includes diagnosis codes and procedures and location of visit; the Ontario Drug Benefits for outpatient drug prescriptions for patients 65 years or older; and the Registered Persons Database for patient demographic information and deaths. Nursing inpatient hours per weighted patient day and per acute care bed were obtained from the Canadian Management Information System27; we could not distinguish registered nurses from other nursing staff.
Cohort membership for AMI, CHF, and hip fracture was determined using the most responsible diagnosis. The colon cancer cohort was derived using the Ontario Cancer Registry and linked to Discharge Abstract Database records to determine colectomy. Comorbidities were identified using secondary Discharge Abstract Database diagnosis fields, excluding complications. Studies have confirmed the validity and reliability of Ontario's health administrative data.28,29International Classification of Diseases, Ninth Revision (before April 1, 2002) and International Classification of Diseases, 10th Revision–Canada (after April 1, 2002) diagnosis codes and the Canadian Classification of Procedures (before April 1, 2002) and Canadian Classification of Interventions (after April 1, 2002) procedure codes used in the study are reported in the eAppendix. Neighborhood income was derived from Statistics Canada census estimates from 2001 (1999-2003 cohorts) and 2006 (2004-2008 cohorts).
Models used patient as the unit of analysis and EOL-EI hospital expenditure categories as the primary exposure variable. This allowed us to control for individual risk factors and permitted inferences to individual patients, although exposures were measured at the hospital level. For each condition, we developed a baseline patient severity score by using logistic regression models to predict 30-day mortality, incorporating all baseline patient characteristics and comorbidities (C statistics, 0.74-0.79).2,14
Cox proportional hazards models were used to compare rates of mortality and readmissions across hospital expenditure categories. Models controlled for baseline patient characteristics, including age group (20-45, 46-64, 65-74, 75-84, ≥85 years), sex, and their interactions; neighborhood income quintiles; individual Charlson comorbidities at admission and during the previous 5 years; condition-specific hospital volume and teaching status; and year of admission. Cardiac models also controlled for condition-specific comorbidities at admission; history of AMI, coronary artery bypass graft surgery, or PCI in the previous 5 years (AMI cohort); and receipt of an implantable cardioverter-defibrillator or permanent pacemaker in the previous 5 years (CHF cohort).23,30 Each cohort was analyzed separately. To determine whether specific components of spending intensity explained the relationships, we added several hospital-level structural and process measures to the models, including attending physician volume, regional cancer center (colon cancer cohort), intensity of interventional (30-day cardiac catheterization rate) and medical (discharge statin prescribing rate) therapies (AMI and CHF cohorts),14 inpatient specialist visit rate, and nursing staff ratios.31
Patients admitted to the same hospital are likely to be treated similarly and have correlated outcomes. We used survival models that account for clustering of patients within hospitals by including a working correlation matrix to adjust the standard errors.32
Statistical tests were 2-sided and performed at the 5% level of significance. Analyses were performed using the STATA procedure STCOX.33
Adjusted spending intensity varied about 2-fold across hospitals. In Canadian dollars, EOL-EI ranged from $22 000 to $45 000 (US $21 978-$44 955) and AC-EI from $19 300 to $32 580 (US $19 281-$32 548) per capita per year. Although there were small differences in some risk factors, mean predicted 30-day mortality, the summary measure of baseline illness severity, was similar across hospital spending groups (Figure 1). The majority of the 1-year costs were incurred during the index hospital episode, varying from 42% for CHF to 64% to 72% for other conditions.
Higher-spending hospitals tended to be higher-volume teaching or community hospitals; be located in urban areas; be associated with regional cancer centers; have on-site computed tomography and magnetic resonance imaging scanners, cardiac catheterization laboratories, and cardiac surgery capability; and be early adopters of critical care response teams (Table 1). Attending physicians in these hospitals were more likely to be specialists or to care for a higher volume of patients with that condition. These hospitals provided 30% more inpatient nursing hours per weighted patient day and per acute care bed.
Table 2 reports selected therapies and procedures for each cohort, according to EOL-EI group, averaged over the 10-year period. Patients admitted to higher-spending hospitals had longer lengths of stay, were less likely to be admitted to an intensive care unit, and had more medical specialist visits during the index episode. Cardiac patients admitted to higher-spending hospitals were more likely to receive cardiac interventions and evidence-based discharge medications. They were also more likely to experience collaborative ambulatory care within 4 weeks and to visit a cardiologist within 1 year. Patients with CHF were less likely to receive contraindicated medications; those with hip fracture were more likely to receive inpatient rehabilitation; and those with colon cancer were more likely to have a preoperative consultation with a surgeon and anesthetist and to undergo computed tomography for preoperative staging.
In the highest- vs lowest-spending hospitals, respectively, the age- and sex-adjusted 30-day mortality rate was 12.7% vs 12.8% for AMI, 10.2% vs 12.4% for CHF, 7.7% vs 9.7% for hip fracture, and 3.3% vs 3.9% for colon cancer. The age- and sex-adjusted 30-day major cardiac event rate was 17.4% vs 18.7% for patients with AMI and 15.0% vs 17.6% for those with CHF. The age- and sex-adjusted 30-day readmission rate was 23.1% vs 25.8% for patients with hip fracture and 10.3% vs 13.1% for those with colon cancer. In higher-spending hospitals, age- and sex-adjusted mortality and readmission rates were lower for all cohorts (Table 3). After full adjustment, mortality and readmission rates were lower in higher-spending hospitals for all cohorts (Figure 2 and Figure 3). Although some of the hospital-level structural and process measures were significantly related to the outcomes, results were similar when adding these variables to the models. Findings were also similar using the “look-forward” hospital expenditure index (AC-EI) as the exposure measure (eAppendix). Results did not change when stratified by age group (younger than 65 years and 65 years or older), sex, and neighborhood income quintile or after excluding remote northern hospitals.
We found that higher hospital spending intensity was associated with better survival, lower readmission rates, and better quality of care for seriously ill, hospitalized patients in Ontario in a universal health care system with more selective access to medical technology. Higher-spending hospitals were higher-volume teaching or community hospitals with high-volume or specialist attending physicians and having specialized programs, such as regional cancer centers, and specialized services, such as on-site cardiac catheterization, cardiac surgery, and diagnostic imaging facilities. The study also points to plausible mechanisms through which higher spending may be associated with better outcomes.
Benefits appeared early, suggesting an acute-phase hospital effect. For acute conditions, timely access to preoperative and in-hospital specialist care, skilled nursing staff, rapid response teams, cardiac high-technology services, and regional cancer centers, all found in the higher-spending systems, are related to better outcomes.21,27,34-39 These systems also provided consistently, but not strikingly, higher levels of evidence-based care and collaborative ambulatory care, both shown to improve care.22,23,40 Higher spending on evidence-based services delivered in the acute phase of care for severely ill hospitalized patients—by far the largest component of spending for our cohorts—is indeed likely to be beneficial.
It would be facile to interpret this study as demonstrating that higher spending is causally related to better outcomes and that providing more money to lower-spending hospitals would necessarily improve their outcomes. Higher-spending hospitals differed in many ways, such as greater use of evidence-based care, skilled nursing and critical care staff, more intensive inpatient specialist services, and high technology, all of which are more expensive.
To place the study in context, the United States has a 3- to 4-times higher per capita supply of specialized technology, such as computed tomography and magnetic resonance imaging scanners, but a similar supply of acute care beds and nurses.41 Ontario 2001 population rates of cardiac testing and revascularization lagged behind corresponding 1992 US rates and paralleled the supply of cardiologists and catheterization facilities.42-44 It is therefore possible that Canadian hospitals, with fewer specialized resources, selective access to medical technology, and global budgets, are using these resources more efficiently, especially during the inpatient episode for care-sensitive conditions.45,46 Canada's health care expenditures per capita are about 57% of those in the United States.47 At this spending level, there might still be a positive association between spending and outcomes. For example, the same-day PCI rate for patients with AMI in low-intensity hospitals in 2008 was 3.5%, leaving room for improvement. This pattern is consistent with studies in the United States showing a positive association between spending and outcomes among low-intensity hospitals or regions but no association at average or higher intensity levels.5,6
Strengths of the study include the population-based, longitudinal cohort design; the consistency of findings across cardiac, cancer, medical, and surgical patients; the examination of plausible clinical mechanisms whereby higher intensity may be associated with better outcomes; and the examination of readmissions. The “look-back” (EOL-EI) and “look-forward” (AC-EI) measures of spending intensity were highly correlated and produced similar findings, as in US studies.2
Several limitations should be considered. Because the design precludes strong inferences about causation, we cannot know which components of care may have led to better outcomes. In observational studies, comparisons of exposure groups may be biased because of unobserved selection bias.13 It is unlikely that the findings are the result of unmeasured case mix, because patients in higher-spending hospitals had similar or higher illness severity at admission, which would, if anything, bias toward finding worse outcomes. We cannot rule out the possibility that higher-intensity hospitals coded more aggressively, but there is less incentive to do so in a system with global hospital budgets. Although admission severity would be determined more accurately using clinical detail from medical charts, previous work has shown high concordance between risk-adjusted hospital outcomes using chart and administrative data.48,49 Canadian data distinguish between comorbidities present at admission and complications, leading to improved admission severity coding. The EOL-EI has been critiqued for the purpose of estimating hospital efficiency50,51 but is used here simply to distinguish high- and low-intensity hospitals, as in other US studies.1-4 The findings may not generalize to chronic conditions, for which avoiding exacerbations of disease that lead to hospitalization through coordinated ambulatory care is key. The findings also may not generalize to jurisdictions in which hospital resources are more abundant and are used in cost-effective as well as cost-ineffective ways, leading to inefficiency.45,46
This study shows that in Ontario, a province with global hospital budgets and fewer specialized health care resources than the United States, outcomes following an acute hospitalization are positively associated with higher hospital spending intensity. Higher spending intensity, in turn, is associated with greater use of specialists, better patient care, and more use of advanced procedures. These results suggest that it is critical to understand not simply how much money is spent but whether it is spent on effective procedures and services.
Corresponding Author: Therese A. Stukel, PhD, Institute for Clinical Evaluative Sciences, G106-2075 Bayview Ave, Toronto, ON M4N 3M5, Canada (firstname.lastname@example.org).
Author Contributions: Dr Stukel had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Stukel, Fisher, Alter, Guttmann, Fung.
Acquisition of data: Stukel.
Analysis and interpretation of data: Stukel, Fisher, Alter, Guttmann, Ko, Fung, Wodchis, Baxter, Earle, Lee.
Drafting of the manuscript: Stukel.
Critical revision of the manuscript for important intellectual content: Stukel, Fisher, Alter, Guttmann, Ko, Fung, Wodchis, Baxter, Earle, Lee.
Statistical analysis: Stukel, Fung, Wodchis.
Obtained funding: Stukel.
Study supervision: Stukel.
Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest and none were reported.
Funding/Support: Funding was provided by an Emerging Team Grant (ETG92248) in Applied Health Services and Policy Research from the Canadian Institutes of Health Research, by a grant from the US National Institute on Aging (1PO1-AG19783-01), and by the Institute for Clinical Evaluative Sciences, which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care.
Role of the Sponsors: The funding agencies had no role in design and conduct of the study; the collection, management, analysis, and interpretation of the data; or the preparation, review, or approval of the manuscript.
Online-Only Material: The Author Video Interview is available here.
Additional Contributions: We thank Nancy MacCallum, MLIS, and Ashley Corallo, MPH, Institute for Clinical Evaluative Sciences, Toronto, for assistance with manuscript preparation. These individuals received no compensation beyond salary for their contributions.