[Skip to Navigation]
Sign In
Figure. Mean Percentage Concordance With HQA Process Measures for AMI, CHF, and Pneumonia
Figure. Mean Percentage Concordance With HQA Process Measures for AMI, CHF, and Pneumonia

AMI indicates acute myocardial infarction; CAHs, critical access hospitals; CHF, congestive heart failure; and HQA, Hospital Quality Alliance. P values are derived from weighted hospital-based linear regression analyses. For comparisons between CAH and non-CAH for all 3 conditions, P < .001. Error bars indicate 95% confidence intervals.

Table 1. Comparison of Hospital Characteristics Between CAHs and Non-CAHsa
Table 1. Comparison of Hospital Characteristics Between CAHs and Non-CAHsa
Table 2. Comparison of Patient Characteristics Between CAHs and Non-CAHsa
Table 2. Comparison of Patient Characteristics Between CAHs and Non-CAHsa
Table 3. Comparison of Clinical Resources Between CAHs and Non-CAHs
Table 3. Comparison of Clinical Resources Between CAHs and Non-CAHs
Table 4. Comparison of Health Information Technology Resources Between CAHs and Non-CAHsa
Table 4. Comparison of Health Information Technology Resources Between CAHs and Non-CAHsa
Table 5. Risk-Adjusted 30-Day Mortality Rates Among CAHs and Non-CAHs for Common Medical Conditionsa
Table 5. Risk-Adjusted 30-Day Mortality Rates Among CAHs and Non-CAHs for Common Medical Conditionsa
Table 6. Quality of Care and 30-Day Mortality Including Only Small, Rural Hospitalsa
Table 6. Quality of Care and 30-Day Mortality Including Only Small, Rural Hospitalsa
1.
 Balanced Budget Act of 1997, HR 2015, 105th Cong (1997) 
2.
Medicare Payment Advisory Committee.  Report to the Congress: Issues in a Modernized Medicare Program. Washington, DC: MedPAC; 2005
3.
Stensland J, Davidson G, Moscovice I. The Financial Benefits of Critical Access Conversion: Working Paper 44. Minneapolis: University of Minnesota Rural Health Research Center; 2004
4.
US Census Bureau.  Census 2000 Summary File Data. Washington, DC: US Census Bureau; 2000
5.
Casey MM, Davidson G. Upper Midwest Rural Health Research Center Final Report #10: Patient Assessments and Quality of Care in Rural Hospitals.  Minneapolis: Upper Midwest Rural Health Research Center, University of Minnesota; 2010
6.
The Joint Commission.  2010 ORYX Performance Measure Reporting Requirements for Hospitals and Guidelines for Measure Selections. Washington, DC: The Joint Commission; 2009
7.
Casey M, Moscovice I.Flex Monitoring Team.  CAH Participation in Hospital Compare and Initial Results. Minneapolis, MN: Rural Health Research Centers at the Universities of Minnesota, North Carolina, and Southern Maine; 2006
8.
Gamm LD, ed, Hutchison LL, ed, Dabney BJ, ed, Dorsey AM, edRural Healthy People 2010: A Companion Document to Healthy People 2010: Volume 1. College Station: Texas A&M University System Health Science Center; 2003
9.
Moscovice I, Rosenblatt R. Quality-of-care challenges for rural health.  J Rural Health. 2000;16(2):168-17610981369PubMedGoogle ScholarCrossref
10.
Werner RM, Goldman LE, Dudley RA. Comparison of change in quality of care between safety-net and non-safety-net hospitals.  JAMA. 2008;299(18):2180-218718477785PubMedGoogle ScholarCrossref
11.
US Department of Agriculture Economic Research Service.  Measuring Rurality: Rural-Urban Commuting Area Codes. http://www.ers.usda.gov/briefing/Rurality/RuralUrbanCommutingAreas/. Accessed November 1, 2010
12.
Desai MM, Lin Z, Schreiner GC,  et al.  2009 Measures Maintenance Technical Report: Acute Myocardial Infarction, Heart Failure, and Pneumonia 30-Day Risk Standardized Readmission Measures. New Haven, CT: Yale-New Haven Health Services Corporation/Center for Outcomes Research and Evaluation (YNHHSC/CORE); 2009
13.
Krumholz HM, Normand SL, Galusha DH,  et al.  Risk-Adjustment Models for AMI and HF 30-Day Mortality. New Haven, CT: Yale University; 2005
14.
Joynt KE, Jha AK. Who has higher readmission rates for heart failure, and why? implications for efforts to improve care using financial incentives.  Circ Cardiovasc Qual Outcomes. 2011;4(1):53-5921156879PubMedGoogle ScholarCrossref
15.
Funk LM, Gawande AA, Semel ME,  et al.  Esophagectomy outcomes at low-volume hospitals: the association between systems characteristics and mortality.  Ann Surg. 2011;253(5):912-91721422913PubMedGoogle ScholarCrossref
16.
Jha AK, Orav EJ, Epstein AM. Public reporting of discharge planning and rates of readmissions.  N Engl J Med. 2009;361(27):2637-264520042755PubMedGoogle ScholarCrossref
17.
Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States.  N Engl J Med. 2008;359(18):1921-193118971493PubMedGoogle ScholarCrossref
18.
Jha AK, DesRoches CM, Campbell EG,  et al.  Use of electronic health records in U.S. hospitals.  N Engl J Med. 2009;360(16):1628-163819321858PubMedGoogle ScholarCrossref
19.
Jha AK, Li Z, Orav EJ, Epstein AM. Care in U.S. hospitals: the Hospital Quality Alliance program.  N Engl J Med. 2005;353(3):265-27416034012PubMedGoogle ScholarCrossref
20.
Pope G, Kautter J, Ingber M, Freeman S, Sekar R, Newhart C. Evaluation of the CMS-HCC Risk Adjustment Model. Research Triangle Park, NC: RTI International; 2011
21.
Li P, Kim MM, Doshi JA. Comparison of the performance of the CMS Hierarchical Condition Category (CMS-HCC) risk adjuster with the Charlson and Elixhauser comorbidity measures in predicting mortality.  BMC Health Serv Res. 2010;10:24520727154PubMedGoogle ScholarCrossref
22.
Keeler EB, Rubenstein LV, Kahn KL,  et al.  Hospital characteristics and quality of care.  JAMA. 1992;268(13):1709-17141527880PubMedGoogle ScholarCrossref
23.
Pathman DE, Ricketts TC III, Konrad TR. How adults' access to outpatient physician services relates to the local supply of primary care physicians in the rural southeast.  Health Serv Res. 2006;41(1):79-10216430602PubMedGoogle ScholarCrossref
24.
Medicare Payment Advisory Committee.  Report to the Congress: Medicare in Rural America. Washington, DC: MedPAC; 2001
25.
Casey MM, Moscovice I. Quality improvement strategies and best practices in Critical Access Hospitals.  J Rural Health. 2004;20(4):327-33415551849PubMedGoogle ScholarCrossref
26.
 Patient Protection and Affordable Care Act, HR 3590, 111th Cong (2009) 
27.
CMS Hospital Pay-for-Performance Workgroup.  U.S. Department of Health and Human Services, Medicare Hospital Value-Based Purchasing Plan Development, Issues Paper. Baltimore, MD: Centers for Medicare & Medicaid Services; 2007
28.
Centers for Medicare & Medicaid Services.  Medicare program: hospital inpatient value-based purchasing program: proposed rule.  Fed Regist. 2011;76(9):2454-2491To be codified at 42 CFR §422 and §480Google Scholar
29.
Jha AK, Orav EJ, Li Z, Epstein AM. The inverse relationship between mortality rates and performance in the Hospital Quality Alliance measures.  Health Aff (Millwood). 2007;26(4):1104-111017630453PubMedGoogle ScholarCrossref
30.
Institute of Medicine Committee on the Future of Rural Health Care, Quality Board on Health Care Services.  Quality Through Collaboration: The Future of Rural Health Care. Washington, DC: National Academies Press; 2005
31.
Sutton J. Patterns of Postacute Utilization in Rural and Urban Communities: Home Health, Skilled Nursing, and Inpatient Medical Rehabilitation. Bethesda, MD: NORC Walsh Center for Rural Health Analysis; 2005
32.
Hartman L, Jarosek SL, Virnig BA, Durham S. Medicare-certified home health care: urban-rural differences in utilization.  J Rural Health. 2007;23(3):254-25717565526PubMedGoogle ScholarCrossref
33.
Chan L, Hart LG, Goodman DC. Geographic access to health care for rural Medicare beneficiaries.  J Rural Health. 2006;22(2):140-14616606425PubMedGoogle ScholarCrossref
34.
Hines S, Joshi MS. Variation in quality of care within health systems.  Jt Comm J Qual Patient Saf. 2008;34(6):326-33218595378PubMedGoogle Scholar
35.
Chukmaitov AS, Bazzoli GJ, Harless DW,  et al.  Variations in inpatient mortality among hospitals in different system types, 1995 to 2000.  Med Care. 2009;47(4):466-47319238101PubMedGoogle ScholarCrossref
36.
Chaudhry B, Wang J, Wu S,  et al.  Systematic review: impact of health information technology on quality, efficiency, and costs of medical care.  Ann Intern Med. 2006;144(10):742-75216702590PubMedGoogle ScholarCrossref
37.
McCambridge M, Jones K, Paxton H,  et al.  Association of health information technology and teleintensivist coverage with decreased mortality and ventilator use in critically ill patients.  Arch Intern Med. 2010;170(7):648-65320386011PubMedGoogle ScholarCrossref
38.
Audebert HJ, Schultes K, Tietz V,  et al.  Long-term effects of specialized stroke care with telemedicine support in community hospitals on behalf of the Telemedical Project for Integrative Stroke Care (TEMPiS).  Stroke. 2009;40(3):902-90819023095PubMedGoogle ScholarCrossref
39.
Shea S, Weinstock RS, Teresi JA,  et al.  A randomized trial comparing telemedicine case management with usual care in older, ethnically diverse, medically underserved patients with diabetes mellitus: 5 year results of the IDEATel study.  J Am Med Inform Assoc. 2009;16(4):446-45619390093PubMedGoogle ScholarCrossref
40.
Bahensky JA, Ward MM, Nyarko K, Li P. HIT implementation in Critical Access Hospitals: extent of implementation and business strategies supporting IT use [published online December 2, 2009]. J Med Syst 20703529PubMed
41.
Wakefield DS, Ward MM, Loes JL, O’Brien J. A network collaboration implementing technology to improve medication dispensing and administration in Critical Access Hospitals.  J Am Med Inform Assoc. 2010;17(5):584-58720819868PubMedGoogle ScholarCrossref
42.
Office of the National Coordinator for Health Information Technology.  RECs Support Critical Access and Rural Hospitals. http://healthit.hhs.gov/portal/server.pt?open=512&mode=2&objID=3152. Accessed November 18, 2010
43.
Nawal Lutfiyya M, Bhat DK, Gandhi SR,  et al.  A comparison of quality of care indicators in urban acute care hospitals and rural Critical Access Hospitals in the United States.  Int J Qual Health Care. 2007;19(3):141-14917442745PubMedGoogle ScholarCrossref
44.
Sheikh K, Bullock C. Urban-rural differences in the quality of care for medicare patients with acute myocardial infarction.  Arch Intern Med. 2001;161(5):737-74311231708PubMedGoogle ScholarCrossref
45.
Baldwin LM, MacLehose RF, Hart LG,  et al.  Quality of care for acute myocardial infarction in rural and urban US hospitals.  J Rural Health. 2004;20(2):99-10815085622PubMedGoogle ScholarCrossref
46.
Ambardekar AV, Fonarow GC, Dai D,  et al.  Quality of care and in-hospital outcomes in patients with coronary heart disease in rural and urban hospitals (from Get With the Guidelines-Coronary Artery Disease Program).  Am J Cardiol. 2010;105(2):139-14320102907PubMedGoogle ScholarCrossref
Original Contribution
July 6, 2011

Quality of Care and Patient Outcomes in Critical Access Rural Hospitals

Author Affiliations

Author Affiliations: Departments of Health Policy and Management (Drs Joynt and Jha) and Biostatistics (Dr Orav), Harvard School of Public Health, Boston, Massachusetts; Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts (Drs Joynt, Orav, and Jha); Veterans Affairs Boston Healthcare System, Boston, Massachusetts (Dr Jha); and Health Resources and Services Administration, Department of Health and Human Services, Rockville, Maryland (Dr Harris).

JAMA. 2011;306(1):45-52. doi:10.1001/jama.2011.902
Abstract

Context Critical access hospitals (CAHs) play a crucial role in the US rural safety net. Current policy efforts have focused primarily on helping these small, isolated hospitals remain financially viable to ensure access for individuals living in rural areas in the United States; however, little is known about the quality of care they provide or the outcomes their patients achieve.

Objectives To examine the quality of care and patient outcomes at CAHs and to understand why patterns of care might differ for CAHs vs non-CAHs.

Design, Setting, and Patients A retrospective analysis in 4738 US hospitals of Medicare fee-for-service beneficiaries with acute myocardial infarction (AMI) (10 703 for CAHs vs 469 695 for non-CAHs), congestive heart failure (CHF) (52 927 for CAHs vs 958 790 for non-CAHs), and pneumonia (86 359 for CAHs vs 773 227 for non-CAHs) who were discharged in 2008-2009.

Main Outcome Measures Clinical capabilities, performance on processes of care, and 30-day mortality rates, adjusted for age, sex, race, and medical comorbidities.

Results Compared with other hospitals (n = 3470), 1268 CAHs (26.8%) were less likely to have intensive care units (380 [30.0%] vs 2581 [74.4%], P < .001), cardiac catheterization capabilities (6 [0.5%] vs 1654 [47.7%], P < .001), and at least basic electronic health records (80 [6.5%] vs 445 [13.9%], P < .001). The CAHs had lower performance on processes of care than non-CAHs for all 3 conditions examined (concordance with Hospital Quality Alliance process measures for AMI, 91.0% [95% CI, 89.7%-92.3%] vs 97.8% [95% CI, 97.7%-97.9%]; for CHF, 80.6% [95% CI, 79.2%-82.0%] vs 93.5% [95% CI, 93.3%-93.7%]; and for pneumonia, 89.3% [95% CI, 88.6%-90.0%] vs 93.7% [95% CI, 93.6%-93.9%]; P < .001 for each). Patients admitted to CAHs had higher 30-day mortality rates for each condition than those admitted to non-CAHs (for AMI: 23.5% vs 16.2%; adjusted odds ratio [OR], 1.70; 95% confidence interval [CI], 1.61-1.80; P < .001; for CHF: 13.4% vs 10.9%; adjusted OR, 1.28; 95% CI, 1.23-1.32; P < .001; and for pneumonia: 14.1% vs 12.1%; adjusted OR, 1.20; 95% CI, 1.16-1.24; P < .001).

Conclusion Compared with non-CAHs, CAHs had fewer clinical capabilities, worse measured processes of care, and higher mortality rates for patients with AMI, CHF, or pneumonia.

Critical access hospitals (CAHs) play an important and unique role in the US health care system, caring for individuals who live in rural areas and who might otherwise have no accessible inpatient care. This hospital designation, created by the Medicare Rural Hospital Flexibility Program of the 1997 Balanced Budget Act, resulted from a federal effort to increase resources for small, geographically isolated hospitals, many of which were struggling financially. The bill defined CAHs as hospitals with no more than 25 acute care beds and located more than 35 miles from the nearest hospital.1 Hospitals that converted to CAH status became eligible for cost-based reimbursement rather than diagnosis related group–based reimbursement.1 As a result, margins improved and closures among these small rural hospitals decreased dramatically2,3; more than a quarter of the acute care hospitals in the United States now have the CAH designation.

The CAH designation was created with the goal of ensuring “proximate access” to basic inpatient and emergency care close to home for approximately 20% of the US population that still lives in rural communities.4 The program has been highly successful in protecting access to inpatient care for rural communities, while providing care that receives high scores on patient satisfaction.5 However, despite broad policy interest in helping CAHs provide access to inpatient care, little is known about the quality of care they provide—these hospitals are exempt from reporting to both the Joint Commission performance measure program6 and the Hospital Quality Alliance (HQA) national public reporting program.7 We are unaware of recent national data comparing outcomes at these hospitals to a national sample. Critical access hospitals have less access to capital and fewer health care professionals in their communities, including fewer specialists.8 Therefore, these hospitals may face equal or greater challenges in delivering high-quality care9 compared with other vulnerable hospitals, such as safety net hospitals, which have been more extensively studied.10 Understanding whether the CAH designation has been helpful, in not only improving access, but also in ensuring high-quality care, is a key element in evaluating federal efforts to ensure an effective rural health system.

We sought to examine CAHs' clinical and personnel resources, the quality of care they deliver, and their patients' outcomes. We focused on 3 common conditions—congestive heart failure (CHF), acute myocardial infarction (AMI), and pneumonia. We also sought to identify what factors, such as clinical capabilities, size, patient volume, or other related issues, might explain any differences in outcomes of care.

Methods
Hospitals

We used the Medicare Provider Analysis and Review file to identify nonfederal hospitals that provide acute care services to Medicare beneficiaries in the 50 US states or District of Columbia. We used the 2009 American Hospital Association survey to obtain data on hospital characteristics, including critical access designation, size, ownership, teaching status, and region. We linked these data with the 2009 Area Resource File, which contains county-level data on median household income and poverty rate. Although the original legislation specified that only isolated rural hospitals qualified for CAH status, states subsequently granted exemptions for this rule, allowing some hospitals in suburban or even urban settings to be eligible. Therefore, we linked the rural urban commuting area codes, which detail population density and urbanization at a granular level, to examine the degree to which rurality affected our findings.11

Patients

We defined our study population as Medicare fee-for-service beneficiaries admitted to the hospitals in our sample in 2008-2009 with a primary discharge diagnosis of AMI, CHF, or pneumonia (International Classification of Diseases, Ninth Revision, Clinical Modification [ICD-9-CM ] codes 398.91, 404.x1, 404.x3, 428.0-428.9 for CHF; ICD-9-CM codes 410.xx, excluding 410.x2, for AMI; and ICD-9-CM codes 480-486 for pneumonia). Patient race as reported to Medicare was categorized based on self-report. We followed the Centers for Medicare & Medicaid Services approach for classifying “index admissions,”12,13 allowing patients to be included in the sample more than once. All patients were assigned to the admitting hospital regardless of whether they were transferred. Our final patient population included 2 351 701 admissions across these 3 conditions.

Outcomes

We used the American Hospital Association survey to quantify resources that have been associated with better care,14,15 including the presence of an intensive care unit, the ability to perform cardiac catheterization or surgery, and nurse staffing levels. Nurse staffing was estimated by calculating the number of full-time equivalent nurses on staff per 1000 patient-days.16,17 We used the Area Resource File to estimate the total physician and subspecialist supply for the county in which each hospital was located. Each hospital's health information technology resources were determined from the American Hospital Association Health Information Technology survey, which was distributed to every acute care hospital in the United States in 2009. The survey asked responding hospitals to report the degree of adoption of specific electronic health record (EHR) functions and achieved a response rate of 63%.18

We used HQA data to obtain hospitals' performance on process measures for AMI, CHF, and pneumonia during 2009. Because of sample size cutoffs and reporting exemptions, these measures were available for only a subset of the hospitals in our sample. We calculated an overall performance score for each hospital for each condition19 (eTable 1). We used Medicare data to calculate mortality within 30 days of admission. Each patient's likelihood of death was adjusted for age, sex, race, and medical comorbidities using the Centers for Medicare & Medicaid Services Hierarchical Condition Category mortality models,20 which were developed by the Centers for Medicare & Medicaid Services and have been demonstrated in recent studies to have a better C statistic and predictive accuracy than the Charlson and Elixhauser methods.21

Analysis

We compared summary statistics for hospital characteristics, demographics, and patient comorbidities between CAHs and non-CAHs using χ2 tests and t tests or Wilcoxon rank sum tests as appropriate. We used χ2 tests to compare the presence of each clinical resource and functionality between CAHs and non-CAHs. We analyzed performance on the HQA metrics, weighting each hospital's performance by its number of patients with that diagnosis. We then created patient-level logistic regression models for 30-day mortality, clustered at the hospital level.

We subsequently built multivariable regression models. We first adjusted for factors that are outside the control of the hospitals and policy makers, including region, hospital ownership, and median county income. We next added variables to the model that we postulated might be in the explanatory pathway between CAH status and outcomes, and might be amenable to change by either hospitals or policy makers, in a stepwise fashion, first adding measures of clinical personnel, followed by clinical resources and system membership, the presence of an EHR, and annual condition-specific case volume. In addition, we examined models adjusting for rurality using the rural urban commuting area codes (divided into urban [≥50 000 population], large town [10 000-49 999 population], small town [2500-9999 population], and rural [<2500 population] categories). Although rurality is highly collinear with being a CAH, it may also be associated with other, unmeasured (or inadequately measured) factors, including travel time and quality of clinical personnel and resources.

Because CAHs transfer more patients than non-CAHs, we examined in sensitivity analyses differences in mortality rates after excluding all transfers. To better understand whether differences in outcomes between CAHs and other hospitals were driven primarily by size and rural status, or whether these differences might be driven by other factors such as CAHs' exemption from reporting or payment mechanisms, we conducted additional sensitivity analyses and restricted our sample to small, rural hospitals. In addition, we used established methods3,4 to model the degree of association between an unmeasured confounder and both our primary predictor (CAH status) and our outcome (mortality) that would have had to be present to eliminate our findings.

To account for multiple comparisons, we considered 2-sided P < .008 to be statistically significant. Analyses were performed by using SAS version 9.2 (SAS Institute Inc, Cary, North Carolina).

Results
Hospital Characteristics and Resources

Of the 4738 hospitals providing acute care to Medicare beneficiaries in 2008-2009, 1268 (26.8%) were designated as CAHs. The median number of operational beds in a CAH was 18 (interquartile range [IQR], 14-23) beds compared with 82 (IQR, 41-154) beds for non-CAHs (Table 1). Critical access hospitals were more likely to be publicly owned and less likely to be a teaching hospital, located in an urban area or large town, or part of a hospital system. Nearly half of the CAHs (49.0%) were located in the Midwest. In general, CAHs were located in counties with a lower median income than non-CAHs and served a higher proportion of Medicare patients but a lower proportion of Medicaid patients.

Patient Characteristics

We identified 2 351 701 index admissions for patients with CHF, AMI, or pneumonia during our study period, of which 149 989 admissions were to CAHs. Patients admitted to CAHs tended to be older and had a higher incidence of diabetes and depression, but a lower incidence of hypertension and chronic kidney disease (Table 2). Patients admitted to CAHs were more likely to be transferred to another acute care hospital than those admitted to non-CAHs (29.7% vs 9.5% for AMI, 7.4% vs 2.5% for CHF, and 5.6% vs 1.5% for pneumonia; P < .001 for each) and had significantly shorter lengths of stay for all 3 conditions. Patients admitted to CAHs were less likely to be transferred to a hospice at the time of discharge than patients admitted to non-CAHs.

Clinical Resources

Critical access hospitals had fewer clinical resources than other hospitals and were less likely to have intensive care units, cardiac catheterization capability, or the ability to perform surgeries (Table 3). Critical access hospitals had comparable nurse staffing levels to non-CAHs, but were located in counties with fewer specialists, with a 7-fold difference in the supply of cardiologists and pulmonologists per 100 000 population.

Critical access hospitals were less likely to have the key functions that comprise an EHR. Overall, 6.5% of CAHs had at least a basic EHR compared with 13.9% of non-CAHs.18 Each EHR component, including clinical documentation, test results viewing, computerized physician order entry, and decision support, was present less often at CAHs, and we found no difference in adoption of telemedicine (Table 4). Critical access hospitals were also less likely to be exchanging clinical data electronically with other hospitals or with outpatient practices.

Processes of Care

For all 3 conditions, CAHs had lower performance on HQA measures than non-CAHs did among reporting hospitals (Figure). For patients admitted with AMI, CAHs provided care that was concordant with HQA process measures 91.0% (95% confidence interval [CI], 89.7%-92.3%) of the time compared with 97.8% (95% CI, 97.7%-97.9%) of the time for non-CAHs (difference of 6.8%, P < .001). The difference was larger for CHF (12.9%; 80.6% [95% CI, 79.2%-82.0%] vs 93.5% [95% CI, 93.3%-93.7%]; P < .001) and smaller but still significant for pneumonia (4.4%; 89.3% [95% CI, 88.6%-90.0%] vs 93.7% [95% CI, 93.6%-93.9%]; P < .001). For 14 of the 17 individual measures, CAHs performed worse than non-CAHs (eTable 2). These differences persisted after adjusting for case mix and hospital characteristics (eTable 3).

Clinical Outcomes

Patients admitted to CAHs had higher 30-day risk-adjusted mortality rates for all 3 conditions than patients admitted to non-CAHs (Table 5). Patients admitted to CAHs had 7.3% higher absolute 30-day mortality rates for AMI (23.5% vs 16.2%; adjusted odds ratio [OR], 1.70; 95% CI, 1.61-1.80; P < .001); 2.5% higher mortality rates for CHF (13.4% vs 10.9%; adjusted OR, 1.28; 95% CI, 1.23-1.32; P < .001); and 2% higher mortality rates for pneumonia (14.1% vs 12.1%; adjusted OR, 1.20; 95% CI, 1.16-1.24; P < .001) than those admitted elsewhere. When we limited our analyses to patients who were not transferred, our results were similar (eTable 4).

We next built models that serially adjusted for variables that might be in the explanatory pathway to identify potentially actionable differences between CAHs and non-CAHs that contribute to outcomes. We found that differences in clinical personnel and resources into the model slightly attenuated the findings (Table 5); even after fully adjusting for all variables, including rurality, differences in mortality between CAHs and non-CAHs persisted for AMI (adjusted OR, 1.18; 95% CI, 1.09-1.28; P < .001) and for CHF (adjusted OR, 1.15; 95% CI, 1.00-1.31; P = .04), but not pneumonia (adjusted OR, 0.92; 95% CI, 0.87-0.97; P = .003).

When we limited our analyses to small, rural hospitals (1022 [81%] of the CAHs and 379 [11%] of the non-CAHs), we found differences in resources, quality of care, and outcomes between those with vs without the CAH designation (eTable 5 and eTable 6). Although there were no significant differences in measured quality for AMI (mean HQA summary score, 89.7 vs 90.3; P = .59), CAHs had higher mortality than non-CAHs for this condition (adjusted OR, 1.14; 95% CI, 1.05-1.24; P = .003). Critical access hospitals had lower performance on quality measures and higher mortality for CHF (mean HQA summary score, 78.7 vs 84.8; P < .001; adjusted OR, 1.09; 95% CI, 1.03-1.16; P = .003), and lower performance on quality measures but identical mortality for pneumonia (mean HQA summary score, 88.7 vs 91.1; P < .001; adjusted OR, 1.05; 95% CI, 0.99-1.11; P = .11) (Table 6).

Based on our sensitivity analysis, unmeasured confounding was unlikely to explain our findings. For AMI, for example, if an unmeasured confounder tripled mortality risk (a much stronger predictor of mortality than any of our current comorbidities) and was 3 times more common in patients in CAHs than in non-CAHs, the OR for mortality associated with receiving care at a CAH would decrease to 1.44, still statistically significant and clinically meaningful.

Comment

Despite more than a decade of concerted policy efforts to improve rural health care, our findings suggest that substantial challenges remain. Although CAHs provide much-needed access to care for many of the nation's rural citizens, we found that these hospitals, with their fewer clinical and technological resources, less often provided care consistent with standard quality metrics and generally had worse outcomes than non-CAHs. The absolute differences in outcomes were even larger than those outcomes reported in the initial work on this topic by Keeler et al,22 who demonstrated an excess all-cause mortality of 1.4% in rural hospitals using data from the 1980s, and comparable with differences noted by the Medicare Payment Advisory Committee using data from 2003.2 These findings suggest that efforts to date have been insufficient in improving the quality of inpatient care in rural communities23—and indicate a need for greater policy attention to the challenges these hospitals face. Given that CAHs care for a population that tends to be older and less likely to have routine access to primary care services,23 it is particularly important that policy efforts help CAHs meet these challenges.

The CAH designation, created with the goal of preserving access to care for individuals living in rural areas in the United States, directed financial resources to vulnerable rural hospitals at a time when many were closing due to financial insolvency. A number of regulations intended to promote quality were included in the legislation, including a formal requirement for credentialing and a state-run evaluation of quality. In return, designation as a CAH provided hospitals with financial security through cost-based reimbursement, which led to significant improvement in these hospitals' financial stability and allowed them to remain open, preserving access9,24,25 while maintaining patient satisfaction scores equal to or greater than those of non-CAHs.5 However, our findings suggest that these efforts have been insufficient in ensuring high-quality care.

Critical access hospitals had significantly poorer performance on process measures, which may be due to fewer resources to devote to quality improvement. Because CAHs are not required to report HQA data,7 the CAHs that reported (which ranged from 39% of CAHs for AMI to 71% of CAHs for pneumonia) may represent a higher-performing subset of CAHs than those choosing not to, which would understate the true differences in care. Furthermore, CAHs have typically been exempt from pay-for-performance programs in the past and will likely be excluded from national value-based purchasing efforts at least in the near term.26-28 Engaging in the process of collecting and reporting data is an important step toward developing an internal quality improvement strategy.29 Indeed, the Institute of Medicine has recommended that all CAHs participate in the HQA program for this reason.30

We found that personnel and clinical resources explained some of the mortality differences between CAHs and other hospitals. Ensuring adequate personnel and resources is challenging for CAHs,9,25 given their difficulties in recruiting health care practitioners.25 Inadequate outpatient care including lack of access to ongoing primary care, posthospitalization follow-up, rehabilitation, and home-based care31-33 may also contribute to poorer outcomes. Additional policy efforts to bring needed health care practitioners to underserved areas to ensure that CAHs have key clinical resources may be helpful. Given prior evidence that being a member of a hospital system may be related to improved clinical outcomes,34,35 promoting partnerships with health care systems might be a useful strategy to help CAHs. Such partnerships could include onsite rotations by clinicians with specialty training, increased use of telemedicine, or formal referral and transfer agreements—arrangements that allow patients to remain close to home while still facilitating access to specialty care are likely to be particularly well received by patients. One approach might be to provide financial incentives for tertiary care hospitals to partner with CAHs, potentially tying incentives to the CAH's performance on quality metrics.

Although we did not find that the presence of an EHR explained a significant amount of the difference in clinical outcomes between CAHs and non-CAHs, this area warrants extra attention. The use of technology, particularly telemedicine and clinical data exchange, has important applications in underserved areas.36-39 Critical access hospitals lack financial capital and access to the personnel needed to install and effectively maintain these systems.40,41 The federal effort to promote EHR adoption among CAHs has focused on technical assistance by the Regional Extension Centers.42 However, some Regional Extension Centers have elected not to work with CAHs and others are charging fees that may be unaffordable for CAHs. Policy makers may need to consider additional strategies to avoid exacerbating an already emerging digital divide.18

Adding rurality to our models seemed to explain some of the mortality differences we observed, and when we compared small, rural CAHs to small, rural non-CAHs, the excess mortality at CAHs decreased. These findings may not be surprising because poorer outcomes in rural settings was part of the motivation for creation of the critical access designation. Our findings suggest that a substantial proportion of the barriers faced by CAHs are due to their size and their rural location, even after accounting for other factors such as clinical resources and personnel. Rurality is likely associated with other unmeasured factors, such as travel distances to primary care or hospital, that affect outcomes. Better understanding what factors are closely associated with rurality that may help explain some of the differences in outcomes would be helpful in formulating effective interventions to help CAHs.

Despite the significant policy attention directed toward these vulnerable hospitals, there has been little empirical work on quality of care in a national sample of CAHs. Lutfiyya et al43 examined performance on HQA process measures in 2004, the first year for which these data were available, and found that CAHs had a lower performance than non-CAHs did. More recent comparisons have shown mixed results. Some studies44,45 have found that rural hospitals provide lower quality care; however, another study46 that examined self-selected hospitals engaged in national quality improvement programs failed to find a difference. Using 2003 data, compared with other rural hospitals, the Medicare Payment Advisory Committee found that CAHs had higher risk-adjusted mortality rates for CHF, AMI, pneumonia, stroke, and gastrointestinal hemorrhage. Our findings extend the Medicare Payment Advisory Committee work by focusing on a contemporary sample and a comparison group of nonrural hospitals, and by assessing care across a wide range of metrics while accounting for hospital characteristics and resources.2

Our study has limitations. We used administrative data, which fail to capture important clinical and patient characteristics (such as educational attainment) that likely affect outcomes. Based on our sensitivity analysis, however, it is unlikely that any unmeasured confounder could be strong enough to fully account for the difference between CAHs and non-CAHs outcomes. We lacked data on the experience or qualifications of the clinicians caring for patients at CAHs, which could have potentially explained some of our findings. We were also unable to assess the role of patient choice in patterns of care—patients may have declined transfer for more advanced care due to personal preference even if clinicians recommended that a transfer occur. We could not examine outpatient care and thus were unable to assess to what extent these differences might affect our findings. Because we relied on Medicare fee-for-service data for outcomes, we could not assess whether the patterns observed were also true for Medicare Advantage patients or for younger patients. In addition, mortality may be a crude measure of hospital quality; therefore, we attempted to incorporate both structural and process measures to provide a more comprehensive view of care at CAHs.

In summary, CAHs play an essential role in ensuring access to health care for individuals living in rural areas in the United States. However, these institutions face many challenges, remain underresourced in terms of both clinical and technological capabilities, perform worse on process measures, and have higher mortality rates than non-CAHs. More than a decade after major federal and state efforts to save US rural hospitals, these findings should be seen as a call to focus on helping these hospitals improve the quality of care they provide so that all individuals in the United States have access to high-quality inpatient care regardless of where they live.

Back to top
Article Information

Corresponding Author: Karen E. Joynt, MD, MPH, Department of Medicine, Brigham and Women's Hospital, 75 Francis St, Boston, MA 02115 (kjoynt@partners.org).

Author Contributions: Dr Joynt had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Joynt, Jha.

Acquisition of data: Harris, Jha.

Analysis and interpretation of data: Joynt, Orav.

Drafting of the manuscript: Joynt.

Critical revision of the manuscript for important intellectual content: Harris, Orav, Jha.

Statistical analysis: Joynt, Orav.

Administrative, technical, or material support: Harris, Jha.

Study supervision: Jha.

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Jha reported providing consulting support to UpToDate and being on the Scientific Advisory Board for Humedica. Drs Joynt, Harris, and Orav reported no financial disclosures.

Disclaimer: The views expressed in this article are solely the opinions of the authors and do not necessarily reflect the official policies of the US Department of Veterans Affairs, Department of Health and Human Services, or the Health Resources and Services Administration, nor does mention of the department or agency names imply endorsement by the US government.

Additional Contributions: Jie Zheng, PhD (Department of Health Policy and Management, Harvard School of Public Health), provided assistance with statistical programming. Dr Zheng received compensation as part of her regular employment.

References
1.
 Balanced Budget Act of 1997, HR 2015, 105th Cong (1997) 
2.
Medicare Payment Advisory Committee.  Report to the Congress: Issues in a Modernized Medicare Program. Washington, DC: MedPAC; 2005
3.
Stensland J, Davidson G, Moscovice I. The Financial Benefits of Critical Access Conversion: Working Paper 44. Minneapolis: University of Minnesota Rural Health Research Center; 2004
4.
US Census Bureau.  Census 2000 Summary File Data. Washington, DC: US Census Bureau; 2000
5.
Casey MM, Davidson G. Upper Midwest Rural Health Research Center Final Report #10: Patient Assessments and Quality of Care in Rural Hospitals.  Minneapolis: Upper Midwest Rural Health Research Center, University of Minnesota; 2010
6.
The Joint Commission.  2010 ORYX Performance Measure Reporting Requirements for Hospitals and Guidelines for Measure Selections. Washington, DC: The Joint Commission; 2009
7.
Casey M, Moscovice I.Flex Monitoring Team.  CAH Participation in Hospital Compare and Initial Results. Minneapolis, MN: Rural Health Research Centers at the Universities of Minnesota, North Carolina, and Southern Maine; 2006
8.
Gamm LD, ed, Hutchison LL, ed, Dabney BJ, ed, Dorsey AM, edRural Healthy People 2010: A Companion Document to Healthy People 2010: Volume 1. College Station: Texas A&M University System Health Science Center; 2003
9.
Moscovice I, Rosenblatt R. Quality-of-care challenges for rural health.  J Rural Health. 2000;16(2):168-17610981369PubMedGoogle ScholarCrossref
10.
Werner RM, Goldman LE, Dudley RA. Comparison of change in quality of care between safety-net and non-safety-net hospitals.  JAMA. 2008;299(18):2180-218718477785PubMedGoogle ScholarCrossref
11.
US Department of Agriculture Economic Research Service.  Measuring Rurality: Rural-Urban Commuting Area Codes. http://www.ers.usda.gov/briefing/Rurality/RuralUrbanCommutingAreas/. Accessed November 1, 2010
12.
Desai MM, Lin Z, Schreiner GC,  et al.  2009 Measures Maintenance Technical Report: Acute Myocardial Infarction, Heart Failure, and Pneumonia 30-Day Risk Standardized Readmission Measures. New Haven, CT: Yale-New Haven Health Services Corporation/Center for Outcomes Research and Evaluation (YNHHSC/CORE); 2009
13.
Krumholz HM, Normand SL, Galusha DH,  et al.  Risk-Adjustment Models for AMI and HF 30-Day Mortality. New Haven, CT: Yale University; 2005
14.
Joynt KE, Jha AK. Who has higher readmission rates for heart failure, and why? implications for efforts to improve care using financial incentives.  Circ Cardiovasc Qual Outcomes. 2011;4(1):53-5921156879PubMedGoogle ScholarCrossref
15.
Funk LM, Gawande AA, Semel ME,  et al.  Esophagectomy outcomes at low-volume hospitals: the association between systems characteristics and mortality.  Ann Surg. 2011;253(5):912-91721422913PubMedGoogle ScholarCrossref
16.
Jha AK, Orav EJ, Epstein AM. Public reporting of discharge planning and rates of readmissions.  N Engl J Med. 2009;361(27):2637-264520042755PubMedGoogle ScholarCrossref
17.
Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States.  N Engl J Med. 2008;359(18):1921-193118971493PubMedGoogle ScholarCrossref
18.
Jha AK, DesRoches CM, Campbell EG,  et al.  Use of electronic health records in U.S. hospitals.  N Engl J Med. 2009;360(16):1628-163819321858PubMedGoogle ScholarCrossref
19.
Jha AK, Li Z, Orav EJ, Epstein AM. Care in U.S. hospitals: the Hospital Quality Alliance program.  N Engl J Med. 2005;353(3):265-27416034012PubMedGoogle ScholarCrossref
20.
Pope G, Kautter J, Ingber M, Freeman S, Sekar R, Newhart C. Evaluation of the CMS-HCC Risk Adjustment Model. Research Triangle Park, NC: RTI International; 2011
21.
Li P, Kim MM, Doshi JA. Comparison of the performance of the CMS Hierarchical Condition Category (CMS-HCC) risk adjuster with the Charlson and Elixhauser comorbidity measures in predicting mortality.  BMC Health Serv Res. 2010;10:24520727154PubMedGoogle ScholarCrossref
22.
Keeler EB, Rubenstein LV, Kahn KL,  et al.  Hospital characteristics and quality of care.  JAMA. 1992;268(13):1709-17141527880PubMedGoogle ScholarCrossref
23.
Pathman DE, Ricketts TC III, Konrad TR. How adults' access to outpatient physician services relates to the local supply of primary care physicians in the rural southeast.  Health Serv Res. 2006;41(1):79-10216430602PubMedGoogle ScholarCrossref
24.
Medicare Payment Advisory Committee.  Report to the Congress: Medicare in Rural America. Washington, DC: MedPAC; 2001
25.
Casey MM, Moscovice I. Quality improvement strategies and best practices in Critical Access Hospitals.  J Rural Health. 2004;20(4):327-33415551849PubMedGoogle ScholarCrossref
26.
 Patient Protection and Affordable Care Act, HR 3590, 111th Cong (2009) 
27.
CMS Hospital Pay-for-Performance Workgroup.  U.S. Department of Health and Human Services, Medicare Hospital Value-Based Purchasing Plan Development, Issues Paper. Baltimore, MD: Centers for Medicare & Medicaid Services; 2007
28.
Centers for Medicare & Medicaid Services.  Medicare program: hospital inpatient value-based purchasing program: proposed rule.  Fed Regist. 2011;76(9):2454-2491To be codified at 42 CFR §422 and §480Google Scholar
29.
Jha AK, Orav EJ, Li Z, Epstein AM. The inverse relationship between mortality rates and performance in the Hospital Quality Alliance measures.  Health Aff (Millwood). 2007;26(4):1104-111017630453PubMedGoogle ScholarCrossref
30.
Institute of Medicine Committee on the Future of Rural Health Care, Quality Board on Health Care Services.  Quality Through Collaboration: The Future of Rural Health Care. Washington, DC: National Academies Press; 2005
31.
Sutton J. Patterns of Postacute Utilization in Rural and Urban Communities: Home Health, Skilled Nursing, and Inpatient Medical Rehabilitation. Bethesda, MD: NORC Walsh Center for Rural Health Analysis; 2005
32.
Hartman L, Jarosek SL, Virnig BA, Durham S. Medicare-certified home health care: urban-rural differences in utilization.  J Rural Health. 2007;23(3):254-25717565526PubMedGoogle ScholarCrossref
33.
Chan L, Hart LG, Goodman DC. Geographic access to health care for rural Medicare beneficiaries.  J Rural Health. 2006;22(2):140-14616606425PubMedGoogle ScholarCrossref
34.
Hines S, Joshi MS. Variation in quality of care within health systems.  Jt Comm J Qual Patient Saf. 2008;34(6):326-33218595378PubMedGoogle Scholar
35.
Chukmaitov AS, Bazzoli GJ, Harless DW,  et al.  Variations in inpatient mortality among hospitals in different system types, 1995 to 2000.  Med Care. 2009;47(4):466-47319238101PubMedGoogle ScholarCrossref
36.
Chaudhry B, Wang J, Wu S,  et al.  Systematic review: impact of health information technology on quality, efficiency, and costs of medical care.  Ann Intern Med. 2006;144(10):742-75216702590PubMedGoogle ScholarCrossref
37.
McCambridge M, Jones K, Paxton H,  et al.  Association of health information technology and teleintensivist coverage with decreased mortality and ventilator use in critically ill patients.  Arch Intern Med. 2010;170(7):648-65320386011PubMedGoogle ScholarCrossref
38.
Audebert HJ, Schultes K, Tietz V,  et al.  Long-term effects of specialized stroke care with telemedicine support in community hospitals on behalf of the Telemedical Project for Integrative Stroke Care (TEMPiS).  Stroke. 2009;40(3):902-90819023095PubMedGoogle ScholarCrossref
39.
Shea S, Weinstock RS, Teresi JA,  et al.  A randomized trial comparing telemedicine case management with usual care in older, ethnically diverse, medically underserved patients with diabetes mellitus: 5 year results of the IDEATel study.  J Am Med Inform Assoc. 2009;16(4):446-45619390093PubMedGoogle ScholarCrossref
40.
Bahensky JA, Ward MM, Nyarko K, Li P. HIT implementation in Critical Access Hospitals: extent of implementation and business strategies supporting IT use [published online December 2, 2009]. J Med Syst 20703529PubMed
41.
Wakefield DS, Ward MM, Loes JL, O’Brien J. A network collaboration implementing technology to improve medication dispensing and administration in Critical Access Hospitals.  J Am Med Inform Assoc. 2010;17(5):584-58720819868PubMedGoogle ScholarCrossref
42.
Office of the National Coordinator for Health Information Technology.  RECs Support Critical Access and Rural Hospitals. http://healthit.hhs.gov/portal/server.pt?open=512&mode=2&objID=3152. Accessed November 18, 2010
43.
Nawal Lutfiyya M, Bhat DK, Gandhi SR,  et al.  A comparison of quality of care indicators in urban acute care hospitals and rural Critical Access Hospitals in the United States.  Int J Qual Health Care. 2007;19(3):141-14917442745PubMedGoogle ScholarCrossref
44.
Sheikh K, Bullock C. Urban-rural differences in the quality of care for medicare patients with acute myocardial infarction.  Arch Intern Med. 2001;161(5):737-74311231708PubMedGoogle ScholarCrossref
45.
Baldwin LM, MacLehose RF, Hart LG,  et al.  Quality of care for acute myocardial infarction in rural and urban US hospitals.  J Rural Health. 2004;20(2):99-10815085622PubMedGoogle ScholarCrossref
46.
Ambardekar AV, Fonarow GC, Dai D,  et al.  Quality of care and in-hospital outcomes in patients with coronary heart disease in rural and urban hospitals (from Get With the Guidelines-Coronary Artery Disease Program).  Am J Cardiol. 2010;105(2):139-14320102907PubMedGoogle ScholarCrossref
×