Customize your JAMA Network experience by selecting one or more topics from the list below.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Siddiqui ZK, Abusamaan M, Bertram A, et al. Comparison of Services Available in 5-Star and Non–5-Star Patient Experience Hospitals. JAMA Intern Med. Published online June 10, 2019. doi:10.1001/jamainternmed.2019.1285
The Centers for Medicare and Medicaid Services publicly report star ratings for hospitals based on their patient experience performance on the Hospital Consumer Assessment of Healthcare Provider and Systems (HCAHPS) survey.1 The agency’s objective is to make information about hospital quality understandable for patients. However, the hospital star rating system may not be intuitive or aid consumer choice. In the hotel industry, higher star ratings are associated with provision of a broader set of services.2 It is unknown whether a similar association exists between hospital star ratings and range of services available. We compared the structural characteristics and clinical services provided by hospitals that received 5-star patient experience ratings with those that did not. We also determined the proportion of hospitals ranked by US News & World Report in the top 5% for each state, which is a commonly understood consumer-based metric for hospital quality.3
Hospital star rating databased on HCAHPS patient experience scores were linked with American Hospital Association data containing information about hospital characteristics, including clinical services provided, for all US hospitals in 2014.4,5 The data sets used for this study do not involve “human subjects” (as defined by federal regulation and guidelines); therefore, the study did not require institutional review board review or exempt determination. We used χ2 tests to compare the proportion of hospitals that provided specific clinical services by 5-star patient experience summary rating and unpaired, 2-tailed t tests to compare the same hospital groups for the number of different types of procedures performed. Subgroup analyses were conducted for general medical hospitals (excluding specialty hospitals). Hospital rankings for 2014 were obtained from US News & World Report, and χ2 tests were used to compare the proportion of hospitals ranked in the top 5% for each state by 5-star patient experience summary rating. All analyses were conducted using JMP Pro, version 13 (SAS Institute Inc).
Among 2798 hospitals with summary patient experience ratings, 150 (5.4%) received a 5-star rating. Compared with hospitals that did not receive 5-star ratings, hospitals that received 5-star ratings were less likely to provide several commonly sought clinical services, including emergency department services (116 of 150 [77.3%] vs 2523 of 2648 [95.3%]; odds ratio [OR], 0.16; 95% CI, 0.11-0.25), ICU services (50 of 119 [42.0%] vs 2005 of 2214 [90.6%]; OR, 0.08; 95% CI, 0.05-0.11), neurology services (28 of 119 [23.5%] vs 1554 of 2214 [70.2%]; OR, 0.13; 95% CI, 0.08-0.20) and adult cardiology services (30 of 119 [25.2%] vs 1687 of 2214 [76.2%]; OR, 0.11; 95% CI, 0.07-0.16) (Table). Subgroup analyses of general medical hospitals demonstrated similar results. Even when these services were available, they were more limited in range than those offered at hospitals without 5-star ratings. Hospitals with 5-star ratings performed fewer types of gastrointestinal procedures (mean number of procedure types, 1.2 [95% CI, 0.9-1.5] vs 2.7 [95% CI, 2.6-2.8]; P < .001) and cardiac procedures (mean number of procedure types, 0.5 [95% CI, 0.2-0.8] vs 2.1 [95% CI, 2.1-2.2]; P < .001) than hospitals without 5-star ratings, and they were less likely to be ranked in the top 5% for each state by US News & World Report (3 of 150 [2.0%] vs 213 of 2648 [8.1%]; OR, 0.23; 95% CI, 0.07-0.74).
Hospitals that provided broader clinical services were less likely to receive 5-star patient experience summary ratings. This remained true after specialty hospitals were excluded. Patients who seek “elite” care and narrow their search to 5-star patient experience hospitals might therefore be surprised that many types of expected services (eg, emergency department, cardiology, and neurology) may not be available. Hospitals that provide comprehensive services are more likely to receive “nonelite” ratings, in part because of challenges related to communication and responsiveness among more complex patient populations. The fact that it is difficult for hospitals providing a wider range of services to achieve 5-star ratings may suggest potential limitations to the star rating system as it is currently constructed. As previously suggested by the Medicare Payment Advisory Commission,6 the hospital star rating system may not produce true “apples-to-apples” comparisons.
Accepted for Publication: March 23, 2019.
Published Online: June 10, 2019. doi:10.1001/jamainternmed.2019.1285
Author Contributions: Dr Siddiqui had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Siddiqui, Allen, Brotman.
Acquisition, analysis, or interpretation of data: Siddiqui, Abusamaan, Bertram, Wu, Zhu, Brotman.
Drafting of the manuscript: Siddiqui, Abusamaan, Bertram.
Critical revision of the manuscript for important intellectual content: Siddiqui, Abusamaan, Allen, Wu, Zhu, Brotman.
Statistical analysis: Siddiqui, Abusamaan, Zhu.
Administrative, technical, or material support: Bertram, Allen.
Supervision: Siddiqui, Wu, Brotman.
Conflict of Interest Disclosures: None reported.
Create a personal account or sign in to: