Could regression to the mean explain some of the decline in readmissions at hospitals initially classified as below-mean performers under the Medicare Hospital Readmissions Reduction Program (HRRP)?
In this analysis of change in hospital readmission rates for specific conditions among Medicare beneficiaries, strong evidence suggests that most declines in excess readmission experienced after implementation of the HRRP at poorly performing hospitals was explained by a statistical phenomenon called regression to the mean. Regression to the mean signifies that entities farther away from the mean in one period are likely to be recorded closer to the mean in subsequent periods, simply by chance.
Random chance or luck rather than improvement in quality of care appears to be the primary driver of improvements in readmissions experienced at hospitals initially classified as below-mean performers under the HRRP.
Excess 30-day readmissions have declined substantially in hospitals initially penalized for high readmission rates under the Medicare Hospital Readmissions Reduction Program (HRRP). Although a possible explanation is that the policy incentivized penalized hospitals to improve care processes, another is regression to the mean (RTM), a statistical phenomenon that predicts entities farther from the mean in one period are likely to fall closer to the mean in subsequent (or preceding) periods owing to random chance.
To quantify the contribution of RTM to declining readmission rates at hospitals initially penalized under the HRRP.
Design, Setting, and Participants
This study analyzed data from Medicare Provider and Analysis Review files to assess changes in readmissions going forward and backward in time at hospitals with high and low readmission rates during the measurement window for the first year of the HRRP (fiscal year [FY] 2013) and for a measurement window that predated the FY 2013 measurement window for the HRRP among hospitals participating in the HRRP. Hospital characteristics are based on the 2012 survey by the American Hospital Association. The analysis included fee-for-service Medicare beneficiaries 65 years or older with an index hospitalization for 1 of the 3 target conditions of heart failure, acute myocardial infarction, or pneumonia or chronic obstructive pulmonary disease and who were discharged alive from February 1, 2006, through June 30, 2014, with follow-up completed by July 30, 2014. Data were analyzed from January 23, 2018, through March 29, 2019.
Hospital Readmission Reduction Program penalties.
Main Outcome and Measures
The excess readmission ratio (ERR), calculated as the ratio of a hospital’s readmissions to the readmissions that would be expected based on an average hospital with similar patients. Hospitals with ERRs of greater than 1.0 were penalized.
A total of 3258 hospitals were included in the study. For the 3 target conditions, hospitals with ERRs of greater than 1.0 during the FY 2013 measurement window exhibited decreases in ERRs in the subsequent 3 years, whereas hospitals with ERRs of no greater than 1.0 exhibited increases. For example, for patients with heart failure, mean ERRs declined from 1.086 to 1.038 (−0.048; 95% CI, −0.053 to −0.043; P < .001) at hospitals with ERRs of greater than 1.0 and increased from 0.917 to 0.957 (0.040; 95% CI, 0.036-0.044; P < .001) at hospitals with ERRs of no greater than 1.0. The same results, with ERR changes of similar magnitude, were found when the analyses were repeated using an alternate measurement window that predated the HRRP and followed up hospitals for 3 years (for patients with heart failure, mean ERRs declined from 1.089 to 1.044 [−0.045; 95% CI, −0.050 to −0.040; P < .001] at hospitals with below-mean performance and increased from 0.915 to 0.948 [0.033; 95% CI, 0.029 to 0.037; P < .001] at hospitals with above-mean performance). By comparing actual changes in ERRs with expected changes due to RTM, 74.3% to 86.5% of the improvement in ERRs for penalized hospitals was explained by RTM.
Conclusions and Relevance
Most of the decline in readmission rates in hospitals with high rates during the measurement window for the first year of the HRRP appeared to be due to RTM. These findings seem to call into question the notion of an HRRP policy effect on readmissions.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Joshi S, Nuckols T, Escarce J, Huckfeldt P, Popescu I, Sood N. Regression to the Mean in the Medicare Hospital Readmissions Reduction Program. JAMA Intern Med. Published online June 26, 2019. doi:10.1001/jamainternmed.2019.1004
Customize your JAMA Network experience by selecting one or more topics from the list below.
Create a personal account or sign in to: