[Skip to Navigation]
Sign In
Table 1.  Cohort Characteristics
Cohort Characteristics
Table 2.  Logistic Regression Results of Low-Value Imaging Predictors for Primary Care Physicians
Logistic Regression Results of Low-Value Imaging Predictors for Primary Care Physicians
Table 3.  Predictors of Low-Value Back Imaging by Clinician Type
Predictors of Low-Value Back Imaging by Clinician Type
Table 4.  Predictors of Low-Value Imaging for Primary Care Physicians, Across Clinical Scenarios
Predictors of Low-Value Imaging for Primary Care Physicians, Across Clinical Scenarios
Table 5.  Adjusted Rates of Low-Value Imaging
Adjusted Rates of Low-Value Imaging
1.
Berwick  DM, Hackbarth  AD.  Eliminating waste in US health care.  JAMA. 2012;307(14):1513-1516. doi:10.1001/jama.2012.362PubMedGoogle ScholarCrossref
2.
Mold  JW, Stein  HF.  The cascade effect in the clinical care of patients.  N Engl J Med. 1986;314(8):512-514. doi:10.1056/NEJM198602203140809PubMedGoogle ScholarCrossref
3.
McEwen  LN, Farjo  R, Foxman  B.  Antibiotic prescribing for cystitis: how well does it match published guidelines?  Ann Epidemiol. 2003;13(6):479-483. doi:10.1016/S1047-2797(03)00009-7PubMedGoogle ScholarCrossref
4.
Kale  MS, Bishop  TF, Federman  AD, Keyhani  S.  Trends in the overuse of ambulatory health care services in the United States.  JAMA Intern Med. 2013;173(2):142-148. doi:10.1001/2013.jamainternmed.1022PubMedGoogle ScholarCrossref
5.
Taur  Y, Smith  MA.  Adherence to the Infectious Diseases Society of America guidelines in the treatment of uncomplicated urinary tract infection.  Clin Infect Dis. 2007;44(6):769-774. doi:10.1086/511866PubMedGoogle ScholarCrossref
6.
Sharp  AL, Klau  MH, Keschner  D,  et al.  Low-value care for acute sinusitis encounters: who’s choosing wisely?  Am J Manag Care. 2015;21(7):479-485.PubMedGoogle Scholar
7.
Lipitz-Snyderman  A, Sima  CS, Atoria  CL,  et al.  Physician-driven variation in nonrecommended services among older adults diagnosed with cancer.  JAMA Intern Med. 2016;176(10):1541-1548. doi:10.1001/jamainternmed.2016.4426PubMedGoogle ScholarCrossref
8.
Mitchell  JM.  The prevalence of physician self-referral arrangements after Stark II: evidence from advanced diagnostic imaging.  Health Aff (Millwood). 2007;26(3):w415-w424. doi:10.1377/hlthaff.26.3.w415PubMedGoogle ScholarCrossref
9.
Levin  DC, Rao  VM, Parker  L, Frangos  AJ, Sunshine  JH.  Ownership or leasing of MRI facilities by nonradiologist physicians is a rapidly growing trend.  J Am Coll Radiol. 2008;5(2):105-109. doi:10.1016/j.jacr.2007.09.017PubMedGoogle ScholarCrossref
10.
Levin  DC, Rao  VM.  The effect of self-referral on utilization of advanced diagnostic imaging.  AJR Am J Roentgenol. 2011;196(4):848-852. doi:10.2214/AJR.10.5823PubMedGoogle ScholarCrossref
11.
Baker  LC.  Acquisition of MRI equipment by doctors drives up imaging use and spending.  Health Aff (Millwood). 2010;29(12):2252-2259. doi:10.1377/hlthaff.2009.1099PubMedGoogle ScholarCrossref
12.
Sharpe  RE, Nazarian  LN, Parker  L, Rao  VM, Levin  DC.  Dramatically increased musculoskeletal ultrasound utilization from 2000 to 2009, especially by podiatrists in private offices.  J Am Coll Radiol. 2012;9(2):141-146. doi:10.1016/j.jacr.2011.09.008PubMedGoogle ScholarCrossref
13.
Hillman  BJ, Joseph  CA, Mabry  MR, Sunshine  JH, Kennedy  SD, Noether  M.  Frequency and costs of diagnostic imaging in office practice–a comparison of self-referring and radiologist-referring physicians.  N Engl J Med. 1990;323(23):1604-1608. doi:10.1056/NEJM199012063232306PubMedGoogle ScholarCrossref
14.
Hendee  WR, Becker  GJ, Borgstede  JP,  et al.  Addressing overutilization in medical imaging.  Radiology. 2010;257(1):240-245. doi:10.1148/radiol.10100063PubMedGoogle ScholarCrossref
15.
Warner  AS, Shah  N, Morse  A,  et al.  Patient and physician attitudes toward low-value diagnostic tests.  JAMA Intern Med. 2016;176(8):1219-1221. doi:10.1001/jamainternmed.2016.2936PubMedGoogle ScholarCrossref
16.
PerryUndem ResearchCommunication; ABIM Foundation.  Unnecessary tests and procedures in the health care system. http://www.choosingwisely.org/wp-content/uploads/2015/04/Final-Choosing-Wisely-Survey-Report.pdf. Published May 1, 2014. Accessed August 9, 2017.
17.
Colla  CH, Kinsella  EA, Morden  NE, Meyers  DJ, Rosenthal  MB, Sequist  TD.  Physician perceptions of Choosing Wisely and drivers of overuse.  Am J Manag Care. 2016;22(5):337-343.PubMedGoogle Scholar
18.
Zikmund-Fisher  BJ, Kullgren  JT, Fagerlin  A, Klamerus  ML, Bernstein  SJ, Kerr  EA.  Perceived barriers to implementing individual Choosing Wisely recommendations in two national surveys of primary care providers.  J Gen Intern Med. 2017;32(2). doi:10.1007/s11606-016-3853-5PubMedGoogle Scholar
19.
The Henry J. Kaiser Family Foundation.  Health Research & Educational Trust. Employer Health Benefits: 2016 Annual Survey. http://www.kff.org/health-costs/report/2016-employer-health-benefits-survey/. Accessed August 9, 2017.
20.
Chou  R, Qaseem  A, Snow  V,  et al.  Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society.  Ann Intern Med. 2007;147(7):478-491. doi:10.7326/0003-4819-147-7-200710020-00006PubMedGoogle ScholarCrossref
21.
Douglas  AC, Wippold  FJ  II, Broderick  DF,  et al.  ACR Appropriateness Criteria headache.  J Am Coll Radiol. 2014;11(7):657-667. doi:10.1016/j.jacr.2014.03.024PubMedGoogle ScholarCrossref
22.
Fiscella  K, Fremont  AM.  Use of geocoding and surname analysis to estimate race and ethnicity.  Health Serv Res. 2006;41(4 Pt 1):1482-1500. doi:10.1111/j.1475-6773.2006.00551.xPubMedGoogle Scholar
23.
Krieger  N.  Overcoming the absence of socioeconomic data in medical records: validation and application of a census-based methodology.  Am J Public Health. 1992;82(5):703-710. doi:10.2105/AJPH.82.5.703PubMedGoogle ScholarCrossref
24.
Krieger  N, Chen  JT, Waterman  PD, Rehkopf  DH, Subramanian  SV.  Race/ethnicity, gender, and monitoring socioeconomic gradients in health: a comparison of area-based socioeconomic measures–the public health disparities geocoding project.  Am J Public Health. 2003;93(10):1655-1671. doi:10.2105/AJPH.93.10.1655PubMedGoogle ScholarCrossref
25.
Trivedi  AN, Rakowski  W, Ayanian  JZ.  Effect of cost sharing on screening mammography in Medicare health plans.  N Engl J Med. 2008;358(4):375-383. doi:10.1056/NEJMsa070929PubMedGoogle ScholarCrossref
26.
Selby  JV, Fireman  BH, Swain  BE.  Effect of a copayment on use of the emergency department in a health maintenance organization.  N Engl J Med. 1996;334(10):635-641. doi:10.1056/NEJM199603073341006PubMedGoogle ScholarCrossref
27.
Trivedi  AN, Zaslavsky  AM, Schneider  EC, Ayanian  JZ.  Relationship between quality of care and racial disparities in Medicare health plans.  JAMA. 2006;296(16):1998-2004. doi:10.1001/jama.296.16.1998PubMedGoogle ScholarCrossref
28.
United States Census Bureau.  Geographical Areas Reference Manual. Washington, DC: US Census Bureau; 1994.
29.
Cassel  CK, Guest  JA.  Choosing wisely: helping physicians and patients make smart decisions about their care.  JAMA. 2012;307(17):1801-1802. doi:10.1001/jama.2012.476PubMedGoogle ScholarCrossref
30.
National Committee for Quality Assurance.  Appendix A: NCQA measure technical specifications. NQF-Endorsed™ National Voluntary Consensus Standards for Physician-Focused Ambulatory Care. Washington, DC: National Committee for Quality Assurance; 2008.
31.
Schwartz  AL, Landon  BE, Elshaug  AG, Chernew  ME, McWilliams  JM.  Measuring low-value care in Medicare.  JAMA Intern Med. 2014;174(7):1067-1076. doi:10.1001/jamainternmed.2014.1541PubMedGoogle ScholarCrossref
32.
Colla  CH, Morden  NE, Sequist  TD, Schpero  WL, Rosenthal  MB.  Choosing wisely: prevalence and correlates of low-value health care services in the United States.  J Gen Intern Med. 2015;30(2):221-228. doi:10.1007/s11606-014-3070-zPubMedGoogle ScholarCrossref
33.
Rosenberg  A, Agiro  A, Gottlieb  M,  et al.  Early trends among seven recommendations from the Choosing Wisely campaign.  JAMA Intern Med. 2015;175(12):1913-1920. doi:10.1001/jamainternmed.2015.5441PubMedGoogle ScholarCrossref
34.
Hong  AS, Ross-Degnan  D, Zhang  F, Wharam  JF.  Small decline in low-value back imaging associated with the “Choosing Wisely” campaign, 2012-14.  Health Aff (Millwood). 2017;36(4):671-679. doi:10.1377/hlthaff.2016.1263PubMedGoogle ScholarCrossref
35.
Rosman  DA, Nsiah  E, Hughes  DR, Duszak  R  Jr.  Regional variation in Medicare payments for medical imaging: radiologists versus nonradiologists.  AJR Am J Roentgenol. 2015;204(5):1042-1048. doi:10.2214/AJR.14.13020PubMedGoogle ScholarCrossref
36.
ABIM Foundation.  Choosing wisely: five things physicians and patients should question.  Choosing Wisely. http://www.choosingwisely.org/wp-content/uploads/2015/01/Choosing-Wisely-Recommendations.pdf. Published April 2012. Accessed June 13, 2016.Google Scholar
37.
Normand  S-LT, Glickman  ME, Gatsonis  CA.  Statistical methods for profiling providers of medical care: issues and applications.  J Am Stat Assoc. 1997;92(439):803-814.Google ScholarCrossref
38.
Shahian  DM, Normand  SL, Torchiana  DF,  et al.  Cardiac surgery report cards: comprehensive review and statistical critique.  Ann Thorac Surg. 2001;72(6):2155-2168.PubMedGoogle ScholarCrossref
39.
Snijders  TAB, Bosker  RJ.  Multilevel Analysis: an Introduction to Basic and Advanced Multilevel Modeling. 2nd ed. London: Sage Publications; 2011.
40.
Wharam  JF, Zhang  F, Landon  BE, LeCates  R, Soumerai  S, Ross-Degnan  D.  Colorectal cancer screening in a nationwide high-deductible health plan before and after the Affordable Care Act.  Med Care. 2016;54(5):466-473. doi:10.1097/MLR.0000000000000521PubMedGoogle ScholarCrossref
41.
Cutler  D, Skinner  J, Stern  AD, Wennberg  D. Physician beliefs and patient preferences: a new look at regional variation in health care spending. National Bureau of Economic Research working paper 19320. http://www.nber.org/papers/w19320. Revised May 10, 2017. Accessed August 9, 2017.
42.
Obermeyer  Z, Powers  BW, Makar  M, Keating  NL, Cutler  DM.  Physician characteristics strongly predict patient enrollment in hospice.  Health Aff (Millwood). 2015;34(6):993-1000. doi:10.1377/hlthaff.2014.1055PubMedGoogle ScholarCrossref
43.
Meeker  D, Linder  JA, Fox  CR,  et al.  Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial.  JAMA. 2016;315(6):562-570. doi:10.1001/jama.2016.0275PubMedGoogle ScholarCrossref
44.
Schwartz  AL, Chernew  ME, Landon  BE, McWilliams  JM.  Changes in low-value services in year 1 of the Medicare Pioneer Accountable Care Organization Program.  JAMA Intern Med. 2015;175(11):1815-1825. doi:10.1001/jamainternmed.2015.4525PubMedGoogle ScholarCrossref
45.
Gerber  JS, Prasad  PA, Fiks  AG,  et al.  Effect of an outpatient antimicrobial stewardship intervention on broad-spectrum antibiotic prescribing by primary care pediatricians: a randomized trial.  JAMA. 2013;309(22):2345-2352. doi:10.1001/jama.2013.6287PubMedGoogle ScholarCrossref
46.
Emanuel  EJ, Ubel  PA, Kessler  JB,  et al.  Using behavioral economics to design physician incentives that deliver high-value care.  Ann Intern Med. 2016;164(2):114-119. doi:10.7326/M15-1330PubMedGoogle ScholarCrossref
47.
Eddy  DM.  Variations in physician practice: the role of uncertainty.  Health Aff (Millwood). 1984;3(2):74-89. doi:10.1377/hlthaff.3.2.74PubMedGoogle ScholarCrossref
48.
Simpkin  AL, Schwartzstein  RM.  Tolerating uncertainty—the next medical revolution?  N Engl J Med. 2016;375(18):1713-1715. doi:10.1056/NEJMp1606402PubMedGoogle ScholarCrossref
49.
Hoffmann  TC, Del Mar  C.  Clinicians’ expectations of the benefits and harms of treatments, screening, and tests: a systematic review.  JAMA Intern Med. 2017;177(3):407-419. doi:10.1001/jamainternmed.2016.8254PubMedGoogle ScholarCrossref
50.
Eisenberg  JM.  Physician utilization. the state of research about physicians’ practice patterns.  Med Care. 1985;23(5):461-483.PubMedGoogle ScholarCrossref
51.
Reschovsky  JD, Rich  EC, Lake  TK.  Factors contributing to variations in physicians’ use of evidence at the point of care: a conceptual model.  J Gen Intern Med. 2015;30(suppl 3):S555-S561. doi:10.1007/s11606-015-3366-7PubMedGoogle ScholarCrossref
52.
Cole  CM.  Physician-owned hospitals and self-referral.  Virtual Mentor. 2013;15(2):150-155. doi:10.1001/virtualmentor.2013.15.2.hlaw1-1302PubMedGoogle ScholarCrossref
53.
Berenson  RA, Ginsburg  PB, Christianson  JB, Yee  T.  The growing power of some providers to win steep payment increases from insurers suggests policy remedies may be needed.  Health Aff (Millwood). 2012;31(5):973-981. doi:10.1377/hlthaff.2011.0920PubMedGoogle ScholarCrossref
54.
Gaynor  M, Town  R. Robert Wood Johnson Foundation. The impact of hospital consolidation—update. http://www.rwjf.org/en/library/research/2012/06/the-impact-of-hospital-consolidation.html. Published June 2012. Accessed August 9, 2017.
55.
Herzlinger  RE.  Let’s put consumers in charge of health care.  Harv Bus Rev. 2002;80(7):44-50, 52-55, 123.PubMedGoogle Scholar
56.
Reddy  SR, Ross-Degnan  D, Zaslavsky  AM, Soumerai  SB, Wharam  JF.  Impact of a high-deductible health plan on outpatient visits and associated diagnostic tests.  Med Care. 2014;52(1):86-92. doi:10.1097/MLR.0000000000000008PubMedGoogle ScholarCrossref
57.
Rolfe  A, Burton  C.  Reassurance after diagnostic testing with a low pretest probability of serious disease: systematic review and meta-analysis.  JAMA Intern Med. 2013;173(6):407-416. doi:10.1001/jamainternmed.2013.2762PubMedGoogle ScholarCrossref
58.
Ubel  PA, Abernethy  AP, Zafar  SY.  Full disclosure—out-of-pocket costs as side effects.  N Engl J Med. 2013;369(16):1484-1486. doi:10.1056/NEJMp1306826PubMedGoogle ScholarCrossref
Original Investigation
Less Is More
November 2017

Clinician-Level Predictors for Ordering Low-Value Imaging

Author Affiliations
  • 1Department of Internal Medicine, University of Texas Southwestern Medical Center, Dallas
  • 2Department of Clinical Science, University of Texas Southwestern Medical Center, Dallas
  • 3Department of Population Medicine, Harvard Pilgrim Health Care Institute, Harvard Medical School, Boston, Massachusetts
JAMA Intern Med. 2017;177(11):1577-1585. doi:10.1001/jamainternmed.2017.4888
Key Points

Question  Given that information concerning geographic variation in health care usage and higher overall radiographic imaging among clinicians who own imaging equipment is well described, is there evidence that ownership of imaging equipment, prior ordering history, and ordering behavior in other clinical scenarios are associated with low-value imaging?

Findings  Clinician specialty, imaging for the prior patient, ownership of imaging equipment, and very high rates of low-value imaging for other clinical scenarios are strong predictors of low-value imaging, after adjusting for patient demographics.

Meaning  There are several strong clinician predictors of low-value imaging that can guide intervention targets to improve the value of care for patients.

Abstract

Importance  Clinicians who order unnecessary radiographic imaging may cause financial harm to patients who have increasing levels of cost sharing. Clinician predictors of low-value imaging are largely unknown.

Objective  To characterize clinician predictors of low-value imaging for acute uncomplicated back pain and headache, including clinicians who saw both conditions.

Design, Setting, and Participants  Multivariate logistic regression modeling of imaging rates after acute uncomplicated back pain and headache visits as indicated by January 2010 to December 2014 commercial insurance claims and demographic data from a large US health insurer. Participants included 100 977 clinicians (primary care physicians, specialist physicians, and chiropractors).

Main Outcomes and Measures  Imaging after acute uncomplicated back pain and headache visits was recorded. We identified whether the clinician’s prior patient received imaging, whether the clinician was an owner of imaging equipment, and the varying impact by clinician specialty. We then used high rates of low-value back imaging as a predictor for low-value headache imaging.

Results  Clinicians conducted 1 007 392 visits for 878 720 adults ages 18 to 64 years with acute uncomplicated back pain; 52 876 primary care physicians conducted visits for 492 805 adults ages 18 to 64 years with acute uncomplicated headache; 34 190 primary care clinicians conducted 405 721 visits for 344 991 adults ages 18 to 64 years with headache and had also conducted at least 4 visits from patients with back pain. If a primary care physician’s prior patient received low-value back imaging, the patient had 1.81 higher odds of low-value imaging (95% CI, 1.77-1.85). This practice effect was larger for chiropractors (odds ratio [OR], 2.80; 95% CI, 2.74-2.86) and specialists (OR, 2.98; 95% CI, 2.88-3.07). For headache, a prior low-value head image predicted 2.00 higher odds of a subsequent head imaging order (95% CI, 1.95-2.06). Clinician ownership of imaging equipment was a consistent independent predictor of low-value imaging (OR, 1.65-7.76) across clinician type and imaging scenario. Primary care physicians with the highest rates of low-value back imaging also had 1.53 (95% CI, 1.45-1.61) higher odds of ordering low-value headache imaging.

Conclusions and Relevance  Clinician characteristics such as ordering low-value imaging on a prior patient, high rates of low-value imaging in another clinical scenario, and ownership of imaging equipment are strong predictors of low-value back and headache imaging. Findings should inform policies that target potentially unnecessary and financially burdensome care.

Introduction

In the quest to contain the rapid growth of medical spending in the United States, policy makers have focused on clinically unnecessary, or low-value, services. Such wasteful care may account for up to one-third of all medical expenditures.1 Low-value services also can uncover findings that trigger downstream cascades of unnecessary care and clinical harm.2

Studies3-7 have found that individual clinician practice variation drives unnecessary care. For example, individual clinician-level variation has been noted in low-value cancer care in Medicare,7 and clinician ownership of imaging equipment has been associated with increased overall imaging use.8-13

Quiz Ref IDClinicians cite patient demand as a major driver of unnecessary medical care, particularly of imaging.14-17 Patient demand for services was the secondmost-cited barrier to avoiding low-value care in a recent physician survey, after malpractice concerns.18 However, commercially insured patients are now responsible for a rapidly growing proportion of their medical expenses,19 which may reduce patient demand for low-value services.

We examined clinician characteristics as predictors for 2 common low-value services: inappropriate back pain and headache imaging. In the absence of certain signs or symptoms indicating a serious underlying cause—such as neurologic problems, history of cancer, or unexplained fever—radiograph, computed tomography (CT), or magnetic resonance imaging (MRI) imaging within the first 6 weeks of acute uncomplicated back pain adds little to no clinical value.20 Similarly, for headache without neurologic symptoms or signs of a serious underlying cause—such as trauma or history of cancer—CT or MRI imaging are not recommended.21

Methods

The Harvard Pilgrim Health Care institutional review board approved the research protocol.

Data Source

We used deidentified Optum data (OptumInsight), a medical claims data set from a large commercial health insurer. It includes enrollment and demographic information for nearly 29 million commercially insured members across all 50 states from January 2010 to December 2014.

Patient Characteristics

Member demographic characteristics included sex and age. From 2000 US census member block group data and a surname-derived ethnicity variable, we used validated approaches to generate an indicator for race/ethnicity.22 As proxies for individual socioeconomic status, we classified neighborhoods as high-poverty and low-education based on the proportion of households below the poverty level or whose members had lower than a high-school education.23-28

Study Outline

Quiz Ref IDWe examined individual clinician predictors by modeling low-value back imaging (study sample 1) for different clinician specialties: primary care physician, chiropractor, and specialist physician. We then examined individual clinician predictors across clinical scenarios by modeling primary care physician ordering behavior for low-value headache imaging (study sample 2), and modeling how back image ordering is associated with headache image ordering (study sample 3).

Study Sample 1: Low-Value Back Imaging by Clinician Type

We identified acute uncomplicated low-back pain visits among patients ages 18 to 64 years (eAppendix 1 in the Supplement). We were guided by the clinical recommendation against inappropriate back pain imaging defined by Choosing Wisely, a campaign developed by the American Board of Internal Medicine Foundation and other medical specialty groups to reduce unnecessary care.29 We also used a well-established claims-based algorithm for low-value back pain imaging in the Healthcare Effectiveness Data and Information Set30 adapted for use in the literature.31-34 The algorithm uses International Classification of Diseases, ninth revision (ICD-9), codes to identify low-back pain visits and exclude high-risk diagnoses, and Current Procedural Terminology (CPT) codes to identify radiograph, CT, and MRI back images.

Clinicians who billed for visits were categorized as primary care physicians if their specialty description included internal medicine, general medicine, or family practice; other nonradiologist, nonemergency physicians were categorized as specialist physicians. The most common specialties (accounting for two-thirds of specialist visits) were orthopedic surgery, neurosurgery, back and spine surgery, physical medicine, and rheumatology. Chiropractors were defined separately.

Ordering Clinician

We used the vendor-generated anonymous identifier for the billing clinician on a visit claim. We attributed ordered images to clinicians by including only images that occurred within 7 days after an index visit with no intervening visits to another clinician. We trimmed to exclude clinicians who billed for more than the 99th percentile of visits in each scenario (62 visits for back pain, 61 visits for headache).

Clinician Ownership of Imaging Equipment

We flagged clinician ownership of imaging equipment by identifying nonradiologist clinicians who billed for technical or global claims for any imaging study, not just low-value imaging. Clinicians who see a patient for the clinic visit and also bill for subsequent imaging can either bill a global claim that includes both the technical component for obtaining the image and a professional fee for interpreting the image, or bill only for the technical component. In line with the literature, clinicians who billed for at least 3 instances of imaging (regardless of clinical appropriateness) with a global claim or technical component were considered to own imaging equipment.7-9,11,35 See Table 1 for rates of imaging equipment ownership.

Study Sample 2: Low-Value Headache Imaging

We created a second study sample to analyze low-value headache imaging among primary care physicians. Our claims-based definition to identify uncomplicated headache visits (eAppendix 1 in the Supplement) was similarly applied to patients ages 18 to 64 years. We were guided by the definition of inappropriate headache imaging as outlined by Choosing Wisely, as well as the literature.31,33,36 We used ICD-9 codes to identify visits and exclude high-risk diagnoses, along with CPT codes for CT and MRI of head images.

We required patients in both samples to be continuously enrolled during the span used to scan for any red-flag diagnoses (12 months prior to the visit for back pain, 3 months prior for headache). We also excluded inpatient and emergency department visits.

Study Sample 3: Subset of Primary Care Physicians Who Saw Both Back Pain and Headache Visits

After creating 2 separate samples of visits for uncomplicated low-back pain and headache, we explored whether primary care physicians with the highest rates of low-value back imaging were also more likely to order low-value headache imaging. We restricted our analysis to primary care physicians who had seen both uncomplicated headache and back pain visits. To define a high rate of low-value back imaging, we eliminated clinicians who had seen fewer than 4 uncomplicated back pain visits, due to the unreliability of imaging rates for clinicians with too few visits. We then defined high-imaging clinicians as those with a low-value back imaging rate at or above the 95th percentile (66.7%), and used this as an independent predictor of low-value headache imaging.

Statistical Analysis

To determine whether individual clinician practice explained a significant proportion of low-value imaging variability, we used a nonlinear random-effects model with logit link function to estimate the level of unexplained variation in low-value imaging across clinicians.7,37,38 We used the clinician identifier as the random effect and generated the logit probability of low-value imaging. From this model, we calculated the median odds ratio of low-value imaging to quantify the between-clinician variation in the use of imaging.39

After developing this estimate of clinician-level variation, we quantified the strength of the clinician effect by developing a logistic regression model to predict low-value imaging after a visit. Drawing from the literature,7 we restricted the sample to clinicians who saw a condition more than once. We used the result of a clinician’s prior encounter as a predictor for low-value imaging in the subsequent patient with the respective condition, excluding a clinician’s first encounter from the sample.

The primary predictor of low-value back and headache imaging in the first 2 samples was the clinician’s prior patient result. The predictors for the third sample, low-value headache imaging among primary care physicians who saw both back pain and headache patients, were the clinician’s prior headache patient result, and also whether the clinician was at or above the 95th percentile for rate of low-value back imaging.

We then added clinician ownership of imaging equipment to each of the models to report its impact on the clinician predictors and its magnitude as an independent predictor.

We also used marginal effects methods with a binary distribution40 to adjust the imaging rate for available covariates (patient age, region, sex, race, poverty level, education level) and clinician predictors. This allowed us to compare imaging rates across clinician subtypes.

We used SAS software version 9.3 (SAS Institute Inc) and Stata/SE v12.1 (StataCorp) for statistical analyses.

Sensitivity Analyses

Study sample 3 included only primary care physicians who saw an uncomplicated headache visit and 4 or more uncomplicated back pain visits. We conducted sensitivity analyses restricting the sample to clinicians who saw at least 5, 6, 7, or 8 uncomplicated back pain visits. We also reanalyzed after adjusting our definition of high rate of low-value back imaging by lowering to the 90th percentile (35.7% imaging rate).

We ran additional analyses controlling for patient out-of-pocket expenses and observed its impact on our results. See eAppendix 3 in the Supplement for a detailed explanation. To account for some patients contributing multiple acute episodes to the samples, we ran additional analyses using the same models but limiting the sample to the patient’s first visit, or a random visit for patients with multiple visits.

Results
Study Sample 1: Low-Value Back Imaging

The cohort of acute uncomplicated low-back pain visits consisted of 1 007 392 visits from 878 720 patients. The sample included visits to 57 859 unique primary care physicians who saw a median (interquartile range [IQR]) of 7 (4-13) acute uncomplicated back pain visits; 27 583 chiropractors who saw a median (IQR) of 10 (5-19) back pain visits; and 15 535 specialist physicians who saw a median (IQR) of 5 (3-9) visits. Refer to Table 1 for a full reporting of clinician and patient visit characteristics.

Quiz Ref IDIn the mixed-effects model with random clinician effect, the median odds ratio was 2.59. This indicates that, compared with another random clinician, the odds that a clinician would order low-value imaging was 2.59 times higher if the clinician had ordered low-value back imaging for the prior patient.

In the multivariate logistic model (Table 2), if a primary care physician had ordered imaging for the prior patient seen for acute uncomplicated low-back pain, the odds of imaging were 2.08 times higher (95% CI, 2.04-2.12) than for clinicians who did not previously order imaging. Adjusting for clinician ownership of imaging equipment attenuated the effect to 1.81 (95% CI, 1.77-1.85).

For chiropractors and specialists, there were varying, but overall higher, odds of low-value back imaging if the prior patient had received imaging (chiropractors: 2.80; 95% CI, 2.74-2.86 vs specialists: 2.98; 95% CI, 2.88-3.07). For all 3 clinician types, ownership of imaging equipment was a significant independent predictor of low-value back imaging: primary care physicians had 2.06 increased odds (95% CI, 2.03-2.10); chiropractors had 7.76 increased odds (95% CI, 7.51-8.01); and specialist physicians had 4.96 increased odds (95% CI, 4.78-5.15). See Table 3 for predictors by clinician type.

Study Sample 2: Low-Value Headache Imaging

The cohort of acute uncomplicated headache visits consisted of 492 804 visits from 417 010 patients. The overall imaging rate was 7.5%. Patients were seen by 52 876 unique primary care physicians, who saw a median (IQR) of 7 (4-13) acute uncomplicated headache visits.

In the mixed-effects model with random clinician effect, the median odds ratio was 2.49. This indicates that, compared with another random clinician, the odds that a clinician would order low-value imaging was 2.49-fold higher if the clinician had ordered low-value headache imaging for the prior patient.

In the multivariate logistic model (Table 2), if a clinician had ordered imaging for the prior patient seen for uncomplicated headache, the odds of imaging were 2.20 higher (95% CI, 2.13-2.25). Adjusting for clinician ownership of imaging equipment attenuated the result to 2.00 (95% CI, 1.95-2.06). Ownership of imaging equipment independently predicted 1.88 higher odds of low-value imaging (95% CI, 1.82-1.94).

Study Sample 3: Whether High Rate of Back Imaging Predicts Low-Value Headache Imaging

The 34 190 unique primary care physicians who saw patients with both conditions of interest accounted for 405 721 headache visits from 344 991 patients. The median (IQR) number of headache visits for these clinicians was 9 (5-17). Clinicians actively generated claims for a median (IQR) of 7 (5-8) quarters.

In the multivariate logistic model (Table 2), if a primary care physician had ordered imaging for the prior patient with a headache, the odds of head imaging were 1.91 higher (95% CI, 1.84-1.97). Adjusting for ownership of imaging equipment attenuated this effect to 1.80 (95% CI, 1.74-1.86), and ownership of imaging equipment remained an independent predictor of low-value headache imaging (odds ratio, 1.65; 95% CI, 1.59-1.72).

Finally, if the clinician exhibited a high rate of low-value back imaging (≥ 66.7%), then there were 1.78 higher odds of low-value headache imaging (95% CI, 1.69-1.86), an effect that persisted after adjusting for ownership (1.53; 95% CI, 1.45-1.61). See Table 4 for the impact of addition of ownership to the model across clinical scenarios.

With a concern for collinearity between high rates of low-value back imaging and imaging equipment ownership, we reanalyzed the model without the high rate of low-value back imaging and the odds ratio for ownership changed minimally, suggesting minimal collinearity (eAppendix 2 and eTable 1 in the Supplement).

Adjusted Imaging Rates

Adjusted imaging rates are summarized in Table 5. The 1.81 increased odds of low-value back imaging for primary care physicians who ordered prior imaging translated to an adjusted imaging rate of 20.3% (95% CI, 20.0%-20.6%) among those who ordered prior imaging vs 12.5% (95% CI, 12.4%-12.6%) among those who did not. The 1.53 increased odds of low-value headache imaging for primary care physicians who had high rates of low-value back imaging translated to an adjusted rate of 11.2% (95% CI, 10.7%-11.7%) among frequent imagers vs 7.6% (95% CI, 7.5%-7.7%) among infrequent imagers.

Sensitivity Analyses

Sensitivity analyses using higher minimum numbers of back pain visits (from 4 to 8 visits) to define clinicians with a high rate of low-value back imaging did not change results. Lowering the threshold to define high rate of low-value back imaging from the 95th percentile of clinicians to the 90th percentile led to small decreases in the magnitude of the clinician-level predictors that do not alter our overall findings (eAppendix 2 and eTable 1 in the Supplement).

Controlling for expected patient out-of-pocket expenditure for imaging led to nearly imperceptible changes to our results (eAppendix 3 and eTable 2 in the Supplement). Running the models on only a patient’s first visit or a random visit for patients with multiple visits also did not change our conclusions (eAppendix 4 and eTable 3 in the Supplement).

Discussion

Quiz Ref IDAmong commercially insured patients, a clinician’s prior imaging pattern and ownership of imaging equipment were strong independent predictors of low-value back pain and headache imaging. The magnitude of these associations was greater among chiropractors and specialists. Primary care physicians who exhibited the highest rates of low-value back pain imaging also had higher odds of ordering low-value headache imaging.

Similar to prior studies, our findings confirm clinician-level variation in imaging,11,41,42 specifically low-value imaging.7 Although prior studies associated ownership of imaging equipment with higher rates of radiological imaging,8-13 we add the finding that such patterns persist specifically for low-value imaging and across clinician types. Delving into explanations for the different rates of low-value imaging across these clinician types deserves further study.

Our finding that primary care physicians with very high rates of low-value back pain imaging have increased odds of ordering low-value headache imaging adds to the literature by identifying clinicians who order more low-value imaging across multiple clinical scenarios. Some approaches to change clinician behavior have shown promise,43-46 particularly audit-feedback mechanisms, where clinicians receive regular feedback on specific performance metrics, in comparison to peers. However, targeting each clinical scenario individually might not address underlying drivers such as varying levels of discomfort with clinical uncertainty,47,48 overestimating the benefits of testing,49 group practice trends,50 and other practice-related factors.51 It also does not directly address the pervasive fear of malpractice. Other interventions are needed to improve communication between patients and clinicians, and to help both sides deal with uncertainty in clinical decision making.

Addressing ownership, previous legislation has limited imaging equipment ownership and clinician self-referral; however, exceptions have been made for patient convenience and evolving practice models. As a result, these laws may be less effective than intended.8,52 Although there are payment programs that hold health care provider groups responsible for the cost of care, early evidence shows that their effectiveness at reducing low-value care has been modest, even among self-selected provider groups.44 Finally, ongoing consolidation of practices and health systems may have an impact on low-value care usage that remains underexplored.53,54

Our findings also have implications for patients. Commercially insured patients have experienced large increases in cost sharing, particularly under high-deductible health plans.19 Cost sharing is promoted as a means of motivating patients to avoid unnecessary care,55 yet it is not clear that financially motivated patients are able to avoid low-value imaging.34,56 Previous research has found that patients gain little reassurance from a negative low-value study,57 and because of increasing patient cost sharing, low-value imaging will increasingly cause “financial toxicity”58 to patients. Future interventions to reduce low-value care could attempt to convey these important findings to patients and clinicians.

Limitations

Our study had several limitations. Quiz Ref IDWe were unable to adjust for potentially relevant clinician characteristics such as training, demographics, practice type, and compensation structures. Although ownership of imaging equipment captures a very important financial incentive, we do not capture arrangements where clinicians might gain financially despite not directly billing for imaging. We focused our analysis on outpatient visits because clinician identifiers did not adequately distinguish individual clinicians in nonoutpatient settings, limiting generalizability of our findings to other settings such as the emergency department. Additionally, our findings apply only to commercially insured patients. Finally, claims data might not fully capture concerning signs or symptoms of low-back pain and headaches, but we used standard claims-based definitions and any misclassification is unlikely to be large enough to change our conclusions.

Conclusions

Among commercially insured patients, strong predictors of low-value back pain and headache imaging included a clinician’s history of ordering low-value imaging, a high rate of imaging in another low-value clinical scenario, and clinician ownership of imaging equipment. Stakeholders should use this information to design clinician-targeted interventions to reduce low-value care.

Back to top
Article Information

Corresponding Author: Arthur S. Hong, MD, MPH, Departments of Internal Medicine and Clinical Science, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390-9169 (arh163@mail.harvard.edu).

Accepted for Publication: July 26, 2017.

Published Online: September 25, 2017. doi:10.1001/jamainternmed.2017.4888

Author Contributions: Dr Hong had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Hong, Ross-Degnan, Wharam.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Hong, Wharam.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Hong, Zhang.

Obtained funding: Hong, Wharam.

Administrative, technical, or material support: Wharam.

Study supervision: Ross-Degnan, Wharam.

Conflict of Interest Disclosures: None reported.

Funding/Support: This work was supported by an Institutional National Research Service Award (award No. T32HP12706), the Ryoichi Sasakawa Fellowship Fund, and the Harvard Pilgrim Health Care Institute.

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

References
1.
Berwick  DM, Hackbarth  AD.  Eliminating waste in US health care.  JAMA. 2012;307(14):1513-1516. doi:10.1001/jama.2012.362PubMedGoogle ScholarCrossref
2.
Mold  JW, Stein  HF.  The cascade effect in the clinical care of patients.  N Engl J Med. 1986;314(8):512-514. doi:10.1056/NEJM198602203140809PubMedGoogle ScholarCrossref
3.
McEwen  LN, Farjo  R, Foxman  B.  Antibiotic prescribing for cystitis: how well does it match published guidelines?  Ann Epidemiol. 2003;13(6):479-483. doi:10.1016/S1047-2797(03)00009-7PubMedGoogle ScholarCrossref
4.
Kale  MS, Bishop  TF, Federman  AD, Keyhani  S.  Trends in the overuse of ambulatory health care services in the United States.  JAMA Intern Med. 2013;173(2):142-148. doi:10.1001/2013.jamainternmed.1022PubMedGoogle ScholarCrossref
5.
Taur  Y, Smith  MA.  Adherence to the Infectious Diseases Society of America guidelines in the treatment of uncomplicated urinary tract infection.  Clin Infect Dis. 2007;44(6):769-774. doi:10.1086/511866PubMedGoogle ScholarCrossref
6.
Sharp  AL, Klau  MH, Keschner  D,  et al.  Low-value care for acute sinusitis encounters: who’s choosing wisely?  Am J Manag Care. 2015;21(7):479-485.PubMedGoogle Scholar
7.
Lipitz-Snyderman  A, Sima  CS, Atoria  CL,  et al.  Physician-driven variation in nonrecommended services among older adults diagnosed with cancer.  JAMA Intern Med. 2016;176(10):1541-1548. doi:10.1001/jamainternmed.2016.4426PubMedGoogle ScholarCrossref
8.
Mitchell  JM.  The prevalence of physician self-referral arrangements after Stark II: evidence from advanced diagnostic imaging.  Health Aff (Millwood). 2007;26(3):w415-w424. doi:10.1377/hlthaff.26.3.w415PubMedGoogle ScholarCrossref
9.
Levin  DC, Rao  VM, Parker  L, Frangos  AJ, Sunshine  JH.  Ownership or leasing of MRI facilities by nonradiologist physicians is a rapidly growing trend.  J Am Coll Radiol. 2008;5(2):105-109. doi:10.1016/j.jacr.2007.09.017PubMedGoogle ScholarCrossref
10.
Levin  DC, Rao  VM.  The effect of self-referral on utilization of advanced diagnostic imaging.  AJR Am J Roentgenol. 2011;196(4):848-852. doi:10.2214/AJR.10.5823PubMedGoogle ScholarCrossref
11.
Baker  LC.  Acquisition of MRI equipment by doctors drives up imaging use and spending.  Health Aff (Millwood). 2010;29(12):2252-2259. doi:10.1377/hlthaff.2009.1099PubMedGoogle ScholarCrossref
12.
Sharpe  RE, Nazarian  LN, Parker  L, Rao  VM, Levin  DC.  Dramatically increased musculoskeletal ultrasound utilization from 2000 to 2009, especially by podiatrists in private offices.  J Am Coll Radiol. 2012;9(2):141-146. doi:10.1016/j.jacr.2011.09.008PubMedGoogle ScholarCrossref
13.
Hillman  BJ, Joseph  CA, Mabry  MR, Sunshine  JH, Kennedy  SD, Noether  M.  Frequency and costs of diagnostic imaging in office practice–a comparison of self-referring and radiologist-referring physicians.  N Engl J Med. 1990;323(23):1604-1608. doi:10.1056/NEJM199012063232306PubMedGoogle ScholarCrossref
14.
Hendee  WR, Becker  GJ, Borgstede  JP,  et al.  Addressing overutilization in medical imaging.  Radiology. 2010;257(1):240-245. doi:10.1148/radiol.10100063PubMedGoogle ScholarCrossref
15.
Warner  AS, Shah  N, Morse  A,  et al.  Patient and physician attitudes toward low-value diagnostic tests.  JAMA Intern Med. 2016;176(8):1219-1221. doi:10.1001/jamainternmed.2016.2936PubMedGoogle ScholarCrossref
16.
PerryUndem ResearchCommunication; ABIM Foundation.  Unnecessary tests and procedures in the health care system. http://www.choosingwisely.org/wp-content/uploads/2015/04/Final-Choosing-Wisely-Survey-Report.pdf. Published May 1, 2014. Accessed August 9, 2017.
17.
Colla  CH, Kinsella  EA, Morden  NE, Meyers  DJ, Rosenthal  MB, Sequist  TD.  Physician perceptions of Choosing Wisely and drivers of overuse.  Am J Manag Care. 2016;22(5):337-343.PubMedGoogle Scholar
18.
Zikmund-Fisher  BJ, Kullgren  JT, Fagerlin  A, Klamerus  ML, Bernstein  SJ, Kerr  EA.  Perceived barriers to implementing individual Choosing Wisely recommendations in two national surveys of primary care providers.  J Gen Intern Med. 2017;32(2). doi:10.1007/s11606-016-3853-5PubMedGoogle Scholar
19.
The Henry J. Kaiser Family Foundation.  Health Research & Educational Trust. Employer Health Benefits: 2016 Annual Survey. http://www.kff.org/health-costs/report/2016-employer-health-benefits-survey/. Accessed August 9, 2017.
20.
Chou  R, Qaseem  A, Snow  V,  et al.  Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society.  Ann Intern Med. 2007;147(7):478-491. doi:10.7326/0003-4819-147-7-200710020-00006PubMedGoogle ScholarCrossref
21.
Douglas  AC, Wippold  FJ  II, Broderick  DF,  et al.  ACR Appropriateness Criteria headache.  J Am Coll Radiol. 2014;11(7):657-667. doi:10.1016/j.jacr.2014.03.024PubMedGoogle ScholarCrossref
22.
Fiscella  K, Fremont  AM.  Use of geocoding and surname analysis to estimate race and ethnicity.  Health Serv Res. 2006;41(4 Pt 1):1482-1500. doi:10.1111/j.1475-6773.2006.00551.xPubMedGoogle Scholar
23.
Krieger  N.  Overcoming the absence of socioeconomic data in medical records: validation and application of a census-based methodology.  Am J Public Health. 1992;82(5):703-710. doi:10.2105/AJPH.82.5.703PubMedGoogle ScholarCrossref
24.
Krieger  N, Chen  JT, Waterman  PD, Rehkopf  DH, Subramanian  SV.  Race/ethnicity, gender, and monitoring socioeconomic gradients in health: a comparison of area-based socioeconomic measures–the public health disparities geocoding project.  Am J Public Health. 2003;93(10):1655-1671. doi:10.2105/AJPH.93.10.1655PubMedGoogle ScholarCrossref
25.
Trivedi  AN, Rakowski  W, Ayanian  JZ.  Effect of cost sharing on screening mammography in Medicare health plans.  N Engl J Med. 2008;358(4):375-383. doi:10.1056/NEJMsa070929PubMedGoogle ScholarCrossref
26.
Selby  JV, Fireman  BH, Swain  BE.  Effect of a copayment on use of the emergency department in a health maintenance organization.  N Engl J Med. 1996;334(10):635-641. doi:10.1056/NEJM199603073341006PubMedGoogle ScholarCrossref
27.
Trivedi  AN, Zaslavsky  AM, Schneider  EC, Ayanian  JZ.  Relationship between quality of care and racial disparities in Medicare health plans.  JAMA. 2006;296(16):1998-2004. doi:10.1001/jama.296.16.1998PubMedGoogle ScholarCrossref
28.
United States Census Bureau.  Geographical Areas Reference Manual. Washington, DC: US Census Bureau; 1994.
29.
Cassel  CK, Guest  JA.  Choosing wisely: helping physicians and patients make smart decisions about their care.  JAMA. 2012;307(17):1801-1802. doi:10.1001/jama.2012.476PubMedGoogle ScholarCrossref
30.
National Committee for Quality Assurance.  Appendix A: NCQA measure technical specifications. NQF-Endorsed™ National Voluntary Consensus Standards for Physician-Focused Ambulatory Care. Washington, DC: National Committee for Quality Assurance; 2008.
31.
Schwartz  AL, Landon  BE, Elshaug  AG, Chernew  ME, McWilliams  JM.  Measuring low-value care in Medicare.  JAMA Intern Med. 2014;174(7):1067-1076. doi:10.1001/jamainternmed.2014.1541PubMedGoogle ScholarCrossref
32.
Colla  CH, Morden  NE, Sequist  TD, Schpero  WL, Rosenthal  MB.  Choosing wisely: prevalence and correlates of low-value health care services in the United States.  J Gen Intern Med. 2015;30(2):221-228. doi:10.1007/s11606-014-3070-zPubMedGoogle ScholarCrossref
33.
Rosenberg  A, Agiro  A, Gottlieb  M,  et al.  Early trends among seven recommendations from the Choosing Wisely campaign.  JAMA Intern Med. 2015;175(12):1913-1920. doi:10.1001/jamainternmed.2015.5441PubMedGoogle ScholarCrossref
34.
Hong  AS, Ross-Degnan  D, Zhang  F, Wharam  JF.  Small decline in low-value back imaging associated with the “Choosing Wisely” campaign, 2012-14.  Health Aff (Millwood). 2017;36(4):671-679. doi:10.1377/hlthaff.2016.1263PubMedGoogle ScholarCrossref
35.
Rosman  DA, Nsiah  E, Hughes  DR, Duszak  R  Jr.  Regional variation in Medicare payments for medical imaging: radiologists versus nonradiologists.  AJR Am J Roentgenol. 2015;204(5):1042-1048. doi:10.2214/AJR.14.13020PubMedGoogle ScholarCrossref
36.
ABIM Foundation.  Choosing wisely: five things physicians and patients should question.  Choosing Wisely. http://www.choosingwisely.org/wp-content/uploads/2015/01/Choosing-Wisely-Recommendations.pdf. Published April 2012. Accessed June 13, 2016.Google Scholar
37.
Normand  S-LT, Glickman  ME, Gatsonis  CA.  Statistical methods for profiling providers of medical care: issues and applications.  J Am Stat Assoc. 1997;92(439):803-814.Google ScholarCrossref
38.
Shahian  DM, Normand  SL, Torchiana  DF,  et al.  Cardiac surgery report cards: comprehensive review and statistical critique.  Ann Thorac Surg. 2001;72(6):2155-2168.PubMedGoogle ScholarCrossref
39.
Snijders  TAB, Bosker  RJ.  Multilevel Analysis: an Introduction to Basic and Advanced Multilevel Modeling. 2nd ed. London: Sage Publications; 2011.
40.
Wharam  JF, Zhang  F, Landon  BE, LeCates  R, Soumerai  S, Ross-Degnan  D.  Colorectal cancer screening in a nationwide high-deductible health plan before and after the Affordable Care Act.  Med Care. 2016;54(5):466-473. doi:10.1097/MLR.0000000000000521PubMedGoogle ScholarCrossref
41.
Cutler  D, Skinner  J, Stern  AD, Wennberg  D. Physician beliefs and patient preferences: a new look at regional variation in health care spending. National Bureau of Economic Research working paper 19320. http://www.nber.org/papers/w19320. Revised May 10, 2017. Accessed August 9, 2017.
42.
Obermeyer  Z, Powers  BW, Makar  M, Keating  NL, Cutler  DM.  Physician characteristics strongly predict patient enrollment in hospice.  Health Aff (Millwood). 2015;34(6):993-1000. doi:10.1377/hlthaff.2014.1055PubMedGoogle ScholarCrossref
43.
Meeker  D, Linder  JA, Fox  CR,  et al.  Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial.  JAMA. 2016;315(6):562-570. doi:10.1001/jama.2016.0275PubMedGoogle ScholarCrossref
44.
Schwartz  AL, Chernew  ME, Landon  BE, McWilliams  JM.  Changes in low-value services in year 1 of the Medicare Pioneer Accountable Care Organization Program.  JAMA Intern Med. 2015;175(11):1815-1825. doi:10.1001/jamainternmed.2015.4525PubMedGoogle ScholarCrossref
45.
Gerber  JS, Prasad  PA, Fiks  AG,  et al.  Effect of an outpatient antimicrobial stewardship intervention on broad-spectrum antibiotic prescribing by primary care pediatricians: a randomized trial.  JAMA. 2013;309(22):2345-2352. doi:10.1001/jama.2013.6287PubMedGoogle ScholarCrossref
46.
Emanuel  EJ, Ubel  PA, Kessler  JB,  et al.  Using behavioral economics to design physician incentives that deliver high-value care.  Ann Intern Med. 2016;164(2):114-119. doi:10.7326/M15-1330PubMedGoogle ScholarCrossref
47.
Eddy  DM.  Variations in physician practice: the role of uncertainty.  Health Aff (Millwood). 1984;3(2):74-89. doi:10.1377/hlthaff.3.2.74PubMedGoogle ScholarCrossref
48.
Simpkin  AL, Schwartzstein  RM.  Tolerating uncertainty—the next medical revolution?  N Engl J Med. 2016;375(18):1713-1715. doi:10.1056/NEJMp1606402PubMedGoogle ScholarCrossref
49.
Hoffmann  TC, Del Mar  C.  Clinicians’ expectations of the benefits and harms of treatments, screening, and tests: a systematic review.  JAMA Intern Med. 2017;177(3):407-419. doi:10.1001/jamainternmed.2016.8254PubMedGoogle ScholarCrossref
50.
Eisenberg  JM.  Physician utilization. the state of research about physicians’ practice patterns.  Med Care. 1985;23(5):461-483.PubMedGoogle ScholarCrossref
51.
Reschovsky  JD, Rich  EC, Lake  TK.  Factors contributing to variations in physicians’ use of evidence at the point of care: a conceptual model.  J Gen Intern Med. 2015;30(suppl 3):S555-S561. doi:10.1007/s11606-015-3366-7PubMedGoogle ScholarCrossref
52.
Cole  CM.  Physician-owned hospitals and self-referral.  Virtual Mentor. 2013;15(2):150-155. doi:10.1001/virtualmentor.2013.15.2.hlaw1-1302PubMedGoogle ScholarCrossref
53.
Berenson  RA, Ginsburg  PB, Christianson  JB, Yee  T.  The growing power of some providers to win steep payment increases from insurers suggests policy remedies may be needed.  Health Aff (Millwood). 2012;31(5):973-981. doi:10.1377/hlthaff.2011.0920PubMedGoogle ScholarCrossref
54.
Gaynor  M, Town  R. Robert Wood Johnson Foundation. The impact of hospital consolidation—update. http://www.rwjf.org/en/library/research/2012/06/the-impact-of-hospital-consolidation.html. Published June 2012. Accessed August 9, 2017.
55.
Herzlinger  RE.  Let’s put consumers in charge of health care.  Harv Bus Rev. 2002;80(7):44-50, 52-55, 123.PubMedGoogle Scholar
56.
Reddy  SR, Ross-Degnan  D, Zaslavsky  AM, Soumerai  SB, Wharam  JF.  Impact of a high-deductible health plan on outpatient visits and associated diagnostic tests.  Med Care. 2014;52(1):86-92. doi:10.1097/MLR.0000000000000008PubMedGoogle ScholarCrossref
57.
Rolfe  A, Burton  C.  Reassurance after diagnostic testing with a low pretest probability of serious disease: systematic review and meta-analysis.  JAMA Intern Med. 2013;173(6):407-416. doi:10.1001/jamainternmed.2013.2762PubMedGoogle ScholarCrossref
58.
Ubel  PA, Abernethy  AP, Zafar  SY.  Full disclosure—out-of-pocket costs as side effects.  N Engl J Med. 2013;369(16):1484-1486. doi:10.1056/NEJMp1306826PubMedGoogle ScholarCrossref
×