Context Data are sparse on the effect of varying the durations of internal medicine attending physician ward rotations.
Objective To compare the effects of 2- vs 4-week inpatient attending physician rotations on unplanned patient revisits, attending evaluations by trainees, and attending propensity for burnout.
Design, Setting, and Participants Cluster randomized crossover noninferiority trial, with attending physicians as the unit of crossover randomization and 4-week rotations as the active control, conducted in a US university-affiliated teaching hospital in academic year 2009. Participants were 62 attending physicians who staffed at least 6 weeks of inpatient service, the 8892 unique patients whom they discharged, and the 147 house staff and 229 medical students who evaluated their performance.
Intervention Assignment to random sequences of 2- and 4-week rotations.
Main Outcome Measures Primary outcome was 30-day unplanned revisits (visits to the hospital's emergency department or urgent ambulatory clinic, unplanned readmissions, and direct transfers from neighboring hospitals) for patients discharged from 2- vs 4-week within-attending-physician rotations. Noninferiority margin was a 2% increase (odds ratio [OR] of 1.13) in 30-day unplanned patient revisits. Secondary outcomes were length of stay; trainee evaluations of attending physicians; and attending physician reports of burnout, stress, and workplace control.
Results Among the 8892 patients, there were 2437 unplanned revisits. The percentage of 30-day unplanned revisits for patients of attending physicians on 2-week rotations was 21.2% compared with 21.5% for 4-week rotations (mean difference, –0.3%; 95% CI, –1.8% to +1.2%). The adjusted OR of a patient having a 30-day unplanned revisit after 2- vs 4-week rotations was 0.97 (1-sided 97.5% upper confidence limit, 1.07; noninferiority P = .007). Average length of stay was not significantly different (geometric means for 2- vs 4-week rotations were 67.2 vs 67.5 hours; difference, –0.9%; 95% CI, –4.7% to +2.9%). Attending physicians were more likely to score lower in their ability to evaluate trainees after 2- vs 4-week rotations by both house staff (41% vs 28% rated less than perfect; adjusted OR, 2.10; 95% CI, 1.50-3.02) and medical students (82% vs 69% rated less than perfect; adjusted OR, 1.41; 95% CI, 1.06-2.10). They were less likely to report higher scores of both burnout severity (16% vs 35%; adjusted OR, 0.39; 95% CI, 0.26-0.58) and emotional exhaustion (19% vs 37%; adjusted OR, 0.45; 95% CI, 0.31 to 0.64) after 2- vs 4-week rotations.
Conclusions The use of 2-week inpatient attending physician rotations compared with 4-week rotations did not result in an increase in unplanned patient revisits. It was associated with better self-rated measures of attending physician burnout and emotional exhaustion but worse evaluations by trainees.
Trial Registration clinicaltrials.gov Identifier: NCT00930111
Trainees learn inpatient medicine on the job, providing clinical care to patients as members of ward teams led by attending physicians. Although the structures of these ward teams vary by local educational heritage and hospital policy,1,2 a prevailing trait is that attending physicians are assigned to them for only 2 continuous weeks—a duration that is half of the previous standard.3,4
Both trainees3 and educational leaders5 have decried short rotations as disruptive because they truncate student-teacher relationships. Shorter rotations may nonetheless benefit the psychological health of attending physicians, whose responsibilities are oversubscribed.4,6 In particular, if shorter rotations can lessen attending physician burnout, they may improve physicians' relationships with patients and the quality of care that patients receive.7,8
Therefore, to weigh the effects of shorter rotations on patients, trainees, and attending physicians, we first assessed whether the outcomes most proximate to policy—effects on patients,9 as assessed by unplanned revisit rates—differ between 2- and 4-week rotations. We then assessed how trainees' ratings of attending physicians' performance and the self-rated psychological health of attending physicians were affected by these rotation durations.
We compared general medicine attending physicians' outcomes from 2- vs 4-week rotations in a cluster randomized crossover noninferiority trial (Figure 1). Treating attending physicians as clusters obviated allocation of individual patients to 2- or 4-week rotations10; a crossover design bolstered statistical power by using attending physicians as their own controls11,12; and noninferiority acknowledged the potentially offsetting benefits of shorter rotations.3 No changes were made to the study design or outcomes after the trial commenced. The hospital institutional review board approved the study protocol without requirement for consent from participating attending physicians, trainees, or patients.
The study was conducted on the general medicine inpatient service of a 500-bed public teaching hospital in Chicago, Illinois, during 1 academic year, from July 2009 through June 2010. Attending physicians were eligible if they were scheduled for at least 6 weeks of service. Patients were eligible if they were discharged alive from eligible physicians' services but were excluded from the analysis of unplanned revisits if they had a planned readmission within 30 days of discharge from the index hospitalization.
The study protocol did not affect the standard way that patients were allocated to the general medicine service, which comprised 12 teams. An attending physician led each team of 4 house staff (2 first-year and 2 second- or third-year postgraduates) and 0 to 3 medical students (0 to 2 third- and 0 or 1 fourth-year students). Every 4 days, each team admitted up to 14 new patients from a central electronic queue. The study protocol did not affect the hospital department of medicine's expectations for attending physicians. Every day, attending physicians were expected to personally visit each patient, to review the care plan of each patient with the team, and to complete a note or cosign a senior house staff member's note in the electronic medical record of each patient. Attending physicians were also expected to finalize all decisions regarding discharges and transfers.
Randomization and Interventions
Details of assignment of attending physicians to random sequences of 2- and 4-week rotations are provided in the eAppendix. Stratified block randomization was used to achieve 2 goals: patients would have an equal chance of being admitted to a 2- or 4-week rotation and attending physicians and ward teams would have a balanced number of weeks from 2- and 4-week rotations throughout the academic year. Attending physicians were not blinded to their rotation assignments because the yearlong rotation schedule was distributed 3 months before the study commenced. Attending physicians, trainees, and patients were, nonetheless, blinded to the study hypothesis.
To minimize the carryover effects of rotation types within attending physicians, prespecified washout durations were based on the opinions of administrative leaders at our hospital. Because outpatient-oriented attending physicians reduce their clinic schedules while staffing inpatient rotations, urgent backlogs of clinic appointments aggregate around these rotations, with volume proportionate to rotation lengths. Thus, we set the washout for a rotation staffed by an outpatient-oriented attending physician to be the sum of the preceding rotation duration plus half of the succeeding rotation duration. For example, the washout period between a 2-week rotation followed by a 4-week rotation was 4 weeks. For inpatient-oriented attending physicians, who generally do not staff outpatient clinics, the washout duration was 2 weeks regardless of rotation type.
Patient Outcomes. The primary outcome was any unplanned revisit to the same hospital within 30 days of discharge. This included visits to the hospital's emergency department or urgent ambulatory clinic, direct transfers from neighboring hospitals, and readmissions that were not planned.13 Length of stay, a secondary outcome, was measured as the duration of a patient's last uninterrupted stay on the general medicine service until discharge. Thus, length of stay for a patient initially admitted to another service was measured from the time of transfer to the general medicine service rather than the time of admission to the hospital. We chose this duration over one that includes time spent on other services to heighten the sensitivity of this outcome to attending physician behavior.
Trainee Evaluations of Attending Physician Performance. Evaluations of attending physicians by both house staff and medical students were confidential and self-administered. House staff received single electronic evaluations at the end of each study rotation (eTable 1). Medical students received multiple paper evaluations for all relevant study rotations at the end of their clerkship rotations at our hospital (eTable 2). Because house staff rotations coincided with crossover periods, house staff evaluated attending physicians who supervised them for full 2- or 4-week durations. In contrast, medical student rotations did not coincide with crossover periods, so they evaluated attending physicians who had supervised them for varied fractions of 2- or 4-week durations. The house staff evaluation had been formally validated,14 whereas the medical student evaluation was developed de novo and a pilot study (2 groups of 12 medical students) was conducted to verify that the evaluation had face and content validity.
Both trainee evaluations had similar sets of domains. Mean summary scores were grouped for nonmissing items in each questionnaire domain into ordinal categories because of trainees' tendency to choose high response scores.14-16 A summary score was defined as perfect when individual scores for all nonmissing domain-specific items were the highest possible. A nonperfect summary score was defined as either low or high depending on whether the average domain-specific score was respectively below or above the median of all trainees' nonperfect evaluation scores for that domain.
Attending Physician Burnout. Four separate facets of attending physician burnout were assessed at the end of each rotation. Research assistants accessed a password-protected online questionnaire (eTable 3) when most convenient for attending physicians. The questionnaire was devised from a conceptual model of burnout17,18 that was refined among outpatient-oriented physicians in 2 large cross-sectional surveys.19,20 The model posits that workplace characteristics, most importantly physician control,21-23 affect physicians' perception of stress and, in turn, their burnout.19 Therefore, measures of control and stress were included to substantiate their proximate roles in burnout: 8 items from Minimizing Error, Maximizing Outcomes20 that were relevant to a hospital workplace control and 4 items from the short version of the Perceived Stress Scale.24 Emotional exhaustion—the initial25 and core26 facet of burnout—was measured using 9 items from the Maslach Burnout Inventory Human Services Survey27,28 and a single-item measure from the National Job Burnout Survey that uses a personal definition of burnout.29,30
Each facet of attending physician burnout was analyzed separately. Facet is used to refer to the components of the burnout assessment instead of domain because only emotional exhaustion is a burnout domain; the others are burnout contributors (inadequate workplace control and perceived control) and a single-item summary of burnout. Mean summary scores were grouped for nonmissing items from each facet into 3 ordinal categories depending on whether the mean domain-specific score was below the 25th percentile (low), between the 25th and 75th percentiles (intermediate), or above the 75th percentile (high) of the mean domain score of all attending physician assessments. For the single burnout question, a high severity score (3 or higher) represents burnout.23,30
The study was powered to assess the noninferiority of 30-day unplanned revisits after discharge from 2- vs 4-week rotations within attending physician. Based on retrospective data, it was estimated that 20% of patients discharged from general medicine teams had 30-day unplanned revisits and that the standard deviation of this estimate across attending physicians was 5.3%. It was judged a priori that, when 30-day unplanned revisits from 2- vs 4-week rotations are compared within attending physician, an absolute increase of 2 percentage points would be unacceptable.31 After converting this increase to a relative scale,32 noninferiority was established as an odds ratio (OR) of less than 1.13. Under 3 simplifying but conservative
assumptions (eAppendix), it was estimated that a sample size of 55 attending physicians would provide a power of 80% to detect a noninferior difference between groups, assuming a 1-sided α = .025.
Outcome variables were transformed to meet the assumptions of the statistical models and to improve interpretation of the estimates. For length of stay, rightward skew was accounted for with logarithmic transformation. For trainee evaluations and assessments of attending physician burnout, the ordinal score categories and severity assessments were transformed so that the direction of favorability was consistent across measurements: lower trainee evaluation score categories aligned with higher attending physician burnout severity assessments.
Mixed-effects regression was used to analyze the data; details of model specification and estimation procedures are provided in the
eAppendix and the
eFigure. Briefly, fixed effects were used to control for ward team and crossover period, thereby adjusting for potential differences in outcomes due to rotation characteristics other than duration. Random effects were used to both incorporate repeated measurements (due to the crossover design) and account for correlations among members of groupings, such as patients discharged by the same attending physician during the same rotation. For construction of confidence intervals for unadjusted proportions and means, we used variances that account for correlations among repeat measurements on the same patients.33 For model estimation, MLwiN software, version 2.25 (Centre for Multilevel Modeling) was run using the runmlwin34 command within Stata, version 12 (StataCorp).
Baseline Characteristics and Study Groups
Among 80 attending physicians who staffed the general medicine wards during the yearlong study, 62 (78%) were assigned random sequences of 2- and 4-week rotations (Figure 1). Study attending physicians were mostly early- or mid-career general internist clinician-educators (Table 1). They collectively staffed 203 rotations (89% of the general medicine inpatient service) and individually staffed a median of two 2-week rotations and one 4-week rotation. Rotation types were evenly distributed over calendar quarters and admitting teams, and more than 97% of rotations met washout
criteria (eTable 4). Of 12 327 patients discharged alive during 203 study rotations, 17 (0.1%) did not receive their allocated intervention and thus were not analyzed (Figure 1). In addition, 637 patients discharged alive (0.05% of 12 327) had 30-day planned readmissions and were not analyzed for 30-day unplanned revisits.
The unadjusted percentage of unplanned revisits within 30 days of hospital discharge was 21.2% (95% CI, 20.0%-22.5%) among 2-week and 21.5% (95% CI, 20.3%-22.7%) among 4-week rotations (Table 2). Within attending physicians, the mean difference between rotation types (2- minus 4-week rotations) was –0.3% (95% CI, –1.8% to +1.2%). This corresponded to a within-attending-physician adjusted OR of 0.97 in favor of 2-week rotations, with a 1-sided upper 97.5% confidence bound of 1.07 that was within the noninferiority margin of 1.13 (Figure 2). Neither this point estimate nor its precision changed after adjusting for patient characteristics, which supports their observed balance across rotation types (Table 2).
Average length of stay was nearly identical among patients discharged alive in the 2-week (geometric mean, 67.2 hours; 95% CI, 65.9-68.6 hours) and 4-week (67.5 hours; 95% CI, 66.2-68.8 hours) rotations, corresponding to a nonsignificant adjusted relative difference within attending physician (2- vs 4-week rotations) of –0.9% (95% CI, –4.7% to +2.9%).
Trainee Evaluations of Attending Physicians
Among the 62 attending physicians, 60 and 62 were evaluated by house staff and medical students, respectively (Figure 3). Trainees generally rated attending physicians higher during their 4-week rotations. For both medical students and house staff, 4-week rotations improved the perceived ability of attending physicians to fairly evaluate trainees.
Attending Physician Outcomes
All attending physicians had at least 1 burnout assessment after each rotation type (Figure 4). Comparing ratings after 2-week vs 4-week rotations, the OR for attending physicians reported burnout was 0.39 (95% CI, 0.26-0.58) and for severe emotional exhaustion was 0.45 (95% CI, 0.31-0.64).
In this study, the likelihood of a patient having an unplanned revisit within 30 days of discharge from an attending physician's 2-week rotation was noninferior to that from the same attending physician's 4-week rotation. For example, if a patient discharged during a 2-week rotation by an attending physician whose percentage of 30-day unplanned revisits during 4-week rotations was 20%, then that patient's likelihood of a 30-day unplanned revisit was less than 22%. Among the secondary outcomes, there was no statistically significant difference in length of stay on the general medicine service during 2- vs 4-week rotations. The 95% confidence intervals for both of these patient outcomes are sufficiently precise to exclude clinically important differences (Figure 2), suggesting that future trials that enroll even more patients would likely have similar conclusions.35
Similar to others,3 we anticipated that shorter rotations might increase both 30-day unplanned revisits and lengths of stay by disrupting patient care because of more frequent attending physician service changes.36 Yet relative to 4-week rotations, only patients handed off between 2-week rotations at the mid point of a crossover period were subject to such changes. For example, given a total of 88 patients discharged during paired 2-week rotations (Figure 1), if 12 patients were handed off between attending physicians assigned to a consecutive 2-week pairing, then only 14% (12/88) of patients discharged would undergo an extra handoff relative to a single 4-week rotation. Moreover, the disruptive effects of attending physician service changes were likely diluted by house staff on our general medicine teams because the same house staff were present throughout paired 2-week rotations.
We also anticipated from others' work that shorter rotations may improve some attending physician outcomes while worsening others. Smith et al4 retrospectively found that 2-week rotations generally worsened house-staff evaluations of attending physicians. Comparing composite evaluation scores from 2- vs 4-week rotations, the OR of a composite score below the median was 1.80 (95% CI, 1.34-2.41). In contrast, Elnicki and Cooper6 found few differences in medical student evaluations, but attending physicians favored 4-week rotations for having the time to evaluate students' overall performance. The average attending physician response on a 5-point scale was 1 point higher for 4-week rotations. Finally, Akl et al3 found that house staff thought shorter rotations would reduce attending physicians' ability to evaluate them (by 1 point on a 7-point scale), whereas attending physicians thought that shorter rotations would improve their private lives (by 1 point on a 7-point scale).
Trade-offs between stakeholders make research in medical education complex because although multiple outcomes and levels of analysis ought to be considered,37,38 interpretation of the relative importance and statistical significance of such findings is challenging. The study was powered for a single patient outcome, 30-day unplanned revisits, reasoning that hospital policy was more likely to be driven by it than by any other.9,39 The statistical significance of the other secondary outcomes should therefore be interpreted in light of increased potential for chance findings. For example, under the conservative assumption that the 17 hypothesis tests presented in Figure 2, Figure 3, and Figure 4 were statistically independent, on average at least 1 of the observed statistically significant results would be expected to be a chance finding. Alternatively, a multiplicity adjustment could be made to the standard P value criterion for statistical significance, lowering it from P = .05 to P = .003 (Figure 2, Figure 3, and Figure 4).40
Thus, although conclusions based on the secondary outcomes must be tentative, those outcomes can be cautiously used to help weigh the relative effects of rotation duration across the involved stakeholders. In contrast to patients, attending physicians were importantly affected by rotation duration—but in opposing ways. Whereas trainees generally evaluated attending physicians more favorably after 4-week rotations, attending physicians reported less burnout and emotional exhaustion after 2-week rotations. The adjusted ORs in Figure 3 and Figure 4 can be applied to concretely weigh this trade-off. If house staff rate attending physicians' ability to evaluate them as imperfect in approximately 30% of 4-week rotations, a hospital policy that mandates all 2-week rotations would increase this by 17 percentage points to 47% (Figure 3; adjusted OR, 2.10). This negative effect, however, would be offset by an 18-percentage-point decrease in rotations in which attending physicians report burnout: if they report burnout after approximately 35% of 4-week rotations, they would be expected to report it after only 17% of 2-week rotations (Figure 4; adjusted OR, 0.39). Administrators and program leaders should expect that, if replacing an all-4-week with an all-2-week rotation calendar, the increase in rotations in which house staff perceive that they were not perfectly evaluated by their attending physicians will be offset in an approximate 1-to-1 ratio with a decrease in rotations in which attending physicians report burnout.
In addition to consideration of rotation duration, it may be beneficial to align the academic calendars of attending physicians and trainees to maximize shared time because we found support for the intuitive notion that attending physicians better evaluate trainees when they spend more time with them. Our findings for medical students are most applicable to settings where medical student rotations do not align with attending physician rotations because medical students in our study spent a median of 7 days (interquartile range [IQR], 4-14 days) on 2-week and 17 days (IQR, 7-21 days) on 4-week rotations (Figure 4). Given such brief durations and the ongoing trend toward shorter ones, evaluation methods themselves may need retooling. Alternatively, for attending physicians who wish to maintain longer rotation durations for potential trainee benefit,6 other practice characteristics beyond rotation duration may help moderate burnout and its antecedents.19 Although rotation duration appeared to affect attending physicians during inpatient medicine wards, it was clearly not the sole factor because attending physicians reported burnout after 16% of 2-week rotations (Figure 4). Others have found, for example, that work-life balance41 and alignment with local administrative leaders42 may lessen burnout.
These findings should be interpreted in light of several limitations. First, the study was in a single center. The common structure of the ward teams,1,2 however, enhances the generalizability of the findings. Second, the trainee evaluations of attending physician performance were subjective. Differences between rotation types may therefore reflect trainees' perceptions, not actual differences in attending physician performance. Because the house staff evaluation was previously validated,14 however, we believe it is a reasonable surrogate for attending physicians' true performance. Third, the washout period was based on theory, not evidence, and carryover may still have affected attending physicians. Nevertheless, the proximities of preceding inpatient weeks were well-balanced across rotation types (eTable 4). Fourth, attending physicians' burnout assessments were not validated with a concurrent, objective measure. Given that attending physicians were not blinded to rotation duration, they may have knowingly adjusted their responses in favor of their preferred rotation type. Workplace preferences, however, tend to align with workplace satisfaction, a moderator of burnout.20
If the projected trend toward shorter rotations continues,6 a trial of 1-week rotations may be needed. If so, direct testing of trainees' skills and behaviors would be a more relevant measure of attending physician teaching performance than trainees' perceptions.9 In addition, to maximize uncovering important effects of rotation duration, future trials should consider patient-level outcomes that are both more reflective of care quality and more vulnerable to extra attending physician handoffs, such as preventable adverse events, patient treatment adherence, and patient satisfaction.43,44 As shown in this study (eTable 5) and as others have reported,45 the variability of both 30-day unplanned revisits and lengths of hospital stay are determined more by patient-level than physician-level factors.
Although rarely collected, patient-level measurements should be a primary focus of medical education outcomes research.9,38,46 Randomization of patients, however, is often not feasible in such research, and justifiable concerns about patient-level confounding often arise. In the present study, these concerns are mitigated by the large patient sample, the assignment of patients to ward teams without regard to the attending physicians' rotation durations, the well-balanced distribution of patient characteristics across rotation types (Table 2), and the stability of the results after adjustment for patient characteristics within attending physicians. Nonetheless, as the present study shows, when patients are not substantively affected, the overall favorability of an intervention will rest on weighing its effects on other stakeholders.
Indeed, without evidence to suggest that patients were adversely affected by 2-week rotations, administrators and program leaders from our department of medicine decided to forego the potential negative effects of 2-week rotations on trainees in favor of reducing the potential for attending physician burnout. As a result of these present findings, therefore, attending physicians at our hospital now voluntarily choose between 2- or 4-week rotations.
Corresponding Author: Brian P. Lucas, MD, MS, Department of Medicine, Cook County Health and Hospitals System and Rush Medical College, 1900 W Polk St, Room 520, Chicago, IL 60612 (brian_lucas@rush.edu).
Author Contributions: Dr Lucas had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Lucas, Trick, Evans, Smith, Das, Clarke, Varkey, Mathew, Weinstein.
Acquisition of data: Lucas, Mba.
Analysis and interpretation of data: Lucas, Trick, Evans, Smith.
Drafting of the manuscript: Lucas.
Critical revision of the manuscript for important intellectual content: Lucas, Trick, Evans, Mba, Smith, Das, Clarke, Varkey, Mathew, Weinstein.
Statistical analysis: Lucas, Trick.
Obtained funding: Weinstein.
Administrative, technical, or material support: Lucas, Trick, Evans, Das, Clarke, Varkey, Weinstein.
Study supervision: Lucas, Weinstein.
Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Trick reports receiving research support from the Agency for Healthcare Research and Quality, but this support was not used for any portion of the current article. No other disclosures were reported.
Funding/Support: Support for this study was provided by a philanthropic gift from the Foglia Family Foundation.
Role of the Sponsor: The sponsor had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.
Additional Contributions: We thank Linda K. Goodine for administrative data retrieval; George Markovski, BS, and Manjula Srinivasan, MCA, for electronic survey and database architecture; Rudolf Kumapley, MD, for coordination of the inpatient service; and the attending physicians, house staff, and medical students for their participation. All were salaried employees of Cook County Hospital, Chicago, Illinois, and received no additional compensation for their efforts in this study. In addition, we thank Ashley L. G. Rogers, an MS student from University of Illinois at Chicago, and Lidia Hernandez, a BSN student from Malcolm X College, Chicago, who were compensated through the Foglia Family Foundation grant as research assistants to collect and enter data.
1. McMahon GT, Katz JT, Thorndike ME, Levy BD, Loscalzo J. Evaluation of a redesign initiative in an internal-medicine residency.
N Engl J Med. 2010;362(14):1304-131120375407
PubMedGoogle ScholarCrossref 2.Spellberg B, Lewis RJ, Sue D,
et al. A controlled investigation of optimal internal medicine ward team structure at a teaching hospital.
PLoS One. 2012;7(4):e3557622532860
PubMedGoogle ScholarCrossref 3.Akl EA, Maroun N, Klocke RA, Schünemann HJ. A survey of internal medicine residents and faculty about the duration of attendings' inpatient rotations.
J Gen Intern Med. 2004;19(11):1133-113915566443
PubMedGoogle ScholarCrossref 4.Smith MEB, Desai SS, Allen ES, Saha S, Hunter AJ. Impact of shorter inpatient faculty rotations on resident learning experience.
Am J Med. 2009;122(1):96-10019114177
PubMedGoogle ScholarCrossref 6.Elnicki DM, Cooper A. Effects of varying inpatient attending physician rotation length on medical students' and attending physicians' perceptions of teaching quality.
Teach Learn Med. 2011;23(1):37-4121240781
PubMedGoogle ScholarCrossref 7.DiMatteo MR, Sherbourne CD, Hays RD,
et al. Physicians' characteristics influence patients' adherence to medical treatment: results from the Medical Outcomes Study.
Health Psychol. 1993;12(2):93-1028500445
PubMedGoogle ScholarCrossref 8.Shanafelt TD. Enhancing meaning in work: a prescription for preventing physician burnout and promoting patient-centered care.
JAMA. 2009;302(12):1338-134019773573
PubMedGoogle ScholarCrossref 9.Chen FM, Burstin H, Huntington J. The importance of clinical outcomes in medical education research.
Med Educ. 2005;39(4):350-35115813754
PubMedGoogle ScholarCrossref 10.Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. West Sussex, England: John Wiley & Sons; 2000
11.Senn S. Cross-over Trials in Clinical Research. 2nd ed. West Sussex, England: John Wiley & Sons; 2002
12.Jones B, Kenward MG. Design and Analysis of Cross-over Trials. 2nd ed. Boca Raton, FL: Chapman & Hall; 2003
14.Smith CA, Varkey AB, Evans AT, Reilly BM. Evaluating the performance of inpatient attending physicians: a new instrument for today's teaching hospitals.
J Gen Intern Med. 2004;19(7):766-77115209591
PubMedGoogle ScholarCrossref 15.Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. Oxford, England: Oxford University Press; 2008
16.Norris CM, Ghali WA, Saunders LD,
et al; APPROACHInvestigators. Ordinal regression model and the linear regression model were superior to the logistic regression models.
J Clin Epidemiol. 2006;59(5):448-45616632132
PubMedGoogle ScholarCrossref 17.Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York, NY: Springer; 1984
18.Ivancevich JM, Matteson MT. Stress and Work: A Managerial Perspective. Glenview, IL: Scott Foresman; 1980
19.Williams ES, Konrad TR, Linzer M,
et al; SGIM Career Satisfaction Study Group. Physician, practice, and patient characteristics related to primary care physician physical and mental health: results from the Physician Worklife Study.
Health Serv Res. 2002;37(1):121-14311949917
PubMedGoogle Scholar 20.Linzer M, Manwell LB, Mundt M,
et al. Organizational climate, stress, and error in primary care: the MEMO study.
In: Henriksen K, Battles JB, Marks ES, Lewin DI, eds. Advances in Patient Safety: From Research to Implementation: Volume 1: Research Findings. Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ publication 05-0021-1. http://www.ahrq.gov/downloads/pub/advances/vol1/Linzer.pdf. Accessed February 24, 2012 21.Freeborn DK. Satisfaction, commitment, and psychological well-being among HMO physicians.
West J Med. 2001;174(1):13-1811154654
PubMedGoogle ScholarCrossref 22.Linzer M, Gerrity M, Douglas JA, McMurray JE, Williams ES, Konrad TR. Physician stress: results from the Physician Worklife Study.
STRESS Health. 2002;18(1):37-42
Google ScholarCrossref 23.Linzer M, Visser MRM, Oort FJ, Smets EMA, McMurray JE, de Haes HCJM.Society of General Internal Medicine Career Satisfaction Study Group. Predicting and preventing physician burnout: results from the United States and the Netherlands.
Am J Med. 2001;111(2):170-17511498074
PubMedGoogle ScholarCrossref 26.Ashforth BE, Lee RT. Burnout as a process: commentary on Cordes, Dougherty and Blum.
J Organ Behav. 1997;18(6):703-708
Google ScholarCrossref 28.Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual. 3rd ed. Mountain View, CA: CPP Inc; 1996
29.Veninga RL, Spradley JP. The Work/Stress Connection: How to Cope With Job Burnout. Boston, MA: Little Brown; 1981
30.Schmoldt RA, Freeborn DK, Klevit HD. Physician burnout: recommendations for HMO managers.
HMO Pract. 1994;8(2):58-6310135263
PubMedGoogle Scholar 31.Jencks SF, Williams MV, Coleman EA. Rehospitalizations among patients in the Medicare fee-for-service program.
N Engl J Med. 2009;360(14):1418-142819339721
PubMedGoogle ScholarCrossref 32.Kaul S, Diamond GA. Good enough: a primer on the analysis and interpretation of noninferiority trials.
Ann Intern Med. 2006;145(1):62-6916818930
PubMedGoogle ScholarCrossref 34.Leckie G, Charlton C. runmlwin: Stata Module for Fitting Multilevel Models in the MLwiN Software Package. Bristol, England: University of Bristol Centre for Multilevel Modelling; 2011
35.Sackett DL. Superiority, equivalence and noninferiority trials. In: Haynes RB, Sackett DL, Guyatt GH, Tugwell P, eds. The Principles Behind the Tactics of Performing Therapeutic Trials. Clinical Epidemiology: How to Do Clinical Practice Research. 3rd ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2006
37.Prystowsky JB, Bordage G. An outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction.
Med Educ. 2001;35(4):331-33611318995
PubMedGoogle ScholarCrossref 38.Carney PA, Nierenberg DW, Pipas CF, Brooks WB, Stukel TA, Keller AM. Educational epidemiology: applying population-based design and analytic approaches to study medical education.
JAMA. 2004;292(9):1044-105015339895
PubMedGoogle ScholarCrossref 40.Pocock SJ. Clinical trials with multiple outcomes: a statistical perspective on their design, analysis, and interpretation.
Control Clin Trials. 1997;18(6):530-5459408716
PubMedGoogle ScholarCrossref 41.Dyrbye LN, West CP, Satele D, Sloan JA, Shanafelt TD. Work/home conflict and burnout among academic internal medicine physicians.
Arch Intern Med. 2011;171(13):1207-120921747018
PubMedGoogle ScholarCrossref 42.Williams ES, Manwell LB, Konrad TR, Linzer M. The relationship of organizational culture, stress, satisfaction, and burnout with physician-reported error and suboptimal patient care: results from the MEMO study.
Health Care Manage Rev. 2007;32(3):203-21217666991
PubMedGoogle ScholarCrossref 43.Petersen LA, Brennan TA, O’Neil AC, Cook EF, Lee TH. Does housestaff discontinuity of care increase the risk for preventable adverse events?
Ann Intern Med. 1994;121(11):866-8727978700
PubMedGoogle ScholarCrossref