[Skip to Navigation]
Sign In
Figure 1. 
Skill acquisition for giving bad news. Codes are listed in the same order as in Table 2 (first 7 measured codes). Dark bars indicate the percentage of participants acquiring a skill, as defined in the “Measurements” subsection of the “Methods” section. Light bars indicate 95% confidence intervals.

Skill acquisition for giving bad news. Codes are listed in the same order as in Table 2 (first 7 measured codes). Dark bars indicate the percentage of participants acquiring a skill, as defined in the “Measurements” subsection of the “Methods” section. Light bars indicate 95% confidence intervals.

Figure 2. 
Skill acquisition for discussing transitions to palliative care. Codes are listed in the same order as in Table 3 (first 7 measured codes). Dark bars indicate the percentage of participants acquiring a skill, as defined in the “Measurements” subsection of the “Methods” section. Light bars indicate 95% confidence intervals.

Skill acquisition for discussing transitions to palliative care. Codes are listed in the same order as in Table 3 (first 7 measured codes). Dark bars indicate the percentage of participants acquiring a skill, as defined in the “Measurements” subsection of the “Methods” section. Light bars indicate 95% confidence intervals.

Table 1. 
Communication Skills Curriculum Based on Illness Trajectory
Communication Skills Curriculum Based on Illness Trajectory
Table 2. 
Content-Based Codes for Giving Bad News
Content-Based Codes for Giving Bad News
Table 3. 
Content-Based Codes for Transitions to Palliative Care
Content-Based Codes for Transitions to Palliative Care
Table 4. 
Participant Characteristics*
Participant Characteristics*
Table 5. 
Communication Skill Changes for Giving Bad News Encounter
Communication Skill Changes for Giving Bad News Encounter
Table 6. 
Communication Skill Changes for Transition to Palliative Care Encounter
Communication Skill Changes for Transition to Palliative Care Encounter
1.
 State-of-the-Science Conference Statement: Improving End-of-Life Care.  Bethesda, Md National Institutes of Health2004;
2.
 Cancer care during the last phase of life.  J Clin Oncol 1998;161986- 1996PubMedGoogle Scholar
3.
Foley  KMGelband  H Improving Palliative Care for Cancer: Summary and Recommendations.  Washington, DC Institute of Medicine and National Academy Press2001;
4.
Morita  TAkechi  TIkenaga  M  et al.  Communication about the ending of anticancer treatment and transition to palliative care.  Ann Oncol 2004;151551- 1557PubMedGoogle ScholarCrossref
5.
Hagerty  RGButow  PNEllis  PM  et al.  Communicating with realism and hope: incurable cancer patients' views on the disclosure of prognosis.  J Clin Oncol 2005;231278- 1288PubMedGoogle ScholarCrossref
6.
Tulsky  JA Interventions to enhance communication among patients, providers, and families.  J Palliat Med 2005;8 ((suppl 1)) S95- S102PubMedGoogle ScholarCrossref
7.
Tulsky  JA Beyond advance directives: importance of communication skills at the end of life.  JAMA 2005;294359- 365PubMedGoogle ScholarCrossref
8.
Tulsky  JAChesney  MALo  B See one, do one, teach one? house staff experience discussing do-not-resuscitate orders.  Arch Intern Med 1996;1561285- 1289PubMedGoogle ScholarCrossref
9.
Accreditation Council for Graduate Medical Education, ACGME home page. http://www.acgme.org. Accessed November 15, 2006
10.
Delvaux  NRazavi  DMarchal  SBredart  AFarvacques  CSlachmuylder  JL Effects of a 105 hours psychological training program on attitudes, communication skills and occupational stress in oncology: a randomised study.  Br J Cancer 2004;90106- 114PubMedGoogle ScholarCrossref
11.
Fallowfield  LJenkins  VFarewell  VSaul  JDuffy  AEves  R Efficacy of a Cancer Research UK communication skills training model for oncologists: a randomised controlled trial.  Lancet 2002;359650- 656PubMedGoogle ScholarCrossref
12.
Levinson  WRoter  D The effects of two continuing medical education programs on communication skills of practicing primary care physicians.  J Gen Intern Med 1993;8318- 324PubMedGoogle ScholarCrossref
13.
Maguire  P Improving communication with cancer patients.  Eur J Cancer 1999;352058- 2065PubMedGoogle ScholarCrossref
14.
Razavi  DDelvaux  NMarchal  SBredart  AFarvacques  CPaesmans  M The effects of a 24-h psychological training program on attitudes, communication skills and occupational stress in oncology: a randomised study.  Eur J Cancer 1993;29A1858- 1863PubMedGoogle ScholarCrossref
15.
Razavi  DMerckaert  IMarchal  S  et al.  How to optimize physicians' communication skills in cancer care: results of a randomized study assessing the usefulness of posttraining consolidation workshops.  J Clin Oncol 2003;213141- 3149PubMedGoogle ScholarCrossref
16.
Bird  JHall  AMaguire  PHeavy  A Workshops for consultants on the teaching of clinical communication skills.  Med Educ 1993;27181- 185PubMedGoogle ScholarCrossref
17.
Baile  WFLenzi  RKudelka  AP  et al.  Improving physician-patient communication in cancer care: outcome of a workshop for oncologists.  J Cancer Educ 1997;12166- 173PubMedGoogle Scholar
18.
Brown  JBBoles  MMullooly  JPLevinson  W Effect of clinician communication skills training on patient satisfaction: a randomized, controlled trial.  Ann Intern Med 1999;131822- 829PubMedGoogle ScholarCrossref
19.
Back  ALArnold  RMTulsky  JABaile  WFFryer-Edwards  KA Teaching communication skills to medical oncology fellows.  J Clin Oncol 2003;212433- 2436PubMedGoogle ScholarCrossref
20.
Boyle  FMDunn  SMHeinrich  P More than one way to foster communication skills for medical oncology fellows: a national program in Australia.  J Clin Oncol 2003;214255PubMedGoogle ScholarCrossref
21.
Lenzi  RParker  PABerek  J  et al.  Design, conduct, and evaluation of a communication course for oncology fellows.  J Cancer Educ 2005;20143- 149PubMedGoogle ScholarCrossref
22.
Hoffman  MFerri  JSison  CRoter  DSchapira  LBaile  W Teaching communication skills: an AACE survey of oncology training programs.  J Cancer Educ 2004;19220- 224PubMedGoogle ScholarCrossref
23.
Parle  MMaguire  PHeaven  C The development of a training model to improve health professionals' skills, self-efficacy and outcome expectancies when communicating with cancer patients.  Soc Sci Med 1997;44231- 240PubMedGoogle ScholarCrossref
24.
Davis  DAMazmanian  PEFordis  MVan Harrison  RThorpe  KEPerrier  L Accuracy of physician self-assessment compared with observed measures of competence: a systematic review.  JAMA 2006;2961094- 1102PubMedGoogle ScholarCrossref
25.
American Society of Clinical Oncology, ASCO home page. http://www.asco.org. Accessed November 15, 2006
26.
Back  ALArnold  RBaile  WTulsky  JFryer-Edwards  KA Approaching difficult communication tasks in oncology.  CA Cancer J Clin 2005;55164- 177PubMedGoogle ScholarCrossref
27.
Back  ALArnold  RMQuill  TE Hope for the best, and prepare for the worst.  Ann Intern Med 2003;138439- 443PubMedGoogle ScholarCrossref
28.
Back  ALArnold  RMTulsky  JABaile  WFFryer-Edwards  KA On saying goodbye: acknowledging the end of the patient-physician relationship with patients who are near death.  Ann Intern Med 2005;142682- 685PubMedGoogle ScholarCrossref
29.
Girgis  ASanson-Fisher  RW Breaking bad news, I: current best advice for clinicians.  Behav Med 1998;2453- 59PubMedGoogle ScholarCrossref
30.
Girgis  ASanson-Fisher  RW Breaking bad news: consensus guidelines for medical practitioners.  J Clin Oncol 1995;132449- 2456PubMedGoogle Scholar
31.
Thorne  SEBultz  BDBaile  WF Is there a cost to poor communication in cancer care? a critical review of the literature.  Psychooncology 2005;14875- 884PubMedGoogle ScholarCrossref
32.
Walsh  RAGirgis  ASanson-Fisher  RW Breaking bad news, II: what evidence is available to guide clinicians?  Behav Med 1998;2461- 72PubMedGoogle ScholarCrossref
33.
Griffith  CH  IIIWilson  JFLanger  SHaist  SA House staff nonverbal communication skills and standardized patient satisfaction.  J Gen Intern Med 2003;18170- 174PubMedGoogle ScholarCrossref
34.
Suchman  ALMarkakis  KBeckman  HBFrankel  R A model of empathic communication in the medical interview.  JAMA 1997;277678- 682PubMedGoogle ScholarCrossref
35.
Fryer-Edwards  KAArnold  RBack  ABaile  WTulsky  J Tough Talk: Helping Physicians Have Difficult Conversations.  Seattle University of Washington2004;
36.
Fryer-Edwards  KArnold  RBaile  WTulsky  JPetracca  FBack  AL Reflective teaching practices: an approach to teaching communication skills in a small-group setting.  Acad Med 2006;81638- 644PubMedGoogle ScholarCrossref
37.
Baile  WFBuckman  RLenzi  RGlober  GBeale  EAKudelka  AP SPIKES: a six-step protocol for delivering bad news: application to the patient with cancer.  Oncologist 2000;5302- 311PubMedGoogle ScholarCrossref
38.
Quill  TEArnold  RMPlatt  F “I wish things were different”: expressing wishes in response to loss, futility, and unrealistic hopes.  Ann Intern Med 2001;135551- 555PubMedGoogle ScholarCrossref
39.
Smith  RC Patient-Centered Interviewing: An Evidence-Based Method.  Philadelphia, Pa Lippincott Williams & Wilkins2002;
40.
Alexander  SCKeitz  SASloane  RTulsky  JA A controlled trial of a short course to improve residents' communication with patients at the end of life.  Acad Med 2006;811008- 1012PubMedGoogle ScholarCrossref
41.
McGinn  TWyer  PCNewman  TBKeitz  SLeipzig  RFor  GG Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic).  CMAJ 2004;1711369- 1373PubMedGoogle ScholarCrossref
42.
Francis  LK Learning to listen: a fellow's experience.  J Clin Oncol 2006;243209- 3210PubMedGoogle ScholarCrossref
43.
Roter  DLLarson  SShinitzky  H  et al.  Use of an innovative video feedback technique to enhance communication skills training.  Med Educ 2004;38145- 157PubMedGoogle ScholarCrossref
44.
Roter  DLHall  JAKern  DEBarker  LRCole  KARoca  RP Improving physicians' interviewing skills and reducing patients' emotional distress: a randomized clinical trial.  Arch Intern Med 1995;1551877- 1884PubMedGoogle ScholarCrossref
45.
Fellowes  DWilkinson  SMoore  P Communication skills training for health care professionals working with cancer patients, their families and/or carers.  Cochrane Database Syst Rev 2004;CD003751PubMedGoogle Scholar
46.
Pieters  HMTouw-Otten  FWDe Melker  RA Simulated patients in assessing consultation skills of trainees in general practice vocational training: a validity study.  Med Educ 1994;28226- 233PubMedGoogle ScholarCrossref
47.
Fallowfield  LJenkins  VFarewell  VSolis-Trapala  I Enduring impact of communication skills training: results of a 12-month follow-up.  Br J Cancer 2003;891445- 1449PubMedGoogle ScholarCrossref
48.
Miller  WRRollnick  S Motivational Interviewing: Preparing People for Change. 2nd ed. New York, NY Guilford Publications2002;
49.
Kagawa-Singer  MBlackhall  LJ Negotiating cross-cultural issues at the end of life: “you got to go where he lives.”  JAMA 2001;2862993- 3001PubMedGoogle ScholarCrossref
Original Investigation
March 12, 2007

Efficacy of Communication Skills Training for Giving Bad News and Discussing Transitions to Palliative Care

Author Affiliations

Author Affiliations: Departments of Medicine (Dr Back) and Medical History and Ethics (Drs Back and Fryer-Edwards), University of Washington, and Clinical Research Division (Drs Back and Gooley), Fred Hutchinson Cancer Research Center, Seattle; Department of Medicine, University of Pittsburgh, Pittsburgh, Pa (Dr Arnold); Department of Behavioral Science, University of Texas M. D. Anderson Cancer Center, Houston (Dr Baile); Department of Medicine (Drs Alexander and Tulsky), Center for Palliative Care (Drs Alexander and Tulsky), and Duke Comprehensive Cancer Center (Dr Tulsky), Duke University and Center for Health Services Research (Drs Alexander and Tulsky), Durham Veterans Affairs Medical Center, Durham, NC; and Department of Family Medicine, University of Colorado at Denver, Aurora (Dr Barley).

Arch Intern Med. 2007;167(5):453-460. doi:10.1001/archinte.167.5.453
Abstract

Background  Few studies have assessed the efficacy of communication skills training for postgraduate physician trainees at the level of behaviors. We designed a residential communication skills workshop (Oncotalk) for medical oncology fellows. The intervention design built on existing successful models by teaching specific communication tasks linked to the patient's trajectory of illness. This study evaluated the efficacy of Oncotalk in changing observable communication behaviors.

Methods  Oncotalk was a 4-day residential workshop emphasizing skills practice in small groups. This preintervention and postintervention cohort study involved 115 medical oncology fellows from 62 different institutions during a 3-year study. The primary outcomes were observable participant communication skills measured during standardized patient encounters before and after the workshop in giving bad news and discussing transitions to palliative care. The standardized patient encounters were audiorecorded and assessed by blinded coders using a validated coding system. Before-after comparisons were made using each participant as his or her own control.

Results  Compared with preworkshop standardized patient encounters, postworkshop encounters showed that participants acquired a mean of 5.4 bad news skills (P<.001) and a mean of 4.4 transitions skills (P<.001). Most changes in individual skills were substantial; for example, in the bad news encounter, 16% of participants used the word “cancer” when giving bad news before the workshop, and 54% used it after the workshop (P<.001). Also in the bad news encounter, blinded coders were able to identify whether a standardized patient encounter occurred before or after the workshop in 91% of the audiorecordings.

Conclusion  Oncotalk represents a successful teaching model for improving communication skills for postgraduate medical trainees.

Patients with life-threatening illnesses need physicians with excellent communication skills, yet what they encounter in their physician's office is often suboptimal.1-8 The communication skills required in these settings go beyond basic interviewing taught in medical school; complex biomedical issues must be integrated with patient-centered values. Thus, the Accreditation Council for Graduate Medical Education now requires competency in communication skills for residents and fellows.9 However, educators face significant challenges in addressing this competency. The communication content must be integrated with biomedical content, and the teaching should include skills practice, which few faculty have been trained to facilitate. Few rigorously evaluated studies of communication skills training have addressed postgraduate trainees.10-22

We designed an experiential curriculum for oncology fellows involving 5 patients with cancer seen at critical incidents along the illness trajectory, using step-by-step approaches or cognitive road maps for specific communication tasks (such as giving bad news) and skills practice with simulated patients. The resulting workshop, called Oncotalk, also incorporated features of other successful programs.11,13,23 To evaluate Oncotalk, we used a system of content-based coding of audiorecordings of encounters with standardized patients because self-assessment often does not correlate with objective measures.24 Herein we report the primary outcome of this evaluation, learner acquisition of communication skills, for the 2 different tasks of delivering bad news and discussing transitions to palliative care.

Methods
Setting and intervention

Oncotalk was a 4-day residential workshop conducted for 20 fellows per workshop biannually. Oncology fellows were recruited by sending brochures and e-mails to fellowship directors listed by the American Society for Clinical Oncology.25 Participant selection was based on interest in communication as expressed in a brief personal statement, potential as an educator, and research in communication.

The Oncotalk curriculum emphasized skill practice. Except for short overviews, the retreat was taught in small groups of 5 participants and 1 faculty facilitator. The curriculum was organized around 5 simulated patients (with breast cancer, prostate cancer, lymphoma, lung cancer, and melanoma) who appear each day at a different point in their illness trajectory (Table 1). Learning activities included overviews, skills practice sessions, and reflective discussions.19,26-28 We taught cognitive road maps for common communication tasks, including giving bad news and discussing transitions to palliative care.26 These road maps are based on empirical studies of patient preferences.4,5,29-33 We emphasized attending to the patient agenda, recognizing empathic opportunities,34 and responding verbally.26

The simulated patients used for teaching were professional actors trained for at least 6 hours by the investigators using a detailed character script, with an additional hour of refresher training given immediately before each retreat.

To develop a consistent teaching approach, one of us (K.A.F.-E.) coordinated faculty development; she observed each facilitator, provided individual feedback, videorecorded or audiorecorded skills practice sessions, and produced a DVD to identify best teaching practices.35,36

Measurements

Participants completed preretreat questionnaires that included demographic information and other data not reported herein.

Participant communication skills were evaluated with 2 preretreat standardized patient (SP) encounters at the beginning of the retreat and 2 postretreat encounters 4 days later. These SP encounters for evaluation used actors different from the simulated patients used for teaching during the week. The SP encounter for giving bad news required the participant to discuss the results of a computed tomogram showing disease recurrence to a patient previously thought to be in remission. The SP encounter for discussing transition to palliative care required the participant to develop and discuss a care plan for a patient whose cancer had progressed despite use of available evidence-based palliative chemotherapy. Each participant saw 1 bad news and 1 transition SP before and after the retreat, for a total of 4 SP encounters per participant (each limited to 20 minutes). To avoid a training effect, 4 different SP characters were developed so that no learner would see the same character before and after the workshop. The SPs were presented in random order.

The SPs were recruited and trained by the Center for Advancing Professional Excellence at the University of Colorado at Denver. Each of 4 SP characters had a standardized script and videotape used for training. The SPs received 6 hours of initial training and 2 hours of refresher training every year. The SP training included review of the case as a group, self-study by the SPs to memorize the case, and then portrayal of the case by each SP with feedback until their performance was rated as consistent. The SPs were blinded to the retreat curriculum.

We developed a content-based coding scheme consisting of observable behaviors for each step in giving bad news and transitions to palliative care that could be recognized by coders with adequate interrater reliability. For giving bad news, the codes followed the stepwise approach with the acronym SPIKES, as defined by Baile et al.37 The 6 steps in SPIKES include (1) preparing the setting; (2) assessing the patient's perception; (3) making an invitation to disclose the news; (4) sharing the knowledge about the news; (5) responding to the patient's emotion; and (6) summarizing the plan. We identified codes for each step except the first (which involves finding a quiet place to talk and verifying the information). Table 1 shows examples of dialogue that met the definition of the codes for each step. The codes were chosen because they represent a best communication practice.29,30,32 One of the codes, however, requires further explanation. One code measuring how participants responded to emotion (step 5) was based on a required SP behavior. After hearing the bad news, the SP was trained to react by becoming upset but not saying anything for 20 seconds, after which the SP would look at the participant as if ready to talk. Ideally, a participant would not address the SP until the SP looked up. We measured whether the participant could remain silent for at least 10 seconds as an indicator that the participant was attending to the patient's emotion to some degree.

For transitions to palliative care, the codes followed a stepwise approach that we developed.26Table 2 shows examples of dialogue that met the definition of the codes for each step. The 6 steps included (1) assessing patient understanding of the situation; (2) eliciting “big-picture” goals or values; (3) asking about worries, fears, and concerns; (4) responding to patient emotion; (5) proposing a care plan that addresses goals, values, and concerns; and (6) checking for patient understanding. We measured participant skills for step 4 by having the SP routinely ask the questions “How much time do I have?” and “Isn't there anything more you can do?” For both required cues, we measured whether participants included an empathic statement in their response, and for the “anything more” required cue, we measured empathic and “I wish” statements38 in the response.

Finally, in the bad news and transitions SP encounters, we also measured participant use of verbal empathic expressions based on the acronym NURSE, which we previously modified26 from Smith39: (1) naming emotions; (2) expressing understanding; (3) showing respect or praise for a patient's behavior; (4) articulating support for the patient; and (5) exploring the patient's emotional state. These verbal empathy codes were used to score participant dialogue that occurred at any point in the SP encounter and were required to be statements separate from the codes used for the stepwise approaches for bad news and transitions (ie, a single participant statement could not be coded for both a bad news step and an empathic expression).

The preretreat and postretreat SP encounters were recorded using digital audiorecorders, and the audiofiles were transferred into a software package designed for Web-based, audio-content coding.40 The coders were trained for 40 hours using a manual with detailed definitions. Coders, blinded to whether an audiofile was made before or after the retreat, assessed audiofiles in random order. To assess reliability, a random sample of 10% of the audiofiles was coded twice by different coders. Only codes with a κ statistic greater than 0.60 (good to excellent agreement) were included in the final analysis41 (Table 2 and Table 3). The κ statistics for the codes used in the bad news encounter ranged from 0.73 to 1.00; in the transitions encounter, they ranged from 0.72 to 1.00.

All study activities were approved by the institutional review boards of the University of Washington and Duke University.

Hypotheses and analysis plan

We hypothesized that, after the workshop, participants would demonstrate increased numbers of communication skills. The proportion of subjects who possessed a skill at their preretreat session was compared using the McNemar test with the proportion who possessed the skill at their postretreat session. This comparison was made for each behavior assessed. We also estimated the probability that a participant who did not demonstrate a skill in the preworkshop encounter would demonstrate that skill in the postworkshop encounter as a simple ratio (number of participants with a negative pretest and positive posttest result/number of participants with a negative pretest and positive or negative posttest result). We estimated 95% confidence intervals using standard techniques. We used 1-sample t tests to test the null hypothesis that participants would acquire zero skills.

Results
Participant characteristics

One hundred fifteen fellows participated in the 6 retreats held from April 2002 through October 2004 (Table 4), representing 42% of eligible fellowship programs.

Giving bad news

From the 115 participants, we obtained 106 evaluable pairs of preretreat and postretreat audiofiles for the bad news encounter. Nine participants were missing a preretreat or a postretreat audiofile because of late arrival (n = 4), early departure (n = 2), operator error (n = 2), or equipment failure (n = 1). In each pair of bad news encounters (preretreat and postretreat), we measured 14 separate skills. The percentage of fellows demonstrating specific skills before or after the retreat is shown in Table 5.

In the SPIKES cognitive map, we directly tested 5 of the 6 recommended steps. We were unable to test step 1 of the SPIKES map (setting), which involves finding a quiet room and verifying the bad news, because of the experimental setting. In postretreat encounters, participants demonstrated statistically significant skill acquisition for steps 2 (perception; P<.001), 3 (invitation; P<.001), 4 (knowledge; P<.001), and 5 (emotion; P<.001). For step 6 (summary), skill acquisition was not statistically significant (P = .35).

In the bad news encounters, we also measured participant use of 5 empathic verbal behaviors. In postretreat encounters, participants demonstrated statistically significant skill acquisition for the empathic skills of naming (P<.001), respecting (P<.001), supporting (P<.001), and exploring (P<.001). For understanding, no significant change was demonstrated (P = .25) (Table 5).

Because a subset of participants demonstrated skills during the preretreat encounters, we measured the percentage of participants who had not demonstrated a skill before the retreat who went on to demonstrate the skill after the retreat (Figure 1). For the SPIKES skills, 38% to 73% of participants who did not demonstrate a skill before the retreat went on to demonstrate the skill after the retreat.

We measured 3 additional skills using required cues performed by the SPs. In the first required cue, after hearing the bad news, the SPs reacted nonverbally for 20 seconds and the coders noted whether the participant was able to remain silent for at least 10 seconds. Before the retreat, 55% of participants did not remain silent for 10 seconds; after the retreat, about two thirds of these participants were able to remain silent for at least 10 seconds after giving the bad news. In the second required cue, the SP was required to say, “Doctor, I’m really scared” at some point after hearing the bad news. Before the retreat, 15% of participants did not respond with an empathic statement to this cue; after the retreat, all of these participants responded with an empathic statement.

For the third required cue in the bad news encounters, the SP was required to ask “Is there any hope for a cure?” after hearing the bad news. Of the participants who did not respond with an empathic statement before the retreat, 38% did so after the retreat. For example, in the preretreat encounter, participant 410 responded to the cue “Is there any hope for a cure?” by saying “Umm . . . it's possible that this [cancer] might take your life.” After the retreat, this same participant responded with “I don't think so—I wish that were not the case.” Of the participants whose preretreat response to the cue “Is there any hope for a cure?” was an immediate offering of anticancer therapy, 68% were able to make a different response after the retreat. For example, before the retreat, participant 502 responded by saying to the patient with new liver metastases from colon cancer, “Definitely. I’m talking about at least a 60% or higher chance of cure” and went on to discuss “new therapies.” After the retreat, the same participant responded by saying “I’m afraid not. I really wish there was.”

Overall, in the postretreat bad news encounters, learners demonstrated acquisition of a median of 6 new skills (mean, 5.4; P<.001). Remarkably, for 91% of the bad news audiorecordings, blinded coders were able to identify whether the recorded encounter was before or after the workshop.

Transitions to palliative care

From the 115 participants, we obtained 100 evaluable pairs of preretreat and postretreat audiofiles for the transition to palliative care encounter. Fifteen participants were missing a preretreat or postretreat audiofile because of late arrival (n = 4), early departure (n = 2), operator error (n = 5), or equipment failure (n = 4). In each pair of transitions encounters, we measured 16 separate skills. The percentage of fellows demonstrating specific skills before and after the retreat is shown in Table 6.

In the transitions cognitive map, we directly measured 5 of the 6 recommended steps and we also measured whether participants avoided a common pitfall. In postretreat encounters, participants demonstrated statistically significant skill acquisition for steps 1 (assessing understanding; P = .02), 2 (discussing the big picture; P<.001), 3 (asking about worries, fears, and concerns; P = .004), and 4 (responding to emotion; P = .02 to P<.001). We were unable to directly measure whether participants demonstrated skill acquisition for step 5 (proposing a care plan) because we could not devise a code with adequate reliability. For step 6 (checking understanding), skill acquisition was not statistically significant (P = .25).

In the transitions encounters, we also measured participant use of specific empathic verbal statements. In the postretreat encounters, participants demonstrated statistically significant skill acquisition for the empathic skills of naming (P<.001), understanding (P = .01), respecting (P<.001), supporting (P = .02), and exploring (P<.001) (Table 6).

The percentage of participants who had not demonstrated a skill before the retreat and went on to do so after the retreat is shown in Figure 2. For the transitions map skills, 30% to 86% of participants who had not demonstrated a skill before the retreat did so after the retreat.

Two additional skills were measured using required cues performed by the SPs. In the first transitions required cue, after hearing that palliative chemotherapy is no longer working, the SP asked, “Isn't there anything more you can do?” Of the 92% of participants did not include an empathic or an “I wish” statement in their response to this cue, approximately one third used one of these responses after the retreat. For example, participant 112 responded before the retreat by saying “You’ve been on quite a few chemotherapies, haven't you—3 or 4?” After the retreat, this participant responded with: “There are more things we can do, yes. This has been a roller-coaster ride for you, hasn't it?” For the second required transitions cue, the SP asked, “How much time do I have?” Before the retreat, 90% of the participants did not include an empathic statement or an exploratory question (eg, “Is there something specific you are thinking about in the future?”) in their response to this cue. After the retreat, 78% were able to use at least one of those responses (Figure 2), and 44% provided a direct answer to the patient's question.

Overall, in the postretreat transitions encounters, learners demonstrated acquisition of a median of 4 new skills (mean, 4.4; P<.001). For 70% of the transitions audiorecordings, blinded coders were able identify whether the recorded encounter occurred before or after the workshop.

Comment

This study demonstrates the efficacy of a teaching model for communication skills designed for postgraduate trainees. Oncotalk participants demonstrated substantial numbers of new communication skills in the postretreat SP encounters. For bad news, participants began with a median of 8 skills and acquired a median of 6 new skills. This degree of behavior change produces a quality of patient centeredness that was easily recognized by the coders, the SPs, and the participants themselves. One of our participants, on her first day back home in her clinic, had a patient say appreciatively, “No one has ever talked to me like this.” Another participant wrote, “I feel less flustered and my words are less tangled; I can focus on the person across from me and find out what they need from me in that moment.”42

How do our results compare with those of other interventions that rigorously measured behavior change? In the randomized study by Fallowfield et al,11 which videotaped oncologists with real patients and used a different coding method, oncologists before the workshop responded appropriately to 43% of patients' emotional cues (similar to our empathy expressions), compared with 57% of cues after the workshop. (In that study, improvement per oncologist was not reported.) In Oncotalk, by comparison, 39% of participants used an empathic naming statement before the workshop, compared with 71% after the workshop. In the Oncotalk analysis, each participant received a score for using each type of empathic statement only once because we believe that broadening the repertoire of available skills is more important than repeatedly performing the same skill. Comparing Oncotalk with studies involving 28 pediatric residents,43 20 internists,12 and 69 internists44 also suggests that Oncotalk is more efficacious for acquiring skills than these other interventions.

Some may comment that Oncotalk is not a controlled study. The main reasons for caution in interpreting uncontrolled phase 2 studies are secular trend and confounding variables. In this case, a control group would have measured whether oncology fellows who did not attend Oncotalk had improved their communication skills spontaneously during a 5-day period, which we think would be exceedingly unlikely given that other controlled studies have clearly shown that communication skills did not improve in the control arms.11,12,44,45 Furthermore, we cannot identify any possible confounding variables present when subjects were used as their own controls and their skills were evaluated after 5 days. Thus, we believe that this before-after cohort design of adequate size represents an important test of efficacy.

This study has notable strengths. The Oncotalk teaching methods and curricular materials have been published to enable others to replicate this course.19,26-28,35,36 The participants were diverse in program location, ethnicity, and previous training and represented 42% of the medical oncology or hematology-oncology fellowship programs and 56% of the National Cancer Institute–designated comprehensive cancer centers. The content-based coding has high face validity for clinicians, directly measures skills taught in the curriculum, and achieved extremely high reliability.

The study also has limitations. First, the evaluation used SPs rather than real patients. Physicians may behave differently in an SP encounter than in real practice.46 We performed 1 posttest SP evaluation, and conflicting data exist regarding the persistence of skills after a single intervention.15,47 Thus, the effectiveness of Oncotalk in actual practice remains to be determined. Second, the cognitive maps have not been validated in patient outcome studies (eg, motivational interviewing has been shown to change alcohol use).48 Third, our coding system focused primarily on verbal skills, because the measurement methods are robust and we did not explicitly teach nonverbal techniques.33 Fourth, we did not specifically test the skills in settings simulating patients from minority, disadvantaged, and low-literacy backgrounds, although we emphasized understanding patient perceptions, which is useful in dealing with cultural difference.49 Finally, the participants are self-selected, and personal motivation may be important.

The Oncotalk teaching model warrants further study, especially for other subspecialties involving communication about life-threatening illnesses; although the simulated scenarios would differ, many core skills are identical. Future studies should also address nonresidential settings, faculty development,45 and the effect of the improved skills on patient-level outcomes.

Correspondence: Anthony L. Back, MD, Department of Medicine/Oncology, University of Washington, 825 Eastlake Ave E, PO Box 19023, Seattle, WA 98109-1023 (tonyback@u.washington.edu).

Accepted for Publication: June 11, 2006.

Author Contributions:Study concept and design: Back, Arnold, Baile, Fryer-Edwards, and Tulsky. Acquisition of data: Back, Baile, and Barley. Analysis and interpretation of data: Back, Arnold, Baile, Alexander, and Tulsky. Drafting of the manuscript: Back, Arnold, Alexander, and Barley. Critical revision of the manuscript for important intellectual content: Back, Arnold, Baile, Fryer-Edwards, Barley, and Tulsky. Statistical analysis: Alexander and Gooley. Obtained funding: Back. Administrative, technical, and material support: Back, Barley, and Tulsky. Study supervision: Back, Alexander, and Tulsky.

Financial Disclosure: None reported.

Funding/Support: This study was supported by grant R25 92055 from the National Cancer Institute.

Acknowledgment: We thank Rose Callahan, Rachel Smith, and Jackie van Allen for their excellent project management; the fellows who participated in Oncotalk; and the actors who made this program possible.

References
1.
 State-of-the-Science Conference Statement: Improving End-of-Life Care.  Bethesda, Md National Institutes of Health2004;
2.
 Cancer care during the last phase of life.  J Clin Oncol 1998;161986- 1996PubMedGoogle Scholar
3.
Foley  KMGelband  H Improving Palliative Care for Cancer: Summary and Recommendations.  Washington, DC Institute of Medicine and National Academy Press2001;
4.
Morita  TAkechi  TIkenaga  M  et al.  Communication about the ending of anticancer treatment and transition to palliative care.  Ann Oncol 2004;151551- 1557PubMedGoogle ScholarCrossref
5.
Hagerty  RGButow  PNEllis  PM  et al.  Communicating with realism and hope: incurable cancer patients' views on the disclosure of prognosis.  J Clin Oncol 2005;231278- 1288PubMedGoogle ScholarCrossref
6.
Tulsky  JA Interventions to enhance communication among patients, providers, and families.  J Palliat Med 2005;8 ((suppl 1)) S95- S102PubMedGoogle ScholarCrossref
7.
Tulsky  JA Beyond advance directives: importance of communication skills at the end of life.  JAMA 2005;294359- 365PubMedGoogle ScholarCrossref
8.
Tulsky  JAChesney  MALo  B See one, do one, teach one? house staff experience discussing do-not-resuscitate orders.  Arch Intern Med 1996;1561285- 1289PubMedGoogle ScholarCrossref
9.
Accreditation Council for Graduate Medical Education, ACGME home page. http://www.acgme.org. Accessed November 15, 2006
10.
Delvaux  NRazavi  DMarchal  SBredart  AFarvacques  CSlachmuylder  JL Effects of a 105 hours psychological training program on attitudes, communication skills and occupational stress in oncology: a randomised study.  Br J Cancer 2004;90106- 114PubMedGoogle ScholarCrossref
11.
Fallowfield  LJenkins  VFarewell  VSaul  JDuffy  AEves  R Efficacy of a Cancer Research UK communication skills training model for oncologists: a randomised controlled trial.  Lancet 2002;359650- 656PubMedGoogle ScholarCrossref
12.
Levinson  WRoter  D The effects of two continuing medical education programs on communication skills of practicing primary care physicians.  J Gen Intern Med 1993;8318- 324PubMedGoogle ScholarCrossref
13.
Maguire  P Improving communication with cancer patients.  Eur J Cancer 1999;352058- 2065PubMedGoogle ScholarCrossref
14.
Razavi  DDelvaux  NMarchal  SBredart  AFarvacques  CPaesmans  M The effects of a 24-h psychological training program on attitudes, communication skills and occupational stress in oncology: a randomised study.  Eur J Cancer 1993;29A1858- 1863PubMedGoogle ScholarCrossref
15.
Razavi  DMerckaert  IMarchal  S  et al.  How to optimize physicians' communication skills in cancer care: results of a randomized study assessing the usefulness of posttraining consolidation workshops.  J Clin Oncol 2003;213141- 3149PubMedGoogle ScholarCrossref
16.
Bird  JHall  AMaguire  PHeavy  A Workshops for consultants on the teaching of clinical communication skills.  Med Educ 1993;27181- 185PubMedGoogle ScholarCrossref
17.
Baile  WFLenzi  RKudelka  AP  et al.  Improving physician-patient communication in cancer care: outcome of a workshop for oncologists.  J Cancer Educ 1997;12166- 173PubMedGoogle Scholar
18.
Brown  JBBoles  MMullooly  JPLevinson  W Effect of clinician communication skills training on patient satisfaction: a randomized, controlled trial.  Ann Intern Med 1999;131822- 829PubMedGoogle ScholarCrossref
19.
Back  ALArnold  RMTulsky  JABaile  WFFryer-Edwards  KA Teaching communication skills to medical oncology fellows.  J Clin Oncol 2003;212433- 2436PubMedGoogle ScholarCrossref
20.
Boyle  FMDunn  SMHeinrich  P More than one way to foster communication skills for medical oncology fellows: a national program in Australia.  J Clin Oncol 2003;214255PubMedGoogle ScholarCrossref
21.
Lenzi  RParker  PABerek  J  et al.  Design, conduct, and evaluation of a communication course for oncology fellows.  J Cancer Educ 2005;20143- 149PubMedGoogle ScholarCrossref
22.
Hoffman  MFerri  JSison  CRoter  DSchapira  LBaile  W Teaching communication skills: an AACE survey of oncology training programs.  J Cancer Educ 2004;19220- 224PubMedGoogle ScholarCrossref
23.
Parle  MMaguire  PHeaven  C The development of a training model to improve health professionals' skills, self-efficacy and outcome expectancies when communicating with cancer patients.  Soc Sci Med 1997;44231- 240PubMedGoogle ScholarCrossref
24.
Davis  DAMazmanian  PEFordis  MVan Harrison  RThorpe  KEPerrier  L Accuracy of physician self-assessment compared with observed measures of competence: a systematic review.  JAMA 2006;2961094- 1102PubMedGoogle ScholarCrossref
25.
American Society of Clinical Oncology, ASCO home page. http://www.asco.org. Accessed November 15, 2006
26.
Back  ALArnold  RBaile  WTulsky  JFryer-Edwards  KA Approaching difficult communication tasks in oncology.  CA Cancer J Clin 2005;55164- 177PubMedGoogle ScholarCrossref
27.
Back  ALArnold  RMQuill  TE Hope for the best, and prepare for the worst.  Ann Intern Med 2003;138439- 443PubMedGoogle ScholarCrossref
28.
Back  ALArnold  RMTulsky  JABaile  WFFryer-Edwards  KA On saying goodbye: acknowledging the end of the patient-physician relationship with patients who are near death.  Ann Intern Med 2005;142682- 685PubMedGoogle ScholarCrossref
29.
Girgis  ASanson-Fisher  RW Breaking bad news, I: current best advice for clinicians.  Behav Med 1998;2453- 59PubMedGoogle ScholarCrossref
30.
Girgis  ASanson-Fisher  RW Breaking bad news: consensus guidelines for medical practitioners.  J Clin Oncol 1995;132449- 2456PubMedGoogle Scholar
31.
Thorne  SEBultz  BDBaile  WF Is there a cost to poor communication in cancer care? a critical review of the literature.  Psychooncology 2005;14875- 884PubMedGoogle ScholarCrossref
32.
Walsh  RAGirgis  ASanson-Fisher  RW Breaking bad news, II: what evidence is available to guide clinicians?  Behav Med 1998;2461- 72PubMedGoogle ScholarCrossref
33.
Griffith  CH  IIIWilson  JFLanger  SHaist  SA House staff nonverbal communication skills and standardized patient satisfaction.  J Gen Intern Med 2003;18170- 174PubMedGoogle ScholarCrossref
34.
Suchman  ALMarkakis  KBeckman  HBFrankel  R A model of empathic communication in the medical interview.  JAMA 1997;277678- 682PubMedGoogle ScholarCrossref
35.
Fryer-Edwards  KAArnold  RBack  ABaile  WTulsky  J Tough Talk: Helping Physicians Have Difficult Conversations.  Seattle University of Washington2004;
36.
Fryer-Edwards  KArnold  RBaile  WTulsky  JPetracca  FBack  AL Reflective teaching practices: an approach to teaching communication skills in a small-group setting.  Acad Med 2006;81638- 644PubMedGoogle ScholarCrossref
37.
Baile  WFBuckman  RLenzi  RGlober  GBeale  EAKudelka  AP SPIKES: a six-step protocol for delivering bad news: application to the patient with cancer.  Oncologist 2000;5302- 311PubMedGoogle ScholarCrossref
38.
Quill  TEArnold  RMPlatt  F “I wish things were different”: expressing wishes in response to loss, futility, and unrealistic hopes.  Ann Intern Med 2001;135551- 555PubMedGoogle ScholarCrossref
39.
Smith  RC Patient-Centered Interviewing: An Evidence-Based Method.  Philadelphia, Pa Lippincott Williams & Wilkins2002;
40.
Alexander  SCKeitz  SASloane  RTulsky  JA A controlled trial of a short course to improve residents' communication with patients at the end of life.  Acad Med 2006;811008- 1012PubMedGoogle ScholarCrossref
41.
McGinn  TWyer  PCNewman  TBKeitz  SLeipzig  RFor  GG Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic).  CMAJ 2004;1711369- 1373PubMedGoogle ScholarCrossref
42.
Francis  LK Learning to listen: a fellow's experience.  J Clin Oncol 2006;243209- 3210PubMedGoogle ScholarCrossref
43.
Roter  DLLarson  SShinitzky  H  et al.  Use of an innovative video feedback technique to enhance communication skills training.  Med Educ 2004;38145- 157PubMedGoogle ScholarCrossref
44.
Roter  DLHall  JAKern  DEBarker  LRCole  KARoca  RP Improving physicians' interviewing skills and reducing patients' emotional distress: a randomized clinical trial.  Arch Intern Med 1995;1551877- 1884PubMedGoogle ScholarCrossref
45.
Fellowes  DWilkinson  SMoore  P Communication skills training for health care professionals working with cancer patients, their families and/or carers.  Cochrane Database Syst Rev 2004;CD003751PubMedGoogle Scholar
46.
Pieters  HMTouw-Otten  FWDe Melker  RA Simulated patients in assessing consultation skills of trainees in general practice vocational training: a validity study.  Med Educ 1994;28226- 233PubMedGoogle ScholarCrossref
47.
Fallowfield  LJenkins  VFarewell  VSolis-Trapala  I Enduring impact of communication skills training: results of a 12-month follow-up.  Br J Cancer 2003;891445- 1449PubMedGoogle ScholarCrossref
48.
Miller  WRRollnick  S Motivational Interviewing: Preparing People for Change. 2nd ed. New York, NY Guilford Publications2002;
49.
Kagawa-Singer  MBlackhall  LJ Negotiating cross-cultural issues at the end of life: “you got to go where he lives.”  JAMA 2001;2862993- 3001PubMedGoogle ScholarCrossref
×