[Skip to Navigation]
Sign In
Figure 1.  CONSORT Diagram of Screening, Enrollment, and Follow-up of Trial Participants
CONSORT Diagram of Screening, Enrollment, and Follow-up of Trial Participants

AD indicates advance directive; and PREPARE, PREPARE For Your Care.

aConcerns about privacy of medical information or distrust of the clinic or hospital.

bPatient willing to participate, but logistical issues (eg, work, caretaking, travel, illness) prevented scheduling.

cRemoved from study for staff safety.

dUnavailable participants completed subsequent interviews and were not lost to follow-up.

eTotal retention rate of survivors was 85.9% (832 of 969); there were 17 decedents. The AD-only retention rate was 88.7% (441 of 497); there were 8 decedents. The PREPARE arm retention rate was 82.8% (391 of 472); there were 9 decedents.

Figure 2.  New Advance Care Planning Documentation in the Medical Record
New Advance Care Planning Documentation in the Medical Record

The PREPARE For Your Care (PREPARE) arm included the website (http://www.prepareforyourcare.org) plus an easy-to-read advance directive (AD). The AD-only arm included only the easy-to-read AD.

Figure 3.  Advance Care Planning (ACP) Engagement Behavior Change and Action Scores
Advance Care Planning (ACP) Engagement Behavior Change and Action Scores

Behavior change was measured on a 5-point Likert scale. Action scores ranged from 0 to 25. P values reflect significance for overall group + time interactions using repeated measures, mixed-effects linear regression models adjusted for health literacy, baseline ACP documentation, and clustering by physician. Statistical significance set at P < .025 to account for multiple comparisons for the 2 outcomes of behavior change and action scores. No additional P value adjustments were made for analyses stratified by language as these were prespecified. P values reflect group by time interactions. In addition, all P values for time were also less than .001 (ie, both PREPARE and AD-only arms increased significantly from baseline). AD indicates advance directive; and PREPARE, PREPARE For Your Care.

Table 1.  Participant Characteristicsa
Participant Characteristicsa
Table 2.  Percentage of Participants With Increased ACP Behavior Change and Actions Scores Over Time
Percentage of Participants With Increased ACP Behavior Change and Actions Scores Over Time
1.
Wright  AA, Zhang  B, Ray  A,  et al.  Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment.  JAMA. 2008;300(14):1665-1673. doi:10.1001/jama.300.14.1665PubMedGoogle ScholarCrossref
2.
Silveira  MJ, Kim  SY, Langa  KM.  Advance directives and outcomes of surrogate decision making before death.  N Engl J Med. 2010;362(13):1211-1218. doi:10.1056/NEJMsa0907901PubMedGoogle ScholarCrossref
3.
Detering  KM, Hancock  AD, Reade  MC, Silvester  W.  The impact of advance care planning on end of life care in elderly patients: randomised controlled trial.  BMJ. 2010;340:c1345. doi:10.1136/bmj.c1345PubMedGoogle ScholarCrossref
4.
Institute of Medicine.  Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life. Washington, DC: The National Academies Press; 2015.
5.
Pope  TM.  Legal briefing: Medicare coverage of advance care planning.  J Clin Ethics. 2015;26(4):361-367.PubMedGoogle Scholar
6.
Ferrell  B, Connor  SR, Cordes  A,  et al; National Consensus Project for Quality Palliative Care Task Force Members.  The national agenda for quality palliative care: the National Consensus Project and the National Quality Forum.  J Pain Symptom Manage. 2007;33(6):737-744. doi:10.1016/j.jpainsymman.2007.02.024PubMedGoogle ScholarCrossref
7.
Ramsaroop  SD, Reid  MC, Adelman  RD.  Completing an advance directive in the primary care setting: what do we need for success?  J Am Geriatr Soc. 2007;55(2):277-283. doi:10.1111/j.1532-5415.2007.01065.xPubMedGoogle ScholarCrossref
8.
Heyland  DK, Barwich  D, Pichora  D,  et al; ACCEPT (Advance Care Planning Evaluation in Elderly Patients) Study Team; Canadian Researchers at the End of Life Network (CARENET).  Failure to engage hospitalized elderly patients and their families in advance care planning.  JAMA Intern Med. 2013;173(9):778-787. doi:10.1001/jamainternmed.2013.180PubMedGoogle ScholarCrossref
9.
Krakauer  EL, Crenner  C, Fox  K.  Barriers to optimum end-of-life care for minority patients.  J Am Geriatr Soc. 2002;50(1):182-190. doi:10.1046/j.1532-5415.2002.50027.xPubMedGoogle ScholarCrossref
10.
Sudore  RL, Landefeld  CS, Barnes  DE,  et al.  An advance directive redesigned to meet the literacy level of most adults: a randomized trial.  Patient Educ Couns. 2007;69(1-3):165-195. doi:10.1016/j.pec.2007.08.015PubMedGoogle ScholarCrossref
11.
Crawley  L, Payne  R, Bolden  J, Payne  T, Washington  P, Williams  S; Initiative to Improve Palliative and End-of-Life Care in the African American Community.  Palliative and end-of-life care in the African American community.  JAMA. 2000;284(19):2518-2521. doi:10.1001/jama.284.19.2518PubMedGoogle ScholarCrossref
12.
Welch  LC, Teno  JM, Mor  V.  End-of-life care in black and white: race matters for medical care of dying patients and their families.  J Am Geriatr Soc. 2005;53(7):1145-1153. doi:10.1111/j.1532-5415.2005.53357.xPubMedGoogle ScholarCrossref
13.
Kwak  J, Haley  WE.  Current research findings on end-of-life decision making among racially or ethnically diverse groups.  Gerontologist. 2005;45(5):634-641. doi:10.1093/geront/45.5.634PubMedGoogle ScholarCrossref
14.
Harrison  KL, Adrion  ER, Ritchie  CS, Sudore  RL, Smith  AK.  Low completion and disparities in advance care planning activities among older Medicare beneficiaries.  JAMA Intern Med. 2016;176(12):1872-1875. doi:10.1001/jamainternmed.2016.6751PubMedGoogle ScholarCrossref
15.
Hong  M, Yi  EH, Johnson  KJ, Adamek  ME.  Facilitators and barriers for advance care planning among ethnic and racial minorities in the US: a systematic review of the current literature.  J Immigr Minor Health. 2018;20(5):1277-1287. doi:10.1007/s10903-017-0670-9PubMedGoogle ScholarCrossref
16.
Castillo  LS, Williams  BA, Hooper  SM, Sabatino  CP, Weithorn  LA, Sudore  RL.  Lost in translation: the unintended consequences of advance directive law on clinical care.  Ann Intern Med. 2011;154(2):121-128. doi:10.7326/0003-4819-154-2-201101180-00012PubMedGoogle ScholarCrossref
17.
Singh  JA, Sloan  JA, Atherton  PJ,  et al.  Preferred roles in treatment decision making among patients with cancer: a pooled analysis of studies using the Control Preferences Scale.  Am J Manag Care. 2010;16(9):688-696.PubMedGoogle Scholar
18.
Sudore  RL, Knight  SJ, McMahan  RD,  et al.  A novel website to prepare diverse older adults for decision making and advance care planning: a pilot study.  J Pain Symptom Manage. 2014;47(4):674-686. doi:10.1016/j.jpainsymman.2013.05.023PubMedGoogle ScholarCrossref
19.
Sudore  RL, Fried  TR.  Redefining the ‘planning’ in advance care planning: preparing for end-of-life decision making.  Ann Intern Med. 2010;153(4):256-261. doi:10.7326/0003-4819-153-4-201008170-00008PubMedGoogle ScholarCrossref
20.
Sudore  RL, Boscardin  J, Feuz  MA, McMahan  RD, Katen  MT, Barnes  DE.  Effect of the PREPARE website vs an easy-to-read advance directive on advance care planning documentation and engagement among veterans: a randomized clinical trial.  JAMA Intern Med. 2017;177(8):1102-1109. doi:10.1001/jamainternmed.2017.1607PubMedGoogle ScholarCrossref
21.
Sudore  RL, Barnes  DE, Le  GM,  et al.  Improving advance care planning for English-speaking and Spanish-speaking older adults: study protocol for the PREPARE randomised controlled trial.  BMJ Open. 2016;6(7):e011705. doi:10.1136/bmjopen-2016-011705PubMedGoogle ScholarCrossref
22.
Sudore  RL, Landefeld  CS, Williams  BA, Barnes  DE, Lindquist  K, Schillinger  D.  Use of a modified informed consent process among vulnerable patients: a descriptive study.  J Gen Intern Med. 2006;21(8):867-873. doi:10.1111/j.1525-1497.2006.00535.xPubMedGoogle ScholarCrossref
23.
Sudore  RL, Lum  HD, You  JJ,  et al.  Defining advance care planning for adults: a consensus definition from a multidisciplinary Delphi panel.  J Pain Symptom Manage. 2017;53(5):821-832. doi:10.1016/j.jpainsymman.2016.12.331PubMedGoogle ScholarCrossref
24.
Volandes  AE, Paasche-Orlow  M, Gillick  MR,  et al.  Health literacy not race predicts end-of-life care preferences.  J Palliat Med. 2008;11(5):754-762. doi:10.1089/jpm.2007.0224PubMedGoogle ScholarCrossref
25.
Sudore  RL, Stewart  AL, Knight  SJ,  et al.  Development and validation of a questionnaire to detect behavior change in multiple advance care planning behaviors.  PLoS One. 2013;8(9):e72465. doi:10.1371/journal.pone.0072465PubMedGoogle ScholarCrossref
26.
Sudore  RL, Heyland  DK, Barnes  DE,  et al.  Measuring advance care planning: optimizing the Advance Care Planning Engagement Survey.  J Pain Symptom Manage. 2017;53(4):669-681.e8. doi:10.1016/j.jpainsymman.2016.10.367PubMedGoogle ScholarCrossref
27.
Kroenke  K, Strine  TW, Spitzer  RL, Williams  JB, Berry  JT, Mokdad  AH.  The PHQ-8 as a measure of current depression in the general population.  J Affect Disord. 2009;114(1-3):163-173. doi:10.1016/j.jad.2008.06.026PubMedGoogle ScholarCrossref
28.
Spitzer  RL, Kroenke  K, Williams  JB, Löwe  B.  A brief measure for assessing generalized anxiety disorder: the GAD-7.  Arch Intern Med. 2006;166(10):1092-1097. doi:10.1001/archinte.166.10.1092PubMedGoogle ScholarCrossref
29.
Cohen  J.  Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Earlbaum Associates; 1988.
30.
El-Jawahri  A, Paasche-Orlow  MK, Matlock  D,  et al.  Randomized, controlled trial of an advance care planning video decision support tool for patients with advanced heart failure.  Circulation. 2016;134(1):52-60. doi:10.1161/CIRCULATIONAHA.116.021937PubMedGoogle ScholarCrossref
31.
Walker  E, McMahan  R, Barnes  D, Katen  M, Lamas  D, Sudore  R.  Advance care planning documentation practices and accessibility in the electronic health record: implications for patient safety.  J Pain Symptom Manage. 2018;55(2):256-264. doi:10.1016/j.jpainsymman.2017.09.018PubMedGoogle ScholarCrossref
32.
Sudore  RL, Heyland  DK, Lum  HD,  et al.  Outcomes that define successful advance care planning: a Delphi panel consensus.  J Pain Symptom Manage. 2018;55(2):245-255. doi:10.1016/j.jpainsymman.2017.08.025PubMedGoogle ScholarCrossref
33.
Austin  CA, Mohottige  D, Sudore  RL, Smith  AK, Hanson  LC.  Tools to promote shared decision making in serious illness: a systematic review.  JAMA Intern Med. 2015;175(7):1213-1221. doi:10.1001/jamainternmed.2015.1679PubMedGoogle ScholarCrossref
34.
Butler  M, Ratner  E, McCreedy  E, Shippee  N, Kane  RL.  Decision aids for advance care planning: an overview of the state of the science.  Ann Intern Med. 2014;161(6):408-418. doi:10.7326/M14-0644PubMedGoogle ScholarCrossref
35.
Hammes  BJ, Rooney  BL, Gundrum  JD.  A comparative, retrospective, observational study of the prevalence, availability, and specificity of advance care plans in a county that implemented an advance care planning microsystem.  J Am Geriatr Soc. 2010;58(7):1249-1255. doi:10.1111/j.1532-5415.2010.02956.xPubMedGoogle ScholarCrossref
36.
Pearlman  RA, Starks  H, Cain  KC, Cole  WG.  Improvements in advance care planning in the Veterans Affairs System: results of a multifaceted intervention.  Arch Intern Med. 2005;165(6):667-674. doi:10.1001/archinte.165.6.667PubMedGoogle ScholarCrossref
37.
Fischer  SM, Cervantes  L, Fink  RM, Kutner  JS.  Apoyo con Cariño: a pilot randomized controlled trial of a patient navigator intervention to improve palliative care outcomes for Latinos with serious illness.  J Pain Symptom Manage. 2015;49(4):657-665. doi:10.1016/j.jpainsymman.2014.08.011PubMedGoogle ScholarCrossref
38.
Maldonado  LY, Goodson  RB, Mulroy  MC, Johnson  EM, Reilly  JM, Homeier  DC.  Wellness in sickness and health (The W.I.S.H. Project): advance care planning preferences and experiences among elderly Latino patients  [published online October 25, 2017].  Clin Gerontol. doi:10.1080/07317115.2017.1389793PubMedGoogle Scholar
Original Investigation
December 2018

Engaging Diverse English- and Spanish-Speaking Older Adults in Advance Care Planning: The PREPARE Randomized Clinical Trial

Author Affiliations
  • 1Division of Geriatrics, Department of Medicine, University of California, San Francisco
  • 2Geriatrics, Palliative, and Extended Care, San Francisco Veterans Affairs Health Care System, San Francisco, California
  • 3Northern California Institute for Research and Education, San Francisco
  • 4Innovation and Implementation Center for Aging and Palliative Care, Division of Geriatrics, Department of Medicine, University of California, San Francisco
  • 5Center for Vulnerable Populations, Zuckerberg San Francisco General Hospital, San Francisco, California
  • 6Department of Medicine, University of California, San Francisco
  • 7Division of General Internal Medicine, Department of Medicine, University of California, San Francisco
  • 8Department of Epidemiology & Biostatistics, University of California, San Francisco
  • 9Department of Psychiatry, University of California, San Francisco
JAMA Intern Med. 2018;178(12):1616-1625. doi:10.1001/jamainternmed.2018.4657
Key Points

Question  Can a patient-facing, online program called PREPARE For Your Care plus an easy-to-read advance directive increase advance care planning documentation and engagement compared with the easy-to-read advance directive alone?

Findings  In this randomized clinical trial of 986 English-speaking and Spanish-speaking older adults with chronic illness from 4 primary care clinics, PREPARE For Your Care plus an easy-to-read advance directive resulted in higher rates of advance care planning documentation (43.0% vs 32.0%) and engagement (98.1% vs 89.5%) compared with an advance directive alone.

Meaning  Patient-facing tools, including an online advance care planning program and an easy-to-read advance directive, may enable diverse populations to engage in the advance care planning process without additional clinician-level or system-level interventions.

Abstract

Importance  Advance care planning improves the receipt of medical care aligned with patients’ values; however, it remains suboptimal among diverse patient populations. To mitigate literacy, cultural, and language barriers to advance care planning, easy-to-read advance directives and a patient-directed, online advance care planning program called PREPARE For Your Care (PREPARE) were created in English and Spanish.

Objective  To compare the efficacy of PREPARE plus an easy-to-read advance directive with an advance directive alone to increase advance care planning documentation and patient-reported engagement.

Design, Setting, and Participants  A comparative efficacy randomized clinical trial was conducted from February 1, 2014, to November 30, 2017, at 4 safety-net, primary-care clinics in San Francisco among 986 English-speaking or Spanish-speaking primary care patients 55 years or older with 2 or more chronic or serious illnesses.

Interventions  Participants were randomized to PREPARE plus an easy-to-read advance directive (PREPARE arm) or the advance directive alone. There were no clinician-level or system-level interventions. Staff were blinded for all follow-up measurements.

Main Outcomes and Measures  The primary outcome was documentation of new advance care planning (ie, legal forms and/or documented discussions) at 15 months. Patient-reported outcomes included advance care planning engagement at baseline, 1 week, 3 months, 6 months, and 12 months using validated surveys. Intention-to-treat analyses were performed using mixed-effects logistic and linear regression, controlling for time, health literacy, and baseline advance care planning, clustering by physician, and stratifying by language.

Results  Among the 986 participants (603 women and 383 men), the mean (SD) age was 63.3 (6.4) years, 387 of 975 (39.7%) had limited health literacy, and 445 (45.1%) were Spanish speaking. No participant characteristic differed between the 2 groups, and retention was 85.9% (832 of 969) among survivors. Compared with the advance directive alone, PREPARE resulted in a higher rate of advance care planning documentation (unadjusted, 43.0% [207 of 481] vs 33.1% [167 of 505]; P < .001; adjusted, 43.0% vs 32.0%; P < .001) and higher self-reported increased advance care planning engagement scores (98.1% vs 89.5%; P < .001). Results remained significant among English speakers and Spanish speakers.

Conclusions and Relevance  The patient-facing PREPARE program and an easy-to-read advance directive, without clinician-level or system-level interventions, increased documentation of advance care planning and patient-reported engagement, with statistically higher gains for PREPARE vs advance directive alone. These tools may mitigate literacy and language barriers to advance care planning, allow patients to begin planning on their own, and could substantially improve the process for diverse English-speaking and Spanish-speaking populations.

Trial Registration  ClinicalTrials.gov identifiers: NCT01990235 and NCT02072941

Introduction

Advance care planning (ACP) improves the receipt of medical care aligned with patients’ values and patient satisfaction.1-3 Thus, ACP has recently been approved for reimbursement and recommended as a quality indicator in clinical guidelines.4-6 However, a majority of older adults, even those with serious illness, have not engaged in conversations about ACP, and patients’ wishes about ACP are often not documented.4,7,8 Engagement in ACP remains especially low among minorities and patients with limited health literacy and limited English proficiency, and is less than 20% among Latinos.9-14 For health care systems and clinicians, barriers to ACP include time and resource constraints. For minorities, ACP is complicated by a lack of trust and prior experiences of racism,15 complex legal language in advance directives (ADs),16 and differing views on autonomy and decision making.17

To overcome these barriers and to address a lack of literacy-appropriate, culturally appropriate, and linguistically appropriate ACP materials, we created an easy-to-read AD and a patient-directed, interactive, online ACP program in English and Spanish called PREPARE For Your Care (PREPARE) (https://prepareforyourcare.org/).10,18 PREPARE is designed to be used at home, to prepare people for complex medical decision making,19 and incorporates several unique health communication elements. These elements include application of user-centered design principles in the co-creation of the program with and for diverse patients and surrogate decision makers; 5 modular skill-building steps based on social cognitive and behavior change theories that model how to engage in ACP through video stories; narratives and testimonials based on real scenarios to mitigate cultural barriers; video, audio, and closed-captioning in 2 languages to mitigate literacy, language, and hearing barriers; and encouragement to include family and loved ones.18 The AD has been shown to improve ACP engagement among English speakers and Spanish speakers,10 and PREPARE has been shown to improve engagement among English-speaking veterans.20 However, to our knowledge, no prior study has compared these interventions among ethnically diverse English-speaking and Spanish-speaking older adults in a safety-net health care system. The objective of this trial was to compare the efficacy of PREPARE plus the easy-to-read AD vs the AD alone on ACP documentation in the medical record and patient-reported ACP engagement. We hypothesized that documentation and engagement would increase in both arms and be greater in the PREPARE arm.

Methods

This is a single-blind, parallel-group, comparative efficacy trial randomized at the patient level. Because of the benefits of ACP,1-3 we chose not to have a control group and provided all participants with ACP materials. The conceptual framework of PREPARE, based on social cognitive and behavior change theories, and the trial protocol including inclusion and exclusion criteria, as well as the study flow diagram, recruitment procedures, sample size estimates, and validity, reliability, and response options of all outcome measures have been previously published and are included in the trial protocol in Supplement 1.18,21 This study was approved by the University of California, San Francisco Institutional Review Board; written informed consent was obtained using a teach-to-goal process in English and Spanish22; and safety was overseen by a patient-clinician stakeholder advisory board and a data safety monitoring board. Although recruitment of English speakers and Spanish speakers was supported by 2 funders, this was 1 trial with 1 protocol.21

Recruitment and Data Collection

Study participants were enrolled from 4 primary care clinics within the San Francisco Health Network, a public-health delivery system, from February 1, 2014, to November 30, 2017. We obtained a Health Insurance Portability and Accountability Act waiver to identify individuals who met inclusion and exclusion criteria and had upcoming primary care appointments.21 After receiving clinician approval, we sent recruitment letters written at a 5th-grade reading level in English or Spanish. If patients did not opt out, staff called them to assess interest and eligibility.

Participants and Enrollment Criteria

Patients were eligible if they were 55 years or older, spoke English or Spanish well or very well, had 2 or more chronic medical conditions by medical record review, 2 or more visits with a primary care provider (ie, established care), and 2 or more additional outpatient, inpatient, or emergency department visits in the past year (ie, marker of illness). To standardize timing of the intervention to upcoming primary care visits, participants were enrolled 1 to 3 weeks prior to an upcoming appointment. Exclusion criteria included dementia, moderate to severe cognitive impairment, blindness, deafness, delirium, psychosis, active drug or alcohol abuse (determined by their clinician, International Classification of Diseases, Ninth Revision codes, medical record review, or in-person screening), lack of a telephone, or inability to answer consent teach-back questions within 3 attempts.21 Because ACP is a process,19,23 we did not exclude individuals who had previously engaged in ACP.

Randomization, Allocation Concealment, Blinding, and Fidelity

Because limited health literacy is associated with lower ACP engagement,10,24 participants were block randomized, in random block sizes of 4, 6, and 8, by adequate vs limited health literacy using a random number generator.21 Clinicians were blinded. Participants could not be blinded but were told during consent there was a “50-50 chance” of getting 1 of 2 ACP interventions, and the nonassigned intervention was not described. Research staff were blinded for all follow-up assessments. Staff followed standardized scripts, used checklists, and were observed for 10% of interviews to ensure protocol fidelity.21

Interventions
Online PREPARE Program Plus AD Intervention

In the PREPARE arm, participants were asked to review PREPARE in English or Spanish in research offices. Although the 5 steps of PREPARE were designed to be viewed individually (approximately 10 minutes per step),18 to standardize exposure, participants were asked to complete all steps in their entirety. Although all materials are designed to be reviewed on their own at home, we standardized procedures for this trial by asking participants to review the materials on their own in our research offices. Research staff were available to answer questions but did not facilitate viewing of the materials. PREPARE includes interactive online values questions that, when answered, generate a unique action plan and “Summary of My Wishes.” This summary was printed and given to participants. PREPARE participants were also asked to review the AD for 5 to 15 minutes. They were provided the AD, the PREPARE Summary of My Wishes, and website login to take home. Participants were called 1 to 3 days prior to their upcoming primary care visit and reminded to talk to their clinician about the PREPARE materials. No clinician-level or system-level interventions were included in either arm.21

AD-Only Intervention

In the AD-only arm, participants were asked to review the easy-to-read AD in English or Spanish for 5 to 15 minutes in research offices on their own and were provided the AD to take home. They were reminded of their upcoming primary care visit by telephone 1 to 3 days before the primary care visit.21

Outcomes

We administered baseline questionnaires in person and follow-up questionnaires in person or by telephone. Fluent English-speaking or Spanish-speaking staff asked survey questions while participants could follow along with a written copy. Validity, reliability, and scoring of all measures are included in the published and online trial protocol included in Supplement 1.21 At baseline, we assessed self-reported participant characteristics including age, gender, race/ethnicity, income, marital status, and educational level.21 We also administered validated measures of health literacy, US acculturation, educational level, finances, religion or spirituality, social support, presence of a possible surrogate decision maker, self-rated health and functional status, desired role in decision making, prior planning (ie, burial or wills), internet access in the home, and, for Spanish speakers, patient-clinician language discordance.21 We determined documentation of ACP legal forms in the medical record at any time prior to enrollment and documented discussions about ACP within 5 years of enrollment. In addition, the baseline rate of documentation of ACP in the 12 months prior to enrollment was determined using a composite of legal forms or documented discussions about ACP.20,21

Primary Outcome

Our primary outcome was new documentation of ACP in the medical record 15 months after enrollment. We used a composite variable of legal forms (ie, ADs, durable power of attorney for health care, and Physicians Orders for Life Sustaining Treatment) and documented discussions (ie, oral directives or goals of care noted in the medical record) because both may be used to direct medical care.21 Documented discussions included documentation of oral directives by a physician or clinician notes describing patients’ surrogates or goals for medical care. All notes in the medical record were hand searched. We also assessed forms and discussions separately. All primary outcome data were double-coded by 2 independent, blinded reviewers as described in the trial protocol in Supplement 1.20,21

Secondary Patient-Reported Outcomes

The validated ACP Engagement Survey was used to measure engagement in the ACP process over time at baseline, 1 week, 3 months, 6 months, and 12 months.25,26 The Behavior Change Process subscales of knowledge, self-efficacy, and readiness included 5-point Likert response options of “not at all, a little, somewhat, fairly, and extremely” and the contemplation subscale included the 5-point response option of “never, once or twice, a few times, several times, and a lot.” The survey also includes a 0- to 25-item action score (eg, reported discussions and documentation of ACP wishes; yes or no).

Feasibility and Safety Outcomes

We measured ease of use on a scale of 1 (very hard) to 10 (very easy) points. Satisfaction was measured by asking about level of comfort, helpfulness, and likeliness of recommending the guide to others using a 5-point Likert scale (where 1 indicates not at all and 5 indicates extremely).21 To assess potential adverse outcomes, we measured depression and anxiety with the validated Patient Health Questionnaire-827 and Generalized Anxiety Disorder-728 questionnaires.

Sample Size

A sample of 350 in each arm allowed 92% power (2-tailed α = .05) to detect a difference in documentation of ACP between arms of 15% vs 30%.21 With an expected 15% loss to follow-up, our recruitment target was 201 English speakers and 201 Spanish speakers per arm (804 total) (trial protocol in Supplement 1).21

Statistical Analysis

We compared baseline characteristics using unpaired t tests, χ2 tests, or Fisher exact tests. We performed intention-to-treat analyses using SAS, version 9.4 (SAS Institute Inc), and STATA, version 15.0 (Stata Corp). All P values were 2 tailed and set at P < .05 for the primary outcome and Bonferroni adjusted for secondary outcomes (P < .025). Because of differences in ACP engagement by language,10 and based on stakeholder and funding agency recommendations, we decided, a priori, to also stratify all analyses by English speakers and Spanish speakers. For our primary outcome of documentation of ACP, we used mixed-effects logistic regression with fixed effects for time (baseline and 15 months), group (PREPARE vs AD-only), and group-by-time interaction. For our secondary outcomes of ACP engagement scores, we used mixed-effects linear regression with fixed effects for time (baseline, 1 week, 3 months, 6 months, and 12 months, with time modeled using dummy variables to allow for nonlinearity), group, and group-by-time interaction. Mixed-effects models enable inclusion of all available data in intention-to-treat analyses while accounting for within-individual correlation over time. Because this was a comparative efficacy trial, we calculated within-group pre-post effect sizes using standard, clinically meaningful thresholds (ie, small, 0.20-0.49; medium, 0.50-0.79; and large, ≥0.80).29 Per stakeholder request, we conducted post hoc mixed-effects regression to calculate the percentage of participants with increased behavior change or action scores from baseline (ie, estimated slope >0) by study arm. All models were adjusted for the blocking variable of health literacy (adequate or limited) and baseline documentation of ACP, and accounted for clustering by physician. P values were Bonferroni adjusted to P < .017.

We also explored effect modification by adding interaction terms to the group-by-time variable for language (English vs Spanish), health literacy (adequate vs limited), desired role in decision making (makes own decisions vs physicians decide), age (<65 years vs ≥65 years), gender (women vs men), race/ethnicity (white vs nonwhite), health status (good to excellent vs fair to poor), presence of a potential surrogate decision maker (yes vs no), internet access at home (yes vs no), and, for Spanish speakers, patient-clinician language discordance (concordant vs discordant); P < .05 was considered significant. Ease of use and satisfaction were assessed using the Wilcoxon rank-sum test, and depression and anxiety, adjusted for baseline scores, were assessed using analysis of variance. Definitions and references for all measures are in the trial protocol in Supplement 1.

Missing Data

There were no missing data for the primary outcome. For secondary outcomes, 920 of 986 participants (93.3%) had at least 1 follow-up interview, and all available data were included in the mixed-effects models.

Results

Of 1797 eligible patients, 986 (54.9%) enrolled; 481 were randomized to PREPARE and 505 to the AD-only group (Figure 1). The refusal rate was 30.1% (540 of 1797). Those who refused were older than those who enrolled (mean [SD] age, 66.9 [7.9] vs 63.3 [6.4] years; P < .001), but the groups did not otherwise differ. Among enrolled participants, 387 of 975 (39.7%) had limited health literacy, 504 of 983 (51.3%) reported fair to poor health, 269 (27.3%) had any prior documentation of ACP, and 99 (10.0%) had documentation of ACP during the 12 months prior to the intervention (Table 1). Participant characteristics did not differ between arms, except a higher rate of prior documentation of ACP among Spanish speakers in the AD-only arm compared with Spanish speakers in the PREPARE arm (64 of 226 [28.3%] vs 44 of 219 [20.1%]; P = .04). Twelve-month retention was 85.9% (832 of 969) among survivors (Figure 1) and 89 (9.0%) withdrew, 56 of 481 in PREPARE (11.6%) and 33 of 505 in the AD-only arm (6.5%) (P = .04) (eTable 1 in Supplement 2). No staff became unblinded.

New overall documentation of ACP at 15 months was higher in the PREPARE vs AD-only arm (unadjusted, 43.0% [207 of 481] vs 33.1% [167 of 505]; P < .001; and adjusted, 43% vs 32%; P < .001). All differences were significant for English and Spanish speakers (Figure 2). When assessed separately, documentation of legal forms was higher in the PREPARE vs AD-only arm in adjusted analysis (26% vs 13%; P < .001), but did not differ between arms for documented discussions in adjusted analysis (31% vs 26%; P = .10). There were no significant interaction effects of any participant characteristics for documentation of ACP, including health literacy, desired role in decision making, and patient-clinician language concordance for Spanish speakers (eTable 2 in Supplement 2).

Mean ACP behavior change and action scores increased significantly more in the PREPARE vs AD-only arm overall and for English speakers and Spanish speakers for all time points (Figure 3). Effect sizes were medium to large for PREPARE and small to medium for the AD-only group (eTable 3 in Supplement 2).29 In the PREPARE arm, 472 of 481 participants (98.1%) reported increased ACP engagement (behavior change or action) scores over time vs 452 of 505 participants (89.5%) for the AD-only arm (Table 2). When examined separately, behavior change scores (469 of 481 [97.5%] vs 441 of 505 [87.3%]; P < .001) and action scores (456 of 481 [94.8%] vs 396 of 505 [78.4%]; P < .001) were also higher for PREPARE vs the AD-only group (Table 2). Increases were significant for all types of ACP activities as well as for discussion-specific and documentation-specific ACP activities and among English speakers and Spanish speakers (Table 2).

Reported ease of use and satisfaction were high and did not differ between arms. However, PREPARE was perceived as significantly more helpful than the AD only overall and by English speakers and Spanish speakers (eTable 4 in Supplement 2). No adverse events were reported and adjusted mean depression and anxiety scores at 12 months did not differ between arms overall or for English speakers or Spanish speakers (eTable 5 in Supplement 2).

Discussion

In a diverse cohort of 986 English-speaking and Spanish-speaking older adults in a safety-net clinic setting, with high rates of chronic disease and limited health literacy, both the easy-to-read AD and the patient-directed, interactive online PREPARE program significantly increased documentation of ACP and patient-reported ACP engagement, with significantly greater gains in the PREPARE arm. This improvement was achieved without additional clinician-level or system-level interventions. To our knowledge, this is the largest, most culturally diverse trial of patient-facing ACP interventions.

These results are important because, historically, studies have demonstrated limited ACP engagement among low-income, diverse, Spanish-speaking older adults as well as a dearth of literacy-appropriate, culturally appropriate, and linguistically appropriate patient-facing ACP materials.9,14-16 The observed gains in documentation of ACP in this trial (43%) and a prior PREPARE trial among veterans (35%)20 are likely the result of a combination of novel health communication components of the patient-directed, interactive, online PREPARE program. These include co-creation with and for diverse populations to mitigate literacy, cultural, and language barriers10,18; theory-based content designed to enhance self-efficacy and readiness; and the use of narratives, testimonials, video stories, and modeling of behaviors, all of which are strategies demonstrated to help patients make decisions about ACP.30 The magnitude of improvement in documentation is clinically meaningful given the known deficiencies in clinician documentation, especially documented discussions.31 The high proportion of patient-reported ACP engagement for both documentation (422 of 481 [87.7%]) and discussions (451 of 481 [93.8%]) in the PREPARE arm further validates our medical record findings and demonstrates that patients engage in a range of ACP behaviors, such as discussions with surrogates and clinicians, in addition to documentation.19,23,32

Prior studies of patient-directed ACP tools in primary care have been less effective in increasing documentation of ACP (5%-23%) than coaching or facilitation.7,33,34 The use of trained clinicians or ACP facilitators has shown improvements of 50% or more in documentation of ACP among English-speaking and Spanish-speaking patients.3,7,33-38 However, many health care organizations, especially public and safety-net settings, do not have the resources for dedicated, trained ACP facilitators. This study demonstrates that PREPARE and the easy-to-read AD enable many patients to initiate and engage in the ACP process on their own, without the need for trained facilitators. All care plans should be reviewed by a medical professional within the patient’s clinical context. In addition, some individuals will need additional support to engage in ACP. Future research should explore whether PREPARE results in ACP quality comparable with that achieved by trained facilitators and whether combining PREPARE and the easy-to-read AD with other clinician-level or system-level interventions results in synergistic gains.

Limitations

This study has some limitations. Generalizability may be limited because participants were recruited from 1 integrated public-health delivery system in San Francisco; however, the sample was racially and ethnically diverse. It was not possible to blind participants; however, research staff were blinded for all follow-up assessments. Although limited staff support was provided, the interventions were viewed in research offices, and we do not have information concerning the questions asked of staff. Similarly, study interviews and reminder calls may have activated patients to engage in ACP. Additional studies are needed to determine whether similar results may be obtained if the materials are viewed at home or without reminder calls, often a regular part of primary care. Alternatively, because PREPARE was compared with an evidence-based, easy-to-read AD, PREPARE’s real-world effect compared with usual care may have been underestimated. Finally, we did not assess quality of ACP or longitudinal effects on the receipt of medical care aligned with patients’ values or costs. Shorter versions of PREPARE are now available for home use and future longitudinal effectiveness trials are needed and are under way.

Conclusions

The patient-facing, easy-to-read AD and the patient-directed, interactive, online PREPARE program, without additional system or clinician interventions, can substantially increase ACP documentation and engagement. PREPARE plus an easy-to-read AD resulted in higher ACP documentation and engagement than the AD alone, an effect that remained across English speakers and Spanish speakers and participants with limited health literacy. This study suggests that PREPARE and the easy-to-read directive are useful and potentially scalable ACP interventions for diverse populations. These patient-directed interventions may mitigate literacy, cultural, and language barriers to ACP; allow patients to begin planning on their own; and could substantially improve the process for diverse, English-speaking and Spanish-speaking populations.

Back to top
Article Information

Accepted for Publication: July 21, 2018.

Corresponding Author: Rebecca L. Sudore, MD, Division of Geriatrics, Department of Medicine, University of California, San Francisco, 4150 Clement St, 151R, San Francisco, CA 94121 (rebecca.sudore@ucsf.edu).

Published Online: October 29, 2018. doi:10.1001/jamainternmed.2018.4657

Author Contributions: Drs Sudore and Barnes had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Sudore, Schillinger, Boscardin, Barnes.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: All authors.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Sudore, Shi, Boscardin, Barnes.

Obtained funding: Sudore.

Administrative, technical, or material support: Katen, Osua.

Supervision: Sudore.

Conflict of Interest Disclosures: None reported.

Funding/Support: Research reported in this publication was supported through grant R01AG045043 from the National Institutes of Health (NIH) National Institute on Aging (NIA) and a Patient-Centered Outcomes Research Institute (PCORI) Award (CDR-1306-01500). Development of PREPARE was supported by the S. D. Bechtel Jr Foundation, the California Healthcare Foundation, and the National Palliative Care Research Center. Dr Sudore is also funded in part by grant K24AG054415 from the NIH, NIA.

Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The statements in this publication are solely the responsibility of the authors and do not necessarily represent the views of PCORI, its Board of Governors or Methodology Committee.

Data Sharing Statement: See Supplement 3.

References
1.
Wright  AA, Zhang  B, Ray  A,  et al.  Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment.  JAMA. 2008;300(14):1665-1673. doi:10.1001/jama.300.14.1665PubMedGoogle ScholarCrossref
2.
Silveira  MJ, Kim  SY, Langa  KM.  Advance directives and outcomes of surrogate decision making before death.  N Engl J Med. 2010;362(13):1211-1218. doi:10.1056/NEJMsa0907901PubMedGoogle ScholarCrossref
3.
Detering  KM, Hancock  AD, Reade  MC, Silvester  W.  The impact of advance care planning on end of life care in elderly patients: randomised controlled trial.  BMJ. 2010;340:c1345. doi:10.1136/bmj.c1345PubMedGoogle ScholarCrossref
4.
Institute of Medicine.  Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life. Washington, DC: The National Academies Press; 2015.
5.
Pope  TM.  Legal briefing: Medicare coverage of advance care planning.  J Clin Ethics. 2015;26(4):361-367.PubMedGoogle Scholar
6.
Ferrell  B, Connor  SR, Cordes  A,  et al; National Consensus Project for Quality Palliative Care Task Force Members.  The national agenda for quality palliative care: the National Consensus Project and the National Quality Forum.  J Pain Symptom Manage. 2007;33(6):737-744. doi:10.1016/j.jpainsymman.2007.02.024PubMedGoogle ScholarCrossref
7.
Ramsaroop  SD, Reid  MC, Adelman  RD.  Completing an advance directive in the primary care setting: what do we need for success?  J Am Geriatr Soc. 2007;55(2):277-283. doi:10.1111/j.1532-5415.2007.01065.xPubMedGoogle ScholarCrossref
8.
Heyland  DK, Barwich  D, Pichora  D,  et al; ACCEPT (Advance Care Planning Evaluation in Elderly Patients) Study Team; Canadian Researchers at the End of Life Network (CARENET).  Failure to engage hospitalized elderly patients and their families in advance care planning.  JAMA Intern Med. 2013;173(9):778-787. doi:10.1001/jamainternmed.2013.180PubMedGoogle ScholarCrossref
9.
Krakauer  EL, Crenner  C, Fox  K.  Barriers to optimum end-of-life care for minority patients.  J Am Geriatr Soc. 2002;50(1):182-190. doi:10.1046/j.1532-5415.2002.50027.xPubMedGoogle ScholarCrossref
10.
Sudore  RL, Landefeld  CS, Barnes  DE,  et al.  An advance directive redesigned to meet the literacy level of most adults: a randomized trial.  Patient Educ Couns. 2007;69(1-3):165-195. doi:10.1016/j.pec.2007.08.015PubMedGoogle ScholarCrossref
11.
Crawley  L, Payne  R, Bolden  J, Payne  T, Washington  P, Williams  S; Initiative to Improve Palliative and End-of-Life Care in the African American Community.  Palliative and end-of-life care in the African American community.  JAMA. 2000;284(19):2518-2521. doi:10.1001/jama.284.19.2518PubMedGoogle ScholarCrossref
12.
Welch  LC, Teno  JM, Mor  V.  End-of-life care in black and white: race matters for medical care of dying patients and their families.  J Am Geriatr Soc. 2005;53(7):1145-1153. doi:10.1111/j.1532-5415.2005.53357.xPubMedGoogle ScholarCrossref
13.
Kwak  J, Haley  WE.  Current research findings on end-of-life decision making among racially or ethnically diverse groups.  Gerontologist. 2005;45(5):634-641. doi:10.1093/geront/45.5.634PubMedGoogle ScholarCrossref
14.
Harrison  KL, Adrion  ER, Ritchie  CS, Sudore  RL, Smith  AK.  Low completion and disparities in advance care planning activities among older Medicare beneficiaries.  JAMA Intern Med. 2016;176(12):1872-1875. doi:10.1001/jamainternmed.2016.6751PubMedGoogle ScholarCrossref
15.
Hong  M, Yi  EH, Johnson  KJ, Adamek  ME.  Facilitators and barriers for advance care planning among ethnic and racial minorities in the US: a systematic review of the current literature.  J Immigr Minor Health. 2018;20(5):1277-1287. doi:10.1007/s10903-017-0670-9PubMedGoogle ScholarCrossref
16.
Castillo  LS, Williams  BA, Hooper  SM, Sabatino  CP, Weithorn  LA, Sudore  RL.  Lost in translation: the unintended consequences of advance directive law on clinical care.  Ann Intern Med. 2011;154(2):121-128. doi:10.7326/0003-4819-154-2-201101180-00012PubMedGoogle ScholarCrossref
17.
Singh  JA, Sloan  JA, Atherton  PJ,  et al.  Preferred roles in treatment decision making among patients with cancer: a pooled analysis of studies using the Control Preferences Scale.  Am J Manag Care. 2010;16(9):688-696.PubMedGoogle Scholar
18.
Sudore  RL, Knight  SJ, McMahan  RD,  et al.  A novel website to prepare diverse older adults for decision making and advance care planning: a pilot study.  J Pain Symptom Manage. 2014;47(4):674-686. doi:10.1016/j.jpainsymman.2013.05.023PubMedGoogle ScholarCrossref
19.
Sudore  RL, Fried  TR.  Redefining the ‘planning’ in advance care planning: preparing for end-of-life decision making.  Ann Intern Med. 2010;153(4):256-261. doi:10.7326/0003-4819-153-4-201008170-00008PubMedGoogle ScholarCrossref
20.
Sudore  RL, Boscardin  J, Feuz  MA, McMahan  RD, Katen  MT, Barnes  DE.  Effect of the PREPARE website vs an easy-to-read advance directive on advance care planning documentation and engagement among veterans: a randomized clinical trial.  JAMA Intern Med. 2017;177(8):1102-1109. doi:10.1001/jamainternmed.2017.1607PubMedGoogle ScholarCrossref
21.
Sudore  RL, Barnes  DE, Le  GM,  et al.  Improving advance care planning for English-speaking and Spanish-speaking older adults: study protocol for the PREPARE randomised controlled trial.  BMJ Open. 2016;6(7):e011705. doi:10.1136/bmjopen-2016-011705PubMedGoogle ScholarCrossref
22.
Sudore  RL, Landefeld  CS, Williams  BA, Barnes  DE, Lindquist  K, Schillinger  D.  Use of a modified informed consent process among vulnerable patients: a descriptive study.  J Gen Intern Med. 2006;21(8):867-873. doi:10.1111/j.1525-1497.2006.00535.xPubMedGoogle ScholarCrossref
23.
Sudore  RL, Lum  HD, You  JJ,  et al.  Defining advance care planning for adults: a consensus definition from a multidisciplinary Delphi panel.  J Pain Symptom Manage. 2017;53(5):821-832. doi:10.1016/j.jpainsymman.2016.12.331PubMedGoogle ScholarCrossref
24.
Volandes  AE, Paasche-Orlow  M, Gillick  MR,  et al.  Health literacy not race predicts end-of-life care preferences.  J Palliat Med. 2008;11(5):754-762. doi:10.1089/jpm.2007.0224PubMedGoogle ScholarCrossref
25.
Sudore  RL, Stewart  AL, Knight  SJ,  et al.  Development and validation of a questionnaire to detect behavior change in multiple advance care planning behaviors.  PLoS One. 2013;8(9):e72465. doi:10.1371/journal.pone.0072465PubMedGoogle ScholarCrossref
26.
Sudore  RL, Heyland  DK, Barnes  DE,  et al.  Measuring advance care planning: optimizing the Advance Care Planning Engagement Survey.  J Pain Symptom Manage. 2017;53(4):669-681.e8. doi:10.1016/j.jpainsymman.2016.10.367PubMedGoogle ScholarCrossref
27.
Kroenke  K, Strine  TW, Spitzer  RL, Williams  JB, Berry  JT, Mokdad  AH.  The PHQ-8 as a measure of current depression in the general population.  J Affect Disord. 2009;114(1-3):163-173. doi:10.1016/j.jad.2008.06.026PubMedGoogle ScholarCrossref
28.
Spitzer  RL, Kroenke  K, Williams  JB, Löwe  B.  A brief measure for assessing generalized anxiety disorder: the GAD-7.  Arch Intern Med. 2006;166(10):1092-1097. doi:10.1001/archinte.166.10.1092PubMedGoogle ScholarCrossref
29.
Cohen  J.  Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Earlbaum Associates; 1988.
30.
El-Jawahri  A, Paasche-Orlow  MK, Matlock  D,  et al.  Randomized, controlled trial of an advance care planning video decision support tool for patients with advanced heart failure.  Circulation. 2016;134(1):52-60. doi:10.1161/CIRCULATIONAHA.116.021937PubMedGoogle ScholarCrossref
31.
Walker  E, McMahan  R, Barnes  D, Katen  M, Lamas  D, Sudore  R.  Advance care planning documentation practices and accessibility in the electronic health record: implications for patient safety.  J Pain Symptom Manage. 2018;55(2):256-264. doi:10.1016/j.jpainsymman.2017.09.018PubMedGoogle ScholarCrossref
32.
Sudore  RL, Heyland  DK, Lum  HD,  et al.  Outcomes that define successful advance care planning: a Delphi panel consensus.  J Pain Symptom Manage. 2018;55(2):245-255. doi:10.1016/j.jpainsymman.2017.08.025PubMedGoogle ScholarCrossref
33.
Austin  CA, Mohottige  D, Sudore  RL, Smith  AK, Hanson  LC.  Tools to promote shared decision making in serious illness: a systematic review.  JAMA Intern Med. 2015;175(7):1213-1221. doi:10.1001/jamainternmed.2015.1679PubMedGoogle ScholarCrossref
34.
Butler  M, Ratner  E, McCreedy  E, Shippee  N, Kane  RL.  Decision aids for advance care planning: an overview of the state of the science.  Ann Intern Med. 2014;161(6):408-418. doi:10.7326/M14-0644PubMedGoogle ScholarCrossref
35.
Hammes  BJ, Rooney  BL, Gundrum  JD.  A comparative, retrospective, observational study of the prevalence, availability, and specificity of advance care plans in a county that implemented an advance care planning microsystem.  J Am Geriatr Soc. 2010;58(7):1249-1255. doi:10.1111/j.1532-5415.2010.02956.xPubMedGoogle ScholarCrossref
36.
Pearlman  RA, Starks  H, Cain  KC, Cole  WG.  Improvements in advance care planning in the Veterans Affairs System: results of a multifaceted intervention.  Arch Intern Med. 2005;165(6):667-674. doi:10.1001/archinte.165.6.667PubMedGoogle ScholarCrossref
37.
Fischer  SM, Cervantes  L, Fink  RM, Kutner  JS.  Apoyo con Cariño: a pilot randomized controlled trial of a patient navigator intervention to improve palliative care outcomes for Latinos with serious illness.  J Pain Symptom Manage. 2015;49(4):657-665. doi:10.1016/j.jpainsymman.2014.08.011PubMedGoogle ScholarCrossref
38.
Maldonado  LY, Goodson  RB, Mulroy  MC, Johnson  EM, Reilly  JM, Homeier  DC.  Wellness in sickness and health (The W.I.S.H. Project): advance care planning preferences and experiences among elderly Latino patients  [published online October 25, 2017].  Clin Gerontol. doi:10.1080/07317115.2017.1389793PubMedGoogle Scholar
×