[Skip to Navigation]
Sign In
Figure 1.  Variation in End-of-Life Events Among Intensive Care Units (ICUs) in the United States
Variation in End-of-Life Events Among Intensive Care Units (ICUs) in the United States

Each circle represents a single ICU, and the y-axis value represents the percentage of decedents in that unit who experienced the event. Units are ranked from 1, representing the lowest end-of-life event frequency, to 68, representing the highest event frequency, along the x-axis. The size of each circle is proportional to the total number of decedents in that unit. The dotted lines indicate the median event rate among all units. CPR indicates cardiopulmonary resuscitation.

Figure 2.  Unit-Level Patterns of End-of-Life (EOL) Care Delivery
Unit-Level Patterns of End-of-Life (EOL) Care Delivery

Cluster analysis revealed 3 mutually exclusive, unit-level patterns of end-of-life care delivery. Of 63 intensive care units (ICUs) in this analysis, 14 (22.2%) belonged to cluster 1, which had the lowest rate of extubation before death and the lowest rate of cardiopulmonary resuscitation (CPR) avoidance but the highest pain-free rate. The 25 units (39.7%) belonging to cluster 2 had the lowest delirium-free rate but high rates of all other EOL events. The 24 units (38.1%) belonging to cluster 3 had consistently high rates across all 5 EOL events. The upper and lower bounds of the boxes represent the 75th and 25th percentiles, respectively. The midbox horizontal line represents the median. The maximum and minimum observations are indicated by the vertical whiskers, and outliers are indicated by circles.

Table 1.  Measures for Structures, Processes, and Outcomes of EOL Care in the ICU
Measures for Structures, Processes, and Outcomes of EOL Care in the ICU
Table 2.  Characteristics of 1536 Decedents and 68 Units
Characteristics of 1536 Decedents and 68 Units
Table 3.  Structures, Processes, and Outcomes of EOL ICU Care
Structures, Processes, and Outcomes of EOL ICU Care
Table 4.  Multivariable aORs of EOL Events for Patient and Hospital Characteristics
Multivariable aORs of EOL Events for Patient and Hospital Characteristics
1.
Angus  DC, Barnato  AE, Linde-Zwirble  WT,  et al; Robert Wood Johnson Foundation ICU End-Of-Life Peer Group.  Use of intensive care at the end of life in the United States: an epidemiologic study.  Crit Care Med. 2004;32(3):638-643. doi:10.1097/01.CCM.0000114816.62331.08PubMedGoogle ScholarCrossref
2.
Mularski  RA, Curtis  JR, Billings  JA,  et al.  Proposed quality measures for palliative care in the critically ill: a consensus from the Robert Wood Johnson Foundation Critical Care Workgroup.  Crit Care Med. 2006;34(11)(suppl):S404-S411. doi:10.1097/01.CCM.0000242910.00801.53PubMedGoogle ScholarCrossref
3.
Truog  RD, Campbell  ML, Curtis  JR,  et al; American Academy of Critical Care Medicine.  Recommendations for end-of-life care in the intensive care unit: a consensus statement by the American College of Critical Care Medicine.  Crit Care Med. 2008;36(3):953-963. doi:10.1097/CCM.0B013E3181659096PubMedGoogle ScholarCrossref
4.
Nelson  JE, Azoulay  É.  Intensive care unit provision at the end of life: miles travelled, miles to go.  Lancet Respir Med. 2019;7(7):560-562. doi:10.1016/S2213-2600(19)30168-7PubMedGoogle ScholarCrossref
5.
Thompson  BT, Cox  PN, Antonelli  M,  et al; American Thoracic Society; European Respiratory Society; European Society of Intensive Care Medicine; Society of Critical Care Medicine; Sociètè de Rèanimation de Langue Française.  Challenges in end-of-life care in the ICU: statement of the 5th International Consensus Conference in Critical Care: Brussels, Belgium, April 2003: executive summary.  Crit Care Med. 2004;32(8):1781-1784.PubMedGoogle ScholarCrossref
6.
Clarke  EB, Curtis  JR, Luce  JM,  et al; Robert Wood Johnson Foundation Critical Care End-Of-Life Peer Workgroup Members.  Quality indicators for end-of-life care in the intensive care unit.  Crit Care Med. 2003;31(9):2255-2262. doi:10.1097/01.CCM.0000084849.96385.85PubMedGoogle ScholarCrossref
7.
Mularski  RA.  Defining and measuring quality palliative and end-of-life care in the intensive care unit.  Crit Care Med. 2006;34(11)(suppl):S309-S316. doi:10.1097/01.CCM.0000241067.84361.46PubMedGoogle ScholarCrossref
8.
Mularski  RA, Hansen  L, Rosenkranz  SJ, Leo  MC, Nagy  P, Asch  SM.  Medical record quality assessments of palliative care for intensive care unit patients: do they match the perspectives of nurses and families?  Ann Am Thorac Soc. 2016;13(5):690-698. doi:10.1513/AnnalsATS.201508-501OCPubMedGoogle ScholarCrossref
9.
Nelson  JE, Mulkerin  CM, Adams  LL, Pronovost  PJ.  Improving comfort and communication in the ICU: a practical new tool for palliative care performance measurement and feedback.  Qual Saf Health Care. 2006;15(4):264-271. doi:10.1136/qshc.2005.017707PubMedGoogle ScholarCrossref
10.
Long  AC, Kross  EK, Engelberg  RA,  et al.  Quality of dying in the ICU: is it worse for patients admitted from the hospital ward compared to those admitted from the emergency department?  Intensive Care Med. 2014;40(11):1688-1697. doi:10.1007/s00134-014-3425-2PubMedGoogle ScholarCrossref
11.
Glavan  BJ, Engelberg  RA, Downey  L, Curtis  JR.  Using the medical record to evaluate the quality of end-of-life care in the intensive care unit.  Crit Care Med. 2008;36(4):1138-1146. doi:10.1097/CCM.0b013e318168f301PubMedGoogle ScholarCrossref
12.
Penrod  JD, Pronovost  PJ, Livote  EE,  et al.  Meeting standards of high-quality intensive care unit palliative care: clinical performance and predictors.  Crit Care Med. 2012;40(4):1105-1112. doi:10.1097/CCM.0b013e3182374a50PubMedGoogle ScholarCrossref
13.
Nelson  JE, Meier  DE, Litke  A, Natale  DA, Siegel  RE, Morrison  RS.  The symptom burden of chronic critical illness.  Crit Care Med. 2004;32(7):1527-1534. doi:10.1097/01.CCM.0000129485.08835.5APubMedGoogle ScholarCrossref
14.
Nelson  JE, Meier  DE, Oei  EJ,  et al.  Self-reported symptom experience of critically ill cancer patients receiving intensive care.  Crit Care Med. 2001;29(2):277-282. doi:10.1097/00003246-200102000-00010PubMedGoogle ScholarCrossref
15.
Kross  EK, Engelberg  RA, Downey  L,  et al.  Differences in end-of-life care in the ICU across patients cared for by medicine, surgery, neurology, and neurosurgery physicians.  Chest. 2014;145(2):313-321. doi:10.1378/chest.13-1351PubMedGoogle ScholarCrossref
16.
Su  A, Lief  L, Berlin  D,  et al.  Beyond pain: nurses’ assessment of patient suffering, dignity, and dying in the intensive care unit.  J Pain Symptom Manage. 2018;55(6):1591-1598.e1.PubMedGoogle ScholarCrossref
17.
Cook  D, Rocker  G.  Dying with dignity in the intensive care unit.  N Engl J Med. 2014;370(26):2506-2514. doi:10.1056/NEJMra1208795PubMedGoogle ScholarCrossref
18.
Quill  CM, Ratcliffe  SJ, Harhay  MO, Halpern  SD.  Variation in decisions to forgo life-sustaining therapies in US ICUs.  Chest. 2014;146(3):573-582. doi:10.1378/chest.13-2529PubMedGoogle ScholarCrossref
19.
Hart  JL, Harhay  MO, Gabler  NB, Ratcliffe  SJ, Quill  CM, Halpern  SD.  Variability among US intensive care units in managing the care of patients admitted with preexisting limits on life-sustaining therapies.  JAMA Intern Med. 2015;175(6):1019-1026. doi:10.1001/jamainternmed.2015.0372PubMedGoogle ScholarCrossref
20.
Sprung  CL, Cohen  SL, Sjokvist  P,  et al; Ethicus Study Group.  End-of-life practices in European intensive care units: the Ethicus Study.  JAMA. 2003;290(6):790-797. doi:10.1001/jama.290.6.790PubMedGoogle ScholarCrossref
21.
Cook  DJ, Guyatt  G, Rocker  G,  et al.  Cardiopulmonary resuscitation directives on admission to intensive-care unit: an international observational study.  Lancet. 2001;358(9297):1941-1945. doi:10.1016/S0140-6736(01)06960-4PubMedGoogle ScholarCrossref
22.
Barnato  AE, Herndon  MB, Anthony  DL,  et al.  Are regional variations in end-of-life care intensity explained by patient preferences?: a study of the US Medicare population.  Med Care. 2007;45(5):386-393. doi:10.1097/01.mlr.0000255248.79308.41PubMedGoogle ScholarCrossref
23.
Dzeng  E, Dohan  D, Curtis  JR, Smith  TJ, Colaianni  A, Ritchie  CS.  Homing in on the social: system-level influences on overly aggressive treatments at the end of life.  J Pain Symptom Manage. 2018;55(2):282-289.e1.PubMedGoogle ScholarCrossref
24.
Hinkle  LJ, Bosslet  GT, Torke  AM.  Factors associated with family satisfaction with end-of-life care in the ICU: a systematic review.  Chest. 2015;147(1):82-93. doi:10.1378/chest.14-1098PubMedGoogle ScholarCrossref
25.
Kross  EK, Engelberg  RA, Gries  CJ, Nielsen  EL, Zatzick  D, Curtis  JR.  ICU care associated with symptoms of depression and posttraumatic stress disorder among family members of patients who die in the ICU.  Chest. 2011;139(4):795-801. doi:10.1378/chest.10-0652PubMedGoogle ScholarCrossref
26.
Pun  BT, Balas  MC, Barnes-Daly  MA,  et al.  Caring for critically ill patients with the ABCDEF bundle: results of the ICU Liberation Collaborative in over 15,000 adults.  Crit Care Med. 2018;47(1):3-14.PubMedGoogle ScholarCrossref
27.
Barnes-Daly  MA, Pun  BT, Harmon  LA,  et al.  Improving health care for critically ill patients using an evidence-based collaborative approach to ABCDEF bundle dissemination and implementation.  Worldviews Evid Based Nurs. 2018;15(3):206-216. doi:10.1111/wvn.12290PubMedGoogle ScholarCrossref
28.
Nelson  JE, Puntillo  KA, Pronovost  PJ,  et al.  In their own words: patients and families define high-quality palliative care in the intensive care unit.  Crit Care Med. 2010;38(3):808-818. doi:10.1097/CCM.0b013e3181c5887cPubMedGoogle ScholarCrossref
29.
Donabedian  A, Axelrod  SJ, Wyszewianski  L.  Medical Care Chartbook. 7th ed. Washington, DC: Association of University Programs in Health Administration Press; 1980.
30.
Donabedian  A.  The Definition of Quality and Approaches to its Assessment. Ann Arbor, MI: Health Administration Press; 1980.
31.
Donabedian  A.  The Criteria and Standards of Quality. Ann Arbor, MI: Health Administration Press; 1982.
32.
Heyland  DK, Dodek  P, You  JJ,  et al; ACCEPT Study Team and the Canadian Researchers at the End of Life Network (CARENET).  Validation of quality indicators for end-of-life communication: results of a multicentre survey.  CMAJ. 2017;189(30):E980-E989. doi:10.1503/cmaj.160515PubMedGoogle ScholarCrossref
33.
Sinuff  T, Dodek  P, You  JJ,  et al.  Improving end-of-life communication and decision making: the development of a conceptual framework and quality indicators.  J Pain Symptom Manage. 2015;49(6):1070-1080. doi:10.1016/j.jpainsymman.2014.12.007PubMedGoogle ScholarCrossref
34.
Leapfrog Hospital Survey. Factsheet: ICU physician staffing. https://www.leapfroggroup.org/sites/default/files/Files/2019%20IPS%20Fact%20Sheet.pdf. Accessed November 6, 2019.
35.
Mularski  RA, Puntillo  K, Varkey  B,  et al.  Pain management within the palliative and end-of-life care experience in the ICU.  Chest. 2009;135(5):1360-1369. doi:10.1378/chest.08-2328PubMedGoogle ScholarCrossref
36.
Steinhauser  KE, Christakis  NA, Clipp  EC, McNeilly  M, McIntyre  L, Tulsky  JA.  Factors considered important at the end of life by patients, family, physicians, and other care providers.  JAMA. 2000;284(19):2476-2482. doi:10.1001/jama.284.19.2476PubMedGoogle ScholarCrossref
37.
Yao  Y, Keenan  G, Al-Masalha  F,  et al.  Current state of pain care for hospitalized patients at end of life.  Am J Hosp Palliat Care. 2013;30(2):128-136. doi:10.1177/1049909112444458PubMedGoogle ScholarCrossref
38.
Kobewka  D, Ronksley  P, McIsaac  D, Mulpuru  S, Forster  A.  Prevalence of symptoms at the end of life in an acute care hospital: a retrospective cohort study.  CMAJ Open. 2017;5(1):E222-E228. doi:10.9778/cmajo.20160123PubMedGoogle ScholarCrossref
39.
Devlin  JW, Skrobik  Y, Gélinas  C,  et al.  Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU.  Crit Care Med. 2018;46(9):e825-e873. doi:10.1097/CCM.0000000000003299PubMedGoogle ScholarCrossref
40.
Hosie  A, Davidson  PM, Agar  M, Sanderson  CR, Phillips  J.  Delirium prevalence, incidence, and implications for screening in specialist palliative care inpatient settings: a systematic review.  Palliat Med. 2013;27(6):486-498. doi:10.1177/0269216312457214PubMedGoogle ScholarCrossref
41.
Bush  SH, Leonard  MM, Agar  M,  et al.  End-of-life delirium: issues regarding recognition, optimal management, and the role of sedation in the dying phase.  J Pain Symptom Manage. 2014;48(2):215-230. doi:10.1016/j.jpainsymman.2014.05.009PubMedGoogle ScholarCrossref
42.
Turnbull  AE, Bosslet  GT, Kross  EK.  Aligning use of intensive care with patient values in the USA: past, present, and future.  Lancet Respir Med. 2019;7(7):626-638. doi:10.1016/S2213-2600(19)30087-6PubMedGoogle ScholarCrossref
43.
Yadav  KN, Gabler  NB, Cooney  E,  et al.  Approximately one in three US adults completes any type of advance directive for end-of-life care.  Health Aff (Millwood). 2017;36(7):1244-1251. doi:10.1377/hlthaff.2017.0175PubMedGoogle ScholarCrossref
44.
Silveira  MJ, Kim  SYH, Langa  KM.  Advance directives and outcomes of surrogate decision making before death.  N Engl J Med. 2010;362(13):1211-1218. doi:10.1056/NEJMsa0907901PubMedGoogle ScholarCrossref
45.
Choi  PJ, Curlin  FA, Cox  CE.  Addressing religion and spirituality in the intensive care unit: a survey of clinicians.  Palliat Support Care. 2018:1-6.PubMedGoogle Scholar
46.
Wendlandt  B, Ceppe  A, Choudhury  S,  et al.  Modifiable elements of ICU supportive care and communication are associated with surrogates’ PTSD symptoms.  Intensive Care Med. 2019;45(5):619-626. doi:10.1007/s00134-019-05550-zPubMedGoogle ScholarCrossref
47.
Liu  V, Read  JL, Scruth  E, Cheng  E.  Visitation policies and practices in US ICUs.  Crit Care. 2013;17(2):R71. doi:10.1186/cc12677PubMedGoogle ScholarCrossref
48.
Davidson  JE, Aslakson  RA, Long  AC,  et al.  Guidelines for family-centered care in the neonatal, pediatric, and adult ICU.  Crit Care Med. 2017;45(1):103-128. doi:10.1097/CCM.0000000000002169PubMedGoogle ScholarCrossref
49.
Davidson  JE, Powers  K, Hedayat  KM,  et al; American College of Critical Care Medicine Task Force 2004-2005, Society of Critical Care Medicine.  Clinical practice guidelines for support of the family in the patient-centered intensive care unit: American College of Critical Care Medicine Task Force 2004-2005.  Crit Care Med. 2007;35(2):605-622. doi:10.1097/01.CCM.0000254067.14607.EBPubMedGoogle ScholarCrossref
50.
Lief  L, Berlin  DA, Maciejewski  RC,  et al.  Dying patient and family contributions to nurse distress in the ICU.  Ann Am Thorac Soc. 2018;15(12):1459-1464. doi:10.1513/AnnalsATS.201804-284OCPubMedGoogle ScholarCrossref
51.
Poncet  MC, Toullic  P, Papazian  L,  et al.  Burnout syndrome in critical care nursing staff.  Am J Respir Crit Care Med. 2007;175(7):698-704. doi:10.1164/rccm.200606-806OCPubMedGoogle ScholarCrossref
52.
Dzeng  E, Curtis  JR.  Understanding ethical climate, moral distress, and burnout: a novel tool and a conceptual framework.  BMJ Qual Saf. 2018;27(10):766-770. doi:10.1136/bmjqs-2018-007905PubMedGoogle ScholarCrossref
53.
Harrison  KL, Dzeng  E, Ritchie  CS,  et al.  Addressing palliative care clinician burnout in organizations: a workforce necessity, an ethical imperative.  J Pain Symptom Manage. 2017;53(6):1091-1096. doi:10.1016/j.jpainsymman.2017.01.007PubMedGoogle ScholarCrossref
Original Investigation
Critical Care Medicine
December 11, 2019

Assessment of Variability in End-of-Life Care Delivery in Intensive Care Units in the United States

Author Affiliations
  • 1Division of Pulmonary and Critical Care, Department of Medicine, Northwestern University, Chicago, Illinois
  • 2Department of Medical Social Sciences, Northwestern University, Chicago, Illinois
  • 3Division of Biostatistics, Department of Preventive Medicine, Northwestern University, Chicago, Illinois
  • 4Department of Health Policy, Vanderbilt University, Nashville, Tennessee
  • 5Geriatric Research, Education and Clinical Center Service, Department of Veterans Affairs Medical Center, Tennessee Valley Healthcare System, Nashville, Tennessee
  • 6Critical Illness, Brain Dysfunction, and Survivorship Center, Vanderbilt University Medical Center, Nashville, Tennessee
  • 7College of Nursing, The Ohio State University, Columbus
  • 8Sutter Health, Sacramento, California
  • 9Society of Critical Care Medicine, Mount Prospect, Illinois
  • 10Division of Pulmonary and Critical Care, Department of Medicine, Vanderbilt University, Nashville, Tennessee
JAMA Netw Open. 2019;2(12):e1917344. doi:10.1001/jamanetworkopen.2019.17344
Key Points

Question  Do intensive care units in the United States provide high-quality end-of-life care?

Findings  In this cohort study of 1536 decedents within a national quality improvement collaborative, end-of-life care delivery varied widely between intensive care units. There were 3 mutually exclusive unit-level patterns of end-of-life care delivery observed, which suggest meaningful differences in the experience of dying for patients cared for in higher-performing and lower-performing units.

Meaning  To improve care for all patients who die in an intensive care unit, future research should target unit-level variation and investigate the latent characteristics of high-performing units that promote high-quality end-of-life care.

Abstract

Importance  Overall, 1 of 5 decedents in the United States is admitted to an intensive care unit (ICU) before death.

Objective  To describe structures, processes, and variability of end-of-life care delivered in ICUs in the United States.

Design, Setting, and Participants  This nationwide cohort study used data on 16 945 adults who were cared for in ICUs that participated in the 68-unit ICU Liberation Collaborative quality improvement project from January 2015 through April 2017. Data were analyzed between August 2018 and June 2019.

Main Outcomes and Measures  Published quality measures and end-of-life events, organized by key domains of end-of-life care in the ICU.

Results  Of 16 945 eligible patients in the collaborative, 1536 (9.1%) died during their initial ICU stay. Of decedents, 654 (42.6%) were women, 1037 (67.5%) were 60 years or older, and 1088 (70.8%) were identified as white individuals. Wide unit-level variation in end-of-life care delivery was found. For example, the median unit-stratified rate of cardiopulmonary resuscitation avoidance in the last hour of life was 89.5% (interquartile range, 83.3%-96.1%; range, 50.0%-100%). Median rates of patients who were pain free and delirium free in last 24 hours of life were 75.1% (interquartile range, 66.0%-85.7%; range, 0-100%) and 60.0% (interquartile range, 43.7%-85.2%; range, 9.1%-100%), respectively. Ascertainment of an advance directive was associated with lower odds of cardiopulmonary resuscitation in the last hour of life (odds ratio, 0.70; 95% CI, 0.49-0.99; P = .04), and a documented offer or delivery of spiritual support was associated with higher odds of family presence at the time of death (odds ratio, 1.95; 95% CI, 1.37-2.77; P < .001). Death in a unit with an open visitation policy was associated with higher odds of pain in the last 24 hours of life (odds ratio, 2.21; 95% CI, 1.15-4.27; P = .02). Unsupervised cluster analysis revealed 3 mutually exclusive unit-level patterns of end-of-life care delivery among 63 ICUs with complete data. Cluster 1 units (14 units [22.2%]) had the lowest rate of cardiopulmonary resuscitation avoidance but achieved the highest pain-free rate. Cluster 2 (25 units [39.7%]) had the lowest delirium-free rate but achieved high rates of all other end-of-life events. Cluster 3 (24 units [38.1%]) achieved high rates across all favorable end-of-life events.

Conclusions and Relevance  In this study, end-of-life care delivery varied substantially among ICUs in the United States, and the patterns of care observed suggest that units can be characterized as higher and lower performing. To achieve optimal care for patients who die in an ICU, future research should target unit-level variation and disseminate the successes of higher-performing units.

Introduction

Approximately 20% of people who die in the United States are admitted to an intensive care unit (ICU) at or near the time of death.1 The provision of high-quality end-of-life (EOL) care is an integral professional responsibility of ICU clinicians.2-7 Regional and single-center studies have uncovered gaps in the quality of EOL ICU care in domains such as symptom control, patient-centered decision-making, and the provision of adequate spiritual support.8-17 However, it is unknown whether these findings represent the current delivery of EOL ICU care across the United States.

Prior work18-21 demonstrated variation among units in the delivery of life-sustaining treatments and cardiopulmonary resuscitation (CPR) at the EOL. Observed unit-level variation in EOL care is not fully explained by differences in patient preferences or characteristics,18,22 suggesting unit-level characteristics and practice patterns may have an important association with EOL care delivery.23 Beyond the delivery of CPR and life-sustaining treatments, families of decedents and clinicians in the ICU recognize additional, meaningful events that take place during death and dying in an ICU, such as the presence of family at the bedside and the avoidance of burdensome symptoms near death.10,11,24,25 Whether these fundamental features of EOL care also vary among units within the United States is unknown.

To achieve the best possible EOL ICU care, we need a better understanding of the existing structures, processes, and patterns of care that underlie EOL ICU care delivery and that influence patients’ and families’ experiences with death and dying. Therefore, the primary objective of this nationwide multicenter cohort study was to identify unit-level opportunities to improve EOL care delivery in ICUs across the United States.

Methods
Setting

The ICU Liberation Collaborative (ILC) was a quality improvement learning collaborative of 68 ICUs within 67 hospitals (with 1 hospital with 2 participating units) across the United States and Puerto Rico. The collaborative took place from January 2015 to April 2017; it was coordinated and sponsored by the Society of Critical Care Medicine and the Gordon and Betty Moore Foundation. The primary objective of the ILC was to disseminate an interprofessional approach to ICU symptom management known as the ABCDEF bundle. All participating units received the same concurrent exposure to in-person meetings, monthly video conferences, an online interactive forum, and coaching from expert faculty. A complete description of the ILC has been previously published.26,27

Participants and Data Collection

Patient-level data were collected from the first 15 consecutive patients admitted per month in each unit during the collaborative. Patient-level data were also provided for 30 patients admitted to the unit in the 6 months before the collaborative. Collaborative data collection procedures excluded patients who died, were discharged, underwent active withdrawal of life-sustaining treatment, or were designated as comfort-care only within the first 24 hours of ICU admission. Local team members were responsible for collecting and entering deidentified patient-level data into the ILC database. The Research Electronic Data Capture (REDCap) platform was used for local data entry, transmission to the coordinating site, and data storage. Local team members were trained to collect data during a 1-hour video conference and followed a standard operating procedure and data definitions manual. Unit-level data were collected at the beginning of the collaborative from each unit’s clinical manager or medical director through a standardized instrument within REDCap. All adults who died during their initial ICU stay in the periods before and during the collaborative were included in this analysis. Patients with missing discharge status (eg, alive, deceased) were excluded. The Vanderbilt University Medical Center institutional review board served as the coordinating center institutional review board and granted the ILC expedited quality improvement project approval. All participating units acquired site-specific institutional review board evaluation and approval, when required. The data and variables collected for this study were included in the original ILC data collection procedures and elements presented to the institutional review boards, so no additional approval or consent was sought for this analysis. This report adheres to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cohort studies.

Structures, Processes, and Outcomes

Multiple consensus statements have established ICU-specific EOL quality measures based on bioethical principles, expert opinion, and limited observational data.2,7,9,28 Study measures were derived from these published quality measures and were organized according to the Donabedian structure, process, outcome model and the 6 key domains of EOL ICU care (Table 1).2,8,29-33

The 5 structural measures in this study evaluated the presence of the following unit-level policies or protocols: (1) EOL-specific protocols for general symptom management; (2) EOL-specific protocols for symptom management during withdrawal of mechanical ventilation; (3) an open visitation policy, defined as a policy that permits family members and friends to spend time in the patient’s room regardless of the time of day; (4) a policy for the continuity of nursing services for patients with multiple-day stays in the ICU; and (5) a policy that supports a regular, structured opportunity for clinicians to reflect about the experience of caring for dying patients.2,7,8,11,32,33 The 4 patient-level process measures were as follows: (1) at least 1 pain assessment documented in the electronic health record (EHR) in last 24 hours of life; (2) at least 1 delirium assessment documented in the EHR in the last 24 hours of life; (3) EHR documentation of the presence or absence of an advance directive (AD), health care power of attorney document, or living will at any time during the terminal hospitalization; and (4) EHR documentation that spiritual support was offered or delivered at any time during the ICU stay.2,7,8,11,32,33

We measured the outcomes of EOL ICU care through specific, meaningful EOL events that are associated with higher quality of death and dying in the ICU, as determined by decedents’ families and ICU clinicians.10,11,24,25 Patient-level EOL events were as follows: (1) extubation or discontinuation of invasive mechanical ventilation before time of death among patients receiving mechanical ventilation; (2) absence of CPR in the last hour of life; (3) being delirium free in the last 24 hours of life; (4) being pain free in last 24 hours of life; and (5) presence of family members or other significant persons at the time of death. Being delirium free was defined as having no episodes of delirium in the last 24 hours of life among patients with at least 1 delirium assessment; an episode of delirium was defined as a positive score on the Confusion Assessment Method for the ICU or a score greater than 4 on the Intensive Care Delirium Screening Checklist. Patients who were unconscious, as determined by a Richmond Agitation Sedation Scale score of −4 or −5, were not candidates for delirium assessment and, thus, were excluded from this measure. Being pain free was defined as having no significant pain episodes in last 24 hours of life among patients with at least 1 pain assessment; significant pain was defined by a numerical rating score greater than 3, a Critical Care Pain Observation Tool score greater than 2, or a Behavioral Pain Score greater than 3. Only communicative patients were eligible for numerical rating score assessment. Patients who were unconscious or otherwise unable to self-report were assessed using either the Critical Care Pain Observation Tool or Behavioral Pain Score, both validated scales based on behavioral manifestations of pain. Patients with missing data (ie, had no pain and/or no delirium assessments in the last 24 hours of life) were excluded from these measures. Data collection definitions from the standard operating procedure manual appear in eAppendix 1 in the Supplement.

Statistical Analysis

We first summarized unit and patient characteristics, cohortwide adherence to structure and process measures, and overall EOL event rates. To evaluate unit-level variation, EOL event rates were stratified by unit and presented as medians, interquartile ranges (IQRs), and ranges. As a sensitivity analysis, we reevaluated unit-level variation and EOL event rates after excluding decedents who had been admitted in the precollaborative period. We conducted a second sensitivity analysis, designating all patients with missing data for EOL pain or delirium assessments as pain free or delirium free, respectively. Results of sensitivity analyses were consistent with our original analyses and are presented in eAppendix 2 in the Supplement.

We used generalized linear mixed models to explore the associations between the following variables and outcomes: (1) patient and unit characteristics with EOL events, (2) patient characteristics with patient-level process measures, and (3) process and structural measures with EOL events. Each EOL event was modeled as binomial with a logit link function and included a random effect for unit to account for association between patients within a unit. We used logistic regression to model associations between unit-level characteristics and unit-level structural measures.

To uncover unit-level patterns in EOL care without applying prespecified hypotheses about the distinct patterns of care delivery (ie, without defining a pattern of high-quality or low-quality performance), we conducted unsupervised clustering analysis using a k-means clustering algorithm with Euclidean distance. This technique identifies subgroups (ie, clusters of ICUs) by maximizing similarities within and differences between clusters according to selected features. Each unit’s rates for the 5 EOL events were input as features into the clustering algorithm; the optimal number of clusters was determined using the average silhouette method. We used Pearson χ2 test to determine whether the distribution of unit characteristics differed between clusters. A 2-tailed P < .05 defined statistical significance; analyses were conducted using R statistical software version 3.3.1 (R Project for Statistical Computing). Data were analyzed between August 2018 and June 2019.

Results

The ILC included data collection for 16 945 adult patients with recorded age and discharge status; 1536 (9.1%) died during their initial ICU stay (Table 2).34 Of the 1536 decedents, 654 (42.6%) were women; 1037 (67.5%) were 60 years or older; and 1088 (70.8%) were identified as white individuals, 178 (11.6%) as black individuals, 65 (4.2%) as Asian individuals, and 197 (12.8%) as other, which included Hawaiian, American Indian, and patients identified as other race. The ILC comprised 68 units; 11 (16.2%) medical, 8 (11.8%) surgical, 43 (63.2%) mixed or other specialty units, and 6 (8.8%) with missing data for ICU type. Of the participating units, 42 (61.8%) were in teaching hospitals; 23 (33.8%) were located in the eastern United States, 22 (32.4%) in the Midwest, and 23 (33.8%) in the western United States. The median number of decedents per ICU was 20 (IQR, 11-31; range, 1-93). The distribution of decedents by ICU type was 332 decedents (21.6%) in medical units, 91 (5.9%) in surgical units, and 909 (59.2%) in mixed specialty and other units; 204 decedents (13.3%) had missing ICU type data.

Structures, Processes, and Outcomes of EOL Care

Table 3 displays adherence rates for structural and process measures and EOL event rates within the entire study sample. A total of 47 of 60 units (78.3%) had an open visitation policy for visitors, but only 18 of 60 (30.0%) had a structured opportunity for staff to reflect about the experience caring for patients who are dying. Of 1520 decedents, 1380 (90.8%) had at least 1 pain assessment in the last 24 hours of life, but only 913 of 1522 decedents (60.0%) had at least 1 delirium assessment during the same period. Patients experienced a median (IQR) of 3 (1-6) significant pain episodes in the last 24 hours of life. A total of 616 of 1527 patients (40.3%) had ascertainment of an AD during their hospitalization. Logistic regression models testing the associations of unit and patient characteristics with structural and process measures appear in eTable 1 and eTable 2 in the Supplement.

Figure 1 demonstrates the wide unit-level variability in EOL event rates. Stratified by unit, the median event rates were as follows: extubation prior to death, 64.7% (IQR, 51.5%-77.3%; range, 0-100%); absence of CPR in last hour of life, 89.5% (IQR, 83.3%-96.1%; range, 50.0%-100%); delirium free in last 24 hours of life, 60.0% (IQR, 43.7%-85.2%; range, 9.1%-100%); pain free in last 24 hours of life, 75.1% (IQR, 66.0%-85.7%; range, 0-100%); and family present at time of death, 88.2% (IQR, 83.3%-94.7%; range 0-100%). Table 4 displays the multivariable adjusted models evaluating associations of patient and unit characteristics with each EOL event. Compared with white individuals, black individuals were associated with lower odds of absence of CPR in last hour of life (adjusted odds ratio [aOR], 0.33; 95% CI, 0.20-0.56; P < .001) and lower odds of extubation before death (aOR, 0.59; 95% CI, 0.39-0.90; P = .02). Black individuals were also associated with increased odds of being pain free before death (aOR, 1.92; 95% CI, 1.08-3.45; P = .03). Compared with ICUs in the eastern United States, those in the Midwest were associated with higher odds of absence of CPR in the last hour of life (aOR, 2.04; 95% CI, 1.06-3.85; P = .03) and of extubation before death (aOR, 2.23; 95% CI, 1.39-3.58; P < .001). Surgical ICUs were associated with higher odds of extubation before death (aOR, 2.47; 95% CI, 1.04-5.69; P = .03) and lower odds of being pain free (aOR, 0.19; 95% CI, 0.04-0.79; P = .02) compared with medical ICUs.

Patterns of EOL Care Delivery

Unsupervised cluster analysis revealed 3 mutually exclusive unit-level patterns of EOL care delivery (Figure 2; eFigure 1 and eFigure 2 in the Supplement). We excluded 5 units from the analysis because of missing data for the delirium EOL event. The 14 units (22.2%) belonging to cluster 1 had the lowest rate of extubation before death and the lowest rate of CPR avoidance but achieved the highest pain-free rate. The 25 units (39.7%) belonging to cluster 2 had the lowest delirium-free rate but achieved high rates of all other EOL events. The 24 units (38.1%) belonging to cluster 3 achieved consistently high rates across all 5 EOL events. Unit characteristics stratified by cluster and pairwise comparisons of event rates between clusters appear in eTable 3 and eTable 4 in the Supplement. Among all measured unit characteristics, the only significant association with cluster membership was advance practice provider coverage in the unit (cluster 1, 66.7% of units with advance practice providers; cluster 2, 30.4%; cluster 3, 73.9%; P = .008).

Association Between Structural, Process, and Outcomes Measures

At the patient level, documented ascertainment of an AD was associated with lower odds of receiving CPR in the last hour of life (OR, 0.70; 95% CI, 0.49-0.99; P = .04), and a documented offer or delivery of spiritual support was associated with higher odds of having family present at the time of death (OR, 1.95; 95% CI, 1.37-2.77; P < .001). Patients who died in a unit with an open visitation policy were more likely to experience pain in the last 24 hours of life (OR, 2.21; 95% CI, 1.15-4.27; P = .02). The full results of univariate mixed-effects logistic regression models testing associations between structure and process measures and EOL events appear in eTable 5 and eTable 6 in the Supplement. Having unit protocols for EOL symptom management was not associated with the presence of delirium or pain in the last 24 hours of life (eTable 6 in the Supplement).

Discussion

In this cohort of 1536 decedents from a diverse sample of 68 ICUs across the United States, we found wide unit-level variation in the delivery of EOL care for patients who died in an ICU. We demonstrated that unit-level variation in EOL care extended beyond the delivery of CPR and mechanical ventilation near death and substantially affected symptom control at the EOL, including delirium. We also uncovered 3 unit-level patterns of care delivery that suggested meaningful differences in the experience of death and dying for patients in higher-performing and lower-performing units. To achieve optimal care for all patients who die in an ICU, future research should target unit-level variation and investigate and disseminate the successes of high-performing units.

Outcomes of EOL ICU Care

Minimizing pain and other burdensome symptoms, such as delirium, near death is a near-universal goal for patients and their loved ones.35,36 However, important trade-offs in symptom control may be necessary and depend on patient values, goals, and preferences; thus, the optimal rate of pain or delirium at EOL is unknown, and our study did not address whether EOL events were aligned with patient-identified or family-identified EOL priorities. Overall, approximately 1 in 4 patients in this study experienced at least 1 significant pain episode in the last day of life, which is similar to the rate of EOL pain in recent studies of hospitalized decedents not limited to the ICU setting.37,38 However, the stark differences between units, which ranged from no patients to almost all patients with at least 1 episode of EOL pain or delirium, suggest unwarranted inconsistency in the delivery of care. In a multivariable model, we found that dying in a surgical ICU was the only patient or unit characteristic significantly associated with the presence of EOL pain. More than 70% of units in this study had protocols for EOL symptom management. However, we found no association between the presence of EOL symptom protocols and EOL symptoms for individual patients. A more granular understanding of the contents of EOL symptom management protocols, how the protocols are implemented at the bedside, and whether these protocols lead to optimal EOL symptom management is a critical next step to improve EOL ICU care.

This study provided a national estimate of the prevalence of EOL ICU delirium, a previously underappreciated symptom for patients who die in an ICU. While the impact of delirium in the general ICU population is well established,39 little is known about the distinctive features of EOL ICU delirium, including assessment challenges, management considerations, and the consequences for patients, families, and clinicians. We speculate that EOL ICU delirium is uniquely important for patients and families, given the strong desire for patients and families to have meaningful interactions with family and friends near the EOL.36 Among decedents in this study who were assessed for delirium, more than 40% experienced delirium in the last day of life, similar to rates described in inpatient hospice and palliative care units.40,41 In the multivariable model, we found no significant associations of patient or unit characteristics with the presence of EOL delirium. Given the favorable staffing ratios and highest available level of care in an ICU, we believe ICUs can be expected to perform even better than other care venues in managing EOL delirium. However, notable challenges to this aspiration exist, given the risk factors for EOL delirium related to critical illness and the ICU environment. Another 40% of decedents in ICUs were never assessed for delirium in the last day of life, despite the favorable staffing ratios in ICUs and the prevalence and burdens of this syndrome. This finding may be partially explained by the number of patients who were unconscious near EOL (ie, Richmond Agitation-Sedation Scale score, −4 or −5) and, thus, not candidates for delirium assessment by the 2 scales used in the ILC. Moreover, this study was conducted within a quality improvement collaborative designed to improve the assessment and management of delirium, and thus, our findings may overestimate delirium assessment and underestimate the prevalence of uncontrolled EOL ICU delirium in the United States.

Our cluster analysis identified 3 previously unrecognized unit-level patterns in the delivery of EOL care. These patterns suggest meaningful differences in the EOL experience for patients and their families in higher-performing and lower-performing units. These patterns were not associated with commonly recognized unit characteristics, such as admitting structure, ICU type, geographic location, or teaching status. This finding suggests latent features of a unit, such as local culture and ethical climate, may have an important influence on EOL care delivery. Approximately 1 in 3 units in this study achieved high performance across all measured domains of EOL care. Units belonging to this cluster should be further studied using qualitative methods to understand the specific mechanisms that promote this high-quality EOL care.

A second cluster achieved similarly high performance, with the exception of higher rates of EOL ICU delirium. This finding further supports our conclusion that EOL ICU delirium warrants further attention to understand whether the stark difference between clusters 2 and 3 can be explained by detection, reporting, or management. Finally, the smallest cluster, representing 22% of units, was characterized by high rates of invasive therapies until the time of death. Units in this cluster had a low rate of extubation before death compared with other units, and the rate of CPR in the last hour of life was double the rate in other clusters. This cluster simultaneously had the highest rate of pain-free patients. This hypothesis-generating finding may reflect sedation and analgesia practices for patients who are intubated vs extubated and deserves close attention through future studies that explicitly acknowledge and evaluate the necessary trade-offs in EOL care to ultimately improve the complex process of delivering goal-concordant EOL ICU care.42

Processes of EOL ICU Care

This study identified several additional gaps in the processes of EOL care delivery. The presence or absence of an AD was documented for only 40% of decedents in an ICU during hospitalization. This finding likely reflects, in part, poor overall uptake of ADs given that only one-third of adults in the United States have completed AD documentation.43 However, ADs remain the most widely adopted tool in advance care planning and have the potential to support the alignment of EOL care with patient preferences.44 Moreover, this process measure evaluated whether any clinician documented whether a patient had an AD (including the status of no AD), suggesting that our findings also reflect poor attention to ADs among clinicians. Individuals who die in an ICU are the precise population to whom ADs apply, and so the low rate of AD documentation in this study suggests a continued need to increase advance care planning efforts before a critical illness and to improve ascertainment of ADs during a critical illness. We also found that 40% of decedents in the ICU failed to receive any offer of spiritual support during their ICU stay. Clinicians in the ICU generally believe it is their responsibility to address religious and spiritual needs of patients,45 and insufficient spiritual support is associated with increased symptoms of posttraumatic stress disorder for surrogates of patients in the ICU.46 Thus, efforts are needed to increase the provision of spiritual support for patients who die in the ICU and their families.

Structures of EOL ICU Care

The vast majority of units in this study allowed open visitation, which conflicts with a study published in 2013 that found restricted visitation hours in 80.4% of surveyed ICUs in the United States.47 This discrepancy may be associated with increased attention during the last decade on fostering patient-centered and family-centered ICU environments, or it may reflect a latent characteristic of the units that chose to participate in the ILC.48,49 In exploratory analyses, we also found an unanticipated association; patients who died in units with open visitation policies were more likely to experience pain at the EOL. Patients with visitors may make deliberate trade-offs between meaningful interaction and pain control with sedating medications. Alternatively, visitors at the bedside may be more likely to call attention to patients’ pain symptoms. This hypothesis-generating finding and potentially unintended consequence of open visitation warrants further study. Less than one-third of units in this study provided structured opportunities for clinicians to reflect on caring for dying patients. Given increased awareness about the impact of providing EOL care on professional burnout in the ICU,50,51 structured, unit-level support for clinicians who care for dying patients may provide a feasible strategy to mitigate this growing problem.52,53

Limitations

This study has limitations. This large cohort of decedents in the ICU were cared for in a diverse sample of units from across the United States. However, the culture and other latent characteristics of units that electively chose to participate in the ILC may differ from nonparticipating units in an unpredictable manner, which may limit the generalizability of our findings. The ILC was focused on pain and delirium; thus, our findings may overestimate the performance of pain and delirium assessment and management at the EOL across the United States. Patient-level data collection within the ILC was also limited to the first 15 consecutive patients admitted per month and excluded patients who died or underwent withdrawal of life-sustaining treatments within the first 24 hours of ICU admission, which may have led to a biased or nonrepresentative sample of decedents. We were unable to conduct case-mix adjustment by severity of illness because of a lack of uniform severity of illness reporting. Participating units were responsible for data collection and received formal data collection training and a detailed standard operating procedures manual with data definitions. However, it is possible that variation and errors may have occurred, introducing potential reporting bias. Our findings only represent quality measures and events that could be feasibly collected through the ILC. The proposed EOL quality measures evaluated in this study are supported by bioethical principles and limited observational data,2,7,8 but whether these measures truly represent the most important features of EOL care remains unknown. For example, process measures that rely on clinician documentation do not fully represent care delivered. Most importantly, these measures do not reflect whether observed EOL events are aligned with individual patients’ values, goals, or preferences. Furthermore, we selected a flat clustering method to explore patterns of EOL care delivery, which produced a single partitioning of the data. This enhanced the interpretability of our findings, but alternate clustering methods may have yielded slightly different results.

Conclusions

This study suggests most decedents in the ICU avoid CPR at EOL, have family present at their bedside, and are closely assessed for pain. However, the delivery of EOL care varies widely among units in the United States, including the rate of pain and delirium near death. Unit-level patterns of care delivery suggest meaningful differences in the EOL experiences of patients who die in higher-performing and lower-performing units. To achieve the best possible care for patients who die in an ICU, future research should target unit-level variation and investigate and disseminate the successes of high-performing units.

Back to top
Article Information

Accepted for Publication: October 22, 2019

Published: December 11, 2019. doi:10.1001/jamanetworkopen.2019.17344

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Kruser JM et al. JAMA Network Open.

Corresponding Author: Jacqueline M. Kruser, MD, MS, Division of Pulmonary and Critical Care, Department of Medicine, Northwestern University, 633 N St Clair, 20th Floor, McGaw M-335, Chicago, IL 60611 (jacqueline.kruser@northwestern.edu).

Author Contributions: Dr Kruser had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Kruser, Stevenson, Pun, Balas, Ely.

Acquisition, analysis, or interpretation of data: Kruser, Aaby, Pun, Balas, Barnes-Daly, Harmon, Ely.

Drafting of the manuscript: Kruser, Aaby, Pun, Harmon, Ely.

Critical revision of the manuscript for important intellectual content: Aaby, Stevenson, Pun, Balas, Barnes-Daly, Ely.

Statistical analysis: Aaby.

Obtained funding: Kruser, Harmon, Ely.

Administrative, technical, or material support: Kruser, Stevenson, Pun, Harmon, Ely.

Supervision: Kruser, Balas, Ely.

Conflict of Interest Disclosures: Dr Pun reported receiving personal fees for serving as a subject matter expert for the Society of Critical Care Medicine during the conduct of the study; receiving personal fees for teaching from the American Association of Critical-Care Nurses outside the submitted work; and receiving honoraria from the Michigan Hospital Association outside the submitted work. Dr Balas reported receiving honoraria from the Society of Critical Care Medicine during the conduct of the study; receiving grants from National Institutes of Health and the American Association of Critical-Care Nurses outside the submitted work; and receiving honoraria from the Michigan Hospital Association and Select Medical outside the submitted work. Dr Barnes-Daly reported being on a speakers bureau for Cheetah Medical. Dr Ely reported receiving personal fees from the Gordon and Betty Moore Foundation during the conduct of the study; receiving personal fees for serving as an independent lecturer for Pfizer and Orion Corporation outside the submitted work; and having an ongoing research relationship with Masimo outside the submitted work. No other disclosures were reported.

Funding/Support: Use of the ICU Liberation Collaborative was supported by the Gordon and Betty Moore Foundation and the Society of Critical Care Medicine. Support for Research Electronic Data Capture data collection was provided by grant UL1TR000445 from the National Center for Advancing Translational Science. Dr Kruser was supported by grants F32HL140825 and K23HL146890 from the National Heart, Lung, and Blood Institute. Dr Stevenson was supported in part by the Veterans Affairs Tennessee Valley Healthcare System.

Role of the Funder/Sponsor: The Society of Critical Care Medicine participated in the design and conduct of the study; the collection and management of the data; review and approval of the manuscript; and the decision to submit the manuscript for publication. It did not participate in data analysis, interpretation of the data, or preparation of the manuscript. The remaining sources of funding listed above had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Additional Contributions: Joanna L. Hart, MD (Perelman School of Medicine, University of Pennsylvania), provided comments on a previous version of this article. She was not compensated for her time.

References
1.
Angus  DC, Barnato  AE, Linde-Zwirble  WT,  et al; Robert Wood Johnson Foundation ICU End-Of-Life Peer Group.  Use of intensive care at the end of life in the United States: an epidemiologic study.  Crit Care Med. 2004;32(3):638-643. doi:10.1097/01.CCM.0000114816.62331.08PubMedGoogle ScholarCrossref
2.
Mularski  RA, Curtis  JR, Billings  JA,  et al.  Proposed quality measures for palliative care in the critically ill: a consensus from the Robert Wood Johnson Foundation Critical Care Workgroup.  Crit Care Med. 2006;34(11)(suppl):S404-S411. doi:10.1097/01.CCM.0000242910.00801.53PubMedGoogle ScholarCrossref
3.
Truog  RD, Campbell  ML, Curtis  JR,  et al; American Academy of Critical Care Medicine.  Recommendations for end-of-life care in the intensive care unit: a consensus statement by the American College of Critical Care Medicine.  Crit Care Med. 2008;36(3):953-963. doi:10.1097/CCM.0B013E3181659096PubMedGoogle ScholarCrossref
4.
Nelson  JE, Azoulay  É.  Intensive care unit provision at the end of life: miles travelled, miles to go.  Lancet Respir Med. 2019;7(7):560-562. doi:10.1016/S2213-2600(19)30168-7PubMedGoogle ScholarCrossref
5.
Thompson  BT, Cox  PN, Antonelli  M,  et al; American Thoracic Society; European Respiratory Society; European Society of Intensive Care Medicine; Society of Critical Care Medicine; Sociètè de Rèanimation de Langue Française.  Challenges in end-of-life care in the ICU: statement of the 5th International Consensus Conference in Critical Care: Brussels, Belgium, April 2003: executive summary.  Crit Care Med. 2004;32(8):1781-1784.PubMedGoogle ScholarCrossref
6.
Clarke  EB, Curtis  JR, Luce  JM,  et al; Robert Wood Johnson Foundation Critical Care End-Of-Life Peer Workgroup Members.  Quality indicators for end-of-life care in the intensive care unit.  Crit Care Med. 2003;31(9):2255-2262. doi:10.1097/01.CCM.0000084849.96385.85PubMedGoogle ScholarCrossref
7.
Mularski  RA.  Defining and measuring quality palliative and end-of-life care in the intensive care unit.  Crit Care Med. 2006;34(11)(suppl):S309-S316. doi:10.1097/01.CCM.0000241067.84361.46PubMedGoogle ScholarCrossref
8.
Mularski  RA, Hansen  L, Rosenkranz  SJ, Leo  MC, Nagy  P, Asch  SM.  Medical record quality assessments of palliative care for intensive care unit patients: do they match the perspectives of nurses and families?  Ann Am Thorac Soc. 2016;13(5):690-698. doi:10.1513/AnnalsATS.201508-501OCPubMedGoogle ScholarCrossref
9.
Nelson  JE, Mulkerin  CM, Adams  LL, Pronovost  PJ.  Improving comfort and communication in the ICU: a practical new tool for palliative care performance measurement and feedback.  Qual Saf Health Care. 2006;15(4):264-271. doi:10.1136/qshc.2005.017707PubMedGoogle ScholarCrossref
10.
Long  AC, Kross  EK, Engelberg  RA,  et al.  Quality of dying in the ICU: is it worse for patients admitted from the hospital ward compared to those admitted from the emergency department?  Intensive Care Med. 2014;40(11):1688-1697. doi:10.1007/s00134-014-3425-2PubMedGoogle ScholarCrossref
11.
Glavan  BJ, Engelberg  RA, Downey  L, Curtis  JR.  Using the medical record to evaluate the quality of end-of-life care in the intensive care unit.  Crit Care Med. 2008;36(4):1138-1146. doi:10.1097/CCM.0b013e318168f301PubMedGoogle ScholarCrossref
12.
Penrod  JD, Pronovost  PJ, Livote  EE,  et al.  Meeting standards of high-quality intensive care unit palliative care: clinical performance and predictors.  Crit Care Med. 2012;40(4):1105-1112. doi:10.1097/CCM.0b013e3182374a50PubMedGoogle ScholarCrossref
13.
Nelson  JE, Meier  DE, Litke  A, Natale  DA, Siegel  RE, Morrison  RS.  The symptom burden of chronic critical illness.  Crit Care Med. 2004;32(7):1527-1534. doi:10.1097/01.CCM.0000129485.08835.5APubMedGoogle ScholarCrossref
14.
Nelson  JE, Meier  DE, Oei  EJ,  et al.  Self-reported symptom experience of critically ill cancer patients receiving intensive care.  Crit Care Med. 2001;29(2):277-282. doi:10.1097/00003246-200102000-00010PubMedGoogle ScholarCrossref
15.
Kross  EK, Engelberg  RA, Downey  L,  et al.  Differences in end-of-life care in the ICU across patients cared for by medicine, surgery, neurology, and neurosurgery physicians.  Chest. 2014;145(2):313-321. doi:10.1378/chest.13-1351PubMedGoogle ScholarCrossref
16.
Su  A, Lief  L, Berlin  D,  et al.  Beyond pain: nurses’ assessment of patient suffering, dignity, and dying in the intensive care unit.  J Pain Symptom Manage. 2018;55(6):1591-1598.e1.PubMedGoogle ScholarCrossref
17.
Cook  D, Rocker  G.  Dying with dignity in the intensive care unit.  N Engl J Med. 2014;370(26):2506-2514. doi:10.1056/NEJMra1208795PubMedGoogle ScholarCrossref
18.
Quill  CM, Ratcliffe  SJ, Harhay  MO, Halpern  SD.  Variation in decisions to forgo life-sustaining therapies in US ICUs.  Chest. 2014;146(3):573-582. doi:10.1378/chest.13-2529PubMedGoogle ScholarCrossref
19.
Hart  JL, Harhay  MO, Gabler  NB, Ratcliffe  SJ, Quill  CM, Halpern  SD.  Variability among US intensive care units in managing the care of patients admitted with preexisting limits on life-sustaining therapies.  JAMA Intern Med. 2015;175(6):1019-1026. doi:10.1001/jamainternmed.2015.0372PubMedGoogle ScholarCrossref
20.
Sprung  CL, Cohen  SL, Sjokvist  P,  et al; Ethicus Study Group.  End-of-life practices in European intensive care units: the Ethicus Study.  JAMA. 2003;290(6):790-797. doi:10.1001/jama.290.6.790PubMedGoogle ScholarCrossref
21.
Cook  DJ, Guyatt  G, Rocker  G,  et al.  Cardiopulmonary resuscitation directives on admission to intensive-care unit: an international observational study.  Lancet. 2001;358(9297):1941-1945. doi:10.1016/S0140-6736(01)06960-4PubMedGoogle ScholarCrossref
22.
Barnato  AE, Herndon  MB, Anthony  DL,  et al.  Are regional variations in end-of-life care intensity explained by patient preferences?: a study of the US Medicare population.  Med Care. 2007;45(5):386-393. doi:10.1097/01.mlr.0000255248.79308.41PubMedGoogle ScholarCrossref
23.
Dzeng  E, Dohan  D, Curtis  JR, Smith  TJ, Colaianni  A, Ritchie  CS.  Homing in on the social: system-level influences on overly aggressive treatments at the end of life.  J Pain Symptom Manage. 2018;55(2):282-289.e1.PubMedGoogle ScholarCrossref
24.
Hinkle  LJ, Bosslet  GT, Torke  AM.  Factors associated with family satisfaction with end-of-life care in the ICU: a systematic review.  Chest. 2015;147(1):82-93. doi:10.1378/chest.14-1098PubMedGoogle ScholarCrossref
25.
Kross  EK, Engelberg  RA, Gries  CJ, Nielsen  EL, Zatzick  D, Curtis  JR.  ICU care associated with symptoms of depression and posttraumatic stress disorder among family members of patients who die in the ICU.  Chest. 2011;139(4):795-801. doi:10.1378/chest.10-0652PubMedGoogle ScholarCrossref
26.
Pun  BT, Balas  MC, Barnes-Daly  MA,  et al.  Caring for critically ill patients with the ABCDEF bundle: results of the ICU Liberation Collaborative in over 15,000 adults.  Crit Care Med. 2018;47(1):3-14.PubMedGoogle ScholarCrossref
27.
Barnes-Daly  MA, Pun  BT, Harmon  LA,  et al.  Improving health care for critically ill patients using an evidence-based collaborative approach to ABCDEF bundle dissemination and implementation.  Worldviews Evid Based Nurs. 2018;15(3):206-216. doi:10.1111/wvn.12290PubMedGoogle ScholarCrossref
28.
Nelson  JE, Puntillo  KA, Pronovost  PJ,  et al.  In their own words: patients and families define high-quality palliative care in the intensive care unit.  Crit Care Med. 2010;38(3):808-818. doi:10.1097/CCM.0b013e3181c5887cPubMedGoogle ScholarCrossref
29.
Donabedian  A, Axelrod  SJ, Wyszewianski  L.  Medical Care Chartbook. 7th ed. Washington, DC: Association of University Programs in Health Administration Press; 1980.
30.
Donabedian  A.  The Definition of Quality and Approaches to its Assessment. Ann Arbor, MI: Health Administration Press; 1980.
31.
Donabedian  A.  The Criteria and Standards of Quality. Ann Arbor, MI: Health Administration Press; 1982.
32.
Heyland  DK, Dodek  P, You  JJ,  et al; ACCEPT Study Team and the Canadian Researchers at the End of Life Network (CARENET).  Validation of quality indicators for end-of-life communication: results of a multicentre survey.  CMAJ. 2017;189(30):E980-E989. doi:10.1503/cmaj.160515PubMedGoogle ScholarCrossref
33.
Sinuff  T, Dodek  P, You  JJ,  et al.  Improving end-of-life communication and decision making: the development of a conceptual framework and quality indicators.  J Pain Symptom Manage. 2015;49(6):1070-1080. doi:10.1016/j.jpainsymman.2014.12.007PubMedGoogle ScholarCrossref
34.
Leapfrog Hospital Survey. Factsheet: ICU physician staffing. https://www.leapfroggroup.org/sites/default/files/Files/2019%20IPS%20Fact%20Sheet.pdf. Accessed November 6, 2019.
35.
Mularski  RA, Puntillo  K, Varkey  B,  et al.  Pain management within the palliative and end-of-life care experience in the ICU.  Chest. 2009;135(5):1360-1369. doi:10.1378/chest.08-2328PubMedGoogle ScholarCrossref
36.
Steinhauser  KE, Christakis  NA, Clipp  EC, McNeilly  M, McIntyre  L, Tulsky  JA.  Factors considered important at the end of life by patients, family, physicians, and other care providers.  JAMA. 2000;284(19):2476-2482. doi:10.1001/jama.284.19.2476PubMedGoogle ScholarCrossref
37.
Yao  Y, Keenan  G, Al-Masalha  F,  et al.  Current state of pain care for hospitalized patients at end of life.  Am J Hosp Palliat Care. 2013;30(2):128-136. doi:10.1177/1049909112444458PubMedGoogle ScholarCrossref
38.
Kobewka  D, Ronksley  P, McIsaac  D, Mulpuru  S, Forster  A.  Prevalence of symptoms at the end of life in an acute care hospital: a retrospective cohort study.  CMAJ Open. 2017;5(1):E222-E228. doi:10.9778/cmajo.20160123PubMedGoogle ScholarCrossref
39.
Devlin  JW, Skrobik  Y, Gélinas  C,  et al.  Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU.  Crit Care Med. 2018;46(9):e825-e873. doi:10.1097/CCM.0000000000003299PubMedGoogle ScholarCrossref
40.
Hosie  A, Davidson  PM, Agar  M, Sanderson  CR, Phillips  J.  Delirium prevalence, incidence, and implications for screening in specialist palliative care inpatient settings: a systematic review.  Palliat Med. 2013;27(6):486-498. doi:10.1177/0269216312457214PubMedGoogle ScholarCrossref
41.
Bush  SH, Leonard  MM, Agar  M,  et al.  End-of-life delirium: issues regarding recognition, optimal management, and the role of sedation in the dying phase.  J Pain Symptom Manage. 2014;48(2):215-230. doi:10.1016/j.jpainsymman.2014.05.009PubMedGoogle ScholarCrossref
42.
Turnbull  AE, Bosslet  GT, Kross  EK.  Aligning use of intensive care with patient values in the USA: past, present, and future.  Lancet Respir Med. 2019;7(7):626-638. doi:10.1016/S2213-2600(19)30087-6PubMedGoogle ScholarCrossref
43.
Yadav  KN, Gabler  NB, Cooney  E,  et al.  Approximately one in three US adults completes any type of advance directive for end-of-life care.  Health Aff (Millwood). 2017;36(7):1244-1251. doi:10.1377/hlthaff.2017.0175PubMedGoogle ScholarCrossref
44.
Silveira  MJ, Kim  SYH, Langa  KM.  Advance directives and outcomes of surrogate decision making before death.  N Engl J Med. 2010;362(13):1211-1218. doi:10.1056/NEJMsa0907901PubMedGoogle ScholarCrossref
45.
Choi  PJ, Curlin  FA, Cox  CE.  Addressing religion and spirituality in the intensive care unit: a survey of clinicians.  Palliat Support Care. 2018:1-6.PubMedGoogle Scholar
46.
Wendlandt  B, Ceppe  A, Choudhury  S,  et al.  Modifiable elements of ICU supportive care and communication are associated with surrogates’ PTSD symptoms.  Intensive Care Med. 2019;45(5):619-626. doi:10.1007/s00134-019-05550-zPubMedGoogle ScholarCrossref
47.
Liu  V, Read  JL, Scruth  E, Cheng  E.  Visitation policies and practices in US ICUs.  Crit Care. 2013;17(2):R71. doi:10.1186/cc12677PubMedGoogle ScholarCrossref
48.
Davidson  JE, Aslakson  RA, Long  AC,  et al.  Guidelines for family-centered care in the neonatal, pediatric, and adult ICU.  Crit Care Med. 2017;45(1):103-128. doi:10.1097/CCM.0000000000002169PubMedGoogle ScholarCrossref
49.
Davidson  JE, Powers  K, Hedayat  KM,  et al; American College of Critical Care Medicine Task Force 2004-2005, Society of Critical Care Medicine.  Clinical practice guidelines for support of the family in the patient-centered intensive care unit: American College of Critical Care Medicine Task Force 2004-2005.  Crit Care Med. 2007;35(2):605-622. doi:10.1097/01.CCM.0000254067.14607.EBPubMedGoogle ScholarCrossref
50.
Lief  L, Berlin  DA, Maciejewski  RC,  et al.  Dying patient and family contributions to nurse distress in the ICU.  Ann Am Thorac Soc. 2018;15(12):1459-1464. doi:10.1513/AnnalsATS.201804-284OCPubMedGoogle ScholarCrossref
51.
Poncet  MC, Toullic  P, Papazian  L,  et al.  Burnout syndrome in critical care nursing staff.  Am J Respir Crit Care Med. 2007;175(7):698-704. doi:10.1164/rccm.200606-806OCPubMedGoogle ScholarCrossref
52.
Dzeng  E, Curtis  JR.  Understanding ethical climate, moral distress, and burnout: a novel tool and a conceptual framework.  BMJ Qual Saf. 2018;27(10):766-770. doi:10.1136/bmjqs-2018-007905PubMedGoogle ScholarCrossref
53.
Harrison  KL, Dzeng  E, Ritchie  CS,  et al.  Addressing palliative care clinician burnout in organizations: a workforce necessity, an ethical imperative.  J Pain Symptom Manage. 2017;53(6):1091-1096. doi:10.1016/j.jpainsymman.2017.01.007PubMedGoogle ScholarCrossref
×