[Skip to Navigation]
Sign In
Visual Abstract. Flexible Family Visitation and Delirium in ICU Patients
Flexible Family Visitation and Delirium in ICU Patients
Figure 1.  Enrollment, Randomization, and Follow-up in the ICU Visits Study
Enrollment, Randomization, and Follow-up in the ICU Visits Study

ICU indicates intensive care unit.

aICUs of public and private nonprofit hospitals from all 5 geopolitical regions of Brazil, all of which have participated in previous studies of the Brazilian Research in Intensive Care Network (BRICNet) or were recommended by the Brazilian Ministry of Health, were invited to participate in the trial.

bAccording to the minimum requirements for the operation of ICUs in Brazil, which include multidisciplinary care (intensivist, nurse, nurse technician, and physiotherapist at minimum) and access to monitoring devices, organ support therapies, and specialty care services.

cCauses of exclusion listed in eTable 2 in Supplement 2.

dRichmond Agitation Sedation Scale score −4 or −5. Values range from −5 (unarousable) to +4 (combative); eg, a score of −4 indicates no response to voice but movement or eye opening in response to physical stimulation, and a score of −5 indicates no response to voice or physical stimulation.

eAphasia or severe hearing deficit.

fICU discharge, transfer, or end of cluster recruitment during the assessment of eligibility criteria.

gIlliteracy or severe visual or hearing impairments.

hData on causes of follow-up losses were not collected.

Figure 2.  Enrollment, Randomization, and Follow-up in the ICU Visits Study (Continued)
Enrollment, Randomization, and Follow-up in the ICU Visits Study (Continued)

aCauses of exclusion listed in eTable 2 in Supplement 2.

bRichmond Agitation Sedation Scale score −4 or −5. Values range from −5 (unarousable) to +4 (combative); eg, a score of −4 indicates no response to voice but movement or eye opening in response to physical stimulation, and a score of −5 indicates no response to voice or physical stimulation.

cAphasia or severe hearing deficit.

dICU discharge, transfer, or end of cluster recruitment during the assessment of eligibility criteria.

eIlliteracy or severe visual or hearing impairments.

fData on causes of follow-up losses were not collected.

Figure 3.  Daily Mean Duration of Visits in Each Visitation Model
Daily Mean Duration of Visits in Each Visitation Model

Daily mean duration of visits per patient is considered the length of stay of all visitors (whether they were family members) at the bedside of an enrolled patient. The box plot inner horizontal lines indicate median; boxes, interquartile range (25th and 75th percentiles); vertical whiskers, 1.5 interquartile range beyond the 25th and 75th percentiles; and dots, more extreme values.

Table 1.  Baseline Characteristics of Participants in the ICU Visits Study
Baseline Characteristics of Participants in the ICU Visits Study
Table 2.  Primary and Secondary Study Outcomes
Primary and Secondary Study Outcomes
Table 3.  Tertiary Study Outcomes
Tertiary Study Outcomes
Supplement 2.

eFigure 1. Implementation of the Flexible Family Visitation Model

eTable 1. Inter-rater Reliability of Delirium Assessment Using the CAM-ICU

eMethods. Description of Post hoc Sensitivity and Subgroup Analyses

eTable 2. Causes of Participant Exclusion

eTable 3. Characteristics of Participants Who Were Lost to Follow-up or Declined to Participate

eFigure 2. Geographical Distribution of Participating Intensive Care Units

eTable 4. Characteristics of Participating Intensive Care Units

eFigure 3. Adherence to the Implementation of Flexible Visitation

eTable 5. Sensitivity Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on Incidence of Delirium

eFigure 4. Subgroup Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on Incidence of Delirium

eTable 6. Sensitivity Analysis of the Association Between Duration of Visits and Incidence of Delirium

eTable 7. Sensitivity Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on Family Member Anxiety and Depression Symptoms

eTable 8. Sensitivity Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on Family Member Satisfaction

eTable 9. Subgroup Analysis of the Effects of Flexible Visitation Versus Restricted Visitation on Family Member Secondary Outcomes

eTable 10. Sensitivity Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on ICU Staff Burnout

eTable 11. Subgroup Analyses of the Effects of Flexible Visitation Versus Restricted Visitation on ICU Staff Burnout

eTable 12. Sensitivity Analysis of the Effects of Flexible Visitation Versus Restricted Visitation on Primary and Secondary Outcomes Adjusted by the Number of ICU Beds

eTable 13. Sensitivity Analysis of the Interaction Between ICU Sequence of Interventions and Effects of Flexible Visitation Versus Restricted Visitation on Length of Visits and Primary and Secondary Outcomes

eFigure 5. Effects of Flexible Visitation Versus Restricted Family Visitation on Family Member Self-perception of Involvement in Patient Care

eReferences

1.
Davidson  JE, Aslakson  RA, Long  AC,  et al.  Guidelines for family-centered care in the neonatal, pediatric, and adult ICU.  Crit Care Med. 2017;45(1):103-128. doi:10.1097/CCM.0000000000002169PubMedGoogle ScholarCrossref
2.
 Family visitation in the adult intensive care unit.  Crit Care Nurse. 2016;36(1):e15-e18. doi:10.4037/ccn2016677PubMedGoogle ScholarCrossref
3.
Rosa  RG, Tonietto  TF, da Silva  DB,  et al; ICU Visits Study Group Investigators.  Effectiveness and safety of an extended ICU visitation model for delirium prevention: a before and after study.  Crit Care Med. 2017;45(10):1660-1667. doi:10.1097/CCM.0000000000002588PubMedGoogle ScholarCrossref
4.
Westphal  GA, Moerschberger  MS, Vollmann  DD,  et al.  Effect of a 24-h extended visiting policy on delirium in critically ill patients.  Intensive Care Med. 2018;44(6):968-970. doi:10.1007/s00134-018-5153-5PubMedGoogle ScholarCrossref
5.
Nassar Junior  AP, Besen  BAMP, Robinson  CC, Falavigna  M, Teixeira  C, Rosa  RG.  Flexible versus restrictive visiting policies in ICUs: a systematic review and meta-analysis.  Crit Care Med. 2018;46(7):1175-1180. doi:10.1097/CCM.0000000000003155PubMedGoogle ScholarCrossref
6.
Fumagalli  S, Boncinelli  L, Lo Nostro  A,  et al.  Reduced cardiocirculatory complications with unrestrictive visiting policy in an intensive care unit: results from a pilot, randomized trial.  Circulation. 2006;113(7):946-952. doi:10.1161/CIRCULATIONAHA.105.572537PubMedGoogle ScholarCrossref
7.
Kleinpell  R, Heyland  DK, Lipman  J,  et al; Council of the World Federation of Societies of Intensive and Critical Care Medicine.  Patient and family engagement in the ICU: report from the task force of the World Federation of Societies of Intensive and Critical Care Medicine.  J Crit Care. 2018;48:251-256. doi:10.1016/j.jcrc.2018.09.006PubMedGoogle ScholarCrossref
8.
Liu  V, Read  JL, Scruth  E, Cheng  E.  Visitation policies and practices in US ICUs.  Crit Care. 2013;17(2):R71. doi:10.1186/cc12677PubMedGoogle ScholarCrossref
9.
Garrouste-Orgeas  M, Vinatier  I, Tabah  A, Misset  B, Timsit  JF.  Reappraisal of visiting policies and procedures of patient’s family information in 188 French ICUs: a report of the Outcomerea Research Group.  Ann Intensive Care. 2016;6(1):82. doi:10.1186/s13613-016-0185-xPubMedGoogle ScholarCrossref
10.
Hunter  JD, Goddard  C, Rothwell  M, Ketharaju  S, Cooper  H.  A survey of intensive care unit visiting policies in the United Kingdom.  Anaesthesia. 2010;65(11):1101-1105. doi:10.1111/j.1365-2044.2010.06506.xPubMedGoogle ScholarCrossref
11.
Giannini  A, Miccinesi  G, Leoncino  S.  Visiting policies in Italian intensive care units: a nationwide survey.  Intensive Care Med. 2008;34(7):1256-1262. doi:10.1007/s00134-008-1037-4PubMedGoogle ScholarCrossref
12.
Ramos  FJ, Fumis  RR, de Azevedo  LC, Schettino  G.  Intensive care unit visitation policies in Brazil: a multicenter survey.  Rev Bras Ter Intensiva. 2014;26(4):339-346. doi:10.5935/0103-507X.20140052PubMedGoogle ScholarCrossref
13.
da Silva Ramos  FJ, Fumis  RR, Azevedo  LC, Schettino  G.  Perceptions of an open visitation policy by intensive care unit workers.  Ann Intensive Care. 2013;3(1):34. doi:10.1186/2110-5820-3-34PubMedGoogle ScholarCrossref
14.
Garrouste-Orgeas  M, Philippart  F, Timsit  JF,  et al.  Perceptions of a 24-hour visiting policy in the intensive care unit.  Crit Care Med. 2008;36(1):30-35. doi:10.1097/01.CCM.0000295310.29099.F8PubMedGoogle ScholarCrossref
15.
Giannini  A, Miccinesi  G, Prandi  E, Buzzoni  C, Borreani  C, ODIN Study Group.  Partial liberalization of visiting policies and ICU staff: a before-and-after study.  Intensive Care Med. 2013;39(12):2180-2187. doi:10.1007/s00134-013-3087-5PubMedGoogle ScholarCrossref
16.
Rosa  RG, Falavigna  M, Robinson  CC,  et al; ICU Visits Study Group Investigators and the BRICNet.  Study protocol to assess the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units: a cluster-randomised, crossover trial (the ICU Visits Study).  BMJ Open. 2018;8(4):e021193. doi:10.1136/bmjopen-2017-021193PubMedGoogle ScholarCrossref
17.
Sganzerla  D, Teixeira  C, Robinson  CC,  et al.  Statistical analysis plan for a cluster-randomized crossover trial comparing the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units (the ICU Visits Study).  Trials. 2018;19(1):636. doi:10.1186/s13063-018-3006-8PubMedGoogle ScholarCrossref
18.
Brazilian Ministry of Health, National Health Surveillance Agency. Resolution RDC No. 7 of 24 February 2010: provides for the minimum requirements for the operation of intensive care units and presents other providences. Brazilian Ministry of Health website. http://bvsms.saude.gov.br/bvs/saudelegis/anvisa/2010/res0007_24_02_2010.html. Published 2010. Accessed November 27, 2017.
19.
Ely  EW, Truman  B, Shintani  A,  et al.  Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS).  JAMA. 2003;289(22):2983-2991. doi:10.1001/jama.289.22.2983PubMedGoogle ScholarCrossref
20.
Ely  EW, Margolin  R, Francis  J,  et al.  Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU).  Crit Care Med. 2001;29(7):1370-1379. doi:10.1097/00003246-200107000-00012PubMedGoogle ScholarCrossref
21.
Centers for Disease Control and Prevention (CDC). Pneumonia (Ventilator-Associated [VAP] and Non-Ventilator-Associated Pneumonia [PNEU]) Event. CDC website. https://www.cdc.gov/nhsn/pdfs/pscmanual/6pscvapcurrent.pdf. Published 2019. Accessed June 6, 2019.
22.
Centers for Disease Control and Prevention (CDC). Bloodstream Infection Event (Central Line-Associated Bloodstream Infection and Non-Central Line Associated Bloodstream Infection). CDC website. https://www.cdc.gov/nhsn/pdfs/pscmanual/4psc_clabscurrent.pdf. Published 2019. Accessed June 6, 2019.
23.
Centers for Disease Control and Prevention (CDC). Urinary Tract Infection (Catheter-Associated Urinary Tract Infection [CAUTI] and Non-Catheter-Associated Urinary Tract Infection [UTI]) and Other Urinary System Infection [USI]) Events. CDC website. https://www.cdc.gov/nhsn/pdfs/pscManual/7pscCauticurrent.pdf. Published 2019. Accessed June 6, 2019.
24.
Zigmond  AS, Snaith  RP.  The hospital anxiety and depression scale.  Acta Psychiatr Scand. 1983;67(6):361-370. doi:10.1111/j.1600-0447.1983.tb09716.xPubMedGoogle ScholarCrossref
25.
Morgon  FH, Guirardello  EdeB.  Validation of a ratio scale for family needs at an intensive care unit  [in Portugese].  Rev Lat Am Enfermagem. 2004;12(2):198-203. doi:10.1590/S0104-11692004000200008PubMedGoogle ScholarCrossref
26.
Maslach  C, Jackson  SE, Leiter  MP.  Maslach Burnout Inventory Manual. 3rd ed. Palo Alto, CA: Consulting Psychologists Press; 1996.
27.
van den Boogaard  M, Pickkers  P, Slooter  AJ,  et al.  Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study.  BMJ. 2012;344:e420. doi:10.1136/bmj.e420PubMedGoogle ScholarCrossref
28.
Knaus  WA, Draper  EA, Wagner  DP, Zimmerman  JE.  APACHE II: a severity of disease classification system.  Crit Care Med. 1985;13(10):818-829. doi:10.1097/00003246-198510000-00009PubMedGoogle ScholarCrossref
29.
Colantuoni  E, Dinglas  VD, Ely  EW, Hopkins  RO, Needham  DM.  Statistical methods for evaluating delirium in the ICU.  Lancet Respir Med. 2016;4(7):534-536. doi:10.1016/S2213-2600(16)30138-2PubMedGoogle ScholarCrossref
30.
Livingston  EH, Elliot  A, Hynan  L, Cao  J.  Effect size estimation: a necessary component of statistical analysis.  Arch Surg. 2009;144(8):706-712. doi:10.1001/archsurg.2009.150PubMedGoogle ScholarCrossref
31.
Doulougeri  K, Georganta  K, Montgomery  A.  “Diagnosing” burnout among healthcare professionals: can we find consensus?  Cogent Med. 2016;3(1):1. doi:10.1080/2331205X.2016.1237605Google ScholarCrossref
32.
Puhan  MA, Frey  M, Büchi  S, Schünemann  HJ.  The minimal important difference of the hospital anxiety and depression scale in patients with chronic obstructive pulmonary disease.  Health Qual Life Outcomes. 2008;6:46. doi:10.1186/1477-7525-6-46PubMedGoogle ScholarCrossref
33.
Devlin  JW, Skrobik  Y, Gélinas  C,  et al.  Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU.  Crit Care Med. 2018;46(9):e825-e873. doi:10.1097/CCM.0000000000003299PubMedGoogle ScholarCrossref
34.
Van Rompaey  B, Elseviers  MM, Schuurmans  MJ, Shortridge-Baggett  LM, Truijen  S, Bossaert  L.  Risk factors for delirium in intensive care patients: a prospective cohort study.  Crit Care. 2009;13(3):R77. doi:10.1186/cc7892PubMedGoogle ScholarCrossref
35.
Malacarne  P, Corini  M, Petri  D.  Health care-associated infections and visiting policy in an intensive care unit.  Am J Infect Control. 2011;39(10):898-900. doi:10.1016/j.ajic.2011.02.018PubMedGoogle ScholarCrossref
36.
Schmidt  M, Azoulay  E.  Having a loved one in the ICU: the forgotten family.  Curr Opin Crit Care. 2012;18(5):540-547. doi:10.1097/MCC.0b013e328357f141PubMedGoogle ScholarCrossref
37.
Moore  GF, Audrey  S, Barker  M,  et al.  Process evaluation of complex interventions: Medical Research Council guidance.  BMJ. 2015;350:h1258. doi:10.1136/bmj.h1258PubMedGoogle ScholarCrossref
Original Investigation
Caring for the Critically Ill Patient
July 16, 2019

Effect of Flexible Family Visitation on Delirium Among Patients in the Intensive Care Unit: The ICU Visits Randomized Clinical Trial

Regis Goulart Rosa, MD, PhD1,2,3; Maicon Falavigna, MD, PhD2; Daiana Barbosa da Silva, RN, MSc1,2; et al Daniel Sganzerla, BSc2; Mariana Martins Siqueira Santos, MSc2; Renata Kochhann, PhD2; Rafaela Moraes de Moura, PHAR2; Cláudia Severgnini Eugênio, RN, MSc1,2; Tarissa da Silva Ribeiro Haack, RN1,2; Mirceli Goulart Barbosa, MSc2; Caroline Cabral Robinson, PhD2; Daniel Schneider, BSc2; Débora Mariani de Oliveira, BSc2; Rodrigo Wiltgen Jeffman, MD2; Alexandre Biasi Cavalcanti, MD, PhD3,4; Flávia Ribeiro Machado, MD, PhD3,5; Luciano Cesar Pontes Azevedo, MD, PhD3,6; Jorge Ibrain Figueira Salluh, MD, PhD3,7; José Augusto Santos Pellegrini, MD, PhD8; Rafael Barberena Moraes, MD, PhD8; Rafael Botelho Foernges, MD9; Andre Peretti Torelly, MD10; Lizandra de Oliveira Ayres, RN11; Pericles Almeida Delfino Duarte, MD, PhD11,12; Wilson José Lovato, MD13; Patrick Harrison Santana Sampaio, MD14; Lúcio Couto de Oliveira Júnior, MD15; Jorge Luiz da Rocha Paranhos, MD16; Alessandro da Silva Dantas, MD17; Pollyanna Iracema Peixoto Gouveia Gomes de Brito, PT17; Eliane Aparecida Peixoto Paulo, RN18; Marcos Antônio Cavalcanti Gallindo, MD19; Janaina Pilau, MD, PhD20; Helen Martins Valentim, MD21; José Mario Meira Teles, MD22; Vandack Nobre, MD, PhD3,23; Daniella Cunha Birriel, MD24; Livia Corrêa e Castro, MD25; Andréia Martins Specht, RN, MSc26; Gregory Saraiva Medeiros, MD, MSc1,2; Tulio Frederico Tonietto, MD1; Emersom Cicilini Mesquita, MD, PhD7; Nilton Brandão da Silva, MD, PhD27; Jeffrey E. Korte, MD, PhD28; Luciano Serpa Hammes, MD, PhD2; Alberto Giannini, MD29; Fernando Augusto Bozza, MD, PhD3,7,30; Cassiano Teixeira, MD, PhD1,3; for the ICU Visits Study Group Investigators and the Brazilian Research in Intensive Care Network (BRICNet)
Author Affiliations
  • 1Intensive Care Unit, Hospital Moinhos de Vento (HMV), Porto Alegre, Rio Grande do Sul, Brazil
  • 2Research Projects Office, HMV, Porto Alegre, Rio Grande do Sul, Brazil
  • 3Brazilian Research in Intensive Care Network (BRICNet), São Paulo, São Paulo
  • 4HCor Research Institute, São Paulo, São Paulo, Brazil
  • 5Department of Anesthesiology, Pain and Intensive Care, Universidade Federal de São Paulo (UNIFESP), São Paulo, São Paulo, Brazil
  • 6Intensive Care Unit, Hospital Sírio-Libanês, São Paulo, São Paulo, Brazil
  • 7Department of Critical Care, Instituto D’Or de Pesquisa e Ensino, Rio de Janeiro, Rio de Janeiro, Brazil
  • 8Intensive Care Unit, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, Rio Grande do Sul, Brazil
  • 9Intensive Care Unit, Hospital Santa Cruz, Santa Cruz do Sul, Rio Grande do Sul, Brazil
  • 10Intensive Care Unit, Hospital Santa Rita, Porto Alegre, Rio Grande do Sul, Brazil
  • 11Intensive Care Unit, Hospital Universitário do Oeste do Paraná, Cascavel, Paraná, Brazil
  • 12Intensive Care Unit, Hospital do Câncer de Cascavel, Cascavel, Paraná, Brazil
  • 13Intensive Care Unit, Hospital das Clínicas, Faculdade de Medicina de Ribeirão Preto, Ribeirão Preto, São Paulo, Brazil
  • 14Intensive Care Unit, Santa Casa de Misericórdia de Feira de Santana, Feira de Santana, Bahia, Brazil
  • 15Intensive Care Unit, Hospital Geral Clériston Andrade, Feira de Santana, Bahia, Brazil
  • 16Intensive Care Unit, Santa Casa de Misericórdia de São João Del Rei, São João Del Rei, Minas Gerais, Brazil
  • 17Intensive Care Unit, Hospital Regional Doutor Deoclécio Marques de Lucena, Parnamirim, Rio Grande do Norte, Brazil
  • 18Intensive Care Unit, Fundação Hospital Adriano Jorge, Manaus, Amazonas, Brazil
  • 19Intensive Care Unit, Hospital Agamenon Magalhães, Recife, Pernambuco, Brazil
  • 20Intensive Care Unit, Hospital da Cidade, Passo Fundo, Rio Grande do Sul, Brazil
  • 21Intensive Care Unit, Hospital Mãe de Deus, Porto Alegre, Rio Grande do Sul, Brazil
  • 22Intensive Care Unit, Hospital de Urgências de Goiânia, Goiânia, Goiânia, Brazil
  • 23Intensive Care Unit, Hospital das Clínicas, Universidade Federal de Minas Gerais (UFMG), Belo Horizonte, Minas Gerais, Brazil
  • 24Intensive Care Unit, Pavilhão Pereira Filho, Porto Alegre, Rio Grande do Sul, Brazil
  • 25Intensive Care Unit, Hospital Regional do Baixo Amazonas, Santarém, Pará, Brazil
  • 26Intensive Care Unit, Hospital Nossa Senhora da Conceição, Porto Alegre, Rio Grande do Sul, Brazil
  • 27School of Medicine, Universidade Federal de Ciências da Saúde de Porto Alegre (UFCSPA), Porto Alegre, Rio Grande do Sul, Brazil
  • 28Department of Public Health Sciences, Medical University of South Carolina, Charleston
  • 29Unit of Pediatric Anesthesia and Intensive Care, Ospedale dei Bambini—ASST Spedali Civili, Brescia, Italy
  • 30Oswaldo Cruz Foundation (FIOCRUZ), Rio de Janeiro, Rio de Janeiro, Brazil
JAMA. 2019;322(3):216-228. doi:10.1001/jama.2019.8766
Visual Abstract. Flexible Family Visitation and Delirium in ICU Patients
Flexible Family Visitation and Delirium in ICU Patients
Key Points

Question  Does a policy that permits flexible family visitation in the intensive care unit (up to 12 hours per day), compared with standard restricted visitation defined by each intensive care unit (median, 1.5 hours per day; up to 4.5 hours per day), reduce the incidence of delirium among patients?

Findings  In this cluster-crossover randomized clinical trial that involved 1685 patients in the intensive care unit, the incidence of delirium was 18.9% in the flexible family visitation group compared with 20.1% in the standard restricted visitation group, a difference that was not statistically significant.

Meaning  Flexible family visiting hours did not significantly reduce the incidence of delirium among patients in the intensive care unit.

Abstract

Importance  The effects of intensive care unit (ICU) visiting hours remain uncertain.

Objective  To determine whether a flexible family visitation policy in the ICU reduces the incidence of delirium.

Design, Setting and Participants  Cluster-crossover randomized clinical trial involving patients, family members, and clinicians from 36 adult ICUs with restricted visiting hours (<4.5 hours per day) in Brazil. Participants were recruited from April 2017 to June 2018, with follow-up until July 2018.

Interventions  Flexible visitation (up to 12 hours per day) supported by family education (n = 837 patients, 652 family members, and 435 clinicians) or usual restricted visitation (median, 1.5 hours per day; n = 848 patients, 643 family members, and 391 clinicians). Nineteen ICUs started with flexible visitation, and 17 started with restricted visitation.

Main Outcomes and Measures  Primary outcome was incidence of delirium during ICU stay, assessed using the CAM-ICU. Secondary outcomes included ICU-acquired infections for patients; symptoms of anxiety and depression assessed using the HADS (range, 0 [best] to 21 [worst]) for family members; and burnout for ICU staff (Maslach Burnout Inventory).

Results  Among 1685 patients, 1295 family members, and 826 clinicians enrolled, 1685 patients (100%) (mean age, 58.5 years; 47.2% women), 1060 family members (81.8%) (mean age, 45.2 years; 70.3% women), and 737 clinicians (89.2%) (mean age, 35.5 years; 72.9% women) completed the trial. The mean daily duration of visits was significantly higher with flexible visitation (4.8 vs 1.4 hours; adjusted difference, 3.4 hours [95% CI, 2.8 to 3.9]; P < .001). The incidence of delirium during ICU stay was not significantly different between flexible and restricted visitation (18.9% vs 20.1%; adjusted difference, −1.7% [95% CI, −6.1% to 2.7%]; P = .44). Among 9 prespecified secondary outcomes, 6 did not differ significantly between flexible and restricted visitation, including ICU-acquired infections (3.7% vs 4.5%; adjusted difference, −0.8% [95% CI, −2.1% to 1.0%]; P = .38) and staff burnout (22.0% vs 24.8%; adjusted difference, −3.8% [95% CI, −4.8% to 12.5%]; P = .36). For family members, median anxiety (6.0 vs 7.0; adjusted difference, −1.6 [95% CI, −2.3 to −0.9]; P < .001) and depression scores (4.0 vs 5.0; adjusted difference, −1.2 [95% CI, −2.0 to −0.4]; P = .003) were significantly better with flexible visitation.

Conclusions and Relevance  Among patients in the ICU, a flexible family visitation policy, vs standard restricted visiting hours, did not significantly reduce the incidence of delirium.

Trial Registration  ClinicalTrials.gov Identifier: NCT02932358

Introduction

Quiz Ref IDA flexible visitation policy for family members in intensive care units (ICUs) has been recommended by professional society guidelines as an important step toward patient- and family-centered care.1,2 Flexible ICU visiting hours may contribute to delirium prevention3-5 and stress reduction5,6 among patients as well as improvement in family satisfaction.5 However, the evidence suggests that most ICUs still adopt restricted visitation models,7-12 possibly motivated by risks purportedly associated with unrestricted visiting hours, mainly disorganization of care,13,14 infectious complications,6 and burnout.15 To date, no large randomized trials have assessed the effects of a flexible family visitation model on patients, family members, and ICU staff, and this evidence gap may constitute a barrier to understanding the best way to implement ICU visitation policies.

This article reports the results of the ICU Visits Study, a cluster-crossover randomized clinical trial designed to evaluate whether a flexible visitation policy in the ICU, supported by family education, was more effective than the standard restricted visitation model in reducing delirium among patients. Family member and clinician outcomes were also assessed.

Methods

The institutional review boards of all participating centers approved the study. A mixed consent process was used. At the cluster level, the head of the ICU and the hospital director provided written consent for the study protocol. Among patients, the need for written informed consent was waived in 33 ICUs. The waiver was based on the nature of the proposed interventions, which were directed at the organizational aspects of ICUs and did not involve untested clinical procedures. In these 33 ICUs, patients or their proxies received verbal and written information about the trial, including the option to refuse participation or withdraw from participation at any time. In 3 ICUs, written consent was deemed necessary and was thus obtained from patients or their proxies. Written consent was also obtained from all family members and clinicians participating in the study.

Study Design

Quiz Ref IDThis study was a cluster-crossover randomized clinical trial comparing patient, family, and clinician outcomes associated with a flexible family visitation model or the usual restricted visitation model in adult ICUs. ICUs were randomly assigned to 1 of 2 sequences of interventions: flexible visitation followed by restricted visitation or restricted visitation followed by flexible visitation. The duration of interventions in each ICU was determined by the patient recruitment rate (25 patients during the first intervention [phase 1] and 25 patients during the second intervention [phase 2]).

Patients and family members admitted to participating ICUs during phase 1 or 2 were assessed. Clinicians were assessed only in phase 1, to avoid a carryover effect. A 30-day period without recruitment was applied between the 2 phases to avoid contamination. All ICUs had a learning period within the first 15 days of flexible visitation and restricted visitation, during which staff could adapt to study interventions before participant recruitment.

The primary hypothesis was that the flexible family visitation model would reduce the incidence of delirium among patients. The trial protocol and statistical analysis plan have been published and are available in Supplement 1.16,17

Participants

The trial enrolled medical-surgical adult ICUs with 6 or more beds and restricted visiting hours (<4.5 hours per day) at public and private nonprofit hospitals in Brazil. ICUs not meeting the minimum structural or organizational requirements for the operation of ICUs in Brazil were excluded.18

Patients 18 years or older admitted to participating ICUs were consecutively included. The exclusion criteria were coma (Richmond Agitation-Sedation Scale19 score ≤−4) lasting longer than 96 hours from initial screening assessment or presence of any of the following characteristics at screening assessment: delirium (positive Confusion Assessment Method for the ICU [CAM-ICU] screening),20 brain death, exclusive palliative care, inability to communicate, predicted ICU length of stay less than 48 hours, unlikely to survive longer than 24 hours, prisoner status, unavailability of a family member to participate in ICU visits, and previous enrollment in the study.

For each patient, 1 relative was enrolled (identified by the family as the closest relative); those who did not speak Portuguese or had communication difficulties were excluded. Day-shift physicians, nurses, nurse technicians, and physiotherapists working in the ICU at least 20 hours per week were eligible for participation as clinicians; however, those planning to take leaves of absence (>15 days) during phase 1 were excluded.

Randomization and Interventions

The ICUs were consecutively randomized in a 1:1 ratio using computer-generated randomization with random block sizes of 2, 4, and 6 and stratified by number of ICU beds (≤10 or >10). A statistician blinded to cluster identity performed randomization.

Quiz Ref IDThe flexible visitation model included both flexibility of ICU visiting hours and family education. One or 2 close family members were allowed to visit the patient for up to 12 hours per day; however, only 1 relative was enrolled in the study. These family members had to attend at least 1 structured meeting in which they received education about the ICU environment, common procedures, multidisciplinary work, infection control, palliative care, and delirium. These structured meetings were conducted by trained clinicians using a face-to-face format at least 3 times per week. Additionally, family members had access to an information brochure and website (http://www.utivisitas.com.br) designed to help them understand the various processes and emotions associated with an ICU stay and improve cooperation without increasing ICU staff workload. Patients were also allowed to receive social visits at specific time intervals according to local rules. Social visits were offered to friends or family members who did not qualify for flexible visitation. Implementation of the flexible visitation model is shown in eFigure 1 in Supplement 2.

In the restricted visitation model, visitors were allowed as before randomization, according to local hours (median, 1.5 hours/d [interquartile range {IQR}, 1.0 to 2.0]; up to 4.5 hours/d). Visitors were not required to attend educational meetings.

In both visitation models, visitors received oral and written guidance about minimum requirements to promote a safe and restful environment. Following the standard of care in Brazil, visitors were asked to leave the room during critical care procedures. Participation of family members in multidisciplinary rounds was allowed depending on local rules. Also, in both interventions, visitors were allowed to stay longer than the time limit in any of the following exceptional situations: patient 65 years or older, terminal illness, and conflicts between the ICU staff and the patient or family.

Outcomes and Follow-up

The primary outcome was the incidence of delirium during ICU stay measured by trained evaluators using the CAM-ICU,20 which was administered once during every 12-hour shift. Delirium was defined as at least 1 positive CAM-ICU screening. Interrater agreement between CAM-ICU evaluators before study initiation was good, with a mean Cohen κ of 0.71 (95% CI, 0.64 to 0.78) for 932 measurements (eTable 1 in Supplement 2).

Prespecified secondary outcomes for patients included daily hazard of delirium, any ICU-acquired infections (pneumonia, bloodstream infection, or urinary tract infection) according to Centers for Disease Control and Prevention criteria,21-23 7-day ventilator-free days, length of ICU stay, and hospital mortality. For family members, prespecified secondary outcomes included anxiety and depression, assessed using the Hospital Anxiety and Depression Scale (HADS; score range, 0 [best] to 21 [worst]; cutoff points >7 and >10 indicate, respectively, possible and probable cases of anxiety or depression),24 and satisfaction, assessed using the Critical Care Family Needs Inventory (CCFNI). The CCFNI addresses satisfaction in 5 domains (proximity, information, reassurance, comfort, and support), with total scores ranging from 43 (worst) to 172 (best).25 To our knowledge, no studies have been conducted to establish minimal clinically important differences for the HADS and CCFNI in family members of ICU patients. For clinicians, the prevalence of burnout was assessed as a prespecified secondary outcome using the Maslach Burnout Inventory (MBI; score range, −48 [best] to 84 [worst], with total scores >−9 indicating burnout).26

The following prespecified tertiary outcomes were assessed: for patients, need for antipsychotic agents or mechanical restraints and unplanned loss of devices (feeding tube, venous catheter, or urinary catheter) during ICU stay, 7-day coma-free days, and analysis of ICU-acquired infections as individual outcomes; for family members, self-perception of involvement in patient care (score range, 0 [no involvement] to 27 [maximum involvement]; Supplement 1); and for clinicians, satisfaction with the visiting policy (score range, 0 [worst] to 4 [best]; Supplement 1). Furthermore, the following post hoc tertiary outcomes were evaluated among clinicians: perception of disorganization of care (score range, 0 [never] to 4 [always]) and conflicts with visitors.

Adherence to implementation of flexible visitation was assessed using semistructured interviews with local staff. Each ICU was rated from 0% [worst] to 100% [best] according to the mean of scores obtained in 4 implementation domains (visiting hours, dissemination, structured meeting, and staff training).

Site investigators followed up patients from study enrollment (baseline) to hospital discharge or death, or for a maximum of 30 days. Family members were evaluated using self-applied questionnaires within the first 48 hours after patient enrollment for baseline data and up to 7 days after patient discharge from ICU, death, or a maximum of 30 days for outcome assessment. Clinicians were evaluated using self-administered questionnaires 2 weeks before study initiation for baseline data and during the last 2 weeks of phase 1 for outcome assessment. Outcome assessors were not blinded to study interventions, except for infectious diseases specialists adjudicating infectious outcomes.

Sample Size

Sample size was calculated based on the results of a before-and-after study3 showing an absolute reduction of 10.9% for delirium with flexible visitation. In that study, the incidence of delirium with restricted visitation was 20.5%. A conservative effect size of 6% was used. A sample of 50 patients per ICU across 33 clusters, for a total of 1650 patients, was estimated to achieve a power of 80% and detect an absolute difference of 6.0% or greater in the incidence of delirium between interventions (considering an outcome incidence of 20.5% with restricted visitation), with a 2-sided α level of .05. This calculation was based on 2 levels of intraclass correlation: 0.05 for patients in the same cluster and period and 0.01 for patients in the same cluster, but in different periods. Forty ICUs were enrolled to compensate for potential losses.

Statistical Analysis

Comparisons were performed at the participant level. Data from participants with a recorded outcome were analyzed according to randomization group. ICUs with incomplete patient recruitment were included in primary outcome analyses considering all participants available in the cluster. Missing data for the primary outcome were not imputed, except in sensitivity analyses. Multiple imputation was used for missing values in analyses of HADS, CCFNI, and MBI subscales.

The primary outcome was assessed using generalized estimating equations (GEE) with adjustment for cluster and period effects and for interaction between intervention and period. Prespecified subgroups were defined according to baseline risk of delirium assessed by the Prediction of Delirium in ICU Patients (PRE-DELIRIC)27 score and severity assessed by the Acute Physiology and Chronic Health Evaluation II (APACHE-II)28 score and according to reason for ICU admission (medical vs surgical and neurocritical vs nonneurocritical); consistency of intervention effects on the primary outcome across these subgroups was assessed by means of interaction tests. The daily hazard of delirium was evaluated using a joint model that accounted for the treatment effect on the repeated daily indicator of delirium within each patient and terminating event (death or discharge from the ICU).29 Likelihood ratio testing confirmed that this model satisfied the proportional hazards assumption. The prevalence of burnout was analyzed using GEE with adjustment for cluster effect and baseline MBI total scores. Tertiary clinician outcomes were analyzed using GEE with adjustment for cluster effect. Additional outcomes were assessed using the same model used for the primary outcome.

Prespecified sensitivity analyses for the primary outcome included evaluation of flexible visitation effects on delirium, adjusted for baseline PRE-DELIRIC score and cluster adherence to flexible visitation implementation, and consideration of the potential confounding effect of sedation on delirium diagnosis as well as a best- or worst-plausible-scenario imputation of outcomes among ICUs with incomplete recruitment. Prespecified sensitivity analyses for secondary outcomes were as follows: assessment of flexible visitation effects on family member HADS scores, considering scores as categorical outcomes with relevant cutoff points (>10 points for probable cases of anxiety or depression)24 and adjusting analyses by history of anxiety or depression; assessment of flexible visitation effects on family member CCFNI total and domain scores using the Coen d statistic30 to determine effect size of differences (effect sizes ≤0.2 were considered small; 0.3-0.7, medium; and ≥0.8, large); and assessment of flexible visitation effects on staff burnout, considering alternative MBI criteria.31 Additional post hoc sensitivity and subgroup analyses are described in the eMethods in Supplement 2.

Bonferroni correction was applied to adjust subgroup analyses and secondary outcomes for multiple comparisons. P values and 95% CIs of secondary outcomes were adjusted taking into consideration the number of comparisons within each population of interest (patients [5 comparisons], family members [3 comparisons]). ICU-acquired infections and burnout were not adjusted for multiplicity, to increase the power to detect differences in these adverse event outcomes. Tertiary outcomes and secondary analyses that were not corrected for multiplicity should be interpreted as exploratory.

A 2-sided P value less than .05, adjusted for multiplicity when appropriate, was established as the level of significance for all comparisons. All analyses were performed using R version 3.5.1 (R Development Core Team).

Results
Trial Centers and Participants

A total of 151 ICUs were invited to participate in the trial (Figure 1 and Figure 2). Of these, 40 were enrolled. Four randomized ICUs withdrew consent before study initiation. Therefore, 36 ICUs were analyzed. Because of the slow rate of recruitment, 7 ICUs did not complete the recruitment goal of 50 patients per ICU (3 starting with flexible visitation, 4 starting with restricted visitation). Of these, 2 ICUs did not cross over to phase 2 (1 starting with flexible visitation and 1 starting with restricted visitation).

From April 2017 to June 2018, a total of 5837 patients, 1508 family members, and 959 clinicians were screened (Figure 1 and Figure 2; eTable 2 in Supplement 2). The number of patients excluded because of absence of a family member available to participate in ICU visits was higher in the flexible visitation group (15.5% vs 6.8%). There were no other differences between interventions regarding causes of participant exclusion. A total of 1685 patients, 1295 family members, and 826 clinicians were enrolled. No patients were lost to follow-up, although data for the primary outcome were not available for 9 patients (6 in the flexible visitation group, 3 in the restricted visitation group). Among family members, 235 (18.1%) were lost to follow-up or declined to participate (120 in the flexible visitation group, 115 in the restricted visitation group). Among clinicians, 89 (10.7%) were lost to follow-up or declined to participate (53 in the flexible visitation group, 36 in the restricted visitation group). The characteristics of family members and clinicians who were lost to follow-up or declined to participate did not differ significantly between the flexible visitation and restricted visitation groups (eTable 3 in Supplement 2).

A total of 1685 patients (1676 for the primary outcome analysis), 1060 family members, and 737 clinicians were analyzed. The characteristics of ICUs are summarized in eFigure 2 and eTable 4 in Supplement 2. The baseline characteristics of the participants enrolled in flexible visitation and of those enrolled in restricted visitation were similar (Table 1).

Interventions

The median duration of intervention was 3.2 months for flexible visitation (IQR, 2.4-4.6) and 3.0 months for restricted visitation (IQR, 2.1-3.8) (adjusted difference, 0.2 months [95% CI, −1.0 to 0.5]; P = .85). The mean adherence of ICUs to implementation of flexible visitation was 90% (95% CI, 87% to 92%) (eFigure 3 in Supplement 2). The daily mean duration of visits was significantly higher for flexible visitation than for restricted visitation: 4.8 hours vs 1.4 hours (adjusted difference, 3.4 hours [95% CI, 2.8 to 3.9]; P < .001) (Figure 3). There was no significant difference in the mean number of visitors per day between flexible visitation and restricted visitation (1.9 vs 1.9; adjusted difference, −0.06 [95% CI, −0.29 to 0.17]; P = .63).

Primary and Secondary Outcomes

Results for the primary and secondary study outcomes are summarized in Table 2. There was no significant difference in the primary outcome between the interventions: delirium occurred in 157 of 831 patients (18.9%) in the flexible visitation group and in 170 of 845 patients (20.1%) in the restricted visitation group (risk ratio [RR], 0.91 [95% CI, 0.73 to 1.15]; adjusted difference, −1.7% [95% CI, −6.1% to 2.7%]; P = .44). The results of sensitivity analyses for the primary outcome were similar to those of the main analysis (eTable 5 in Supplement 2). There was no significant heterogeneity in flexible visitation effect on the primary outcome across subgroups of patients (eFigure 4 in Supplement 2). A post hoc analysis showed no association between duration of visits and incidence of delirium (eTable 6 in Supplement 2).

Flexible visitation effects were not significantly different from restricted visitation effects for daily hazard of delirium (0.09 vs 0.10; hazard ratio, 0.88 [95% CI, 0.74 to 1.04]; adjusted difference, −0.02 [95% CI, −0.13 to 0.09]; P = .52), incidence of ICU-acquired infections (3.7% vs 4.5%; RR, 0.81 [95% CI, 0.51 to 1.29]; adjusted difference, −0.8% [95% CI, −2.1% to 1.0%]; P = .38), mean 7-day ventilator-free days (5.9 vs 6.0; adjusted difference, −0.01 days [95% CI, −0.05 to 0.03]; P = .99), median days of ICU stay (5.0 vs 5.0; adjusted difference, −0.02 days [95% CI, −0.15 to 0.09]; P = .99), and hospital mortality (14.8% vs 14.4%; RR, 1.01 [95% CI, 0.77 to 1.32]; adjusted difference, 0.2% [95% CI, −3.7% to 4.0%]; P = .99).

In family members, flexible visitation resulted in significantly better median scores for HADS anxiety (6.0 vs 7.0; adjusted difference, −1.6 points [95% CI, −2.3 to −0.9]; P < .001) and HADS depression (4.0 vs 5.0; adjusted difference, −1.2 points [95% CI, −2.0 to −0.4]; P = .003) and mean scores for CCFNI satisfaction (146.1 vs 132.6; adjusted difference, 13.5 points [95% CI, 10.4 to 16.7]; P < .001), compared with restricted visitation. Sensitivity analyses of the HADS (eTable 7 in Supplement 2) showed that flexible visitation resulted in significantly lower prevalence of probable clinical anxiety (13.4% vs 28.2%; prevalence ratio [PR], 0.48 [95% CI, 0.35 to 0.66]; adjusted difference, −14.6% [95% CI, −20.8% to −8.3%]; P < .001) and depression (8.1% vs 17.7%; PR, 0.46 [95% CI, 0.28 to 0.76]; adjusted difference, −9.5% [95% CI, −15.3% to −3.7%]; P = .001). The adjustment of HADS scores by history of anxiety or depression did not change the results of primary analyses (eTable 7 in Supplement 2).

Sensitivity analyses of CCFNI domains (eTable 8 in Supplement 2) showed significantly better mean scores with flexible visitation than with restricted visitation in proximity (31.5 vs 27.6; adjusted difference, 3.9 points [95% CI, 3.2 to 4.7]; P < .001; effect size, 0.83 [95% CI, 0.70 to 0.96]), information (27.8 vs 25.2; adjusted difference, 2.6 points [95% CI, 1.9 to 3.2]; P < .001; effect size, 0.59 [95% CI, 0.46 to 0.72]), reassurance (25.3 vs 23.5; adjusted difference, 1.7 points [95% CI, 1.1 to 2.3]; P < .001; effect size, 0.50 [95% CI, 0.38 to 0.63]), comfort (19.0 vs 17.4; adjusted difference, 1.5 points [95% CI, 0.9 to 2.1]; P < .001; effect size, 0.42 [95% CI, 0.30 to 0.55]), and support (42.4 vs 38.9; adjusted difference, 3.7 points [95% CI, 2.6 to 4.8]; P < .001; effect size, 0.49 [95% CI, 0.37 to 0.62]).

Post hoc subgroup analysis showed better HADS and CCFNI scores with flexible visitation, both for family members who accessed the website and for those who did not (eTable 9 in Supplement 2).

For ICU staff, the prevalence of burnout did not differ significantly between the flexible visitation and restricted visitation groups (22.0% vs 24.8%; PR, 0.89 [95% CI, 0.70 to 1.14]; adjusted difference, −3.8% [95% CI, −4.8% to 12.5%]; P = .36). Sensitivity analyses considering alternative MBI criteria and incident cases did not change this finding (eTable 10 in Supplement 2). A post hoc subgroup analysis did not find significant differences in the prevalence of burnout between the interventions across subgroups of clinicians (eTable 11 in Supplement 2).

Additional post hoc sensitivity analyses were conducted to assess the consistency of intervention effects on length of visits and primary and secondary outcomes (eTable 12 and eTable 13 in Supplement 2). Adjustment for number of ICU beds did not change the conclusions of the main analyses. Additionally, there was no evidence of interaction between the ICU intervention sequence and the effects of interventions on length of visits and primary and secondary outcomes.

Tertiary Outcomes

There were no significant differences between the interventions in tertiary patient outcomes (Table 3). The mean score of family self-perception of involvement in patient care was significantly higher with flexible visitation than with restricted visitation (13.8 vs 8.4; adjusted difference, 5.3 points [95% CI, 4.1 to 6.4]; P < .001). This result was consistent across multiple domains of patient care, including reorientation, emotional support, helping ICU staff understand patient needs, pain control, and mobilization (eFigure 5 in Supplement 2). For ICU staff, flexible visitation and restricted visitation did not differ significantly regarding the mean score of satisfaction with visiting policy (2.5 vs 2.4; adjusted difference, 0.1 point [95% CI, −0.1 to 0.3]; P = .27), the median score of perceptions regarding disorganization of care (1.0 vs 0; adjusted difference, 0.1 point [95% CI, −0.01 to 0.4]; P = .06), and conflicts with visitors (3.9% vs 4.8%; RR, 0.83 [95% CI, 0.37 to 1.87]; adjusted difference, −0.7% [95% CI, −4.1% to 2.6%]; P = .67).

Discussion

Quiz Ref IDIn this cluster-crossover randomized clinical trial performed in adult ICUs, a flexible family visitation policy supported by family education did not significantly reduce the incidence of delirium among patients compared with standard restricted visitation.

The flexible family visitation model proposed in the present trial was feasible, as reflected by the high adherence of ICUs to implementation. However, although flexible visitation resulted in increased presence of family members at the bedside and in higher perception of involvement in multiple strategies aimed to prevent delirium, such as reorientation, mobilization, and pain control, it was insufficient to prevent delirium.33 This finding contradicts previous before-and-after studies reporting a lower incidence of delirium with flexible visitation models.3,4

Potential explanations were considered for the lack of effect of flexible visitation on delirium. The relatively short duration of implementation of flexible visitation may have mitigated the potential benefits of this intervention. A longer implementation period might have improved the ability of clinicians to engage family members in multicomponent prevention strategies for delirium. Also, the present eligibility criteria excluded a large portion of patients with increased risk for delirium (eg, patients with prolonged coma),33 who could have benefited from delirium prevention.34 Therefore, the study may have missed a smaller difference in delirium than the 6% absolute difference used for sample size calculation.

The findings of this trial concerning infectious outcomes are consistent with those observed in previous studies, which failed to show an association between flexible ICU visiting hours and infectious complications.3,6,35 The present results contradict those of a before-and-after study that detected an increased risk of ICU staff burnout after partial liberalization of visiting hours15 and those of observational studies that showed an increased perception among clinicians of disorganization of care with flexible visitation.13,14 In the present study, the use of an educational strategy targeting visitors may have improved visitor understanding of the ICU environment and perhaps lessened any negative effect of increased duration of visits on ICU routines and staff workload.

Quiz Ref IDThe consistent effect of flexible visitation on family member anxiety and depression symptoms and satisfaction in this trial draws attention to the important role of ICU organization in the prevention of family dissatisfaction and psychological distress. The critical care setting may expose family members to a variety of stressors, such as problems with communication, uncertainty about patient survival or rehabilitation, and lack of support for shared decisions.36 Accordingly, the better family outcomes observed with flexible visitation may have been mediated by better communication, proximity to the patient, reassurance, and support, which is suggested by the better results of flexible visitation in these domains of satisfaction.

The strengths of this trial include assessment of flexible visitation effects from the multiple perspectives needed to comprehensively appraise the intervention and use of strategies to enhance the evaluation of complex interventions, such as a learning period, cluster randomization, and assessment of fidelity of implementation.37

Limitations

This study has several limitations. First, although the study recruited a large number of ICUs, the sample was limited to 1 middle-income country. Therefore, flexible visitation may have different effects across distinct sociocultural contexts. Second, data on the characteristics of ICUs not enrolled in the study, and causes of participant losses to follow-up, were not collected. Third, cluster randomization was susceptible to recruitment bias, since participants were aware of the interventions. Some imbalance in number and causes of participant exclusion and follow-up losses might have resulted from this phenomenon. Nevertheless, baseline characteristics of participants were well balanced. Fourth, although this study used a washout period and sensitivity analyses did not show evidence of significant interaction between intervention effects and sequence of ICU interventions (flexible visitation in phase 1 or restricted visitation in phase 1), the risk of carryover effect still exists. Fifth, the effect of the educational component of the flexible visitation model on family members cannot be isolated from flexible visiting hours. Sixth, this study did not evaluate the effects of flexible visitation on long-term outcomes. The length of clinician follow-up may have been insufficient to properly assess burnout.

Conclusions

Among patients in the ICU, a flexible family visitation policy, vs standard restricted visiting hours, did not significantly reduce the incidence of delirium.

Section Editor: Derek C. Angus, MD, MPH, Associate Editor, JAMA (angusdc@upmc.edu).
Back to top
Article Information

Corresponding Author: Regis Goulart Rosa, MD, PhD, Intensive Care Unit, Hospital Moinhos de Vento, Rua Ramiro Barcelos, 910, 3° andar, Porto Alegre, Rio Grande do Sul 90035-001, Brazil (regis.rosa@hmv.org.br).

Accepted for Publication: June 3, 2019.

Author Contributions: Drs Rosa and Teixeira had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Rosa, Falavigna, da Silva, Sganzerla, Santos, Robinson, Schneider, Jeffman, Cavalcanti, Machado, Azevedo, Salluh, Pellegrini, Moraes, Birriel, Tonietto, Brandão da Silva, Hammes, Giannini, Bozza, Teixeira.

Acquisition, analysis, or interpretation of data: Rosa, Falavigna, da Silva, Sganzerla, Santos, Kochhann, de Moura, Eugênio, Haack, Barbosa, Robinson, Schneider, de Oliveira, Jeffman, Cavalcanti, Azevedo, Pellegrini, Moraes, Foernges, Torelly, Ayres, Duarte, Lovato, Sampaio, de Oliveira Júnior, Paranhos, Dantas, de Brito, Paulo, Gallindo, Pilau, Valentim, Teles, Nobre, Birriel, e Castro, Specht, Medeiros, Tonietto, Mesquita, Brandão da Silva, Korte, Giannini, Teixeira.

Drafting of the manuscript: Rosa, Falavigna, Sganzerla, Santos, Robinson, Schneider, Moraes, Foernges, de Brito, Tonietto, Brandão da Silva, Teixeira.

Critical revision of the manuscript for important intellectual content: Rosa, Falavigna, da Silva, Sganzerla, Santos, Kochhann, de Moura, Eugênio, Haack, Barbosa, Schneider, de Oliveira, Jeffman, Cavalcanti, Machado, Azevedo, Salluh, Pellegrini, Moraes, Torelly, Ayres, Duarte, Lovato, Sampaio, de Oliveira Júnior, Paranhos, Dantas, Paulo, Gallindo, Pilau, Valentim, Teles, Nobre, Birriel, e Castro, Specht, Medeiros, Tonietto, Mesquita, Brandão da Silva, Korte, Hammes, Giannini, Bozza, Teixeira.

Statistical analysis: Rosa, Falavigna, Sganzerla, Schneider, Pellegrini, Brandão da Silva, Korte.

Obtained funding: Rosa, Falavigna, Hammes, Teixeira.

Administrative, technical, or material support: Rosa, da Silva, Sganzerla, Santos, Kochhann, de Moura, Eugênio, Haack, Barbosa, Robinson, Schneider, de Oliveira, Jeffman, Cavalcanti, Pellegrini, Moraes, Foernges, Torelly, Ayres, Duarte, Lovato, de Oliveira Júnior, Paranhos, Dantas, Paulo, Pilau, Valentim, Birriel, e Castro, Specht, Medeiros, Tonietto, Mesquita, Teixeira.

Supervision: Rosa, Falavigna, Sganzerla, Schneider, Salluh, Pellegrini, Foernges, Teles, Nobre, Birriel, Brandão da Silva, Hammes, Bozza, Teixeira.

Conflict of Interest Disclosures: Dr Falavigna reported receiving grants from Associação Hospitalar Moinhos de Vento and receiving other from HTAnalyze Economia e Gestão em Saúde. Dr Eugênio reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Barbosa reported grants from Associação Hospitalar Moinhos de Vento. Dr Pellegrini reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Torelly reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Ayres reported receiving grants from Hospital Moinhos de Vento. Dr Duarte reported receiving grants from SUS/Sistema Único de Saúde—Brazilian Health Ministry. Dr Lovato reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr de Oliveira Júnior reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Paranhos reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Dantas reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Paulo reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Pilau reported receiving grants from Associação Hospitalar Moinhos de Vento. Dr Castro reported receiving grants from Associação Hospitalar Moinhos de Vento. No other disclosures were reported.

Funding/Support: This study was funded by the Brazilian Ministry of Health through the Brazilian Unified Health System Institutional Development Program (PROADI-SUS).

Role of the Funder/Sponsor: The Brazilian Ministry of Health had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Group Information: The ICU Visits Group Investigators:Hospital de Urgência de Rio Branco (state of Acre): Íris de Lima Ferraz Siqueira, Gigliane Maria Angelim de Albuquerque, Edna Lopes Monteiro, Natasha Varjão Volpati, Tatiana Mendes Zerbini Leão. Hospital Geral do Estado Professor Osvaldo Brandão Vilela (Alagoas): Lucia Regina Arana Leite, Jullienne de Albuquerque Estevam, Fabiana Andrea da Silva Moreira, Maria Cleide de Abreu Torres, Larisse Simões Costa, Cristiane Caetano da Silva. Fundação Hospitalar Adriano Jorge (Amazonas): Kalil Emmanuel Oliveira, Alessandra de Sousa Resutto, Francisca Maria Nascimento da Cruz, Arlecy Moraes Do Carmo Martins, Oriana Wilkens Melo. Hospital Geral Clériston Andrade (Bahia): Paulo Henrique Panelli Ferreira, Daniela Cunha de Oliveira, Katia Santana Freitas, Eduardo da Silva Oliveira, João Victor Moraes de Melo, Maurício Gomes da Silva Serra. Santa Casa de Misericórdia de Feira de Santana (Bahia): Deise Freitas Casaes, Ananda Catharina Azevedo Silva, Rosa Maria Rios Santana, Maria Aparecida dos Santos Dantas. Hospital de Urgências de Goiânia (Goiás): Alexandre Amaral, Aline Dias Martins, Ana Paula Menezes, Lilian Siqueira Costa Correia Pádua, Marco Antonio Mendes Castilho Junior, Janaynna Rodrigues Silva, Carla Keit Aparecida Braz, Luciana Mendonça de Carvalho, Júlia de Paula Oliveira. Hospital das Clínicas da Universidade Federal de Minas Gerais (Minas Gerais): Christiane de Freitas Mourão Helt Mantuano Pereira, Ronan de Souza, Ana Carolina de Oliveira Paiva, Thiago Bragança Lana Silveira Ataíde. Santa Casa de Misericórdia de São João Del Rei (Minas Gerais): Adilson de Carvalho Meireles, Leonardo José de Oliveira Santos, Valéria Cristina Lima Coelho, Delmar Camelo de Oliveira, Iany Grinezia da Silva Wierman. Hospital Regional do Baixo Amazonas (Pará): Marden Junio Sousa Ferreira, Alline de Aguiar Cardoso Costa, Rodrigo Pedroso de Lima, Ilticiana Martins da Silva. Hospital Alberto Urquiza Wanderley (Paraíba): Igor Mendonça do Nascimento, Alana Maria Meireles Pereira, Rosilene Linhares de Souza Valentim, Karla Maria Duarte Silva Oliveira, Maria de Fátima Lima Serrano. Hospital Universitário Alcides Carneiro (Paraíba): Amanda Manuella Dantas Nobre, Iago Vieira Gomes, Cristiana Barbosa da Silva Gomes, Milena Késsia Tenório Leopoldino, Andrezza dos Santos Xavier Souto Maior. Hospital Universitário Lauro Wanderley (Paraíba): Lucrécia Maria Bezerra, Ciro Leite Mendes, Adriana Coutinho Leite, Márcia Abath Aires de Barros. Hospital do Câncer de Cascavel (Paraná): Delmiro Becker, Raysa Cristina Schmidt, Lucia Aparecida Daniel Lorencini, Audrey Regina Horochoski, Tatiane Borges da Silva Heidemann. Hospital Universitário do Oeste do Paraná (Paraná): Loide Ferreira Waldow, Renata de Souza Zaponi, Giseli Yumi Hoshino, Amaury Cezar Jorge, Itamar Regazzo Pedreschi Porto. Hospital Agamenom Magalhães (Pernambuco): Claudia Raquel Alcântara Manzi, Marçal Durval Paiva Junior, Marcelo Fiuza Chaves, Deyse Queiroz Nogueira. Hospital Universitário da Universidade Federal do Vale do São Francisco (Pernambuco): Kátia Regina de Oliveira, Maria Luciana Brasil de Lima Souza, Renata de Carvalho Gomes Prates, Saulo Bezerra Xavier. Hospital Universitário da Universidade Federal do Piauí (Piauí): Rejane Martins Prestes, Laís Sousa Santos de Almeida, Francisco Eduardo Viana Brito, Murilo Moura Lima, Francisco Magno Lima Alves, Tágora do Lago Santos, Carla Maria de Castro Dias e Silva, Martha Maria da Silva Batista. Hospital Geral de Nova Iguaçu (Rio de Janeiro): Alexander de Oliveira Sodré, Cid Leite Villela, Letícia Alves Pereira Entrago, Osvaldo Marques Barros da Silva, Thiago Matos Barcellos. Hospital Deoclécio Marques de Lucena (Rio Grande do Norte): Patrícia Manuella Melo de Oliveira Magalhães, Jose André de Anchieta Monteiro, Amanda Cristina Lima do Nascimento. Fundação Saúde Pública de Esteio (Rio Grande do Sul): Luciana Caccavo Miguel, Carolina Karnopp, Patrícia Bonatto, Juana Aracy Trindade Gómez, Cristiane Rolim Novakowski, Helton Lemos dos Reis. Hospital Ana Nery (Rio Grande do Sul): William Rutzen, Ricardo da Silveira Bastos, Clébio Barreto Teixeira, Vanessa Cargnelutti, Cassiele Daiane dos Santos. Hospital da Cidade de Passo Fundo (Rio Grande do Sul): Juliane Disegna Fraporti, Priscila Tonial Foscarini, Elsa Zanette Tallamini. Hospital de Clínicas de Porto Alegre (Rio Grande do Sul): Taís Hochegger, Thais Dos Santos Donato Schmitz, Rita Gigliola Gomes Prieb, Aloma Luz da Silva, Amanda Andrade Forni, Ana Paula Melo Carvalho, Giovana Getelina Ferreira, Letícia Gorski Simões Pires, Maria Renata Pereira dos Santos, Paula Jordana Pereira dos Santos. Hospital Dom Vicente Scherer (Rio Grande do Sul): Edison Moraes Rodrigues Filho, Alexandre Formighieri de Mello, Raquel Hohenreuther, Ruth Susin. Hospital Mãe de Deus (Rio Grande do Sul): Rafael Viegas Cremonese, Priscylla Souza Castro, Fabricia Cristina Hoff, Lilian da Fé Silveira, Eduarda Cristina Martins, Higia Pires Pizzato, Adriana Oliveira Prestes, Fabio Silva da Rosa, Andrea Diez Beck. Hospital Nossa Senhora da Conceição (Rio Grande do Sul): Carla Silva Lincho, Raquel Cristina Lazzari, Sofia Louise Santin Barilli, Wagner Luis Nedel, Henrique Saltz Netto, William Victor Lissa Dalpra. Hospital Montenegro (Rio Grande do Sul): José Pettine, Moreno Calcagnotto dos Santos, Ana Flávia Gallas Leivas, Lourenço Dobrinsky. Hospital Santa Cruz (Rio Grande do Sul): Andreia Schubert Carvalho, Roberta Veleda Rodrigues, Roberto Ritter de Souza, Katiuscia Brandenburg. Hospital Santa Rita (Rio Grande do Sul): Martha Hadrich, Alldren Silva de Souza, Caroline Fachini. Hospital Tacchini (Rio Grande do Sul): Rogério Tregnago, Carla Flores Braga, Juliana Giacomazzi, Samanta da Costa, Danieli Madruga de Souza. Pavilhão Pereira Filho (Rio Grande do Sul): Elisiane Gouveia da Silva, Luana Oliveira da Silva, Clarisa Vargas Xis. Hospital Dona Helena (Santa Catarina): Milton Caldeira Filho, Raquel Souza de Aguiar, Fabiana Efting Mohr, Kethe de Oliveira Souza, Micheli Coral Arruda. Hospital das Clínicas da Faculdade de Medicina de Ribeirão Preto (São Paulo): Rodrigo Barbosa Cerantola, Julia Batista de Carvalho, Maria Aline Sprioli, Janaina de Oliveira Perez, Tania Mara Gomes. Hospital do Coração (São Paulo): Vinícius Avellar Werneck, Rosianne de Vasconcelos, Daniele Penha Dassi, Rafael Trevizoli Neves, Jorge Alcantara Farran.

Meeting Presentation: Presented in part at the 31st European Society of Intensive Care Medicine Congress; October 24, 2018; Paris, France.

Data Sharing Statement: See Supplement 3.

References
1.
Davidson  JE, Aslakson  RA, Long  AC,  et al.  Guidelines for family-centered care in the neonatal, pediatric, and adult ICU.  Crit Care Med. 2017;45(1):103-128. doi:10.1097/CCM.0000000000002169PubMedGoogle ScholarCrossref
2.
 Family visitation in the adult intensive care unit.  Crit Care Nurse. 2016;36(1):e15-e18. doi:10.4037/ccn2016677PubMedGoogle ScholarCrossref
3.
Rosa  RG, Tonietto  TF, da Silva  DB,  et al; ICU Visits Study Group Investigators.  Effectiveness and safety of an extended ICU visitation model for delirium prevention: a before and after study.  Crit Care Med. 2017;45(10):1660-1667. doi:10.1097/CCM.0000000000002588PubMedGoogle ScholarCrossref
4.
Westphal  GA, Moerschberger  MS, Vollmann  DD,  et al.  Effect of a 24-h extended visiting policy on delirium in critically ill patients.  Intensive Care Med. 2018;44(6):968-970. doi:10.1007/s00134-018-5153-5PubMedGoogle ScholarCrossref
5.
Nassar Junior  AP, Besen  BAMP, Robinson  CC, Falavigna  M, Teixeira  C, Rosa  RG.  Flexible versus restrictive visiting policies in ICUs: a systematic review and meta-analysis.  Crit Care Med. 2018;46(7):1175-1180. doi:10.1097/CCM.0000000000003155PubMedGoogle ScholarCrossref
6.
Fumagalli  S, Boncinelli  L, Lo Nostro  A,  et al.  Reduced cardiocirculatory complications with unrestrictive visiting policy in an intensive care unit: results from a pilot, randomized trial.  Circulation. 2006;113(7):946-952. doi:10.1161/CIRCULATIONAHA.105.572537PubMedGoogle ScholarCrossref
7.
Kleinpell  R, Heyland  DK, Lipman  J,  et al; Council of the World Federation of Societies of Intensive and Critical Care Medicine.  Patient and family engagement in the ICU: report from the task force of the World Federation of Societies of Intensive and Critical Care Medicine.  J Crit Care. 2018;48:251-256. doi:10.1016/j.jcrc.2018.09.006PubMedGoogle ScholarCrossref
8.
Liu  V, Read  JL, Scruth  E, Cheng  E.  Visitation policies and practices in US ICUs.  Crit Care. 2013;17(2):R71. doi:10.1186/cc12677PubMedGoogle ScholarCrossref
9.
Garrouste-Orgeas  M, Vinatier  I, Tabah  A, Misset  B, Timsit  JF.  Reappraisal of visiting policies and procedures of patient’s family information in 188 French ICUs: a report of the Outcomerea Research Group.  Ann Intensive Care. 2016;6(1):82. doi:10.1186/s13613-016-0185-xPubMedGoogle ScholarCrossref
10.
Hunter  JD, Goddard  C, Rothwell  M, Ketharaju  S, Cooper  H.  A survey of intensive care unit visiting policies in the United Kingdom.  Anaesthesia. 2010;65(11):1101-1105. doi:10.1111/j.1365-2044.2010.06506.xPubMedGoogle ScholarCrossref
11.
Giannini  A, Miccinesi  G, Leoncino  S.  Visiting policies in Italian intensive care units: a nationwide survey.  Intensive Care Med. 2008;34(7):1256-1262. doi:10.1007/s00134-008-1037-4PubMedGoogle ScholarCrossref
12.
Ramos  FJ, Fumis  RR, de Azevedo  LC, Schettino  G.  Intensive care unit visitation policies in Brazil: a multicenter survey.  Rev Bras Ter Intensiva. 2014;26(4):339-346. doi:10.5935/0103-507X.20140052PubMedGoogle ScholarCrossref
13.
da Silva Ramos  FJ, Fumis  RR, Azevedo  LC, Schettino  G.  Perceptions of an open visitation policy by intensive care unit workers.  Ann Intensive Care. 2013;3(1):34. doi:10.1186/2110-5820-3-34PubMedGoogle ScholarCrossref
14.
Garrouste-Orgeas  M, Philippart  F, Timsit  JF,  et al.  Perceptions of a 24-hour visiting policy in the intensive care unit.  Crit Care Med. 2008;36(1):30-35. doi:10.1097/01.CCM.0000295310.29099.F8PubMedGoogle ScholarCrossref
15.
Giannini  A, Miccinesi  G, Prandi  E, Buzzoni  C, Borreani  C, ODIN Study Group.  Partial liberalization of visiting policies and ICU staff: a before-and-after study.  Intensive Care Med. 2013;39(12):2180-2187. doi:10.1007/s00134-013-3087-5PubMedGoogle ScholarCrossref
16.
Rosa  RG, Falavigna  M, Robinson  CC,  et al; ICU Visits Study Group Investigators and the BRICNet.  Study protocol to assess the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units: a cluster-randomised, crossover trial (the ICU Visits Study).  BMJ Open. 2018;8(4):e021193. doi:10.1136/bmjopen-2017-021193PubMedGoogle ScholarCrossref
17.
Sganzerla  D, Teixeira  C, Robinson  CC,  et al.  Statistical analysis plan for a cluster-randomized crossover trial comparing the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units (the ICU Visits Study).  Trials. 2018;19(1):636. doi:10.1186/s13063-018-3006-8PubMedGoogle ScholarCrossref
18.
Brazilian Ministry of Health, National Health Surveillance Agency. Resolution RDC No. 7 of 24 February 2010: provides for the minimum requirements for the operation of intensive care units and presents other providences. Brazilian Ministry of Health website. http://bvsms.saude.gov.br/bvs/saudelegis/anvisa/2010/res0007_24_02_2010.html. Published 2010. Accessed November 27, 2017.
19.
Ely  EW, Truman  B, Shintani  A,  et al.  Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS).  JAMA. 2003;289(22):2983-2991. doi:10.1001/jama.289.22.2983PubMedGoogle ScholarCrossref
20.
Ely  EW, Margolin  R, Francis  J,  et al.  Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU).  Crit Care Med. 2001;29(7):1370-1379. doi:10.1097/00003246-200107000-00012PubMedGoogle ScholarCrossref
21.
Centers for Disease Control and Prevention (CDC). Pneumonia (Ventilator-Associated [VAP] and Non-Ventilator-Associated Pneumonia [PNEU]) Event. CDC website. https://www.cdc.gov/nhsn/pdfs/pscmanual/6pscvapcurrent.pdf. Published 2019. Accessed June 6, 2019.
22.
Centers for Disease Control and Prevention (CDC). Bloodstream Infection Event (Central Line-Associated Bloodstream Infection and Non-Central Line Associated Bloodstream Infection). CDC website. https://www.cdc.gov/nhsn/pdfs/pscmanual/4psc_clabscurrent.pdf. Published 2019. Accessed June 6, 2019.
23.
Centers for Disease Control and Prevention (CDC). Urinary Tract Infection (Catheter-Associated Urinary Tract Infection [CAUTI] and Non-Catheter-Associated Urinary Tract Infection [UTI]) and Other Urinary System Infection [USI]) Events. CDC website. https://www.cdc.gov/nhsn/pdfs/pscManual/7pscCauticurrent.pdf. Published 2019. Accessed June 6, 2019.
24.
Zigmond  AS, Snaith  RP.  The hospital anxiety and depression scale.  Acta Psychiatr Scand. 1983;67(6):361-370. doi:10.1111/j.1600-0447.1983.tb09716.xPubMedGoogle ScholarCrossref
25.
Morgon  FH, Guirardello  EdeB.  Validation of a ratio scale for family needs at an intensive care unit  [in Portugese].  Rev Lat Am Enfermagem. 2004;12(2):198-203. doi:10.1590/S0104-11692004000200008PubMedGoogle ScholarCrossref
26.
Maslach  C, Jackson  SE, Leiter  MP.  Maslach Burnout Inventory Manual. 3rd ed. Palo Alto, CA: Consulting Psychologists Press; 1996.
27.
van den Boogaard  M, Pickkers  P, Slooter  AJ,  et al.  Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study.  BMJ. 2012;344:e420. doi:10.1136/bmj.e420PubMedGoogle ScholarCrossref
28.
Knaus  WA, Draper  EA, Wagner  DP, Zimmerman  JE.  APACHE II: a severity of disease classification system.  Crit Care Med. 1985;13(10):818-829. doi:10.1097/00003246-198510000-00009PubMedGoogle ScholarCrossref
29.
Colantuoni  E, Dinglas  VD, Ely  EW, Hopkins  RO, Needham  DM.  Statistical methods for evaluating delirium in the ICU.  Lancet Respir Med. 2016;4(7):534-536. doi:10.1016/S2213-2600(16)30138-2PubMedGoogle ScholarCrossref
30.
Livingston  EH, Elliot  A, Hynan  L, Cao  J.  Effect size estimation: a necessary component of statistical analysis.  Arch Surg. 2009;144(8):706-712. doi:10.1001/archsurg.2009.150PubMedGoogle ScholarCrossref
31.
Doulougeri  K, Georganta  K, Montgomery  A.  “Diagnosing” burnout among healthcare professionals: can we find consensus?  Cogent Med. 2016;3(1):1. doi:10.1080/2331205X.2016.1237605Google ScholarCrossref
32.
Puhan  MA, Frey  M, Büchi  S, Schünemann  HJ.  The minimal important difference of the hospital anxiety and depression scale in patients with chronic obstructive pulmonary disease.  Health Qual Life Outcomes. 2008;6:46. doi:10.1186/1477-7525-6-46PubMedGoogle ScholarCrossref
33.
Devlin  JW, Skrobik  Y, Gélinas  C,  et al.  Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU.  Crit Care Med. 2018;46(9):e825-e873. doi:10.1097/CCM.0000000000003299PubMedGoogle ScholarCrossref
34.
Van Rompaey  B, Elseviers  MM, Schuurmans  MJ, Shortridge-Baggett  LM, Truijen  S, Bossaert  L.  Risk factors for delirium in intensive care patients: a prospective cohort study.  Crit Care. 2009;13(3):R77. doi:10.1186/cc7892PubMedGoogle ScholarCrossref
35.
Malacarne  P, Corini  M, Petri  D.  Health care-associated infections and visiting policy in an intensive care unit.  Am J Infect Control. 2011;39(10):898-900. doi:10.1016/j.ajic.2011.02.018PubMedGoogle ScholarCrossref
36.
Schmidt  M, Azoulay  E.  Having a loved one in the ICU: the forgotten family.  Curr Opin Crit Care. 2012;18(5):540-547. doi:10.1097/MCC.0b013e328357f141PubMedGoogle ScholarCrossref
37.
Moore  GF, Audrey  S, Barker  M,  et al.  Process evaluation of complex interventions: Medical Research Council guidance.  BMJ. 2015;350:h1258. doi:10.1136/bmj.h1258PubMedGoogle ScholarCrossref
×