The established 2-step, prospective, systematic surveillance methodology currently considered highest yield for detecting errors and AEs in safety surveillance research.5,14,15 Notably, patients and families are absent from this process. Our study integrated family safety reports into the first step of this process.
Sources of medical errors as validated through 2-step methodology (research clinician review followed by review by 2 physicians) across all 4 sites. Additional sources of medical errors included observation (eg, by study nurse while on unit; n = 12) and other (n = 8). Additional sources of AEs included observation (n = 7) and other (n = 4).
aCategories are not mutually exclusive, so numbers do not sum to 179 errors and 113 AEs.
bThere were 0 unique medical errors reported through hospital incident reports.
eFigure. Cohort diagram.
eTable 1. Unadjusted rates of family-reported errors/AEs by patient and parent/caregiver characteristicsa.
eTable 2. Adjusted predictors of family-reported errors/AEs.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Khan A, Coffey M, Litterer KP, et al. Families as Partners in Hospital Error and Adverse Event Surveillance. JAMA Pediatr. 2017;171(4):372–381. doi:10.1001/jamapediatrics.2016.4812
How do rates of family-reported errors and adverse events (AEs) compare with those detected by other sources of hospital safety reporting that do not typically include families?
In this cohort study including 746 parents/caregivers of 989 hospitalized pediatric patients, families reported similar rates of errors and AEs as clinicians, and families reported 5-fold more errors and 3-fold more AEs than hospital incident reports. Including families in prospective systematic surveillance increased overall error detection rates by 16% and AE detection rates by 10%.
Families provide unique safety information and have the potential to be valuable partners in safety surveillance conducted by both hospitals and researchers.
Medical errors and adverse events (AEs) are common among hospitalized children. While clinician reports are the foundation of operational hospital safety surveillance and a key component of multifaceted research surveillance, patient and family reports are not routinely gathered. We hypothesized that a novel family-reporting mechanism would improve incident detection.
To compare error and AE rates (1) gathered systematically with vs without family reporting, (2) reported by families vs clinicians, and (3) reported by families vs hospital incident reports.
Design, Setting, and Participants
We conducted a prospective cohort study including the parents/caregivers of 989 hospitalized patients 17 years and younger (total 3902 patient-days) and their clinicians from December 2014 to July 2015 in 4 US pediatric centers. Clinician abstractors identified potential errors and AEs by reviewing medical records, hospital incident reports, and clinician reports as well as weekly and discharge Family Safety Interviews (FSIs). Two physicians reviewed and independently categorized all incidents, rating severity and preventability (agreement, 68%-90%; κ, 0.50-0.68). Discordant categorizations were reconciled. Rates were generated using Poisson regression estimated via generalized estimating equations to account for repeated measures on the same patient.
Main Outcomes and Measures
Error and AE rates.
Overall, 746 parents/caregivers consented for the study. Of these, 717 completed FSIs. Their median (interquartile range) age was 32.5 (26-40) years; 380 (53.0%) were nonwhite, 566 (78.9%) were female, 603 (84.1%) were English speaking, and 380 (53.0%) had attended college. Of 717 parents/caregivers completing FSIs, 185 (25.8%) reported a total of 255 incidents, which were classified as 132 safety concerns (51.8%), 102 nonsafety-related quality concerns (40.0%), and 21 other concerns (8.2%). These included 22 preventable AEs (8.6%), 17 nonharmful medical errors (6.7%), and 11 nonpreventable AEs (4.3%) on the study unit. In total, 179 errors and 113 AEs were identified from all sources. Family reports included 8 otherwise unidentified AEs, including 7 preventable AEs. Error rates with family reporting (45.9 per 1000 patient-days) were 1.2-fold (95% CI, 1.1-1.2) higher than rates without family reporting (39.7 per 1000 patient-days). Adverse event rates with family reporting (28.7 per 1000 patient-days) were 1.1-fold (95% CI, 1.0-1.2; P = .006) higher than rates without (26.1 per 1000 patient-days). Families and clinicians reported similar rates of errors (10.0 vs 12.8 per 1000 patient-days; relative rate, 0.8; 95% CI, .5-1.2) and AEs (8.5 vs 6.2 per 1000 patient-days; relative rate, 1.4; 95% CI, 0.8-2.2). Family-reported error rates were 5.0-fold (95% CI, 1.9-13.0) higher and AE rates 2.9-fold (95% CI, 1.2-6.7) higher than hospital incident report rates.
Conclusions and Relevance
Families provide unique information about hospital safety and should be included in hospital safety surveillance in order to facilitate better design and assessment of interventions to improve safety.
Between 44 000 and 440 000 patients are estimated to die yearly in the United States due to medical errors,1-4 making medical errors a leading cause of death. Detecting medical errors is important for identifying causative factors and measuring the effectiveness of prevention strategies. Error detection methodologies have greatly advanced over the past few decades.5-7 However, implementation of error detection, or safety surveillance, varies across hospitals.
Hospital incident reports, which are voluntary and suffer from underreporting, are commonly used but only capture a small subset of errors and adverse events (AEs), ie, harms due to medical care.8-12 Trigger tools are higher yield and becoming more sophisticated at identifying events but are not yet widely used.13 Prospective systematic surveillance, in which trained research staff conduct daily reviews of patient medical records (Figure 1), is the most effective way to measure errors but is expensive and typically limited to research settings.5,14,15
Patients and families are absent both from hospital incident reports and systematic surveillance. Limited adult studies suggest that patients are a fruitful source of safety surveillance.16,17 Small, single-center pediatric studies suggest similar findings; however, the role of patients and families in pediatric safety reporting has not been widely examined.18-20 Additionally, to our knowledge, a rigorous patient and family error-reporting methodology has not been developed or operationalized.
We sought to fill these gaps by developing a family error-reporting methodology and testing its utility and effectiveness in systematic safety surveillance across 4 US pediatric hospitals. We hypothesized that families would report errors and AEs not discovered by other methods and that adding a family reporting mechanism to systematic surveillance methodology would increase error and AE detection. If these hypotheses are correct, then adding families to safety surveillance systems would provide an important new way to detect errors, identify their causes, and measure the effectiveness of efforts to prevent them.
We conducted a prospective cohort study in 4 pediatric hospitals. Data were collected from December 2014 to July 2015 coincident with data collection for the Patient and Family Centered I-PASS Study, an ongoing multicenter investigation of clinician-family communication and safety built on prior communication and safety research.21
Study participants included parents/guardians or caregivers (eg, grandparents living in the home) and clinicians (resident-physicians and nurses) of 989 hospitalized medical patients 17 years and younger on inpatient general pediatric and subspecialty units. We obtained written informed consent from clinicians, verbal consent using an information sheet from parents/caregivers, and a waiver of informed consent to review patient records. The Boston Children’s Hospital Institutional Review Board and each participating institution’s institutional review board approved the study.
Given limited translation and interpretation resources, we included parents/caregivers speaking English, Spanish, Arabic, Chinese, or Russian (the most commonly spoken languages across study sites).
We developed the Family Safety Interview (FSI) using a modified Delphi method with input from experts in survey methodology, patient safety, and health literacy, as well as family partners. Draft versions of the FSI were pilot tested through cognitive interviews with parents/caregivers at Boston Children’s Hospital.
To orient families to types of information to report, the FSI began with descriptions, definitions, and examples of safety events related to medications, miscommunications, diagnoses, delays in care, complications of care, and equipment. Using closed-ended and open-ended questions, it then asked parents/caregivers to indicate whether the child’s illness worsened or almost worsened because (1) of medical care (ie, an AE), (2) something was not done that should have been (ie, a preventable AE due to an error of omission), or (3) something was done that should not have been (ie, a preventable AE due to an error of commission). It also asked if a mistake occurred that did not result in harm (ie, a nonharmful error) and whether anything else happened or almost happened that was upsetting or could have harmed the child.
Research assistants administered this semistructured interview to parents/caregivers of eligible patients every 7 days while hospitalized and before discharge. Interviews typically lasted 3 to 5 minutes when no concerns were reported and 10 to 15 minutes when concerns were reported. Research clinicians (nurses or physicians) then classified family responses as safety concerns (ie, potential errors and AEs), nonsafety-related quality concerns (eg, an unpleasant interaction with a physician), or other concerns (eg, a difficult intravenous placement). Off-unit (eg, emergency department) safety concerns were subsequently excluded from analyses.
Clinician event reporting was conducted by modifying an instrument used in previous studies.21,22 This less-than-1-minute survey asked respondents to describe errors and AEs or procedures, medications, fluids, or other therapies that were unnecessary or questionably beneficial, delayed, involved in an error or AE, or ordered erroneously but intercepted before reaching the patient (near-misses). They also asked about resident or nurse sign-out omissions or inaccuracies leading to problems with patient care. Every weekday morning, research clinicians administered the survey (verbally or on paper) to outgoing overnight residents. Surveys were also posted on the study units to allow unit staff, particularly nurses, not enrolled in the study to voluntarily report anonymously.
To identify potential errors and AEs, research clinicians conducted systematic surveillance using a validated methodology21-26 (ie, daily review of all study-unit patients’ medical records, hospital incident reports, and clinician event reporting surveys) (Figure 1). These data were supplemented with incidents collected during FSIs. For potential errors and AEs, research clinicians recorded reporting source(s) (ie, family, clinician, observation by study personnel, or other), preceding events, patient outcomes, harm level (using modified National Coordinating Council for Medication Error Reporting and Prevention categorization27), preventability (if harmful), error category, and follow-up actions.
To validate and categorize events, physician reviewer pairs independently reviewed all research clinician–collected events (including those obtained from FSIs) as AEs (ie, harms), nonharmful errors, or exclusions (preconsensus agreement, 67.6%; κ, 0.50). Physician raters additionally assessed AEs for harm level27 (preconsensus agreement, 89.5%; κ, 0.68) and preventability (preconsensus agreement, 83.7%; κ, 0.60). Physician reviewer pairs reconciled discordant categorizations through consensus.
We collected clinician and parent/caregiver demographic information through surveys. We obtained patient clinical and sociodemographic characteristics data from hospital administrative data.
Our primary outcome was overall medical error and AE rates per 1000 patient-days (days hospitalized on the study unit) both including and excluding family reporting (ie, FSI data). We also analyzed error and AE rates per 100 admissions. We secondarily analyzed error and AE rates reported by families vs clinicians and by families vs hospital incident reports. We identified the following a priori variables as potential predictors of family reporting: patient age, sex, race/ethnicity, insurance, complex chronic conditions (CCCs, a marker of medical complexity according to International Classification of Diseases, Ninth Revision, Clinical Modification28), and parent/caregiver age, sex, race/ethnicity, language, education, and household income.
To compare error and AE rates (overall with vs without family data, family vs clinician, and family vs hospital incident report), we used Poisson regression estimated via generalized estimating equations to account for correlation arising from collecting parent/caregiver, clinician, and hospital incident reports on the same patient. All 989 sample patients were used for the overall and family vs clinician analyses. The family vs hospital incident report analysis only included the 3 sites with available hospital incident report data.
In unadjusted and adjusted analyses, we compared family-reported error and AE rates per 1000 patient-days using bias-corrected Poisson regression, which has better statistical properties than usual Poisson regression when the total number of events is not large.29,30 A priori parent/caregiver-level and patient-level predictors of interest that were significant (P < .05) in unadjusted analyses were fit in an adjusted model. The final adjusted model only included predictors with P < .05. Site effects were considered as fixed effects in the adjusted model. For consistency, final adjusted models for errors and AEs contained the same predictors.
Unadjusted and adjusted analyses included only the 717 patients whose parents/caregivers completed FSIs, which we refer to as a complete-case analysis. Because FSIs were not completed for all study-unit patients, we compared patient characteristics among those with and without completed FSIs. Additionally, we conducted a sensitivity analysis using a reweighted estimating equation missing data approach to determine if complete-cases produced biased results. In the reweighted estimating equations approach, we fit a logistic regression model to determine predictors of a parent/caregiver completing an interview (using all nonmissing variables). Then, complete-cases were reweighted by the inverse probability of a parent/caregiver completing an interview. Thus, patients whose parents/caregivers completed interviews despite being less likely to complete them were up-weighted to account for those similar parents/caregivers who did not complete interviews.31,32 We used REDcap33 to collect and manage study data and SAS version 9.3 (SAS Institute) for analyses.
Of 1024 patients on the study units, 989 met study criteria (eFigure in the Supplement). Parents/caregivers of 782 eligible patients (79.1%) were available and therefore approached. Most parents/caregivers (746 [95.4%]) who were approached consented for the study. Of these, 717 parents/caregivers completed 763 interviews (35 parents/caregivers completed more than 1 interview). Among clinicians, 146 nurses (98.6%) and 207 resident-physicians (95.4%) consented for the study. A total of 717 of 782 eligible parents/caregivers (91.7%) completed FSIs. Overall, 77 residents completed a total of 284 of 327 (86.9%) solicited postshift event reporting surveys, with residents completing 0-11 surveys each.
Patient, parent/caregiver, and clinician demographic data are reported in Table 1. Patients and parents/caregivers were from varied racial/ethnic and socioeconomic backgrounds. Overall, 243 of 989 patients (24.6%) had 1 or more CCCs. Patients without completed FSIs (primarily because parents/caregivers were not present) were similar to patients with completed FSIs in terms of age, CCCs, race/ethnicity, insurance, and error and AE rates. Patient sex was the only statistically significant difference between these 2 groups.
We found a total of 179 errors and 113 AEs on our study units through all sources. Families reported 39 of 179 total errors (21.8%; 19 [10.6%] uniquely and 20 [11.2%] in combination with another source) and 33 of 113 total AEs (29.2%; 8 [7.1%] uniquely and 25 [22.1%] in combination with another source) (Figure 2).
Overall, 185 parents/caregivers (25.8%) reported 255 total incidents, of which we classified 132 (51.8%) as safety concerns, 102 (40.0%) as nonsafety-related quality concerns, and 21 (8.2%) as other concerns. Of reported safety concerns, 35 occurred off-unit and were excluded from further analyses; 97 (73.5%) occurred on-unit. On 2-step review, 50 family-reported on-unit errors and/or AEs were confirmed, including 22 preventable AEs, 17 nonharmful medical errors, and 11 nonpreventable AEs.
Family reports included 8 otherwise unidentified AEs, including 7 preventable AEs. Unique family-reported AEs included multiple needle sticks, inadequate suctioning, and adverse effects from medication (Table 2). Of 39 validated family-reported errors (ie, preventable AEs and nonharmful errors), 20 were also detected through research clinician medical record review, 3 through resident report, 2 through nurse report, and 1 through hospital incident report. Of 33 validated family-reported AEs, 25 were also detected through medical record review, 3 through nurse report, 2 through resident report, and 2 through hospital incident report.
Family-reported AEs most commonly involved temporary patient harm requiring intervention (28 [84.9%]) or prolonging hospitalization (5 [15.2%]). Both family-reported and nonfamily-reported errors and AEs were primarily medication related.
Overall error rates with family reporting were 15.5% (95% CI, 9.0%-22.3%) higher than without. Overall AE rates with family reporting were 9.8% (95% CI, 3.1%-16.9%) higher than without (Table 3).
Family-reported error rates were equivalent to clinician-reported rates (relative rate [RR], 0.8; 95% CI, 0.5-1.2). Family-reported AE rates were also equivalent to clinician-reported rates (RR, 1.4; 95% CI, 0.8-2.2) (Table 4).
Among the 3 sites with available hospital incident report data, of 111 errors detected through all sources, hospital incident reports detected 5 errors (4.5%) and family reports detected 25 errors (22.5%). Of 71 AEs detected through all sources, hospital incident reports detected 7 AEs (9.9%) and family reports detected 20 AEs (28.2%).
Family-reported error rates were 5.0-fold (95% CI, 1.9-13.0) higher than hospital incident report rates across these sites. Family-reported AE rates were 2.9-fold (95% CI, 1.2-6.7) higher than hospital incident report rates (Table 5).
Results of the weighted estimated approach accounting for missing data were similar to unweighted results; for simplicity, we report only unweighted results. Unadjusted predictors of family-reported errors included patient age, 1 or more CCCs, parent/caregiver proficiency in written and spoken English, and higher parent/caregiver education (eTable 1 in the Supplement). Adjusted predictors of family-reported errors included younger patient age (RR, 0.9 per 1-year increment; 95% CI, 0.9-1.0), 1 or more CCCs (RR, 2.4; 95% CI, 1.2-4.8), older parent/caregiver age (RR, 1.0; 95% CI, 1.0-1.1), and higher parent/caregiver education (less than high school vs college education: RR, 0.2; 95% CI, 0.1-0.3) (eTable 2 in the Supplement).
Unadjusted predictors of family-reported AEs include 1 or more CCCs, higher parent/caregiver education, and greater family presence during hospitalization. Adjusted predictors of family-reported AEs included 1 or more CCCs (RR, 2.3; 95% CI, 1.1-4.8) and higher parent/caregiver education (less than high school vs college education: RR, 0.3; 95% CI, 0.2-0.4).
In a study of 4 US hospitals, solicited family reporting yielded 5-fold more errors and 3-fold more AEs than the voluntary hospital incident reports that most hospitals use as their primary patient safety surveillance tool. Additionally, we found that family reporting substantively enhanced rigorous multifaceted patient safety surveillance methods, with families reporting patient safety incidents that were not otherwise detected. Our finding that family reporting increased overall error detection by 16% and AE detection by 10%—compared with what is typically considered the highest-yield methodology in safety surveillance research—supports our hypothesis that including families in safety surveillance improves safety detection. This represents an important patient safety innovation. By including families in safety reporting, we can identify otherwise unrecognized errors and AEs, providing new opportunities to prevent them from occurring.
Our study’s family-reported error and AE rates are far higher than rates detected through clinician-only, voluntary hospital incident reports, which typically only detect 1% to 14% of AEs.8,14 We similarly found that hospital incident reports only captured 5% of errors and 10% of AEs. In contrast, our family-reporting methodology was much higher yield, detecting 22% of errors and 29% of AEs. This may be because families are available to provide patient safety information and may in fact have more opportunity to provide such reports than clinicians, who might be prevented from reporting by competing time demands.34,35 We additionally found that 49% of family-reported errors and 24% of family-reported AEs were not present in the medical record, consistent with prior studies.14,16-18
Based on other studies, patient and family safety-reporting rates are variable and appear related to mode of reporting. The percentage of families in our study reporting incidents (26%) was approximately 3-fold higher than in our prior single-center study (9%),18 in which we used written family discharge experience surveys (vs the active semistructured family interviews used in our current study). Additionally, our current study’s reporting rate is more than 600-fold higher than that of a voluntary prototype consumer-reporting hotline that was tested with funding from the Agency for Healthcare Research and Quality in 2 hospital institutions in a single state and administered via the web and telephone (0.04%; Denise Quigley, PhD, email communication, June 2016).36
Prior studies using active patient and family reporting similarly found that 23% to 49% of patients and families reported safety concerns.16,17,19 These studies used various methods, including postdischarge patient telephone interviews,16 computer-based safety-reporting parent discharge surveys,17 and in-person patient/caregiver interviews 2 to 3 times per week.19 An important difference between our study and these is that we subsequently validated family safety reporting using a rigorous 2-step methodology. Our validation step represents an important advance in medical error and AE reporting methodology.
Further research is needed to determine the best process for operationalizing patient and family reporting in hospitals and to assess its feasibility, success, and safety implications. While less intensive than systematic surveillance, gathering patient and family safety reports requires hospital personnel time and effort. Time and effort may vary depending on whether postdischarge interviews or in-hospital surveys are used, for instance. Further research is required to compare and weigh yield and costs of different approaches. While we employed research assistants for this purpose in our study, it is plausible that, if they felt it worthwhile, hospitals might use existing quality improvement staff to administer family safety surveys or interviews. Hospitals might additionally consider incorporating safety reporting into their existing family surveys, thereby leveraging existing resources, although the sensitivity of this approach would need to be further evaluated.
The effects of patient and family safety reporting on outcomes, such as malpractice risk, parent experience, and subsequent hospital improvement efforts, are unknown. Research suggests that disclosing errors of which patients are unaware does not lead to more malpractice cases.37-40 It seems unlikely that gathering patient and family reports of errors of which patients are already aware would increase malpractice risk. Moreover, engaging patients and families may drive hospitals to bridge the gap between safety reporting and improvement. Involving patients and families may increase transparency and accountability of safety reporting and thereby address criticisms that safety reports are not consistently acted on.41
Given our finding that families of children with 1 or more CCCs were more likely to report errors and AEs, actively partnering with families of patients with CCCs may be a high-yield approach to detecting and perhaps preventing medical errors and AEs. Patients with CCCs experience higher rates of errors and AEs owing to increased illness complexity and length of stay.17,18,42,43 Their families may also be more activated or better understand the medical system,44 making them particularly high-yield reporters. However, it is also important for hospitals to make concerted efforts to actively engage all families in safety reporting and, in particular, to engage less educated and other vulnerable populations.
Our study had several limitations. We included patients from general pediatric and subspecialty services, not surgical services, at 4 hospitals. Therefore, our reporting rates may not be generalizable to all hospitals or services. However, family and caregiver reporting may be broadly applicable to other patient populations (eg, adult, surgical, and geriatric). Although we used a rigorous methodology using a well-established 2-step review process with kappas similar to or higher than prior studies,21 rating errors and AEs is complex. Additionally, families reported a number of off-unit (eg, emergency department) safety concerns beyond our study’s scope to further investigate. Our rates of validated family-reported errors and AEs may have been even higher had we done so.
We developed and studied a novel family-reporting methodology that suggests families may be useful partners in hospital safety reporting. They report events not otherwise detected or documented, including preventable AEs. Family reporting increases error and AE rates detected through voluntary hospital incident reporting systems used by most hospitals and systematic safety surveillance used in research—both of which typically exclude patients and families. Actively surveying families about safety may be a fruitful way to gather errors and AEs—for both hospital safety improvement and research.
Corresponding Author: Alisa Khan, MD, MPH, Division of General Pediatrics, Department of Medicine, Boston Children’s Hospital, 21 Autumn St, 200.2, Boston, MA 02215 (email@example.com).
Accepted for Publication: December 5, 2016.
Correction: This article was corrected on January 8, 2018, to fix Rebecca L. Blankenburg’s name.
Published Online: February 27, 2017. doi:10.1001/jamapediatrics.2016.4812
The Patient and Family Centered I-PASS Study Group, in addition to the listed authors, includes the following individuals: Brenda K. Allair, BA, MEd; Claire Alminde, MSN, RN; Wilma Alvarado-Little, MA, MSW; Marisa Atsatt, MS; Megan E. Aylor, MD; James F. Bale Jr, MD; Dorene Balmer, PhD; Kevin T. Barton, MD; Carolyn Beck, MD, FRCPC; Zia Bismilla, MD, FRCPC, MEd; Rebecca L. Blankenburg, MD, MPH; Debra Chandler, RN; Amanda Choudhary, MHA; Eileen Christensen, BA; Sally Coghlan-McDonald, JD; F. Sessions Cole, MD; Elizabeth Corless, RN; Sharon Cray, BBA; Roxi Da Silva, MSN, RN; Devesh Dahale, BS, MSc; Benard Dreyer, MD; Amanda S. Growdon, MD; LeAnn Gubler, RN; Amy Guiot, MD, MEd; Roben Harris; Helen Haskell, MA; Irene Kocolas, MD, MS; Elizabeth Kruvand, BS; Michele Marie Lane, RN; Kathleen Langrish, RN, MN; Christy J. W. Ledford, PhD; Kheyandra Lewis, MD; Joseph O. Lopreiato, MD, MPH; Christopher G. Maloney, MD, PhD; Amanda Mangan, RN; Peggy Markle, BA; Fernando Mendoza, MD; Dale Ann Micalizzi, AAS; Vineeta Mittal, MD, MBA; Maria Obermeyer, RN; Katherine A. O’Donnell, MD; Mary Ottolini, MD, MPH; Shilpa J. Patel, MD; Rita Pickler, PhD, RN; Jayne Elizabeth Rogers, MSN, RN, NEA-BC; Lee M. Sanders, MD; Kimberly Sauder, RN; Samir S. Shah, MD, MSCE; Meesha Sharma, MD, MPH; Arabella Simpkin, BMBCh, MMSc; Anupama Subramony, MD, MBA; E. Douglas Thompson Jr, MD; Laura Trueman, RN; Tanner Trujillo, MHA; Michael P. Turmelle, MD; Cindy Warnick, BS; Chelsea Welch, BS; Andrew J. White, MD; Matthew F. Wien, BS; Ariel S. Winn, MD; Stephanie Wintch, RN; Michael Wolf, PhD, MPH; H. Shonna Yin, MD, MS; Clifton E. Yu, MD.
Affiliations of The Patient and Family Centered I-PASS Study Group: Boston Children’s Hospital, Boston, Massachusetts (Allair, Rogers, Sharma); St Christopher’s Hospital for Children, Philadelphia, Pennsylvania (Alminde, Cray); Alvarado-Little Consulting LLC, Albany, New York (Alvarado-Little); Lucile Packard Children’s Hospital, Stanford, California (Atsatt, Wintch); Doernbecher Children’s Hospital, Oregon Health and Science University, Portland (Aylor); Primary Children’s Hospital, Intermountain Healthcare, University of Utah School of Medicine, Salt Lake City (Bale, Kocolas, Maloney); Children’s Hospital of Philadelphia, University of Pennsylvania Perelman School of Medicine, Philadelphia (Balmer); St Louis Children’s Hospital, Washington University School of Medicine, St Louis, Missouri (Barton, Cole, Turmelle, White); Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada (Beck, Bismilla, Langrish); Lucile Packard Children’s Hospital, Stanford University, Stanford, California (Blankenburg, Mendoza, Sanders); Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio (Chandler, Dahale, Obermeyer, Trueman); Primary Children’s Hospital, Salt Lake City, Utah (Choudhary, Christensen, Corless, Gubler, Trujillo, Warnick, Welch); Benioff Children’s Hospital, San Francisco, California (Coghlan-McDonald, Mangan); Walter Reed National Military Medical Center, Bethesda, Maryland (Da Silva, Markle); New York University Langone Medical Center, New York University School of Medicine, New York (Dreyer, Yin); Boston Children’s Hospital, Harvard Medical School, Boston, Massachusetts (Growdon, O’Donnell, Winn); Cincinnati Children’s Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, Ohio (Guiot, Shah); St Louis Children’s Hospital, St Louis, Missouri (Harris, Kruvand, Lane, Sauder); Mothers Against Medical Error, Columbia, South Carolina (Haskell); Walter Reed National Military Medical Center, Uniformed Services University of the Health Sciences, Bethesda, Maryland (Ledford, Lopreiato, Yu); St Christopher’s Hospital for Children, Drexel University College of Medicine, Philadelphia, Pennsylvania (Lewis, Thompson); Justin’s HOPE Project, Task Force for Global Health, Decatur, Georgia (Micalizzi); Children’s Medical Center Dallas, University of Texas Southwestern Medical Center, Dallas (Mittal); Children’s National Health System, George Washington University School of Medicine, Washington, DC (Ottolini); Kapi’olani Medical Center for Women and Children, University of Hawai’i John A. Burns School of Medicine, Honolulu (Patel); Ohio State University, Columbus (Pickler); Harvard Medical School, Boston, Massachusetts (Simpkin); Cohen Children’s Medical Center, Hofstra Northwell School of Medicine, East Garden City, New York (Subramony); Brigham and Women’s Hospital, Boston, Massachusetts (Wien); Northwestern University Feinberg School of Medicine, Evanston, Illinois (Wolf).
Author Contributions: Dr Lipsitz and Ms Yoon had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: All authors.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Khan, Landrigan.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Lipsitz, Yoon.
Obtained funding: Khan, Landrigan.
Administrative, technical, or material support: Furtak, Garcia.
Conflict of Interest Disclosures: Drs Landrigan, Sectish, Spector, Srivastava, Starmer, and West have consulted with and hold equity in the I-PASS Institute, which seeks to train institutions in best handoff practices and aid in their implementation. Drs Sectish, Spector, Srivastava, Starmer, and West have received monetary awards, honoraria, and travel reimbursement from multiple academic and professional organizations for teaching and consulting on physician performance and handoffs. Drs Landrigan and Srivastava are supported in part by the Children’s Hospital Association for their work as Executive Council members of the Pediatric Research in Inpatient Settings (PRIS) network. Dr Landrigan has also served as a paid consultant to Virgin Pulse to help develop a Sleep and Health Program. In addition, Dr Landrigan has received monetary awards, honoraria, and travel reimbursement from multiple academic and professional organizations for teaching and consulting on sleep deprivation, physician performance, handoffs, and safety and has served as an expert witness in cases regarding patient safety and sleep deprivation. No other disclosures were reported.
Funding/Support: This project was supported by grant CDR-1306-03556 from the Patient-Centered Outcomes Research Institute (Dr Landrigan). Dr Khan’s time was supported by K12 grant K12HS022986 from the Agency for Healthcare Research and Quality (principal investigator: Jonathan Finkelstein, MD; Boston Children’s Hospital, Boston, Massachusetts). Dr Baird’s time was supported by grant 5T32HS00063-21 from the Agency for Healthcare Research and Quality (principal investigator: Jonathan Finkelstein, MD).
Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Additional Information: The authors listed in the byline are also members of the Patient and Family Centered I-PASS Study Group.
Additional Contributions: We thank the patients, families, and caregivers involved in this project, as well as the research assistants, research clinicians, and unit staff. We also thank Cindy Brach, MPP (Agency for Healthcare Research and Quality, Rockville, Maryland), for her assistance reviewing study instruments and providing guidance on health literacy best practices. Ms Brach was not compensated for her work.
Create a personal account or sign in to: