Key PointsQuestion
Was the occurrence of an unexpected newborn death associated with changes in obstetric and neonatal process of care?
Findings
In this cross-sectional study using difference-in-differences analysis, an unexpected newborn death was associated with a modest increase in the subsequent use of cesarean delivery, newborn assisted ventilation, and antibiotic use for suspected sepsis, as well as an increase in neonatal intensive care unit admission in subgroup analysis.
Meaning
Unexpected newborn deaths were associated with increases in subsequent use of procedures to avert and mitigate fetal distress and newborn complications.
Importance
The death of a healthy term infant may signal patient safety and quality issues. Various initiatives aim to encourage clinicians to learn from these events, but little evidence exists regarding how exposure to an unexpected newborn death may alter clinician practice.
Objective
To examine the association between an unexpected newborn death and changes in obstetric and newborn procedures that may be used in response to potential fetal distress or newborn complications.
Design, Setting, and Participants
This cross-sectional study used difference-in-differences analysis of 2011 to 2017 US vital statistics data from 477 US counties experiencing an unexpected newborn death during the study period. All in-hospital live births in the 477 counties during the study period were included. Data were analyzed from September 2019 to September 2020.
Exposures
The death of an infant aged 0 to 7 days following an unremarkable pregnancy owing to causes other than birth defects, accidents/assaults, or sudden infant death syndrome.
Main Outcomes and Measures
Primary outcomes included binary variables capturing intervention in labor/delivery (induction, augmentation, cesarean delivery, forceps/vacuum) and procedures to avert and mitigate newborn complications (assisted ventilation, surfactant replacement therapy, antibiotics for suspected sepsis, neonatal intensive care unit admission).
Results
The main sample included 5.72 million births (2.54 million during preexposure time). Mean (SD) maternal age was 27.3 (5.8) years; 67% of mothers were White, and 12% were Black. Associations varied across the 4 estimated models. Following an unexpected newborn death, there was no significant increase in the probability of cesarean delivery in the full sample model (0.28 percentage points [pp]; 95% CI, −0.01 to 0.57 pp), but a significant increase in the other 3 models, with values ranging from 0.55 pp (95% CI, 0.21 to 0.88 pp) in the full sample model with matching to 0.66 pp (95% CI, 0.13 to 1.19 pp) in the 1-hospital county subsample with matching. There was a significant increase in the probability of newborn assisted ventilation in the full sample model with matching (0.46 pp; 95% CI, 0.08 to 0.83 pp), but no significant increase in the other 3 models, with estimates ranging from 0.33 pp (95% CI, −0.04 to 0.71 pp) to 0.69 pp (95% CI, −0.02 to 1.40 pp). An unexpected newborn death was not associated with a significant increase in antibiotic use in the full sample models (without matching: 0.19 pp; 95% CI, −0.00 to 0.39 pp; with matching: 0.22 pp; 95% CI: −0.02 to 0.46 pp), but was associated with a significant increase in both of the 1-hospital county subsample models (without matching: 0.38 pp; 95% CI, 0.02 to 0.73 pp; with matching: 0.39 pp; 95% CI, 0.01 to 0.77 pp).
Conclusions and Relevance
In some study models, an unexpected newborn death was associated with statistically significant increases in subsequent use of procedures to avert and mitigate fetal distress and newborn complications, which could reflect increases in identifying and proactively addressing serious potential complications or increased clinician caution applied across all cases. Future research should address whether these changes affect patient outcomes.
More than 7000 full-term infants die each year in the United States, equivalent to roughly 2.2 deaths per 1000 term births.1 About one-fifth of these deaths occur within the first week of birth.1 Although sudden infant death syndrome and congenital malformation represent the majority of term newborn deaths,1 some newborn deaths are preventable and may be attributable to inadequate quality of care during childbirth and the early neonatal period.2 Increasing research documents wide variation in use of obstetric and neonatal procedures and term newborn complications across hospitals in the US, suggesting room for quality improvement and standardization.3-6
Various policy initiatives have required or encouraged retrospective examination of unexpected and potentially avertible newborn deaths with the aim of improving childbirth safety and quality of routine obstetric and newborn care. The Joint Commission requires accredited hospitals to review and develop a proper response to the unanticipated death of a full-term infant, and the National Quality Forum includes the death of a neonate associated with labor or delivery in a low-risk pregnancy as a serious adverse event to be reported by states.7-9 The Fetal and Infant Mortality Review program reviews selected cases of fetal and infant deaths to identify weaknesses of medical and nonmedical systems.10
Despite efforts encouraging learning from unexpected newborn deaths, little evidence exists about whether exposure to unexpected newborn death leads to changes in obstetric and newborn care practice. Studies examining clinician behavior in other medical settings find that learning about the recent occurrence of a severe adverse event changes clinician decision-making in ways that can have important implications for patient outcomes.11-14 Related literature on comparative quality of care reporting suggests that public reporting can trigger clinician responses that improve quality but also can generate unintended consequences.15,16
In this study, we investigated whether the death of an otherwise healthy term newborn following an unremarkable pregnancy was associated with subsequent use of obstetric and newborn procedures. After an unexpected newborn death, clinicians may become more responsive to potential signs of fetal or newborn distress and complications, or their decisions about when to intervene could become more conservative. These responses could manifest through changes in delivery-related obstetric procedures and/or newborn procedures. We leveraged the variation in the timing of a death across counties to examine the association between unexpected deaths and obstetric and neonatal procedures using the US vital statistics data.
This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.17 This study was based on deidentified secondary data and deemed exempt by the Institutional Review Board at the Harvard T.H. Chan School of Public Health. Our primary data came from the restricted-use US vital statistics data from 2011 to 2017, which included data from birth certificates of all live births in the US and data from infant death certificates linked to their birth certificates. We excluded 14 states (18% of all births) that had not fully adopted the 2003 version of the birth certificate by 2011. To account for local socioeconomic status and health care resources, we merged in data from the US Census and the Centers for Medicare & Medicaid Services (eTable 1 in the Supplement). Data were analyzed from September 2019 to September 2020.
Definition of Exposure and Sample Selection
The exposure of interest was the occurrence of an unexpected newborn death at the county level. “Unexpected newborn death” was defined as the death of an infant aged 0 to 7 days following an unremarkable pregnancy owing to causes other than birth defects, accidents, assaults, or sudden infant death syndrome. An unremarkable pregnancy was defined as a singleton pregnancy to a woman aged 18 to 40 years who gave birth to a newborn with birthweight greater than 2500 g, gestational age between 37 and 42 weeks, and no congenital anomalies. We focused on deaths among infants that were born in hospitals and died in acute care settings. In all, 737 counties in our data set experienced at least 1 unexpected newborn death between the first quarter (Q1) of 2011 and Q4 of 2017.
The exposure was defined as the first incidence of unexpected newborn death within a county during the study period. To ensure enough preexposure and postexposure data and sufficient sample size, we restricted the exposure group to counties whose first incidence occurred between Q1 of 2012 and Q1 of 2016. We excluded counties with fewer than 25 average quarterly births and counties with fewer than 25 births in any given quarter, as data for these counties may be subject to greater noise and measurement error. Two counties that appeared to be outliers (with >10 deaths during the study period) were dropped. Within the remaining sample, roughly 80% of counties did not experience a second death during the study period or did so at least a year after the first death. Our final sample was constructed based on all in-hospital births in 477 ever-exposed counties (eTable 2 in the Supplement).
We analyzed outcomes related to processes of care during delivery and the early newborn period, focusing on procedures that could be indicated based on signs of fetal or newborn distress or complications and that are captured in national vital statistics data. Process measures related to labor and delivery included binary variables for induction, augmentation, cesarean delivery, and delivery using forceps/vacuum. Newborn procedures included binary variables for assisted ventilation immediately after delivery or for more than 6 hours, receipt of surfactant replacement therapy, receipt of antibiotics for suspected sepsis, and admission to a neonatal intensive care unit (NICU). We stratified the analysis of cesarean delivery by whether the delivery was scheduled or unplanned and whether the birth was considered a low-risk first birth (eMethods in the Supplement).18 Since some of the examined labor and delivery procedures can have downstream impacts on maternal outcomes, we explored the association between the exposure and maternal complications/procedures in eTable 8 in the Supplement, including the presence of third- or fourth-degree laceration, ruptured uterus, unplanned hysterectomy, blood transfusion, and admission to an intensive care unit.
We included the following birth-level covariates: mother’s race/ethnicity, marital status, age, education, nulliparous/multiparous, singleton/multiple, health insurance type, smoking status during pregnancy, maternal infections during pregnancy, obesity, late/no antenatal care, history of cesarean delivery, prepregnancy/gestational diabetes, prepregnancy/gestational hypertension, breech presentation, sex of the infant, birthweight less than 2500 g, birthweight greater than 4000 g, preterm birth, and any congenital anomalies. County-level covariates included yearly measures of poverty rate, median household income, uninsured rate, number of hospitals offering obstetric care, number of hospitals with a NICU, number of obstetricians per 1000 women aged 15 to 44 years, and number of primary care physicians per 1000 individuals (eTable 1 in the Supplement).
We used a stacked difference-in-differences (DD) design,19-21 in which counties experiencing a newborn death currently (the exposure group, or current-exposed) were compared with future-exposed counties during the period when the future-exposed counties had yet to experience a death (eMethods in the Supplement). We used the future-exposed counties as the comparison group because the current-exposed and future-exposed counties were much more similar to each other across maternal and birth characteristics and birth volume than to the never-exposed counties (eTable 3 in the Supplement). We considered changes in the outcomes over the 4 quarters before and after a newborn death (ie, from −4 to +4). For counties experiencing a death in quarter k, we paired them with a comparison group comprising counties experiencing a death over the period between k + 4 + 1 and k + 4 + 6 (eFigure 1 and eTable 4 in the Supplement). Each pair formed a DD cohort defined by k; we pooled together all cohorts for the regression analysis. The identification assumption was that absent exposure, outcomes in the exposure and comparison counties would have moved in parallel, conditional on covariates. A second assumption was that the timing of the event was unpredictable so there was no anticipatory behavior right before the event.
We estimated 2 birth-level linear regression models with fixed effects for county-cohort and year-quarter and adjusted for birth characteristics and time-varying county characteristics. The first model interacted a binary variable for current-exposed counties with a series of quarter-to-event dummy variables; we presented the estimated coefficients from these models graphically. In the second model, we estimated the average differential change by replacing the quarter-to-event dummies with a binary variable for all quarters postexposure.
We also conducted a subgroup analysis among the 245 counties with only 1 hospital offering obstetric care throughout 2011 to 2017 for 2 reasons. First, this analysis focused on only the clinicians in hospitals that experienced the exposure, rather than clinicians in unexposed hospitals in the same county as the exposed hospitals. Second, this analysis reduced potential confounding from changes in patient utilization patterns following the unexpected newborn death.
In our study design, counties with higher birth volumes were more likely to experience a death earlier in time and therefore were disproportionately represented in the exposure group. We performed coarsened exact matching (CEM) to improve comparability between the exposure and comparison groups over birth volume and county health care resources (eMethods in the Supplement).22 The CEM-matched data retained just above two-thirds of the observations in the exposure group and slightly more than half of the observations in the comparison group (eTable 5 in the Supplement). We repeated the analysis within the full set of CEM-matched data and the subset of matched data for counties with 1 hospital.
Standard errors were clustered at the county level to account for correlated data within counties. The threshold for statistical significance was set at 2-tailed P < .05. All analyses were performed using Stata version 15 (StataCorp).23
We conducted 2 sensitivity analyses. First, since newborn deaths occurring further from the delivery date may be less likely to occur in the hospital used for delivery, we performed an analysis restricting to unexpected deaths of newborns aged 0 to 2 days. Second, for individual outcomes within an outcome domain (ie, labor/delivery procedures, newborn procedures, and maternal complications/procedures), as a robustness check we performed the Benjamini-Hochberg procedure to control for a false-discovery rate of 0.1.24,25
Of the 402 unexpected newborn deaths included in the analysis, 39.3% occurred within the first 24 hours, 36.2% were vaginal deliveries, 23.8% were unplanned cesarean deliveries, 40% were scheduled cesarean deliveries, and most were related to low oxygen levels in the newborn (Table 1). Of the 2 539 031 births observed during preexposure time, the mean (SD) maternal age was 27.3 (5.8), 67% of mothers were White, 12% were Black, 47.5% had Medicaid, 32.2% were nulliparous, and 10.7% were preterm (Table 2).
Individual- and county-level characteristics were generally comparable between the current-exposed and future-exposed counties, though some differences existed (Table 2). Current-exposed counties were on average larger, with higher birth volume, and less likely to be in rural areas. Pregnant women in current-exposed counties were somewhat more likely to be Black or Hispanic, more likely to be married, have private insurance, and have higher levels of education. They were slightly less likely to have obesity or to smoke during pregnancy.
The estimated coefficients on preexposure quarter-to-event −4 through −2 were not significantly different from zero across all outcomes, suggesting that trends in the outcomes before the event were similar in the current- and future-exposed countries (Figure 1 and Figure 2). The P values of the F test of preexposure coefficients jointly equal to zero was .75 for induction, .56 for cesarean delivery, .33 for forceps/vacuum, .86 for augmentation, .71 for assisted ventilation, .95 for surfactant therapy, .95 for antibiotics use for suspected sepsis, and .56 for NICU admission.
Postexposure, there was a modest increase in cesarean delivery in the first quarter following an unexpected newborn death (ie, quarter-to-event = 1; Figure 1), and statistically significant associations were found in 3 of the 4 models estimated (Table 3). An unexpected newborn death was not associated with a significant increase in the probability of cesarean delivery in the full sample model (0.28 percentage points [pp]; 95% CI, −0.01 to 0.57 pp; P = .06; 0.9% of sample mean; Table 3, panel A), but was associated with a significant increase in cesarean delivery in the other 3 models, with values ranging from 0.55 pp in the full sample model with matching (95% CI, 0.21 to 0.88 pp; P < .01; 1.7% of sample mean; Table 3, panel C) to 0.66 pp in the 1-hospital county subsample model with matching (95% CI, 0.13 to 1.19 pp; P = .02; 2.1% of sample mean; Table 3, panel D). While augmentation appeared to increase gradually following an unexpected newborn death (Figure 1), the estimate was statistically insignificant in the full sample model and inconsistent across models. We observed no changes in the probabilities of induction or forceps/vacuum.
Turning to newborn procedures, there was an immediate increase in newborn assisted ventilation and a gradual increase in antibiotic use for suspected sepsis (Figure 2), with the estimates statistically significant in some, but not all, of the models (Table 3). After an unexpected newborn death, there was a statistically significant increase in the probability of assisted ventilation in the full sample model with matching (0.46 pp; 95% CI, 0.08 to 0.83 pp; P = .02; 12.3% of sample mean; Table 3, panel C), but no significant increase in assisted ventilation in the other 3 models, with these estimates ranging from 0.33 pp in the full sample model (95% CI, −0.04 to 0.71 pp; P = .08; 8.6% of sample mean; Table 3, panel A) to 0.69 pp in the 1-hospital county subsample model (95% CI, −0.02 to 1.40; P = .06; 21.1% of sample mean; Table 3, panel B). There was no significant increase in the probability of antibiotic use in the full sample models, without matching (0.19 pp; 95% CI, −0.00 to 0.39 pp; P = .05; 8.4% of sample mean; Table 3, panel A) or with matching (0.22 pp; 95% CI, −0.02 to 0.46 pp; P = .07; 9.5% of sample mean; Table 3, panel C), but a significant increase in antibiotic use in the 1-hospital county subsample models, without matching (0.38 pp; 95% CI, 0.02 to 0.73 pp; P = .04; 18.6% of sample mean; Table 3, panel B) and with matching (0.39 pp; 95% CI, 0.01 to 0.77 pp; P = .04; 19.2% of sample mean; Table 3, panel D).
We estimated statistically nonsignificant but practically meaningful postexposure changes in NICU admission in the 1-hospital county subsample, without matching (0.62 pp; 95% CI, −0.03 to 1.27 pp; P = .06; 11.7% of sample mean; Table 3 panel B) and with matching (0.70 pp; 95% CI, −0.05 to 1.45 pp; P = .07; 13.6% of sample mean; Table 3 panel D). The estimates for surfactant therapy were small, statistically insignificant, and inconsistent across all models.
The increase in cesarean delivery was more pronounced for low-risk first-births (eTable 6 in the Supplement). Results based on newborn deaths within 0 to 2 days were largely consistent with the main results (eTable 7 in the Supplement). Our results were generally robust to controlling for a false-discovery rate of 0.1.
As to downstream maternal procedures/complications, most estimates were practically small except for the estimated reduction in third- and fourth-degree perineal laceration, but it was statistically insignificant across all 4 models (eTable 8 in the Supplement).
Unexpected newborn deaths are sentinel events that may signal a need for clinician practice reviews and quality improvement initiatives. We found that, following an unexpected newborn death, some models indicated that clinicians increased use of some obstetric and newborn procedures meant to respond to signs of fetal or newborn distress and complications, including cesarean delivery, newborn assisted ventilation, and antibiotics use for suspected sepsis. In 1-hospital counties, estimated changes were larger, possibly because responses in multihospital counties were diluted by hospitals that did not experience the unexpected death.
The estimated association between an unexpected newborn death and cesarean delivery, while modest and statistically nonsignificant in 1 of the 4 models, was comparable to estimates of changes in cesarean delivery use associated with policy-relevant factors such as payment differentials and clinician income shocks due to declining fertility rates in other observational studies.26-28 Our estimates for neonatal procedures were also comparable with or larger than those associated with factors such as incentives to fill empty NICU beds and delivering at a hospital with a high rate of cesarean delivery.29,30
It is possible that clinicians in this study became more cautious following an unexpected newborn death in their county and may therefore have performed more obstetric and neonatal procedures. For example, at least one-third of deaths included in this analysis were associated with low oxygen levels in newborns. Despite limited evidence about the effect of cesarean delivery on birth asphyxia,31,32 clinicians may initiate cesarean delivery to avoid prolonged labor—a risk factor for birth asphyxia.33 Litigation pressure could lead to further precaution and possibly “defensive” cesarean deliveries, as by one estimate the most common diagnoses involved in obstetrics malpractice lawsuits was hypoxic-ischemic encephalopathy and severe birth asphyxia.34,35 Another important possibility was that clinicians learned about quality gaps, such as misjudgment of situations that should have required cesarean delivery.
Similarly, increases in newborn assisted ventilation and antibiotics use for suspected sepsis may be due to greater caution and/or improved care on the part of clinicians. It is notable that some of the biggest observed increases in neonatal procedures were surrounding treatment of suspected sepsis, although sepsis-related complications were only relevant for 3.7% of the unexpected newborn deaths. Recent work has documented highly variable antibiotic use across NICUs but low correlation with actual infection,4 suggesting that use of antibiotics may be influenced by clinician discretion and practice style.36
These results may help inform current efforts to improve maternal and newborn death review and quality of care. Recent evidence has highlighted the challenges in measuring sentinel events in obstetric and perinatal care that accurately identify potential quality concerns.37 Based on the estimates from some of our models, we found that a sentinel event like the death of an otherwise healthy newborn is associated with changes in processes of care for labor/delivery and for newborns, suggesting that these events present new information on performance for clinicians. However, clinicians may learn from the event and improve care processes or react defensively and increase interventions for all deliveries. Standardized procedures to review adverse events, share data, and monitor changes could help understand clinicians’ response and the implications for patient outcomes.38,39
This study had several limitations. First, our data did not allow for evaluating whether overall quality of care or clinical outcomes improved following an unexpected newborn death. Second, given the absence of hospital and clinician identifiers in the data, our estimates mainly captured the local aggregate response, which did not represent any particular hospital’s or clinician’s practice and may be diluted by unexposed hospitals in the same county. This concern was ameliorated somewhat by the 1-hospital county subgroup analysis, which showed broadly consistent findings. Third, one-third of the unexpected deaths occurred among newborns transferred out of their birth county. To the extent that these transfers weakened the response of the transferring clinicians because they may not know of the death or they may not attribute the death to their own actions, our estimates may have underestimated changes in clinician practice. Fourth, stillbirths were not examined because data on fresh vs macerated stillbirths was inconsistently reported in our data and because stillbirths occurred too frequently to enable our analytical setup. Finally, given the imposed sample restrictions, our analysis may not be representative of small, rural counties with low population density.
We found that , in some models, an unexpected newborn death at the county level was associated with higher probabilities of cesarean delivery, newborn assisted ventilation, and antibiotic use for suspect neonatal sepsis in subsequent births. Our results are consistent with prior evidence from other health care settings that clinician practice style is sensitive to severe adverse events. More research is needed on whether these changes in clinician practice reflect overall quality and safety improvements and, in turn, improve clinical outcomes for subsequent patients.
Accepted for Publication: September 4, 2020.
Published: December 7, 2020. doi:10.1001/jamanetworkopen.2020.24589
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Han D et al. JAMA Network Open.
Corresponding Author: Dan Han, PhD, Lee Kuan Yew School of Public Policy, National University of Singapore, 469B Bukit Timah Rd, Singapore 259771 (spphd@nus.edu.sg).
Author Contributions: Dr Han had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Drs McConnell and Cohen were co–senior authors.
Concept and design: Han, McConnell, Cohen.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Han.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Han, Khadka.
Administrative, technical, or material support: Han, Khadka.
Supervision: McConnell, Cohen.
Conflict of Interest Disclosures: None reported.
12.Sacarny
A, Barnett
ML, Le
J, Tetkoski
F, Yokum
D, Agrawal
S. Effect of peer comparison letters for high-volume primary care prescribers of quetiapine in older and disabled adults: a randomized clinical trial.
JAMA Psychiatry. 2018;75(10):1003-1011. doi:
10.1001/jamapsychiatry.2018.1867
PubMedGoogle ScholarCrossref 17.von Elm
E, Altman
DG, Egger
M, Pocock
SJ, Gøtzsche
PC, Vandenbroucke
JP; STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.
J Clin Epidemiol. 2008;61(4):344-349. doi:
10.1016/j.jclinepi.2007.11.008
PubMedGoogle ScholarCrossref 23.StataCorp. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC; 2017.
30.Card
D, Fenizia
A, Silver
D.
The Health Impacts of Hospital Delivery Practices. National Bureau of Economic Research; 2019. doi:
10.3386/w25986
31.Foley
ME, Alarab
M, Daly
L, Keane
D, Macquillan
K, O’Herlihy
C. Term neonatal asphyxial seizures and peripartum deaths: lack of correlation with a rising cesarean delivery rate.
Am J Obstet Gynecol. 2005;192(1):102-108. doi:
10.1016/j.ajog.2004.06.102
PubMedGoogle ScholarCrossref 33.Sandström
A, Altman
M, Cnattingius
S, Johansson
S, Ahlberg
M, Stephansson
O. Durations of second stage of labor and pushing, and adverse neonatal outcomes: a population-based cohort study.
J Perinatol. 2017;37(3):236-242. doi:
10.1038/jp.2016.214
PubMedGoogle ScholarCrossref