[Skip to Navigation]
Sign In
Figure 1.  Organ Dysfunction Distribution and Associated Mortality in Patients With Sepsis in 2014 and Associated Mortality by Number of Organ Dysfunction Criteria Met
Organ Dysfunction Distribution and Associated Mortality in Patients With Sepsis in 2014 and Associated Mortality by Number of Organ Dysfunction Criteria Met

A, Number of sepsis cases with each organ dysfunction and associated in-hospital deaths were n = 49 400 (16 715 deaths) for vasopressor initiation; n = 45 088 (14 290 deaths) for initiation of mechanical ventilation; n = 92 779 (18 345 deaths) for hyperlactatemia (serum lactate level ≥2.0 mmol/L); n = 75 553 (9664 deaths) for acute kidney injury (doubling in baseline creatinine level or decrease in estimated glomerular filtration rate by ≥50%); n = 26 083 (3717 deaths) for hepatic injury (doubling in baseline total bilirubin level to ≥2.0 mg/dL); n = 21 830 (4869 deaths) for thrombocytopenia (decrease in baseline platelet count by ≥50%, with baseline platelets >100 cells/µL). Further details on organ dysfunction criteria are described in the Box. Total number of sepsis encounters, 173 690. B, Number of sepsis cases meeting the specified number of organ dysfunction criteria and associated in-hospital deaths were n = 173 690 (26 061 deaths) for 1 or more organ dysfunction criteria; n = 88 248 (20 687 deaths) for 2 or more organ dysfunction criteria; n = 50 466 (16 506 deaths) for 3 or more organ dysfunction criteria; and n = 29 161 (11 725 deaths) for 4 or more organ dysfunction criteria. Number of organ dysfunction criteria includes different organ dysfunctions that may have occurred at separate times during hospitalization if surveillance criteria were met more than once.

Figure 2.  Sepsis Trends From 2009-2014: Incidence, In-hospital Sepsis Mortality, and In-hospital Mortality or Discharge to Hospice.
Sepsis Trends From 2009-2014: Incidence, In-hospital Sepsis Mortality, and In-hospital Mortality or Discharge to Hospice.

Adjusted rates from 2009-2013 calculated relative to observed 2014 rates. Error bars indicate 95% CIs. “Clinical criteria” indicates blood cultures + antibiotics + concurrent organ dysfunction (Box). “Clinical criteria without lactate” excludes the criterion for lactate level of 2.0 mmol/L or greater. Primary trends assessment was conducted using clinical criteria without lactate levels. “Explicit sepsis codes”: discharge diagnoses of severe sepsis (995.92) or septic shock (785.52). “Implicit sepsis codes”: at least 1 infection diagnosis and 1 organ dysfunction diagnosis. All trends adjusted for hospital characteristics (institution, region, teaching status, bed count, annual admissions) and case mix (median age of hospitalized patients, sex and race/ethnicity distributions, proportion of intensive care unit vs total admissions). Veterans Affairs hospitals not included in the trends analysis. Total number of sepsis cases per year was 30 744 (2009), 35 596 (2010), 34 445 (2011), 36 524 (2012), 144 322 (2013), and 145 236 (2014) for clinical criteria; 28 723 (2009), 32 175 (2010), 30 348 (2011), 32 019 (2012), 120 402 (2013), and 112 355 (2014) for clinical criteria without lactate levels; 50 223 (2009), 61 483 (2010), 65 193 (2011), 76 208 (2012), 275 480 (2013), and 272 679 (2014) for implicit or explicit codes; and 9062 (2009), 12 688 (2010), 12 571 (2011), 15 309 (2012), 61 285 (2013), and 65 176 (2014) for explicit codes.

Table 1.  Characteristics and Case Mix of Study Hospitals in 2014
Characteristics and Case Mix of Study Hospitals in 2014
Table 2.  Demographics and Clinical Characteristics of Patients With Sepsis in 2014
Demographics and Clinical Characteristics of Patients With Sepsis in 2014
1.
Torio  CM, Andrews  RM. National inpatient hospital costs: the most expensive conditions by payer, 2011: Statistical Brief 160. Healthcare Cost and Utilization Project (HCUP) website. https://www.hcup-us.ahrq.gov/reports/statbriefs/sb160.jsp. 2006. Accessed August 31, 2017.
2.
Liu  V, Escobar  GJ, Greene  JD,  et al.  Hospital deaths in patients with sepsis from 2 independent cohorts.  JAMA. 2014;312(1):90-92.PubMedGoogle ScholarCrossref
3.
Martin  GS, Mannino  DM, Eaton  S, Moss  M.  The epidemiology of sepsis in the United States from 1979 through 2000.  N Engl J Med. 2003;348(16):1546-1554.PubMedGoogle ScholarCrossref
4.
Dombrovskiy  VY, Martin  AA, Sunderram  J, Paz  HL.  Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003.  Crit Care Med. 2007;35(5):1244-1250.PubMedGoogle ScholarCrossref
5.
Lagu  T, Rothberg  MB, Shieh  MS, Pekow  PS, Steingrub  JS, Lindenauer  PK.  Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007.  Crit Care Med. 2012;40(3):754-761.PubMedGoogle ScholarCrossref
6.
Kumar  G, Kumar  N, Taneja  A,  et al; Milwaukee Initiative in Critical Care Outcomes Research (MICCOR) Group of Investigators.  Nationwide trends of severe sepsis in the 21st century (2000-2007).  Chest. 2011;140(5):1223-1231.PubMedGoogle ScholarCrossref
7.
Gaieski  DF, Edwards  JM, Kallan  MJ, Carr  BG.  Benchmarking the incidence and mortality of severe sepsis in the United States.  Crit Care Med. 2013;41(5):1167-1174.PubMedGoogle ScholarCrossref
8.
Shankar-Hari  M, Phillips  GS, Levy  ML,  et al; Sepsis Definitions Task Force.  Developing a new definition and assessing new clinical criteria for septic shock: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):775-787.PubMedGoogle ScholarCrossref
9.
Rhee  C, Gohil  S, Klompas  M.  Regulatory mandates for sepsis care—reasons for caution.  N Engl J Med. 2014;370(18):1673-1676.PubMedGoogle ScholarCrossref
10.
Jafarzadeh  SR, Thomas  BS, Marschall  J, Fraser  VJ, Gill  J, Warren  DK.  Quantifying the improvement in sepsis diagnosis, documentation, and coding: the marginal causal effect of year of hospitalization on sepsis diagnosis.  Ann Epidemiol. 2016;26(1):66-70.PubMedGoogle ScholarCrossref
11.
Klompas  M, Rhee  C.  Sepsis and the theory of relativity: measuring a moving target with a moving measuring stick.  Crit Care. 2016;20(1):396.PubMedGoogle ScholarCrossref
12.
Rhee  C, Kadri  S, Huang  SS,  et al.  Objective sepsis surveillance using electronic clinical data.  Infect Control Hosp Epidemiol. 2016;37(2):163-171.PubMedGoogle ScholarCrossref
13.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Epicenters Program.  Improving documentation and coding for acute organ dysfunction biases estimates of changing sepsis severity and burden: a retrospective study.  Crit Care. 2015;19:338.PubMedGoogle ScholarCrossref
14.
Kadri  SS, Rhee  C, Strich  JR,  et al.  Estimating ten-year trends in septic shock incidence and mortality in United States academic medical centers using clinical data.  Chest. 2017;151(2):278-285.PubMedGoogle ScholarCrossref
15.
Singer  M, Deutschman  CS, Seymour  CW,  et al.  The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):801-810.PubMedGoogle ScholarCrossref
16.
Seymour  CW, Liu  VX, Iwashyna  TJ,  et al.  Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):762-774.PubMedGoogle ScholarCrossref
17.
Vincent  JL, Moreno  R, Takala  J,  et al; Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine.  The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure.  Intensive Care Med. 1996;22(7):707-710.PubMedGoogle ScholarCrossref
18.
Bledsoe  BE, Casey  MJ, Feldman  J,  et al.  Glasgow Coma Scale scoring is often inaccurate.  Prehosp Disaster Med. 2015;30(1):46-53.PubMedGoogle ScholarCrossref
19.
Rhodes  A, Evans  LE, Alhazzani  W,  et al.  Surviving Sepsis Campaign: international guidelines for management of sepsis and septic shock: 2016.  Crit Care Med. 2017;45(3):486-552.PubMedGoogle ScholarCrossref
20.
National Quality Forum (NQF). Severe Sepsis and Septic Shock: Management Bundle (Composite Measure). NQF website. http://www.qualityforum.org/Qps/QpsTool.aspx. 2017. Accessed March 24, 2017.
21.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Prevention Epicenters Program.  Lactate testing in suspected sepsis: trends and predictors of failure to measure levels.  Crit Care Med. 2015;43(8):1669-1676.PubMedGoogle ScholarCrossref
22.
Seymour  CW, Coopersmith  CM, Deutschman  CS,  et al.  Application of a framework to assess the usefulness of alternative sepsis criteria.  Crit Care Med. 2016;44(3):e122-e130.PubMedGoogle ScholarCrossref
23.
Charlson  ME, Pompei  P, Ales  KL, MacKenzie  CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.  J Chronic Dis. 1987;40(5):373-383.PubMedGoogle ScholarCrossref
24.
National Hospice and Palliative Care Organization (NHPCO). NHPCO’s facts and figures: hospice care in America. NHPCO website. https://www.nhpco.org/sites/default/files/public/Statistics_Research/2015_Facts_Figures.pdf. 2015. Accessed May 15, 2017.
25.
Casserly  B, Phillips  GS, Schorr  C,  et al.  Lactate measurements in sepsis-induced tissue hypoperfusion: results from the Surviving Sepsis Campaign database.  Crit Care Med. 2015;43(3):567-573.PubMedGoogle ScholarCrossref
26.
Angus  DC, Linde-Zwirble  WT, Lidicker  J, Clermont  G, Carcillo  J, Pinsky  MR.  Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care.  Crit Care Med. 2001;29(7):1303-1310.PubMedGoogle ScholarCrossref
27.
Iwashyna  TJ, Odden  A, Rohde  J,  et al.  Identifying patients with severe sepsis using administrative claims: patient-level validation of the Angus implementation of the International Consensus Conference definition of severe sepsis.  Med Care. 2014;52(6):e39-e43.PubMedGoogle ScholarCrossref
28.
Whittaker  SA, Mikkelsen  ME, Gaieski  DF, Koshy  S, Kean  C, Fuchs  BD.  Severe sepsis cohorts derived from claims-based strategies appear to be biased toward a more severely ill patient population.  Crit Care Med. 2013;41(4):945-953.PubMedGoogle ScholarCrossref
29.
Poeze  M, Ramsay  G, Gerlach  H, Rubulotta  F, Levy  M.  An international sepsis survey: a study of doctors’ knowledge and perception about sepsis.  Crit Care. 2004;8(6):R409-R413.PubMedGoogle ScholarCrossref
30.
Rhee  C, Kadri  SS, Danner  RL,  et al.  Diagnosing sepsis is subjective and highly variable: a survey of intensivists using case vignettes.  Crit Care. 2016;20:89.PubMedGoogle ScholarCrossref
31.
Rothberg  MB, Pekow  PS, Priya  A, Lindenauer  PK.  Variation in diagnostic coding of patients with pneumonia and its association with hospital risk-standardized mortality rates: a cross-sectional analysis.  Ann Intern Med. 2014;160(6):380-388.PubMedGoogle ScholarCrossref
32.
Utter  GH, Cuny  J, Strater  A, Silver  MR, Hossli  S, Romano  PS.  Variation in academic medical centers’ coding practices for postoperative respiratory complications: implications for the AHRQ postoperative respiratory failure Patient Safety Indicator.  Med Care. 2012;50(9):792-800.PubMedGoogle ScholarCrossref
33.
Lorence  DP, Ibrahim  IA.  Benchmarking variation in coding accuracy across the United States.  J Health Care Finance. 2003;29(4):29-42.PubMedGoogle Scholar
34.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Epicenters Program.  Comparison of trends in sepsis incidence and coding using administrative claims versus objective clinical data.  Clin Infect Dis. 2015;60(1):88-95.PubMedGoogle ScholarCrossref
35.
Gohil  SK, Cao  C, Phelan  M,  et al.  Impact of policies on the rise in sepsis incidence, 2000-2010.  Clin Infect Dis. 2016;62(6):695-703.PubMedGoogle ScholarCrossref
36.
Calderwood  MS, Kleinman  K, Soumerai  SB,  et al.  Impact of Medicare’s payment policy on mediastinitis following coronary artery bypass graft surgery in US hospitals.  Infect Control Hosp Epidemiol. 2014;35(2):144-151.PubMedGoogle ScholarCrossref
37.
Kawai  AT, Calderwood  MS, Jin  R,  et al.  Impact of the Centers for Medicare and Medicaid Services hospital-acquired conditions policy on billing rates for 2 targeted healthcare-associated infections.  Infect Control Hosp Epidemiol. 2015;36(8):871-877.PubMedGoogle ScholarCrossref
38.
Metersky  ML, Wang  Y, Klompas  M, Eckenrode  S, Bakullari  A, Eldridge  N.  Trend in ventilator-associated pneumonia rates Between 2005 and 2013.  JAMA. 2016;316(22):2427-2429.PubMedGoogle ScholarCrossref
39.
Angus  DC, Seymour  CW, Coopersmith  CM,  et al.  A framework for the development and interpretation of different sepsis definitions and clinical criteria.  Crit Care Med. 2016;44(3):e113-e121.PubMedGoogle ScholarCrossref
40.
Klompas  M, Rhee  C.  We need better tools for sepsis surveillance.  Crit Care Med. 2016;44(7):1441-1442.PubMedGoogle ScholarCrossref
Original Investigation
Caring for the Critically Ill Patient
October 3, 2017

Incidence and Trends of Sepsis in US Hospitals Using Clinical vs Claims Data, 2009-2014

Author Affiliations
  • 1Department of Population Medicine, Harvard Medical School/Harvard Pilgrim Health Care Institute, Boston, Massachusetts
  • 2Department of Medicine, Brigham and Women’s Hospital, Boston, Massachusetts
  • 3Division of Healthcare Quality Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia
  • 4Division of Hospital Medicine, Department of Medicine, Emory University School of Medicine, Atlanta, Georgia
  • 5Division of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, Emory University School of Medicine, and Emory Critical Care Center, Atlanta, Georgia
  • 6Clinical Research, Investigation and Systems Modeling of Acute illness (CRISMA) Center, Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
  • 7Department of Internal Medicine, University of Michigan, Ann Arbor
  • 8VA Center for Clinical Management Research, VA Ann Arbor Health System, Ann Arbor, Michigan
  • 9Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, Maryland
  • 10Associate Editor, JAMA
  • 11Hospital Corporation of America, Nashville, Tennessee
  • 12Texas A&M Health Science Center College of Medicine, Houston
  • 13Department of Medicine, Washington University School of Medicine, St Louis, Missouri
  • 14Institute for Health Metrics, Burlington, Massachusetts
JAMA. 2017;318(13):1241-1249. doi:10.1001/jama.2017.13836
Key Points

Question  Is the incidence of sepsis in the United States increasing and mortality decreasing, as suggested by estimates from claims-based analyses?

Findings  In this retrospective cohort study that included detailed clinical data from 7 801 624 adult hospitalizations, sepsis incidence did not change significantly between 2009 and 2014 (+0.6%/y). While in-hospital mortality decreased during the study period, the combined outcome of death or discharge to hospice did not change significantly (−1.3%/y).

Meaning  Based on clinical data, the incidence of sepsis, and related mortality or discharge to hospice, has remained stable between 2009-2014. The findings also suggest that clinical data provide more objective estimates than claims-based data for sepsis surveillance.

Abstract

Importance  Estimates from claims-based analyses suggest that the incidence of sepsis is increasing and mortality rates from sepsis are decreasing. However, estimates from claims data may lack clinical fidelity and can be affected by changing diagnosis and coding practices over time.

Objective  To estimate the US national incidence of sepsis and trends using detailed clinical data from the electronic health record (EHR) systems of diverse hospitals.

Design, Setting, and Population  Retrospective cohort study of adult patients admitted to 409 academic, community, and federal hospitals from 2009-2014.

Exposures  Sepsis was identified using clinical indicators of presumed infection and concurrent acute organ dysfunction, adapting Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) criteria for objective and consistent EHR-based surveillance.

Main Outcomes and Measures  Sepsis incidence, outcomes, and trends from 2009-2014 were calculated using regression models and compared with claims-based estimates using International Classification of Diseases, Ninth Revision, Clinical Modification codes for severe sepsis or septic shock. Case-finding criteria were validated against Sepsis-3 criteria using medical record reviews.

Results  A total of 173 690 sepsis cases (mean age, 66.5 [SD, 15.5] y; 77 660 [42.4%] women) were identified using clinical criteria among 2 901 019 adults admitted to study hospitals in 2014 (6.0% incidence). Of these, 26 061 (15.0%) died in the hospital and 10 731 (6.2%) were discharged to hospice. From 2009-2014, sepsis incidence using clinical criteria was stable (+0.6% relative change/y [95% CI, −2.3% to 3.5%], P = .67) whereas incidence per claims increased (+10.3%/y [95% CI, 7.2% to 13.3%], P < .001). In-hospital mortality using clinical criteria declined (−3.3%/y [95% CI, −5.6% to −1.0%], P = .004), but there was no significant change in the combined outcome of death or discharge to hospice (−1.3%/y [95% CI, −3.2% to 0.6%], P = .19). In contrast, mortality using claims declined significantly (−7.0%/y [95% CI, −8.8% to −5.2%], P < .001), as did death or discharge to hospice (−4.5%/y [95% CI, −6.1% to −2.8%], P < .001). Clinical criteria were more sensitive in identifying sepsis than claims (69.7% [95% CI, 52.9% to 92.0%] vs 32.3% [95% CI, 24.4% to 43.0%], P < .001), with comparable positive predictive value (70.4% [95% CI, 64.0% to 76.8%] vs 75.2% [95% CI, 69.8% to 80.6%], P = .23).

Conclusions and Relevance  In clinical data from 409 hospitals, sepsis was present in 6% of adult hospitalizations, and in contrast to claims-based analyses, neither the incidence of sepsis nor the combined outcome of death or discharge to hospice changed significantly between 2009-2014. The findings also suggest that EHR-based clinical data provide more objective estimates than claims-based data for sepsis surveillance.

Introduction

Sepsis is a major public health problem. It is among the most expensive conditions treated in US hospitals and a leading cause of death.1,2 Numerous studies suggest that the incidence of sepsis is increasing over time, offsetting declining case-fatality rates.3-6

Despite its importance, reliably measuring sepsis incidence and trends is challenging. Most studies have used claims data, but increasing clinical awareness, changes in diagnosis and coding practices, and variable definitions have led to uncertainty about the accuracy of reported trends as well as marked heterogeneity in incidence and mortality rates.7-11 Analyses in a limited set of hospitals using clinical data have also suggested that sepsis incidence and outcomes may be more stable than previously thought.12-14

The increasing use of electronic health record (EHR) systems allows for the possibility of widespread sepsis surveillance using consistent clinical criteria for concurrent infection and organ dysfunction rather than claims data. In this study, Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) criteria were adapted for public health surveillance and optimized for applicability across different EHR systems. This definition was then applied to EHR data from a diverse set of hospitals to estimate US sepsis incidence and trends from 2009-2014 and to compare with trends estimated from claims data.

Methods
Study Design, Data Sources, and Population

This was a retrospective cohort study using EHR and administrative data from 409 academic, community, and federal acute care hospitals gathered from 7 independent data sets: Brigham and Women’s Hospital, Cerner HealthFacts, Emory Healthcare, Hospital Corporation of America, Institute for Health Metrics, University of Pittsburgh Medical Center health care system, and the Veterans Affairs (VA) hospital system (described further in eMethods 1 in the Supplement). These data sets were chosen to include a broad mix of hospitals that resemble all US acute care hospitals in terms of geographic mix, teaching status, and hospital size (eTable 1 in the Supplement).

The study included adults 20 years or older admitted as inpatients or under observation status or who died in the emergency department in calendar years 2009-2014. Fixed categories of race/ethnicity, as reported by patients in the EHR systems of each health care system, were included to characterize the generalizability of the study dataset and because of previously reported associations between race/ethnicity and sepsis incidence and outcomes.3 The study was approved with a waiver of informed consent by the institutional review boards at Harvard Pilgrim Health Care Institute, Partners HealthCare, University of Pittsburgh, Emory University, and Ann Arbor VA.

Sepsis Clinical Surveillance Definition

As per Sepsis-3 criteria, sepsis was defined as concurrent infection and organ dysfunction.15,16 Suspected infection criteria and the Sequential Organ Failure Assessment (SOFA) score,17 however, were modified to facilitate widespread retrospective surveillance using routinely collected EHR data (Box). Presumed serious infections were defined as a blood culture draw and sustained administration of new antibiotics. Four or more antibiotic days, including at least 1 intravenous antibiotic, were required to identify those most likely to have serious infections and to eliminate patients treated empirically for 48 to 72 hours before culture results were obtained. Fewer than 4 antibiotic days were allowed if death or discharge to hospice or another acute care hospital occurred before 4 days elapsed. Sepsis criteria were met if patients had at least 1 concurrent acute organ dysfunction, defined by initiation of vasopressors or mechanical ventilation, elevated lactate level, or significant changes in baseline creatinine level, bilirubin level, or platelet count. The first antibiotic day and organ dysfunction were required to occur within ±2 calendar days of the blood culture draw.

Box Section Ref ID
Box.

Sepsis Clinical Surveillance Definition

  1. Presumed serious infection:

    • Blood culture obtained (regardless of result), AND

    • ≥4 QADs—starting within ±2 days of blood culture daya

    AND

  2. Acute organ dysfunction (any 1 of the following criteria within ±2 days of blood culture day):

    • Vasopressor initiation (norepinephrine, dopamine, epinephrine, phenylephrine, or vasopressin)b

    • Initiation of mechanical ventilationb

    • Doubling in serum creatinine level or decrease by ≥50% of estimated glomerular filtration rate relative to baseline (excluding patients with ICD-9-CM code for end-stage kidney disease [585.6])c

    • Total bilirubin level ≥2.0 mg/dL and doubling from baselinec

    • Platelet count <100 cells/µL and ≥50% decline from baseline (baseline must be ≥100 cells/µL)c

    • Serum lactate ≥2.0 mmol/Ld

    Sepsis: Presumed serious infection plus ≥1 criteria for acute organ dysfunction

    Septic shock: Presumed serious infection plus vasopressor plus serum lactate level ≥2.0 mmol/L

Abbreviations: ICD-9-CM, International Classification of Diseases, Ninth Revision, Clinical Modification; QAD, qualifying antibiotic day.

a QADs start with the first “new” antibiotic (not given in the prior 2 calendar days) within the ±2-day period surrounding the day of the blood culture draw. Subsequent QADs can be different antibiotics as long as the first dose of each is “new.” Days between administration of the same antibiotic count as QADs as long as the gap is not more than 1 day. At least 1 of the first 4 QADs must include an intravenous antibiotic. If death or discharge to another acute care hospital or hospice occurs prior to 4 days, QADs are required each day until 1 day or less prior to death or discharge.

b Vasopressors and mechanical ventilation are considered to be “initiated” during the ±2-day period surrounding the day of the blood culture draw if there were no vasopressors or mechanical ventilation administered on the prior calendar day.

c For presumed infection present on admission (blood culture day or first QAD occurring on hospital day 1 or 2), baseline laboratory values are defined as the best values during hospitalization. For hospital-onset infection (blood culture day and first QAD occurring on hospital day ≥3), baseline laboratory values are defined as the best values during the ±2-day period surrounding the day of the blood culture draw.

d Serum lactate criterion was excluded from the primary 2009-2014 trends analysis because of risk of ascertainment bias from increasing rates of lactate testing over time.

Organ dysfunction thresholds were selected to generally yield an increase in SOFA score of 2 or more points, to parallel Sepsis-3 criteria. The Glasgow Coma Scale score was not included because it was not measured in most patients and was variably assessed across hospitals.18 Vital signs were also not included because they are not available in all EHRs and are susceptible to transient perturbations and measurement errors. Although not part of the SOFA score, lactate levels of 2.0 mmol/L or greater were included for the analysis of sepsis incidence, outcomes, and clinical characteristics in 2014, given the central role of lactate levels in identifying and risk stratifying sepsis.19,20 As discussed below, however, the lactate criterion was excluded from the primary trends analysis because lactate testing rates are rapidly increasing over time and may thus introduce ascertainment bias.21

Sepsis was defined as hospital onset (vs present on admission) if infection and organ dysfunction criteria first occurred on or after hospital day 3. Baseline laboratory values for creatinine, bilirubin, and platelets were estimated using the best value during hospitalization for infection present on admission, or best values within ±2 days of the blood culture for hospital-onset infection. The entire hospitalization was considered a single case of sepsis if surveillance criteria were met multiple times. Septic shock was defined as presumed serious infection concurrent with vasopressors and serum lactate level 2.0 mmol/L or greater.

Blood culture draws were used to anchor the primary definition because they are an important marker of suspected sepsis and are relatively simple to identify in EHRs. However, a sensitivity analysis was performed using any clinical culture as a broader definition of presumed infection (eAppendix C in the Supplement). These definitions were developed through consensus discussions among the investigative team, informed by prior work using similar approaches.12,14,16,22

Implementation

Case-finding code was created in SAS and SQL and distributed to partners to execute locally against their EHR data arrayed according to a common data specification (detailed description provided in eAppendices A-F in the Supplement). Patient comorbidities were derived from International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes using the Charlson method.23

Validation Using Medical Record Reviews

Study physicians reviewed full text medical records from 510 randomly selected hospitalizations, stratified into those that did and did not meet EHR sepsis surveillance criteria. These hospitalizations were drawn from 3 academic centers and 2 community hospitals in Massachusetts and Georgia. Hospitalizations were classified by reviewers as sepsis-positive if there was definite or possible infection and an increase in SOFA score by 2 or more points from baseline as a result of infection, as per Sepsis-3 criteria.15 “Definite infection” required positive cultures or radiography and a compatible clinical syndrome. “Possible infection” required documentation that the medical team presumed the patient’s illness was due to infection, treated for infection, and did not find an alternative etiology. Reviewers were blinded to whether cases were flagged by EHR surveillance criteria and patients’ ICD-9-CM codes (additional details in eMethods 2 in the Supplement).

Trends

Annual trends in sepsis incidence and in-hospital mortality from 2009-2014 were calculated in the subset of hospitals with historical data (at least 84 hospitals per year) (eTable 2 in the Supplement). In light of rising rates of hospice utilization nationwide,24 the combined outcome of in-hospital death or discharge to hospice was also examined to obtain a more complete picture of trends in sepsis outcomes.

An a priori decision was made to exclude the lactate criterion when assessing whether sepsis incidence and outcomes are changing over time. This was done in light of steady increases in lactate testing rates, which might create ascertainment bias and inflate perceived changes in sepsis incidence.21,25 However, a secondary analysis was performed with the lactate criterion to test this hypothesis.

We also applied 2 claims-based definitions: “explicit” ICD-9-CM codes for severe sepsis (995.92) and septic shock (785.52) and an “implicit” method requiring at least 1 infection code and 1 organ dysfunction code (Angus method) or explicit codes for severe sepsis or septic shock.26,27 To examine whether recognition and coding for sepsis is increasing, we calculated the annual proportion of hospitalizations flagged by the primary EHR surveillance definition that also received sepsis codes.

Statistical Analyses

To account for different hospitals contributing data in different years, 2009-2014 trends were modeled using generalized estimating equations to fit Poisson regression models, adjusting for hospital characteristics (institution, region, teaching status, bed count, and annual admissions) and case mix (median age of hospitalized patients, sex and race/ethnicity distributions, and proportion of intensive care unit [ICU] vs total admissions). Generalized estimating equations were used to account for correlations in the data over time as well as hospital-level clustering. Adjusted rates for 2009-2013 were generated by creating binary indicators for each year in the model, with 2014 as the reference year. The overall change from 2009 to 2014 was summarized as the exponentiated slope of the line between these 2 years on the log scale. All percentages were presented as relative annual changes. VA hospitals were excluded from trends analyses because only data from 2014 were available.

The national weighted incidence and mortality of sepsis among hospitalized adults in 2014 was estimated by projecting study hospital case counts into stratifications of US hospitals by region, size, and teaching status (eMethods 3 in the Supplement).

Missing laboratory data for organ dysfunction calculations were assumed to be normal. Multiple imputation was not performed because missing data were presumed to be missing owing to clinical decisions not to order certain tests rather than missing at random. Data completeness was assessed by inspecting each data element required for the EHR sepsis definition on a hospital-by-hospital–level basis and aggregate rates of organ dysfunction and sepsis incidence and outcomes across each dataset (eFigures 1 and 2 in the Supplement).

Continuous variables were expressed as means. Nonnormally distributed variables were expressed as medians of the medians among the 7 datasets. Analyses were conducted using SAS version 9.3 (SAS Institute) and R version 3.3.1 (http://www.r-project.org). For all analyses, P < .05 (2-sided) was considered statistically significant.

Results
Sepsis Incidence, Clinical Characteristics, and Outcomes in 2014

The 2014 study cohort included 2 901 019 adult encounters in 409 hospitals, representing approximately 10% of all US adult hospitalizations. Study hospitals’ characteristics are reported in Table 1. There were 423 758 patients with presumed serious infection (14.6% incidence [95% CI, 14.6% to 14.7%), of which 32 574 (7.7% [95% CI, 7.6% to 7.8%]) died in the hospital. There were 173 690 patients with sepsis (overall hospital incidence, 6.0% [95% CI, 6.0% to 6.0%]). The clinical characteristics of patients with sepsis are reported in Table 2. Mean age was 66.5 years (SD, 15.5), and 42.4% (95% CI, 42.2% to 42.6%) were women. Comorbidities were common, including diabetes (35.7% [95% CI, 35.5% to 36.0%]), pulmonary disease (30.9% [95% CI, 30.7% to 31.2%]), renal disease (26.8% [95% CI, 26.7% to 27.0%]), and cancer (19.7% [95% CI, 19.5% to 19.9%]). Most sepsis cases (86.8% [95% CI, 86.7% to 87.0%]) were present on admission. Among hospitals (n = 280) for which culture results were available, 17.2% (95% CI, 17.0% to 17.4%) of patients with sepsis had positive blood cultures.

Of the 173 690 patients with sepsis in study hospitals in 2014, 94 956 (54.7%) required ICU care during hospitalization, 27 502 (15.8%) had septic shock, 26 061 (15.0%) died in the hospital, and 10 731 (6.2%) were discharged to hospice (Table 2). Median ICU length of stay was 5 days (range, 2-6). Median hospital length of stay was 10 days (range, 8-12). Hospital mortality was 25.5% among patients with hospital-onset sepsis vs 13.4% for patients with sepsis present on admission (difference, 12.1% [95% CI, 11.5% to 12.7%]; P < .001). Sepsis was present during hospitalization in 34.7% of the 75 079 study patients who died in the hospital in 2014. When adjusting for hospital region, size, and teaching status, the estimated national weighted incidence of sepsis was 5.9% (95% CI, 5.5% to 6.3%), and the in-hospital mortality rate was 15.6% (95% CI, 14.8% to 16.5%) (strata-specific counts reported in eTable 3 in the Supplement). Mortality rates for septic patients were higher for older patients, men, teaching hospitals, and larger hospitals (eTable 4 in the Supplement).

The distribution of organ dysfunctions, and their associated mortality rates, are shown in Figure 1. Approximately 50% of patients with sepsis met at least 2 criteria for acute organ dysfunction.

Validation

On medical record reviews, EHR surveillance criteria had 69.7% sensitivity (95% CI, 52.9% to 92.0%), 98.1% specificity (95% CI, 97.7% to 98.5%), 70.4% positive predictive value (PPV) (95% CI, 64.0% to 76.8%), and 98.0% negative predictive value (95% CI, 95.9% to 99.6%), relative to Sepsis-3 criteria. Explicit sepsis codes had lower sensitivity (32.3% [95% CI, 24.4% to 43.0%] vs 69.7% [95% CI, 52.9% to 92.0%] for EHR criteria, P < .001) but with comparable PPV (75.2% [95% CI, 69.8% to 80.6%] vs 70.4% [95% CI, 64.0% to 76.8%] for EHR criteria, P = .23). The combination of explicit or implicit codes had comparable sensitivity compared with EHR criteria (66.0% [95% CI, 51.4% to 80.7%], P = .37) but lower PPV (31.0% [95% CI, 24.9% to 40.4%], P < .001) (eTable 5 in the Supplement).

Among the 13 Sepsis-3 cases missed by EHR criteria, the most common reason was hypoxemia causing an increase in SOFA score of 2 or more points without need for mechanical ventilation (eTable 6 in the Supplement). None of these 13 patients died. There were 57 false-positives flagged by EHR criteria; most were because clinicians initially suspected infection but medical record reviewers ultimately deemed no infection was present or because patients’ organ dysfunction did not increase SOFA score by 2 or more points (typically patients with elevated lactate levels alone) (eTable 7 in the Supplement). If sepsis was defined as clinically suspected infection with organ dysfunction at the thresholds specified by EHR criteria, PPV was 87.9% (95% CI, 82.7% to 92.0%).

Trends From 2009-2014

The trends analysis included 7 801 624 hospitalizations between 2009-2014 (Figure 2). The annual incidence of sepsis (without the lactate criterion) was stable (+0.6% relative change/y [95% CI, −2.3% to 3.5%], P = .67). In-hospital mortality decreased (−3.3%/y [95% CI, −5.6% to −1.0%], P = .004), but there was no significant change in the combined outcome of death or discharge to hospice (−1.3%/y [95% CI, −3.2% to 0.6%], P = .19). Patients with sepsis were increasingly discharged to hospice over time (+6.3%/y [95% CI, 1.1% to 11.6%], P = .02).

When including lactate as a criterion, sepsis incidence increased (+3.5%/y [95% CI, 0.7% to 6.4%], P = .02), mortality decreased (−5.0%/y [95% CI, −7.3% to −2.7%], P < .001), and death or discharge to hospice decreased (−2.0%/y [95% CI, −3.8% to −0.2%], P = .03).

Sepsis incidence using explicit severe sepsis/septic shock codes increased significantly (+10.3%/y [95% CI, 7.2% to 13.3%], P < .001), as did sepsis/septic shock defined using explicit codes or implicit codes (+7.3%/y [95% CI, 5.0% to 9.5%], P < .001). Mortality declined using explicit codes (−7.0% [95% CI, −8.8% to −5.2%], P < .001) and explicit or implicit codes combined (−6.6%/y [95% CI, −8.3% to −4.8%], P < .001). The combined outcome of death or discharge to hospice also decreased with explicit codes (−4.5% [95% CI, −6.1% to −2.8%], P < .001) and with explicit or implicit codes combined (−3.6% [95% CI, −4.9% to −2.3%], P < .001).

Among patients meeting EHR clinical criteria for sepsis, the proportion who received explicit sepsis codes increased from 24.9% in 2009 to 30.5% in 2014 (difference, 5.6% [95% CI, 5.1% to 6.1%]; P = .007); the proportion who received implicit or explicit codes increased from 58.1% to 63.7% (difference, 5.6% [95% CI, 5.0% to 6.2%]; P = .04).

Sensitivity Analyses

Sensitivity analyses restricted to hospitals that reported data each year from 2009-2014 yielded similar differences in EHR-based vs claims-based trends (eFigure 3 in the Supplement). When any clinical culture was used to indicate presumed infection rather than blood cultures alone, sepsis incidence rates in 2014 were higher (7.1% vs 6.0%; difference, 1.1% [95% CI, 1.0% to 1.1%]; P < .001) and mortality rates lower (14.0% vs 15.0%; difference, 1.0% [95% CI, 0.8% to 1.2%]; P < .001). Clinical characteristics and trends were similar (eTables 8-9 in the Supplement).

Discussion

In this retrospective analysis of more than 2.9 million adults admitted to 409 US hospitals in 2014, clinical indicators of sepsis were present in 6% of hospitalized patients, of whom 21% died in the hospital or were discharged to hospice. Sepsis was present in 35% of all hospitalizations that culminated in death. In contrast to claims-based analyses, sepsis incidence rates using clinical data were stable from 2009-2014; in-hospital mortality rates declined, but there was no significant change in the combined outcome of death or discharge to hospice.

Reliable sepsis surveillance is essential given its high burden, the proliferation of treatment and prevention initiatives, and new national sepsis quality measures. Identifying sepsis using consistent clinical criteria through EHR data, rather than relying on explicit clinical diagnoses or hospital coders, enhances confidence in sepsis estimates because clinicians underrecognize sepsis and vary widely in their knowledge and application of sepsis definitions.28-30 Hospitals also vary significantly in how they assign codes for infection and organ dysfunction, and the presence of both of these codes at discharge does not guarantee that they occurred concurrently.31-33 EHR-based criteria were more sensitive than explicit sepsis codes on medical record review, with comparable PPV; EHR-based criteria had similar sensitivity to implicit or explicit codes combined but higher PPV.

EHR-based clinical surveillance also provides more credible estimates of sepsis trends compared with claims, which can be biased by changing diagnosis and coding practices over time.9,10,13,34 Among patients with sepsis identified using EHR clinical criteria, there was an increase over time in the proportion assigned explicit and implicit sepsis codes, presumably reflecting ongoing efforts to improve sepsis awareness, documentation, and coding. Improving sepsis recognition, including less severe cases, likely accounts for the difference in clinical vs claims-based incidence trends as well as the greater mortality decline seen with claims. The apparent improvement in sepsis-associated mortality was also nullified when also considering discharge to hospice, underscoring the need to consider temporal changes in end-of-life care patterns when assessing trends in clinical outcomes.24

When including elevated lactate levels in the surveillance definition, mild increases in sepsis incidence and decreases in mortality or discharge to hospice were observed. This likely reflects increasingly aggressive lactate testing over time and identification of progressively less ill patients with sepsis, paralleling the increase in sepsis awareness and coding.21,25 Thus, although lactate surveillance can be useful for identifying sepsis cases at a single point, it risks generating misleading impressions of changes in sepsis incidence and outcomes over time.

Ongoing improvements in sepsis coding suggest that claims may eventually reach the accuracy of EHR data. However, the variability of claims between hospitals and their susceptibility to shifting policy and reimbursement incentives limits their use to compare hospitals or assess trends—limitations particularly important in the new era of sepsis quality measures and regulations.9,35 Surveillance experience from other domains, such as health care–associated infections, speak to the risk of reimbursement policies changing coding practices and hence perceived rates that do not reflect true changes in infection rates.36-38

The national weighted sepsis incidence of 5.9% among hospitalized patients and in-hospital mortality of 15.6% estimated in this study would translate into approximately 1.7 million US adult sepsis hospitalizations and 270 000 deaths in 2014. This falls within the wide incidence range of 900 000 to 3.1 million previously estimated using 4 different claims-based definitions.7 The observed mortality rate exceeds the 10% mortality reported in the Sepsis-3 derivation and validation studies.16 This may reflect the more stringent definition of presumed infection (requiring blood cultures and ≥4 days of antibiotics rather than a single dose) and SOFA score adaptations.

Strengths and Limitations

Strengths of the current study include the use of detailed clinical data from a large number of diverse hospitals that together account for approximately 10% of all US acute care hospitalizations in 2014. The data sets came from unrelated hospital networks, limiting the possibility of bias from idiosyncratic clinical, diagnosis, or coding patterns. A sensitivity analysis using a broader definition of presumed infection demonstrated relatively little change in sepsis incidence and outcomes and no difference in trends, supporting the robustness of the primary definition.

This study also has several limitations. First, EHR-based surveillance may be affected by differences in clinical practice between clinicians and hospitals as well as changes over time. This may be most evident with rising rates of lactate testing, but earlier initiation of vasopressors for hypotension and increasing use of noninvasive ventilation and high-flow nasal cannulas for respiratory failure could also affect estimates. The partial dependence on clinician-initiated interventions to measure organ dysfunction, however, is also a limitation of the SOFA score and thus the Sepsis-3 criteria.

Second, only adults in US acute care hospitals were included; future studies should address sepsis in neonates and children, as well as consider ways to identify sepsis outside hospitals and in countries without widespread EHR systems.

Third, not all hospitals contributed data each year for trends analyses. However, regression models were used to adjust for hospital-level differences.

Fourth, the study did not directly ascertain sepsis mortality that occurs after hospital discharge.

Fifth, medical record reviews were only conducted on a fraction of the study cohort. Cases were drawn from both academic and community hospitals, but they still may not be representative of all hospitals.

Sixth, the study dataset might not be representative of national data. However, study hospitals had characteristics similar to those of US hospitals overall and represented a substantial fraction of total admissions nationwide.

Seventh, medical record reviews suggest that EHR-based surveillance may miss up to 30% of patients with sepsis while misclassifying another 30%. Quantifying the accuracy of sepsis criteria is elusive, however, because there is no true gold standard for sepsis.30,39,40 Recognizing this problem, the Sepsis-3 task force developed and validated criteria based on associations with adverse outcomes.15,16 The EHR surveillance definition in this study carried high mortality rates (15%) compared with all encounters with presumed infection (8%), and mortality increased with increasing numbers of dysfunctional organs. On medical record reviews, the Sepsis-3 cases missed by EHR surveillance involved mild organ dysfunction, such as hypoxemia without need for mechanical ventilation, and no patients in that group died. False-positives were most often attributable to reviewers adjudicating the absence of infection despite patients receiving blood culture draws and antibiotics, or a noninfectious cause of organ dysfunction. When sepsis was defined as organ dysfunction concurrent with clinically suspected infection (as is common in practice), PPV of the surveillance definition increased to 88%.

Eighth, neither Sepsis-3 criteria nor EHR-based clinical surveillance can solve the challenge that clinicians routinely face in deciding whether their patient is infected and whether organ dysfunction is due to infection. Instead, EHR surveillance provides a consistent gauge to estimate sepsis incidence and outcomes using readily available, objective clinical data. This method cannot help clinicians identify sepsis at the bedside since it is retrospective, but it may be useful for public health surveillance, hospital evaluation, and assessing the effects of quality improvement efforts. EHR-based surveillance may further support these objectives by facilitating granular evaluation of the timing of sepsis onset and interventions.

Conclusions

In clinical data from 409 hospitals, sepsis was present in 6% of adult hospitalizations, and in contrast to claims-based analyses, neither the incidence of sepsis nor the combined outcome of death or discharge to hospice changed significantly between 2009-2014. The findings also suggest that EHR-based clinical data provide more objective estimates than claims-based data for sepsis surveillance.

Back to top
Article Information

Corresponding Author: Chanu Rhee, MD, MPH, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, 401 Park Dr, Ste 401, Boston, MA 02215 (crhee@bwh.harvard.edu).

Accepted for Publication: August 30, 2017.

Published Online: September 13, 2017. doi:10.1001/jama.2017.13836

Author Contributions: Dr Rhee had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Rhee, Dantes, Epstein, Murphy, Seymour, Iwashyna, Kadri, Angus, Danner, Fiore, Jernigan, Septimus, Warren, Klompas.

Acquisition, analysis, or interpretation of data: Rhee, Dantes, Epstein, Murphy, Seymour, Iwashyna, Kadri, Danner, Martin, Warren, Karcz, Chan, Menchaca, Wang, Gruber, Klompas.

Drafting of the manuscript: Rhee, Murphy, Martin, Septimus, Klompas.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Rhee, Murphy, Seymour, Iwashyna, Chan, Menchaca, Wang, Gruber.

Obtained funding: Rhee, Iwashyna, Fiore, Klompas.

Administrative, technical, or material support: Murphy, Seymour, Iwashyna, Danner, Fiore, Jernigan, Martin, Septimus, Karcz.

Supervision: Dantes, Murphy, Seymour, Iwashyna, Angus, Martin, Klompas.

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Seymour reported receiving personal fees from Beckman Coulter and Edwards Inc. Dr Martin reported reported receiving grants paid to his institution from the US Food and Drug Administration and Bristol-Myers Squibb and serving on the medical advisory boards of Astute Medical, Grifols, and Edwards Lifesciences. Dr Warren reported serving as a consultant for Centene Corp, Worrell Inc, and BD/Carefusion; and receiving funds paid to his institution from Pfizer. No other authors reported disclosures.

Funding/Support: This work was funded by the Centers for Disease Control and Prevention (3U54CK000172-05S2) and in part by the Agency for Healthcare Research and Quality (1K08HS025008-01A1), National Institutes of Health (R35GM119519), Department of Veterans Affairs (HSR&D 11-109), and intramural funding from the National Institutes of Health Clinical Center and National Institute of Allergy and Infectious Diseases.

Role of the Funders/Sponsors: Members of the Centers for Disease Control and Prevention, who are coauthors on this study, contributed to the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, and approval of the manuscript; and decision to submit the manuscript for publication. The other funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review or approval of the manuscript; and decision to submit the manuscript for publication.

Meeting Presentation: This work was presented in abstract form at the 2017 American Thoracic Society Conference (poster A5010).

Disclaimer: Dr Angus, JAMA Associate Editor, had no role in the evaluation of or decision to publish this article. The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention, the National Institutes of Health, or the Department of Veterans Affairs.

Additional Contributions: We thank Richard Platt, MD, MS (Harvard Medical School/Harvard Pilgrim Health Care Institute), Ravi Chari, MD (Hospital Corporation of America), and Jonathan B. Perlin, MD (Hospital Corporation of America), for their support and review of the manuscript. They received no compensation for their contributions. We thank Caren Spencer-Smith, MIS (Hospital Corporation of America), for her assistance in obtaining data for this study. She received no compensation for her time. We thank the following study team members, who did receive compensation, for their assistance in obtaining and analyzing data needed for the study: Brenda Vincent, MS, Wyndy Wiitala, PhD, Vanessa Dickerman, PhD, and Jennifer A. Davis, MHSA (Ann Arbor VA); Jonathan Holton, BS, and Edvin Music, MBA, MSIS (University of Pittsburgh Medical Center); Elizabeth Overton, MS (Emory Healthcare); Richard Schaaf, BS, David Fram, BA, and Karen Eberhardt, BS (Commonwealth Informatics); and Robert Jin, MS (Harvard Medical School/Harvard Pilgrim Health Care Institute).

References
1.
Torio  CM, Andrews  RM. National inpatient hospital costs: the most expensive conditions by payer, 2011: Statistical Brief 160. Healthcare Cost and Utilization Project (HCUP) website. https://www.hcup-us.ahrq.gov/reports/statbriefs/sb160.jsp. 2006. Accessed August 31, 2017.
2.
Liu  V, Escobar  GJ, Greene  JD,  et al.  Hospital deaths in patients with sepsis from 2 independent cohorts.  JAMA. 2014;312(1):90-92.PubMedGoogle ScholarCrossref
3.
Martin  GS, Mannino  DM, Eaton  S, Moss  M.  The epidemiology of sepsis in the United States from 1979 through 2000.  N Engl J Med. 2003;348(16):1546-1554.PubMedGoogle ScholarCrossref
4.
Dombrovskiy  VY, Martin  AA, Sunderram  J, Paz  HL.  Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003.  Crit Care Med. 2007;35(5):1244-1250.PubMedGoogle ScholarCrossref
5.
Lagu  T, Rothberg  MB, Shieh  MS, Pekow  PS, Steingrub  JS, Lindenauer  PK.  Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007.  Crit Care Med. 2012;40(3):754-761.PubMedGoogle ScholarCrossref
6.
Kumar  G, Kumar  N, Taneja  A,  et al; Milwaukee Initiative in Critical Care Outcomes Research (MICCOR) Group of Investigators.  Nationwide trends of severe sepsis in the 21st century (2000-2007).  Chest. 2011;140(5):1223-1231.PubMedGoogle ScholarCrossref
7.
Gaieski  DF, Edwards  JM, Kallan  MJ, Carr  BG.  Benchmarking the incidence and mortality of severe sepsis in the United States.  Crit Care Med. 2013;41(5):1167-1174.PubMedGoogle ScholarCrossref
8.
Shankar-Hari  M, Phillips  GS, Levy  ML,  et al; Sepsis Definitions Task Force.  Developing a new definition and assessing new clinical criteria for septic shock: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):775-787.PubMedGoogle ScholarCrossref
9.
Rhee  C, Gohil  S, Klompas  M.  Regulatory mandates for sepsis care—reasons for caution.  N Engl J Med. 2014;370(18):1673-1676.PubMedGoogle ScholarCrossref
10.
Jafarzadeh  SR, Thomas  BS, Marschall  J, Fraser  VJ, Gill  J, Warren  DK.  Quantifying the improvement in sepsis diagnosis, documentation, and coding: the marginal causal effect of year of hospitalization on sepsis diagnosis.  Ann Epidemiol. 2016;26(1):66-70.PubMedGoogle ScholarCrossref
11.
Klompas  M, Rhee  C.  Sepsis and the theory of relativity: measuring a moving target with a moving measuring stick.  Crit Care. 2016;20(1):396.PubMedGoogle ScholarCrossref
12.
Rhee  C, Kadri  S, Huang  SS,  et al.  Objective sepsis surveillance using electronic clinical data.  Infect Control Hosp Epidemiol. 2016;37(2):163-171.PubMedGoogle ScholarCrossref
13.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Epicenters Program.  Improving documentation and coding for acute organ dysfunction biases estimates of changing sepsis severity and burden: a retrospective study.  Crit Care. 2015;19:338.PubMedGoogle ScholarCrossref
14.
Kadri  SS, Rhee  C, Strich  JR,  et al.  Estimating ten-year trends in septic shock incidence and mortality in United States academic medical centers using clinical data.  Chest. 2017;151(2):278-285.PubMedGoogle ScholarCrossref
15.
Singer  M, Deutschman  CS, Seymour  CW,  et al.  The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):801-810.PubMedGoogle ScholarCrossref
16.
Seymour  CW, Liu  VX, Iwashyna  TJ,  et al.  Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).  JAMA. 2016;315(8):762-774.PubMedGoogle ScholarCrossref
17.
Vincent  JL, Moreno  R, Takala  J,  et al; Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine.  The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure.  Intensive Care Med. 1996;22(7):707-710.PubMedGoogle ScholarCrossref
18.
Bledsoe  BE, Casey  MJ, Feldman  J,  et al.  Glasgow Coma Scale scoring is often inaccurate.  Prehosp Disaster Med. 2015;30(1):46-53.PubMedGoogle ScholarCrossref
19.
Rhodes  A, Evans  LE, Alhazzani  W,  et al.  Surviving Sepsis Campaign: international guidelines for management of sepsis and septic shock: 2016.  Crit Care Med. 2017;45(3):486-552.PubMedGoogle ScholarCrossref
20.
National Quality Forum (NQF). Severe Sepsis and Septic Shock: Management Bundle (Composite Measure). NQF website. http://www.qualityforum.org/Qps/QpsTool.aspx. 2017. Accessed March 24, 2017.
21.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Prevention Epicenters Program.  Lactate testing in suspected sepsis: trends and predictors of failure to measure levels.  Crit Care Med. 2015;43(8):1669-1676.PubMedGoogle ScholarCrossref
22.
Seymour  CW, Coopersmith  CM, Deutschman  CS,  et al.  Application of a framework to assess the usefulness of alternative sepsis criteria.  Crit Care Med. 2016;44(3):e122-e130.PubMedGoogle ScholarCrossref
23.
Charlson  ME, Pompei  P, Ales  KL, MacKenzie  CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.  J Chronic Dis. 1987;40(5):373-383.PubMedGoogle ScholarCrossref
24.
National Hospice and Palliative Care Organization (NHPCO). NHPCO’s facts and figures: hospice care in America. NHPCO website. https://www.nhpco.org/sites/default/files/public/Statistics_Research/2015_Facts_Figures.pdf. 2015. Accessed May 15, 2017.
25.
Casserly  B, Phillips  GS, Schorr  C,  et al.  Lactate measurements in sepsis-induced tissue hypoperfusion: results from the Surviving Sepsis Campaign database.  Crit Care Med. 2015;43(3):567-573.PubMedGoogle ScholarCrossref
26.
Angus  DC, Linde-Zwirble  WT, Lidicker  J, Clermont  G, Carcillo  J, Pinsky  MR.  Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care.  Crit Care Med. 2001;29(7):1303-1310.PubMedGoogle ScholarCrossref
27.
Iwashyna  TJ, Odden  A, Rohde  J,  et al.  Identifying patients with severe sepsis using administrative claims: patient-level validation of the Angus implementation of the International Consensus Conference definition of severe sepsis.  Med Care. 2014;52(6):e39-e43.PubMedGoogle ScholarCrossref
28.
Whittaker  SA, Mikkelsen  ME, Gaieski  DF, Koshy  S, Kean  C, Fuchs  BD.  Severe sepsis cohorts derived from claims-based strategies appear to be biased toward a more severely ill patient population.  Crit Care Med. 2013;41(4):945-953.PubMedGoogle ScholarCrossref
29.
Poeze  M, Ramsay  G, Gerlach  H, Rubulotta  F, Levy  M.  An international sepsis survey: a study of doctors’ knowledge and perception about sepsis.  Crit Care. 2004;8(6):R409-R413.PubMedGoogle ScholarCrossref
30.
Rhee  C, Kadri  SS, Danner  RL,  et al.  Diagnosing sepsis is subjective and highly variable: a survey of intensivists using case vignettes.  Crit Care. 2016;20:89.PubMedGoogle ScholarCrossref
31.
Rothberg  MB, Pekow  PS, Priya  A, Lindenauer  PK.  Variation in diagnostic coding of patients with pneumonia and its association with hospital risk-standardized mortality rates: a cross-sectional analysis.  Ann Intern Med. 2014;160(6):380-388.PubMedGoogle ScholarCrossref
32.
Utter  GH, Cuny  J, Strater  A, Silver  MR, Hossli  S, Romano  PS.  Variation in academic medical centers’ coding practices for postoperative respiratory complications: implications for the AHRQ postoperative respiratory failure Patient Safety Indicator.  Med Care. 2012;50(9):792-800.PubMedGoogle ScholarCrossref
33.
Lorence  DP, Ibrahim  IA.  Benchmarking variation in coding accuracy across the United States.  J Health Care Finance. 2003;29(4):29-42.PubMedGoogle Scholar
34.
Rhee  C, Murphy  MV, Li  L, Platt  R, Klompas  M; Centers for Disease Control and Prevention Epicenters Program.  Comparison of trends in sepsis incidence and coding using administrative claims versus objective clinical data.  Clin Infect Dis. 2015;60(1):88-95.PubMedGoogle ScholarCrossref
35.
Gohil  SK, Cao  C, Phelan  M,  et al.  Impact of policies on the rise in sepsis incidence, 2000-2010.  Clin Infect Dis. 2016;62(6):695-703.PubMedGoogle ScholarCrossref
36.
Calderwood  MS, Kleinman  K, Soumerai  SB,  et al.  Impact of Medicare’s payment policy on mediastinitis following coronary artery bypass graft surgery in US hospitals.  Infect Control Hosp Epidemiol. 2014;35(2):144-151.PubMedGoogle ScholarCrossref
37.
Kawai  AT, Calderwood  MS, Jin  R,  et al.  Impact of the Centers for Medicare and Medicaid Services hospital-acquired conditions policy on billing rates for 2 targeted healthcare-associated infections.  Infect Control Hosp Epidemiol. 2015;36(8):871-877.PubMedGoogle ScholarCrossref
38.
Metersky  ML, Wang  Y, Klompas  M, Eckenrode  S, Bakullari  A, Eldridge  N.  Trend in ventilator-associated pneumonia rates Between 2005 and 2013.  JAMA. 2016;316(22):2427-2429.PubMedGoogle ScholarCrossref
39.
Angus  DC, Seymour  CW, Coopersmith  CM,  et al.  A framework for the development and interpretation of different sepsis definitions and clinical criteria.  Crit Care Med. 2016;44(3):e113-e121.PubMedGoogle ScholarCrossref
40.
Klompas  M, Rhee  C.  We need better tools for sepsis surveillance.  Crit Care Med. 2016;44(7):1441-1442.PubMedGoogle ScholarCrossref
×