[Skip to Navigation]
Sign In
Figure 1.  Enrollment Flowchart for Adults Seen in the Hospital for Febrile Illness, Northern Tanzania, 2016-2019
Enrollment Flowchart for Adults Seen in the Hospital for Febrile Illness, Northern Tanzania, 2016-2019
Figure 2.  Area Under the Receiver Operating Characteristic Curve (AUROC) Values for Clinical Prognostic Scores Using All Ordinal Values for In-Hospital Death in Participants With Febrile Illness, Northern Tanzania, 2016-2019
Area Under the Receiver Operating Characteristic Curve (AUROC) Values for Clinical Prognostic Scores Using All Ordinal Values for In-Hospital Death in Participants With Febrile Illness, Northern Tanzania, 2016-2019

The dashed diagonal line is a reference line representative of a test with no discriminatory ability (AUROC = 0.5). MEWS indicates Modified Early Warning Score; NEWS, National Early Warning Score; qSOFA, quick Sequential Organ Failure Assessment; SIRS, systemic inflammatory response syndrome; and UVA, Universal Vital Assessment.

Table 1.  Baseline Characteristics of Participants Admitted to the Hospital With Febrile Illness, Northern Tanzania, 2016-2019
Baseline Characteristics of Participants Admitted to the Hospital With Febrile Illness, Northern Tanzania, 2016-2019
Table 2.  Baseline Risk Scores and Risk of Death by Proposed Risk Score Cutoffs for Participants With Febrile Illness, Northern Tanzania, 2016-2019
Baseline Risk Scores and Risk of Death by Proposed Risk Score Cutoffs for Participants With Febrile Illness, Northern Tanzania, 2016-2019
Table 3.  Risk Score Prognostic Performance for In-Hospital Death by Proposed Score Cutoffs in Participants With Febrile Illness, Northern Tanzania, 2016-2019
Risk Score Prognostic Performance for In-Hospital Death by Proposed Score Cutoffs in Participants With Febrile Illness, Northern Tanzania, 2016-2019
1.
GBD 2017 DALYs and HALE Collaborators.  Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017.   Lancet. 2018;392(10159):1859-1922. doi:10.1016/S0140-6736(18)32335-3 PubMedGoogle ScholarCrossref
2.
Feikin  DR, Olack  B, Bigogo  GM,  et al.  The burden of common infectious disease syndromes at the clinic and household level from population-based surveillance in rural and urban Kenya.   PLoS One. 2011;6(1):e16085. doi:10.1371/journal.pone.0016085 PubMedGoogle Scholar
3.
Crump  JA, Morrissey  AB, Nicholson  WL,  et al.  Etiology of severe non-malaria febrile illness in northern Tanzania: a prospective cohort study.   PLoS Negl Trop Dis. 2013;7(7):e2324. doi:10.1371/journal.pntd.0002324 PubMedGoogle Scholar
4.
Kotloff  KL, Nataro  JP, Blackwelder  WC,  et al.  Burden and aetiology of diarrhoeal disease in infants and young children in developing countries (the Global Enteric Multicenter Study, GEMS): a prospective, case-control study.   Lancet. 2013;382(9888):209-222. doi:10.1016/S0140-6736(13)60844-2 PubMedGoogle ScholarCrossref
5.
Pneumonia Etiology Research for Child Health (PERCH) Study Group.  Causes of severe pneumonia requiring hospital admission in children without HIV infection from Africa and Asia: the PERCH multi-country case-control study.   Lancet. 2019;394(10200):757-779. doi:10.1016/S0140-6736(19)30721-4 PubMedGoogle ScholarCrossref
6.
Rubach  MP, Maro  VP, Bartlett  JA, Crump  JA.  Etiologies of illness among patients meeting integrated management of adolescent and adult illness district clinician manual criteria for severe infections in northern Tanzania: implications for empiric antimicrobial therapy.   Am J Trop Med Hyg. 2015;92(2):454-462. doi:10.4269/ajtmh.14-0496 PubMedGoogle ScholarCrossref
7.
Taylor  AW, Blau  DM, Bassat  Q,  et al; CHAMPS Consortium.  Initial findings from a novel population-based child mortality surveillance approach: a descriptive study.   Lancet Glob Health. 2020;8(7):e909-e919. doi:10.1016/S2214-109X(20)30205-9 PubMedGoogle ScholarCrossref
8.
Singer  M, Deutschman  CS, Seymour  CW,  et al.  The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).   JAMA. 2016;315(8):801-810. doi:10.1001/jama.2016.0287 PubMedGoogle ScholarCrossref
9.
Bone  RC, Balk  RA, Cerra  FB,  et al; The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine.  Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis.   Chest. 1992;101(6):1644-1655. doi:10.1378/chest.101.6.1644 PubMedGoogle ScholarCrossref
10.
Subbe  CP, Kruger  M, Rutherford  P, Gemmel  L.  Validation of a modified Early Warning Score in medical admissions.   QJM. 2001;94(10):521-526. doi:10.1093/qjmed/94.10.521 PubMedGoogle ScholarCrossref
11.
Do  SN, Luong  CQ, Pham  DT,  et al.  Factors relating to mortality in septic patients in Vietnamese intensive care units from a subgroup analysis of MOSAICS II study.   Sci Rep. 2021;11(1):18924. doi:10.1038/s41598-021-98165-8PubMedGoogle ScholarCrossref
12.
Ssekitoleko  R, Pinkerton  R, Muhindo  R, Bhagani  S, Moore  CC.  Aggregate evaluable organ dysfunction predicts in-hospital mortality from sepsis in Uganda.   Am J Trop Med Hyg. 2011;85(4):697-702. doi:10.4269/ajtmh.2011.10-0692 PubMedGoogle ScholarCrossref
13.
Rylance  J, Baker  T, Mushi  E, Mashaga  D.  Use of an early warning score and ability to walk predicts mortality in medical patients admitted to hospitals in Tanzania.   Trans R Soc Trop Med Hyg. 2009;103(8):790-794. doi:10.1016/j.trstmh.2009.05.004 PubMedGoogle ScholarCrossref
14.
Wheeler  I, Price  C, Sitch  A,  et al.  Early warning scores generated in developed healthcare settings are not sufficient at predicting early mortality in Blantyre, Malawi: a prospective cohort study.   PLoS One. 2013;8(3):e59830. doi:10.1371/journal.pone.0059830 PubMedGoogle Scholar
15.
Kruisselbrink  R, Kwizera  A, Crowther  M,  et al.  Modified Early Warning Score (MEWS) identifies critical illness among ward patients in a resource restricted setting in Kampala, Uganda: a prospective observational study.   PLoS One. 2016;11(3):e0151408. doi:10.1371/journal.pone.0151408 PubMedGoogle Scholar
16.
Rudd  KE, Seymour  CW, Aluisio  AR,  et al; Sepsis Assessment and Identification in Low Resource Settings (SAILORS) Collaboration.  Association of the Quick Sequential (Sepsis-Related) Organ Failure Assessment (qSOFA) score with excess hospital mortality in adults with suspected infection in low- and middle-income countries.   JAMA. 2018;319(21):2202-2211. doi:10.1001/jama.2018.6229 PubMedGoogle ScholarCrossref
17.
Moore  CC, Hazard  R, Saulters  KJ,  et al.  Derivation and validation of a universal vital assessment (UVA) score: a tool for predicting mortality in adult hospitalised patients in sub-Saharan Africa.   BMJ Glob Health. 2017;2(2):e000344. doi:10.1136/bmjgh-2017-000344 PubMedGoogle Scholar
18.
Stenhouse  C, Coates  S, Tivey  M, Allsop  P, Parker  T.  Prospective evaluation of a modified Early Warning Score to aid earlier detection of patients developing critical illness on a general surgical ward.   Br J Anaesth. 2000;84(5):663P. doi:10.1093/bja/84.5.663Google ScholarCrossref
19.
Klinger  A, Mueller  A, Sutherland  T,  et al.  Predicting mortality in adults with suspected infection in a Rwandan hospital: an evaluation of the adapted MEWS, qSOFA and UVA scores.   BMJ Open. 2021;11(2):e040361. doi:10.1136/bmjopen-2020-040361 PubMedGoogle Scholar
20.
Prin  M, Pan  S, Kadyaudzu  C, Li  G, Charles  A.  ICU risk stratification models feasible for use in sub-Saharan Africa show poor discrimination in Malawi: a prospective cohort study.   World J Surg. 2019;43(10):2357-2364. doi:10.1007/s00268-019-05078-9 PubMedGoogle ScholarCrossref
21.
Schmedding  M, Adegbite  BR, Gould  S,  et al.  A prospective comparison of Quick Sequential Organ Failure Assessment, Systemic Inflammatory Response Syndrome Criteria, Universal Vital Assessment, and Modified Early Warning Score to predict mortality in patients with suspected infection in Gabon.   Am J Trop Med Hyg. 2019;100(1):202-208. doi:10.4269/ajtmh.18-0577 PubMedGoogle ScholarCrossref
22.
Royal College of Physicians.  National Early Warning Score (NEWS): Standardizing the Assessment of Acute-Illness Severity in the NHS. Royal College of Physicians; 2012.
23.
Bossuyt  PM, Reitsma  JB, Bruns  DE,  et al; STARD Group.  STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies.   BMJ. 2015;351(h5527):h5527. doi:10.1136/bmj.h5527 PubMedGoogle Scholar
24.
Population Based HIV Impact Assessment (PHIA).  Tanzania HIV Impact Survey (THIS) 2016-2017. Columbia University; 2017. Accessed May 26, 2021. https://phia.icap.columbia.edu/wp-content/uploads/2017/11/Tanzania_SummarySheet_A4.English.v19.pdf
25.
Gething  PW, Patil  AP, Smith  DL,  et al.  A new world malaria map: Plasmodium falciparum endemicity in 2010.   Malar J. 2011;10:378. doi:10.1186/1475-2875-10-378 PubMedGoogle ScholarCrossref
26.
United Republic of Tanzania Ministry of Health, Community Development, Gender, Elderly and Children. Tanzania malaria indicator survey 2017. August 2018. Accessed May 26, 2021. https://dhsprogram.com/pubs/pdf/MIS31/MIS31.pdf
27.
Tang  AM, Chung  M, Dong  K,  et al. Determining a global mid-upper arm circumference cutoff to assess underweight in adults (men and nonpregnant women). June 2017. Food and Nutrition Technical Assistance III Project. FHI 360/FANTA. Accessed November 11, 2021. https://www.fantaproject.org/sites/default/files/resources/Global-MUAC-Cutoffs-nonPregnant-Adults-Jun2017.pdf
28.
World Health Organization.  Imai District Clinician Manual: Hospital Care for Adolescents and Adults: Guidelines for the Management of Common Illnesses With Limited Resources. World Health Organization; 2011.
29.
Carugati  M, Zhang  HL, Kilonzo  KG,  et al.  Predicting mortality for adolescent and adult patients with fever in resource-limited settings.   Am J Trop Med Hyg. 2018;99(5):1246-1254. doi:10.4269/ajtmh.17-0682 PubMedGoogle ScholarCrossref
30.
DeLong  ER, DeLong  DM, Clarke-Pearson  DL.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.   Biometrics. 1988;44(3):837-845. doi:10.2307/2531595 PubMedGoogle ScholarCrossref
31.
Crump  JA.  Typhoid fever and the challenge of nonmalaria febrile illness in sub-Saharan Africa.   Clin Infect Dis. 2012;54(8):1107-1109. doi:10.1093/cid/cis024 PubMedGoogle ScholarCrossref
32.
Huson  MAM, Katete  C, Chunda  L,  et al.  Application of the qSOFA score to predict mortality in patients with suspected infection in a resource-limited setting in Malawi.   Infection. 2017;45(6):893-896. doi:10.1007/s15010-017-1057-5 PubMedGoogle ScholarCrossref
33.
Foy  KE, Pearson  J, Kettley  L, Lal  N, Blackwood  H, Bould  MD.  Four early warning scores predict mortality in emergency surgical patients at University Teaching Hospital, Lusaka: a prospective observational study.   Can J Anaesth. 2020;67(2):203-212. doi:10.1007/s12630-019-01503-8 PubMedGoogle ScholarCrossref
34.
Beane  A, De Silva  AP, De Silva  N,  et al.  Evaluation of the feasibility and performance of early warning scores to identify patients at risk of adverse outcomes in a low-middle income country setting.   BMJ Open. 2018;8(4):e019387. doi:10.1136/bmjopen-2017-019387 PubMedGoogle Scholar
Original Investigation
Global Health
December 16, 2021

Performance Assessment of the Universal Vital Assessment Score vs Other Illness Severity Scores for Predicting Risk of In-Hospital Death Among Adult Febrile Inpatients in Northern Tanzania, 2016-2019

Author Affiliations
  • 1Department of Pathology, Duke University Medical Center, Durham, North Carolina
  • 2Division of Infectious Diseases and International Health, Department of Medicine, Duke University Medical Center, Durham, North Carolina
  • 3Duke Global Health Institute, Duke University, Durham, North Carolina
  • 4Kilimanjaro Christian Medical Centre, Moshi, Tanzania
  • 5Programme in Emerging Infectious Diseases, Duke–National University of Singapore Medical School, Singapore
  • 6Department of Medicine, University of Otago, Dunedin, New Zealand
  • 7Centre for International Health, University of Otago, Dunedin, New Zealand
  • 8Kilimanjaro Christian Medical University College, Tumaini University, Moshi, Tanzania
  • 9Mawenzi Regional Referral Hospital, Moshi, Tanzania
  • 10Kilimanjaro Clinical Research Institute, Moshi, Tanzania
JAMA Netw Open. 2021;4(12):e2136398. doi:10.1001/jamanetworkopen.2021.36398
Key Points

Question  How does the Universal Vital Assessment (UVA) score perform compared with other common illness severity scores in predicting in-hospital death for febrile hospitalized patients in a lower-income setting?

Findings  In this prognostic study of 597 adults hospitalized with febrile illness in northern Tanzania, the UVA score and National Early Warning Score outperformed other illness severity scores at predicting risk of in-hospital death. Scores of 2 or higher on the UVA were associated with significant increases in risk of death.

Meaning  The findings of this study indicate that, as a clinical illness severity measure using readily available clinical data appropriate to resource-limited settings, the UVA shows promise for predicting risk of in-hospital mortality among febrile inpatients in lower-income settings.

Abstract

Importance  Severity scores are used to improve triage of hospitalized patients in high-income settings, but the scores may not translate well to low- and middle-income settings such as sub-Saharan Africa.

Objective  To assess the performance of the Universal Vital Assessment (UVA) score, derived in 2017, compared with other illness severity scores for predicting in-hospital mortality among adults with febrile illness in northern Tanzania.

Design, Setting, and Participants  This prognostic study used clinical data collected for the duration of hospitalization among patients with febrile illness admitted to Kilimanjaro Christian Medical Centre or Mawenzi Regional Referral Hospital in Moshi, Tanzania, from September 2016 through May 2019. All adult and pediatric patients with a history of fever within 72 hours or a tympanic temperature of 38.0 °C or higher at screening were eligible for enrollment. Of 3761 eligible participants, 1132 (30.1%) were enrolled in the parent study; of those, 597 adults 18 years or older were included in this analysis. Data were analyzed from December 2019 to September 2021.

Exposures  Modified Early Warning Score (MEWS), National Early Warning Score (NEWS), quick Sequential Organ Failure Assessment (qSOFA), Systemic Inflammatory Response Syndrome (SIRS) assessment, and UVA.

Main Outcomes and Measures  The main outcome was in-hospital mortality during the same hospitalization as the participant’s enrollment. Crude risk ratios and 95% CIs for in-hospital death were calculated using log-binomial risk regression for proposed score cutoffs for each of the illness severity scores. The area under the receiver operating characteristic curve (AUROC) for estimating the risk of in-hospital death was calculated for each score.

Results  Among 597 participants, the median age was 43 years (IQR, 31-56 years); 300 participants (50.3%) were female, 198 (33.2%) were HIV-infected, and in-hospital death occurred in 55 (9.2%). By higher risk score strata for each score, compared with lower risk strata, risk ratios for in-hospital death were 3.7 (95% CI, 2.2-6.2) for a MEWS of 5 or higher; 2.7 (95% CI, 0.9-7.8) for a NEWS of 5 or 6; 9.6 (95% CI, 4.2-22.2) for a NEWS of 7 or higher; 4.8 (95% CI, 1.2-20.2) for a qSOFA score of 1; 15.4 (95% CI, 3.8-63.1) for a qSOFA score of 2 or higher; 2.5 (95% CI, 1.2-5.2) for a SIRS score of 2 or higher; 9.1 (95% CI, 2.7-30.3) for a UVA score of 2 to 4; and 30.6 (95% CI, 9.6-97.8) for a UVA score of 5 or higher. The AUROCs, using all ordinal values, were 0.85 (95% CI, 0.80-0.90) for the UVA score, 0.81 (95% CI, 0.75-0.87) for the NEWS, 0.75 (95% CI, 0.69-0.82) for the MEWS, 0.73 (95% CI, 0.67-0.79) for the qSOFA score, and 0.63 (95% CI, 0.56-0.71) for the SIRS score. The AUROC for the UVA score was significantly greater than that for all other scores (P < .05 for all comparisons) except for NEWS (P = .08).

Conclusions and Relevance  This prognostic study found that the NEWS and the UVA score performed favorably compared with other illness severity scores in predicting in-hospital mortality among a hospitalized cohort of adults with febrile illness in northern Tanzania. Given its reliance on readily available clinical data, the UVA score may have utility in the triage and prognostication of patients admitted to the hospital with febrile illness in low- to middle-income settings such as sub-Saharan Africa.

Introduction

Infectious diseases are a leading cause of acute illness, disability, and death worldwide.1,2 Despite efforts to improve scientific knowledge of febrile illness in low- and middle-income countries (LMICs),3-7 the tools available to improve management of such acute illness remain inadequate.

A major component of research on the management of acute febrile illness focuses on the appropriate identification and triage of severely ill patients once they reach the health care system. In high-income countries, several illness severity scores have been developed for patients with severe illness, including patients with febrile illness.8-10 However, most such models were developed entirely within high-income settings. In sub-Saharan Africa and other LMIC settings, the etiology of febrile illness differs from that in temperate high-income countries.3,5,6 Furthermore, severe febrile illness outcomes likely differ owing to patterns of comorbidities and the availability of intensive care.11 It is unsurprising that studies of existing illness severity scores derived in high-income countries have shown mixed results for predictive performance for adverse outcomes in LMICs.12-16

In response to the limitations of existing predictive outcome models to identify hospital-admitted patients at high risk of death in resource-limited settings, the Universal Vital Assessment (UVA) score was derived and initially proposed in 2017 to predict inpatient mortality in sub-Saharan Africa.17 Derived from pooled data from studies of hospitalized patients in sub-Saharan Africa, the score uses easily measured clinical data, including temperature, heart and respiratory rates, systolic blood pressure, oxygen saturation, Glasgow Coma Scale scores, and HIV infection status.17 Initial internal validation showed a greater area under the receiver operating characteristic curve (AUROC) than that for the Modified Early Warning Score (MEWS)18 and the quick Sequential Organ Failure Assessment (qSOFA) score8 in the pooled cohort. To our knowledge, to date, 3 prospective external assessments have compared UVA scores with other predictive scores in sub-Saharan Africa: 1 showed only moderate performance across scores for predicting mortality at a single center in Rwanda19; another showed poor performance in a single-center, primarily surgical intensive care cohort in Malawi20; and a study in Gabon showed favorable performance for the UVA but was markedly limited by sample size and statistical power.21

We assessed the predictive performance of the UVA score for in-hospital mortality within a prospective cohort of patients admitted with febrile illness to 1 of 2 hospitals in northern Tanzania. We also compared the performance of the UVA with that of other common predictive tools—the National Early Warning Score (NEWS),22 the MEWS, the qSOFA score, and the Systemic Inflammatory Response Syndrome (SIRS) score.9

Methods
Ethics Statement

This prognostic study was approved by the Kilimanjaro Christian Medical University College’s Research Ethical Review Committee, the United Republic of Tanzania’s National Institute for Medical Research National Health Research Ethics Committee, and the Duke University Health System Institutional Review Board. Adults 18 years or older provided their own written consent when feasible, and those with impaired consciousness were enrolled with written consent from next of kin. This study was conducted in accordance with the Standards for Reporting of Diagnostic Accuracy (STARD) 2015 reporting guideline (eTable 2 in the Supplement).23

Study Setting

Moshi is a municipality (population approximately 200 000) and the administrative center of the Kilimanjaro Region (population >1.6 million) in northern Tanzania. In 2016-2017, the estimated prevalence of HIV among adults 15 to 64 years in the Kilimanjaro Region was 2.6%.24 Viral suppression of HIV in the Kilimanjaro Region was estimated at 67% in 2017 among individuals who access health care resources.24 The transmission intensity of malaria is low in the Kilimanjaro Region,25 with an estimated child community malaria parasite prevalence of less than 1% in 2017.26 Kilimanjaro Christian Medical Centre is the 630-bed referral hospital for northern Tanzania and the site of a university medical college. Mawenzi Regional Referral Hospital is a 300-bed regional hospital that serves the Kilimanjaro Region.

Study Design and Procedures

We conducted a prospective cohort study of patients with febrile illness admitted to Kilimanjaro Christian Medical Centre or Mawenzi Regional Referral Hospital in Moshi, Tanzania, from September 2016 to May 2019. Both adult and pediatric patients were included in the study. For the data analysis of the present prognostic study, participants were included if 18 years or older, consistent with the initial derivation and validation of the UVA score.17 Within 24 hours of admission, all adult and pediatric patients admitted to the medical ward were screened for those with a history of fever within 72 hours or a tympanic temperature of 38.0 °C or higher. Enrolled participants had a standardized clinical history and physical examination performed by trained study staff that included measurement of vital signs, mid–upper arm circumference,27 percutaneous oximetry, and assessment of mental status by both the Glasgow Coma Scale and alert-voice-pain-unconscious scores. Blood testing was performed, including HIV antibody testing, blood cultures, complete blood cell counts, blood smear for parasites, and lactate testing. Testing for HIV antibodies was performed using SD BIOLINE HIV 1/2 3.0 (Abbott Laboratories), and positive tests were confirmed by Uni-Gold HIV (Trinity Biotech). Blood culture bottles were BACT/ALERT FA PLUS bottles loaded into the BACT/ALERT 3D microbial detection system (bioMérieux), and 2 sets of culture bottles were collected when feasible. Testing for CD4+ T lymphocytes was performed for HIV-infected participants using the FACSCalibur platform (BD Biosciences). Lactate testing was performed using the StatStrip Lactate System (Nova Biomedical). Participants were followed up during their hospitalization for ascertainment of in-hospital outcome.

Definitions

The primary outcome for this study was in-hospital death, defined as participant death at Kilimanjaro Christian Medical Centre or Mawenzi Regional Referral Hospital during the same hospitalization as their enrollment. Blood cultures were considered positive if there was growth from either set of cultures collected. Single cultures positive for normal skin flora, including Micrococcus species, coagulase-negative Staphylococcus species, and Streptococcus species other than S pneumoniae, were not considered to be potential pathogens. Hypoxemia was defined as peripheral oxygen saturation of less than 92% on room air or the use of supplemental oxygen. A lactate level cutoff of 36 mg/dL or more (to convert to millimoles per liter, multiply by 0.111) was chosen in the analysis given its greater likelihood of representing participants with shock than a cutoff of 18 mg/dL or more; both thresholds were assessed in the Third International Consensus Definitions for Sepsis and Septic Shock definition.8

Scores for predictive models were determined based on the original definitions proposed for each model, using clinical data collected by the study team at enrollment.8,10,18,22 The full calculation scheme for each severity score is depicted in eTable 1 in the Supplement. All scores were analyzed by standard proposed cutoffs and in their entirety, including all ordinal values, with respect to performance characteristics in the study cohort. Although all scores included in this study have been assessed for performance in predicting inpatient mortality,8,16-18,22 the MEWS and NEWS are primarily used to assess the risk of inpatient clinical deterioration,18,22 and the qSOFA and SIRS scores have been used to assist in both classifying and triaging patients with sepsis.8,9

Participants were also classified based on the World Health Organization’s Integrated Management of Adolescent and Adult Illness guidelines28 as having septic shock or severe respiratory distress without shock. Septic shock was defined by the Integrated Management of Adolescent and Adult Illness guidelines as systolic blood pressure less than 90 mm Hg and either a heart rate greater than 100/min, a respiratory rate greater than 24/min, or a temperature greater than 38 °C or less than 36 °C. The Integrated Management of Adolescent and Adult Illness guidelines defined severe respiratory distress without shock as a respiratory rate greater than 30/min or peripheral oxygen saturation less than 90% and a systolic blood pressure of 90 mm Hg or greater. Presence of radiographic pneumonia or clinical heart failure were excluded from the latter definition because these data were not available.

Power Calculation

We performed an assessment of statistical power for this study based on our ability to find a difference between the UVA and qSOFA scores as the primary comparators of interest. Based on published literature, we expected AUROC values for predicting in-hospital mortality of 0.85 for the UVA and 0.75 for the qSOFA.17,21,29 With an expected mortality of 10% based on a prior febrile cohort at our 2 study hospitals3 and assuming at least moderate correlation between UVA and qSOFA scores (r ≥ 0.4) for the 597 participants included in the study, we estimated that our analysis had a minimum of 80% power to detect a difference of 0.1 between AUROC values for UVA and qSOFA scores.

Statistical Analysis

Descriptive statistics were used, including medians and IQRs for nonnormally distributed variables, as assessed by the Shapiro-Wilk test. No normally distributed continuous variables were included. Categorical variables were presented as frequencies. To assess for differences between those who died in the hospital and those who survived, the rank sum test was used for nonnormally distributed continuous variables. The χ2 test of independence was used to compare proportions for binomial variables where all observed counts of cells in a 2 × 2 contingency table were 5 or greater; the Fisher exact test was used for any with fewer than 5. Crude risk ratios and 95% CIs for in-hospital death were calculated using log-binomial risk regression for each proposed score cutoff. Performance characteristics for predicting in-hospital death were calculated for each score, which included sensitivity, specificity, positive and negative predictive values, positive and negative likelihood ratios, and the AUROC. The AUROCs were compared using a method suggested by DeLong et al30 as implemented in Stata, version 16 (StataCorp LLC). Statistical significance was defined as 2-sided P < .05 for each of these comparisons. All statistical analyses were performed using Stata, version 16. Data were analyzed from December 2019 to September 2021.

Results
Baseline Clinical Characteristics

Of 3761 eligible participants, 1132 (30.1%) were enrolled in the parent study, 618 of whom (54.6%) were adults 18 years or older and eligible for the present analysis (Figure 1). Of the 618 eligible participants, 21 (3.4%) were excluded owing to missing variables relevant to score calculation; thus, 597 adults were included in the final analysis. The median age of participants was 43 years (IQR, 31-56 years) (P = .08), and 300 participants (50.3%) were female (P = .13).

Baseline characteristics from the full cohort and the HIV-infected subgroup by outcome are compared in Table 1. Of the 597 participants, 55 (9.2%) died in the hospital. There were 198 HIV-infected participants (33.2% of the full cohort), of whom 35 (17.7%) died in the hospital. Thirty-seven HIV-infected patients (18.7%) reported no HIV infection at the time of admission and tested positive for HIV during their hospitalization. The median CD4+ T lymphocyte count among all participants with an HIV infection was 121 cells/mm3 (IQR, 24-288 cells/mm3). Among participants who reported no HIV infection but tested positive for HIV, the median CD4+ T lymphocyte count was 138 cells/mm3 (IQR, 46-230 cells/mm3). Of the 161 participants who reported HIV infection at the time of enrollment, 120 (74.5%) reported taking any antiretroviral regimen and 95 (59.0%) reported taking trimethoprim-sulfamethoxazole.

Baseline Prognostic Scores for Participants

The median scores for each prognostic test and the risk of death based on proposed cutoff scores by prognostic test for the total cohort and the HIV-infected cohort are summarized in Table 2. For the total cohort by UVA score, compared with participants with scores less than 1, the RRs for in-hospital death were 9.1 (95 CI, 2.7-30.3) for those with scores from 2 to 4 and 30.6 (95% CI, 9.6-97.8) for those with scores of 5 or higher. For the NEWS, compared with the low-risk group (scores ≤4), the RRs were 2.7 (95% CI, 0.9-7.8) for those with scores of 5 or 6 and 9.6 (95% CI, 4.2-22.2) for those with scores of 7 or higher. For the qSOFA, compared with participants with scores of 0, those with scores of 1 had an RR of 4.8 (95% CI, 1.2-20.2) compared with 15.4 (95% CI, 3.8-63.1) for those with scores of 2 or higher. For the dichotomous risk strata of the 2 other tests, compared with the lower-risk groups, the RRs for death were 2.5 (95% CI, 1.2-5.2) for those with a SIRS score of 2 or higher and 3.7 (95% CI, 2.2-6.2) for those with a MEWS of 5 or higher.

Performance of Predictive Scores

The sensitivity of the respective scores and their cutoffs for predicting death ranged from 56.4% to 96.4%, whereas specificity had a range of 25.3% to 87.5% (Table 3). Positive predictive values ranged from 11.2% to 32.0%, and negative predictive values ranged from 94.7% to 99.0%. Moving the UVA cutoff from a score of 2 or higher to a score of 5 or higher was associated with a decrease in sensitivity from 94.5% (95% CI, 84.0%-98.9%) to 58.2% (95% CI, 44.1%-71.3%) and an increase in specificity from 52.4% (95% CI, 48.1%-56.7%) to 87.5% (95% CI, 84.4%-90.1%).

The AUROC values by severity score cutoff are also shown in Table 3. The AUROC values ranged from 0.58 for a SIRS score of 2 or higher to 0.74 for both a UVA score of 2 or higher and a NEWS of 7 or higher. Considering performance of the scores by all included ordinal values, the AUROC values were as follows (Figure 2): UVA, 0.85 (95% CI, 0.80-0.90); NEWS, 0.81 (95% CI, 0.75-0.87); MEWS, 0.75 (95% CI, 0.69-0.82); qSOFA, 0.73 (95% CI, 0.67-0.79); and SIRS, 0.63 (95% CI, 0.56-0.71). When these AUROC values were compared with one another, UVA scores had statistically higher values than MEWS, qSOFA, and SIRS scores (P < .001 for each) but not NEWS (P = .08). Scores for the participants with an HIV infection are presented in eTables 3 and 4 in the Supplement.

Discussion

In this prognostic study of illness severity scores among hospitalized adult patients with febrile illness, the UVA score and NEWS showed the best performance for estimating the risk of in-hospital death among the study cohort, with AUROC values of 0.85 and 0.81, respectively. The AUROC values decreased for the MEWS, qSOFA score, and SIRS score, respectively. Most of the cutoffs for each prognostic score were statistically associated with an increased risk of in-hospital death with increasing score. However, the UVA score showed the greatest discriminatory power, with statistically significant and meaningful increases in estimated risk of death for scores of 2 to 4 and 5 or higher; NEWS values of 5 to 6 compared with those of 4 or lower were not associated with a significant increase in mortality.

These data are consistent with the findings of derivation and validation studies of the UVA score’s predictive performance compared with that of other illness severity scores in LMICs.17,21 In the UVA derivation study, among participants with suspected infection, the AUROC for the UVA was the greatest (0.75; 95% CI, 0.72-0.77) compared with that of the MEWS (0.65; 95% CI, 0.63-0.68) and the qSOFA (0.68; 95% CI, 0.65-0.71).17 The prognostic score performance data also are consistent with the findings from a prospective validation study from Gabon, in which the UVA score had an AUROC of 0.90 (95% CI, 0.78-1.0) compared with that of the qSOFA score (0.77; 95% CI, 0.63-0.91) and the MEWS (0.72; 95% CI, 0.58-0.87) among 187 patients with suspected infection,21 although that study had limited statistical power to detect differences between the scores. The results of the current study differ from the findings of a study of 647 patients with suspected infection in Rwanda, in which the AUROC of the UVA score (0.71; 95% CI, 0.66-0.76) did not significantly differ from that of an adapted MEWS (0.69; 95% CI, 0.64-0.74) or the qSOFA score (0.65; 95% CI, 0.60-0.70).19 However, the Rwandan study and this study differed substantially in terms of inclusion criteria, enrollment (which in the Rwandan study was conducted throughout the course of hospitalization), and time points for data collection. In contrast, because we enrolled participants within 24 hours of hospital admission, our analysis assessed the performance of risk scores at a similar and important time period for febrile inpatients. This study’s data also differ from those of a Malawi study,20 wherein the AUROC for the UVA score was 0.54 (95% CI, 0.48-0.60). However, the Malawi study was notably different than the current study in that the cohort was smaller and primarily included participants requiring surgical intensive care, with all severity scores performing poorly in predicting outcomes.20 Overall, the current analysis provides additional support for use of the UVA score in patients in sub-Saharan Africa who are seen in the hospital with febrile illness, a common cause of hospital admission in LMIC settings.1,31

Other notable findings in this study include the limited performance of SIRS and qSOFA scores for estimating mortality risk in the study’s cohort of persons with fever. Both the SIRS criteria and the qSOFA were intended for the diagnosis and triage of patients with sepsis rather than prediction of in-hospital death. However, it is notable that SIRS criteria have since been abandoned in the most recent sepsis definition, in part owing to concerns about its poor specificity.8 The shortcomings of SIRS are reflected in this study’s findings of comparatively high sensitivity but poor specificity and poor positive predictive value for in-hospital death. For the qSOFA, despite this study’s finding of meaningful increases in risk of death with scores higher than 0, the limited performance based on the AUROC is consistent with the findings of other studies in LMICs.29,32

The NEWS and MEWS had moderate predictive performance in this study’s cohort. The MEWS has shown limited performance in prior studies in LMICs to date,17,21 but the NEWS has performed better in LMICs despite fewer publications assessing its potential utility in such settings.33,34 The performance of these tests is notable in that both scores were originally derived to predict inpatient clinical deterioration as opposed to predicting outcomes. However, both scores rely on frequent vital sign monitoring and are better suited to institutions with electronic health records that can provide real-time feedback on decompensation risk to prompt provider interventions, neither of which are available in many LMIC settings.34

Strengths and Limitations

This study has several strengths. To our knowledge, it provides the first prospective external validation of the UVA score in a cohort of this size in which variables were assessed at a single time point early within a participant’s hospitalization.1 The use of a unified time point for clinical variables in this study’s cohort allowed for an assessment of the utility of the scores for early triage and prognostication on hospitalization. Furthermore, very few clinical data points were missing for score calculation. This not only allowed for improved assessment of the clinical scores but also allowed for a strong prospective validation of score performance for the large subset of participants with HIV infection (eTables 3 and 4 in the Supplement).

This study also has limitations. First is the limited generalizability of the data. The study was conducted at only 2 medical centers in northern Tanzania. Thus, demographic and epidemiological differences would likely be associated with different score performance elsewhere. Second, the strength of UVA and other scores is contingent on how they are used by clinicians, including whether a single cutoff score or the entire scoring system is used for risk stratification. For that reason, we presented data on each score for both proposed cutoffs and by all ordinal values. Further exploration of appropriate risk strata for each score is needed. Another limitation of the study is that relatively few eligible patients chose to participate in the study, which inherently risks introducing bias into this analysis. In addition, this study was conducted only with participants with febrile illness as opposed to a general population admitted to a medical ward. Further prospective validation of UVA scores is needed in populations with other common noninfectious conditions in LMICs.

Conclusions

In this prognostic study of the performance of the UVA and other illness severity scores in a cohort of hospitalized patients with febrile illness in northern Tanzania, the UVA score showed favorable performance characteristics compared with other illness severity scores. Given the simplicity of calculation of the UVA score based on its reliance on readily available clinical parameters at a single time point, the UVA may be appropriate for triage and prognostication for hospitalized patients with febrile illness in LMIC settings such as sub-Saharan Africa.

Back to top
Article Information

Accepted for Publication: September 26, 2021.

Published: December 16, 2021. doi:10.1001/jamanetworkopen.2021.36398

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2021 Bonnewell JP et al. JAMA Network Open.

Corresponding Author: Matthew P. Rubach, MD, Division of Infectious Diseases and International Health, Department of Medicine, Duke University Medical Center, Box 102359, Durham, NC 27710 (matthew.rubach@duke.edu).

Author Contributions: Drs Rubach and Crump had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Rubach, Carugati, Marandu, Kalengo, Lwezaula, Maro, Crump.

Acquisition, analysis, or interpretation of data: Bonnewell, Rubach, Madut, Carugati, Maze, Kilonzo, Lyamuya, Mmbaga.

Drafting of the manuscript: Bonnewell, Rubach, Marandu, Kalengo, Lwezaula, Maro.

Critical revision of the manuscript for important intellectual content: Bonnewell, Rubach, Madut, Carugati, Maze, Kilonzo, Lyamuya, Mmbaga, Crump.

Statistical analysis: Bonnewell.

Obtained funding: Crump.

Administrative, technical, or material support: Rubach, Kilonzo, Lyamuya, Marandu, Lwezaula, Mmbaga.

Supervision: Rubach, Carugati, Marandu, Mmbaga, Maro, Crump.

Conflict of Interest Disclosures: Dr Rubach reported receiving grants from the National Institute of Allergy & Infectious Diseases, National Institutes of Health (NIH) during the conduct of the study. Dr Crump reported receiving grants from the NIH during the conduct of the study. Drs Rubach and Crump also reported receiving funding from the Bill & Melinda Gates Foundation. No other disclosures were reported.

Funding/Support: Drs Bonnewell and Madut reported being supported by Vanderbilt-Emory-Cornell-Duke Global Health Fellowship D43 TW009337, which is funded by the Fogarty International Center of the NIH. This study also was supported by grants R01 AI121378 (Dr Crump) and K23 AI116869 (Dr Rubach) and the Ruth L. Kirschstein National Research Service Award, 5T32AI007392 (Dr Madut), all from the NIH.

Role of the Funder/Sponsor: The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The views expressed are solely those of the authors and do not necessarily represent the views of the NIH.

Additional Contributions: We thank those involved in recruitment, laboratory work, data management, and study administration, all of whom were compensated for their contributions: Flora W. Mboya, CO, Lilian E. Ngowi, CO, Ephrasia Mariki, BS, Edna Ngowi, DN, Olterere Salimu, DN, Rither Mhela, DN, Jamal Bashiri, DN, Christopher Swai, CO, Jerome Mlangi, CO, Tumsifu G. Tarimo, BA, Edward M. Singo, Certificate (Cert) of Health Attendance, Stephen Sikumbili, Cert of Health Attendance, Erica Chuwa, Diploma (Dip) in Procedure and Logistic Management, Daniel Mauya, BA, Isaac A. Afwamba, DMLT, Remigi P. Swai, BS, Augustine M. Musyoka, MS, Rose Oisso, BS, Gershom Mmbwambo, BS, Philoteus A. Sakasaka, MS, Alphonse S. Mushi, BS, Robert S. Chuwa, Diploma in Information Technology and Data Management, Charles Muiruri, PhD, Cynthia A. Asiyo, MS, Frank M. Kimaro, MBA, and Francis P. Karia, MBA. We also thank the clinical staff and administration at Kilimanjaro Christian Medical Centre and Mawenzi Regional Referral Hospital for their support and contributions to this study. Most important, we thank all the study participants for their contributions to science and health care research.

References
1.
GBD 2017 DALYs and HALE Collaborators.  Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017.   Lancet. 2018;392(10159):1859-1922. doi:10.1016/S0140-6736(18)32335-3 PubMedGoogle ScholarCrossref
2.
Feikin  DR, Olack  B, Bigogo  GM,  et al.  The burden of common infectious disease syndromes at the clinic and household level from population-based surveillance in rural and urban Kenya.   PLoS One. 2011;6(1):e16085. doi:10.1371/journal.pone.0016085 PubMedGoogle Scholar
3.
Crump  JA, Morrissey  AB, Nicholson  WL,  et al.  Etiology of severe non-malaria febrile illness in northern Tanzania: a prospective cohort study.   PLoS Negl Trop Dis. 2013;7(7):e2324. doi:10.1371/journal.pntd.0002324 PubMedGoogle Scholar
4.
Kotloff  KL, Nataro  JP, Blackwelder  WC,  et al.  Burden and aetiology of diarrhoeal disease in infants and young children in developing countries (the Global Enteric Multicenter Study, GEMS): a prospective, case-control study.   Lancet. 2013;382(9888):209-222. doi:10.1016/S0140-6736(13)60844-2 PubMedGoogle ScholarCrossref
5.
Pneumonia Etiology Research for Child Health (PERCH) Study Group.  Causes of severe pneumonia requiring hospital admission in children without HIV infection from Africa and Asia: the PERCH multi-country case-control study.   Lancet. 2019;394(10200):757-779. doi:10.1016/S0140-6736(19)30721-4 PubMedGoogle ScholarCrossref
6.
Rubach  MP, Maro  VP, Bartlett  JA, Crump  JA.  Etiologies of illness among patients meeting integrated management of adolescent and adult illness district clinician manual criteria for severe infections in northern Tanzania: implications for empiric antimicrobial therapy.   Am J Trop Med Hyg. 2015;92(2):454-462. doi:10.4269/ajtmh.14-0496 PubMedGoogle ScholarCrossref
7.
Taylor  AW, Blau  DM, Bassat  Q,  et al; CHAMPS Consortium.  Initial findings from a novel population-based child mortality surveillance approach: a descriptive study.   Lancet Glob Health. 2020;8(7):e909-e919. doi:10.1016/S2214-109X(20)30205-9 PubMedGoogle ScholarCrossref
8.
Singer  M, Deutschman  CS, Seymour  CW,  et al.  The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).   JAMA. 2016;315(8):801-810. doi:10.1001/jama.2016.0287 PubMedGoogle ScholarCrossref
9.
Bone  RC, Balk  RA, Cerra  FB,  et al; The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine.  Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis.   Chest. 1992;101(6):1644-1655. doi:10.1378/chest.101.6.1644 PubMedGoogle ScholarCrossref
10.
Subbe  CP, Kruger  M, Rutherford  P, Gemmel  L.  Validation of a modified Early Warning Score in medical admissions.   QJM. 2001;94(10):521-526. doi:10.1093/qjmed/94.10.521 PubMedGoogle ScholarCrossref
11.
Do  SN, Luong  CQ, Pham  DT,  et al.  Factors relating to mortality in septic patients in Vietnamese intensive care units from a subgroup analysis of MOSAICS II study.   Sci Rep. 2021;11(1):18924. doi:10.1038/s41598-021-98165-8PubMedGoogle ScholarCrossref
12.
Ssekitoleko  R, Pinkerton  R, Muhindo  R, Bhagani  S, Moore  CC.  Aggregate evaluable organ dysfunction predicts in-hospital mortality from sepsis in Uganda.   Am J Trop Med Hyg. 2011;85(4):697-702. doi:10.4269/ajtmh.2011.10-0692 PubMedGoogle ScholarCrossref
13.
Rylance  J, Baker  T, Mushi  E, Mashaga  D.  Use of an early warning score and ability to walk predicts mortality in medical patients admitted to hospitals in Tanzania.   Trans R Soc Trop Med Hyg. 2009;103(8):790-794. doi:10.1016/j.trstmh.2009.05.004 PubMedGoogle ScholarCrossref
14.
Wheeler  I, Price  C, Sitch  A,  et al.  Early warning scores generated in developed healthcare settings are not sufficient at predicting early mortality in Blantyre, Malawi: a prospective cohort study.   PLoS One. 2013;8(3):e59830. doi:10.1371/journal.pone.0059830 PubMedGoogle Scholar
15.
Kruisselbrink  R, Kwizera  A, Crowther  M,  et al.  Modified Early Warning Score (MEWS) identifies critical illness among ward patients in a resource restricted setting in Kampala, Uganda: a prospective observational study.   PLoS One. 2016;11(3):e0151408. doi:10.1371/journal.pone.0151408 PubMedGoogle Scholar
16.
Rudd  KE, Seymour  CW, Aluisio  AR,  et al; Sepsis Assessment and Identification in Low Resource Settings (SAILORS) Collaboration.  Association of the Quick Sequential (Sepsis-Related) Organ Failure Assessment (qSOFA) score with excess hospital mortality in adults with suspected infection in low- and middle-income countries.   JAMA. 2018;319(21):2202-2211. doi:10.1001/jama.2018.6229 PubMedGoogle ScholarCrossref
17.
Moore  CC, Hazard  R, Saulters  KJ,  et al.  Derivation and validation of a universal vital assessment (UVA) score: a tool for predicting mortality in adult hospitalised patients in sub-Saharan Africa.   BMJ Glob Health. 2017;2(2):e000344. doi:10.1136/bmjgh-2017-000344 PubMedGoogle Scholar
18.
Stenhouse  C, Coates  S, Tivey  M, Allsop  P, Parker  T.  Prospective evaluation of a modified Early Warning Score to aid earlier detection of patients developing critical illness on a general surgical ward.   Br J Anaesth. 2000;84(5):663P. doi:10.1093/bja/84.5.663Google ScholarCrossref
19.
Klinger  A, Mueller  A, Sutherland  T,  et al.  Predicting mortality in adults with suspected infection in a Rwandan hospital: an evaluation of the adapted MEWS, qSOFA and UVA scores.   BMJ Open. 2021;11(2):e040361. doi:10.1136/bmjopen-2020-040361 PubMedGoogle Scholar
20.
Prin  M, Pan  S, Kadyaudzu  C, Li  G, Charles  A.  ICU risk stratification models feasible for use in sub-Saharan Africa show poor discrimination in Malawi: a prospective cohort study.   World J Surg. 2019;43(10):2357-2364. doi:10.1007/s00268-019-05078-9 PubMedGoogle ScholarCrossref
21.
Schmedding  M, Adegbite  BR, Gould  S,  et al.  A prospective comparison of Quick Sequential Organ Failure Assessment, Systemic Inflammatory Response Syndrome Criteria, Universal Vital Assessment, and Modified Early Warning Score to predict mortality in patients with suspected infection in Gabon.   Am J Trop Med Hyg. 2019;100(1):202-208. doi:10.4269/ajtmh.18-0577 PubMedGoogle ScholarCrossref
22.
Royal College of Physicians.  National Early Warning Score (NEWS): Standardizing the Assessment of Acute-Illness Severity in the NHS. Royal College of Physicians; 2012.
23.
Bossuyt  PM, Reitsma  JB, Bruns  DE,  et al; STARD Group.  STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies.   BMJ. 2015;351(h5527):h5527. doi:10.1136/bmj.h5527 PubMedGoogle Scholar
24.
Population Based HIV Impact Assessment (PHIA).  Tanzania HIV Impact Survey (THIS) 2016-2017. Columbia University; 2017. Accessed May 26, 2021. https://phia.icap.columbia.edu/wp-content/uploads/2017/11/Tanzania_SummarySheet_A4.English.v19.pdf
25.
Gething  PW, Patil  AP, Smith  DL,  et al.  A new world malaria map: Plasmodium falciparum endemicity in 2010.   Malar J. 2011;10:378. doi:10.1186/1475-2875-10-378 PubMedGoogle ScholarCrossref
26.
United Republic of Tanzania Ministry of Health, Community Development, Gender, Elderly and Children. Tanzania malaria indicator survey 2017. August 2018. Accessed May 26, 2021. https://dhsprogram.com/pubs/pdf/MIS31/MIS31.pdf
27.
Tang  AM, Chung  M, Dong  K,  et al. Determining a global mid-upper arm circumference cutoff to assess underweight in adults (men and nonpregnant women). June 2017. Food and Nutrition Technical Assistance III Project. FHI 360/FANTA. Accessed November 11, 2021. https://www.fantaproject.org/sites/default/files/resources/Global-MUAC-Cutoffs-nonPregnant-Adults-Jun2017.pdf
28.
World Health Organization.  Imai District Clinician Manual: Hospital Care for Adolescents and Adults: Guidelines for the Management of Common Illnesses With Limited Resources. World Health Organization; 2011.
29.
Carugati  M, Zhang  HL, Kilonzo  KG,  et al.  Predicting mortality for adolescent and adult patients with fever in resource-limited settings.   Am J Trop Med Hyg. 2018;99(5):1246-1254. doi:10.4269/ajtmh.17-0682 PubMedGoogle ScholarCrossref
30.
DeLong  ER, DeLong  DM, Clarke-Pearson  DL.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.   Biometrics. 1988;44(3):837-845. doi:10.2307/2531595 PubMedGoogle ScholarCrossref
31.
Crump  JA.  Typhoid fever and the challenge of nonmalaria febrile illness in sub-Saharan Africa.   Clin Infect Dis. 2012;54(8):1107-1109. doi:10.1093/cid/cis024 PubMedGoogle ScholarCrossref
32.
Huson  MAM, Katete  C, Chunda  L,  et al.  Application of the qSOFA score to predict mortality in patients with suspected infection in a resource-limited setting in Malawi.   Infection. 2017;45(6):893-896. doi:10.1007/s15010-017-1057-5 PubMedGoogle ScholarCrossref
33.
Foy  KE, Pearson  J, Kettley  L, Lal  N, Blackwood  H, Bould  MD.  Four early warning scores predict mortality in emergency surgical patients at University Teaching Hospital, Lusaka: a prospective observational study.   Can J Anaesth. 2020;67(2):203-212. doi:10.1007/s12630-019-01503-8 PubMedGoogle ScholarCrossref
34.
Beane  A, De Silva  AP, De Silva  N,  et al.  Evaluation of the feasibility and performance of early warning scores to identify patients at risk of adverse outcomes in a low-middle income country setting.   BMJ Open. 2018;8(4):e019387. doi:10.1136/bmjopen-2017-019387 PubMedGoogle Scholar
×