Comparing the precision of the pSOFA and SIRS scores in predicting sepsis-related deaths among hospitalized children: a multi-center retrospective cohort study

doi:10.5847/wjem.j.1920-8642.2022.060

Abstract

Abstract:

BACKGROUND: The latest sepsis definition includes both infection and organ failure, as evidenced by the sequential organ failure assessment (SOFA) score. However, the applicability of the pediatric SOFA score (pSOFA) is not yet determined. This study evaluated the effectiveness of both pSOFA and system inflammatory reaction syndrome (SIRS) scores in predicting sepsis-related pediatric deaths.

METHODS: This is a retrospective multi-center cohort study including hospitalized patients <18 years old with diagnosed or not-yet-diagnosed infections. Multivariate analyses were carried out to evaluate risk factors for in-hospital mortality. According to Youden index (YI), three sub-categories of pSOFA were screened out and a new simplified pSOFA score (spSOFA) was formed. The effectiveness and accuracy of prediction of pSOFA, SIRS and spSOFA was retrieved from the area under the receiver operating characteristic curve (AUROC) and Delong’s test.

RESULTS: A total of 1,092 participants were eligible for this study, and carried a 23.4% in-hospital mortality rate. The 24-h elevated pSOFA score (24 h-pSOFA), bloodstream infection, and mechanical ventilation (MV) requirement were major risk factors associated with sepsis-related deaths. The AUROC analysis confirmed that the spSOFA provided good predictive capability in sepsis-related pediatric deaths, relative to the 24 h-pSOFA and SIRS.

CONCLUSIONS: The pSOFA score performed better than SIRS in diagnosing infected children with high mortality risk. However, it is both costly and cumbersome. We, therefore, proposed spSOFA to accurately predict patient outcome, without the disadvantages. Nevertheless, additional investigations, involving a large sample population, are warranted to confirm the conclusion of this study.

Key words: Simple-pSOFA, pSOFA, Children, Mortality, Infection, SIRS

Chun Zhao, Mei-yun Xin, Jing Li, Jin-fang Zhao, Yu-juan Wang, Wei Wang, Qian Gao, Jie Chen, Qi-wei Wang, You-peng Jin. Comparing the precision of the pSOFA and SIRS scores in predicting sepsis-related deaths among hospitalized children: a multi-center retrospective cohort study[J]. World Journal of Emergency Medicine, 2022, 13(4): 259-265.

Figures/Tables 7

Figure 1.

Table 1.

Figure 2.

Table 2.

Table 3.

Table 4.

Figure 3.

References 24

1	Hartman ME, Linde-Zwirble WT, Angus DC, Watson RS. Trends in the epidemiology of pediatric severe sepsis. Pediatr Crit Care Med. 2013; 14(7): 686-93. doi: 10.1097/PCC.0b013e3182917fad
2	Balamuth F, Weiss SL, Neuman MI, Scott H, Brady PW, Paul R, et al. Pediatric severe sepsis in US children’s hospitals. Pediatr Crit Care Med. 2014; 15(9): 798-805.
3	Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012; 379(9832): 2151-61. doi: 10.1016/S0140-6736(12)60560-1 pmid: 22579125
4	Schlapbach LJ, Straney L, Alexander J, MacLaren G, Festa M, Schibler A, et al. Mortality related to invasive infections, Sepsis, and septic shock in critically ill children in Australia and New Zealand, 2002-13: a multicentre retrospective cohort study. Lancet Infect Dis. 2015; 15(1): 46-54. doi: 10.1016/S1473-3099(14)71003-5 pmid: 25471555
5	Weiss SL, Balamuth F, Hensley J, Fitzgerald JC, Bush J, Nadkarni VM, et al. The epidemiology of hospital death following pediatric severe sepsis: when, why, and how children with sepsis die. Pediatr Crit Care Med. 2017; 18(9): 823-30. doi: 10.1097/PCC.0000000000001222
6	Kissoon N, Carcillo JA, Espinosa V, Argent A, Devictor D, Madden M, et al. World federation of pediatric intensive care and critical care societies: global sepsis initiative. Pediatr Crit Care Med. 2011; 12(5): 494-503. doi: 10.1097/PCC.0b013e318207096c
7	Boeddha NP, Schlapbach LJ, Driessen GJ, Herberg JA, Rivero-Calle I, Cebey-López M, et al. Mortality and morbidity in community-acquired sepsis in European pediatric intensive care units: a prospective cohort study from the European Childhood Life-threatening Infectious Disease Study (EUCLIDS). Crit Care. 2018; 22(1): 143. doi: 10.1186/s13054-018-2052-7
8	Weiss SL, Fitzgerald JC, Pappachan J, Wheeler D, Jaramillo-Bustamante JC, Salloo A, et al. Global epidemiology of pediatric severe sepsis: the sepsis prevalence, outcomes, and therapies study. Am J Respir Crit Care Med. 2015; 191(10): 1147-57. doi: 10.1164/rccm.201412-2323OC
9	Goldstein B, Giroir B, Randolph A, International Consensus Conference on Pediatric Sepsis. International pediatric sepsis consensus conference:definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med.ed. 2005; 6(1): 2-8.
10	Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Intensive Care Med. 2013; 39(2):165-228. doi: 10.1007/s00134-012-2769-8 pmid: 23361625
11	Kaukonen KM, Bailey M, Pilcher D, Cooper DJ, Bellomo R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N Engl J Med. 2015; 372(17): 1629-38. doi: 10.1056/NEJMoa1415236
12	Raith EP, Udy AA, Bailey M, McGloughlin S, MacIsaac C, Bellomo R, et al. Prognostic accuracy of the SOFA score, SIRS criteria,and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit. JAMA. 2017; 317(3): 290-300.
13	Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016; 315(8): 801-10. doi: 10.1001/jama.2016.0287
14	Matics TJ, Sanchez-Pinto LN. Adaptation and validation of a pediatric sequential organ failure assessment score and evaluation of the Sepsis-3 definitions in critically ill children. JAMA Pediatr. 2017; 171(10): e172352. doi: 10.1001/jamapediatrics.2017.2352
15	Schlapbach LJ, Straney L, Bellomo R, MacLaren G, Pilcher D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. 2018; 44(2): 179-88. doi: 10.1007/s00134-017-5021-8 pmid: 29256116
16	Shime N, Kawasaki T, Nakagawa S. Proposal of a new pediatric sequential organ failure assessment score for possible validation. Pediatr Crit Care Med. 2017; 18(1): 98-9.
17	Kawasaki T, Shime N, Straney L, Bellomo R, MacLaren G, Pilcher D, et al. Paediatric sequential organ failure assessment score (pSOFA): a plea for the world-wide collaboration for consensus. Intensive Care Med. 2018; 44(6): 995-7. doi: 10.1007/s00134-018-5188-7 pmid: 29704146
18	Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016; 315(8): 762-74. doi: 10.1001/jama.2016.0288
19	Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982; 143(1): 29-36. doi: 10.1148/radiology.143.1.7063747 pmid: 7063747
20	Vincent JL, Mira JP, Antonelli M. Sepsis: older and newer concepts. Lancet Respir Med. 2016; 4(3): 237-40. doi: 10.1016/S2213-2600(15)00522-6
21	Vincent JL, Opal SM, Marshall JC, Tracey KJ. Sepsis definitions: time for change. Lancet. 2013; 381(9868): 774-5. doi: 10.1016/S0140-6736(12)61815-7
22	Scott HF, Deakyne SJ, Woods JM, Bajaj L. The prevalence and diagnostic utility of systemic inflammatory response syndrome vital signs in a pediatric emergency department. Acad Emerg Med. 2015; 22(4): 381-9. doi: 10.1111/acem.12610
23	Agyeman PKA, Schlapbach LJ, Giannoni E, Stocker M, Posfay-Barbe KM, Heininger U, et al. Epidemiology of blood culture-proven bacterial sepsis in children in Switzerland: a population-based cohort study. Lancet Child Adolesc Health. 2017; 1(2): 124-33. doi: 10.1016/S2352-4642(17)30010-X
24	Vincent JL, Moreno R, Takala J, Willatts S, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996; 22(7): 707-10. doi: 10.1007/BF01709751

Characteristics	All (n=1,092)	Survivors (n=837)	Non-survivors (n=255)	P-value
Age, months	7.0 (2.9-19.2)	7.0 (2.9-19.0)	6.0 (2.8-24.0)	0.100
Male	669 (61.3)	156 (61.2)	513 (61.3)	1.000
Type of admission				0.450
Medical condition	953 (87.2)	734 (87.7)	219 (85.9)
Surgical condition	139 (12.8)	103 (12.3)	36 (14.1)	-
Admission type
Respiratory failure	403 (36.9)	339 (40.5)	64 (25.1)	<0.001
Neurologic compromise	175 (16.0)	147 (17.6)	28 (11.0)	0.010
Cardiovascular compromise	168 (15.4)	92 (11.0)	76 (29.8)	<0.001
Hematologic derangement	113 (10.3)	86 (10.3)	27 (10.6)	0.890
Metabolic derangement	88 (8.1)	78 (9.3)	10 (3.9)	0.010
Trauma	107 (9.8)	75 (9.0)	32 (12.5)	0.090
Other	38 (3.5)	20 (2.4)	18 (7.1)	<0.001
Infection source
Bloodstream	147 (13.5)	102 (12.2)	45 (17.6)	0.030
Respiratory tract	625 (57.2)	502 (60.0)	123 (48.2)	0.001
Cerebral	132 (12.1)	108 (12.9)	24 (9.4)	0.130
Genitourinary tract	9 (0.8)	9 (1.1)	0 (0)	0.100
Digestive tract	117 (10.7)	75 (9.0)	42 (16.5)	0.001
Other	62 (5.7)	41 (4.9)	21 (8.2)	0.044
SIRS criteria score (n=1,092)	2 (1-3)	2 (1-3)	2 (1-3)	0.018
24 h-pSOFA (n=898)	4.0 (2.0-6.0)	3.0 (2.0-5.0)	6.0 (4.0-9.0)	<0.001
Treatments
Mechanical ventilation	825 (75.5)	585 (69.9)	240 (94.1)	<0.001
Continuous blood purification	144 (13.2)	93 (11.1)	51 (20.0)	<0.001
Outcomes
Ventilator days, d	2.7 (0-7.7)	4 (0-9)	6 (1-12)	<0.001
PICU LOS, d	8 (4-15)	14 (8-24)	10 (3-16)	<0.001

Variables	B	S.E.	Wald	P-value	OR (95% CI)
Infection source	-0.301	0.055	55.701	<0.001
Respiratory tract	-0.561	0.785	0.510	0.475	0.571 (0.123-2.660)
Bloodstream	-2.853	0.979	8.500	0.004	0.058 (0.008-0.393)
Hepatobiliary system	-0.970	1.012	0.918	0.338	0.379 (0.052-2.757)
SIRS	-0.149	0.099	2.284	0.131	0.861 (0.709-1.045)
24 h-pSOFA	0.241	0.030	64.029	<0.001	1.273 (1.200-1.350)
MV	1.732	0.331	27.329	<0.001	5.653 (2.953-10.822)
CBP	-0.176	0.245	0.581	0.472	0.839 (0.519-1.354)

Predictor	AUC	95% CI	S.E.		P-value
SIRS	0.559	0.519-0.600	0.021		0.004
24 h-pSOFA	0.740	0.706-0.774	0.017		<0.001
Simple-pSOFA	0.751	0.716-0.786	0.019		<0.001
Predictor	Definition	In-hospital mortality
Predictor	Definition	Sensitivity (%)	Specificity (%)	Negative predictive value (%)	Positive predictive value (%)
SIRS	≥ 2 criteria (pediatric)	74.1	32.6	80.5	25.1
	≥ 3 criteria (pediatric)	45.9	65.2	76.3	22.8
24 h-pSOFA	≥ 2	97.6	21.1	95.5	27.6
	≥ 4	79.2	52.7	89.1	33.4
	≥ 5	68.2	69.2	87.4	39.5
Simple-pSOFA	≥ 2	83.5	48.7	90.7	33.2
	≥ 3	65.9	74.6	87.8	44.1

Variables	Score^a
Variables	0	1	2		3	4
Coagulation^b
Platelet count,×10⁹ /L	≥150	100-149	50-99		20-49	<20
Cardiovascular
MAP (mmHg) by age group				Vasoactive infusion (μg/[kg·min])^c
<1 month	≥46	<46	Dopamine hydrochloride ≤5 or dobutamine hydrochloride (any)		Dopamine hydrochloride >5 or epinephrine ≤0.1 or norepinephrine bitartrate ≤0.1	Dopamine hydrochloride >15 or epinephrine >0.1 or norepinephrine bitartrate >0.1
1-11 months	≥55	<55
12-23 months	≥60	<60
24-59 months	≥62	<62
60-143 months	≥65	<65
144-216 months	≥67	<67
>216 months	≥70	<70
Neurologic
Glasgow Coma Score^d	15	13-14	10-12		6-9	<6

[1]	Ahammed Mekkodathil, Ayman El-Menyar, Talat Chughtai, Ahmed Abdel-Aziz Bahey, Ahmed Labib Shehatta, Ali Ayyad, Abdulnasser Alyafai, Hassan Al-Thani. Initial serum electrolyte imbalances and mortality in patients with traumatic brain injury: a retrospective study [J]. World Journal of Emergency Medicine, 2025, 16(4): 331-339.
[2]	Carlos del Pozo Vegas, Ancor Sanz-García, Antonio Dueñas-Ruiz, Pedro de Santos Castro, Ana Gil Contreras, María Blanco González, Alberto Correas Galán, Joan B. Soriano, Raúl López-Izquierdo, Francisco Martín-Rodríguez. Prehospital oxygen-therapy and mortality in patients treated by emergency medical services: a prospective, observational multicenter study [J]. World Journal of Emergency Medicine, 2025, 16(4): 357-366.
[3]	Jesús Jurado-Palomo, José Luis Martín-Conty, Begoña Polonio-López, Cristina Rivera Picón, Raúl López-Izquierdo, Carlos del Pozo Vegas, Pedro Ángel de Santos Castro, Ancor Sanz-García, Francisco Martín-Rodríguez. Prehospital critical care drug-therapy and 30-day mortality in patients with acute respiratory disease [J]. World Journal of Emergency Medicine, 2025, 16(1): 43-50.
[4]	Tianpeng Hu, Yan Li, Shengtao Yan, Lichao Sun, Rui Lian, Jieqiong Yu, Jie Chen, Xiaoyu Liu, Guoqiang Zhang. Application of myxovirus resistance protein A in the etiological diagnosis of infections in adults [J]. World Journal of Emergency Medicine, 2025, 16(1): 35-42.
[5]	Chao Gong, Shengyong Xu, Youlong Pan, Shigong Guo, Joseph Harold Walline, Xue Wang, Xin Lu, Shiyuan Yu, Mubing Qin, Huadong Zhu, Yanxia Gao, Yi Li. Effects of probiotic treatment on the prognosis of patients with sepsis: a systematic review [J]. World Journal of Emergency Medicine, 2025, 16(1): 18-27.
[6]	Yangyang Guo, Yaqi Sun, Hongxia Wu, Jian Lu, Yuan Lin, Jiaqing Zhu, Meihong Lai, Meiqi Zhang, Jun Wang, Jungang Zheng. Protective effect and mechanism of nanoantimicrobial peptide ND-C14 against Streptococcus pneumoniae infection [J]. World Journal of Emergency Medicine, 2024, 15(1): 28-34.
[7]	Catherine V. Levitt, Quincy K. Tran, Hashem Hraky, Maryann Mazer-Amirshahi, Ali Pourmand. Emergency department approach to monkeypox [J]. World Journal of Emergency Medicine, 2023, 14(5): 341-348.
[8]	Xinlei Wang, Yao Sun, Xiaoyu Ni, Shu Zhang. Development and validation of an emergency bloodstream infection score for predicting in-hospital mortality in patients with community-acquired bloodstream infections [J]. World Journal of Emergency Medicine, 2023, 14(4): 280-286.
[9]	Hai Hu, Ni Yao, Xiao-qin Lai. Factors related to early and rapid assessment of in-hospital mortality among older adult trauma patients in an earthquake [J]. World Journal of Emergency Medicine, 2022, 13(6): 425-432.
[10]	Ralph Bou Chebl, Nadim Kattouf, Mohamad Assaf, Saadeddine Haidar, Gilbert Abou Dagher, Sarah Abdul Nabi, Rana Bachir, Mazen El Sayed. Comparing the demographic data and outcomes of septic shock patients presenting to teaching or non-teaching metropolitan hospitals in the United States [J]. World Journal of Emergency Medicine, 2022, 13(6): 433-440.
[11]	Gui-ying Dong, Fei-fei Jin, Qi Huang, Chun-bo Wu, Ji-hong Zhu, Tian-bing Wang. Exploratory COVID-19 death risk score based on basic laboratory tests and physiological clinical measurements [J]. World Journal of Emergency Medicine, 2022, 13(6): 453-458.
[12]	Hai Hu, Jing-yuan Jiang, Ni Yao. Comparison of different versions of the quick sequential organ failure assessment for predicting in-hospital mortality of sepsis patients: A retrospective observational study [J]. World Journal of Emergency Medicine, 2022, 13(2): 114-119.
[13]	Yu-qing Cui, Xian-fei Ding, Huo-yan Liang, Dong Wang, Xiao-juan Zhang, Li-feng Li, Quan-cheng Kan, Le-xin Wang, Tong-wen Sun. Efficacy and safety of low-dose corticosteroids for acute respiratory distress syndrome: A systematic review and meta-analysis [J]. World Journal of Emergency Medicine, 2021, 12(3): 207-213.
[14]	Wen Gao, Yu-ping Zhang, Jing-fen Jin. Poor outcomes of delirium in the intensive care units are amplified by increasing age: A retrospective cohort study [J]. World Journal of Emergency Medicine, 2021, 12(2): 117-123.
[15]	Hao-tian Chen, Jian-feng Xu, Xiao-xia Huang, Ni-ya Zhou, Yong-kui Wang, Yue Mao. Blood eosinophils and mortality in patients with acute respiratory distress syndrome: A propensity score matching analysis [J]. World Journal of Emergency Medicine, 2021, 12(2): 131-136.