Agreement between qSOFA and NEWS scores in the screening of sepsis through Monte Carlo simulation
DOI:
https://doi.org/10.26694/repis.v8i1.2744Keywords:
Sepsis, Computer Simulation, Organ Dysfunction Scores, Diagnostic Techniques and Procedures, Sensitivity and SpecificityAbstract
Introduction: The early warning scores used for sepsis have different risk stratification and accuracy metrics, which can delay diagnosis by the health team. Aim: The study aims to evaluate the agreement and differences between the qSOFA and NEWS criteria in the early detection of sepsis risk in a defined population through a computer simulation. Outlining: A computer simulation was performed using the Monte Carlo method. 10,000 cases were simulated based on the variables described by the NEWS and qSOFA scores. Results: After evaluating the 10,000 cases, qSOFA≥2 proved to be less sensitive (22.22% (95% CI 21.00 – 23.49)) than NEWS≥7 (93.41% (95% CI 91.72 – 94.78)). When analyzing specificity, NEWS≥7 (62.99% (CI 95% 61.98 – 63.98)) was lower than qSOFA≥2 (98.83% (CI 95% 98.52 – 99.08)). Agreement was 66.08% (95% CI 65.15 - 67.00). Implications: The study showed good agreement between the scores and also showed that NEWS is superior to qSOFA when analyzing sensitivity, but the result is reversed when talking about specificity.
References
Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest [Internet]. 1992 Jun [cited 2021 Nov 02];101(6):1644–55. Available from: https://doi.org/10.1378/chest.101.6.1644
Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med [Internet]. 2003 Apr [cited 2021 Nov 02];31(4):1250–6. Available from: https://doi.org/10.1097/01.CCM.0000050454.01978.3B
Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA - J Am Med Assoc [Internet]. 2016 Feb [cited 2021 Nov 12];315(8):801–10. Available from: https://doi.org/10.1001/jama.2016.0287
Rudd Ke, Johnson SC, Agesa KM, Shackelford KA, Tsoi D, Kievlan DR, et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: analysis for the Global Burden of Disease Study. Lancet [Internet] 2020 [cited 2022 Jun 07];395:200–11.Available from: https://doi.org/10.1016/S0140-6736(19)32989-7
Almeida NRC, Pontes GF, Jacob FL, Deprá JVS, Porto JPP, Lima FR, et al. Analysis of trends in sepsis mortality in Brazil and by regions from 2010 to 2019. Revista de Saúde Pública [Internet] 2022 [cited 2022 Jun 07]; 56(25):1-13. Available from: https://doi.org/10.11606/s1518-8787.2022056003789>.
Lobo SM, Rezende E, Mendes CL, de Oliveira MC. Mortality due to sepsis in Brazil in a real scenario: The Brazilian ICUs project. Rev Bras Ter Intensiva [Internet]. 2019 [cited 2021 Nov 02];31(1):1–4. Available from: https://doi.org/10.5935/0103-507X.20190008
Harpaz R, Dahl RM, Dooling KL. Prevalence of immunosuppression among US adults, 2013. JAMA - J Am Med Assoc [Internet]. 2016 Dec [cited 2021 Nov 02];316(23):2547–8. Available from: https://doi.org/10.1001/jama.2016.16477
Paoli CJ, Reynolds MA, Sinha M, Gitlin M, Crouser E. Epidemiology and Costs of Sepsis in the United States-An Analysis Based on Timing of Diagnosis and Severity Level. Crit Care Med [Internet] 2018 Dec [cited 2021 Nov 02] ;46(12):1889-1897. Available from: doi: 10.1097/CCM.0000000000003342.
Arefian H, Heublein S, Scherag A, Brunkhorst FM, Younis MZ, Moerer O, Fischer D, Hartmann M. Hospital-related cost of sepsis: A systematic review. J Infect [Internet] 2017 Feb [cited 2021 Nov 02];74(2):107-117. Available from: doi: 10.1016/j.jinf.2016.11.006.
Rudd KE, Kissoon N, Limmathurotsakul D, Bory S, Mutahunga B, Seymour CW, et al. The global burden of sepsis: barriers and potential solutions. Crit Care [Internet] 2018 [cited 2021 Nov 02]; 22:232. Available from: https://doi.org/10.1186/s13054-018-2157-z
Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for sepsis for the third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA - J Am Med Assoc [Internet]. 2016 Feb [cited 2021 Nov 02];315(8):762–74. Available from: https://doi.org/10.1001/jama.2016.0288
Royal College of Physicians (UK). National Early Warning Score (NEWS):Standardising the assessment of acute-illness severity in the NHS. London; 2012 [cited 2021 Nov 12]. Available from: https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2
Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation [Internet]. 2013 Apr [cited 2021 Nov 12];84(4):465–70. Available from: https://doi.org/10.1016/j.resuscitation.2012.12.016
Spagnolli W, Rigoni M, Torri E, Cozzio S, Vettorato E, Nollo G. Application of the National Early Warning Score (NEWS) as a stratification tool on admission in an Italian acute medical ward: A perspective study. Int J Clin Pract [Internet]. 2017 Mar [cited 2021 Nov 02];71(3–4):1–8. Available from: https://doi.org/10.1111/ijcp.12934
Redfern OC, Smith GB, Prytherch DR, Meredith P, Inada-Kim M, Schmidt PE. A comparison of the Quick sequential (Sepsis-related) Organ failure assessment score and the National early warning score in non-ICU patients with/without infection. Crit Care Med [Internet]. 2018 Dec [cited 2021 Nov 02];46(12):1923–33. Available from: https://doi.org/10.1097/CCM.0000000000003359
National Early Warning Score (NEWS) 2: Standardising the assessment of acute-illness severity in the NHS. Royal College of Physicians; 2017 [cited 2021 Nov 15]. Available from: https://www.rcplondon.ac.uk/projects/outputs/
national-early-warning-score-news-2
Pierrakos C, Velissaris D, Bisdorff M, Marshall JC, Vincent JL. Biomarkers of sepsis: time for a reappraisal. Crit Care [Internet]. 2020 Jun [cited 2021 Nov 15] ;24(1):287. Available from: https://doi.org/10.1186/s13054-020-02993-5.
Yousefi M, Yousefi M, Fogliatto FS, Ferreira RPM, Kim JH. Simulating the behavior of patients who leave a public hospital emergency department without being seen by a physician: A cellular automaton and agent-based framework. Brazilian J Med Biol Res [Internet]. 2018 [cited 2021 Nov 02];51(3):1–10. Available from: https://doi.org/10.1590/1414-431X20176961
Yoriyaz H. Monte Carlo Method: principles and applications in Medical Physics. Rev Bras Física Médica [Internet]. 2009 [cited 2021 Nov 02];3(1):141–9. Available from: https://doi.org/10.29384/rbfm.2009.v3.n1.p141-149
Churpek MM, Snyder A, Han X, Sokol S, Pettit N, Howell MD, et al. Quick sepsis-related organ failure assessment, systemic inflammatory response syndrome, and early warning scores for detecting clinical deterioration in infected patients outside theintensive care unit. Am J Respir Crit Care Med [Internet]. 2017 Apr [cited 2021 Nov 02];195(7):906–11. Available from: https://doi.org/10.1164/rccm.201604-0854OC
Lind ML, Phipps AI, Mooney S, Liu C, Fohner A, Patel K, et al. Predictive value of three clinical criteria for sepsis (qSOFA, SIRS, and NEWS) with respect to short-term mortality in allogeneic hematopoietic cell transplant recipients with suspected infections. Clin Infect Dis [Internet]. 2021 Apr [cited 2021 Nov 02]; 72(7):1220-9. Available from: https://doi.org/10.1093/cid/ciaa214
Prytherch DR, Smith GB, Schmidt P, Featherstone PI, Stewart K, Knight D, et al. Calculating early warning scores-A classroom comparison of pen and paper and hand-held computer methods. Resuscitation [Internet]. 2006 Aug [cited 2021 Nov 02];70(2):173–8. Available from: https://doi.org/10.1016/j.resuscitation.2005.12.002
Goulden R, Hoyle MC, Monis J, Railton D, Riley V, Martin P, et al. QSOFA, SIRS and NEWS for predicting inhospital mortality and ICU admission in emergency admissions treated as sepsis. Emerg Med J [Internet]. 2018 Jun [cited 2021 Nov 02];35(6):345–9. Available from: https://doi.org/10.1136/emermed-2017-207120
Williams JM, Greenslade JH, McKenzie J V., Chu K, Brown AFT, Lipman J. Systemic Inflammatory Response Syndrome, Quick Sequential Organ Function Assessment, and Organ Dysfunction: Insights From a Prospective Database of ED Patients With Infection. Chest [Internet]. 2017 Mar [cited 2021 Nov 02];151(3):586–96. Available from: https://doi.org/10.1016/j.chest.2016.10.057.
Rogers DWO. Fifty years of Monte Carlo simulations for medical physics. Phys Med Biol [Internet]. 2006 Jul [cited 2021 Nov 02];51(13). Available from: https://doi.org/10.1088/0031-9155/51/13/R17
Toerper MF, Kelen GD, Sauer LM, Bayram JD, Catlett C, Levin S. Hospital Surge Capacity: A Web-Based Simulation Tool for Emergency Planners. Disaster Med Public Health Prep [Internet]. 2018 Aug [cited 2021 Nov 02];12(4):513–22. Available from: https://doi.org/10.1017/dmp.2017.93
Arenas DJ, Lett E, Klusaritz H, Teitelman AM. A Monte Carlo simulation approach for estimating the health and economic impact of interventions provided at a student-run clinic. PLoS One [Internet]. 2017 Dec 28 [cited 2021 Nov 02];12(12):e0189718. Available from: doi: 10.1371/journal.pone.0189718.
Keuffel EL, Stevens M, Gunnarsson C, Rizzo J, Sessler DI, Maheshwari K. A Monte Carlo simulation estimating US hospital cost reductions associated with hypotension control in septic ICU patients. J Med Econ [Internet]. 2019 Apr [cited 2021 Nov 02];22(4):383–9. Available from: https://doi.org/10.1080/13696998.2019.1576695
