Next Article in Journal
Korean Nursing Students’ Experiences of Virtual Simulation Programs Replacing In-Person Mental Health Nursing Practicum during the COVID-19 Pandemic
Previous Article in Journal
Immigrant Perspectives of Social Connection in a Nontraditional Migration Area
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Mortality for COVID-19 Patients Admitted to an Emergency Department Using Early Warning Scores in Poland

by
Patryk Rzońca
1,*,
Sławomir Butkiewicz
2,
Paula Dobosz
3,
Artur Zaczyński
4,
Marcin Podgórski
5,
Robert Gałązkowski
5,
Waldemar Wierzba
6 and
Katarzyna Życińska
7
1
Department of Human Anatomy, Faculty of Health Sciences, Medical University of Warsaw, 02-091 Warsaw, Poland
2
Emergency Department, The National Institute of Medicine of the Ministry of Interior and Administration, 02-507 Warsaw, Poland
3
Institute of Genetics and Biotechnology, Faculty of Biology, University of Warsaw, 00-927 Warsaw, Poland
4
Clinical Department of Neurosurgery, The National Institute of Medicine of the Ministry of Interior and Administration, 02-507 Warsaw, Poland
5
Department of Emergency Medical Services, Faculty of Health Sciences, Medical University of Warsaw, 02-091 Warsaw, Poland
6
Satellite Campus in Warsaw, University of Humanities and Economics, 90-212 Łódź, Poland
7
Department of Rheumatology, Systemic Connective Tissue Diseases and Rare Diseases, The National Institute of Medicine of the Ministry of Interior and Administration, 02-507 Warsaw, Poland
*
Author to whom correspondence should be addressed.
Submission received: 22 February 2024 / Revised: 14 March 2024 / Accepted: 16 March 2024 / Published: 19 March 2024

Abstract

:
COVID-19 disease is characterised by a wide range of symptoms that in most cases resemble flu or cold. Early detection of infections, monitoring of patients’ conditions, and identification of patients with worsening symptoms became crucial during the peak of pandemic. The aim of this study was to assess and compare the performance of common early warning scores at the time of admission to an emergency department in predicting in-hospital mortality in patients with COVID-19. The study was based on a retrospective analysis of patients with SARS-CoV-2 infection admitted to an emergency department between March 2020 and April 2022. The prognostic value of early warning scores in predicting in-hospital mortality was assessed using the receiver operating characteristic (ROC) curve. Patients’ median age was 59 years, and 52.33% were male. Among all the EWS we assessed, REMS had the highest overall accuracy (AUC 0.84 (0.83–0.85)) and the highest NPV (97.4%). REMS was the most accurate scoring system, characterised by the highest discriminative power and negative predictive value compared to the other analysed scoring systems. Incorporating these tools into clinical practice in a hospital emergency department could provide more effective assessment of mortality and, consequently, avoid delayed medical assistance.

1. Introduction

The SARS-CoV-2 virus was first identified in late December 2019 in Wuhan, China. It is a pathogen belonging to the coronavirus family that spreads through droplet or contact transmission [1,2]. In humans, it causes a disease called COVID-19, which is characterised by a wide range of symptoms that in most cases resemble flu or cold. However, in some cases, it can lead to serious complications, including pneumonia, respiratory failure, and death [2,3]. The severity of the disease and mortality due to COVID-19 may vary depending on the patient’s age, health status, presence of comorbidities, and regional availability of medical services. According to numerous studies, about 15% of patients infected with SARS-CoV-2 require hospitalisation, with approximately 5% requiring intensive care unit treatment [4,5,6,7,8].
The COVID-19 pandemic had a huge impact on healthcare systems worldwide, forcing quick and effective action to combat the disease. In the initial phase of the pandemic, the biggest challenge was the rapid increase in the number of patients requiring treatment, including hospitalisation, mechanical ventilation, and intensive care. The pressure that healthcare systems faced when COVID-19 became a global problem was enormous and necessitated many changes aimed at dealing with a large number of patients infected with SARS-CoV-2 [9,10,11]. The methods for dealing with this problem varied depending on the country and region. Many countries decided to build new hospitals, usually temporarily kept, to accommodate a large number of patients, while others, operating under crisis conditions, decided to transform existing infrastructure into temporary hospitals. Ensuring adequate infrastructure, medical equipment, and appropriate healthcare staff was just the first step taken in the event of an increasing number of COVID-19 patients [12,13,14].
During the COVID-19 pandemic, early detection of infections, monitoring of patients’ conditions, and identification of patients with worsening symptoms became crucial. To achieve this goal, many countries utilised existing early warning scores (EWS) that are widely used in clinical practice in hospital emergency departments [15]. The use of EWS became particularly significant during the pandemic, as they enabled the rapid identification of patients requiring medical intervention as well as assessments of the risk of hospitalisation and the need for treatment in intensive care units. Moreover, EWS scales allow for the monitoring of COVID-19 patients and determining whether their condition is improving or worsening and provide a tool to support physicians in making therapeutic decisions and planning the treatment of COVID-19 patients [16,17,18,19]. The use of EWS scales may also play a key role in making decisions about which patients should be admitted to the hospital emergency department and receive treatment in the hospital setting and which can be discharged for outpatient treatment. This aspect of patient management is particularly important in light of a recent study by Fried et al., who demonstrated that with correct patient selection, even severe COVID-19 cases can be safely treated in the outpatient setting [20].
The aim of this study was to assess and compare the performance of the common early warning scores at the time of admission to the emergency department in predicting in-hospital mortality in patients with COVID-19.

2. Materials and Methods

2.1. Study Design and Setting

This was a retrospective study carried out in a National Institute of Medicine of the Ministry of Interior and Administration in Warsaw (Poland), which is one of the largest teaching hospitals in Warsaw and was a Referral Centre for COVID-19 in central Poland. The study was carried out based on the medical records covering the period between March 2020 and April 2022 of patients admitted to the Emergency Department of the Central Clinical Hospital of the Ministry of Interior and Administration in Warsaw.

2.2. Study Cohort and the Eligibility Criteria

A total cohort of 5024 cases were included in the final analysis. In the following study, all adult (>18 years old) patients admitted to the Emergency Department with SARS-CoV-2, which was confirmed by laboratory testing (dedicated test performed with the real-time reverse-transcriptase-polymerase-chain-reaction technique—RT-PCR) and/or whose final diagnosis expressed with the aid of the ICD-10 (International Classification of Diseases 10) code was U07.1, meaning COVID-19 disease. The exclusion criteria were: pregnancy among women (n = 316), pneumonia caused by other pathogens (n = 713), and incomplete data required to retrospectively calculate early warning scores (n = 1301).

2.3. Data Collection and Measurements

The data were extracted from the hospital’s internal database of clinical records and prepared by the hospital’s IT Department. Extracted data included: age and sex of the patients, length of hospital stay, temperature, heart rate (HR), respiratory rate (RR), systolic blood pressure (SBP), diastolic blood pressure (DBP), mean arterial pressure (MAP), laboratory test results, Glasgow Coma Scale (GCS) score, oxygen therapy, and peripheral oxygen saturation (SpO2), clinical symptoms and comorbidities, as well as outcomes of hospitalisation (survival or death).
Among all the EWSs available, we chose those that were the quickest to use and that could be calculated for each patient from available vital signs and physiological measurements recorded on admission to the Emergency Department. In this study, we selected six EWSs: Modified Early Warning Score (MEWS) [21], National Early Warning Score 2 (NEWS2) [22], National Early Warning Score (NEWS) [23,24], Standardised Early Warning Score (SEWS) [25], Rapid Emergency Medicine Score (REMS) [26], and Rapid Acute Physiology Score (RAPS) [27]. During the pandemic, MEWS was used to identify patients admitted to the hospital emergency department, and its results were featured in the database we obtained. The scores on the other scales, on the other hand, were calculated retrospectively. For NEWS2 calculation, patients were considered at risk of hypercapnic respiratory failure (SpO2 Scale 2) if they had a confirmed history of chronic obstructive pulmonary disease (COPD).

2.4. Statistical Analysis

Categorical variables were reported as numbers (n) and percentages (%), while continuous variables were reported as medians (Me) and interquartile ranges (IQR). Data distribution was evaluated using the Kolmogorov–Smirnov test and the Lilliefors test. Baseline data were compared using the chi-squared test for categorical variables and the Mann–Whitney U-test for continuous variables.
The prognostic value of early warning scores in predicting in-hospital mortality was assessed using the receiver operating characteristic (ROC) curve. The optimal cut-off values were calculated by the Youden index. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (+LR), and negative likelihood ratio (−LR) were then calculated. The areas under the ROC curve (AUROCs) were compared by the method described by DeLong.
The data obtained were analysed statistically using IBM SPSS statistics for Windows, Version 25.0 (Armonk, NY, USA: IBM Corp.) and MedCalc Statistical Software version 20.218 (MedCalc Software Ltd., Ostend, Belgium). In the study, a two-tailed p value of <0.05 was considered statistically significant.

2.5. Ethics

The study protocol was approved by the Bioethics Committee at the Medical University of Warsaw, which confirmed that the study did not require consent due to its retrospective nature (AKBE/13/2022). The study was performed in accordance with the principles established in the 1964 Declaration of Helsinki and its later amendments. Reports from the database did not permit identification of individual patients at any stage of the study.

3. Results

3.1. Population and Outcomes

Baseline characteristics of all 5024 patients who were included in the study cohort are presented in Table 1. Patients’ median age was 59 (IQR 42–74) years and 52.33% (2629 patients) were male. More than 21% of the patients required passive oxygen therapy, 1.13% patients required mechanical ventilation and more than 18% of the patients required nasal high-flow therapy. Admission to the ICU was recorded for more than 6% of the patients. The most commonly reported comorbidities were hypertension (23.09%) and diabetes (10.27%). Fever was the most common symptom (26.21%), followed by dyspnoea (18.31%) and cough (17.54%). The baseline MEWS, SEWS, NEWS, NEWS2, REMS and RAPS at the moment of admission were 1 (0–3), 1 (0–2), 2 (0–4), 2 (0–4), 5 (2–7), and 0 (0–2), respectively. Detailed results are shown in Table 1.
Cases were categorised into non-survivor and survivor groups. Patients in the non-survivor group were more likely to be male (61.64% vs. 50.98%), of older age (median 77 vs. 55 years). The comorbidities identified were more common among patients who did not survive. Fever (31.29% vs. 25.29%) and dyspnoea (28.93% vs. 16.77%) were more common in the non-survivor group. Passive oxygen therapy (54.09% vs. 17.05%), ventilator therapy (7.55% vs. 0.21%), nasal high-flow therapy (41.35% vs. 14.86%) and intensive care unit admission (32.08% vs. 2.42%) were more often required in the non-survivor group. The survivor and non-survivor groups also differed in terms of the vital signs and laboratory test results. Non-survivors were more likely to have higher MEWS (3 vs. 1), SEWS (3 vs. 1), NEWS (5 vs. 1), NEWS2 (5 vs. 2), REMS (8 vs. 4) and RAPS (1 vs. 0) (Table 1).

3.2. Prognostic Accuracy of Early Warning Score in Predicting the in-Hospital Mortality Rate

To assess the utility of EWS to predict the in-hospital mortality, the ROC curves were constructed and the AUCs were calculated (Figure 1A). The AUCs of MEWS, NEWS2, NEWS, SEWS, REMS, and RAPS were 0.74, 0.74, 0.79, 0.77, 0.84, and 0.66, respectively. Based on the best Youden index, an optimum cut-off value was used to predict in-hospital mortality using each score. The cut-off values for each score, together with the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (+LR), and negative likelihood ratio (−LR) are shown in Table 2. Among all the EWS we assessed, REMS had the highest overall accuracy (AUC 0.84 (0.83–0.85)) and the highest NPV (97.4%) (Table 2).
In the subgroup of age <65 years, the AUCs of MEWS, NEWS2, NEWS, SEWS, REMS, RAPS were 0.76, 0.77, 0.81, 0.79, 0.81, and 0.71, respectively (Figure 1B), whereas in the subgroup of age ≥65 years, the AUCs of MEWS, NEWS2, NEWS, SEWS, REMS, RAPS were 0.69, 0.68, 0.72, 0.72, 0.69 and 0.62, respectively (Figure 1C). Table 2 shows the cut-off values for each score based on the best Youden index together with the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (+LR), and negative likelihood ratio (−LR). An optimum cut-off value was used to predict in-hospital mortality using each score appropriate for the subgroup of age ≥65 years and the subgroup of age <65 years. Among all the EWS we assessed in the subgroup of age <65 years, NEMS had the highest overall accuracy (AUC 0.81 (0.80–0.82)) and the highest sensitivity (81.6%) and NPV (99.2%). In the subgroup of age ≥65 years, SEWS had the highest overall accuracy (AUC 0.72 (0.70–0.74)) and the highest sensitivity (71.4%) and NPV (85.8%) (Table 2).
Pairwise comparisons of the AUCs associated with the six EWSs showed significant differences among all investigated scales. The AUC of the REMS for predicting in-hospital mortality was much higher than that for MEWS, NEWS2, NEWS, SEWS, REMS, RAPS. The greatest difference between areas under curves, respectively, was observed in the case of REMS—RAPS (0.188, <0.001), REMS—MEWS (0.103, <0.001) and REMS—NEWS2 (0.102, <0.001) (Table 3).
Pairwise comparisons of the AUCs associated with the 6 EWSs showed significant differences among 9 pairs in the subgroup of age <65 years and 11 pairs in the subgroup of age ≥65 years. In the subgroup of age <65 years, the AUC of the NEMS for predicting in-hospital mortality was much higher than that for MEWS, NEWS2, SEWS, REMS, RAPS. The greatest difference between areas under curves was observed between NEMS and SEWS (0.105, <0.001). In the subgroup of age ≥65 years, the AUC of the SEWS for predicting in-hospital mortality was much higher than that for MEWS, NEWS2, NEWS, REMS, RAPS, of which the greatest difference between areas under curves was observed between SEWS and RAPS (0.106, <0.001) (Table 3).

4. Discussion

The SARS-CoV-2 pandemic, its impact, and consequences have been the subject of numerous scientific publications worldwide. The aims of these studies have been and continue to be the analysis of risk factors for severe disease progression and in-hospital mortality, diagnostic evaluation, and treatment; thus, ongoing research is necessary for a better understanding of this global problem. This requires patience, improvement, innovation, the need for evolution, and learning from others’ experience during the SARS-CoV-2 pandemic [28,29,30,31,32]. Therefore, the aim of the undertaken research was to assess and compare the performance of common early warning scores (EWS) at the time of admission to the Accident and Emergency department in predicting in-hospital mortality in patients with COVID-19.
The results of our research have shown that, among the analysed participants who did not survive, there were males and older individuals, which is consistent with the findings of López-Pérez et al. [33]. At the same time, the literature emphasises strongly that advanced age and male gender are the main risk factors for severe disease and mortality due to COVID-19 [32,33,34]. Numerous studies published to date have demonstrated that comorbidities such as hypertension, diabetes, COPD, malignancy and chronic kidney disease are associated with a severe course of infection and higher mortality due to COVID-19 [35,36,37,38,39,40,41]. Our results have shown that the highest mortality rate was associated with hypertension, renal failure and diabetes. Furthermore, the main symptoms of COVID-19 include fever, headache, muscle pain, cough, fatigue, and shortness of breath [28,34,42,43]. In our study, non-survivors more frequently required specialised medical procedures such as respiratory therapy and nasal high-flow therapy. They also more frequently required admission to the Intensive Care Unit. Similar results were obtained by van Halem et al. and Díaz-Vélez et al. [44,45]. The clinical picture in hospitalised patients who died due to COVID-19 showed elevated values of selected vital signs, such as heart rate and respiration rate, and lower MAP or oxygen saturation values. Moreover, the results of laboratory tests pointed to higher inflammation, which has been corroborated by our findings and those of other researchers [32,45,46,47]. The obtained results of our research reflect scientific reports from around the world regarding the characteristics of individuals who did not survive due to COVID-19.
It should be emphasised that since the beginning of the COVID-19 pandemic, a total of 6,950,655 deaths have been reported worldwide, according to data from the World Health Organization [48]. Rentsch et al. demonstrated a mortality rate of 10.7% among their studied patients with a positive PCR test in the United States [49]. On the other hand, Olivas-Martinez et al. reported an in-hospital mortality rate of 30.1% for hospitalised patients with severe COVID-19 in a tertiary care centre in Mexico [50]. Aygun et al. found a 16.8% 28-day mortality rate among their analysed patients with a positive PCR test in Turkey [17]. López-Pérez et al. reported a mortality rate of 13.1% among the analysed patients in their study on risk factors for mortality of hospitalised adult patients with COVID-19 pneumonia in a private tertiary care centre in Mexico [33]. In our analysis, the mortality rate among patients was nearly 22%. It should be noted that factors such as the duration of the study period and the organisation of the healthcare system (including the level of the referring hospital) can influence the mortality rates observed in COVID-19 patients.
A study by Martín-Rodríguez et al. on patients transferred to the hospital emergency department with suspected COVID-19 infection showed that non-survivors had higher scores on the following scales: NEWS2, qSOFA, Modified REMS and RAPS [51]. In our study, patients who did not survive also had significantly higher scores on early warning scales. Therefore, the identification of patients who are likely to deteriorate clinically and die from COVID-19 in a short period of time is absolutely essential for proper organisation of work in the hospital emergency department and rational utilisation of medical staff. Of all the early warning scores analysed, the best overall prognostic performance was obtained by the Rapid Emergency Medicine Score (REMS), which had the highest discriminatory power (AUC 0.84) and the highest negative predictive value (97.4%) when assessed upon admission to the emergency department compared to other scoring systems. This is consistent with studies by other researchers [27,52,53]. These results can be explained by the components of REMS, i.e., MAP and age, which are not part of the other EWS scales analysed. A study by Nam et al. on the effect of blood pressure variability in patients with COVID-19 and hypertension showed that age and higher MAPcv were significantly associated with in-hospital mortality [54]. It is worth emphasising that there are also studies that used other early warning scales. Wei et al. found that the National Early Warning Score 2 (NEWS2) exhibits excellent sensitivity and specificity in predicting early mortality in both prehospital and emergency department settings. In their study comparing triage tools for identifying mortality risk and injury severity in patients with multiple traumas admitted to the emergency department (ED) during daytime and night time [55], Ying et al. demonstrated that NEWS is the best tool in this regard for both daytime and night-time admissions. They also found that the modified Rapid Emergency Medicine Score (mREMS) was better at identifying serious injuries during the day [56]. Kostakis et al. conducted an analysis of the use of NEWS and NEWS2 in hospitalised patients with SARS-CoV-2 and found that the results of NEWS or NEWS2 were good and similar across all five analysed cohorts (range = 0.842–0.894), suggesting that adjustments to these scores, such as adding new variables or changing the weights of existing parameters, are not necessary for evaluating patients with COVID-19 [57].
Several studies indicate that advanced age is an independent factor associated with mortality in patients with COVID-19 [58,59,60,61]. Therefore, the next step of our study was to calculate the prognostic value of early warning scales in two subgroups (<65 years and ≥65 years). Analysis of our research revealed that for the subgroup of patients under the age of 65, NEWS and REMS upon admission to the emergency department had the highest discriminatory power values (AUC 0.81) compared to other scoring systems. For the subgroup of patients aged 65 and above, NEWS and Standardised Early Warning Score (SEWS) achieved the highest discriminatory power values (AUC 0.72) compared to the other scores. Additionally, the findings of Hu et al. showed that NEWS and NEWS2 had the highest AUC values (0.829) for the subgroup aged 65 and above, while for the subgroup under the age of 65, SEWS had the highest AUC (0.893) [15].
This study had several limitations. Firstly, it was a single-centre study and had a retrospective nature. Further validation in a multi-centre cohort is still required. Secondly, in the study, the EWS value was calculated only based on parameters at the time of admission to the hospital emergency department, without recording parameter changes during the hospital stay. Thirdly, the primary outcome measure was in-hospital mortality, assuming that all patients who were discharged did not die. Despite these limitations, we made every effort to ensure the study had high-quality results.

5. Conclusions

REMS was the most accurate scoring system, characterised by the highest discriminative power and negative predictive value compared to the other analysed scoring systems. This may stem from the fact that REMS is the only scale whose parameters include the patient’s age and MAP. In the group of patients below 65 years of age, NEWS and REMS were the most effective in predicting mortality in COVID-19 patients, while in the group of patients aged 65 years and above, NEWS and SEWS had the highest predictive value. Despite MEWS being used in many hospitals during the pandemic in Poland, it is not suitable for COVID-19 patients, as its performance and prognostic value in predicting mortality are inferior to other early warning scales. Incorporating these tools into clinical practice in the hospital emergency department could provide more effective assessment of mortality and, consequently, avoid delayed medical assistance.

Author Contributions

Conceptualisation, P.R. and K.Ż.; methodology, P.R. and. S.B.; formal analysis, P.R.; resources, P.R.; data curation, P.R. and S.B.; writing—original draft preparation, P.R. and S.B.; writing—review and editing, P.R., S.B., P.D., A.Z., R.G., K.Ż., M.P. and W.W.; supervision, K.Ż.; project administration, P.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study protocol was submitted to the Bioethics Committee at the Medical University of Warsaw, which confirmed that the study did not require consent due to its retrospective nature (AKBE/13/2022).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hu, B.; Guo, H.; Zhou, P.; Shi, Z.L. Characteristics of SARS-CoV-2 and COVID-19. Nat. Rev. Microbiol. 2021, 19, 141–154. [Google Scholar] [CrossRef]
  2. Adil, M.T.; Rahman, R.; Whitelaw, D.; Jain, V.; Al-Taan, O.; Rashid, F.; Munasinghe, A.; Jambulingam, P. SARS-CoV-2 and the pandemic of COVID-19. Postgrad. Med. J. 2021, 97, 110–116. [Google Scholar] [CrossRef]
  3. Li, Q.; Guan, X.; Wu, P.; Wang, X.; Zhou, L.; Tong, Y.; Ren, R.; Leung, K.S.M.; Lau, E.H.Y.; Wong, J.Y.; et al. Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus-Infected Pneumonia. N. Engl. J. Med. 2020, 382, 1199–1207. [Google Scholar] [CrossRef]
  4. Meyerowitz, E.A.; Richterman, A.; Gandhi, R.T.; Sax, P.E. Transmission of SARS-CoV-2: A Review of Viral, Host, and Environmental Factors. Ann. Intern. Med. 2021, 174, 69–79. [Google Scholar] [CrossRef] [PubMed]
  5. Boehm, E.; Kronig, I.; Neher, R.A.; Eckerle, I.; Vetter, P.; Kaiser, L.; Geneva Centre for Emerging Viral Diseases. Novel SARS-CoV-2 variants: The pandemics within the pandemic. Clin. Microbiol. Infect. 2021, 27, 1109–1117. [Google Scholar] [CrossRef] [PubMed]
  6. Peltan, I.D.; Caldwell, E.; Admon, A.J.; Attia, E.F.; Gundel, S.J.; Mathews, K.S.; Nagrebetsky, A.; Sahetya, S.K.; Ulysse, C.; Brown, S.M.; et al. Characteristics and Outcomes of US Patients Hospitalized With COVID-19. Am. J. Crit. Care. 2022, 31, 146–157. [Google Scholar] [CrossRef] [PubMed]
  7. Chaudhary, A.; Singh, U.N.; Paudel, P.; Thapa, N.; Khadka, K.; Sah, P.K.; Kamar, S.B.; Joshi, J.; Ansari, K.H.; Tiwari, S.R.; et al. Characteristics and outcomes of hospitalized adults with COVID-19 in Nepal: A multicenter, prospective cohort study. J. Infect. Dev. Ctries. 2022, 16, 469–477. [Google Scholar] [CrossRef] [PubMed]
  8. Goyal, P.; Reshetnyak, E.; Khan, S.; Musse, M.; Navi, B.B.; Kim, J.; Allen, L.A.; Banerjee, S.; Elkind, M.S.V.; Shah, S.J.; et al. Clinical Characteristics and Outcomes of Adults With a History of Heart Failure Hospitalized for COVID-19. Circ. Heart Fail. 2021, 14, e008354. [Google Scholar] [CrossRef] [PubMed]
  9. Arabi, Y.M.; Murthy, S.; Webb, S. COVID-19: A novel coronavirus and a novel challenge for critical care. Intensive Care Med. 2020, 46, 833–836. [Google Scholar] [CrossRef] [PubMed]
  10. Filip, R.; Gheorghita Puscaselu, R.; Anchidin-Norocel, L.; Dimian, M.; Savage, W.K. Global Challenges to Public Health Care Systems during the COVID-19 Pandemic: A Review of Pandemic Measures and Problems. J. Pers. Med. 2022, 12, 1295. [Google Scholar] [CrossRef]
  11. Zhang, H. Challenges and Approaches of the Global Governance of Public Health Under COVID-19. Front. Public. Health 2021, 9, 727214. [Google Scholar] [CrossRef] [PubMed]
  12. Brambilla, A.; Sun, T.Z.; Elshazly, W.; Ghazy, A.; Barach, P.; Lindahl, G.; Capolongo, S. Flexibility during the COVID-19 Pandemic Response: Healthcare Facility Assessment Tools for Resilient Evaluation. Int. J. Environ. Res. Public Health 2021, 18, 11478. [Google Scholar] [CrossRef]
  13. Candel, F.J.; Canora, J.; Zapatero, A.; Barba, R.; González Del Castillo, J.; García-Casasola, G.; San-Román, J.; Gil-Prieto, R.; Barreiro, P.; Fragiel, M.; et al. Temporary hospitals in times of the COVID pandemic. An example and a practical view. Rev. Esp. Quimioter. 2021, 34, 280–288. [Google Scholar] [CrossRef]
  14. Campos, A.T.; Dos Santos, C.H.; Gabriel, G.T.; Montevechi, J.A.B. Safety assessment for temporary hospitals during the COVID-19 pandemic: A simulation approach. Saf. Sci. 2022, 147, 105642. [Google Scholar] [CrossRef] [PubMed]
  15. Hu, H.; Yao, N.; Qiu, Y. Predictive Value of 5 Early Warning Scores for Critical COVID-19 Patients. Disaster Med. Public Health Prep. 2022, 16, 232–239. [Google Scholar] [CrossRef] [PubMed]
  16. Myrstad, M.; Ihle-Hansen, H.; Tveita, A.A.; Andersen, E.L.; Nygård, S.; Tveit, A.; Berge, T. National Early Warning Score 2 (NEWS2) on admission predicts severe disease and in-hospital mortality from COVID-19—A prospective cohort study. Scand. J. Trauma. Resusc. Emerg. Med. 2020, 28, 66. [Google Scholar] [CrossRef] [PubMed]
  17. Aygun, H.; Eraybar, S. The role of emergency department triage early warning score (TREWS) and modified early warning score (MEWS) to predict in-hospital mortality in COVID-19 patients. Ir. J. Med. Sci. 2022, 191, 997–1003. [Google Scholar] [CrossRef]
  18. Mahmoodpoor, A.; Sanaie, S.; Saghaleini, S.H.; Ostadi, Z.; Hosseini, M.S.; Sheshgelani, N.; Vahedian-Azimi, A.; Samim, A.; Rahimi-Bashar, F. Prognostic value of National Early Warning Score and Modified Early Warning Score on intensive care unit readmission and mortality: A prospective observational study. Front. Med. 2022, 9, 938005. [Google Scholar] [CrossRef]
  19. Aygun, H.; Eraybar, S.; Ozdemir, F.; Armagan, E. Predictive Value of Modified Early Warning Scoring System for Identifying Critical Patients with Malignancy in Emergency Department. Arch. Iran. Med. 2020, 23, 536–541. [Google Scholar] [CrossRef]
  20. Fried, S.; Bar-Shai, A.; Frydman, S.; Freund, O. Transition of care interventions to manage severe COVID-19 in the ambulatory setting: A systematic review. Intern. Emerg. Med. 2023. [Google Scholar] [CrossRef]
  21. Chang, S.H.; Hsieh, C.H.; Weng, Y.M.; Hsieh, M.S.; Goh, Z.N.L.; Chen, H.Y.; Chang, T.; Ng, C.J.; Seak, J.C.; Seak, C.K.; et al. Performance Assessment of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score, and Rapid Acute Physiology Score in Predicting Survival Outcomes of Adult Renal Abscess Patients in the Emergency Department. Biomed. Res. Int. 2018, 2018, 6983568. [Google Scholar] [CrossRef]
  22. Zaidi, H.; Bader-El-Den, M.; McNicholas, J. Using the National Early Warning Score (NEWS/NEWS 2) in different intensive care units (ICUs) to predict the discharge location of patients. BMC Public Health 2019, 19, 1231. [Google Scholar] [CrossRef]
  23. Kivipuro, M.; Tirkkonen, J.; Kontula, T.; Solin, J.; Kalliomäki, J.; Pauniaho, S.L.; Huhtala, H.; Yli-Hankala, A.; Hoppu, S. National early warning score (NEWS) in a Finnish multidisciplinary emergency department and direct vs. late admission to intensive care. Resuscitation 2018, 128, 164–169. [Google Scholar] [CrossRef]
  24. Day, T.; Oxton, J. The National Early Warning Score in practice: A reflection. Br. J. Nurs. 2014, 23, 1036–1040. [Google Scholar] [CrossRef]
  25. Paterson, R.; MacLeod, D.C.; Thetford, D.; Beattie, A.; Graham, C.; Lam, S.; Bell, D. Prediction of in-hospital mortality and length of stay using an early warning scoring system: Clinical audit. Clin. Med. 2006, 6, 281–284. [Google Scholar] [CrossRef] [PubMed]
  26. Bidari, A.; Talachian, E. Rapid Emergency Medicine Score (REMS) As a Predictor of Early Mortality in the Setting of Emergency Department. Iran. J. Med. Sci. 2022, 47, 81–82. [Google Scholar] [CrossRef]
  27. Özdemir, S.; Akça, H.Ş.; Algın, A.; Altunok, İ.; Eroğlu, S.E. Effectiveness of the rapid emergency medicine score and the rapid acute physiology score in prognosticating mortality in patients presenting to the emergency department with COVID-19 symptoms. Am. J. Emerg. Med. 2021, 49, 259–264. [Google Scholar] [CrossRef] [PubMed]
  28. Ochani, R.; Asad, A.; Yasmin, F.; Shaikh, S.; Khalid, H.; Batra, S.; Sohail, M.R.; Mahmood, S.F.; Ochani, R.; Hussham Arshad, M.; et al. COVID-19 pandemic: From origins to outcomes. A comprehensive review of viral pathogenesis, clinical manifestations, diagnostic evaluation, and management. Infez. Med. 2021, 29, 20–36. [Google Scholar] [PubMed]
  29. Leither, L.M.; Buckel, W.; Brown, S.M. Care of the Seriously Ill Patient with SARS-CoV-2. Med. Clin. N. Am. 2022, 106, 949–960. [Google Scholar] [CrossRef] [PubMed]
  30. Mukherjee, S.; Ray, S.K. Third Wave of the COVID-19 Pandemic: Prominence of Initial Public Health Interference. Infect. Disord. Drug Targets 2022, 22, e080222200919. [Google Scholar] [CrossRef] [PubMed]
  31. Deana, C.; Rovida, S.; Orso, D.; Bove, T.; Bassi, F.; De Monte, A.; Vetrugno, L. Learning from the Italian experience during COVID-19 pandemic waves: Be prepared and mind some crucial aspects. Acta Biomed. 2021, 92, e2021097. [Google Scholar] [CrossRef]
  32. Zhang, J.J.; Dong, X.; Liu, G.H.; Gao, Y.D. Risk and Protective Factors for COVID-19 Morbidity, Severity, and Mortality. Clin. Rev. Allergy Immunol. 2023, 64, 90–107. [Google Scholar] [CrossRef] [PubMed]
  33. López-Pérez, C.A.; Santa Cruz-Pavlovich, F.J.; Montiel-Cortés, J.E.; Núñez-Muratalla, A.; Morán-González, R.B.; Villanueva-Gaona, R.; Franco-Mojica, X.; Moreno-Sandoval, D.G.; González-Bañuelos, J.A.; López-Pérez, A.U.; et al. Risk Factors for Mortality of Hospitalized Adult Patients with COVID-19 Pneumonia: A Two-Year Cohort Study in a Private Tertiary Care Center in Mexico. Int. J. Environ. Res. Public Health 2023, 20, 4450. [Google Scholar] [CrossRef] [PubMed]
  34. Long, B.; Carius, B.M.; Chavez, S.; Liang, S.Y.; Brady, W.J.; Koyfman, A.; Gottlieb, M. Clinical update on COVID-19 for the emergency clinician: Presentation and evaluation. Am. J. Emerg. Med. 2022, 54, 46–57. [Google Scholar] [CrossRef] [PubMed]
  35. Wang, D.; Hu, B.; Hu, C.; Zhu, F.; Liu, X.; Zhang, J.; Wang, B.; Xiang, H.; Cheng, Z.; Xiong, Y.; et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA 2020, 323, 1061–1069. [Google Scholar] [CrossRef] [PubMed]
  36. Liang, W.; Guan, W.; Chen, R.; Wang, W.; Li, J.; Xu, K.; Li, C.; Ai, Q.; Lu, W.; Liang, H.; et al. Cancer patients in SARS-CoV-2 infection: A nationwide analysis in China. Lancet Oncol. 2020, 21, 335–337. [Google Scholar] [CrossRef]
  37. Wang, L.; Li, X.; Chen, H.; Yan, S.; Li, D.; Li, Y.; Gong, Z. Coronavirus Disease 19 Infection Does Not Result in Acute Kidney Injury: An Analysis of 116 Hospitalized Patients from Wuhan, China. Am. J. Nephrol. 2020, 51, 343–348. [Google Scholar] [CrossRef]
  38. Sami, R.; Hajian, M.R.; Amra, B.; Soltaninejad, F.; Mansourian, M.; Mirfendereski, S.; Sadegh, R.; Khademi, N.; Jalali, S.; Shokri-Mashhadi, N. Risk Factors for the Mortality in Hospitalized Patients with COVID-19: A Brief Report. Iran. J. Med. Sci. 2021, 46, 487–492. [Google Scholar] [CrossRef]
  39. Karasneh, R.A.; Khassawneh, B.Y.; Al-Azzam, S.; Al-Mistarehi, A.H.; Lattyak, W.J.; Aldiab, M.; Kabbaha, S.; Hasan, S.S.; Conway, B.R.; Aldeyab, M.A. Risk Factors Associated with Mortality in COVID-19 Hospitalized Patients: Data from the Middle East. Int. J. Clin. Pract. 2022, 2022, 9617319. [Google Scholar] [CrossRef]
  40. Riziki Ghislain, M.; Muzumbukilwa, W.T.; Magula, N. Risk factors for death in hospitalized COVID-19 patients in Africa: A systematic review and meta-analysis. Medicine 2023, 102, e34405. [Google Scholar] [CrossRef] [PubMed]
  41. O’Leary, A.L.; Wattengel, B.A.; Carter, M.T.; Drye, A.F.; Mergenhagen, K.A. Risk factors associated with mortality in hospitalized patients with laboratory confirmed SARS-CoV-2 infection during the period of omicron (B.1.1.529) variant predominance. Am. J. Infect. Control. 2022, 51, 603–606. [Google Scholar] [CrossRef] [PubMed]
  42. Chilamakuri, R.; Agarwal, S. COVID-19: Characteristics and Therapeutics. Cells 2021, 10, 206. [Google Scholar] [CrossRef] [PubMed]
  43. Liu, Q.; Xu, K.; Wang, X.; Wang, W. From SARS to COVID-19: What lessons have we learned? J. Infect. Public Health 2020, 13, 1611–1618. [Google Scholar] [CrossRef] [PubMed]
  44. van Halem, K.; Bruyndonckx, R.; van der Hilst, J.; Cox, J.; Driesen, P.; Opsomer, M.; Van Steenkiste, E.; Stessel, B.; Dubois, J.; Messiaen, P. Risk factors for mortality in hospitalized patients with COVID-19 at the start of the pandemic in Belgium: A retrospective cohort study. BMC Infect. Dis. 2020, 20, 897. [Google Scholar] [CrossRef]
  45. Díaz-Vélez, C.; Urrunaga-Pastor, D.; Romero-Cerdán, A.; Peña-Sánchez, E.R.; Fernández Mogollon, J.L.; Cossio Chafloque, J.D.; Marreros Ascoy, G.C.; Benites-Zapata, V.A. Risk factors for mortality in hospitalized patients with COVID-19 from three hospitals in Peru: A retrospective cohort study. F1000Research 2021, 10, 224. [Google Scholar] [CrossRef] [PubMed]
  46. Soto, A.; Quiñones-Laveriano, D.M.; Azañero, J.; Chumpitaz, R.; Claros, J.; Salazar, L.; Rosales, O.; Nuñez, L.; Roca, D.; Alcantara, A. Mortality and associated risk factors in patients hospitalized due to COVID-19 in a Peruvian reference hospital. PLoS ONE 2022, 17, e0264789. [Google Scholar] [CrossRef] [PubMed]
  47. Hanh, D.L.M.; Hao, P.T.; Oanh, D.T.T.; Tho, N.V. Risk Factors Related to the Death of Admitted COVID-19 Patients: A Buffalo Study. Open Respir. Med. J. 2023, 17, e187430642302200. [Google Scholar] [CrossRef] [PubMed]
  48. WHO Coronavirus (COVID-19) Dashboard. Available online: https://covid19.who.int/ (accessed on 14 July 2023).
  49. Rentsch, C.T.; Kidwai-Khan, F.; Tate, J.P.; Park, L.S.; King, J.T., Jr.; Skanderson, M.; Hauser, R.G.; Schultze, A.; Jarvis, C.I.; Holodniy, M.; et al. Patterns of COVID-19 testing and mortality by race and ethnicity among United States veterans: A nationwide cohort study. PLoS Med. 2020, 17, e1003379. [Google Scholar] [CrossRef]
  50. Olivas-Martínez, A.; Cárdenas-Fragoso, J.L.; Jiménez, J.V.; Lozano-Cruz, O.A.; Ortiz-Brizuela, E.; Tovar-Méndez, V.H.; Medrano-Borromeo, C.; Martínez-Valenzuela, A.; Román-Montes, C.M.; Martínez-Guerra, B.; et al. In-hospital mortality from severe COVID-19 in a tertiary care center in Mexico City; causes of death, risk factors and the impact of hospital saturation. PLoS ONE. 2021, 16, e0245772. [Google Scholar] [CrossRef]
  51. Martín-Rodríguez, F.; Martín-Conty, J.L.; Sanz-García, A.; Rodríguez, V.C.; Rabbione, G.O.; Cebrían Ruíz, I.; Oliva Ramos, J.R.; Castro Portillo, E.; Polonio-López, B.; Enríquez de Salamanca Gambarra, R.; et al. Early Warning Scores in Patients with Suspected COVID-19 Infection in Emergency Departments. J. Pers. Med. 2021, 11, 170. [Google Scholar] [CrossRef]
  52. Ruangsomboon, O.; Phanprasert, N.; Jirathanavichai, S.; Puchongmart, C.; Boonmee, P.; Thirawattanasoot, N.; Dorongthom, T.; Praphruetkit, N.; Monsomboon, A. The utility of the Rapid Emergency Medicine Score (REMS) compared with three other early warning scores in predicting in-hospital mortality among COVID-19 patients in the emergency department: A multicenter validation study. BMC Emerg. Med. 2023, 23, 45. [Google Scholar] [CrossRef]
  53. Bourn, S.S.; Crowe, R.P.; Fernandez, A.R.; Matt, S.E.; Brown, A.L.; Hawthorn, A.B.; Myers, J.B. Initial prehospital Rapid Emergency Medicine Score (REMS) to predict outcomes for COVID-19 patients. J. Am. Coll. Emerg. Physicians Open 2021, 2, e12483. [Google Scholar] [CrossRef]
  54. Nam, J.H.; Park, J.I.; Kim, B.J.; Kim, H.T.; Lee, J.H.; Lee, C.H.; Son, J.W.; Kim, U.; Park, J.S.; Shin, D.G.; et al. Clinical impact of blood pressure variability in patients with COVID-19 and hypertension. Blood Press. Monit. 2021, 26, 348–356. [Google Scholar] [CrossRef]
  55. Wei, S.; Xiong, D.; Wang, J.; Liang, X.; Wang, J.; Chen, Y. The accuracy of the National Early Warning Score 2 in predicting early death in prehospital and emergency department settings: A systematic review and meta-analysis. Ann. Transl. Med. 2023, 11, 95. [Google Scholar] [CrossRef]
  56. Ying, Y.; Huang, B.; Zhu, Y.; Jiang, X.; Dong, J.; Ding, Y.; Wang, L.; Yuan, H.; Jiang, P. Comparison of Five Triage Tools for Identifying Mortality Risk and Injury Severity of Multiple Trauma Patients Admitted to the Emergency Department in the Daytime and Nighttime: A Retrospective Study. Appl. Bionics Biomech. 2022, 2022, 9368920. [Google Scholar] [CrossRef]
  57. Kostakis, I.; Smith, G.B.; Prytherch, D.; Meredith, P.; Price, C.; Chauhan, A.; Portsmouth Academic ConsortIum For Investigating COVID-19 (PACIFIC-19). The performance of the National Early Warning Score and National Early Warning Score 2 in hospitalised patients infected by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Resuscitation 2021, 159, 150–157. [Google Scholar] [CrossRef]
  58. Wu, C.; Chen, X.; Cai, Y.; Xia, J.; Zhou, X.; Xu, S.; Huang, H.; Zhang, L.; Zhou, X.; Du, C.; et al. Risk Factors Associated With Acute Respiratory Distress Syndrome and Death in Patients With Coronavirus Disease 2019 Pneumonia in Wuhan, China. JAMA Intern. Med. 2020, 180, 934–943. [Google Scholar] [CrossRef]
  59. Feng, Y.; Ling, Y.; Bai, T.; Xie, Y.; Huang, J.; Li, J.; Xiong, W.; Yang, D.; Chen, R.; Lu, F.; et al. COVID-19 with Different Severities: A Multicenter Study of Clinical Features. Am. J. Respir. Crit. Care Med. 2020, 201, 1380–1388. [Google Scholar] [CrossRef] [PubMed]
  60. Pijls, B.G.; Jolani, S.; Atherley, A.; Derckx, R.T.; Dijkstra, J.I.R.; Franssen, G.H.L.; Hendriks, S.; Richters, A.; Venemans-Jellema, A.; Zalpuri, S.; et al. Demographic risk factors for COVID-19 infection, severity, ICU admission and death: A meta-analysis of 59 studies. BMJ Open 2021, 11, e044640. [Google Scholar] [CrossRef] [PubMed]
  61. Su, Y.; Ju, M.J.; Xie, R.C.; Yu, S.J.; Zheng, J.L.; Ma, G.G.; Liu, K.; Ma, J.F.; Yu, K.H.; Tu, G.W.; et al. Prognostic Accuracy of Early Warning Scores for Clinical Deterioration in Patients With COVID-19. Front. Med. 2021, 7, 624255. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Receiver operator characteristic curves illustrating the ability of MEWS score, NEWS2 scores, NEWS score, SEWS score, REMS score, RAPS score at emergency department admission to predict mortality from COVID-19 for overall cases and for subgroups ((A)—overall cases; (B)—subgroup of age <65 years; (C)—subgroup of age ≥65 years).
Figure 1. Receiver operator characteristic curves illustrating the ability of MEWS score, NEWS2 scores, NEWS score, SEWS score, REMS score, RAPS score at emergency department admission to predict mortality from COVID-19 for overall cases and for subgroups ((A)—overall cases; (B)—subgroup of age <65 years; (C)—subgroup of age ≥65 years).
Healthcare 12 00687 g001
Table 1. Patients’ characteristics and a comparative analysis between the surviving and non-surviving groups of patients with COVID-19 infection.
Table 1. Patients’ characteristics and a comparative analysis between the surviving and non-surviving groups of patients with COVID-19 infection.
VariablesTotal
(n = 5024)
Survivors (n = 4023)Non-Survivors (n = 1104)p-Value
Age [years]—Me (IQR)59 (42–74)55 (40–70)77 (69–86)<0.001
      >65—n (%)2122 (42.24)1573 (35.85)549 (86.32)<0.001
Sex [Male]—n (%)2629 (52.33)2237 (50.98)392 (61.64)<0.001
Comorbidities—n (%)
      Hypertension1160 (23.09)877 (19.99)283 (44.50)<0.001
      Diabetes516 (10.27)360 (8.20)156 (24.53)<0.001
      Acute coronary syndromes history367 (7.30)256 (5.83)111 (17.45)<0.001
      Stroke history254 (5.06)175 (3.99)79 (12.42)<0.001
      Cancer202 (4.02)127 (2.89)75 (11.79)<0.001
      Renal failure422 (8.40)261 (5.95)161 (25.31)<0.001
      Heart failure350 (6.97)237 (5.40)113 (17.77)<0.001
      COPD107 (2.16)72 (1.64)35 (5.50)<0.001
      Smoking248 (4.94)197 (4.49)51 (8.02)<0.001
Symptoms—n (%)
      Fever1317 (26.21)1118 (25.48)199 (31.29)0.002
      Cough881 (17.54)768 (17.50)113 (17.77)0.870
      Dyspnoea920 (18.31)736 (16.77)184 (28.93)<0.001
      Muscle pain365 (7.27)339 (7.73)26 (4.09)0.001
      Diarrhoea361 (7.19)309 (7.04)52 (8.18)0.301
      Loss/change in sense of taste271 (5.39)254 (5.79)17 (2.67)0.001
      Loss/change in sense of smell311 (6.19)291 (6.63)20 (3.14)0.001
      Headache386 (7.68)362 (8.25)24 (3.77)<0.001
Passive oxygen therapy [Yes]—n (%)1092 (21.74)748 (17.05)344 (54.09)<0.001
Ventilator therapy [Yes]—n (%)57 (1.13)9 (0.21)48 (7.55)<0.001
Nasal high-flow therapy [Yes]—n (%)915 (18.21)652 (14.86)263 (41.35)<0.001
ICU admission [Yes]—n (%)310 (6.17)106 (2.42)204 (32.08)<0.001
Vital signs—Me (IQR)
      Systolic blood pressure [mmHg]133 (119–149)134 (120–149)127 (108–150)<0.001
      Diastolic blood pressure [mmHg]81 (72–90)81 (93–90)75 (63–88)<0.001
      MAP [mmHg]99 (89–108)99 (90–108)93 (81–107)<0.001
      Heart rate [beats per minute]87 (77–100)87 (76–100)92 (78–110)<0.001
      Respiratory rate [breaths per minute]17 (15–20)17 (15–19)20 (18–25)<0.001
      Oxygen saturation [%]97 (95–99)97 (95–99)92 (86–96)<0.001
      Body temperature [°C]36.7 (36.4–37.5)36.7 (36.4–37.4)36.9 (36.3–38.0)0.083
Laboratory test results—Me (IQR)
      WBC count [thousand/µL]6 (5–9)6 (5–8)10 (6–18)<0.001
      RBC count [million/µL]5 (4–5)5 (4–5)4 (3–4)<0.001
      Haemoglobin [g/dL]14 (12–15)14 (13–15)12 (10–13)<0.001
      Hematocrit [%]40 (37–44)40 (38–44)36 (32–40)<0.001
      Platelet count [thousand/µL]209 (163–265)210 (165–265)188 (128–252)0.001
      Neutrophil count [thousand/µL]4 (3–7)4 (3–6)8 (5–14)<0.001
      Lymphocyte count [thousand/µL]1.3 (0.9–1.8)1.3 (0.9–1.8)0.8 (0.5–1.3)<0.001
Scores on admission—Me (IQR)
      MEWS1 (0–3)1 (0–2)3 (1–5)<0.001
      SEWS1 (0–2)1 (0–2)3 (1–5)<0.001
      NEWS2 (0–4)1 (0–3)5 (3–7)<0.001
      NEWS22 (0–4)2 (0–3)5 (2–7)<0.001
      REMS5 (2–7)4 (2–6)8 (6–10)<0.001
      RAPS0 (0–2)0 (0–2)1 (0–3)<0.001
Me—median; IQR—interquartile range; COPD—chronic obstructive pulmonary disease; ICU—intensive care unit; MAP—mean arterial pressure; WBC—white blood cells; RBC—red blood cells; MEWS—Modified Early Warning Score; NEWS—National Early Warning Score; NEWS2—National Early Warning Score 2; SEWS—Standardised Early Warning Score; REMS—Rapid Emergency Medicine Score; RAPS—Rapid Acute Physiology Score.
Table 2. Performance of MEWS score, NEWS2 scores, NEWS score, SEWS score, REMS score, RAPS score in predicting in-hospital mortality of COVID-19 patients.
Table 2. Performance of MEWS score, NEWS2 scores, NEWS score, SEWS score, REMS score, RAPS score in predicting in-hospital mortality of COVID-19 patients.
ScoreAUC
(95% CI)
p-ValueCut-OffSEN (%)SPE (%)PPVNPVLR+LR−
Overall
MEWS0.74 (0.73–0.75)<0.001371.566.323.594.42.120.43
NEWS20.74 (0.73–0.75)<0.001573.163.722.694.22.00.4
NEWS0.79 (0.77–0.80)<0.001580.465.425.295.82.30.3
SEWS0.77 (0.76–0.78)<0.001471.269.525.394.32.30.4
REMS0.84 (0.83–0.85)<0.001787.966.727.797.42.60.2
RAPS0.66 (0.64–0.67)<0.001270.857.219.393.11.70.5
<65 years
MEWS0.76 (0.74–0.77)<0.001460.983.110.098.63.60.5
NEWS20.77 (0.76–0.79)<0.001475.970.77.499.02.60.3
NEWS0.81 (0.80–0.82)<0.001481.673.68.799.23.10.3
SEWS0.79 (0.78–0.81)<0.001459.887.512.998.64.80.5
REMS0.81 (0.80–0.82)<0.001660.987.613.298.64.90.5
RAPS0.71 (0.69–0.72)<0.001273.662.25.798.72.00.4
≥65 years
MEWS0.69 (0.67–0.71)<0.001371.857.136.985.31.70.5
NEWS20.68 (0.66–0.70)<0.001652.674.441.881.82.10.6
NEWS0.72 (0.70–0.74)<0.001565.066.840.684.52.00.5
SEWS0.72 (0.70–0.74)<0.001371.460.338.585.81.80.5
REMS0.69 (0.67–0.71)<0.001757.969.039.582.41.90.6
RAPS0.62 (0.60–0.64)<0.001270.348.332.282.31.40.6
AUC—area under the curve of the receiver operating characteristic; 95% CI—95% confidence interval; SEN—sensitivity; SPE—specificity; PPV—positive predictive value; NPV—negative predictive value; LR+—likelihood ratio positive; LR−—likelihood ratio negative; MEWS—Modified Early Warning Score; NEWS—National Early Warning Score; NEWS2—National Early Warning Score 2; SEWS—Standardised Early Warning Score; REMS—Rapid Emergency Medicine Score; RAPS—Rapid Acute Physiology Score.
Table 3. The comparisons between AUROCs of EWS for predicting mortality.
Table 3. The comparisons between AUROCs of EWS for predicting mortality.
AUROC
Overall
RAPS
(0.66)
REMS
(0.84)
SEWS
(0.77)
NEWS
(0.79)
NEWS2
(0.74)
MEWS (0.74)0.085 ***0.103 ***0.031 ***0.046 ***0.001 *
NEWS2 (0.74) 0.086 ***0.102 ***0.030 ***0.045 ***
NEWS (0.79)0.131 ***0.057 ***0.014 **
SEWS (0.77)0.117 ***0.072 ***
REMS (0.84)0.188 ***
AUROC
<65 years
RAPS
(0.71)
REMS
(0.81)
SEWS
(0.79)
NEWS
(0.81)
NEWS2
(0.77)
MEWS (0.76)0.051 *0.054 **0.034 **0.054 **0.015 *
NEWS2 (0.77) 0.066 **0.039 *0.020 *0.039 **
NEWS (0.81)0.085 **0.000 *0.105 ***
SEWS (0.79)0.020 *0.085 **
REMS (0.81)0.105 ***
AUROC
≥65 years
RAPS
(0.62)
REMS
(0.69)
SEWS
(0.72)
NEWS
(0.72)
NEWS2
(0.68)
MEWS (0.69)0.075 ***0.001 *0.032 ***0.029 ***0.009 *
NEWS2 (0.68) 0.066 ***0.010 *0.041 ***0.038 ***
NEWS (0.72)0.103 ***0.028 **0.003 *
SEWS (0.72)0.106 ***0.031 **
REMS (0.69)0.075 ***
*—p < 0.05; **—p < 0.01; ***—p < 0.001. MEWS—Modified Early Warning Score; NEWS—National Early Warning Score; NEWS2—National Early Warning Score 2; SEWS—Standardised Early Warning Score; REMS—Rapid Emergency Medicine Score; RAPS—Rapid Acute Physiology Score.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Rzońca, P.; Butkiewicz, S.; Dobosz, P.; Zaczyński, A.; Podgórski, M.; Gałązkowski, R.; Wierzba, W.; Życińska, K. Predicting Mortality for COVID-19 Patients Admitted to an Emergency Department Using Early Warning Scores in Poland. Healthcare 2024, 12, 687. https://0-doi-org.brum.beds.ac.uk/10.3390/healthcare12060687

AMA Style

Rzońca P, Butkiewicz S, Dobosz P, Zaczyński A, Podgórski M, Gałązkowski R, Wierzba W, Życińska K. Predicting Mortality for COVID-19 Patients Admitted to an Emergency Department Using Early Warning Scores in Poland. Healthcare. 2024; 12(6):687. https://0-doi-org.brum.beds.ac.uk/10.3390/healthcare12060687

Chicago/Turabian Style

Rzońca, Patryk, Sławomir Butkiewicz, Paula Dobosz, Artur Zaczyński, Marcin Podgórski, Robert Gałązkowski, Waldemar Wierzba, and Katarzyna Życińska. 2024. "Predicting Mortality for COVID-19 Patients Admitted to an Emergency Department Using Early Warning Scores in Poland" Healthcare 12, no. 6: 687. https://0-doi-org.brum.beds.ac.uk/10.3390/healthcare12060687

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop