A novel scoring system for early assessment of the risk of the COVID-19-associated mortality in hospitalized patients: COVID-19 BURDEN
European Journal of Medical Research volume 28, Article number: 4 (2023)
Corona Virus Disease 2019 (COVID-19) presentations range from those similar to the common flu to severe pneumonia resulting in hospitalization with significant morbidity and/or mortality. In this study, we made an attempt to develop a predictive scoring model to improve the early detection of high risk COVID-19 patients by analyzing the clinical features and laboratory data available on admission.
We retrospectively included 480 consecutive adult patients, aged 21–95, who were admitted to Faghihi Teaching Hospital. Clinical and laboratory features were collected from the medical records and analyzed using multiple logistic regression analysis. The final data analysis was utilized to develop a simple scoring model for the early prediction of mortality in COVID-19 patients. The score given to each associated factor was based on the coefficients of the regression analyses.
A novel mortality risk score (COVID-19 BURDEN) was derived, incorporating risk factors identified in this cohort. CRP (> 73.1 mg/L), O2 saturation variation (greater than 90%, 84–90%, and less than 84%), increased PT (> 16.2 s), diastolic blood pressure (≤ 75 mmHg), BUN (> 23 mg/dL), and raised LDH (> 731 U/L) were the features constituting the scoring system. The patients are triaged to the groups of low- (score < 4) and high-risk (score ≥ 4) groups. The area under the curve, sensitivity, and specificity for predicting mortality in patients with a score of ≥ 4 were 0.831, 78.12%, and 70.95%, respectively.
Using this scoring system in COVID-19 patients, the patients with a higher risk of mortality can be identified which will help to reduce hospital care costs and improve its quality and outcome.
Corona Virus Disease 2019 (COVID-19) caused by the Severe Acute Respiratory Syndrome Coronavirus-2 (SARS-CoV-2) is highly a contagious disease, with symptoms ranging from those of common flu including fever, cough, and congestion of the nasal cavity to very severe respiratory symptoms . As the pandemic spread, other symptoms such as loss of taste and smell (anosmia) have also emerged [2, 3]. Patients with the severe form of the disease can experience a large range of symptoms arising from the host immune response against the infection including serious respiratory disease and pneumonia, vascular and hemodynamic disorders, and metabolic dysfunction [4,5,6,7]. Patients can also present normal or abnormal leukocyte counts, lymphopenia, or thrombocytopenia, with extended activated thromboplastin time, and elevated C-reactive protein (CRP) [5, 8, 9]. Those most at risk are the elderly and people with preexisting medical conditions, such as cardiovascular disorders and diabetes mellitus [10,11,12]. The exact mechanisms behind the disease and why some remain asymptomatic carriers, while other patients develop severe diseases with unfavorable outcomes are still poorly understood .
Here, we present details of the patients with laboratory-confirmed COVID-19 pneumonia to shed light on the specifications of patients who experienced in-hospital mortality and explore the risk factors that might facilitate early screening. Finally, we develop a predictive model for early detection of COVID-19 patients with a high risk of mortality using analysis of clinical features and laboratory data on admission, allowing timely identification and intervention.
Materials and methods
We retrospectively investigated 480 adult patients, aged 21–95, who were admitted to Faghihi Teaching Hospital from September 23, 2020, to November 21, 2020, with a positive RT-PCR COVID-19 test. The patients who did not complete their course of hospitalization and were released with their own consent were excluded. The study protocol was approved by the Ethics Committee of Shiraz University of Medical Sciences (IR.SUMS.MED.REC.1400.382). Written informed consent was obtained from all participants on admission.
Corresponding medical records were thoroughly examined. Variables investigated in this study for correlation with the outcome of hospitalization (discharge or death) included demographics (gender and age), previous medical conditions (smoking/opium abuse, hypertension, HTN, and diabetes mellitus, DM, ischemic heart disease, IHD, and hyperlipidemia, and HLP), previous drug history (angiotensin-converting-enzyme inhibitors/angiotensin II receptor blockers; ACEIs/ARBs, calcium channel blocker; CCB, beta blockers; BB, acetylsalicylic acid; ASA, and Statins) the patients’ condition on admission (systolic blood pressure; SBP, diastolic blood pressure; DBP, pulse rate; PR, respiratory rate; RR, temperature; T, O2 saturation; O2 Sat, presence of dyspnea, cough, chest pain, fever, malaise, anorexia, nausea and/or vomiting; N/V, other gastrointestinal symptoms, and the interval between disease onset and hospital admission), the laboratory findings of the sample obtained on admission (white blood cell count; WBC, absolute neutrophil count; ANC, absolute lymphocyte count; ALC, hemoglobin; Hb, prothrombin time; PT, partial thromboplastin time; PTT, blood urea nitrogen; BUN, creatinine; Cr, sodium; Na, potassium; K, aspartate transaminase; AST, alanine transaminase; ALT, alkaline phosphatase; ALP, albumin; Alb, total bilirubin; TB, direct bilirubin; DB, creatinine phosphokinase; CPK, lactate dehydrogenase; LDH, erythrocyte sedimentation rate; ESR, C-reactive protein; CRP), and total length of stay in the hospital.
Quantitative variables are presented as mean ± SD and qualitative variables as frequency (percentage) for all independent variables. Univariate analysis was applied to identify the potential risk factors of mortality using independent t‐test and chi-square test as appropriate. Statistically significant variables (significance level set at 0.05) that were of concern from a clinical perspective were subsequently employed in multiple logistic regression analysis with backward elimination method to identify the predictive factors. To formulate and obtain a clinical predictive risk score, we followed a similar strategy used by Ho et al. . Accordingly, the continuous prognostic variables that were significant in the univariate analysis were categorized using the receiver operating characteristic (ROC) curve. Then, all significant categorical variables in the univariate analysis were re‐entered into a logistic regression model. According to the relative contribution of each variable in the logistic regression model, which was determined by the regression coefficient, an integer score was assigned to each categorical variable. Finally, the scores were organized to obtain a practical triage of the patients into low‐ and high‐risk cases. SPSS version 23 (SPSS Inc, IBM, New York, NY) and MedCalc statistical program, version 19.5 (MedCalc Software, Mariakerke, Belgium) were used to analyze the data. This study was conducted and written in accordance with the TRIPOD Statement.
Patient details and hospitalization
A total of 1511 patients were visited at the triage of Faghihi hospital with the impressions related to COVID-19, of whom 480 patients (212 females and 268 males) fulfilled the criteria set by this study. The median age of the patients included was 61 years old (IQR: 49–72). The median days from the onset of symptoms to admission was 8 ± 6 days, and the total length of stay in the hospital was 5 days (IQR: 3–9). Intensive care unit (ICU) admission of COVID-19 patients is significantly associated with the worse outcome of hospitalization (P value < 0.0001).
Comparison of the associated factors
The patients were assigned into two groups (discharged = 312 and expired = 168). In total, 48 demographic, clinical, and laboratory variables were compared in both groups according to the outcome of hospitalization to determine meaningful ones (Additional file 1: Table S1). Multiple logistic regression analysis was carried out separately to assess the effect of 19 variables identified as significant independent predictors of outcome in our cohort (Table 1).
To generate a scoring system, O2 Sat, DBP, PT, BUN, LDH, and CRP values, among other continuous variables, were categorized using integer cut-points guided by the receiver–operator characteristic (ROC) curve.
Final model and COVID-19 BURDEN risk score
To formulate a numerical scoring model, we used the coefficients generated by the logistic regression equation, to create an integer number, approximating the values of the coefficients for each of the categories in Table 2.
Using the coefficients of the regression analyses, the O2 Sat greater than 90%, 84–90%, and less than 84% were given scores of 0, 1, and 2, respectively. Scores of either 0 or 1 were given to other variables including CRP, PT, DBP, BUN, and LDH levels (Table 3).
A novel mortality risk score (termed COVID-19 BURDEN) was derived, incorporating risk factors identified in this cohort. COVID-19 BURDEN is an acronym for CRP (> 73.1 mg/L), O2 saturation Variation (greater than 90%, 84–90%, and less than 84%), Increased PT (> 16.2 s), Diastolic blood pressure (≤ 75 mmHg), BUN (> 23 mg/dL), and Raised LDH (> 731 U/L), as shown in Table 3.
Using the new scoring system, we scored each patient and compared him/her with his/her eventual outcomes. For an individual patient, the total score was derived from the sum of the score attributed to the variables mentioned above. The minimum and maximum possible scores are 0 and 7, respectively.
It was possible to triage the patients to the groups of low- (score < 4) and high-risk (score ≥ 4) groups. ROC analysis for this risk score yielded an area under the curve (AUC) of 0.831 (AUC of 1.0 indicating a perfect test) (Fig. 1). The sensitivity and specificity of the model for predicting mortality in patients with scores of ≥ 4 were 78.12% and 70.95%, respectively.
The COVID-19 pandemic is a public health concern with dire health, environmental, and economic consequences . Currently, the facilities required for the hospitalization of patients with COVID-19 are limited. This limitation is especially pronounced in ICUs for patients requiring mechanical ventilation . It is necessary to develop prediction models that can be used by clinicians, to estimate the severity of the disease and prognosis of each patient at an early stage of the disease, which will grant a better allocation of resources and a wider window for interventions. This tool also potentially helps to reduce hospital care costs and improves its quality in the health care units [17,18,19]. Applying such prediction models is a useful strategy for the early screening of high-risk patients in crowded care centers during the COVID-19 outbreak. Risk prediction models are increasingly utilized in medical practice to help practitioners promote healthcare quality. Following extensive validations in independent samples, a predictive score can be used routinely.
Thus far, several prognostic models with varying clinical applicability and performance have been developed for COVID-19. Among them, a few have a low risk of bias and low concern for applicability. The most well-validated models are developed by Clift et al. and Knight et al. with the potential of being applied by clinicians in public health and clinical settings [30, 31]. Age, sex, RR, O2 sat, level of consciousness, BUN, BMI, and comorbidities are among the variables incorporated into the aforementioned models. On top of that, a few models developed before the pandemic were applied to COVID-19 prognostication. Most notably APACHE II had very promising results (area under the curve, 0.966) in predicting in-hospital mortality .
In this survey, we designed a simply calculated clinical risk score, using the patient's clinical characteristics and laboratory data, which can be used as a predictor to predict mortality, the most important outcome in the course of hospitalization and implicitly related to the severity of the disease, the need for hospitalization, and the possibility of ICU admission requirement during the hospitalization. Low DBP (≤ 75 mmHg), prolonged PT (> 16.2 s), increase in the level of LDH (> 731 U/L), BUN > 23 mg/dl, elevated CRP (> 73.1 mg/L), and decrease in oxygen saturation (< 84%) were identified as risk factors for disease severity among 480 adult patients.
Severe hypoxemia (O2 sat < 84%) had the highest odds ratio (OR = 9.19) among the 6 risk factors determining the mortality in our survey. This finding was consistent with a cohort study by Bahl et al. among 1461 patients in which O2 sat of ≤ 88% was associated with a higher mortality rate . In the review conducted by Petrilli et al. among 4103 patients, oxygen saturation of < 88% (OR = 6.99) was also introduced as the most critical factor predicting the outcome of hospitalization on admission .
Recently, several studies have been conducted in different parts of the world to develop a simple scoring system to predict the prognosis and outcome of COVID-19 [19, 22,23,24,25]. The first scoring system to predict the severity of COVID-19, incorporating age, glomerular filtration rate (GFR), WBC, neutrophil count, and myoglobin, was developed by Zhang et al. in 2020 among 80 patients . The low sample size was one of the limitations of their study. Moreover, the aforementioned model did not include any of the vital signs, which were shown to be quite important in determining the clinical course of COVID-19 patients. The findings of the study conducted by Altschul et al. are also in agreement with the present study. Old age (especially ≥ 80 years) mean arterial blood pressure ≤ 60 mmHg, O2 sat < 94%, BUN > 30 mg/dl, CRP > 10 mg/dl, and INR > 1.2 were identified as six risk factors that affect the mortality rate of COVID-19 patients. Their study was conducted in three major referral hospitals in New York City. However, the study data is limited to their urban population and may not be fully generalizable to other settings with different backgrounds . In another study which was published in July 2020, old age, the presence of coronary heart disease, high procalcitonin, lymphopenia, and high d-Dimer level were associated with a high mortality rate in the affected population .
Having a precise, inexpensive, accessible, and straightforward prediction model will improve the patients' triage, and help to identify high-risk individuals, initiate timely interventions, and allocate resources efficiently [22, 26]. One of the advantages of our model is that it does not include lung high-resolution computed tomography (HRCT) scans, which contributes greatly to the health financial system during this pandemic. Rather, we used more accessible clinical and laboratory metrics to predict disease severity, which will reduce the costs, improve the timing of the decision-making in the initial screening, and lift the burden from the already exhausted imaging facilities. HRCT can be conducted later during the hospitalization of the patients rather than on admission in the high risk patients; however, the present study is not concerned with this issue and this hypothesis requires further investigation on the effect of applying prediction models on the burden imposed on various units in hospitals.
CRP, Oxygen saturation variation, increased PT, DBP, and BUN, and raised LDH (COVID-19 BURDEN) were detected as six factors for COVID-19 infection severity. Using this prediction model, the severity of the disease in the early stages of the disease can be estimated and helps to reduce health costs and improve the quality of patient care in the health care units. The great utility of clinical prediction models have been demonstrated previously in several instances (e.g., CURB65, MELD, etc.) [27, 28].
The present survey was mainly limited by studying COVID-19 patients in a single center retrospectively. The management of the patients included in the present study was based on the most recent version of the WHO guideline for COVID-19 management at the time (https://www.who.int/publications/i/item/WHO-2019-nCoV-Clinical-2022.2) . Furthermore, our model did not make use of viral load in predicting the mortality in COVID-19 patients. Viral load is among the most important parameters in the setting of COVID-19 infection; however, it is mostly limited to experimental settings and not implemented in the real-world clinical setting. Moreover, it is not easy-to-obtain and not available early in the admission of the patients, if at all. As a result, incorporating it into a screening model will defeat its purpose and make triage based on the model impossible. It is quite common for patients to receive non-invasive ventilation or high-flow nasal cannula before their screen either in the emergency department or during transportation with emergency medical service. In our study, although the clinicians conducting the primary screening abided by the recommendations for cessation of therapy before recording O2 saturation, it is plausible to assume that the O2 saturation was falsely recorded in a set of patients, inclining toward a higher O2 saturation. Undoubtedly, further studies with larger sample sizes are needed in settings with diverse backgrounds to validate the COVID-19 BURDEN model. Moreover, many more studies are still required to better understand the disease itself. Finally, simple models similar to that outlined in the present paper can be beneficial in other aspects of the care for COVID-19 patients and their needs including ICU admission requirements, unplanned readmission, its long-lasting health effects, etc.
Availability of data and materials
All data generated or analyzed during this study are included in the final published article.
Zu ZY, Jiang MD, Xu PP, Chen W, Ni QQ, Lu GM, et al. Coronavirus disease 2019 (COVID-19): a perspective from China. Radiology. 2020;296(2):E15-e25.
Menni C, Valdes AM, Freidin MB, Sudre CH, Nguyen LH, Drew DA, et al. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020;26(7):1037–40.
Callejon-Leblic MA, Moreno-Luna R, Del Cuvillo A, Reyes-Tejero IM, Garcia-Villaran MA, Santos-Peña M, et al. Loss of smell and taste can accurately predict COVID-19 infection: a machine-learning approach. J Clin Med. 2021. https://doi.org/10.3390/jcm10040570.
Gupta A, Madhavan MV, Sehgal K, Nair N, Mahajan S, Sehrawat TS, et al. Extrapulmonary manifestations of COVID-19. Nat Med. 2020;26(7):1017–32.
Mathew D, Giles JR, Baxter AE, Oldridge DA, Greenplate AR, Wu JE, et al. Deep immune profiling of COVID-19 patients reveals distinct immunotypes with therapeutic implications. Science. 2020. https://doi.org/10.1126/science.abc8511.
Lucas C, Wong P, Klein J, Castro TBR, Silva J, Sundaram M, et al. Longitudinal analyses reveal immunological misfiring in severe COVID-19. Nature. 2020;584(7821):463–9.
Del Valle DM, Kim-Schulze S, Huang HH, Beckmann ND, Nirenberg S, Wang B, et al. An inflammatory cytokine signature predicts COVID-19 severity and survival. Nat Med. 2020;26(10):1636–43.
Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020;382(8):727–33.
Chan JF, Yuan S, Kok KH, To KK, Chu H, Yang J, et al. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster. Lancet. 2020;395(10223):514–23.
Bajgain KT, Badal S, Bajgain BB, Santana MJ. Prevalence of comorbidities among individuals with COVID-19: a rapid review of current literature. Am J Infect Control. 2021;49(2):238–46.
Liu Y, Mao B, Liang S, Yang JW, Lu HW, Chai YH, et al. Association between age and clinical characteristics and outcomes of COVID-19. Eur Respir J. 2020. https://doi.org/10.1183/13993003.01112-2020.
Pan A, Liu L, Wang C, Guo H, Hao X, Wang Q, et al. Association of public health interventions with the epidemiology of the COVID-19 outbreak in Wuhan. China Jama. 2020;323(19):1915–23.
Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, et al. Factors associated with COVID-19-related death using Opensafely. Nature. 2020;584(7821):430–6.
Ho GT, Mowat C, Goddard CJ, Fennell JM, Shah NB, Prescott RJ, et al. Predicting the outcome of severe ulcerative colitis: development of a novel risk score to aid early selection of patients for second-line medical therapy or surgery. Aliment Pharmacol Ther. 2004;19(10):1079–87.
Sarkodie SA, Owusu PA. Global assessment of environment, health and economic impact of the novel coronavirus (COVID-19). Environ Develop Sustain. 2021;23:5005–15.
Butler CR, Wong SP, Wightman AG, O’Hare AM. US clinicians’ experiences and perspectives on resource limitation and patient care during the COVID-19 pandemic. JAMA Netw Open. 2020;3(11):e2027315-e.
Dong Y, Zhou H, Li M, Zhang Z, Guo W, Yu T, et al. A novel simple scoring model for predicting severity of patients with SARS-CoV-2 infection. Transbound Emerg Dis. 2020;67(6):2823–9.
Bae S, Kim Y, Hwang S, Kwon KT, Chang H-H, Kim S-W. New scoring system for predicting mortality in patients with COVID-19. Yonsei Med J. 2021;62(9):806.
Chua F, Vancheeswaran R, Draper A, Vaghela T, Knight M, Mogal R, et al. Early prognostication of COVID-19 to guide hospitalisation versus outpatient monitoring using a point-of-test risk prediction score. Thorax. 2021;76(7):696–703.
Bahl A, Van Baalen MN, Ortiz L, Chen N-W, Todd C, Milad M, et al. Early predictors of in-hospital mortality in patients with COVID-19 in a large American cohort. Internal Emerg Med. 2020;15(8):1485–99.
Petrilli CM, Jones SA, Yang J, Rajagopalan H, O’Donnell LF, Chernyak Y, et al. Factors associated with hospitalization and critical illness among 4,103 patients with COVID-19 disease in New York City. MedRxiv. 2020. https://doi.org/10.1136/bmj.m3731.
Zhang C, Qin L, Li K, Wang Q, Zhao Y, Xu B, et al. A novel scoring system for prediction of disease severity in COVID-19. Frontiers cell Infection Microbiol. 2020;10:318.
Qin L, Yang Y, Cao Q, Cheng Z, Wang X, Sun Q, et al. A predictive model and scoring system combining clinical and CT characteristics for the diagnosis of COVID-19. Eur Radiol. 2020;30(12):6797–807.
Altschul DJ, Unda SR, Benton J, de la Garza RR, Cezayirli P, Mehler M, et al. A novel severity score to predict inpatient mortality in COVID-19 patients. Sci Rep. 2020;10(1):1–8.
Shang Y, Liu T, Wei Y, Li J, Shao L, Liu M, et al. Scoring systems for predicting mortality for severe patients with COVID-19. EClinicalMedicine. 2020;24: 100426.
Belkacem AN, Ouhbi S, Lakas A, Benkhelifa E, Chen C. End-to-end AI-based point-of-care diagnosis system for classifying respiratory illnesses and early detection of COVID-19: a theoretical framework. Frontiers Med. 2021;8:372.
Lim WS, van der Eerden MM, Laing R, Boersma WG, Karalus N, Town GI, Lewis SA, Macfarlane JT. Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study. Thorax. 2003;58:377–82.
Kamath PS, Kim WR. The model for end-stage liver disease (MELD). Hepatology. 2007;45:797–805.
Organization WH. Clinical management of COVID-19: interim guidance, 27 May 2020. World Health Organization. 2020.
Clift AK, Coupland CAC, Keogh RH, Diaz-Ordaz K, Williamson E, Harrison EM, et al. Living risk prediction algorithm (QCOVID) for risk of hospital admission and mortality from coronavirus 19 in adults: national derivation and validation cohort study. BMJ. 2020. https://doi.org/10.1136/bmj.m3731.
Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO clinical characterisation protocol development and validation of the 4C mortality score. BMJ. 2020. https://doi.org/10.1136/bmj.m3339.
Zou X, Li S, Fang M, Hu M, Bian Y, Ling J, et al. Acute physiology and chronic health evaluation II score as a predictor of hospital mortality in patients of coronavirus disease 2019. Critical Care Med. 2020;48: e657.
The authors would like to thank Shiraz University of Medical Sciences, Shiraz, Iran and also Center for Development of Clinical Research of Nemazee Hospital and Dr. Nasrin Shokrpour for editorial assistance.
The authors received no financial support for the research, authorship, or publication of this article.
Ethics approval and consent to participate
The study protocol was approved by the local ethics committee of Shiraz University of Medical Sciences (IR.SUMS.MED.REC.1400.382). Written informed consents were obtained from all participants on admission.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Imanieh, M.H., Amirzadehfard, F., Zoghi, S. et al. A novel scoring system for early assessment of the risk of the COVID-19-associated mortality in hospitalized patients: COVID-19 BURDEN. Eur J Med Res 28, 4 (2023). https://doi.org/10.1186/s40001-022-00908-4
- Risk assessment