key: cord-0017652-gvfrooqs
authors: Marois, Ingrid; Forfait, Carole; Inizan, Catherine; Klement-Frutos, Elise; Valiame, Anabelle; Aubert, Daina; Gourinat, Ann-Claire; Laumond, Sylvie; Barsac, Emilie; Grangeon, Jean-Paul; Cazorla, Cécile; Merlet, Audrey; Tarantola, Arnaud; Dupont-Rouzeyrol, Myrielle; Descloux, Elodie
title: Development of a bedside score to predict dengue severity
date: 2021-05-24
journal: BMC Infect Dis
DOI: 10.1186/s12879-021-06146-z
sha: c1aba11ab134628bcd3acfdbcec4880429ac5b2f
doc_id: 17652
cord_uid: gvfrooqs

BACKGROUND: In 2017, New Caledonia experienced an outbreak of severe dengue causing high hospital burden (4379 cases, 416 hospital admissions, 15 deaths). We decided to build a local operational model predictive of dengue severity, which was needed to ease the healthcare circuit. METHODS: We retrospectively analyzed clinical and biological parameters associated with severe dengue in the cohort of patients hospitalized at the Territorial Hospital between January and July 2017 with confirmed dengue, in order to elaborate a comprehensive patient’s score. Patients were compared in univariate and multivariate analyses. Predictive models for severity were built using a descending step-wise method. RESULTS: Out of 383 included patients, 130 (34%) developed severe dengue and 13 (3.4%) died. Major risk factors identified in univariate analysis were: age, comorbidities, presence of at least one alert sign, platelets count < 30 × 10(9)/L, prothrombin time < 60%, AST and/or ALT > 10 N, and previous dengue infection. Severity was not influenced by the infecting dengue serotype nor by previous Zika infection. Two models to predict dengue severity were built according to sex. Best models for females and males had respectively a median Area Under the Curve = 0.80 and 0.88, a sensitivity = 84.5 and 84.5%, a specificity = 78.6 and 95.5%, a positive predictive value = 63.3 and 92.9%, a negative predictive value = 92.8 and 91.3%. Models were secondarily validated on 130 patients hospitalized for dengue in 2018. CONCLUSION: We built robust and efficient models to calculate a bedside score able to predict dengue severity in our setting. We propose the spreadsheet for dengue severity score calculations to health practitioners facing dengue outbreaks of enhanced severity in order to improve patients’ medical management and hospitalization flow. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12879-021-06146-z.

Dengue fever is the most prevalent human arbovirosis and a major public health issue in tropical and subtropical countries with epidemic outbreaks [1, 2] . Dengue viruses are subdivided in 4 serotypes (DENV-1 to − 4). There is a lack of specific treatments, vector control measures regularly fail to prevent epidemics and safe preventive dengue vaccines are not widely available [3] [4] [5] . While new prevention methods are being developed, clinical management strategies are of prime importance.

Dengue has a wide spectrum of clinical presentations usually starting by an abrupt onset of fever, malaise, skin rash, headache, anorexia/vomiting, diarrhea, and abdominal pain, often with unpredictable clinical evolution. Clinical outcome can vary from a self-limiting non-severe condition to a potentially lethal disease subsequent to a vascular permeability resulting in leakage of fluids into serosal cavities and shock, hemorrhages, and/or organ failures [4] . Warning signs of severe dengue include persisting vomiting, abdominal pain, lethargy/anxiety, mucosal bleeding, liquid accumulation, hepatomegaly, and rapid hematocrit increase concurrent with a platelet count drop [4] .

In New Caledonia (NC), a French South Pacific Island Territory of 270,000 inhabitants, dengue is a closely monitored notifiable disease, enabling the collection of reliable documentation of dengue cases. Dengue fever outbreaks frequency is increasing in NC, and is associated to the emergent co-circulation of several DENV serotypes and other arboviruses, i.e. chikungunya and Zika viruses [6] [7] [8] . An uninterrupted circulation of DENV-1 has been documented in NC between 2007 and 2018.

During the 2017 dengue outbreak, three serotypes have co-circulated (DENV-1, DENV-2, DENV-3) for the first time. Four thousand three hundred seventy-nine dengue cases were declared among which 2372 (54%) were biologically confirmed by RT-qPCR [6] . Fifteen patients died (lethality rate = 0.3%). The hospitalization rate was exceptionally high (11.5% versus 3.5% during the 2012-2013 outbreak, 2.1% during the 2008-2009 outbreak, and 4.5% during the 2003 outbreak).

Identifying risk factors for severe dengue is of prime importance to improve patients' medical care and better manage in-hospital patient flow. Such risk factors may differ depending on the region of the world considered, in link with populations' genetics and way of living. To our knowledge, risk factors for severe dengue have been mostly explored in countries where dengue is endemic and have never been explored in the Pacific region, where dengue has an epidemic mode of circulation. Assessing the reliability of identified risk factor for severe dengue in epidemiological contexts where dengue has an epidemic mode of circulation is important to relieve the health care system upon outbreaks. Furthermore, the expansion of dengue in more temperate countries will certainly lead the hospitals to be overwhelmed, and operational tools developed in epidemic countries would help better manage in-hospital patient flow.

In 2014-2015, the Pacific region and South America experienced a Zika pandemic. This pandemic occurred in countries where dengue circulates actively, it is therefore crucial to determine whether a previous Zika infection represents a risk factor for severe dengue.

The purposes of this study were to investigate clinical and biological parameters associated with severe dengue and elaborate an operational model to score patients' risk to develop severe dengue in the NC medical facilities setting.

A total of 416 patients were admitted to the Territorial Hospital of New Caledonia between January 1st 2017 and July 31st 2017 with a diagnosis of dengue fever. Among them, 385 were biologically confirmed using RT-qPCR [9] , of which 383 were enrolled in this study (Fig. 1) .

Patients' clinical and biological characteristics were retrieved from hospital medical records (DxCare-Medasys), dengue notification sheets and completed by a telephone interview using a standardized questionnaire. Although sometimes contested in the litterature, we opted for a binary gender classification. No patient enrolled expressed difficulty with this classification. Collected data included patients' gender, age, ethnicity, medical history, treatments, substance abuse (tobacco, alcohol > 3 units/day, cannabis, kava), clinical and biological parameters, presence of warning and severe signs, infecting dengue serotype and previous dengue and Zika infection. Dengue serotyping by RT-qPCR and IgG serology for dengue (PanBio®) and Zika (Euroimmun®) were performed.

Disease severity was assessed according to the WHO 2009 criteria [4] . Patients were classified as severe when they displayed at least one of the following criteria: severe plasma leakage (shock, liquid accumulation visualized by sonogram or x-ray) with respiratory distress; severe hemorrhage; and/or severe organ failure (kidney, central nervous system, liver, heart). Thrombocytopenia with platelet count under 10 × 10 9 /L (reference range 150-400 × 10 9 /L) associated to minor bleeding was used as an additional severity criterion. Acute renal failure was defined as a Glomerular Filtration Rate by the MDRD Equation < 60 mL/min/1.73m 2 or, for patients with previous chronic renal failure, a 2-fold increase from their baseline creatinine level. Severe hepatitis was defined by a transaminase (AST or ALT) level above 1000 IU/L.

For each quantitative variable, minimum, maximum, mean and median were calculated. In order to allow the implementation of univariate analyses, quantitative variables age and biological parameters were categorized into qualitative variables. Non-severe patients were compared to severe patients. In the univariate analysis, Odds Ratio (OR) and 95% confidence interval were calculated. Test of independence p-values were estimated using Fisher's exact test. Differences were considered significant if p < 0.05. Parameters for which Fisher test p ≤ 0.2 were used to perform the multivariate analysis. Longtime conventional cutoff point in bivariate analysis to select variables to be included in a multiple regression model [10] , the p ≤ 0.2 has been further justified and strengthened recently [11] . Odds ratio were adjusted for each variable category with the value of the other variables being fixed .A predictive model for severe dengue was built using multiple logistic regression and a descending stepwise analysis. Statistics were performed using R software (version 3.5.1 (2018-07-02)).

A k-fold cross-validation procedure (k = 10) was used. The subsample k was retained as validation data and the remaining k-1 subsamples were used as training data. The cross-validation process was repeated k times, each of the k subsamples used exactly once as the validation data. Model performance was measured using the following indicators: sensitivity, specificity, positive predictive value, negative predictive value, Yule index [12] , Youden index (sensitivity + specificity -1) [13] and the Area Under Curve (AUC) of the Receiving Operating Characteristic (ROC) curve. The R code used to perform the k-fold cross-validation procedure is provided as supplementary material ( Supplementary Fig. 1 ). Using the variable coefficients determined in the logistic regression, patients' score was expressed as p (probability of developing severe dengue). The decision-making threshold was defined using the ROC curve as the best combination of sensitivity and specificity.

Ethical approval was granted by the Consultative Ethics Committee of NC, and by the internal ethical review board of the Territorial Hospital. Dengue fever is a compulsory declarative disease in NC. Oral informed consent was obtained from all participating patients or their relatives retrospectively when consulted by telephone.

The characteristics of the 383 PCR-confirmed dengue patients included in this study are presented in Table 1 . Patients were hospitalized on average on the 5th day after symptom onset (median = 4, IQR = 3), for a median duration of 4 days (IQR = 3). They were 174 men and 209 women (Sex-ratio = 0.83) with an age ranging from birth to 96 years old (IQR = 34, median 32 years). Symptoms and biological parameters available at hospital admission are summarized in Table 2 . DENV-1 was the major serotype (80.6%), followed by DENV-2 (15.9%) and DENV-3 (3.6%). According to the WHO 2009 classification, 299/383 patients (78%) displayed at least one warning sign. Overall, 130 patients (34%) developed severe dengue.

While 121 patients (40%) with at least one warning sign developed severe dengue, only nine patients (10.7%) without warning signs did so (Fig. 2) . WHO classification thus yields a Positive Predictive Value of 93% and a Negative Predictive Value of 89.3% with our dataset. The Odds ratio (OR) for patients presenting at least one warning sign is 5.6 (Confidence Interval CI95% [2.17; 13.3]), with a corresponding Relative Risk of 3.8 [2.0; 7.1]. Hepatitis was the most frequent severity criterion accounting for 41.5% of severe cases. Twenty-two patients (5.7%) developed major hemorrhaging, 47 (12.3%) had deep thrombocytopenia < 10 × 10 9 /L with minor bleeding, 

Variables significantly associated with dengue severity in univariate analysis with p ≤ 0.2 and available at hospital admission were taken into account in the multivariate analysis. These variables were: age, comorbidities (hypertension, myocardiopathy, dyslipidemia, obesity), excessive tobacco and alcohol consumption, anticoagulant or use of platelet aggregation inhibitors, mucosal bleeding, hematuria and/or presence of blood in stools, skin rash, clinical liquid accumulation, abdominal pain, simultaneous hematocrit increase and platelet count drop, platelets < 30 × 10 9 /L, ALT and/or AST > 10 N. Raw analysis of the dataset showed that certain age groups in females were more at risk to develop severe dengue, while no difference was observed between age groups in men. This suggested the existence of an interaction between age and sex. This interaction was confirmed using a bivariate analysis taking age and sex as variables. Multivariate analysis further confirmed this interaction between age and sex: women between 20 and 30 years and men over 60 years were more at risk for severe dengue (OR 7. Descending stepwise analysis identified the best explanatory variables for progression towards severe dengue (Table 3 ). In the model for females, these variables were: age class, hypertension, skin rash, mucosal bleeding, platelets count < 30 × 10 9 /L and ALT > 10 N. In the model for males, these variables were: age class, excessive alcohol consumption, mucosal bleeding, platelets count < 30 × 10 9 /L and ALT > 10 N. The predictive models provide a score. Score threshold is derived from the ROC curve as the threshold optimal value for which sensitivity and specificity are the highest for the whole dataset. A score ≥ 0.36 for females and ≥ 0.34 for males indicates a high probability to develop severe dengue. The Excel spreadsheet enabling the calculation of this risk score is presented in Supplementary Fig. 2 . Examples of models' usage are presented in Supplementary  Fig. 3 .

A k-fold cross-validation procedure (k = 10) showed that both models for females and males were robust and efficient (Fig. 4) All parameters are risk factors for dengue severity albeit skin rash that appears as a protective factor to develop severe dengue in females 

The 2017 dengue outbreak in New Caledonia was characterized by a high hospitalization rate leading to an overwhelming of emergency rooms and hospitalization units. Clinicians and epidemiologists expressed the necessity to develop a comprehensive operational tool in order to improve medical care and in-patients flow in local hospitals. Based on a detailed analysis of 383 hospitalized patients, we identified important demographical, clinical and biological parameters associated with severe dengue. Parameters easily available in routine practice were used to score patients' risk of developing severe dengue. Importantly, we confirm that the WHO 2009 criteria to evaluate the severity of dengue infection are applicable in NC, with a Positive Predictive Value for the presence of at least one warning sign of 93% and a Negative Predictive Value (NPV) of 89.3% on our 2017 dataset. The NPV yielded by our models challenged for the management of the 2018 dengue outbreak in NC were similar, reaching 92 and 91% for females and males respectively, consolidating the reliability of our models. Most importantly, while WHO warning signs are serious symptoms resulting from an already advanced dengue infection and relying on clinicians' interpretation, the criteria used by our model are mostly objective and available early in the development of dengue. The criteria of our models indeed rely on demographic (age), behavioral (alcohol consumption) or biomedical (AST, platelet count) data or data linked to a preexisting medical condition (hypertension), which are available early in the development of dengue, as soon as hospital admission. These criteria therefore allow an earlier and reliable assessment of the risk of developing severe dengue.

Most of the risk factors we identified in univariate analysis have been described in other studies, i.e. age [14, 15] , comorbidities such as hypertension [16] or diabetes [14, 16, 17] , persistent vomiting [15, 18] , increase in hematocrit [14, 18] . A platelet count < 30 × 10 9 /L was also strongly associated with severe dengue in our study (OR 4.42) like in other studies [14, 18, 19] . However, no consensus on severe thrombocytopenia definition was obtained in a recent working group of dengue researchers and public health specialists to develop standardized endpoints, and they remained divided on whether a rapid decreasing trend or a specific platelet count should be case-defining [20] . Factors not associated with severity in NC are sex, ethnicity and substance abuse. In our study, the detected serotype responsible for the acute infection is not linked to the severity of the disease, unlike previous findings [21] .

Dengue disease can have a greater impact in case of comorbidity. Our multivariate analysis identifies hypertension as a risk factor for severe dengue among females. Others have identified chronic comorbidities such as asthma, obesity, diabetes, hypertension and heart diseases to yield ORs of severe dengue diseases of about 2 to 4 in infected patients [22] . However, the link between comorbidity and severe dengue may be due to confounding factors: Comorbidities are more frequent among more aged persons in the population. Further, as people age, their probability of having undergone several dengue infections with successive serotypes during their lifetime is higher, leading to a greater risk of secondary infection.

We report a 4.7 fold increased risk of severe dengue in patients who had a serologically documented history of previous dengue infection, in accordance with the Antibody-Dependent Enhancement (ADE) theory stating that secondary dengue infections are usually more severe [23] . However, as dengue serology is usually not available at hospital admission, the presence of dengue IgG antibodies was not included in our multivariate analysis. For the first time to our knowledge, we have investigated the influence of a previous Zika infection on dengue outcome, and we found no association with dengue severity. As DENV and ZIKV serological tests display partial cross-reactivity [24] , the impact of previous DENV and ZIKV infection on dengue severity should be confirmed by seroneutralization tests.

We were able to build two robust and efficient logistic regression models to evaluate patients' risk of developing severe dengue in men and women. These models enable the calculation of a risk score based on simple parameters and may represent easy-to-use operational tools to help clinicians in hospitalization decision and improve in-hospital patient flux ( Supplementary Figs. 2 & 3) . Different predictive models have been proposed in previous studies, based on multivariate logistic regression [25] [26] [27] or on classification and regression trees [28, 29] . Parameters used in these models were mainly age, leukocytosis and platelet count. Interestingly, Nguyen et al. developed a prognosis model taking into account vomiting, platelet count (< 10 × 10 9 /L), AST level (2-fold increase) and NS1 rapid test status [27] . The model they propose yielded a very good discriminative ability (AUC 0.95), which is close to the AUC of 0.80 and 0.88 yielded by our models for females and males, respectively. However, a major caveat to their study is the absence of model cross-validation.

The bedside scoring tool we propose is very simple and easy to use, results ranging from 0 (minimal risk of severe dengue) to 1 (maximal risk). When a patient refers to the hospital with probable or confirmed dengue fever, we calculate his severity score at first hospital referral, as soon as platelet count and ALT quantification are available. If it is ≤0.34 for a man and ≤ 0.36 for a woman, we recommend medical monitoring, preferentially in a medical unit whenever possible. If patients are discharged, we invite them to be reassessed by a physician at day 4-6 post-symptoms' onset. If the score is greater, we propose an admission for IV fluid treatment and bio-clinical monitoring. If the score is > 0.6 the patient should be closely monitored and if it is > 0.8 he might require intensive care. We also systematically recommend ICU admission when platelet count is < 10 × 10 9 /L or transaminases > 2000 IU/L.

Although based on a well-documented and validated database, biological data were heterogeneous as collected at different time points after symptoms' onset, but this limit is inherent to retrospective studies. As our studied population was composed of relatively old patients (which is a characteristic of dengue epidemiology in NC), hospitalized in a single hospital (albeit the largest in NC), our models may not be valid to predict patients' risk to develop severe dengue in other populations. However, our models were prospectively validated on 130 patients during 2018 DENV-2 outbreak in NC, yielding a high Negative Predictive Value of 92 and 91% for females and males respectively. Our models could thus be relevant for dengue severity prediction regardless of the serotype. 

Dengue infection

The global distribution and burden of dengue

Effect of dengue serostatus on dengue vaccine safety and efficacy

Dengue: guidelines for diagnosis, treatment, prevention and control: new edition

Dengue vaccine: WHO position paper -September 2018 -Note de synthèse de l'OMS sur le vaccin contre la dengue-septembre 2018

Documents, rapport, études -La situation sanitaire de la Nouvelle-Calédonie

Epidemiological and molecular features of dengue virus type-1 in

Dengue in New Caledonia: knowledge and gaps

Trioplex real-time RT-PCR assay instruction for use

Applied survival analysis: regression modeling of time to event data

Augmented backward elimination: a pragmatic and purposeful way to develop statistical models

On the association of attributes in statistics: with illustrations from the material of the childhood society

Index for rating diagnostic tests

Diabetes, cardiac disorders and asthma as risk factors for severe organ involvement among adult dengue patients: a matched case-control study

Clinical profiles and factors associated with death in adults with dengue admitted to intensive care units

Diabetes with hypertension as risk factors for adult dengue hemorrhagic fever in a predominantly dengue serotype 2 epidemic: a case control study

Allergies and diabetes as risk factors for dengue hemorrhagic fever: results of a case control study

Confirmed adult dengue deaths in Singapore: 5-year multi-center retrospective study

Factors of severity at admission during an epidemic of dengue 1 in New Caledonia (South Pacific) in 2003

Development of standard clinical endpoints for use in dengue interventional trials

Serotype influences on dengue severity: a cross-sectional study on 485 confirmed dengue cases in Vitória, Brazil

Prevalence of chronic comorbidities in dengue fever and West Nile virus: a systematic review and meta-analysis

Secondary infection as a risk factor for dengue hemorrhagic fever/dengue shock syndrome: an historical perspective and role of antibody-dependent enhancement of infection

Serological tests reveal significant cross-reactive human antibody responses to Zika and dengue viruses in the Mexican population

Predictive tools for severe dengue conforming to World Health Organization

Development of a simple clinical risk score for early prediction of severe dengue in adult patients

An evidence-based algorithm for early prognosis of severe dengue in the outpatient setting

Prediction of dengue disease severity among pediatric Thai patients using early clinical laboratory indicators

Predicting the severity of dengue fever in children on admission based on clinical features and laboratory indicators: application of classification tree analysis

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We thank Sébastien Mabon, Sophie Lafleur, Pascal André, and Mathieu Serié from CHT Noumea for their help during this study, Antoine Biron, Marie-Amélie Goujart, Nathalie Amedeo, Erwan Choblet, Gauthier Delvallez from CHT Laboratory. We thank Ludovic Floury, Viktoria Taofifenua, Anne Pfannstiel from DASS-NC, Morgan Mangeas and Magali Teurali (IRD) for their help in statistics. We dedicate this work to our dear colleague Dr Elodie Descloux who was deeply involved in arboviruses research in New Caledonia.

We developed a bedside score to predict dengue severity. We propose this bedside score to be deployed, tested and validated in other countries with similar dengue epidemiology, in order to optimize patients' triage, inhospital patients flux, and improve personalized medical care, thus benefiting both health practitioners and populations facing dengue outbreaks of enhanced severity. 

The online version contains supplementary material available at https://doi. org/10.1186/s12879-021-06146-z. 

This work was supported by the government of New Caledonia. The funder provided financial support to the study but did not participate in the design of the study, data collection, analysis, and interpretation or writing of the manuscript.

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate Ethical approval was granted by the Consultative Ethics Committee of NC, and by the internal ethical review board of the Territorial Hospital. Dengue fever is a compulsory declarative disease in NC. The current research involves the human person with minimal risks and constraints. In order to comply with the local regulation related to this kind of research and following approval by the Consultative Ethics Committee of NC, verbal consent was obtained from all participating patients or their relatives retrospectively when consulted by telephone.

Not applicable.

The authors declare no conflict of interest.Author details 1 Internal Medicine and Infectious Diseases Department, Territorial Hospital Center (CHT), Dumbea, New Caledonia. 2 Health Authorities (DASS), Noumea, New Caledonia. 3 Institut Pasteur in New Caledonia, URE Dengue and Arboviruses, Institut Pasteur International Network, Noumea, New Caledonia. 4 Hôpitaux Universitaires Pitie Salpetriere-Charles Foix, Paris, France. 5 Microbiology Laboratory, Territorial Hospital Center (CHT), Dumbea, New Caledonia. 6 Institut Pasteur in New Caledonia, URE Epidemiology, Institut Pasteur International Network, Noumea, New Caledonia.