key: cord-0705933-867hsryo
authors: Orlando, Valentina; Rea, Federico; Savaré, Laura; Guarino, Ilaria; Mucherino, Sara; Perrella, Alessandro; Trama, Ugo; Coscioni, Enrico; Menditto, Enrica; Corrao, Giovanni
title: Development and validation of a clinical risk score to predict the risk of SARS-CoV-2 infection from administrative data: A population-based cohort study from Italy
date: 2021-01-20
journal: PLoS One
DOI: 10.1371/journal.pone.0237202
sha: b0385ac70f0dc67847c4bfe02ac714e7d4fb978d
doc_id: 705933
cord_uid: 867hsryo

BACKGROUND: The novel coronavirus (SARS-CoV-2) pandemic spread rapidly worldwide increasing exponentially in Italy. To date, there is lack of studies describing clinical characteristics of the people at high risk of infection. Hence, we aimed (i) to identify clinical predictors of SARS-CoV-2 infection risk, (ii) to develop and validate a score predicting SARS-CoV-2 infection risk, and (iii) to compare it with unspecific scores. METHODS: Retrospective case-control study using administrative health-related database was carried out in Southern Italy (Campania region) among beneficiaries of Regional Health Service aged over than 30 years. For each person with SARS-CoV-2 confirmed infection (case), up to five controls were randomly matched for gender, age and municipality of residence. Odds ratios and 90% confidence intervals for associations between candidate predictors and risk of infection were estimated by means of conditional logistic regression. SARS-CoV-2 Infection Score (SIS) was developed by generating a total aggregate score obtained from assignment of a weight at each selected covariate using coefficients estimated from the model. Finally, the score was categorized by assigning increasing values from 1 to 4. Discriminant power was used to compare SIS performance with that of other comorbidity scores. RESULTS: Subjects suffering from diabetes, anaemias, Parkinson’s disease, mental disorders, cardiovascular and inflammatory bowel and kidney diseases showed increased risk of SARS-CoV-2 infection. Similar estimates were recorded for men and women and younger and older than 65 years. Fifteen conditions significantly contributed to the SIS. As SIS value increases, risk progressively increases, being odds of SARS-CoV-2 infection among people with the highest SIS value (SIS = 4) 1.74 times higher than those unaffected by any SIS contributing conditions (SIS = 1). CONCLUSION: Conditions and diseases making people more vulnerable to SARS-CoV-2 infection were identified by the current study. Our results support decision-makers in identifying high-risk people and adopting of preventive measures to minimize the spread of further epidemic waves.

Retrospective case-control study using administrative health-related database was carried out in Southern Italy (Campania region) among beneficiaries of Regional Health Service aged over than 30 years. For each person with SARS-CoV-2 confirmed infection (case), up to five controls were randomly matched for gender, age and municipality of residence. Odds ratios and 90% confidence intervals for associations between candidate predictors and risk of infection were estimated by means of conditional logistic regression. SARS-CoV-2 Infection Score (SIS) was developed by generating a total aggregate score obtained from assignment of a weight at each selected covariate using coefficients estimated from the model. Finally, the score was categorized by assigning increasing values from 1 to 4. Discriminant power was used to compare SIS performance with that of other comorbidity scores. 

Since December 2019, the novel coronavirus (SARS-CoV-2) pandemic spread rapidly from the Hubei province in China to 185 countries causing over 3,000,000 cases [1] . The epidemic spread to and increased exponentially in Italy, earlier than in any other western Country, having generated at the current time (June 15) over 236,000 confirmed SARS-CoV-2 infections [2] . SARS-COV-2 causes a Coronavirus disease 2019 (Covid- 19) , for which minor symptoms are anosmia, ageusia, gastrointestinal symptoms, headache, and cutaneous manifestations and major symptoms are fever, cough, dyspnoea [3, 4] . Due to these major symptoms it may be considered necessary to hospitalize patients for respiratory complications [5] .

Several hospital-based studies [6] [7] [8] [9] [10] , including a systematic review of literature and metaanalysis [11] , focused on the attempt for predicting the progression of the disease towards developing critical manifestations or death. These studies are important for the clinical practice point of view for identifying patients at whom early treatment must be guaranteed. However, as most infections are not life-threatening [7] , for the public health point of view it becomes increasingly important stratifying population for identifying people at higher risk of infection. Despite this, at our best knowledge, no studies on this topic have been still published.

We therefore performed a large investigation based upon healthcare utilization database from the Italian Region of Campania aimed (1) to identify clinical predictors of the risk of SARS-CoV-2 infection, (2) to develop and validate a score overall predicting the risk of SARS-CoV-2 infection, and (3) to compare discriminant power of such a score with that from unspecific scores of clinical profile.

Residents in Campania who were beneficiaries of the Regional Health Service (RHS) aged 30 years or older formed the target population (almost 3.9 million people, around 9% of the Italian population of that age group). Italian citizens have equal access to essential healthcare services provided by the National Health Service [12] . An automated system of healthcare utilization (HCU) databases allows managing NHS within each Italian region, including Campania. HCU data report a variety of information drawn from services provided fully or in part free of charge from NHS to beneficiaries of NHS (e.g. the ICD-CM-9 codes of inpatient diagnoses and services supplied from public or private hospitals, the ATC codes of outpatient drugs dispensed from pharmacies). This allowed to Campania Region of designing, building and routinely managing the so-called Campania Region Database (CaReDB) which formed the data source for the current study. Completeness and data validity of CaReDB being elsewhere reported [13] [14] [15] [16] [17] [18] [19] [20] [21] . Selected characteristics of CaReDB are described in S1 Table. From the beginning of the Covid-19 epidemic, a surveillance system was implemented to detect all cases identified by reverse transcription-polymerase chain reaction (RT-PCR) testing for SARS-CoV-2. Diagnostic algorithm was based on the protocol released by the World Health Organization (WHO) [22] , i.e., on nasopharyngeal swab specimens tested with at least two real-time RT PCT assays targeting different genes (E, RdRp and M) of SARS-CoV-2.

These various types of data (i.e., CaReDB and Covid-19 registry) can be interconnected, since a single individual identification code is used by all databases for each citizen enrolled. To preserve privacy, each identification code was automatically deidentified, the inverse process being allowed only to the Regional Health Authority on request from judicial authorities. Permission for using anonymized data for this study was granted to the researchers of the Centro di Ricerca in Farmacoeconomia e Farmacoutilizzazione (CIRFF) by the governance board of Unità del Farmaco della Regione Campania. According with Italian Data protection Authority, neither Ethical Committee approval, nor informed consent were required for carrying out observational studies based on HCU data as the our [23]. Our research protocol adhered to the tenets of the Declaration of Helsinki 1975 and its later amendments.

The date of SARS-CoV-2 infection diagnosis was considered as the index date and patients were extracted from the Covid-19 registry until June 10, 2020. A total of 4,629 subjects positive to SARS-CoV-2 were identified. Among these, we excluded i) patients with missing demographic information (N = 469) and ii) patients younger than 30 years at the index date (N = 663). Finally, 3,497 patients were included into the study as cases. Among them, 453 patients died during the observational period.

For each case, up to five controls were randomly selected from the target population to be matched for gender, age at index date and municipality of residence. The density incidence approach was used for selecting controls since patients who had a confirmed diagnosis of SARS-CoV-2 infection were eligible as potential controls until they became cases, and all matches had to be at risk of SARS-CoV-2 infection. [11, [29] [30] [31] . The algorithms for detecting patients who suffer from each of them from the above-mentioned databases were carefully chosen according to previously published papers on case-identification algorithms based on Italian healthcare data [32] [33] [34] [35] [36] . Individuals were classified as having one of the conditions listed if they received at least two consecutive dispensations of a drug for treatment of a specific class of disease and/or one hospital discharge with the diagnoses coded with the specific ICD-9-CM (S2 Table) .

Conditional logistic regression was used to estimate odds ratios (ORs), with 90% confidence intervals (CIs), for the association between candidate predictors and the odds of SARS-CoV-2 infection. Predictors entered as dichotomous covariates into the model, i.e., with value 0 or 1 according to whether the specific condition was not or was recorded at least once within twoyears prior baseline (2018-2019). Unadjusted and mutually adjusted models were fitted by including one by one covariate, and all covariates together, respectively. Power considerations suggested of excluding covariates with prevalence � 0.12% among controls, i.e., predictors for which our sample size was not enough for detecting OR of at least 3, with a 0.80 power, and by accepting a 0.10 two-sided first type error. In addition, some conditions were grouped together when strong uncertainty of algorithm did not allow for distinguishing them.

With the aim of testing the hypothesis that predictors may affect severity of clinical manifestations of SARS-CoV-2 infection, rather than infection per se, analyses were restricted to strata having fatal infection. Stratifications for sex and age categories (<65 years, �65 years) were performed as secondary analyses.

Seven out of ten of the 3,497 1:5 case-control sets were randomly selected to form the so-called training (derivation) set. The conditional logistic regression model was fitted to compute the ORs as above described. The least absolute shrinkage and selection operator (LASSO) method was applied for selecting the diseases / conditions able to independently predict the SARS--CoV-2 infection [37] . The coefficients estimated from the model were used for assigning a weight at each selected covariate. A weight was assigned to each coefficient by multiplying it by 10 and rounding it to the nearest whole number [38] . The weights thus obtained were then summed to generate a total aggregate score. To simplify the system, i.e., with the aim of accounting for excessive heterogeneity of the total aggregate score, the latter was categorized by assigning increasing values of 1, 2, 3 and 4 to the categories of the aggregate score of 0, 1-2, 3-4, � 5, respectively. The so obtained index was denoted SARS-CoV-2 Infection Score (SIS).

Performance of SIS was explored by applying the corresponding weights to the so-called validation set consisting of the 1,048 1:5 case-control sets who did not enter the training set. To evaluate the clinical utility of SIS for predicting infection, we considered the receiver operating characteristic (ROC) curve analysis and used area under the ROC curve (AUC) as a global summary of the discriminatory capacity of the scores [39] .

Some unspecific scores surrogating general clinical profile of each case and control included into the study were considered. In particular, the number of drugs with different 3rd level ATC dispensed to, and comorbidities with different ICD-9-CM experienced by each case and control within two-years prior baseline (2018-2019) were recorded. Categorization was made by assigning increasing values of 1, 2, 3 and 4 to 0, 1-4, 5-9 and �10 drugs (comedication score) and 1, 2, 3 and 4 to 0, 1-2 and �3 comorbidities (comorbidity score). In addition, cases and controls were categorized according to the Multisource Comorbidity Score (MCS), a new index of patients' clinical status derived from inpatients diagnostic information and outpatient drug prescriptions provided by the regional Italian data and validated for outcome prediction [40, 41] . To simplify comparisons, the original five categories of worsening clinical profile (0, 1, 2, 3 and 4) as defined by MCS, were reduced to milder (MCS = 0), middle (1�MCS�3) and severe (MCS�4) categories.

With the aim of comparing discriminatory ability of specific (SIS) and unspecific (comedications, comorbidities and MCS) predictors of SARS-CoV-2 infection, ROC curves and corresponding AUCs were again used.

All analyses were performed using SAS 9.4 (Cary, NC). A 2-sided p-value of 0.10 or less was considered significant.

Owing to their low prevalence, fourteen conditions were excluded from this analysis (tuberculosis, weight loss, disorders involving the immune mechanisms, disorders of fluid, electrolyte and acid-base balance, coagulation defects, bipolar disorders, alcohol abuse, drug addiction, multiple sclerosis, cystic fibrosis, chronic and acute pancreatitis, anchylosing spondylitis, systemic sclerosis, systemic sclerosis). Among the 33 remaining conditions, two were grouped, i.e., chronic pulmonary obstructive disease with asthma (chronic respiratory disease), and chronic renal disease with or without dialysis.

The characteristics of the cohort members are shown in Table 1 . Among the 31 remaining conditions, 23 (74%) showed significant association with the risk of SARS-CoV-2 infection from univariate regression. Table 2 reports multivariate association between the considered diseases/conditions and the risk of SARS-CoV-2 infection which results significant for 12 conditions (39%).

In particular, patients suffering from diabetes, anaemias, mental disorders (dementia / Alzheimer's disease, psychosis and anxiety), Parkinson's disease, glaucoma, diseases of the circulatory system (heart failure and hypertension), chronic respiratory, inflammatory bowel, and rheumatologic conditions showed statistical evidence of increased risk of infection with respect to patients who did not suffer from them. Likely because of low power, only 7 conditions resulted significantly associated with the risk of fatal Covid-19 disease, but there was no relevant difference in the estimates with respect to the risk of SARS-CoV-2 infection ( Table 2) .

Anaemias, dementia/Alzheimer, psychosis, anxiety, epilepsy, heart failure, kidney diseases and particularly cystic fibrosis increased the risk of SARS-CoV-2 infection among women, whereas higher risk of infection was observed among men suffering from diabetes, psychosis, anxiety, Parkinson, arrhythmia, chronic pulmonary disease, inflammatory bowel diseases and particularly dementia/Alzheimer and rheumatologic conditions (S3 Table) .

Estimates were similar for Covid-19 patients younger and older than 65 years. Among the former group, a significant higher risk of infection was observed for diabetes, anxiety, Parkinson's disease, arrhythmia, inflammatory bowel and chronic pulmonary diseases, particularly dementia/Alzheimer, whereas patients older than 65 years suffering from thyroid disorders, anaemias, dementia/Alzheimer, psychosis, anxiety, epilepsy and heart failure showed a significant higher risk infection (S4 Table) .

Fifteen conditions significantly contributed to the SIS, the corresponding weights being reported in Table 3 . Factors which most contributed to the total aggregate score were dementia / Alzheimer's disease, kidney disease, psychosis, inflammatory bowel disease and rheumatologic conditions, while diabetes, anaemias, anxiety, Parkinson's disease, glaucoma, heart failure, hypertension, arrhythmia, thyroid disorders and chronic respiratory disease provided small, although significant, contributions. 

Generic/unspecific scores surrogating clinical profile showed to be associated with the risk of SARS-CoV-2 infection, showing patients with � 10 drug treatments, those with � 3 comorbidities, and those with MCS value � 4, increased risk of 65%, 36% and 45% with respect to patients cotreatments, comorbidities and MCS value = I, respectively ( Table 4) . AUC (90% CI) of SIS, cotreatment and comorbidity scores and MCS respectively had values of 0.54 (0.52 to 0.56), 0.52 (0.50 to 0.54), 0.53 (0.51 to 0.55), and 0.53 (0.51 to 0.55) (Fig 2) . There was no evidence that specific and unspecific scores had different discriminatory ability.

Our study shows that several diseases and conditions are significantly and independently associated with the risk of SARS-CoV-2 infection. Beyond conditions making particularly vulnerable the respiratory system (e.g., chronic obstructive pulmonary disease and asthma), comorbidities positively associated with the infection practically included all diagnostic categories. Predictors belonging to nutritional and metabolic (diabetes), cardiovascular (heart failure and hypertension) and renal diseases were widely expected, since it has accepted that SARS-CoV-2 has major implications for the cardiovascular system. Indeed, patients with heart failure [42] , diabetes [43] [44] [45] , hypertension [12] and kidney disease [46] [47] [48] have been consistently identified as particularly vulnerable populations, and these findings were consistently found in our study. In addition, we confirmed that people with weakened immune systems from a medical condition or treatment are at a higher risk. Among these, those living with haemoglobin disorders [49] , inflammatory bowel disease [50] and immune-rheumatological diseases [51] must be considered vulnerable groups for SARS-CoV-2 infection. Mental health and cognitive function might have independent utility in understanding the burden of respiratory disease, since they may influence the risk of contracting the infection, at least in part by impairing innate or adaptive immunity [52] and diminishing the precautions taken to minimize risk. Another explanation of our findings is that people with history of depression [53] , psychosis [54] and stress disorders [55] could experience elevated rates of an array of respiratory infections because these conditions often require treatment in a psychiatric care facility, and the risk of infection can be particularly high in these structures. Finally, our study adds evidence regarding the impact of diseases and conditions on the risk of SARS-CoV-2 infection between men and women. As pointed out by a recent study [56] , sex and age disaggregated data are essential for understanding the distributions of risk infection in the population and the extent to which they affect clinical outcomes.

Despite our results confirm that a wide range of diseases and conditions likely increase vulnerability to SARS-CoV-2 infection, and probably its more severe clinical manifestations, we have not been able to develop a score that accurately may predict the risk of infection. In addition, we found that predictive ability of the score obtained by weighting risk factors of SARS--CoV-2 infection did not overcome that of some generic scores of comorbidities and comedications. This expands upon previous findings of individual comorbidities as 

SARS-CoV-2 Infection Score (SIS) to predict patients most at risk of Covid-19 independent risk factors for SARS-CoV-2 infection [57, 58] , and confirms our substantial inability to predict the risk of SARS-CoV-2 infection. This can be explained by several limitations of our approach, which generate estimates biased towards the null. First, exposure misclassification regards our inability to careful capturing conditions and diseases through algorithms based on healthcare utilization databases [59] . Second, it is well known that outcome misclassification can bias epidemiologic results. For Covid-19, suboptimal test sensitivity, despite excellent specificity, results in an overestimation of cases in the early stages of an outbreak, and substantial underestimation of cases as prevalence increases [60] . It should be noticed, however, that both, exposure and outcome misclassification likely drew estimates towards the null (i.e., underestimate the strength of the association between their presence and the outcome risk) so generating uncertainty for the weighting approach of score developing. Third, the lack of information on biologic markers potentially able to predict infection, and severity of its clinical manifestations, is another limitation of our study. For example, according to the current literature, some laboratory hallmarks have been shown to predict infection, particularly in more severe cases [61] . Finally, our choice of accepting a 0.10 first type error, and of consequently reporting 90% confidence intervals, is justified by the exploratory nature of our study, but at the same time likely generate false positive signals, so limiting discriminant power of the score.

Three other elements of weakness should be acknowledged. First, the lack of data regarding the clinical outcome experienced by SARS-CoV-2 positive patients in terms of home isolation, hospitalization and admission in intensive care. Second, because few people aged less than 30 years were diagnosed to be affected by SARS-CoV-2 infection during the investigated period, and few of them suffered from chronic conditions such as those considered in our study, patients with less than 30 years were excluded from the analysis. Although this reduced the uncertainty of the results, the generalisability of our findings requires extreme caution. Finally, because data on stays in long-term facilities are not recorded in our database, we cannot exclude that the higher risks associated with mental disorders observed in our study could be explained by confounding, i.e., patients who suffered from these conditions are often hospitalized in these structures where the risk of infection can be particularly high.

In conclusion, taking the limitations we discussed into account, we identified conditions and diseases that make people more vulnerable to SARS-CoV-2 infection. These findings contribute to inform public health, and clinical decisions regarding risk stratifying. However, further research is need for developing a score reliably predicting the risk, possibly by integrating healthcare utilization with clinical and biological data.

Our results can be an important tool supporting all clinical and political stakeholders allowing the identification of the population most at risk of contracting SARS-CoV-2 infection and facilitating the provision of appropriate preventive/therapeutic measures, especially with the hypothetic prediction of a new autumn outbreak. Adopting preventive measures can help to minimize the damage generated by a potential new relapse that the health systems will face. 

An interactive web-based dashboard to track COVID-19 in real time

Case-Fatality Rate and Characteristics of Patients Dying in Relation to COVID-19 in Italy

Olfactory and gustatory function impairment in COVID-19 patients: Italian objective multicenter-study. Head Neck

Objective evaluation of anosmia and ageusia in COVID-19 patients: Single-center experience on 72 cases. Head Neck

Clinical features, laboratory findings and predictors of death in hospitalized patients with COVID-19 in

Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19

Development and external validation of a prognostic multivariable model on admission for hospitalized patients with COVID-19

A simple algorithm helps early identification of SARS-CoV-2 infection patients with severe progression

Epidemiological and Clinical Predictors of COVID-19

Development and validation of the COVID-19 severity index (CSI): a prognostic tool for early respiratory decompensation

Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis

Renin-Angiotensin-Aldosterone System Blockers and the Risk of Covid-19

Treatment Patterns of Diabetes in Italy: A Population-Based Study

Biological therapy utilization, switching, and cost among patients with psoriasis: retrospective analysis of administrative databases in Southern Italy

Prevalence of antibiotic prescription in southern Italian outpatients: real-world data analysis of socioeconomic and sociodemographic variables at a municipality level

Osteoporosis drugs in realworld clinical practice: an analysis of persistence

Prescription Patterns of Antidiabetic Treatment in the Elderly. Results from Southern Italy

Adherence to chronic medication in older populations: application of a common protocol among three European cohorts

Assessment and potential determinants of compliance and persistence to antiosteoporosis therapy in Italy

Drug Utilization Pattern of Antibiotics: The Role of Age, Sex and Municipalities in Determining Variation

Drug-utilisation Profiles and COVID-19: Retrospective Cohort Study in Italy

Does comorbidity increase the risk of patients with COVID-19: evidence from meta-analysis

Using pharmacy data to identify those with chronic conditions in

A Systematic Review of Case-Identification Algorithms Based on Italian Healthcare Administrative Databases for Three Relevant Diseases of the Nervous System: Parkinson's Disease, Multiple Sclerosis, and Epilepsy

Prevalence of Multiple Sclerosis in Tuscany (Central Italy): A Study Based on Validated Administrative Data

Prevalence of multiple sclerosis in the Lazio region, Italy: use of an algorithm based on health information systems

Can we use the pharmacy data to estimate the prevalence of chronic conditions? a comparison of multiple data sources

The lasso method for variable selection in the Cox model

A combined comorbidity score predicted mortality in elderly patients better than existing scores

Estimating the receiver operating characteristic curve in matched case control studies

Developing and validating a novel multisource comorbidity score from administrative data: a large population-based cohort study from Italy

Measuring multimorbidity inequality across Italy through the multisource comorbidity score: a nationwide study

Susceptibility and prognosis of COVID-19 patients with cardiovascular disease

Risk of Infection in Type 1 and Type 2 Diabetes Compared With the General Population: A Matched Cohort Study

Immune dysfunction in patients with diabetes mellitus (DM)

Common infections in diabetes: pathogenesis, management and relationship to glycaemic control

Should COVID-19 Concern Nephrologists? Why and to What Extent? The Emerging Impasse of Angiotensin Blockade

Kidney disease is associated with in-hospital death of patients with COVID-19

Human kidney is a target for novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. medRxiv

Management of Hemoglobin Disorders During the COVID-19 Pandemic

Aspectos y consideraciones generales en la enfermedad inflamatoria intestinal durante la pandemia por COVID-19

COVID-19 infection and rheumatoid arthritis: Faraway, so close!

Psychological stress and susceptibility to the common cold

Depression and the risk of severe infections: prospective analyses on a nationwide representative sample

Risk of pneumonia and pneumococcal disease in people with severe mental illness: English record linkage studies

Posttraumatic Stress Disorder and Incident Infections: A Nationwide Cohort Study

Sex Differences in Mortality from COVID-19 Pandemic: Are Men Vulnerable and Women Protected?

Comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis

Charlson Comorbidity Index Score and Risk of Severe Outcome and Death in Danish COVID-19 Patients

Effects of non-differential exposure misclassification on false conclusions in hypothesis-generating studies

Towards reduction in bias in epidemic curves due to outcome misclassification through Bayesian analysis of time-series of laboratory test results: Case study of COVID-19 in Alberta, Canada and Philadelphia

Prompt predicting of early clinical deterioration of moderate-to-severe COVID-19 patients: usefulness of a combined score using IL-6 in a preliminary study