key: cord-0886545-eqdd3oqk
authors: Müller, Martin; Schechter, Clyde B.; Hautz, Wolf E.; Sauter, Thomas C.; Exadaktylos, Aristomenis K.; Stock, Stephanie; Birrenbach, Tanja
title: The development and validation of a resource consumption score of an emergency department consultation
date: 2021-02-19
journal: PLoS One
DOI: 10.1371/journal.pone.0247244
sha: b772f035d72bb7ab1bdc5e707cdb666a848b7b14
doc_id: 886545
cord_uid: eqdd3oqk

BACKGROUND: Emergency Department (ED) visits and health care costs are increasing globally, but little is known about contributing factors of ED resource consumption. This study aims to analyse and to predict the total ED resource consumption out of the patient and consultation characteristics in order to execute performance analysis and evaluate quality improvements. METHODS: Characteristics of ED visits of a large Swiss university hospital were summarized according to acute patient condition factors (e.g. chief complaint, resuscitation bay use, vital parameter deviations), chronic patient conditions (e.g. age, comorbidities, drug intake), and contextual factors (e.g. night-time admission). Univariable and multivariable linear regression analyses were conducted with the total ED resource consumption as the dependent variable. RESULTS: In total, 164,729 visits were included in the analysis. Physician resources accounted for the largest proportion (54.8%), followed by radiology (19.2%), and laboratory work-up (16.2%). In the multivariable final model, chief complaint had the highest impact on the total ED resource consumption, followed by resuscitation bay use and admission by ambulance. The impact of age group was small. The multivariable final model was validated (R(2) of 0.54) and a scoring system was derived out of the predictors. CONCLUSIONS: More than half of the variation in total ED resource consumption can be predicted by our suggested model in the internal validation, but further studies are needed for external validation. The score developed can be used to calculate benchmarks of an ED and provides leaders in emergency care with a tool that allows them to evaluate resource decisions and to estimate effects of organizational changes.

a1111111111 a1111111111 a1111111111 a1111111111 a1111111111

Increasing healthcare costs are a worldwide problem [1] . A substantial proportion of these costs results from Emergency Departments (ED), as these provide nearly half of the hospitalassociated medical care nowadays in Western countries [2] . ED visits are rising globally [3] , and over and above, ED care is more expensive compared to other forms of healthcare [4] . Furthermore, in times of a global healthcare and economic crisis, as in the on-going COVID-19 pandemic, an efficient allocation of material and human resources in the ED is crucial to ensure medical care that is economically sustainable [5] .

Despite the important role of ED care in the healthcare system, ED resource consumption has only been modestly studied so far [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] . Furthermore, instead of reporting the actual resource consumption, some studies rely on surrogate measures to represent resource consumption, i.e. arrival by ambulance, triage category, number of tests and procedures performed, length of stay in the ED, or admission rates [7, 14] . Most studies reported a positive association of increasing age [8-10, 12, 14] and higher acuity triage category [6, 7, 10, 11, 16] with resource consumption. The evaluation of EDs in terms of resource and performance analysis was often based solely on the volume of an ED counting, for example the number of patients treated each year [17] . However, the profile of the patients admitted to a medical department often varies considerably-consequently so do the resources required by each ED [7] . Thus, assessments of efficiency must take the treated patient profile into consideration.

Within intensive care units, an adapted version of the "Therapeutic Intervention Scoring System" (TISS) [18] is often used as a tool to perform resource and performance analysis [19, 20] . The average overall TISS-28 score per patient day or nurse, for instance, is used to measure the performance of intensive care units in Switzerland and internationally [21] [22] [23] [24] . To our knowledge an analogue score that evaluates the use of resources in ED departments does not yet exist. Such a score has the potential to identify areas and special ED patient groups with high resource demands at an early stage-a prerequisite to implement preventive procedures and adaptive actions that might increase the structural, process, and performance quality in the ED in combination with optimisation of needed resources. Furthermore, it might be of great use in research as a standardised tool to describe the performance of an ED and to compare different EDs on an international level.

The aims of this study are i) to illustrate the distribution of an ED patient's needed resources in different subgroups (laboratory, nurse, physician, material, and radiology), ii) to identify factors that are associated with the total ED resources, iii) to develop and validate a scoring system that predicts the ED resource consumption of a patient and demonstrate a practical example of application for quality assurance.

Switzerland with a catchment area of two million people, and about 50,000 ED consultations per year [25] . The study period is over five years from 01.01.2013 to 31.12.2017 . There were no major structural changes during the study period (see S1 Appendix for a detailed description of our ED and patient management process).

All adult patients (age�18) presenting to the ED over the study period were included. Patients were excluded if i) the case identification number or a documented chief complaint was missing, ii) multiple consultations shared one case identification number (e.g. very short-term revisits), iii) the consultation generated few or no entries (total ED resources less than 10 tax points, see below) in the resource databases (e.g. cancellations, incomplete documentation), and iv) patients were seen by the psychiatrist as the leading ED physician, as they have a different billing system.

Every procedure that is performed in the ED is documented by the person who performed the procedure with a procedural code out of the TARMED Suisse catalogue [26] given by the Swiss health law for billing purposes. Although not all procedural codes are billing-relevant, those codes form the basis for the billing. All members of the ED are trained regularly to achieve accurate coding.

Two-hundred fifty-nine specific procedural codes of the TARMED Suisse catalogue [26] that are regularly used in our ED were chosen by a working group consisting of acute care nurses, radiology nurses, ED physicians, and the controller of our ED department. A numeric value is assigned for each procedural code (e.g. 00.0410 brief physical examination of a patient) with corresponding unit/"medical currency" tax points. The medical currency one tax point (TP) roughly corresponds to 1 US-$, but the exact amount varies among hospitals.

Those codes were grouped into different resource groups i.e. physician, nurse, laboratory, radiology, and material, see S2 Appendix). The total ED resource consumption of a consultation was defined as the sum of all TP of all defined codes. Additionally, the total ED costs for each patient were obtained.

As a secondary outcome and additional surrogate marker of ED resource consumption, the length of stay (LOS) in the ED was also extracted.

Contextual factors and factors describing the acute as well as the chronic condition of a patient's consultation were assessed as potential predictor variables:

1. Contextual factors: season of the year (spring to winter), Saturday or Sunday admission, and night-time admissions (from 19:00 to 06:59), the occupancy index (defined as the ratio between the total number of patients in the ED and the total number of ED treatment beds) [27, 28] and the emergency department work index (EDWIN) calculated as (S n i

, where n i = number of patients in the ED in triage category i, t i = triage category, N a = number of attending physicians on duty, B T = the number of ED treatment beds, B A = total number of admitted patients in the ED (0-1.5, active ED; 1.5-2.0, very busy ED; >2, overcrowded ED) [29, 30] . The two latter factors were used to describe the business of the ED.

2. Acute condition: type of admission, chief complaint groups such as trauma and neurological complaint (see S4 Appendix, based on Aronsky et al. [31] ), and documented vital deviations i.e. oxygen saturation (<90%), systolic blood pressure (<100mmHg), temperature (<35.0˚C or >38.5˚C), level of consciousness (Glascow Coma Scale <15), respiratory rate (<8/min or >25/min), and heart rate (<50/min or >110/min) as these deviations are associated with severe disease courses and higher mortality [32] . To reflect polytrauma and unstable patients, the need for resuscitation room care was defined as a potential predictor variable.

For sensitivity analysis, instead of vital deviations, the triage group was used, which is routinely assessed by special trained nurses using the Swiss Emergency Triage Scale [33] , a triage scale similar to the Manchester Triage System [34] (1: highly acute to 5: non-urgent).

a. Important comorbidities based on the Charlson Comorbidity Index [35] : COPD, diabetes, liver disease, dementia, malignancy, cerebrovascular disease, peripheral artery disease, coronary vessel disease, and chronic kidney disease.

b. Drug intake (on admission or discharge) based on the Anatomical Therapeutic Chemical (ATC) classification system [36] : antidiabetic (ATC code A10), antithrombotic (B01), antihypertensive (C02, C04-C09), diuretic (C03), opioid (N02A), and-to set neurological patients, who are thought to have high ED resource consumption, in a broader context-antiepileptic (N03) and psycholeptic (N05).

Other: Demographic factors: age and sex.

The potential predictor variables were extracted from the computerized clinical databases (E-Care, ED 2.1.3.0, Turnhout, Belgium). All procedural codes were extracted from the administrative database (OpenText Suite for SAP1 Solutions, OpenText Corporation, Waterloo, Canada). For a detailed protocol, including the definitions of the variables and validation, see S2-S4 Appendices.

The study was performed in accordance with Swiss law. The Bern ethics committee registered the study as a quality assurance study (2018-00198) and waived the requirement for informed consent.

Stata1 13.1 (StataCorp, The College Station, Texas, USA) was used for statistical analysis. All continuous variables are presented as medians with 25 th -75 th percentile ranges (IQR). Categorical variables are shown with frequency and proportion. The outcome was natural logarithm (ln)-transformed account for the skewness of the total ED resource consumption. Univariable linear regression analysis with the transformed outcome was performed to quantify the association of the total ED consumption and potential score parameters. The exponentiated coefficient of such a model correspond to the geometric mean ratio (GMR) of the nonlog-transformed outcome in the presence vs. the absence of the predictor [37] . For the score development the dataset was randomly split (50:50) into a training and validation set. All studied predictor variables were included in a multivariable linear regression analysis with the ln-transformed total ED resource consumption as outcome. For a parsimonious final model, predictors that changed the geometric mean by less than 10% (0.9 < GMR < 1.1) were removed stepwise from the final model.

The total ED resource consumption can be predicted from the linear regression model as

Where a 0 is the constant and a 1 ,. . .,a m are the coefficients of the final model and x 1 ,. . .,x m are binary variables (0/1) indicating the presence or absence of the predictor. From the final model, the resource score, will be defined as

where the constants c 0 and c 1 are determined, so that the obtained score possibly ranges from 0 to 100. Different sensitivity analyses for the final model were performed: A model i) with the use of the triage category instead of the vital parameters (model 2), ii) with an additional interaction term between trauma and resuscitation room use to better reflect polytrauma (model 3), and iii) excluding revisits (model 4). One might argue that the Swiss Tarmed codes do not validly reflect resource consumption as a "resource measure" is already assigned to each process. Thus, we also evaluated the parameter LOS in the ED (in hours) as an outcome, applying the same model development procedure.

To assess the fit and parsimony of the ED resource consumption models, predictive accuracy, and explained variance, the following parameters were calculated: Akaike information criterion (AIC), and Bayesian information criterion (BIC) for the development sample, and mean absolute prediction error (MAPE), mean relative squared error (MRSE), mean squared prediction error (MSPE) and R 2 for the validation sample [38] . The obtained R 2 was compared to a model that included triage and age group as predictor variables only. Furthermore, for a more intuitive measure of predictive accuracy, we calculated the median and IQR of the absolute percentage of the deviation of the predicted to observed ratio (|100%-predicted/observed x 100%|) for all deciles in the different models [39] .

In total, 164,729 out of 206,006 consultations were included in the analysis and were randomised 1:1 into validation (n = 82,341) and training sets (n = 82,388). The reasons for exclusion were i) patient age younger than 18 years (n = 6,992), ii) case identification number missing or associated with multiple consultations (n = 7,478), iii) few or no (<10 TP) resource database entries, e.g. cancelled consultation (n = 7,639), iv) the psychiatrist was the leading physician (n = 8,511), or v) the chief complaint was not documented (n = 10,657), see S5 Appendix.

In the study population, the median age was 49 years (IQR 32, 67), with 56.3% males. The most common triage group was urgent (60.7%). In total, 16.3% of the consultations had a neurological chief complaint and 16.7% of the patients presented after trauma, and 35.2% of the ED consultations led to hospitalization. There were no significant differences between the validation and training set (S6 Appendix).

Distribution of ED resource consumption. The median total ED resource consumption was 638 (IQR 254, 1264) TP in the training set. The median in the resource subgroup was highest for the physician resources (training set: 323 TP, IQR 119, 500) followed by laboratory work-up (training set: 96.4 TP, IQR 0, 227) and radiological work-up (training set: 60 TP, IQR 0, 420) with no difference between the training and validation set (S7 Appendix).

The mean relative distribution was slightly different: Physician resources made up the largest proportion (54.8%), followed by radiology (19.2%), laboratory work-up (16.2%), nursing resources (5.4%), and materials (4.5%) in the training set.

The distribution of the total ED resource consumption by triage category is shown in Fig 1. Physician resources accounted for the major percentage in all but the life-threatening triage category. The proportions of radiology and laboratory resources were higher in the life-threatening and high urgent categories than in the less acute triage groups.

The correlation of ln-transformed total ED resource consumption and total ED costs was high; Pearson's correlation coefficient was 0.939 (95% CI: 0.939-0.940). Table 1 shows the univariable associations of the acute patient condition factors with the total ED resource consumption. Ambulance admission and resuscitation bay use increased the geometric mean about the factor 2.5 (2.7 and 2.5). Compared to urgent triage, semi-urgent triage had less (GMR 0.5) while high urgent (GMR 2.3) and life-threatening (GMR 4.6) had more resource needs. Last, the chief complaint group had a high impact on resource consumption ranging from a geometric mean factor 0.2 (eye problem) to 2.9 (neurological complain) compared to resources of patients presenting with musculoskeletal complains. Table 2 shows the univariable associations of chronic patient condition and contextual factors with the total ED resource consumption. The resource needs increased with increasing age, with the least resource consumption by [18] [19] [20] [21] [22] [23] [24] year olds, and the most for patients older than 85 years. The analysed drug intake and comorbidities increased the geometric mean by factors from 1.7 to 3.0. Apart from weekend admissions (GMR 0.8), the impact of contextual factors on ED resource consumption was small.

The two analysed factors describing busyness of the ED, occupancy index and EDWIN score, did only slightly change the GMR (1.0, respectively 1.02). 

The results of the multivariable linear regression analysis of the final model (see statistical analysis) are shown in Table 3 . The highest impact on the total ED resource consumption had chief complaint with a GMR ranging from 0.2 (eye problems) to 2.3 (neurological complaints) compared to patients with musculoskeletal complaints (baseline group). Each documented vital parameter deviation (heart rate, blood pressure, oxygen saturation, respiratory rate, level of consciousness and temperature) increased the geometric mean of the total ED resource consumption between 11 and 23%. Resuscitation bay use increased the geometric mean by a factor of 2.3 and admission by ambulance by a factor of 1.4. Additionally, drug intake (antithrombotic, antihypertensive, and opioids) and comorbidities (liver disease, malignancy, and cerebrovascular disease) increased the geometric mean each about 18-19% and 25-32%. The impact of age on total ED resource consumption was smaller in the multivariable model than in the univariable analysis.

With the formula presented in the statistical analysis the section and the values for the coefficients presented in Table 3 , for instance, the total ED resource consumption of a 30 year old patient with respiratory symptoms, normal vitals, without any comorbidity, and admitted by Out of the coefficients presented in Table 3 , the total ED resource consumption score was thus Validation of the scoring system and sensitivity analysis. The median resource score was 35.9 (IQR 31.5, 44.2) with a range of 0 to 84.3 in the validation set. The ED resource score was validated by validation of the multivariable model. Table 4 and S8 Appendix show the validation of the final model (model 1), as well as-for sensitivity analysis-the three other models. All sensitivity analysis models only slightly changed the observed R 2 of 0.54, which means that 54% of the variance in the total ED resources (ln-transformed) is predictable with the model (S8 Appendix).

A linear regression analysis with only triage and age group as predictor variables showed an R 2 of 23.7%. For patients with average ED resource consumption the median deviation of the predicted values is less than 8%, while the performance is worse in the lower deciles (11.9%-17.4%) as well as in the highest decile (10.9%) ( Table 4 ). This performance measure is similar in all four studied models.

Practical application: ED resource score and quality assurance As a practical application example, the change in ED resource consumption over the study period was analysed ( Table 5 ).

The number of visits increased over the years, increasing by 30% compared to 2013. The increase in resource needs reflected by cumulative total ED resource score points (Cum. RSP) was similar, suggesting a uniform increase over all patient resource groups. Compared to the baseline year 2013, in 2014 and 2015, the cumulative total ED resource score points per health care worker (HCW) increased by +9% and +10%, which might indicate a higher performance in the latter years compared to the baseline year.

As a secondary outcome the LOS in the ED in hours was studied (LOS-ED). The median LOS-ED was 3.7 h (2.2-5.7) with no difference between the validation and training set (p = 0.996).

The multivariable linear regression model to predict ln-transformed LOS-ED revealed an R 2 in the validation sample of 0.24 (Table 6 ). While the chief complaint showed an effect in the same direction as the analysis modelling ED resource consumption, more acute consultations, reflected by resuscitation bay use and temperature deviations, showed a GMR<1 when predicting ln-transformed LOS-ED. 

In this retrospective analysis of a large Swiss interdisciplinary ED, the distribution of an ED patient's consumption of resources was quantified, and predictors of total ED resource utilization were determined. Furthermore, this study developed and validated a novel scoring system for resource utilization for patients presenting to the ED that takes data acquired at the very early stages of patient care into consideration, providing better resource prediction than the use of a triage tool alone.

The distribution of ED resources between physician and imaging as well as laboratory was comparable to international findings [10, 11] . Resource contribution varied significantly according to triage level. The contribution of physician resources was highest for low-acuity patients, and decreased gradually with rising urgency, also comparable to international results [10, 11] . The contribution of ancillary services (laboratory work, imaging studies) showed a reverse result, with lower contribution to total ED resources in low-acuity patients and higher contribution in high-acuity patients. This finding has several implications for cost-containment and adaptive organizational measures, e.g. referral of low-acuity patients in a separate less-resource intense area of the ED and optimizing laboratory and imaging resources for high-acuity patients.

Our predictors identified in univariable analysis correspond well to published findings: arrival by ambulance [40] , chief complaint group [13] , resuscitation bay use, deviation of vital signs [32] , and triage level [6, 7, [9] [10] [11] 16] . Chief complaint has a large influence on resource utilization, with neurologic complaints showing the biggest impact, probably due to the large amount of diagnostic studies and extensive physician-patient resource needs, comparable to international findings [13] , followed by cardiovascular, respiratory, gastrointestinal, and trauma. Ear-nose-throat (ENT) and ophthalmologic complaints were associated with less resource utilization. This may be explained by the fact, that these patients usually require less extensive laboratory and imaging work-up, however, there might be an underrepresentation of specialized procedural codes in the selection of the Tarmed catalogue. A similar finding was reported in a paediatric ENT population [41] .

Regarding chronic patient conditions and contextual factors, we found an association of increasing age with resource consumption that is well described in the literature [8-10, 12, 14] . However, in our multivariable linear regression model, this difference was almost negligible. This emphasizes the important fact, that resource consumption is not associated with age per se, but rather with the accompanying relevant multiple comorbidities and polypharmacy, as well as cognitive or functional decline, leading to higher clinical complexity, e.g. liver disease [9] .

Drug intake of any antithrombotic, antihypertensive or any opioid medication increased the geometric mean of total resource consumption about 18%, comparable to previous publications. An emergency ward setting in a tertiary hospital in Sweden reported cardiovascular medications and antithrombotic agents among the top three common drugs causing or contributing to admission [42] . Individuals with high-risk prescription opioid use are known to have significantly higher healthcare costs and utilization than their counterparts [43] , and we recently demonstrated multi-substance users need significantly more ED resources than agematched controls [44] .

Similar to our predictors of resource utilization, data derived from the United States National Hospital Ambulatory Medical Care Survey also demonstrated age, triage level, arrival mode, and certain comorbidities (cerebrovascular disease, dementia) to be predictive of the eventual use of advanced diagnostic imaging in the ED [45] . With the multivariable model using easily available acute patient presentation factors as well as markers of chronic patient condition, 54% of the variance of resource utilization could be explained by the variables available at the early stages of patient presentation. These findings were verified in multiple internal sensitive analyses using different models. The identified model performed much better than a linear regression analysis with only triage and age group, two well-known predictors of resource utilization, with much poorer prediction (R 2 = 0.24).

Furthermore, we found a high correlation of actual resource utilization with cost. However, due to very different national healthcare and billing systems [46] , the results from this Swiss ER setting cannot simply be generalized to other countries, and further international studies are needed to determine, if a pure cost analysis (were data usually is more easily available) sufficiently reflects the actual resource utilization of an ED patient.

Resource consumption is difficult to measure. Some might argue that the Swiss Tarmed codes do not validly reflect resource consumption as a "resource measure" is already assigned to each process. Thus, we additionally evaluated the variable LOS-ED as an outcome parameter. At first glance, this might be a valid outcome variable to reflect ED resource consumption. Chief complaint showed the same direction of effect as the analysis modelling ED resource consumption, undermining the robustness of the parameter. However, a multitude of factors affect patients' LOS-ED [13] , i.e. simulation-based training for sedation procedures [47] , or the use of ED observation units [48] . Furthermore, parallel and high-priority work-up of the patient is not at all reflected by LOS. High-acuity patients, treated in the resuscitation bay, are usually rapidly transferred to definite care (operating theatre, intensive/intermediate care unit), thus having a short LOS-ED, but are very resource intensive. Therefore, LOS-ED is not a suitable measure to reflect resource consumption.

Using the variables derived in the multivariable regression, we developed and validated a novel scoring system for total ED resource consumption, taking initial information at patient presentation and the patient profile into account, explaining more than half of the variation in total ED resource consumption. These insights are crucial especially in times of resource shortages, not only for ED physicians and managers but hospital administrators and economics as well. The resource score, when applied at time of ED triage has the potential to better identify areas and special patient groups with high resource demands at an early stage.

Analogous to the TISS in the intensive care setting this score can be used be reflect resource consumption in the ED. Whereas the TISS is composed of tasks and chores actually conducted this resource score predicts ED resource consumption from the initial patient presentation, and thus it can be used to guide patient management in the ED beyond triage-category alone, i.e. assisting patient-flow by locating the patient in a more or less resource intensive area of the ED, improving medical decision-making, and providing efficient and sustainable health care. Furthermore, instead of simply presenting the volume of ED patients, it might be valuable in research as a standardised benchmarking tool to describe the service-performance of an ED and providing resource-adjusted inter-institutional cost and performance comparisons. Analogous to the TISS, which is used not only for performance measurement but also reimbursement, this score can provide hospital administrations with valuable information regarding cost generation, appropriate invoicing of emergency services provided, as well as workforce planning. Additional international multicentre studies are needed to determine how the application of such a scoring system can optimize ED resource allocation and consumption, thus providing optimal sustainable emergency care, quality assurance, and improvement.

External validation of the suggested scoring system is the next step necessary for investigating generalizability. The predictors identified in univariable analysis correspond well to published findings also in less resource-intense settings (i.e. Lebanon) [10] , which underlines a possible generalizability. Furthermore, as the score uses clinical predictors whose data collection can easily be integrated into the daily routine, e.g. triage process, it can be used in ED settings that do not collect such granular resource consumption data. The verification of external validity requires further prospective multicentre and international studies due to different intergovernmental health care and billing systems and patient populations. For example, our ED does not work under a 4-hour rule, transferring patients who need longer diagnostic work-up to an observation/short-stay unit, but takes care of the whole treatment process. Additionally, health spending varies significantly among different countries, and Switzerland is near the top of the range [46] .

The interpretation of our results warrants some caveats. First, data are derived from a single level one trauma and adult tertiary care referral centre, albeit one of the largest in Switzerland, making results less generalizable. Furthermore, this ED includes a large neurological referral and stroke center, a patient group prone to using a lot of resources, adding a selection bias. Next, in our definition of utilized resources we only include the direct medical resources actually documented in the ED by physician and nursing staff, as well as ancillary services, thus not considering overhead resources (i.e. infrastructure, maintenance, and hospital security). However, we have detailed records of our resource documentation, our staff is regularly trained in the documentation process, and controlling assures completeness of the documentation and circumvents variability in physician documentation practice. We focussed only on the ED process and did not include hospitalization-related resources/costs. This may lead to a partial underrepresentation of resources utilized in the third of the total patient population that required hospitalization, as some diagnostic or therapeutic measures may have been postponed. Moreover, comorbidities and medications were not standardized and automatically collected, but derived by full text parsing. Nonetheless, this was validated against manual coding. Besides that, due to a different documentation and billing system we had to exclude patients seen solely by the psychiatrist, resulting in possible selection bias, as psychiatric comorbidity may be one reason for excessive physician resource utilization [49] . Finally, whereas we recently found that resource utilization is in large part dependent on the physicians' ratings of case difficulty (i.e. their situational level of uncertainty, familiarity and perceived difficulty), we did not include these variables in our study, which focusses on data easily available early in the patient ED presentation [50] .

As ED visits and health care costs are increasing globally, it is of paramount importance to understand the components of ED resource utilization, particular in times of resource scarcity. In this large retrospective study at an interdisciplinary ED, the distribution of ED resource utilization was illustrated. The novel ED resource score developed has manifold potential uses, such as an instrument i) that allows leaders in emergency care to evaluate resource decisions and to estimate effects of organizational changes, ii) to calculate benchmarks of an ED in research and process optimisation, iii) to identify resource-intensive patients more rapidly and comprehensively than triage-category alone, iv) to develop cost-containment and qualityimprovement measures, and iv) that represents an easy and fast internal billing system analogous to the TISS in the intensive care unit.

Supporting information S1 Appendix. The patient management process in our ED. 

Global Burden of Disease Health Financing Collaborator Network. Past, present, and future of global health financing: a review of development assistance, government, out-of-pocket, and other private spending on health for 195 countries

Trends in the Contribution of Emergency Departments to the Provision of Hospital-Associated Health Care in the USA

National trends in emergency department occupancy

Cost effectiveness of treating primary care patients in accident and emergency: a comparison between general practitioners, senior house officers, and registrars

COVID-19 rapid guideline: critical care in adults

Emergency severity index triage system correlation with emergency department evaluation and management billing codes and total professional charges

NHAMCS Validation of Emergency Severity Index as an Indicator of Emergency Department Resource Utilization

Emergency department utilization by older adults: a descriptive study

Pattern of non-trauma emergency department resource utilization in older adults: An 8-year experience in Taiwan

Distribution and predictors of emergency department charges: the case of a tertiary hospital in Lebanon

Distribution of emergency department costs

The impact of age and gender on resource utilization and profitability in ED patients seen and released

Two-step predictive model for early detection of emergency department patients with prolonged stay and its management implications

Comparative emergency department resource utilisation across age groups

Resource utilization and health care charges associated with the most frequent ED users

The Emergency Severity Index (version 3) 5-level triage system scores predict ED resource consumption

Volume-Related Differences in Emergency Department Performance

Therapeutic intervention scoring system: a method for quantitative comparison of patient care

Retrospective evaluation of the simplified Therapeutic Intervention Scoring System (TISS-28) in a surgical intensive care unit

Serial measurement of Therapeutic Intervention Scoring System-28 (TISS-28) in a surgical intensive care unit

The utilities of the therapeutic intervention scoring system (TISS-28)

Kostenanalyse und Prognoseabschä tzung internistischer Intensivpatienten mittels des

Evaluation of an interdisciplinary data set for national intensive care unit assessment

Sedation and weaning from mechanical ventilation: effects of process optimization outside a clinical trial

Quantifying emergency department crowding: comparison between two scores

The Emergency Department Occupancy Rate: A Simple Measure of Emergency Department Crowding?

Development and Validation of a New Index to Measure Emergency Department Crowding

A conceptual model of emergency department crowding

A comprehensive set of coded chief complaints for the emergency department

The association between vital signs and mortality in a retrospective cohort study of an unselected emergency department population

Reliability of the revised Swiss Emergency Triage Scale: a computer simulation study

Emergency triage: Manchester triage group

A new method of classifying prognostic comorbidity in longitudinal studies: development and validation

WHO Collaborating Centre for Drug Statistics Methodology. ATC/DDD index

Linear regression models with logarithmic transformations

A comparison of several regression models for analysing cost of CABG surgery

Development and Validation of a Score for Adjusting Health Care Costs in General Practice

Clinical and Economic Factors Associated with Ambulance Use to the Emergency Department

How well do General EMS 911 dispatch protocols predict ED resource utilization for pediatric patients?

Adverse Drug Reactions in a Tertiary Care Emergency Medicine Ward-Prevalence, Preventability and Reporting

Healthcare costs and utilization associated with high-risk prescription opioid use: a retrospective cohort study

Resource consumption of multi-substance users in the emergency room: A neglected patient group

Advanced diagnostic imaging utilization during emergency department visits in the United States: A predictive modeling study for emergency department triage

Health at a Glance

Interprofessional and interdisciplinary simulation-based training leads to safe sedation procedures in the emergency department

Triage to Observation: A Quality Improvement Initiative for Chest Pain Patients Presenting to the Emergency Department

Emergency department use of persons with comorbid psychiatric and substance abuse disorders

What determines diagnostic resource consumption in emergency medicine: patients, physicians or context?

We acknowledge the following people's support in selecting the procedural codes and data extraction: Sebastian Becker, Martina Siffert, Kathrin Dopke, Smilijana Balli, Sabine Schuh, Gert Krummrey, Michael Gygax, and Jolanta Klukowska-Röetzler.