key: cord-0900080-ieosq23f authors: Radulescu, Constanta Zoie; Radulescu, Marius; Boncea, Radu title: A Multi-Criteria Decision Support and Application to the Evaluation of the Fourth Wave of COVID-19 Pandemic date: 2022-05-03 journal: Entropy (Basel) DOI: 10.3390/e24050642 sha: 256317e94c730f0f296ba470ffedda47f0709ddd doc_id: 900080 cord_uid: ieosq23f The COVID-19 pandemic caused important health and societal damage across the world in 2020–2022. Its study represents a tremendous challenge for the scientific community. The correct evaluation and analysis of the situation can lead to the elaboration of the most efficient strategies and policies to control and mitigate its propagation. The paper proposes a Multi-Criteria Decision Support (MCDS) based on the combination of three methods: the Group Analytic Hierarchy Process (GAHP), which is a subjective group weighting method; Extended Entropy Weighting Method (EEWM), which is an objective weighting method; and the COmplex PRoportional ASsessment (COPRAS), which is a multi-criteria method. The COPRAS uses the combined weights calculated by the GAHP and EEWM. The sum normalization (SN) is considered for COPRAS and EEWM. An extended entropy is proposed in EEWM. The MCDS is implemented for the development of a complex COVID-19 indicator called COVIND, which includes several countries’ COVID-19 indicators, over a fourth COVID-19 wave, for a group of European countries. Based on these indicators, a ranking of the countries is obtained. An analysis of the obtained rankings is realized by the variation of two parameters: a parameter that describes the combination of weights obtained with EEWM and GAHP and the parameter of extended entropy function. A correlation analysis between the new indicator and the general country indicators is performed. The MCDS provides policy makers with a decision support able to synthesize the available information on the fourth wave of the COVID-19 pandemic. The coronavirus SARS-CoV 2, the virus that generated COVID-19 disease, has been the main cause of important changes in people's lives since it was identified at the end of 2019. The COVID-19 has received pandemic status in March 2020, as it spread to all continents and all countries in a relative short period of time. Sustained efforts are being made to limit the spread of the virus and to support and allow health systems to cope with the situation. The evolution of the pandemic generated by the SARS-CoV 2 virus differs from continent to continent, from country to country and from the virus variants. This situation posed many challenges to European healthcare systems. Most governments have implemented restrictive, sometimes intrusive decisions to reduce the spread of SARS-CoV 2. The pandemic generated by the SARS-CoV 2 coronavirus is monitored, at the level of each country, every day, by several COVID-19 indicators. Under these conditions, the correct evaluation and analysis of the situation caused by the COVID-19 pandemic can lead to the elaboration of the more efficient strategies at the country level. An important contribution in the elaboration of European policies is the understanding of the situation generated by the coronavirus infection (COVID- 19) from several points of view. This may be achieved by calculating a complex indicator that takes healthcare sector [16] , and a SEIRD model (Susceptible, Exposed, Infective, Recovered and Deceased) for COVID-19 infection with a new parametrization that was proposed [17] . An analysis of the scientific literature reveals that the idea of using a complex indicator for the study of COVID-19 calculated by a multi-criteria method and a combination of weighting methods (EEWM and GAHP) is new. There are several articles in which the indicators taken into account are different depending on the situation approached. No weighting methods are considered or equal weights are used for the criteria. Some examples are presented in the following. The authors of [18] evaluated and analyzed the safety levels of 100 regions in the world in terms of COVID-19 using TOPSIS, VIKOR and COPRAS methods. The main criteria of quarantine efficiency, government efficiency of risk management, monitoring and detection, health readiness, regional resilience, and emergency preparedness are used in the evaluation of countries and regions. No weighting methods are used or a hybrid combination of methods is used. In [19] , the multi-criteria method TOPSIS is used to generate a ranking of countries based on health, society and work criteria that define three areas severely affected by the COVID-19. TOPSIS calculates a score that cumulates the considered criteria. No weighting methods are used in the paper. In the study by [20] , MCDM techniques such as Weighted Sum Model (WSM), Weighted Product Model (WPM), Weighted Aggregated Sum Product Assessment (WASPAS), and TOPSIS were used, and regions were listed according to control measures implemented to stop the spread of COVID-19. No weighting methods are used. In [21] , the authors computed an index of vulnerability at the state and district levels of India based on 15 indicators across the following five domains: socioeconomic, demographic, housing and hygiene, epidemiological, and health system. A percentile ranking method which is a simple method to compute both domain-specific and overall vulnerability is used. The equal weights were assigned to each indicator for calculating the domain vulnerability. The aim of the paper [22] is to generate an area-level COVID- 19 Pandemic Vulnerability Index (CPVI) and to assess its correlation with COVID-19 cases. Using factor analysis, four latent factors were identified and named as sociodemographic, medical conditions, transportation, and land use. No weighting methods are used in the paper. Paper [23] presents a comparison of the OECD countries' performance during the COVID-19 pandemic with the Global Health Security Index. No weighting methods were used for the criteria weights. The cumulative score involving all four variables of interest was equally weighted for each criterion. This was achieved by calculating the average rank for the cumulative score. In [24] , several factors that vary across geographies and can determine adverse effects on the National Health System during a pandemic, such as age, existing disease prevalence, medical resource availability, and deprivation are combined in order to obtain an indicator of community-level vulnerability that shows which areas are more exposed. The new indicator may help policy makers to mitigate the impact of similar pandemics. No weighting methods are used in the paper. In [25] , an indicator was developed, comprising appropriate components for assessing the level of wealth and "happiness" of all the Romanian counties. This indicator was used for approaching the entrepreneurial resilience during times of crisis caused by the COVID-19 pandemic in Romania in multiple manners according to its diverse forms. No weighting methods were used for the criteria. The indicator is calculated by summing the normalized indicators. In [26] , the correlation between tourism vulnerability and the COVID-19 pandemic was investigated. The authors proposed a vulnerability indicator for the tourism in Spain provinces. The multi-criteria method used is DEA, and the weighting method used is Principal Component Analysis. For the control and diagnosis of COVID-19 in the paper [27] , a spherical intelligent fuzzy decision model is proposed. This model is based on TOPSIS and COPRAS methods under a spherical fuzzy environment. A comprehensive review and an analysis of the multidisciplinary fields, carried out by different MCDM concerning COVID-19 in complex case studies, are provided in the paper [28] . In the paper [29] , for estimating and choosing the best alternative of health care waste treatment, the COPRAS method in a Pythagorean fuzzy set (PFS) is used. A new entropy measure on PFSs is proposed, and its validity is studied. The MCDS is based on the combination of GAHP, EEWM and COPRAS methods. The overall criteria weights are calculated as a linear combination of criteria weights obtained with the GAHP and EEWM. These weights are used in COPRAS. The weight associated to each criterion reflects the relative importance of the criterion. The determination of the weights can be performed by an expert (evaluator, decisionmaker) or by a group of experts (evaluators, decision-makers). A critical input to most multi-criteria methods is the assignment of criteria weights. These can be obtained by subjective, objective or a combination of weighting methods [30] . The determination of the subjective weights is based on the opinion and experience of the experts. In order to obtain judgments on the criteria, experts answer a set of questions about the criteria. Determining subjective weights is often time consuming and depends on the expertise of the specialists involved. Subjective weighting methods are based on the experts' preferences, while the emphasis of the objective methods is put on the statistical evaluation of data taken from the evaluation matrix. In cases when experts' opinions are difficult to obtain, one can use objective weights [31] . Each of these weighting methods has its advantages and disadvantages. The lack of experience, imprecise information, the limited capability of the expert for analyzing and correlating criteria may have a negative impact on the precision of the weights assigned to criteria. A disadvantage of the objective methods is that they do not benefit from the expert's experience. None of the two weightings methods, subjective and objective, are perfect, and the integrated weighting method might be the most appropriate for determining the criteria weights. A combination of a subjective weighting method and an objective weighting method would ensure the combination of the experience of experts who know the field well with the measurement of the existing uncertainty in the evaluation matrix. The combination is controlled by a parameter that ensures the level of subjectivity (objectivity) in the calculation of the weights of the criteria. Examples of objective weighting methods are the Entropy method [32] [33] [34] , CRITIC (Criteria Importance Through Intercriteria Correlation) [35] , and the Weighted Least-Square Method [36] . Example of subjective weighting methods are the Simple Multi-Attribute Rating Technique (SMART) [37] , Analytical Hierarchy Process (AHP) [38, 39] , Step-Wise Weight Assessment Ratio Analysis (SWARA) [40] , Weighted Aggregated Sum Product Assessment (WASPAS) [41] , and Best-Worst Method (BWM) [42] . A summary of criteria weighting methods is presented in [43] . One of the effective and appropriate subjective weighting methods for group decision making is GAHP. A group approach was chosen because the diversity of stakeholders can have direct effects on the quality of results as well as the decision-making procedure. The GAHP is a structured method for organizing and analyzing complex decisions. Group AHP is suitable when the number of criteria is not very large. The method was chosen because it has a sound mathematical foundation, has a Saaty evaluation scale for the evaluation in pairs of criteria, is systematic, concise and calculates a consistency ratio that ensures a correct comparison in pairs, without inconsistencies. The concept of information entropy was first introduced by Shannon [32] . Shannon and Weaver's [33] entropy is a measure of uncertainty in information theory that indicates the inherent contrast intensity of the corresponding criteria. It can measure the amount of useful information in the evaluation matrix. When the difference between criteria values is high, then the entropy is small. When a criterion provides more useful information, the value of the corresponding weight should be higher [44] . One of the popular objective weights methods for obtaining criteria weights is the entropy weighting method (EWM). The entropy and EWM method were used in various other problems. In [45] , EWM was used in the selection of an industrial robot for the arc welding operation. The TOPSIS method, combined with the EWM, was used to improve freight selection decisions [46] . In [47] , EWM was used for the selection of Femoral Component material for total knee replacement. The paper [48] introduced the EWM to develop a combination prediction model for the ionospheric F2 layer critical frequency. The weights for calculating a multivariate index of sustainable development are calculated with the EWM in [49] . A gray EWM and a gray relation-projection pursuit model was proposed in [50] to calculate the weights of criteria for soybean irrigation schedule in the Huaibei Plain. In [51] , EWM was used for providing collective information of the entropy weights methodology applied to different machining operations which compute the objective weights. A bibliometric analysis of EWM for multi-objective optimization in machining operations was made in [52] . The EWM is widely used compared to other objective weighting methods. The EEWM, proposed in this paper, uses an extended definition of entropy that is a generalization of Shannon entropy. There are several generalizations of Shannon entropy; see for example [53] . The most important generalized entropies are Rényi entropy [54] , Tsallis entropy [55] , Havrda and Charvát entropy [56] , and Kapur entropy [57] . The generalized entropies have played an important role in thermodynamic, statistical and informational systems. Let Renyi entropy [54] : Here, q = 1, q > 0. One can easily check that f 2 is concave if 0 < q < 1. Renyi entropy reduces to Shannon entropy as a limiting case when q → 1. Tsallis entropy [55] : Here, q = 1, q ≥ 0. Tsallis entropy reduces to Shannon entropy as a limiting case when q → 1. Kapur entropy [57] : Here, q = 1, q > 0, β > 0, q + β − 1 > 0. The above function reduces to Renyi entropy when β = 1. Further, it reduces to Shannon entropy when β = 1 and q → 1. In our study, we shall propose a generalization of Shannon entropy, which we shall call extended entropy. Note that f 5 is concave for a ∈ [0.5; 1]. The Shannon entropy is obtained for a = 1. We shall use the extended entropy in the classical entropy weighting method for finding objective weights. We shall call EEWM the resulting entropy weights method. A linear combination between GAHP and EEWM weights is proposed. The trade-off between the subjective involvement of experts and the objective evaluation in the final calculation of weights is controlled by the parameter µ ∈ [0, 1]. The advantages of using the parameter µ that controls the trade-off between the objective and the subjective weighting is that the decision maker can face various real-life situations. For example, If there are no experts to help in the evaluations, then the parameter will be chosen to be equal to zero. If there are some experts for the evaluations in which there is a little confidence, one can take the values of the parameter close to zero. If there are several experts for the evaluations in which there is great confidence, one can take the values of the parameter close to one or even equal to one. In MCDS, the COPRAS multi-criteria method is selected. Examples of multi-attribute methods frequently used in the practice are: SAW [34, 58] , TOPSIS [34] , VIKOR [59, 60] , COPRAS [6, 7] , AHP [38, 39] , PROMETHEE [61] and ELECTRE III [62] . The COmplex PRoportional ASsessment (COPRAS) method was introduced by Zavadskas, Kaklauskas, and Sarka in 1994 [6, 7] . In this method, the ranking of alternatives is performed using the value evaluation of maximizing and minimizing indexes. A comparative analysis of SAW and COPRAS was realized in [63] . A recent comparative analysis of TOPSIS, VIKOR and COPRAS was performed in [18] . The paper [64] presents a state-ofthe-art literature survey on COPRAS applications and methodologies. The COPRAS method is simple, logical, easy to understand for non-specialists in the field and provides a rational basis for decision making. Although it is a relatively new method, it has proven its effectiveness. However, the COPRAS method involves establishing weights associated with the selected criteria. It is based on an evaluation matrix (criteria alternatives) with quantitative values. In the COVID problem, the arrays of the evaluation matrix have numerical, concrete values given by the COVID-19 indicators for the fourth wave. The choice of the methods VIKOR and ELECTRE III involves the user's subjective contribution in setting parameters (the selection of threshold parameters). The subjective involvement of experts was preferred only in the case of calculating the criteria weights. The choice of the COPRAS method was based on the advantages of this method compared to other multi-attribute methods for the studied problem. One of these advantages is that EEWM and COPRAS use the same normalization method (sum normalization, SN) for the evaluation matrix. The use of different normalization methods, when a combination of methods is applied, may lead to disruption of the results. The input data in the GAHP method are: . . , C n }. A criterion C i from the set C is measured using a measure unit. They are two types of criteria: min criteria (those for which the decreasing values are better) and max criteria (those for which the increasing values are better). A weight can be calculated for each criterion. • α is the threshold for acceptance of inconsistency. In our study, we shall take α = 0.1. The input data in the EEWM are: Parameter a ∈ [0.5; 1] of the extended entropy function. The input data in the overall criteria weights are: • Parameter µ ∈ [0; 1] that shows the trade-off between subjective and objective weights. • GAHP weights and EEWM weights. The input data in the COPRAS are: C is the set of n criteria (same as in GAHP and EEWM). • Q is the normalized evaluation matrix alternatives criteria (same as in EEWM). • Overall criteria weights. MCDS has the following stages ( Figure 1 ): Each expert from the set E of p experts makes sets of pairwise comparisons between criteria from the criteria set C based on Saaty's 1-9 scale. For each expert Er from the set E of experts, a n x n pairwise comparison matrix = ( ) is obtained. We have (Table 1) . Equal Importance 3 Moderate Importance 5 Strong Importance 7 Very Strong Importance 9 Absolute Importance 2, 4, 6, 8 Intermediate values 1/2, ..., 1/9 Reciprocals of above Each expert from the set E of p experts makes sets of pairwise comparisons between criteria from the criteria set C based on Saaty's 1-9 scale. For each expert E r from the set E of experts, a n × n pairwise comparison matrix denotes the evaluation of pairwise comparison of the E r -th expert on the degree the criterion C i , which influences the criterion C j on the Saaty scale (Table 1) . The consistency ratio CR (E r ) for each matrix G (E r ) is calculated: where RI is the random consistency index obtained from Table 2 . then the expert E r must correct his pairwise comparison. The matrices G E r are aggregated. There are several methods to obtain a group aggregation [65] . The comparison matrix in pairs G = g ij of the group of experts E will be calculated as follows: The GAHP criteria weights are calculated in the proposed MCDS using the Dominant Eigenvalue (Power Method). The Dominant Eigenvalue algorithm used in MCDS is presented in the following: Step 1. The initial elements are defined: The initial eigenvector is defined: . . , n. The error tolerance ε = 0.000000001 and calculated error ERR = 10 is fixed. The initial scaled vector V (0) is defined: The initial normalized vector is defined: The initial iteration number k = 1. Step 2. The greatest eigenvalue and the corresponding eigenvector are calculated iteratively: While ERR > ε then: The approximative eigenvalue at iteration k, The error at iteration k, ERR k = End While If ERR k ≤ ε, then the approximation of the greatest eigenvalue is EIG (k−1) and the corresponding eigenvector (whose entries are the weights) is . Step 3. the GAHP criteria weights where: The weights have numerical values in the range (0,1) and ∑ n j=1 w (GAHP) j = 1. In order to have a valid comparison, the matrix Q must be normalized. Normalization methods usually map criteria with different measurement units to a common scale in the interval [0; 1]. The matrix Q is normalized with sum normalization (SN). The entries of normalized matrix Q = (q ij ) are calculated as follows: A value in the range [0.5; 1] for the parameter a is selected. Then, e j is calculated with the normalized extended entropy: Recall that for a = 1, the Shannon entropy is obtained. The arrays of the vector of criteria weights W (EEW M) = w (EEW M) j based on the entropy concept are calculated: , j = 1, 2, . . . , n The weights have numerical values in the range (0; 1) and n ∑ j=1 w (EEW M) j = 1. The set of overall criteria weights W = w j is obtained by a linear combination of GAHP criteria weights W (GAHP) = w (GAHP) j and entropy criteria weights The trade-off between the subjective involvement of experts and the objective evaluation in the final calculation of weights is controlled by a parameter µ ∈ [0; 1]. The value of the parameters can be set depending on the degree of trust in the experts' expertise. In the case where there are no evaluators or there is little confidence in the evaluators' expertise, the choice of µ is 0 or close to 0. In the case that there is great confidence in the evaluators' expertise, the choice of µ is close to 1. In the following, COPRAS solutions, and alternatives ranks are calculated. The weighted normalized matrix = Q = ( = q ij ) is calculated based on the normalized matrix Q = (q ij ), (cf. Equation (9)) and the weights vector W = w j (cf. Equation (12)) as follows: Let M 1 = j ∈ {1, 2, . . . , n} : C j is amaxcriterion . Let M 2 = j ∈ {1, 2, . . . , n} : C j is amincriterion . The Maximizing Indexes (for max criteria set M 1 ) A + = a + i and Minimizing Indexes (for min criteria set M 2 ) A − = a − i , i = 1, 2, . . . , m are calculated as: For each i = 1, 2, . . . , m, are calculated the Relative Significance Value, the vector P = (p i ) and the COPRAS solution S = (s i ): The best alternative is A i for which s i = max k s k . The vector of solution ranks is S = ( s i ). In the following, we shall apply the above-described MCDS to rank a group of European countries, in the context of the fourth wave of the SARS-CoV 2 pandemic based on COVIND indicators. The group of countries for which the analysis is conducted is considered as the set of alternatives. A set of COVID-19 indicators for the fourth wave is considered as the set of criteria. The COPRAS solutions are considered countries' COVIND indicators. The criteria (set C) in MCDS are: • The slope of the fourth COVID wave in 2021 (C 1 ). Here, by the slope, we understand the ratio between the number of new cases, in the period of time this number (we shall consider the smooth number) is increasing, and the number of days in the abovementioned period. One can easily see that a great slope is not desirable, since the hospitals have a limited capacity and cannot treat more patients than they can handle; • New cases smoothed/1 million inhabitants (C 2 ); • New deaths smoothed/1 million inhabitants (C 3 ); • Patients in intensive care units/1 million inhabitants (C 4 ); • New tests smoothed/1 million inhabitants (C 5 ). These criteria can be compared because they are calculated in relation to the population of a country (per 1 million inhabitants). There are two types of indicators: min indicators: C 1 , C 2 , C 3 , C 4 and max indicators: C 5 . The set of European countries was selected according to several conditions: • European countries with a population of more than 5 million; • Countries for which data were available for the all selected criteria; • Countries where there was an obvious COVID-19 fourth wave. [63] . From the remaining European countries were selected countries where there was an obvious COVID-19 fourth wave in the period considered. We preferred to choose a smaller number of countries to make it easier to highlight the proposed application of MCDS. Decision makers can apply the proposed MCDS for any set of countries for which an analysis is wanted and for any pandemic wave. In The set A 1 , A 2 , A 5 , A 6 , A 7 , A 10 and A 11 is a group of Western European countries. The set A 3 , A 4 , A 8 , A 9 and A 12 is a group of Eastern European countries. Each country from the set A was monitored by COVID-19 indicators in the fourth wave in 2021. The entries of the Q matrix are calculated taking into account existing information on the Internet. The fourth wave of COVID-19 happened differently in the European countries selected in the MCDS. In some countries, it started earlier than in others. The period is different; the slope corresponding to the period the number of new cases was increasing, was different and the peak of the wave was higher or lower. A situation of the number of smoothed daily new confirmed COVID-19 cases/1 million people, for the fourth wave, for the selected countries, is illustrated in Figure 2 . The entire period considered of fourth wave COVID-19, for these countries, is between 1 June 2021 and 28 December 2021. The fourth wave of COVID-19 happened differently in the European countries selected in the MCDS. In some countries, it started earlier than in others. The period is different; the slope corresponding to the period the number of new cases was increasing, was different and the peak of the wave was higher or lower. A situation of the number of smoothed daily new confirmed COVID-19 cases/1 million people, for the fourth wave, for the selected countries, is illustrated in Figure 2 . The entire period considered of fourth wave COVID-19, for these countries, is between 1 June 2021 and 28 December 2021. The entries of the Q matrix are displayed in Table 3 . For the calculation of the criteria weights, a group of four experts in the field is selected. Each of them will evaluate in pairs the criteria considered according to Saaty's scale and build four comparisons in pairs matrices G E 1 , G E 2 , G E 3 , G E 4 ( Table 4) . Each matrix is verified for consistency based on Equation (7) . All the matrices G E 1 , G E 2 , G E 3 , G E 4 are consistent. The CR E 1 = 0.086 for matrix G E 1 , CR E 2 = 0.035 for matrix G E 2 , CR E 3 = 0.098 for matrix G E 3 and CR E 4 = 0.085 for matrix G E 4 . are aggregated with the geometric mean method (Equation (8)), and the aggregated comparison in pairs matrix are presented in Table 5 . The GAHP criteria weights for each expert and aggregated criteria weights are calculated using the Dominant Eigenvalue algorithm (Section 3.4). The results are presented in Table 6 . The criteria weights calculated with EEWM (Equation (11) for different values of parameter a ∈ [0.5; 1] are presented in Table 7 . A comparison between the GAHP weights and EEWM weights for different values of a is displayed in Figure 3 . The objective nature of the EEWM shows a high value for the weight of criterion C5 compared to the weight of criterion C5 calculated with GAHP. The large value of the weight corresponding to criterion C5 calculated by EEWM is due to the fact that there is a great variability of data values for this criterion. For a = 1/2, the variability of the data values is smaller than that for a = 1 (Shannon entropy). The low value of the weight corresponding to C5 criterion calculated by GAHP is due to the subjectivity of the experts in evaluating the criteria. Experts considered that the criterion C5, new tests smoothed/1 million inhabitants, is less important than the other criteria. To make a compromise between the subjective involvement of experts and the objective evaluation, in the final calculation of weights, EEWM and GAHP are combined in The objective nature of the EEWM shows a high value for the weight of criterion C 5 compared to the weight of criterion C 5 calculated with GAHP. The large value of the weight corresponding to criterion C 5 calculated by EEWM is due to the fact that there is a great variability of data values for this criterion. For a = 1/2, the variability of the data values is smaller than that for a = 1 (Shannon entropy). The low value of the weight corresponding to C 5 criterion calculated by GAHP is due to the subjectivity of the experts in evaluating the criteria. Experts considered that the criterion C 5 , new tests smoothed/1 million inhabitants, is less important than the other criteria. To make a compromise between the subjective involvement of experts and the objective evaluation, in the final calculation of weights, EEWM and GAHP are combined in Equation (12) . The parameter µ controls the degree of subjectivity versus objectivity in calculating the weights of the criteria. The vector of overall criteria weights W is calculated with the EEWM and GAHP for different values of parameter µ and for a = 0.5 ( Table 8 ). The differences of criteria weights for variations of parameter µ are presented in Figure 4 . The variation of the criteria weights depends on the importance of the objective evaluation of matrix Q (in EEWM) compared to the subjective evaluation of experts (in GAHP). When the parameter µ = 0, the criteria weights are calculated only with the EEWM. The objective character in the calculation of the criteria weights is maximum. Then, by varying the parameter µ from 0.1 to 0.9, the objective character gradually decreases, and the subjective character gradually increases. For µ = 1, the criteria weights are calculated only with the GAHP method. The subjective character in the calculation of the criteria weights is maximum. The weights of criteria C 2 and C 3 vary less than weights of criteria C 1 , C 4 and C 5 . The largest variation is for the C 5 criterion. The variation of the criteria weights depends on the importance of the objective evaluation of matrix Q (in EEWM) compared to the subjective evaluation of experts (in GAHP). When the parameter µ = 0, the criteria weights are calculated only with the EEWM. The objective character in the calculation of the criteria weights is maximum. Then, by varying the parameter µ from 0.1 to 0.9, the objective character gradually decreases, and the subjective character gradually increases. For µ = 1, the criteria weights are calculated only with the GAHP method. The subjective character in the calculation of the criteria weights is maximum. The weights of criteria C2 and C3 vary less than weights of criteria C1, C4 and C5. The largest variation is for the C5 criterion. For the fourth COVID-19 wave, the COPRAS solutions are calculated. These solutions are considered countries' COVIND indicators. For each value of parameter µ, a criteria weights set is considered (Table 8 ). For each criteria weights set, the COPRAS method is applied. For the fourth COVID-19 wave, the COPRAS solutions are calculated. These solutions are considered countries' COVIND indicators. For each value of parameter µ, a criteria weights set is considered (Table 8 ). For each criteria weights set, the COPRAS method is applied. The vector S with COPRAS results for each criteria weights set is displayed in Table 9 (for the parameter a = 0.5). The The ranks of COPRAS results obtained with different criteria weights set are obtained based on Equations (13)-(17) ( Table 10 ). The Germany 9 8 8 8 8 8 8 6 6 6 6 Italy 2 2 2 2 2 2 2 2 1 1 1 Romania 12 12 12 12 12 12 12 11 11 11 11 Serbia 10 10 10 10 10 10 10 10 10 10 10 Slovakia 8 9 Countries from the group of Western European countries (µ = 0.8, µ = 0.9 and µ = 1) occupy the first positions, and countries from the group of Eastern Europe occupy the last positions. The same rank is observed, whatever the value of µ, for Serbia and France. As the degree of objectivity, in the calculation of the criteria weights, decreases, the countries' ranks change. For µ = 0.1, µ = 0.2, µ = 0.3, µ = 0.4 and µ = 0.5, there are no changes in countries ranks. The greater differences are for µ = 0.8, µ = 0.9 and µ = 1 when the subjective character in the criteria calculation is high. It is observed that great variations are from Germany and Czechia (three positions) and Austria and Spain (two positions) ( Figure 5 ). A comparison of the COPRAS ranks obtained with EWM (a = 1) and EEWM for ∈ 0.5; 0.6; 0.7; 0.8; 0.9 is presented in Table 11 . A comparison of the COPRAS ranks obtained with EWM (a = 1) and EEWM for a ∈ {0.5; 0.6; 0.7; 0.8; 0.9} is presented in Table 11 . A difference of one position is for Bulgaria, Slovakia, Spain and Serbia. The ranks of results obtained with VIKOR and TOPSIS multi-criteria methods for a ∈ {0.5; 0.6; 0.7; 0.8; 0.9; 1} are presented in Table 12 . By comparing the COPRAS with VIKOR and TOPSIS, it is observed that the smallest difference in rank change is between COPRAS and TOPSIS for EEWM with a = 0.5. A comparative analysis of the COVIND indicator ranks with general countries' indicators is realized based on Spearman correlations. The general countries indicators are: number of people fully vaccinated/per million (I 1 ), stringency index (I 2 ), population density (I 3 ), median age (I 4 ), aged 65 older (I 5 ) and GDP per capita (Gross Domestic Product per capita (per person)) (I 6 ). The Stringency Index is a composite measure based on nine metrics. The metrics used are: school closures; workplace closures; cancellation of public events; restrictions on public gatherings; closures of public transport; stay-at-home requirements; public information campaigns; restrictions on internal movements; and international travel controls [71] . The index is calculated as the mean score of these metrics, each taking a value between 0 and 100. A higher score indicates a stricter response to the SARS-CoV 2 pandemic [71] . The COVIND ranks obtained with criteria weights set for µ ∈ {0; 0.1; 0.2; 0.3; 0.4; 0.5; 0.6; 0.7; 0.8; 0.9; 1} and a = 0.5 are compared with the ranks for general indicators. The Spearman correlations are calculated (Table 14) . In all cases, the highest correlation is for I 6 -GDP per capita and then for I 1 -number of people fully vaccinated/per million. The values of these indicators and indicators ranks are presented in Table 13 . The paper proposes a multi-criteria decision support (MCDS) implemented to solve the problem of ranking a group of countries based on a new country COVID-19 complex indicator called COVIND in the COVID-19 fourth wave. The experts are selected by a manager or decision maker. The parameter that controls the trade-off between the subjective and objective weighting helps decision makers face various situations in which the confidence in experts' evaluations is essential. The value of parameter can be set by the decision maker or analyst depending on the degree of trust in the experts' expertise. Applying MCDS could lead to a better understanding of the factors involved in the COVID-19 pandemic on population health in a cumulative way. The information gained from this research can be used for support efforts and to justify public health spending. The decision makers can propose interventions and health policies based on scientific knowledge. This COVIND indicator can better reflect the situation of a country in a group of countries or on a continental level in a desired period of time or wave. Based on COVIND results, decision makers can make more informed decisions and set strategies and policies to combat the pandemic. MCDS can also be applied to other areas where it is necessary to rank the alternatives evaluated according to several criteria. The contributions of the paper can be summarized as follows: • A multi-criteria decision support (MCDS) based on EEWM, GAHP and COPRAS was proposed. • An extended method called EEWM for computing the objective weights of the criteria was proposed. This method extends the classical EWM method by using an entropy function, which generalizes the classical Shannon entropy function. The EEWM is used in combination with GAHP and COPRAS in the MCDS. In order to emphasize the compromise between the subjectivism of experts and the objectivism of evaluation matrix, a parameter was introduced. The parameter can be varied in the range [0; 1] to achieve the compromise between the two methods for determining the criteria weights. The proposed MCDS is applied for the calculation of a complex indicator COVIND for a group of European countries in the fourth wave COVID-19. An analysis of the obtained MCDS rankings was realized: • By the variation of the parameter that combines the EEWM and GAHP weights; • By the variation of the parameter of extended entropy; • By using alternative multi-criteria methods VIKOR and TOPSIS. A Spearman correlation analysis with general country indicators such as the number of people fully vaccinated/per million, stringency index, population density, median age, aged 65 older and GDP (Gross Domestic Product) per capita per capita is realized. By varying the two parameters (parameter a from the extended entropy function and parameter µ from the linear combination of weights), several ranking alternatives are obtained. They allow decision makers to analyze different evaluations of the fourth wave of COVID-19. An interesting development of our study in the spirit of the papers [72] is the approach of consensus issues in the evaluators group and the consideration of the situations when experts show their self-confidence levels by referring to consensus reaching for group decision making with multi-granular unbalanced linguistic information. A minimum adjustment optimization model based on bounded confidence may be developed. A novel extended EDAS in Minkowski Space (EDAS-M) method for evaluating autonomous vehicles M-generalied q-neutrosophic MULTIMOORA for Decision Making An extended TOPSIS approach for ranking cloud service providers. Stud. Inf Fundamentals of Decision Making and Priority Theory with the Analytic Hierarchy Process Ranking by eigenvector versus other methods in the analytic hierarchy process The new method of multicriteria complex proportional assessment of projects Determination of an efficient contractor by using the new method of multicriteria assessment A Multicriteria Group Decision-making Method Based on AIVIFSs, Z-numbers, and Trapezium Clouds Risk of the Brazilian health care system over 5572 municipalities to exceed health care capacity due to the 2019 novel coronavirus (COVID-19) Ozsahin, I. Comparative Evaluation of the Treatment of COVID-19 with Multicriteria Decision-Making Techniques Development of a Multi-Criteria Model for Sustainable Reorganization of a Healthcare System in an Emergency Situation Caused by the COVID-19 Pandemic Benchmarking methodology for selection of optimal COVID-19 diagnostic model based on entropy and TOPSIS methods The New York City COVID-19 spread in the 2020 spring: A study on the potential role of particulate using time series analysis and machine learning COVID-19 global risk: Expectation vs. reality The effect of COVID-19 pandemic on domestic tourism: A DEMATEL method analysis on quarantine decisions An integrated BWM-LBWA-CoCoSo framework for evaluation of healthcare sectors in Eastern Europe SEIRD COVID-19 formal characterization and model comparison validation Comparative analysis of TOPSIS, VIKOR and COPRAS methods for the COVID-19 Regional Safety Assessment European countries' vulnerability to COVID-19: Multicriteria decision-making techniques Country ranking of COVID 19 using MCDM methods A vulnerability index for the management of and response to the COVID-19 epidemic in India: An ecological study Supporting pandemic disease preparedness: Development of a composite index of area vulnerability The Global Health Security Index is not predictive of coronavirus pandemic responses among Organization for Economic Cooperation and Development countries Measuring geographical disparities in England at the time of COVID-19: Results using a composite indicator of population vulnerability Multidimensional Facets of Entrepreneurial Resilience during the COVID-19 Crisis through the Lens of the Wealthiest Romanian Counties Fernández-Fernández, M. COVID-19 and tourism vulnerability. Tourism Manag. Perspect. 2021 A new emergency response of spherical intelligent fuzzy decision process to diagnose of COVID19 Multi-criteria decision-making for coronavirus disease 2019 applications: A theoretical analysis review Pythagorean fuzzy entropy measure-based complex proportional assessment technique for solving multi-criteria healthcare waste treatment problem Computer-Supported Collaborative Decision-Making Imprecise Shannon's Entropy and Multi Attribute Decision Making A mathematical theory of communication The Mathematical Theory of Communication Multiple Attribute Decision Making: Methods and Applications Determining objective weights in multiple criteria problems: The CRITIC method A comparison of two methods for determining the weights of belonging to fuzzy sets How to use multi attribute utility measurement for social decision making A scaling method for priorities in hierarchical structures The Analytic Hierarchy Process Selection of rational dispute resolution method by applying new step wise weight assessment ratio analysis (SWARA) Optimization of Weighted Aggregated Sum Product Assessment Best-worst multi-criteria decision-making method Group decision support approach for cloud quality of service criteria weighting Entropy method for determination of weight of evaluating indicators in fuzzy synthetic evaluation for water quality assessment Selection of industrial arc welding robot with TOPSIS and Entropy MCDM techniques. Mater. Today-Proc. 2022 Freight transport and logistics evaluation using entropy technique integrated to TOPSIS algorithm. In Design Solutions for User-Centric Information Systems Revealing the benefits of entropy weights method for multi-objective optimization in machining operations: A critical review A combination prediction model of long-term ionospheric foF2 based on entropy weight method Use of entropy in developing SDG-based indices for assessing regional sustainable development: A provincial case study of China Decision-making of irrigation scheme for soybeans in the Huaibei plain based on grey entropy weight and grey relation-projection pursuit Multiple-Criteria Decision-Making and Sensitivity Analysis for Selection of Materials for Knee Implant Femoral Component Bibliometric analysis of entropy weights method for multi-objective optimization in machining operations On statistical properties of Jizba-Arimitsu hybrid entropy On measures of entropy and information Possible generalization of Boltzmann-Gibbs statistics Quantification method of classification processes: Concept of structural a-entropy Generalized entropy of order α and type β An approximate measure of value Multiobjective Optimization in River Basin Development The Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS Elaboration d'instruments d'aide à la décision. La méthode PROMETHEE. In L'aide à la Décision: Nature, Instruments et Perspectives d'Avenir Classement et choix en présence de points de vue multiples (la méthode ELECTRE) The comparative analysis of MCDA methods SAW and COPRAS Complex Proportional Assessment): State of the art research and its applications Aggregation of individual preference structures in AHP-group decision making. Group Decis. Negot COVID-19 Data Repository by the Center for Systems Science and Engineering World Health Organization (WHO) European Centre for Disease Prevention and Control (ECDC) Available online Available online A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker) Consensus reaching for group decision making with multi-granular unbalanced linguistic information: A bounded confidence and minimum adjustment-based approach Acknowledgments: We thank the reviewers for the constructive and insightful comments, which have helped us to substantially improve our manuscript. We thank the reviewers for the constructive and insightful comments, which have helped us to substantially improve our manuscript. The authors declare no conflict of interest. 12 12 12 12 12 12 12 12 12 12 12 12 Czechia 3 3 3 3 3 3 5 4 3 3 3 3 France 2 2 2 2 2 2 2 2 2 2 2 2 Germany 9 9 9 9 9 9 8 8 8 8 8 8