key: cord-0044797-priu9xys authors: Guevara, Juan Antonio; Gómez, Daniel; Robles, José Manuel; Montero, Javier title: Measuring Polarization: A Fuzzy Set Theoretical Approach date: 2020-05-15 journal: Information Processing and Management of Uncertainty in Knowledge-Based Systems DOI: 10.1007/978-3-030-50143-3_40 sha: 49086cf074b384c5189ac868a51aaa6a64dfb3da doc_id: 44797 cord_uid: priu9xys The measurement of polarization has been studied over the last thirty years. Despite the different applied approaches, since polarization concept is complex, we find a lack of consensus about how it should be measured. This paper proposes a new approach to the measurement of the polarization phenomenon based on fuzzy set. Fuzzy approach provides a new perspective whose elements admit degrees of membership. Since reality is not black and white, a polarization measure should include this key characteristic. For this purpose we analyze polarization metric properties and develop a new risk of polarization measure using aggregation operators and overlapping functions. We simulate a sample of [Formula: see text] cases across a 5-likert-scale with different distributions to test our measure. Other polarization measures were applied to compare situations where fuzzy set approach offers different results, where membership functions have proved to play an essential role in the measurement. Finally, we want to highlight the new and potential contribution of fuzzy set approach to the polarization measurement which opens a new field to research on. Polarization is one of the most studied concepts in social sciences, specially over the last few years due to the recent growth of polarization episodes in different scenarios. The concept of polarization has been studied in social sciences from different perspectives [1, 6, 14, [16] [17] [18] . As can be seen after a fast literature review there is not an universal and accepted measure. As a consequence, there is not a well-defined consensus in the literature about what is the true nature of polarization. Nevertheless, one of the most cited and used polarization measures was defined in the economics framework. Wolfson (1992) and Esteban and Ray (1994) among others, were some of the first authors in measuring polarization [5] [6] [7] 19] . These polarization measures are strongly linked to the concept of inequality. Since then, a growing number of diverse polarization measures has arisen, most of them based on the idea given in [6] and [7] , although there are others that have also had a significant impact [1, 4, 16, 17] . It is important to remark that in the classical definition of Esteban and Ray of 1994 (and any other polarization measure based on Esteban and Ray) concepts like identification, membership, alienation and at the end aggregation are included in respective formulas. Some of the previous concepts allow graduation and are vague in nature. For example, the way in which an individual feels identified with a group can be modeled by a fuzzy membership function. These functions represents the individual's membership degree in a given group. Focusing in the idea of Esteban and Ray in the bipolar case (i.e there are two extreme situations), in this paper we propose a new polarization measure expressed in terms of fuzzy membership functions. These functions are aggregated by adequate aggregation operators to obtain a final polarization score. Polarization literature is essentially divided in two main approaches. First, those measures which only admit the existence of two groups, where the maximum polarization values are found in those cases where the group size is equal. According to this point of view, polarization follows a bimodal distribution (e.g.: Reynal-Querol, 2001 [17] ). Otherwise, there are approaches which accept the presence of multiple groups. So that, those measures which take into account such diversity, are closer to terms like dispersion and variation. Since the more different values the more polarized is a population, the measure is moderated by the existence of two main groups with significant size. In this section, we focus our attention in measures based on diversity. Furthermore, we use the IOV index [2] as a reference measure in following sections because of its closeness to the concept of polarization. - Esteban and Ray (1994) : Being one of the first polarization measures proposed, in [6] it is defined the ER polarization measure. This measure was proposed because of the need of measuring the polarization concept, where inequality indices do not fit to this task. Esteban and Ray aimed to establish a difference between polarization and inequality proposing three main basics of a polarization measure. So that, must be: 1. a) high degree of homogeneity within groups. 2. b) high degree of heterogeneity between groups. 3. c) few number of groups with significant size. To assess this, given a population of N individuals that take values X along a given numeric variable, in [6] the measurement of polarization is based on the effective antagonism approach. This is also called the IA approach that contains two concepts: identification (I) and alienation (a). The first one, reflects the degree in which a given individual feels closeness with the group that he/she belongs to. Otherwise, a shows the absolute distance between two individuals in terms of income. Finally, the authors proposed the next polarization measure: Where identification (I) is a function which depends on π i group's relative size, alienation (a) reflects the absolute distance between the groups y i and y j . Regarding these two key aspects, effective antagonism is the product between I and a. It is worth mentioning that in the following years other authors have adapted ER measure (i.e. [4, 15] ). This model assume a symmetric alienation between individuals. Authors also established an asymmetric model in [6] . According to Eq. (1), the most used and simplified version of this formula (that we have denoted as P S here) are reformulated for those cases in which the only information available about the population N is the variable X = {Xu, u ∈ N } with its relative distribution: {(x 1 , π 1 ), . . . , (x n , π n )}. So that, the following assumptions are made: • The population N is partitioned into groups according to different values of X. An individual u ∈ N that takes the value x i belongs to the group y i = {u ∈ N X u = x i }. • The relative frequency of the group y i is denoted by π i . • The identification felt by one individual u to his/her group y i depend by the relative size of that group. In fact, we have that this value is I(u) = π α i . The value of α should be greater than 1 (see [6] ). • The value of δ((y i , y j )) that represents the discrepancy between these two groups (y i and y j ) is the absolute difference between the values that they takes in the variable X, (i.e δ(y i , y j ) = |x i − x j |). • The alienation function a is the identification function. • Finally, the function T is the product operator between the I and a. Taking this into account, previous expression is commonly used as follow: Let us recall again that the definition of Esteban and Ray of polarization (and of course its simplified version P S ) assumes certain hypothesis that it is necessary to remark. From now on, we will denote by C i , the group that is denoted as y i by Esteban and Rey. 1. The different values of income present at X determine how many K groups are. So that, given a set of responses X with a finite domain Individuals can be only assigned to one group, since the C is a partition of N . Also let us observe that |C l | = Nπ l . 3. Given a group C l , if we denote μ Cl (i) as the degree to which the individual i feels identification to the group C l , this value is assumed to be: Taking previous considerations into account, formula (2) can be viewed as where ) is the effective antagonism felt by person i to individual j that is not symmetric. The effective antagonism of two individuals is the aggregation T of two values: the identification of individual i with the group to which he/she belongs (μ Ci (i)) and the alienation a of the discrepancy of the groups to which individuals i and j belong δ(C i , C j ). Example 2. Let X = {1, 2, 1, 3, 3, 4, 5, 5} be a population of N = 8 individuals. Following the assumptions of Esteban and Ray we have 5 groups that are perfectly identified with those individuals that takes values in D X = {1, 2, 3, 4, 5}. So the relative frequency are π = ( 2 8 , 1 8 , 2 8 , 1 8 , 2 8 ). In order to obtain the final polarization score, we have to sum for each pair of relative frequencies the value T (I(i, ∈ C i ), a(δ(C i , C j ))). Now we are going to see how this expression performs starting with two individuals i, j. Let us assume that i = 1 and j = 7. Then their values x 1 and x 7 are 1 and 5 respectively. we have that the expression corresponding to the individuals 1 and 7 is If we chose α = 2 for a clearer example, we have that I 1,7 = 16 64 = 1 4 . -IOV Blair and Lacy. Ordinal index variation. The concept of polarization have been confusing frequently with variation. Variability, dispersion and variance are key concepts in Statistics, and they are main argument to describe both the distribution of random variables and to describe the observed values of a statistical variable. In the last context, according to [12] the measurement of dispersion is usually associated to continuous statistical variables. When the dispersion has to be measured in ordinal variables (like for example a Likert-scale) the common approach is to convert the ordinal estimation into a numerical one by assigning numerical values to each ordinal variable category. Afterwards it is then possible to use a classical dispersion measure. But some authors [3, 8, 9] have pointed out that this procedure can lead to misunderstanding and misinterpretation of the measurement results. Hence, some ordinal dispersion measures have been defined [3, 8, 9] to properly deal with ordinal statistical variables instead of forcing the use of classical measures (such as entropy, standard deviation, variance or quasivariance) that do take into account such ordinal characteristic. Although other measures could be alternatively used within our ordinal framework, in this paper we will focus on the ordinal dispersion measure defined by Berry and Mielke [2] , usually called as IOV. Given an ordinal variable with values X = {L 1 , . . . , L n } and a relative frequency vector f = (f 1 , . . . , f n ), the ordinal dispersion measure IOV is defined as: Fuzzy set were introduced by Zadeh in 1965 [20] , with the idea of sets with a continuum grades of membership, instead of the classical dual (yes/no) membership. Thus, as [13] remark in their work: Aggregation Operators (AO) are one of the hottest disciplines in information sciences. AO appears in a natural way when the soft information has to be aggregated. At the beginning, AO were defined to aggregate values from membership functions associated to fuzzy set (see [20] ). A key concept for the development of this paper is that of aggregation function. It is important to emphasize that previous definition can be extended into a more general framework allowing to deal with more general objects than values into [0, 1]. Given two degrees of membership x = μ A (c) and y = μ B (c) of an object c into classes A and B, an overlap function is supposed to yield the degree z up to which the object c belongs to the intersection of both classes. Particularly, an overlap function was defined in [10] as a particular type of bivariate aggregation function characterized by a set of commutative, natural boundary and monotonicity properties. These authors extended the bivariate aggregation function to a n-dimensional case. Grouping functions are supposed to yield the degree z up to which the combination (grouping) of the two classes A and B is supported, that is, the degree up to which either A or B (or both) hold. Overlap functions are particularly useful. Furthermore, their applicability can be extended to community detection problems [11] or even to edge detection methods in the field of computer vision. In this section we are focused on the case in which the only available information of a given population is a one-dimensional variable X. This variable X could be incomes (as it is assumed in ER approach) or even opinions. Now, let us assume that this variable X, presents two poles X A and X B . In this situation we will say that the variable X is bipolar or present two extreme values. Furthermore, we assume that the communication between individual for those extreme poles is broken, and thus, polarization does exist. The only information we need to assume for the measure here propose is that we are able to measure the identification (or membership or closeness) of each individual with both extreme values/poles. Let us denote by μ XA , μ XB the two membership degree functions that represent the membership degree. μ XA , μ XB : N −→ [0, 1] are functions and for each i ∈ N , μ XA (i) and μ XB (i) represent the membership degree of individual i to the classes of extreme opinion X A and extreme opinion X B respectively (Fig. 1) . For this bipolar case, in which we assume the existence of two radical/extreme or poles opinions and we don't have a-priori groups, we understand that polarization is associated when the following two situations appear: 1. a) A significant part of population is close to the pole X A . 2. b) A significant part of population is close to the pole X B . Also, as it happen with the ER case, we are going to assume that we are able to measure the discrepancy between these two poles or extreme situations by δ (X A , X B ) . Finally, the polarization measure that we propose here can be expressed as the sum of the aggregation of three important concepts and could be understood as the risk of polarization. Let us remark that polarization appears when two groups break their relationships and also their communication. We consider the risk of polarization between two individuals (e.g.: i, j) as the possibility of these two situations: -How individual i is close to the extreme position X A and j is close to the other pole X B . -How individual i is close to the extreme position X B and j is close to the other pole X A . So that, if we assume that polarization appears in the last two situations we propose: Here we propose the following case: μ A,B (i) = (μ A (i), μ B (i)) = (0.5, 0.5) and μ A,B (j) = (μ A (i), μ B (i)) = (0.5, 0.5). We have two individuals in the middle of the distribution. Then we have to aggregate by a grouping function the ϕ the results of two values: the degree to which i belong to A and j to B a = φ(μ XA (i), μ XB (j)) = φ(0.5, 0.5) = 0.5 and the degree to which i belong to B and j to A b = φ(μ XB (i), μ XA (j)) = φ(0.5, 0.5) = 0.5. Finally, we have ϕ(0.5, 0.5) = 0.5. Since this is a case with medium polarization. 3. Case 3. Individual i is close to pole A and j is also close to pole B. μ A,B (i) = (μ A (i), μ B (i)) = (1, 0) and μ A,B (j) = (μ A (j), μ B (j)) = (1, 0.5). We have two individuals close to the pole A. No polarization case. Then we have to aggregate by a grouping function the ϕ the results of two value: the degree to which i belong to A and j to B a = φ(μ A (i), μ B (j)) = φ(1, 0) = 0 and the degree to which i belong to B and j to A b = φ(μ B (i), μ A (j)) = φ(0, 1) = 0. Finally we have ϕ(0, 0) = 0. Since this is a case with low polarization. Remark 1. Also let us note that since φ is an aggregation function, any increment of the three component will increase the polarization values for a fixed i, j ∈ N . Remark 2. Those situations where a population X is partitioned into k groups, there will be as much groups as values are in the variable X (i.e. D X = {X 1 , . . . , X K }). The previous bi-polarization index will be So that, the difference with the other polarization index is the way in which I(i, j) are measured for each pair of the groups C i , C j . Let us analyze the case in which we have a population with N individuals that takes values on a discrete/ordinal variable X with domain D x = {1, 2, 3, 4, 5}. In order to build the JDJ polarization measure defined in the previous section, we need to chose the grouping, overlapping and membership functions that we are going to use. For simplicity, the grouping function that we have chosen is the Maximum aggregation operator. Furthermore, we are going to study two well-known overlapping functions: the minimum and the product. Finally we are going to analyze a triangular membership function μ T (see Fig. 2 ): It is possible to consider different triangular membership functions too. For example, we can reduce the triangular membership function domain if we want to force the μ 1 function to zero for those values in x greater than a as well as to force the μ 5 function to be zero for those values in x lower than b. For this experiment we have always considered ϕ(u, v) = Max{u, v} and φ(x, y, z) = Min{x, y, z} or φ(x, y, z) = xyz. We have also considered two options for JDJ polarization index denoted by JDJ Max−Min−T ri(a=3,b=3) and JDJ Max−P ro−T ri . In the following experiment, we reproduce a sample of N = 391315 cases and their different relative frequency distributions along a 5-Likert Scale with the same probability. Therefore, three polarization measures were applied and compared for each case: Esteban and Ray measure (ER), and the last two index mentioned above JDJ Max − P ro − T ri (JDJ P ro) and JDJ Max − Min − T ri(a = 3, b = 3) (JDJ MIN). Furthermore, an index of ordinal variance (IOV ) is applied. Thus, next table shows some descriptive statistics for the measures applied ( Table 1) . As the following histograms suggest (see Fig. 3 ), it is worth mentioning the opposite skewed between ER and JDJ P ro measures, finding lower ER values of polarization than JDJ P ro. In fact, this is a key aspect between both measures In Fig. 4 we show the relationship between each polarization measure and the IOV values grouped by deciles. We can see a natural tendency to find the higher polarization the higher IOV values. In fact, correlation between IOV and all polarization measures can be found in the figure below, where JDJ P ro shows the highest correlation value (0.87), JDJ MIN has a correlation value of 0.843 and ER shows the lower (0.78). Otherwise, we can see in ER measure a significant portion of medium values of polarization in the first decile of IOV , finding a lack of stability in this scenario. The concept of polarization is rich and complex and there is a need to find an approach which includes both metric and conceptual perspectives at the same time. According to this, for those cases where not all information are available in data (such as communication flow), we shall propose not to mean polarization itself but a risk of polarization for the bipolar case. In this work, we present a fuzzy set approach to measure the risk of bipolarization. Moreover, polarization has been understood as a synonym of variation. Regarding this, despite we find high correlation between ordinal variation and polarization values, we want to highlight that these small discrepancies make the difference. Otherwise, as another main proposal in this work, is to provide a new methodology on the measurement of polarization. As a main tool to this new point of view, fuzzy set provides the appropriate resources. In one hand, in daily life people does not only feel identified with one single group but to some others too. Although, this duality is not a strict dichotomy but a long spectrum of nuances. Reality is fuzzy itself. As an example, an individual can be a strong supporter of a given political party but being identified with some contrary party proposals as well. In other hand, from a metric building perspective, using aggregation operators and membership functions, fuzzy set approach allows to pursue this philosophy. The membership functions used in this work are just a general example to apply this methodology. Along the different 391315 populations for a 5 likert scale, we have seen how the membership function determines the model behaviour. Specially for both measures proposed here, whose different membership functions reflect different results. Other membership functions more adequate are up to being develop for being applied. Specifically, this key aspect has two main consequences: a) the frequency or bias to show high or low values of each polarization measure and b) those specific scenarios where high or low values should appear. It is important the equivalence between this membership functions and reality (e.g.: in those cases where individuals get clustered into two antagonistic groups, a given polarization measure should offer its highest values). To conclude, we suggest for some directions for future research. Regarding membership functions, we consider as an important task to research about which membership function is more adequate for a given scenario. Furthermore, to develop new polarization measure incorporating a multi-dimensional case with multiples features. Moreover, including more theoretical polarization concepts like communication flow is needed to build an adequate polarization measure. Measuring health polarization with self-assessed health data Indices of ordinal variation From the sage social science collections. Rights reserved Polarization: concepts, measurement, estimation On the measurement of polarization, Boston university, institute for economic development On the measurement of polarization Polarization and the decline of the middle class: Canada and the US mimeo Qualitative ordinal scales: the concept of ordinal range Ordanova: Analysis of ordinal variation ndimensional overlap functions A new modularity measure for fuzzy community detection problems based on overlap and grouping functions A novel ordered weighted averaging weight determination based on ordinal dispersion Computable aggregations Measuring political polarization: Twitter shows the two sides of venezuela Measuring social polarization with ordinal and categorical data The conceptualization and measurement of social polarization Ethnic and religious conflicts, political systems and growth Polarization orderings and new classes of polarization indices When inequalities diverge Fuzzy sets