key: cord-0109436-59q3spkq authors: Niu, Xiang; Brissette, Christopher; Jiang, Chunheng; Gao, Jianxi; Korniss, Gyorgy; Szymanski, Boleslaw K. title: Heuristic assessment of the economic effects of pandemic control date: 2020-10-27 journal: nan DOI: nan sha: c0c31df71552f3323ac66f820d8abb1c1b877c3d doc_id: 109436 cord_uid: 59q3spkq Data-driven risk networks describe many complex system dynamics arising in fields such as epidemiology and ecology. They lack explicit dynamics and have multiple sources of cost, both of which are beyond the current scope of traditional control theory. We construct the global risk network by combining the consensus of experts from the World Economic Forum with risk activation data to define its topology and interactions. Many of these risks, including extreme weather, pose significant economic costs when active. We introduce a method for converting network interaction data into continuous dynamics to which we apply optimal control. We contribute the first method for constructing and controlling risk network dynamics based on empirically collected data. We identify seven risks commonly used by governments to control COVID-19 spread and show that many alternative driver risk sets exist with potentially lower cost of control. Network dynamics define a plethora of real world systems and describe the evolution of various spreading processes ranging from epidemiology to economic shocks. In recent years ideas from control theory have been adapted to network science with some success in understanding structural linear control of static networks [19, 48, 49, 28, 39] , temporal networks [15, 37, 32] , and multilayer networks [36] . Current work also focuses on networks with nonlinear dynamics [51, 7] . Comparatively little work studies the evolution and control of risk networks where active risks incur additional cost to the controller beyond the cost of the input signal [11] . A differentiating factor of risk networks in the context of control is that the activity of a single risk has the capability of activating others in a potentially catastrophic cascade that makes componentoriented analysis of individual risks inadequate for understanding their consequences. To fully understand the prevailing risks around us, we must understand the ways in which those risks interact and the ways those interactions evolve yielding risk dynamics. Despite a large body of literature on risk management and mitigation [42, 10, 46] , the fundamental questions of networked risk control are rarely discussed [11, 41] as they are beyond the state of the art in both control engineering and network science. Two problems facing the study of networked risk control are the need for explicit dynamics and optimizing over multiple cost types. The former arises from the fact most real-world dynamics are informally defined by data as opposed to the formal differential equations required for control theory. We address this problem by defining a stochastic process that transitions each risk among a finite set of states such as active, non-active, or recovering. Collectively these stochastic processes define our dynamics. In Figure 1 we show how activity in a subnetwork of the larger global risk network changes over time when nodes take a binary state and are allowed to be either active or inactive. Figure 1 : An example of continuous risk dynamics on a subnetwork from the World Economic Forum's Global Risk Network consisting of inflation, failure of climate change mitigation, interstate conflict, large scale migration, and cyberattacks. No control is applied and we can see that all nodes are inactive at the beginning of the simulation except for inflation. The activity from inflation can be seen to disperse over the network until all nodes are at a low level of activity at the end of the simulation. We adapt these states to represent a continuous dynamical analogue of the discrete dynamics in order to apply optimal control theory [43, 40, 16] . The equations we consider controlling take the following general form: where x i (k) is the expected value of risk i at time step k, F [ x(k)] and G[ x(k), E] are nonlinear functions depending on the endogenous and exogenous probabilities of activation for risks respectively, E is the adjacency matrix defining interactions between pairs of risks, and B u(k) defines our input control signals. Using the above continuous equation, we apply an altered version of the linear-quadratic regulator to account for multiple cost types and ensure optimal control. We apply these methods to the annually published global risk network from the World Economic Forum in order to obtain the dynamic global risk network and control it. The 2017 WEF global risk network can be seen in Figure 2 . Globalization has provided extensive quality of life improvements for billions of people worldwide, including increased life expectancy, poverty reduction, and far reaching medical advances. Also due to globalization, risks are now more connected through the avenues of technology, business, and individuals than ever. As both the global economy and the technology defining our interactions become more connected, they are also becoming more vulnerable [2, 11] . The annually reported global risk network from the World Economic Forum [11] currently represents the best understanding of the ways systemic risks are connected to each other. This network distills the immeasurably complex and constantly evolving network of global economic factors based on a consensus of expert opinions, and instead includes various transitions to catastrophic states such as unmanageable inflation [34] , climate change [20] , interstate conflict [14] , involuntary migration [24] , and large-scale cyber attacks [6] , a subnetwork of these risks can be seen in Figure 1 . While active, corresponding risks induce tremendous damages to resources, economies, and most importantly human lives. As examples consider the 2014 Ebola virus outbreak in Africa [35, 1, 9] and the 2008 financial meltdown triggered by a crisis in the subprime mortgage market [26, 38, 13, 5] . Neither the viral outbreak nor the financial meltdown were confined to where they erupted nor limited to initially triggered risks, but continued to grow and affect other risks, often causing enormous losses. An even more contemporary example of networked risk dynamics comes from the 2019 breakout of COVID-19. In response to the epidemic, nations around the world enacted a plethora of control measures to mitigate the virus's effects. While policies deviated between countries, control measures generally included the temporary closure of businesses, stimulus packages, and travel limitations. It is still unknown what the long term fallout of COVID-19 will be, and understanding the risks associated with the disease is going to be important in addressing long term effects. According to the Global Bank COVID-19 could lead to widespread school closings, increased dropout rates, and decreased development in human capital in Europe and Central Asia [4] . In South America, the Caribbean, and South Africa the Global Bank suspects social unrest may arise due to food shortages related to COVID-19 [4] . In addition to this analysis, the World Economic Forum also released a report on risks associated to COVID-19 based on the risks outlined in their yearly Global Risk Report [3] . They listed prolonged recession of the global economy, high levels of structural unemployment, tighter restriction Figure 2 : Incurred cost from optimal control for random samples of 7 driver nodes on the 2017 dynamic risk network with the "rapid and massive spread of infectious diseases" risk held constant at one. The network itself is dense and near regular with mean vertex degree of 18.27 and standard deviation of 4.60. We compare the 7 node costs with that of the nodal set consisting of deflation, failure of major financial institutions, unemployment, failure of national governance, failure of global governance, failure of urban planning, and profound social instability. These risks relate closely with observed government action in response to COVID-19. In the above network we have highlighted the nodes within the 2017 global risk network these drivers consist of by making them square. This driver set performs better than average by a reasonable margin, but we also see that many other driver sets performed better. on cross-border movement of people and goods, and economic collapse of emerging markets and developing economies as the most prevalent risks. The simplified abstraction of the dynamic global risk network [30] indicates connections between major risks that are prone to cascading failures. These risks are active or inactive and evolve as a Markov process depending on the network's current state. This poses a significant challenge to control theory, since applying theory from control analysis requires continuously defined dynamics for the risk variables. Therefore, we introduce a continuous dynamical model describing how risk activation propagates through the underlying network. We model the network activity dynamics with an adaptation of a stochastic process that is based on an alternating renewal process [8, 41, 50, 21] and is continuous. Instead of each risk transitioning to a discrete state indicating activity, we have the state of each node represent the expected value of risk i being active at time step k + 1, x i (k + 1) using the following model [41, 18, 29, 27, 30] . where B is the diagonal binary matrix representing the family of nodes being driven by the control signal are nonlinear dynamical functions depending on the state vector x(k). Here the probabilities p int , p ext , and p con represent the internal and external probabilities of activation, and the probability nodes retain their state, respectively. Each of these probabilities is calculated according to a maximum likelihood estimation as discussed in previous work [18] . The function G is additionally dependent on the underlying network defined by the possibly weighted adjacency matrix E. Since the individual states x i (k) at the given time k vary in meaning for different applications, so too do the signal costs, u i (k). For example in the case of a Lotka Volterra network an individual control signal u i (k) may represent additional population added or removed at time k, where the state x i (k) represents the population of a given species at that time. Alternatively in a mechanical system x i (k) may represent quantities such as velocity, or force of moving components, while u i (k) represents energy applied to the system. In the case of the Lotka Volterra network the nonlinear dynamics F [ x(k), p int , p con ] and G[ x(k), p ext , A] may instead represent the growth rate of a node's population based on its current population and its neighbor's populations respectively. Similarly, for a mechanical system the equations may represent the resistance of a component and the force being applied to it by other components respectively. We note that while this model is convenient and provides accurate risk activity estimates, real risk networks are constantly evolving. Risks can be added to the network as they arise and they may also be removed due to factors such as government and industries intervention. Consequently the underlying network changes and as such, the probabilities associated with each risk change to accommodate fluctuations in network interactions. This implies the risk network and its underlying dynamics should be regularly revisited and redefined. When applying control theory to nonlinear problems, we require a linearization of the underlying nonlinear dynamics. Assume that when uncontrolled, the system in equation (2) approaches a natural steady state x s . Also assume f x = F + G and A = ∂fx ∂ x | x= xs, u= us is the adjacency matrix defining the underlying probability of activation between links. Then we linearize (1) as follows. Here If the linearized system (3) is locally controllable along a specific trajectory then the associated non-linear system is controllable along the same trajectory. Therefore the linearized system is sufficient for several parts of control analysis including determination of driver nodes and determination of instanaeous optimal control. In traditional control, the control energy after τ time steps is expressed as a sum over our control signal at each time step given by J = τ −1 k=0 || u(k)|| 2 . J depends only on the control signal, whereas we require a cost function additionally depending on risk activity. For this purpose, we alter the cost function of the linear quadratic regulator to obtain the following control cost which includes the cost of active risks. Here Q f denotes the cost matrix at the final state, Q is the cost matrix for intermediate states, and R is the cost matrix for our control signals. Examining this equation we see that the right most term is a sum over the costs associated with the state of each risk and the control cost being applied to each risk. For our tests we assume all of these matrices to be the identity for simplicity. As such, we have expressed the cost of controlling our risk network in a form where we may apply an optimal control strategy to reduce the overall incurred cost. In the case of networked risks, system dynamics have a natural steady state we will refer to as x s . This is the state that the system will approach in the absence of a control signal. Because of this, when trying to drive the entire network towards an alternate state x * = x s it is necessary to continuously apply a control signal. Therefore, we introduce a distinction between reactive and proactive control. It is important to note that this is common in risk reduction literature [42] , however it lacks theoretical or heuristic tools for assessment. To motivate the need for heuristic cost estimates we examine the case of controlling the activity of COVID-19 within the 2017 dynamic risk network. In order to better understand the hidden costs associated with control measures related to COVID-19 we construct a set of seven control nodes within the 2017 risk network associated with observed government intervention and use optimal energy control to attempt driving the dynamic global risk network towards inactivity. The nodal set consists of deflation, failure of major financial institutions, unemployment, failure of national governance, failure of global governance, failure of urban planning, and profound social instability. The cost of control measures on this driver set is compared with the cost of controlling the network using seven randomly sampled control nodes. The results of this simulation are demonstrated in Figure 2 . We find that while the seven nodes chosen incur relatively low cost among the sample, there are many more efficient sets of control nodes one could pick. This suggests that the policy decisions made in response to COVID-19 were reasonable ones, but not optimal. It should be noted that the costs associated with each risk are taken to be unit while in reality they would likely vary and require expert opinion to deduce. Because the costs are all unit, this method is giving us a qualitative understanding of how topologically important our chosen control set is within the dynamic risk network. This highlights the combinatorial nature of finding optimal risk driver sets and the need for heuristic assessment tools in choosing them. Unfortunately such heuristics are not widespread and the current understanding of risk assessment is often limited to individual, or narrow groups of risks [47, 31, 12, 45, 22, 44, 33, 25, 23, 17 ]. We suggest two heuristics to help inform driver node choice when applying reactive and proactive control phases respectively on risk networks. Call N D the total number of driver nodes, N Da the number of driver nodes that are initially active, and N Dp the number of driver nodes that are among the most active at the system's natural steady state x s . In Figure 3 , we see how N Da affects both the control cost and total cost in the reactive control phase. For the reactive phase we see a strong negative relation between the control cost and the total cost. Once the system has been driven to inactivity, the dynamics will continue to evolve towards the natural steady state of the system x s . To combat this, we use proactive control in which we apply a control signal to our driver nodes based on their activation probabilities at the natural steady state x s . The cost of this control phase depends on N D just as the reactive phase did. We also find that the number of driver nodes with high activation probabilities at the natural steady state x s , N Dp has a drastic effect on the control Figure 3 : We show the relationships between the number of "high impact" nodes in our control set N Da and N Dp and the effects on costs incurred during the reactive and proactive control phases respectively. There were 12 total control nodes in all tests and for each associated N Da and N Dp 100 driver node sets were sampled. In the proactive phase the network was controlled for 50 time steps, and in the reactive phase the network was controlled for 500 time steps. We can see that control costs went up with an increase in N Da or N Dp in both the reactive and proactive control phases respectively. Alternatively we see the opposite trend in total costs. Total costs appear to decline far more with N Dp in the proactive phase than they do with N Da in the reactive phase. cost. In Figure 3 , we plot the control costs and total costs against each other for collections of driver nodes with different N Dp in the proactive control phase. We can see that the trends are broadly similar to those seen in the reactive phase with respect to N Da . We see that a high number of N Dp among our driver nodes generally reduces our total cost and increases our control cost. However, the control cost and total cost here have far smaller quartiles than in the reactive phase seen in Figure 3 . It should be noted that applying this control to real-world networks is not a trivial problem in and of itself. In the case of the Global Risk Network, the control signal must be designed by experts and may take the form of strategies such as enacting legal policy, investing, or quarantining infections. In practice, it may require iterations of design to force risks towards inactivity, and in that time, the underlying network and probabilities defining its dynamics may change. Despite this, knowing which set of risks forms an optimal set of drivers is valuable in its own right and can minimize control costs. Networked risks provide a theoretical foundation for defining complex interactions between factors that are consistently prone to cascading failures. To avoid the damages of inevitable steady states that arise from the interactions of these networks, we require an optimal method to them. The dynamics resulting from these networks are difficult to analytically define for use in control theory since they must be constructed from probabilities and extensive data collection. Our method presents a pipeline for constructing dynamic risk networks from extensive data and how to control them. This requires using a massive amount of collected data and applying maximum likelihood estimation in order to predict transition probabilities. Using these transition probabilities, we can construct continuous dynamics from the alternating renewal process [8] that defines the network's underlying discrete dynamics. In these new continuous dynamics, the state of each node represents its probability of activity over the current time step as opposed to the initially defined discrete dynamics. These continuous dynamics allow for the application of control methods for driving the system into inactivity. We adapt the linear quadratic regulator to account for risk networks in which control cost and risk activity cost are simultaneously considered. We also show that by altering the control strategy before and after driving the network to inactivity we can drastically reduce the total cost of controlling the system. The tools proposed in this paper are very general and widely applicable. It should be noted that a trade-off between proactive and reactive control arises not only in risk networks but in any system in which the desired final state of control is not stable. Most of the control designs for such systems make a salient assumption that the cost of the system being out of the desired final state is negligible. Certainly, there are other systems than risk networks, in which this assumption is not true. Our approach to control such systems in two phases, reactive and proactive, can be applied to such cases. Hence the usefulness of our approach reaches beyond risk networks. We first note that this model requires consistent reevaluation from experts. Both the connectivity and the weighting of the links in the dynamic risk network are subject to change as experts reevaluate and add new risks. Additionally the cost matrices used in our model are subject to change with expert evaluation as well. Furthermore, applying the linear quadratic regular as an explicit control method to the dynamic global risk network is difficult in practice. The control signal being added to nodes in our control set varies over many professional domains and would realistically require the fine tuning of many distinct policy decisions. For this reason, in many real world applications we suggest that this method be used as a heuristic for evaluating comparative costs between driver node sets as opposed to an explicit method for generating real-world control strategies. This study aims to develop a heuristic understanding of which nodes are optimal for controlling risk networks. We specifically study this on the dynamic global risk network derived from the World Economic Forum's global risk network. Our study takes random samples of driver nodes and simulates the networked dynamics while assess the control costs of forcing the network to inactivity. In the Cascading Alternating Renewal Processes (CARP) model, a node i has binary state x i (k) at each step k, either active (1), or inactive (0). In the global risk networks, an active node state represents a materialized risk. The model is Markovian, so at each time step, a node computes for each node its state for the next time step based on states of nodes at the current time step. There are three transitions: • Internal activation: an inactive node i is activated internally with probability p int i . • External activation: an inactive node i is activated externally by an active node j with probability p ext ji = p ext i . • Internal recovery: an active node i is inactivated internally with probability p rec i = 1 − p con i . The dynamics of CARP model is defined by the following transitions: where E ij ∈ {0, 1} and E ij is 1 if and only if edge (i, j) exists. It should be noted that both risks themselves and their probabilities of transitions between states constantly change; new risks arise and are added to the network, while existing active risks either continue to be a threat and remain in the network but with modified parameters, or, thanks to the response of threatened governments and industry, decline in importance and are removed. This evolution causes continuous changes in the global risks and their probabilities, and leads to the need for annual revisions of the list of risks present in the network and their parameters by the expert. However, if left unabated, the global risk network would approach the steady state, in which some risk will be active much more frequently making their threats much more pronounced than in the initial state. The The histograms in Figure 2 (B) and (C) come from simulations run on a random sample of 767 7-node driver sets driving the dynamic global risk network. In these experiments the node associated with the spread of infectious disease was held constant and the control method being used is optimal energy control. The subfigures in Figure 3 each come from a sample of 1200 driver node sets. Each driver set consists of 12 nodes. For subfigures (A) and (B) these 1200 diver node sets were divided into 12 groups of 100 random driver sets with each group having a consistent number of high activity driver nodes (N Dp ) ranging between 1 and 12 across the 12 groups. Subfigures (C) and (D) each consist of 1200 diver node sets were divided into 12 groups of 100 random driver sets with each group having a consistent number of initially active driver nodes (N Da ) ranging between 1 and 12 across the 12 groups. COVID-19 Risks Outlook A Preliminary Mapping and Its Implications Recession: The Global Economy in Crisis Complexity theory and financial regulation The economic impact of cyberattacks Realistic control of network dynamics The theory of stochastic processes Phylodynamic assessment of intervention strategies for the West African Ebola virus outbreak Global change: Put people at the centre of global risk management Globally networked risks and how to respond Water scarcity challenges to business Bank lending during the financial crisis of Explaining interstate conflict and war: What should be controlled for? Conflict Management and Peace Science The fundamental advantages of temporal networks Controllability and optimal control of a temporal boolean network Sexual medicine: online risks to health -the problem of counterfeit drugs Limits of risk predictability in a cascading alternating renewal process model Controllability of complex networks Prioritizing climate change adaptation needs for food security in 2030 Eugene) Stanley. Spontaneous recovery in dynamical networks Misrepresentation of the IPCC CO2 emission scenarios The (nano) entrepreneur's dilemma Climate change and involuntary migration: Implications for food security Four billion people facing severe water scarcity Financial regulation in a system context Carp model for multi-risk dynamics Controlling edge dynamics in complex networks Evolution of the global risk network mean-field stability point Evolution of threats in the global risk network IPCC reasons for concern regarding climate change risks Motifs in temporal networks High-resolution mapping of global surface water and its long-term changes Monetary reforms and inflation dynamics in Zimbabwe Ebola in West Africa: from disease outbreak to humanitarian crisis. The Lancet Infectious Diseases Controllability of multiplex, multi-time-scale networks Structural controllability of temporal networks Is the 2007 US sub-prime financial crisis so different? An international historical comparison Control profiles of complex networks An efficient sequential linear quadratic algorithm for solving nonlinear optimal control problems Failure dynamics of the global risk network Proactive and reactive approaches to risk regulation: the case of biotechnology Optimal feedback control as a theory of motor coordination What scale for water governance Wedge approach to water stress After Ebola in West Africa -unpredictable risks, preventable epidemics Global drivers of future river flood risk Spectrum of controlling and observing complex networks Network control principles predict neuron function in the Caenorhabditis elegans connectome Uncertain alternating renewal process and its application Structure-based control of complex networks with nonlinear dynamics