key: cord-287546-0x294f8t authors: Lin, Feng; Muthuraman, Kumar; Lawley, Mark title: An optimal control theory approach to non-pharmaceutical interventions date: 2010-02-19 journal: BMC Infect Dis DOI: 10.1186/1471-2334-10-32 sha: doc_id: 287546 cord_uid: 0x294f8t BACKGROUND: Non-pharmaceutical interventions (NPI) are the first line of defense against pandemic influenza. These interventions dampen virus spread by reducing contact between infected and susceptible persons. Because they curtail essential societal activities, they must be applied judiciously. Optimal control theory is an approach for modeling and balancing competing objectives such as epidemic spread and NPI cost. METHODS: We apply optimal control on an epidemiologic compartmental model to develop triggers for NPI implementation. The objective is to minimize expected person-days lost from influenza related deaths and NPI implementations for the model. We perform a multivariate sensitivity analysis based on Latin Hypercube Sampling to study the effects of input parameters on the optimal control policy. Additional studies investigated the effects of departures from the modeling assumptions, including exponential terminal time and linear NPI implementation cost. RESULTS: An optimal policy is derived for the control model using a linear NPI implementation cost. Linear cost leads to a "bang-bang" policy in which NPIs are applied at maximum strength when certain state criteria are met. Multivariate sensitivity analyses are presented which indicate that NPI cost, death rate, and recovery rate are influential in determining the policy structure. Further death rate, basic reproductive number and recovery rate are the most influential in determining the expected cumulative death. When applying the NPI policy, the cumulative deaths under exponential and gamma terminal times are close, which implies that the outcome of applying the "bang-bang" policy is insensitive to the exponential assumption. Quadratic cost leads to a multi-level policy in which NPIs are applied at varying strength levels, again based on certain state criteria. Results indicate that linear cost leads to more costly implementation resulting in fewer deaths. CONCLUSIONS: The application of optimal control theory can provide valuable insight to developing effective control strategies for pandemic. Our findings highlight the importance of establishing a sensitive and timely surveillance system for pandemic preparedness. Emerging influenza is threatening the world with the next pandemic [1] . The current swine flu caused by a novel H1N1 virus has infected a documented 182,166 humans, killing 1,799 from April 2009 to August 2009 [2] . The World Health Organization (WHO) declared the outbreak to be a pandemic because of growing worldwide cases [3] . Currently, the severity of the outbreak is moderate as most people recover from infection without the need for medical care [4] . However, if the virus mutates and achieves the ability to cause severe illness, it will kill more people and overwhelm the health system. Vaccination is the most effective means of pandemic mitigation. Vaccine production is a complex multi-step process which involves development, manufacturing, and delivery processes and current levels of vaccine production capacity are inadequate. Thus many uncertainties exist in every step and effective vaccines are typically available well after the viral strain has emerged [5] [6] [7] [8] . For instance, vaccines against the H1N1 strain are still under development and will remain in short supply by November 2009 [9] . Current stockpiling of antiviral drugs will also be in short supply and their efficiency will be limited once a pandemic occurs [7, 8] . Public health systems need to be prepared for cases when effective pharmaceutical interventions are unavailable. Non-pharmaceutical interventions (NPIs) are necessary to delay and dampen the pandemic before pharmaceuticals become available [7] . Recommended NPIs include: (1) social distancing: school closure, workplace distancing, restricted public gathering and travel; (2) case containment measures: voluntary case isolation, voluntary quarantine of members of households with ill persons; and (3) infection control measures: hand hygiene, cough etiquette, and mask/respirator usage [1, 7] . NPIs were implemented during the 1918 pandemic and more recently during the severe acute respiratory syndrome (SARS) outbreak of 2003. Although research on these events confirms the importance of NPIs, suboptimal triggering during the 1918 pandemic rendered NPIs only moderately effective at reducing mortality [10] [11] [12] . During SARS, sheltering and quarantine were found to be effective [13, 14] , while border screening was not [6] . During the current H1N1 outbreak, infection control is recommended to prevent spread of the virus among humans. Public health authorities are developing action plans which may request social distancing actions depending on the severity of the outbreak [15] . Mathematical models are often used to study disease spread, with the Susceptible-Infectious-Recovered (SIR) model being preferred for diseases spread via droplet and aerosol. The SIR model has been used to study pandemic flu [11, 12, [16] [17] [18] [19] [20] [21] [22] [23] [24] [25] , seasonal flu [26] [27] [28] , SARS [13, [29] [30] [31] , and smallpox [32] [33] [34] [35] . These papers use SIR to simulate the disease outbreak and evaluate the effectiveness of selected control measures under various predefined scenarios. They do not provide optimal controls for initiating implementation, and thus we will not review them here. SIR literature most directly relevant to this work includes [36] [37] [38] [39] [40] [41] . These authors use the SIR model to study optimal controls, i.e., controls that minimize a prescribed objective function. Most show "bangbang" controllers to be optimal (in the sense of minimizing a specified objective function). These policies apply no control until the occurrence of a triggering event and then apply controls at maximum strength. Sethi derived optimal closed-form results for isolation and immunization policies [37, 38] using an SI model. With this model, the population is partitioned into two parts, susceptible and infectious. The control is to either isolate and vaccinate at a maximum rate or do nothing. Infectious individuals who recover become susceptible once again, and thus immunity due to infection and subsequent recovery are not considered. Clancy [36] studied the properties of optimal policies for isolation and immunization assuming that all infectious individuals can be immediately isolated and all susceptible individuals can be immediately immunized. The policy takes no action when the number of infectious is below an optimal threshold and immediately isolates and/or immunizes when the number exceeds the threshold. However, they can only obtain optimal policies when the state space is small. Morton and Wickwire [40] developed optimal control policies for immunization assuming an infinite pandemic terminal time. However their switching curve derivation has an error in the derivatives (Eqs. 7a and 7b of [40] ) and thus their results are unclear. Behncke [41] derived mathematical properties of optimal vaccination programs under the following assumptions: 1) the time when vaccine becomes available is known; 2) infectious individuals can be immediately and completely isolated; and 3) the time horizon of the pandemic is infinite. Overall, we think the underlying assumptions of currently published results are questionable. It is not the case that all infectious can be immediately identified and isolated. Further, planners do not know when vaccines will become available, and even when available, it is not true that mass prophylaxis is instantaneous. Finally, during a pandemic, people will die. The current models do not account for mortality, which could be significant for viral strains such as H5N1. In this work, we use an expanded SIR model to develop triggers for NPI implementation to minimize expected person-days lost resulting from influenza related deaths and NPI implementation. NPI policies are derived for a deterministic control model. Results are compared with the most relevant optimal control papers discussed above. Multivariate sensitivity analyses based on Latin Hypercube Sampling are performed to investigate the effects of input parameters on the control policy structure and the mean cumulative deaths. Additional studies investigate the effects of departures from the modeling assumptions, which include exponential terminal time and linear NPI implementation cost. In this section, we formulate an optimal control problem with an expanded epidemic model to compute NPI implementation strategy. To understand the following discussion, the reader is referred to Figure 1 , which illustrates the compartmental model, and to Table 1 , which provides a summary of notation. To construct the model, we make six assumptions: 1. At any time, t ≥ 0, the community is composed of S(t) susceptible, I(t) infectious, R(t) recovered, and D(t) deceased individuals. The population is closed, ignoring the demographic turnover or immigration, i.e. S(t) + I(t) + R(t) + D(t) = N. To make the analysis independent of population size, we normalize the model by letting s t . Thus, any community can be described by state variable x(t) = (s(t), i(t), r(t), d(t)). 2. The population is homogeneously mixed and people make contact at random. 3. People susceptible are able to get infected when they contact infectious people. Once infected, they move into the infectious compartment. People infected can either recover at a constant rate, g, or die at a constant rate, τ. People recovered are assumed to be immune within our study horizon. 4. NPI implementation is modeled by the decision variable u(t), where 0 ≤ u(t) ≤ b 0. Due to the complexity of the Eq. (5), the switching curve, ψ (x), has no closed form. To find ψ (x), we use an algorithm based on Dynamic Programming [44] , which requires discretization over time and space. The uniqueness and convergence of the solution is guaranteed by the viscosity solution concept developed in [44] . The optimal control, u*, is obtained by solving the HJB equation (Eq. (5)). Figure 2 shows u* for two infection rates, 0.4 and 0.6, given a recovery rate of 0.25 and a death rate of 0.05 (taken from [45] ). Person-days lost from NPI implementation, c, is set to 0.05 (5% of the cost of a single death). The maximum impact of NPIs on the infection rate is assumed to be a 20% reduction. Note that the basic reproductive number R 0 without any control is given by Figures 2(a) and 2(b) indicate when to trigger NPI implementation. When the system state falls in region Ω1, NPIs should be implemented at maximum strength; in contrast, NPIs should not be implemented when the state falls in Ω2. For example, in the influenza scenario of Figure 2 (a), NPIs should be implemented when 60% remains susceptible and 20% of the population is infected. However, if 50% remains susceptible and 10% is infected, it is better not to trigger the NPIs. We compare our policy against the most relevant optimal isolation policies derived in [37] . Figures 2(c) and 2(d) show these isolation policies under the different infection rates. The control either isolates at a maximum rate when the number of infectious exceeds a threshold or does nothing. For a pandemic with b = 0.6 and R 0 = 2.0, Figure 2 (d) tells us not to act until the percent infectious exceeds 50%; while Figure 2 (b) tells us to implement NPIs at an earlier stage of the outbreak, for example 99% susceptible and 1% infectious. We illustrate cases for which R 0 > 1, i.e., the uncontrolled infection spreads rather than dying out. Figures 3 (a) and 3(b) compare the epidemic curves with and without NPIs, starting from a state 99% susceptible and 1% infected. According to Figures 2(a) and 2(b) , the NPIs should be triggered at this state. In Figure 3(a) , NPI implementation not only reduces the total death by 62%, but also eliminates the peak of the outbreak. Overall, NPI implementation saves 50% of the average person-days lost. In Figure 3(b) , where a more severe pandemic is considered, the reduction in total deaths is 19% and NPI implementation reduces and delays the peak of outbreak, which allows additional time for vaccine development. Figures 3(c) and 3(d) compare the epidemic curves with and without NPIs starting from states that fall on the control thresholds of [37] shown in Figures 2(a) and 2(d) . The proportions of recovered and dead population were set to 0 because they could not be differentiated from infectious people in an SI model. It is still best to implement NPIs at these states but the impact is limited. We also computed control policies for systems assuming quadratic control cost instead of linear cost, i.e., the value function is written as , while the system dynamics still follow Eq. (1). Based on Pontryagin's Maximum Principle [42] , we can derive the Hamilton-Jacobi-Bellman (HJB) equation for the new problem: Eq. (8) is now a quadratic function of u, thus the optimal control will not be "bang-bang" control. The candidate control u* should satisfy: By solving Eq. (8), we obtained the NPI policies for systems assuming quadratic control cost shown in Figure 2 shows the optimal control policies for two infection rates, 0.4 and 0.6, given a recovery rate g = 0.25 and a death rate τ = 0.05. 2(a) presents the optimal NPI control for b = 0.4 and R 0 = 1.33. 2(b) presents the optimal NPI control for b = 0.6 and R 0 = 2.00. 2(c) presents the optimal isolation policy derived in [37] for b = 0.4 and R 0 = 1.33. (d) presents the optimal isolation policy derived in [37] for b = 0.6 and R 0 = 2.00. influenza characterized by b = 0.4 and R 0 = 1.33. Figure 4 (a) shows a multi-level policy in which NPIs are applied at varying strength levels based on certain state criteria. Note that "red" indicates > 80% NPI strength, "yellow" indicates 60 80% NPI strength, and so forth. The level of NPI policy decreases from 100% of maximum NPI level to 0% as system state traverses from the upper to the lower part and from the right corner to the interior region. The contour line at u* ≈ 50% of maximum impelmentation level is very similar in shape and location to the boundary between Ω1 and Ω2 in Figure 2 (a). As another demonstration, Figures 4(b) and 2(b) show the control policies under both control costs with influenza characterized by b = 0.6. The two boundaries between Ω1 and Ω2 in Figure 2 (b) resemble the contour lines u* ≈ 50% of maximum impelmentation level in Figure 4 (b). The two regions of high level of u* in the upper corner and lower right corner of Figure 4 (b) correspond to two control regions Ω1 in Figure 2 (b). In addition, Table 2 compares the means of the expected person-days lost per person due to death, D , and control intensity, u *, between the linear and quadratic models. The overall NPI strength of the linear model is higher than that of the quadratic model, while the expected person-days lost due to death is lower. The linear model tends to implement NPIs more intensely and save more lives while having a higher overall cost. A multivariate uncertainty and sensitivity analysis was performed to study the effects of input parameters on the control policy for the linear cost model. This analysis investigated the effects of five inputs (R 0 , g, τ, c, b) on a performance measure, ω, defined as the proportion of the control space to the total state space, i.e., . There is no well-defined performance measure to evaluate the NPI policy, especially when the policy is defined in a 2-dimensional state space. We Figure 3 Epidemic curves of infectious and dead population with and without NPI implementation. Figure 3 shows the impact of optimal control on pandemic severity, peak, and total deaths, when NPIs are triggered at different initial states. (a) compares the epidemic curves with and without NPIs, starting from a state 99% susceptible and 1% infected when b = 0.4. (b) compares the epidemic curves with and without NPIs, starting from a state 99% susceptible and 1% infected when b = 0.6. (c) compares the epidemic curves with and without NPIs, starting from a state 67% susceptible and 33% infected when b = 0.4. (d) compares the epidemic curves with and without NPIs, starting from a state 50% susceptible and 50% infected when b = 0.6. chose ω because it captures the overall intensiveness of NPI implementations. In addition, we investigated the effect of these parameters on the outcome of applying the control policy, defined as the mean cumulative death, d T . We simulated the SIRD system under the optimal policy starting from all state (s 0 , i 0 , r 0 , d 0 ), where s 0 > 80%, i 0 <20%, and d 0 = 0. The simulation was terminated at a randomly selected exponential terminal time, and we recorded and analyzed the cumulative number of deaths. The mean cumulative death was calculated by taking the average of cumulative deaths over all tested initial states. Table 3 summarizes the estimated probability distribution functions (PDFs) of five input parameters, assuming the input parameters are statistically independent. The PDFs of influenza transmission characteristics (R 0 , 1/g, and 1/τ) are estimated based on the 1918 pandemic [25] . Note that the infection rate b can be written as R 0 (g + τ). The effect of NPIs, b, was found to reduce the infection rate, b, by up to 30-50% in 1918 and in many cases the effect of NPIs was very limited [11] ; thus we assume the impact of NPI implementation, b, follows Uniform(0,50%). We are not able to find any empirical data on the cost of NPI, c. This value is a relative cost, which depends on decision makers' perceptions of saving lives versus maintenance of daily societal functions. In our analysis we let c take the value from 0 to 0.25 uniformly, which would imply that the cost of four sessions of maximal NPI implementation is equivalent to the cost of one death. We sampled ranges of the parameters 1000 times using Latin Hypercube Sampling (LHS) to generate 1000 scenarios [46] [47] [48] . Then we conducted multivariate uncertainty and sensitivity analysis to determine the uncertainty in the performance measure that was due to the uncertainty in estimating the input parameters. The descriptive statistics for ω and d T are given in Table 4 , which lists the mean, variance, median, minimum, and maximum of ω and d T . Figure 5 shows the empirical cumulative distribution functions (CDFs) of ω and d T obtained from 1000 LHS scenarios and Table 5 provides the partial rank correlation coefficients (PRCCs) for the performance measures and each parameter. The CDF of ω revealed a wide range of estimates due to the uncertainty in estimating the values of the five input parameters. Sixty percent of ω estimates are less than 2.3%, with a minimum of 0% and a maximum of 98.7%. For ω, the PRCCs are all statistically significant, i.e. p < 0.05. The cost of NPI implementation, c, the time when a death occurs after infection, 1/τ, and the time for an infectious person to recover, 1/g, are the most statistically influential (|PRCC| > 0. 5 ). An increase in c or 1/τ corresponds to a decrease in ω; while an increase in the infection period 1/g corresponds to an increase in ω. The CDF of d T shows that the mean of cumulative death is 14.25%, with a minimum of 0.63% and a maximum of 76.39%. For d T , the PRCCs are are all statistically significant, i.e. p < 0.05. The most statistically influential inputs are 1/τ, R 0 , and 1/g (|PRCC| > 0.5) while the other two parameters are lessinfluential. A decrease in 1/τ corresponds to an increase in d T ; while an increase in R 0 or 1/g corresponds to an increase in d T . To test the sensitivity of our control policy to the terminal time assumption, we simulated the disease propagation and studied the outcome of applying our NPI policy to settings with an exponential and a gamma terminal time. For each flu scenario specified in the sensitivity analysis, a corresponding NPI policy can be obtained. We randomly selected a value from Exponential(0.0056) and a value Gamma(3, 59.5) as the vaccine arrival time (or simulation terminal time). The sampling was repeated 20 times for each scenario. Then, we simulated the SIRD system starting from an initial state applying the corresponding NPI policy. The simulation was terminated at the sampled vaccine arrival times and the cumulative deaths were recorded. A total of 210 initial states were selected, where s 0 ≥ 80% and i 0 ≤ 20%, for a total of 210, 000 simulations. We studied the difference in cumulative deaths under these two vaccine arrival assumptions. Table 6 lists the descriptive statistics of percentage difference in cumulative deaths for the same initial states at two terminal times. Overall, the difference in cumulative deaths under exponential and gamma terminal times is small (mean = 3.49%). The distribution of difference in cumulative deaths is left-skewed, with 91.8% of these differences being less than 10%. There are a few cases where the cumulative deaths differ significantly (≥ 30%). These cases all started from initial states where only a small Table 5 lists the partial rank correlation coefficients (PRCCs) for the performance measure ω and d T . Table 6 lists the summary statistics of difference in cumulative deaths at exponential and gamma terminal time. proportion people are infectious, i.e., i0 ≤ 1%, and the difference between the selected gamma and exponential terminal time exceeds 60% of the maximum of these two. For example, in a case where i 0 = 1%, S 0 = 95%, gamma terminal time = 235 days and exponential terminal time = 55 days, the difference in cumulative death is 32.04%. Effect of NPI policies on the epidemic NPIs reduce and delay the spread of pandemic by moderating social contact between susceptible and infectious people. Because NPIs disrupt daily societal functions, it is important that they be implemented judiciously. This requires identifying effective initiating triggers, which is a challenging research task. Implementing NPIs will impede influenza spread; on the other hand, normal societal functions will be interrupted. The optimal control method takes both aspects into account and tries to find the best balance between them, given the decision makers relative weighting of the two. Based on Figures 2 and 3 , early implementation for moderate and severe pandemic is very important for NPIs to have impact on the outbreak and the impact is effective only if NPIs are implemented early. Late NPI implementation might still be optimal, but the impact is much less. For a severe pandemic, it is optimal to trigger NPIs at the beginning stage when susceptible population is large and infectious population is small. If we miss the beginning stage, it is not optimal to implement NPIs until the outbreak is significantly progressed. This is because once the pathogen achieves a certain level of infection, NPIs are not effective against it, and thus are not worth the cost. That is, the benefit of NPIs at a stage when the disease has progressed significantly is less than the cost of NPI implementation. This finding supports the CDC pandemic mitigation guidelines, which state that when the pandemic is Category 4 or 5, all NPIs are recommended for early implementation [7] . Furthermore, earlier NPI implementation reduces and delays the peak of the outbreak as illustrated Figures 3(a) and 3(b), which allows additional time for vaccine development. If a severe pandemic occurs, hospitals will experience an overwhelming influx of patients and need to operate at their surge capacities. Earlier NPI implementation can reduce the magnitude of infectious at the peak, which relieves some of the burden on hospitals and other health care infrastructures. In contrast, NPIs are not nearly as effective if disease has already spread into the community as the cases shown in Figures 3(c) and 3 (d). In both cases, NPIs are triggered after the peak of the outbreak, where hospitals might have already been operating at their surge capacities for a few weeks. Both cases start at states falling on the control thresholds recommended in Figures 2(c) and 2(d) [37] . This finding indicates that the additional complexity of our model is warranted when compared with the SI model used in [37] . Timely and sensitive surveillance systems are key to successful application of the optimal control method as knowledge of both the pathogen characteristics and the community state are assumed. The surveillance systems should be able to identify the virus quickly and provide accurate estimates for parameters which characterize the severity of an influenza. The effectiveness of the control policy depends on the accuracy of these estimates, which include infection rate b, death rate τ and recovery rate g. Once the control policy is computed, we also need to track the community state to determine if NPIs should be triggered. As early NPI implementation is found to be much more effective, we do not want to miss the beginning stage of the outbreak. Thus, the surveillance system should also estimate the community state, including the size of the infectious and susceptible populations. Our sensitivity analysis identified three important input parameters for determining the overall NPI intensity. The important parameters are the NPI cost, death rate, and recovery rate. For high NPI costs, it is not worthwhile implementing NPIs because the benefit is less than the cost. For higher death rates, the policy sacrifices daily societal functions to save lives. In contrast, when recovery rate is small, infected people recover more slowly and continue infecting susceptible people. Thus, more NPI implementation is required. These results suggest that an influenza virus with a high death rate and a small recovery rate requires early intensive NPI implementation, particularly when the community places a high value on avoiding death. Cumulative death was most affected by the death rate, the basic recovery number and the recovery rate. For higher death rates, a higher proportion of infected people will die. For higher basic reproductive number, more people will be infected, resulting in more deaths even when the death rate is smaller. For lower recovery rate, infected people recover at a slower rate, and thus more people will be infected. This suggests that an influenza virus with a high death rate, a high basic reproductive number and a small recovery rate is less affected by NPI implementation. NPI cost does not seem to affect the cumulative death. However, NPI cost was identified as the most influential (PRCC = -0.865) in determining the intensity of NPI implementation. Different communities have different perspectives of death versus disruption of daily societal functions. The range of c should be determined by decision makers after carefully evaluating the demographic, cultural, and economic characteristics of the community. As a performance measure, ω does not capture the complete structure of the control policy. It only captures the overall control intensity, but subtle differences between control policies, such as distribution and shape of Ω 1 in the state space, is missing. Policies that have different structure in the state space might have same ω value. Therefore, continued effort should be made in selecting more refined measures for the control policy performance. Linear v.s. quadratic cost function If the cost function is linear, the control policy is bangbang, which suggests implementing NPIs at the maximum strength or not implementing at all as shown in Figure 2 . If the cost function is nonlinear, for example the quadratic cases presented in Figure 4 , the control policy has multiple levels, which requires varying the NPI strengths as the system evolves from one state to another. It is easily shown from Eqs. 7 and 9 that if the linear model indicates NPI implementation for a state x, i.e., u* = b for state x, then the quadratic model also indicates some implementation in state x, i.e., u* > 0 for state x. But the inverse is not true. This property can be proved easily. If u* = b in the linear model, we have ψ(s, i) < 0, for all (s, i) Ω1 according to Eq. 7. So Together with Eq. 9, we have u* > 0 for these states in the quadratic model. Thus, a quadratic cost structure will require NPIs to be implemented in more states but with much lower intensity in those states. Overall, a linear cost structure leads to higher average NPI intensity than the quadratic cost. In the examples observed, the boundaries between control and non-control regions in linear model resemble the quadratic contour lines u* ≈ 50% of maximum implementation. Moreover, the linear cost model appears to place more weight on death, thus implementing more control and saving more lives as shown in Table 2 . In cases with quadratic cost structure, using a linear model might result in over-control which would not be marginally effective. However, quadratic cost introduces additional complexity in parameter estimation, computation, and policy interpretation. For example, we must determine how to implement NPIs at X% of maximum. This requires determining which NPIs will be implemented for each control level. The bang-bang policy, on the other hand, has only two levels, which is easier to understand and implement. Finally, it is not clear that a direct comparison between policies obtained under linear and qudratic cost structures is appropriate, because the value functions are defined differently. More research needs to be done to better define the NPI levels and interpret the policy if a non-linear cost function is chosen. We are currently not able to derive an optimal control policy for a general terminal time assumption. Although the exponential optimal policy will not be optimal for cases with general terminal time, results shown in Table 6 indicate that the expected cumulative deaths predicted by the exponential optimal policy will be close to those occurring in a more general terminal time case. This suggests that the impact of the optimal exponential policy on virus spread is not always sensitive to terminal time distribution. Although the exponential assumption might not be completely realistic, making this assumption allows us to obtain the NPI policy, which then seems to provide desirable impact for cases with nonexponential terminal times. Our model was limited in several ways. First, although HJB can be derived for models assuming general terminal time (e.g., gamma), so far the control policy can only be computed assuming exponential terminal time. Second, the present modeling framework does not capture uncertainty in parameter estimation, i.e. the model accuracy relies on accurate estimation of input parameters. In practice, collection of accurate data and estimation of input parameters from data can be challenging and time consuming. Third, the present modeling framework assumes equal effect of various NPIs in a homogeneously-mixed population, while different NPIs will have distinct impacts for disparate population groups. Finally, bang-bang control must be further refined since it is not clear that on/off implementation is realistic for larger communities. To better apply optimal control methods in disease control problems, continued efforts should be made to refine the present model and to better estimate the input parameters. To conclude, we have considered a problem of nonpharmaceutical intervention (NPI) implementation for pandemic control using optimal control theory to develop triggers that minimize expected person-days lost associated with infection related death and NPI implementation over an exponential time horizon. The best control strategy for the model depends on the transmission characteristics of the influenza virus, the state of the pandemic, and the cost and implementation levels of NPIs. We present the computed policies under different transmission characteristics, where it is optimal to activate all NPIs when the system state falls in the control region, Ω1. The optimal policy can be calculated for any combination of flu and cost parameters. We compare the impacts of NPIs triggered at different states, which supports the idea of early containment. For comparison, we present the NPI policies assuming quadratic control cost. The quadratic cost assumption introduces additional complexity into parameter estimation, computation and policy interpretation, thus more research needs to be done to better define the NPI levels and interpret the policy. We perform multivariate sensitivity analysis, which identifies important parameters that affect the intensity of control and the outcome of applying the policy. The findings highlight the importance of establishing a sensitive and timely surveillance system. Finally, we study the outcome of applying our NPI policy under exponential and gamma terminal times, and find small difference in the cumulative death. Many uncertainties exist in estimating flu parameters, future research directions include developing a model that allows using stochastic rather than deterministic inputs and updates the control polices in real time. Since NPI implementation is not mandatory, compliance to NPI requirements is crucial for successful implementation. Community engagement, job security, and disruption of daily life affect compliance to NPI implementation [7] . Moreover, prolonged outbreak might result in compliance fatigue. Thus, in future work, we will integrate time-based compliance models into the system dynamics. Other important research directions include consideration of population heterogeneity, stochasticity and partial observability in disease outbreak, and developing methods for general terminal time distributions. World Health Organization (WHO): WHO strategic action plan for pandemic influenza Situation updates -Pandemic (H1N1) Current WHO phase of pandemic alert World now at the start of 2009 influenza pandemic Will vaccines be available for the next influenza pandemic Nonpharmaceutical interventions for pandemic influenza international measures Centers for Disease Control and Prevention: Intreim Pre-pandemic Planning Guidance: community strategy for pandemic influenza World Health Organization (WHO) Writing Group: Non-pharmaceutical interventions: their role in reducing transmission and spread Mitigation strategies for pandemic influenza in the United State The effect of public health measures on the 1918 influenza pandemic in U.S. cities Nonpharmaceutical influenza mitigation strategies, US communities, 1918-1920 pandemic Transmission dynamics of the etiological agent of SARS in Hong Kong: impact of public health intervention Prevention: Use of quarantine to prevent transmission of Severe Acute Respiratory Syndrome -Taiwan Novel H1N1 flu: CDC response Targeted social distancing design for pandemic influenza A 'smallworld-like' model for comparing interventions aimed at preventing and controlling influenza pandemics Comparative estimation of the reproduction number for pandemic influenza from daily case notification data Reducing the impact of the next influenza pandemic using household-based public health interventions Transmission dynamics of the great influenza pandemic of Containing pandemic influenza with antiviral agents Strategies for mitigating an influenza pandemic Containing pandemic influenza at the source Are we ready for pandemic influenza Transmissibility of 1918 pandemic influenza A Bayesian MCMC approach to study transmission of influenza: application to household longitudinal data Earn DJD: Dynamical resonance can account for seasonality of influenza epidemics Transmission of influenza: implications for control in health care settings Transmission dynamics of Severe Acute Respiratory Syndrome Danchin A: A double epidemic model for the SARS propagation Appropriate models for the management of infectious diseases Uncertainty in predictions of diseases spread and public health responses to bioterrorism and emerging diseases Emergency response to a smallpox attack: the case for mass vaccination Smallpox transmission and control: Spatial dynamics in Great Britain Poxy models and rash decisions Optimal intervention for epidemic models with general infection and removal rate functions Optimal control of some simple deterministic epidemic models Optimal quarantine programmes for controlling an epidemic spread Optimal immunization rules for an epidemic with recovery On the optimal control of a deterministic epidemic Optimal control of deterministic epidemics Dynamic Programming and Optimal Control Athena Scientific Introduction to Optimal Control Theory Springer Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Springer What is the best control strategy for multiple infectious disease outbreaks Sensitivity and uncertainty analysis of complex models of disease transmission: an HIV model, as an example Uncertainty and sensitivity analysis of the basic reproductive rate: tuberculosis as an example Modelling an outbreak of an emerging pathogen Pre-publication history The pre-publication history for this paper can be accessed here An optimal control theory approach to non-pharmaceutical interventions The authors thank the Indiana State Department of Health for supporting several pandemic planning projects that led to this research. The authors are also grateful to the editors and referees for very insightful and helpful comments. Authors' contributions LF conducted the research, including model design, acquisition of data, analysis and interpretation of data, and manuscript drafting. KM provided important guidance in model design and methods. He also revised the manuscript critically for important intellectual content. ML supervised the study. He had actively involved in model design and interpretation of data. He also revised the manuscript critically for important intellectual content. All the authors have given approval of the version to be published. The authors declare that they have no competing interests.