key: cord-0871495-bolspgvt
authors: Warsame, Abdihamid; Murray, Jillian; Gimma, Amy; Checchi, Francesco
title: The practice of evaluating epidemic response in humanitarian and low-income settings: a systematic review
date: 2020-11-03
journal: BMC Med
DOI: 10.1186/s12916-020-01767-8
sha: 1fe41335175211283c2831be7cbff69bf6698293
doc_id: 871495
cord_uid: bolspgvt

BACKGROUND: Epidemics of infectious disease occur frequently in low-income and humanitarian settings and pose a serious threat to populations. However, relatively little is known about responses to these epidemics. Robust evaluations can generate evidence on response efforts and inform future improvements. This systematic review aimed to (i) identify epidemics reported in low-income and crisis settings, (ii) determine the frequency with which evaluations of responses to these epidemics were conducted, (iii) describe the main typologies of evaluations undertaken and (iv) identify key gaps and strengths of recent evaluation practice. METHODS: Reported epidemics were extracted from the following sources: World Health Organization Disease Outbreak News (WHO DON), UNICEF Cholera platform, Reliefweb, PROMED and Global Incidence Map. A systematic review for evaluation reports was conducted using the MEDLINE, EMBASE, Global Health, Web of Science, WPRIM, Reliefweb, PDQ Evidence and CINAHL Plus databases, complemented by grey literature searches using Google and Google Scholar. Evaluation records were quality-scored and linked to epidemics based on time and place. The time period for the review was 2010–2019. RESULTS: A total of 429 epidemics were identified, primarily in sub-Saharan Africa, the Middle East and Central Asia. A total of 15,424 potential evaluations records were screened, 699 assessed for eligibility and 132 included for narrative synthesis. Only one tenth of epidemics had a corresponding response evaluation. Overall, there was wide variability in the quality, content as well as in the disease coverage of evaluation reports. CONCLUSION: The current state of evaluations of responses to these epidemics reveals large gaps in coverage and quality and bears important implications for health equity and accountability to affected populations. The limited availability of epidemic response evaluations prevents improvements to future public health response. The diversity of emphasis and methods of available evaluations limits comparison across responses and time. In order to improve future response and save lives, there is a pressing need to develop a standardized and practical approach as well as governance arrangements to ensure the systematic conduct of epidemic response evaluations in low-income and crisis settings.

Infectious disease epidemics continue to pose a substantial risk globally [1] . Epidemics routinely occur in lowincome and humanitarian settings [2] . Populations in these settings often do not have the resources to effectively respond to epidemics [3] and as a result are at higher risk of increased morbidity and mortality [4] . Globally, more than 700 million people live in lowincome countries [5] , while 2 billion live in fragile or conflict-affected settings [6] . Responses to large-scale epidemics or epidemics of newly emergent pathogens tend to generate global attention and corresponding responses incur scrutiny [7] [8] [9] . However, evidence on responses to smaller-scale epidemics or epidemics involving well-known pathogens (e.g. measles, cholera) for which effective control measures exist is thought to be limited [10] . Evidence from some limited contexts points to weaknesses in responses ranging from detection, investigation to effective and timely response [11, 12] . However, the practice of epidemic response evaluation has not been systematically assessed in low-income and humanitarian settings. Within public health programming, effective evaluations generate critical evidence and allow for systematic understanding, improvement and accountability of health action [13] . We sought to review the extent to which evaluations of epidemic responses are actually conducted in low-income and crisis settings and describe key patterns in evaluation practice. Specifically, we aimed to (i) identify epidemics reported in low-income and crisis settings, by aetiologic agent, over a recent period; (ii) determine the frequency with which evaluations of responses to these epidemics were conducted; (iii) describe the main typologies of evaluations undertaken; and (iv) identify key gaps and strengths of recent evaluation practice, so as to formulate recommendations.

This review (PROSPERO registration CRD42019150693) focuses on recent epidemics in low-income settings, defined using the 2018 World Bank criteria [14] , as well as epidemics occurring in settings with ongoing humanitarian responses, as reported in the United Nations Office for the Coordination of Humanitarian Affairs' annual Global Humanitarian Overview. Our search focused on epidemic-prone pathogens commonly occurring in low resource or humanitarian settings and which presented an immediate threat to life. For this reason, our search excluded HIV [15] , tuberculosis [16] and Zika [17] . Epidemics occurring within healthcare settings only or within animal populations were considered outside the scope of this review. In order to capture recent trends and assess contemporary reports, we focused on the period 2010-2019.

The following sources were reviewed in order to compile a list of reported epidemics: World Health Organization Disease Outbreak News (WHO DON) [18] , UNICEF Cholera platform [19] , Reliefweb [20] , PROMED [21] and Global Incidence Map [22] . In line with WHO guidance on infectious disease control in emergencies [23] , one suspected case of the following was considered to be an epidemic: acute haemorrhagic fevers (Ebola, Lassa fever, Rift valley fever, Crimean-Congo haemorrhagic fever), anthrax, cholera, measles, typhus, plague and polio. For the remainder of the pathogens, we defined an epidemic as an unusual increase in incidence relative to a previously established baseline in a given setting.

We reviewed WHO DON narrative reports to extract metadata on location (country), year, month and pathogen. Reliefweb was searched for reported epidemics using the search engine and the disaster type filter. For the PROMED database, only epidemics rated as 3 or higher in the 5-point rating system (which reflected a higher degree of certainty in the scale of the epidemic and its potential severity) and in which incident cases and deaths were reported were considered for inclusion. The Global Incident Map database was searched utilizing the inbuilt search function filtering results that were out of scope (wrong location, pathogen, etc.) at the source.

We collated all epidemic records into a single database and removed duplicate reports of the same epidemic based on first date and location of occurrence; duplicated included multiple reports within any given database (e.g. an update on an earlier reported epidemic) and reports of the same epidemic in multiple databases. As phylogenetic or spatio-temporal reconstructions of epidemics were mostly unavailable, we assumed that reports of the same pathogen from within the same country and 4-month period referred to the same single epidemic. We decided to split cross-border epidemics (e.g. the West Africa 2013-2016 Ebola epidemic) into one separate epidemic for each country affected, recognizing that responses would have differed considerably across these countries.

We compiled epidemic reports from various sources into one database. For each epidemic, information on location (country), year, month and pathogen was extracted using a standardized form (see Additional file 1). For reach evaluation record, information was extracted on a number of variables including type of evaluation, location (country), year, month and pathogen using a standardized form (see Additional file 2).

To determine the availability and quality of epidemic response evaluations within recent epidemics, we undertook a systematic review using PRISMA criteria including peer-reviewed and grey literature. We identified peer-reviewed reports by consulting the MEDLINE, EMBASE, Global Health, Web of Science, Western Pacific Region Index Medicus, PDQ Evidence and Cumulative Index to Nursing and Allied Health Literature (CINAHL) Plus databases. We utilized Google, Google Scholar and Reliefweb, to undertake a comprehensive search of the grey literature. Given previously described challenges in using such search engines [24] , we reviewed results from the first 150 hits only. We searched the webpages of major humanitarian and health organizations including the World Health Organization (WHO), United Nations Children's Fund (UNICEF), Save the Children, International Federation of Red Cross and Red Crescent Societies (IFRC) and Médecins Sans Frontières (MSF) for evaluation records and contacted these organizations to source non-public evaluations identified through this webpage search. Overarching conceptual search terms synonymous with outbreaks, evaluations and humanitarian crises were utilized. The full search strategy can be found in Additional file 3.

We cross-referenced the reported epidemics with the evaluation reports, matching on date (month and year) and location.

We limited our search to any record that met the following criteria: any document published in the period 2010-2019 in the English and French languages that examined epidemics within low-income countries and humanitarian settings, as defined above. There were no restrictions on study design.

We excluded records relying exclusively on mathematical models of potential responses as the review was focused on responses that were operationally implemented. We also excluded evaluations of a novel diagnostic or treatment; evaluations that focussed on preparedness, resilience or recovery from an epidemic, as opposed to the epidemic period itself; records addressing other health issues (e.g. reproductive health) in the context of an epidemic; epidemiological studies of the epidemic (e.g. transmission patterns, risk factors) that did not explore the response; records classified as clinical research, opinion or news pieces; and abstracts for which full records could not be accessed.

In assessing the eligibility of records for narrative synthesis, we used a broad definition of epidemic evaluation as one in which:

I. An epidemic was reported to have occurred II. The intervention(s) being evaluated began after the start of the epidemic and were specifically implemented in response to the epidemic III. The intervention(s) were assessed on at least one specified criterion (i.e. the report was not merely a description of activities).

After removing duplicates, two reviewers independently assessed the relevance of all titles and abstracts based on the inclusion criteria. We retrieved the full text of each article initially meeting the criteria. Two researchers then independently confirmed that fulltext records met inclusion criteria. Any disagreements were resolved through discussion and consensus with a third reviewer. We used the following definitions to classify the type of evaluations retrieved in this search:

Formative evaluation: Evaluation which assesses whether a program or program activity is feasible, appropriate and acceptable before it is fully implemented Process evaluation: Evaluation which determines whether program activities have been implemented as intended Output evaluation: Evaluation which assesses progress in short-term outputs resulting from program implementation Outcome/performance evaluation: Evaluation which assesses program effects in the target population by measuring the progress in the outcomes or outcome objectives that the program is meant to achieve Impact evaluation: An evaluation that considers 'positive and negative, primary and secondary long-term effects produced by a development intervention, directly or indirectly, intended or unintended.' [25] Analysis We undertook a narrative synthesis of the findings and tabulated key characteristics of evaluations. We created an evaluation quality checklist derived from existing standards to grade the quality of the evaluation records. Reference standards included the United Nations' Evaluation Group (UNEG) Quality Checklist [26] , the European Commission Quality Assessment for Final Evaluation Reports [27] and the UNICEF-Adapted UNEG Quality Checklist [28] . We derived 13 evaluation criteria grouped into 4 equally weighted categories: scope, methodology, findings and recommendations. The checklist can be found in Additional file 3.

The funder of the study had no role in study design, data collection, data analysis, data interpretation or writing of the report. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.

A total of 429 epidemics were identified across 40 lowincome and crisis affected countries during the study period ( Table 1 ). The most common pathogens reported were Vibrio cholerae, measles, poliovirus and Lassa virus.

Epidemics were reported primarily in sub-Saharan Africa, the Middle East and Central Asia. Generally, the more populous countries in each region experienced the highest number of epidemics including Nigeria and the Democratic Republic of Congo in the AFRO region and Pakistan and Sudan in the EMRO region.

A total of 15,124 records were identified and screened based on title and abstract (Fig. 1) . The full text of 699 records was assessed for eligibility. A final tally of 132 records was carried forward for cross referencing against reported epidemics and for narrative synthesis . See Additional file 2 for full list of included evaluations.

More than half of the evaluation records assessed outcome of the response, with a substantial number of Table 2 ). Very few evaluations could be classified as impact or formative evaluations while 4 studies were considered to be of mixed typology. Half of the evaluations reported (n = 66) utilizing a mix of primary and secondary data while approximately a quarter of evaluations utilized either mainly primary (n = 36) or secondary data (n = 30). Additionally, more than half of evaluations (n = 78) collected a mixture of quantitative and qualitative data while a smaller proportion relied on either qualitative data (n = 18) and quantitative data (n = 37). Few records (n = 9) had no explicit evaluation framework or criteria while the majority (n = 123) did refer to some evaluation criteria including the OECD evaluation criteria. However, only few (n = 10) presented an explicitly named framework which anchored the evaluation approach. Effectiveness was the most widely used evaluation criterion while the most widely evaluated activities included coordination, vaccination, contact tracing, case management and community sensitization. See Additional file 2 for full results.

There was an improvement in the availability of evaluation reports over time with fewer evaluations in the first 3 years of the decade (n = 10) compared to the last 3 years (n = 43) (Fig. 2) . Lastly, where evaluations were published, there was an average of 2 years between the onset of an epidemic and publication of the response evaluation.

Quality scores of evaluation reports ranged from 31 to 96 on a 100-point scale. The average quality score of . Additionally, there appeared to be an improvement in the quality of evaluation reports over time with reports in the first 3 years of the decade averaging a score of 64 compared to a score of 80 in the last 3 years. Although the majority of evaluations (n = 104) did identify and utilize existing information and documentation, few (n = 28) provided an appraisal of quality or reliability of these data sources. For the most part, evaluation studies did score well in presenting the rationale of the evaluation (average score = 0.88), providing the contextual information (average score 0.92) and clarifying the evaluation timeline (average score 0.82). They scored less well in providing sufficient detail on the methodological approach suitable to the scope (average score 0.77) as well as detailing limitations of the evaluation (average score 0.61).

We were able to link approximately 9% (n = 39) of epidemics with one or more response evaluations (Table 3) . Some evaluation reports (n = 18) covered responses in multiple countries. A large number of evaluations focused on the same epidemic; for example, 47 evaluations were undertaken to assess the West Africa Ebola epidemic (2013-2016). There were approximately equal numbers of post-epidemic (56%) and midepidemic evaluations (44%). The majority of epidemic response evaluations (87%) were undertaken in countries which had experienced humanitarian emergencies during the study period. Furthermore, 83% of response evaluations were undertaken in the WHO Africa region, 8% in the Eastern Mediterranean region and the remainder in the Americas region. Two evaluations could not be linked to an epidemic as the epidemic occurred outside of the study period (prior to 2010). Coverage of response evaluations varied by disease (Fig. 3) . Ebola epidemics had the highest coverage of response evaluations with 64% of reported epidemics having a response evaluation with Lassa fever epidemics having the lowest coverage (6%). No response evaluations were found for epidemics of anthrax, brucellosis, diphtheria, hepatitis E, Japanese encephalitis, malaria, Marburg haemorrhagic fever, Meningococcal disease and Rift Valley fever epidemics.

To our knowledge, this is the first study to systematically explore the coverage and characteristics of epidemic evaluations in low resource and humanitarian settings. The low proportion of epidemics with evidence of evaluations in settings with low resources and high needs suggests an inequity [3] requiring urgent addressing. The lack of evaluations also points to a deficit in the accountability to affected populations, a key principle in humanitarian response [161] . Without the availability of rigorous, high quality and standardized response evaluations, affected populations are unable to hold responders to account and have no recourse to redress [29] .

The 2-year delay between the onset of an epidemic and the publication of an evaluation report is a barrier to efficient dissemination of response findings. Reducing this delay can potentially be of use in addressing existing delays in global disease response [162] . More importantly, it represents a missed opportunity to enact changes in a timely manner. There was considerable variability in the criteria considered by the evaluations, including quality, coverage, efficiency, effectiveness, relevance, appropriateness, fidelity or adherence, acceptability and feasibility. Various combinations of these criteria were used to assess a large number of response activities. Within a given epidemic as well as across epidemics, individual evaluations utilized a wide array of differing assessment criteria and assessed response activities. This variability combined with a lack of an overarching evaluation framework makes it difficult to compare evaluations to the same response or generalize their conclusions. This finding is consistent with a previous study on the use of public health evaluation frameworks in emergencies [1] and underscores a need for an approach and corresponding toolset that standardizes the evaluation of epidemics in these settings. We have previously proposed an overarching framework for such a unifying approach [1] .

The term 'impact' was frequently found in the assessed evaluations, but very few of the assessed evaluations could be classified as impact evaluations, reflecting the relatively high technical and resource barriers required to conduct a robust impact evaluation. Furthermore, there were marked differences in the number of evaluations by disease pathogen. Whereas one would expect well-characterized diseases with frequent epidemics to have the most evaluations, the opposite was largely found. Approximately two thirds of the Ebola epidemics recorded had response evaluations compared to 8% of cholera epidemics and 5% of Lassa fever epidemics. This is despite the annual attributable deaths due to cholera being 120,000 [163] and Lassa fever 5000 [164] . This finding is in line with previous research suggesting that more severe epidemics or epidemics that threaten large numbers of people do not necessarily receive more timely response [162] . The overrepresentation of Ebola response evaluations is perhaps reflective of a number of factors such as the unprecedented scale and better resourcing of the response of the West African outbreak. Superficially, this overrepresentation could perhaps be due to the poor containment efforts at the outset of the epidemic leading to international spread and in turn generating higher international attention and scrutiny. However, the scale-up and securitization of the response and subsequent increased scrutiny may have also reflected the proximity of the epidemic to developed countries [165, 166] .

The gaps identified in this review are particularly pertinent to future evaluations of the COVID-19 pandemic which has reached most low-income and humanitarian settings [167] . Infectious disease epidemics have been known to exploit and exacerbate social inequalities within societies for some time [168, 169] . This review highlights the current global inequality in the response to these epidemics as gauged by the number of epidemics in low-income settings and the paucity of evaluation reports. This nonexistence or lack of publication of these critical evaluations prevents improvements to future public health response. The lack of uniformity of Fig. 3 Proportion of outbreaks evaluated for each disease. Asterisk indicates no evaluation reports were found for outbreaks of anthrax, brucellosis, diphtheria, hepatitis E, Japanese encephalitis, malaria, Marburg haemorrhagic fever, Meningococcal disease and Rift Valley fever available evaluations limits comparison of the findings across responses and across time, precluding tracking of whether epidemic responses do in fact improve over time, globally or at regional level. The quality limitations of some of the evaluations hinder the strength of inference and applicability of their findings. There is a need to overcome this limitation in order to enable future research to be conducted on the findings of response valuations. More specifically, future reviews of epidemic response should attempt to synthesize quantitative effects of response interventions and may benefit from SWiM guidelines where appropriate [170] .

Our study relied overwhelmingly on publicly available evaluations. It is possible that the disparity between the number of epidemics, their responses and their subsequent evaluations could be overstated as evaluation findings might simply be kept internal and not shared more widely. However, the effect is largely the same as internal evaluations are only of benefit to the commissioning organization and cannot be used more widely. Additionally, we assumed that all epidemics were responded to and therefore should have been evaluated. However, we did not know the true proportion of epidemics that were responded to and therefore could potentially overestimate the gap between evaluations and epidemics. On the other hand, the use of a 4-month decision rule to combine multiple reports of epidemics within the same country could have resulted in an underestimate of the total number of epidemics and thus an overestimate of evaluation coverage. We did not look at records that were not written in English or French and could potentially have missed some evaluations.

The relative paucity of evaluated epidemics, the disproportionate number of evaluations focusing on a limited number of epidemics together with constrained resource availability in low-income settings suggests the need for a governance arrangement or systematic mechanism that would trigger the conduct of evaluations, no matter what. The need for strengthening global governance mechanisms related to infectious disease epidemics and related challenges have been discussed [171, 172] . We suggest that arrangements should cover the criteria that should trigger an evaluation, the timing of evaluation, the composition and affiliation of the evaluation team, funding, minimum evaluation standards (e.g. a common scope and framework) and publication steps.

Approximately 2 billion people live in conflict-affected or fragile states and are at risk of increased morbidity and mortality due to epidemics every year. Robust epidemic response evaluations seek to improve response through critically assessing the performance of response interventions in a given context. However, evaluations of epidemic response are not a stand-alone activity but rather must be integrated into a cycle of preparedness and recovery in order to reach their full utility [173] . The lessons learned from an evaluation should concretely support all responders to better prepare for similar epidemic and to support health system recovery.

Supplementary information accompanies this paper at https://doi.org/10. 1186/s12916-020-01767-8.

Additional file 1. List of Epidemics.

Additional file 2. Evaluation Extraction Table. Additional file 3. Search Strategy & Evaluation Quality Checklist.

We would like to thank Ruwan Ratnayake and Imran Morhaso-Bello for their inputs.

This study was designed by AW and FC. The data collection and cleaning was undertaken by AW, JM and AG. The analysis was undertaken by AW. All authors contributed to writing of the first draft. All authors read and approved the final manuscript.

This work was supported by UK Research and Innovation as part of the Global Challenges Research Fund, grant number ES/P010873/.

All data generated or analysed during this study are included in this published article and its supplementary information files.

Ethics approval and consent to participate As this study relied on secondary data, no ethical approval was required.

Not applicable

Towards systematic evaluation of epidemic responses during humanitarian crises: A scoping review of existing public health evaluation frameworks

Health-care needs of people affected by conflict: future trends and changing frameworks

Global burden, distribution, and interventions for infectious diseases of poverty

Health inequalities and infectious disease epidemics: A challenge for global health security

World Bank. Population, total | Data

Global Humanitarian Overview 2019: United Nations Coordinated Support to People Affected by Disaster and Conflict

Harvard Global Health Institute. Global Monitoring of Disease Outbreak Preparedness: Preventing the Next Pandemic. Cambridge: Harvard University

Daily chart -Coronavirus research is being published at a furious pace | Graphic detail | The Economist. The Economist

Publications in PubMed on Ebola and the 2014 outbreak

Policy Debate | International Responses to Global Epidemics: Ebola and Beyond

Detection of infectious disease outbreaks in twentytwo fragile states, 2000-2010: A systematic review

Use of systematic epidemiological methods in outbreak investigations from India

Program Performance and Evaluation Office

World Bank Country and Lending Groups

The end of AIDS: HIV infection as a chronic disease

Tuberculosis: A global health problem

Fifth meeting of the Emergency Committee under the International Health Regulations (2005) regarding microcephaly, other neurological disorders and Zika virus

World Health Organization (WHO)

Global Incident Map Displaying Outbreaks Of All Varieties Of Diseases

Communicable disease control in emergencies: a field manual edited by

Gray literature: An important resource in systematic reviews

Development Results-An Overview of Results Measurement and Management

Detail of UNEG Quality Checklist for Evaluation Terms of Reference and Inception Reports

TAXUD QUALITY ASSESSMENT FORM Quality Assessment for Final Evaluation Report-Quality Assessment for Final Evaluation Report

UNICEF-Adapted UNEG Quality Checklist for Evaluation Terms of Reference

First Wave of the 2016-17 Cholera Outbreak in Hodeidah City, Yemen -Acf Experience and Lessons Learned

Evaluation of pot-chlorination of wells during a cholera outbreak

Emergency Health Unit After Action Review Madagascar

Detecting Ebola with limited laboratory access in the Democratic Republic of Congo: evaluation of a clinical passive surveillance reporting system

Use of a Nationwide Call Center for Ebola Response and Monitoring During a 3-Day House-to-House Campaign -Sierra Leone

Responding to a cVDPV1 outbreak in Ukraine: Implications, challenges and opportunities

Evaluation of Disasters Emergency Committee and Age International funded: Responding to the Ebola outbreak in Sierra Leone through age-inclusive community-led action

Yellow fever vaccination coverage following massive emergency immunization campaigns in rural Uganda

Cholera outbreak in districts around Lake Chilwa, Malawi: Lessons learned

Evaluating the use of cell phone messaging for community ebola syndromic surveillance in high risked settings in Southern Sierra Leone

Assessment of Environmental Contamination and Environmental Decontamination Practices within an Ebola Holding Unit

Measles Outbreak in South Africa: Epidemiology of Laboratory-Confirmed Measles Cases and Assessment of Intervention

Epidemiological characterization and key lessons learned for early detection and control

Real-time learning report on World Vision's response to the ebola virus in Sierra Leone | ALNAP

Challenges in Responding to the Ebola Epidemic -Four Rural Counties

MDRNG020 Nigeria Cholera Epidemic Operational Review

Evaluation of a National Call Center and a Local Alerts System for Detection of New Cases of Ebola Virus Disease -Guinea

An assessment of the emergency response among health workers involved in the 2010 cholera outbreak in northern Nigeria

Operational research during the Ebola emergency

Case study: Design and implementation of training for scientists deploying to ebola diagnostic field laboratories in Sierra Leone

Contact tracing performance during the ebola virus disease outbreak in kenema district

Offering general pediatric care during the hard times of the 2014 Ebola outbreak: Looking back at how many came and how well they fared at a Médecins Sans Frontières referral hospital in rural Sierra Leone

Evaluation of economic costs of a measles outbreak and outbreak response activities in Keffa Zone

The Haitian Health Cluster Experience: A comparative evaluation of the professional communication response to the 2010 earthquake and the subsequent cholera outbreak

Intensive education of health care workers improves the outcome of ebola virus disease: Lessons learned from the 2014 outbreak in Sierra Leone

Effectiveness of one dose of oral cholera vaccine in response to an outbreak: a case-cohort study

Ebola viral hemorrhagic disease outbreak in West Africa-lessons from Uganda

Contact tracing performance during the Ebola epidemic in Liberia

Enhancing laboratory capacity during Ebola virus disease (EVD) heightened surveillance in Liberia: lessons learned and recommendations

Evaluation of Ebola virus disease surveillance system in Tonkolili District

Leadership in Times of Crisis: The Example of Ebola Virus Disease in Liberia

Assessment of water, sanitation and hygiene interventions in response to an outbreak of typhoid fever in Neno District

Progress toward poliomyelitis eradication -Nigeria

Implementation of the first dedicated Ebola screening and isolation for maternity patients in Sierra Leone

Benin Floods, Cholera and Fire (MDRBJ 009, MDRBJ010 and MDRBJ011) DREF Review

Successful Control of Ebola Virus Disease: Analysis of Service Based Data from Rural Sierra Leone

Uganda: IFRC

Effectiveness of oral cholera vaccine in Haiti: 37-month follow-up

Feasibility of Mass Vaccination Campaign with Oral Cholera Vaccines in Response to an Outbreak in Guinea

Implementation of an alert and response system in Haiti during the early stage of the response to the Cholera Epidemic

Cholera in Pregnancy: Outcomes from a Specialized Cholera Treatment Unit for Pregnant Women in Léogâne

Cholera outbreak in Yemen: Timeliness of reporting and response in the national electronic disease early warning system

Community Event-Based Surveillance for Ebola Virus Disease in Sierra Leone: Implementation of a National-Level System During a Crisis

Public health at all levels in the recent Nigerian Ebola viral infection epidemic: Lessons for community, public and international health action and policy

Characteristics of wild polio virus outbreak investigation and response in Ethiopia in 2013-2014: implications for prevention of outbreaks due to importations

Evaluation of the USAID/OFDA Ebola Virus Disease Outbreak Response in West Prepared for

Evaluation of contact tracing activities during the Ebola virus disease outbreak in Guinea

Establishment of an ebola treatment unit and laboratory

Epidemiological and surveillance response to ebola virus disease outbreak in lofa county, liberia

Evaluating the frequency of operational research conducted during the 2014-2016 West Africa Ebola epidemic

Monitoring and Evaluating the Ebola Response Effort in Two Liberian Communities

Lessons learned during public health response to cholera epidemic in Haiti and the Dominican Republic

La Riposte à L'épidémie de Choléra de 2008 àCotonou (Bénin)

Noor al deen A, Qatinah A. A crisis within a crisis -evaluation of the UNICEF Level 3 response to the cholera epidemic in Yemen

Joint review of Ebola response -Uganda

The Role of the Polio Program Infrastructure in Response to Ebola Virus Disease Outbreak in Nigeria

Baseline evaluation of infection prevention and control (IPC) in the context of Ebola virus disease (EVD) in nine healthcare facilities in the city of Conakry

Evaluation of the USAID/OFDA Ebola Virus Disease Outbreak Response in West Africa

Designing and implementing an electronic dashboard for disease outbreaks response -Case study of the

Somalia Polio outbreak response dashboard

Implementing infection prevention and control capacity building strategies within the context of Ebola outbreak in a "Hard-to-Reach" area of Liberia

Global lessons from Nigeria's ebolavirus control strategy

Cross-border cholera outbreaks in Sub-Saharan Africa, the mystery behind the silent illness: What needs to be done?

An evaluation of WFP's L3 Response to the Ebola virus disease (EVD) crisis in West Africa Evaluation Report WFP Office of Evaluation

Using Mobile Health (mHealth) and Geospatial Mapping Technology in a Mass Campaign for Reactive Oral Cholera Vaccination in Rural Haiti

Evaluation of Sierra Leone Cholera Response 2012 Project Effectiveness Review Oxfam GB Global Humanitarian Indicator

Deployment of the 1st Area Medical Laboratory in a Split-Based Configuration During the Largest Ebola Outbreak in History

Assessment of the MSF triage system, separating patients into different wards pending ebola virus laboratory confirmation

Development and deployment of the OpenMRS-Ebola electronic health record system for an Ebola treatment center in Sierra Leone

I Cholera in Yemen: a case study of epidemic preparedness and response CHOLERA IN YEMEN: A CASE STUDY OF EPIDEMIC PREPAREDNESS AND RESPONSE

Adherence to Ebola-specific malaria case management guidelines at health facilities in Guinea during the West African Ebola epidemic

Report of the real time evaluation of Ebola control programs in Guinea

Evaluation of UNICEF's response to the Ebola outbreak in West Africa, 2014-2015 Evaluation database UNICEF

Effectiveness of reactive oral cholera vaccination in rural Haiti: A casecontrol study and bias-indicator analysis

Ebola virus disease contact tracing activities, lessons learned and best practices during the Duport Road

Evaluation of Save the Children's Community Care Centers in Dolo Town and Worhn

Evaluation Report Liberia YMCA Ebola Outbreak Emergency Response Learning for impact Humanitarian Response Executive Summary Acknowledgements from Liberia YMCA

External Evaluation of Plan International UK's Response to the Ebola Virus Outbreak in Sierra Leone ALNAP

The Oxfam Ebola Response in Liberia and Sierra Leone: An evaluation report for the Disasters Emergency Committee Oxfam Policy & Practice

Containing a Lassa fever epidemic in a resource-limited setting: Outbreak description and lessons learned from Abakaliki

Ebola Laboratory Response at the Eternal Love Winning Africa Campus

Stopping Ebola in its Tracks: A Community-Led Response

Rapid development and use of a nationwide training program for cholera management

CARE International DEC Ebola Emergency Response Project Final Evaluation Report

Evaluation of Polio Supplemental Immunization Activities in Kano, Katsina, and Zamfara States, Nigeria: Lessons in Progress | The Journal of Infectious Diseases | Oxford Academic

The timeliness of the US military response to the 2014 Ebola disaster: a critical review

Community-based social mobilization and communications strategies utilized in the 2014 West Africa Ebola outbreak

Responses to a public health emergency Second Report of Session

Evaluation of EHU/Save the Children Democratic Republic of Congo (DRC) Yellow Fever Mass Vaccination Campaign in Binza Ozone Health Zone, Kinshasa province (DRC)

Evaluation of ECDC Ebola deployment in Guinea Final report

Polio Outbreak Among Nomads in Chad: Outbreak Response and Lessons Learned

A practical communitybased response strategy to interrupt Ebola transmission in sierra Leone

Ebola haemorrhagic fever outbreak in Masindi District, Uganda: Outbreak description and lessons learned

Cost evaluation of a government-conducted oral cholera vaccination campaign -Haiti

Programme D'Intervention Pour Limiter Et Prevenir La Propagation De L'Epidemie Du Cholera En Republique Democratique Du Congo

Evaluation of Oxfam's humanitarian response to the West Africa Ebola crisis | Oxfam Policy & Practice

Evaluation of the USAID/OFDA Ebola Virus Disease Outbreak Response in West Africa 2014-2016 Objective 2: Effectiveness of Programmatic Components

Impact of engaging security personnel on access and polio immunization outcomes in security-inaccessible areas in Borno state

Final Evaluation Cholera Emergency Appeal in Haiti and the Dominican Republic

Strengthening Health Systems while Responding to a Health Crisis: Lessons Learned by a Nongovernmental Organization during the Ebola Virus Disease Epidemic in Sierra Leone

Improving burial practices and cemetery management during an Ebola virus disease epidemic -Sierra Leone

Contact Tracing during an Outbreak of Ebola Virus Disease in the Western Area Districts of Sierra Leone: Lessons for Future Ebola Outbreak Response

Nigerian response to the 2014 Ebola viral disease outbreak: lessons and cautions

Feasibility and acceptability of oral cholera vaccine mass vaccination campaign in response to an outbreak and floods in Malawi

North Kivu and Ituri

Épidémie de méningite : Évaluation de la surveillance et du traitement des cas dans les formations sanitaires d'un district du Burkina Faso

Control Strategies, and Lessons Learned in the CDC Response to the

Creating a National Specimen Referral System in Guinea: Lessons From Initial Development and Implementation. Front Public Heal

Visceral Leishmaniasis Outbreak in South Sudan 2009-2012: Epidemiological Assessment and Impact of a Multisectoral Response

Rapid response to ebola outbreaks in remote areas -Liberia

The cholera outbreak in Yemen: Lessons learned and way forward

Polio outbreak investigation and response in Somalia

Evaluation of the OCG Response to the Ebola Outbreak Lessons learned from the Freetown Ebola Treatment Unit, Sierra Leone Managed by the Vienna Evaluation Unit

Evaluating implementation of the Ebola response in Margibi County

The Mission to Stop Ebola: Lessons for UN Crisis Response

Evaluation Externe Réponse d'Urgence à L'Epidémie de Choléra en Haïti (ACF)

Assessment of community event-based surveillance for Ebola virus disease

Final Report: Evaluation of DEC Ebola Response Program Phase 1 and 2 DEC Emergency Response Program Implemented by CAFOD, Caritas, Street Child and Troacaire in Sierra Leone

Improving mapping for Ebola response through mobilising a local community with self-owned smartphones

A Real-Time Evaluation of ACF's response to cholera emergency in Juba, South Sudan | ALNAP

Electronic medical records in humanitarian emergencies -the development of an Ebola clinical information and patient management system

Evaluation of the Red Cross and Red Crescent contribution to the 2009 Africa polio outbreak response

The Ebola Outbreak of 2013-2014: An Assessment of U.S. Actions | The Heritage Foundation

Using evidence to inform response to the 2017 plague outbreak in Madagascar: A view from the WHO African Regional Office

Infection prevention and control training and capacity building during the Ebola epidemic in Guinea

The impact of active surveillance and health education on an Ebola virus disease cluster -Kono District

Accountability to Affected Populations (AAP) : A brief overview

Delays in global disease outbreak responses: Lessons from H1N1, Ebola, and Zika

Number of deaths due to cholera. Geneva: WHO

Ebola responses reinforce social inequalities | Africa at LSE: London School of Economics

The Social and Political Dimensions of the Ebola Response: Global Inequality, Climate Change, and Infectious Disease

Coronavirus Disease (COVID-19) Dashboard

Social Inequalities and Emerging Infectious Diseases

Health inequalities: A global perspective

Synthesis without meta-analysis (SWiM) in systematic reviews: Reporting guideline

The state of governance and coordination for health emergency preparedness and response-Background report commissioned by the Global Preparedness Monitoring Board

Governance Implications Of Global Infectious Disease Epidemics Under Shared Health Governance Scheme. Lessons From Sars. Public Heal Theses

A new twenty-first century science for effective epidemic response

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We declare no competing interests.Received: 12 June 2020 Accepted: 26 August 2020