key: cord-0968050-peppszqx authors: Ishola, David A.; Phin, Nick title: Could influenza transmission be reduced by restricting mass gatherings? Towards an evidence-based policy framework date: 2011-08-18 journal: J Epidemiol Glob Health DOI: 10.1016/j.jegh.2011.06.004 sha: 4b82f68e399d847ad6046fa8ccc13586ab2ed7b5 doc_id: 968050 cord_uid: peppszqx INTRODUCTION: Mass gatherings (MG) may provide ideal conditions for influenza transmission. The evidence for an association between MG and influenza transmission is reviewed to assess whether restricting MG may reduce transmission. METHODS: Major databases were searched (Pubmed, EMBASE, Scopus, CINAHL), producing 1706 articles that were sifted by title, abstract, and full-text. A narrative approach was adopted for data synthesis. RESULTS: Twenty-four papers met the inclusion criteria, covering MG of varying sizes and settings, and including 9 observational studies, 10 outbreak reports, 4 event reports, and a quasi-experimental study. There is some evidence that certain types of MG may be associated with increased risk of influenza transmission. MG may also “seed” new strains into an area, and may instigate community transmission in a pandemic. Restricting MGs, in combination with other social distancing interventions, may help reduce transmission, but it was not possible to identify conclusive evidence on the individual effect of MG restriction alone. Evidence suggests that event duration and crowdedness may be the key factors that determine the risk of influenza transmission, and possibly the type of venue (indoor/outdoor). CONCLUSION: These factors potentially represent a basis for a policy-making framework for MG restrictions in the event of a severe pandemic. It is well established that influenza is transmitted from person to person through close contact with an infected, symptomatic individual. The exact mechanisms by which transmission occurs are still unclear, but is believed to involve multiple routes, including respiratory droplets and direct/indirect contact [1] with secretions or fomites. Aerosol transmission may also occur, but controversy surrounds this [2] and some further evidence of aerosol transmission has recently been put forward [3] . This is an important issue as the mechanism of transmission is always a key factor in infection control planning. While uncertainty persists regarding aerosols, droplet and contact transmission remain largely regarded as the most important and likely routes. Transmission through these routes clearly requires physical nearness to infected persons, via either direct touch or the propulsion of large droplets across a relatively short distance. This requirement makes the consideration of mass gatherings a crucial issue. Whilst there is not a ''standard'' definition of what constitutes a mass gathering, there is an understanding that these are events that involve large numbers of people (suggested minimum of 1000 people) [4] [5] [6] congregating in finite geographical areas to share an event or experience. Individuals can be in very close proximity for variable periods of time and, if the event is over a number of days, may even share over-crowded and/or temporary accommodation. Therefore for those infectious diseases such as influenza, where close contact is the main determinant of transmission, it appears self-evident that mass gathering events could lead to the rapid transmission of a new causative agent. In the event of an influenza pandemic, minimizing transmission of influenza has been a priority for public health action. A variety of non-pharmaceutical public health interventions to reduce close contact between infected and susceptible individuals, or the opportunities for the virus to be picked up by susceptible people such as self-isolation of patients, respiratory etiquette and hand washing have been advocated. Banning or restricting mass gatherings has been seen as a logical extension of this policy, however, it is a particular concern of policy makers that the scientific evidence upon which to base guidance for mass gatherings is lacking. This is particularly important given the need to weigh any potential benefits against the economic and social disruption that banning or restricting mass gatherings could have on society. There have been other systematic reviews undertaken in recent years on the broader subject of non-pharmaceutical interventions aimed at reducing transmission of respiratory viral infections [7, 8] . These reviews considered a range of such interventions, and they explicitly recognized that there is a paucity of primary evidence regarding restriction of mass gatherings (and other ''social distancing'' measures); thus they did not primarily focus on this specific area. The aim of this review, therefore, was to attempt to reduce this evidence gap by assessing the available evidence base relating to the utility of restrictions on mass gatherings during an influenza pandemic. This is an important policy area not only because of the impact such restrictions could have on public confidence and morale, but also because of the economic and liability issues that such action might generate. The findings of the review may be able to help inform policy statements on the effectiveness of mass gathering restriction interventions that may be deployed to help reduce influenza virus spread during a pandemic. The study protocol was largely based on the University of YorkÕs Centre for Reviews and Dissemination guidance for undertaking reviews in healthcare [9] . Work commenced in mid-July 2010 and the main part of it was completed in mid-October 2010. Further work was carried out in June 2011 to bring the literature coverage up to date. The following specific questions were developed to capture the objectives of the review: • Is there an association between mass gatherings and influenza outbreaks or spread? • Are there any particular characteristics (such as size or duration) of mass gatherings that influence transmission of influenza? • Does the restriction of mass gatherings reduce the spread of influenza within the community (compared with no restriction or with other interventions)? The following types of studies were included in the review: • Randomized controlled trial • Quasi-experimental study -Non-randomized controlled study -Before-and-after study • Observational study -Cohort study -Case-control study • Outbreak reports -Outbreak/cluster reports -Historical archival outbreak analyses • Surveillance reports -Major event infection surveillance reports The list above is largely in hierarchical order of study design quality [9] , but with the addition of outbreak and surveillance reports, not traditionally included in such lists, important to the topic of this review. To cover the other ''non-standard'' study design encountered, the term ''quasi-experimental'' is employed to describe controlled but nonrandomized studies [10, 11] . Only studies published in English were included. Relevant systematic and narrative reviews and operational description papers were utilized for useful background information. The reference lists of the systematic reviews were scanned to identify potentially relevant primary studies that could be considered for inclusion. Case reports, mathematical modelling and human/non-human experimental laboratory studies were excluded from the review. Outcome measures included laboratory-confirmed influenza infection (i.e., documented by virus isolation, molecular testing such as polymerase chain reaction, and serological studies) and clinical influenza-like illness as defined by the investigators, whilst recognizing that this is less specific. The search strategy focused on primary studies taking into account the issues detailed above. The term ÔinfluenzaÕ rather than Ôpandemic influenzaÕ was used to reflect the entire spectrum of influenza for which guidance would be relevant. The transmission of other respiratory viruses was also included because of the similarity of transmission and therefore the potential applicability of any results to influenza. An initial ''scoping'' search was followed by further discussions and consultation on the work plan and search strategy. The term mass gathering on its own proved inadequate as a search term as there is no clearly accepted definition of what constitutes a mass gathering. Therefore, a range of additional terms were used, such as public gatherings, social gatherings, large crowds, mass events, festivals, Olympics, Hajj, championship, and others listed in Table 1 . Transit settings such as long-distance flights and cruise ships were not included, as it was decided that these settings would fit better in a separate review of evidence for influenza transmission through transport. The final search with revised terms and refined using the ''advanced search'' tool on PubMed was carried out as described in Table 1 , with no time period restrictions. The initial searches included the literature up till July 2010. A further search was conducted on 31 May 2011 to bring the literature coverage up to date as part of an editorial process. In addition, secondary searches were also initially carried out in the following databases: Scopus, Excerpta Medica Database (EMBASE), and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). These are described in Table 2 . In addition to the search results, the reference lists of papers identified from the search were scanned for other potentially relevant studies. Efforts were also made to identify studies other than those published in the peer-reviewed literature; the authorsÕ Study selection was conducted in stages. At all stages, scanning and reviews were done independently by the authors, who then harmonized their selections. Papers identified by the searches were scanned and some excluded on the basis of the Ôti-tleÕ for relevance to the review. The abstracts of the remaining papers were then reviewed to identify studies that appeared to meet the inclusion criteria. The full text versions of all these articles were then sought and read in full. For papers that had relevant titles but no abstracts, the full text articles were also obtained, scanned for relevance, and if relevant they were read in full. In addition, some papers that did not meet the inclusion criteria (e.g. operational descriptions of interventions, commentaries, or editorial reviews of influenza transmission or pandemic influenza) were selected to provide relevant background or supplemental information. Data from the selected full text papers were extracted using a pre-designed form. Data elements included publication information, study characteristics, participant characteristics, the intervention (if any) and setting, outcome and results. The data extracted were used to determine the eligibility of each paper for inclusion in the review. This process resulted in a final selection of eligible articles that were then included in the review. The main body of this work was undertaken in 2010 by the UK Health Protection Agency as part of a comprehensive influenza scientific evidence review informing the UK National Pandemic Influenza Strategy. Within this context, the work was carried out within a very tight three-month timeframe and with significantly limited resources. As a result, some of the most comprehensive steps required of a full systematic review could not be realistically accommodated. Therefore, a modified process was adopted in conducting this ''rapid evidence assessment'' rather than a full, formal systematic review. Rapid evidence assessments are well recognized as a pragmatic approach to include all the major elements of a full systematic review, ensuring an outcome that is as comprehensive as possible while accepting limited compromises in order to meet stipulated deadlines for feeding into the policy process [9] . Due to the time constraints, it was not practical to pursue time-intensive contacts with authors or to seek translations for non-English articles, which were therefore excluded. Articles lacking abstracts were largely excluded, and there was a limited search for unpublished studies. However, to try to mitigate these limitations, full draft versions of the review were submitted to national experts at the UK Health Protection Agency and the Scientific Pandemic Influenza committee of the UK Department of Health, seeking their comments and advice on any papers or documents that may have been omitted. Some further work was carried out in May to June 2011 to update the literature. At the outset, a strategy was developed to assess the quality of eligible studies using the Critical Appraisal Skills Programme (CASP) tools as appropriate for each type of study [12] . However, after completion of the literature search, it was clear that the types of studies and the study design types identified were not suitable for assessment by the CASP tools. Similarly for the outbreak reports included in the review, no suitable existing framework could be readily identified for quality assessment. The ORION tool was not strictly applicable as it is specific to outbreaks of nosocomial infection [13, 14] . Therefore, a modified approach was adopted, whereby each paper was categorized as having low risk, some risk, or high risk for bias with respect to the relevant review question addressed by that study. The grading was assessed based on the presence of significant methodological limitations. A high risk of bias was attributed to papers with at least three significant methodological issues as identified by the review authors, while papers with at least two issues were classified as having some risk. This approach was adapted from a system previously used by Jefferson et al. [7] . The quality of the review itself was tested against checklists based on the MOOSE [15] and PRISMA [16, 17] standards. Within the restrictions of the time constraints already described, key gaps and issues identified by the checklists were addressed as appropriate and/or acknowledged in Sections 2.5 (explaining the review context including time constraints) and 4.4 (recognizing the study limitations). The data synthesis was restricted to a narrative approach that included an analysis of the relationships within and between studies and an overall assessment of the robustness of the evidence and limitations of both the studies and the evidence review [9] . In addition, the synthesis considered the implications for policy and guidance development as well as future research. The search identified a total of 1706 papers after accounting for overlaps between the different databases. These were reviewed on the basis of ÔtitleÕ for relevance to the review (Fig. 1) , and on this basis 1593 papers were excluded. Abstracts for the remaining 113 papers were reviewed and a further 54 were eliminated. Full copies of the remaining 59 papers plus 6 papers identified from scanning the reference lists of review papers, and 3 papers retrieved from the authorsÕ hardcopy files, were reviewed and summarized. Table 3 provides a classification of the 68 papers that were read in full text. After full text review, 24 papers were classified as meeting the inclusion criteria. These included a quasi-experimental study (a non-randomized trial) [18] , nine observational studies [19] [20] [21] [22] [23] [24] [25] [26] [27] , seven outbreak reports [28] [29] [30] [31] [32] [33] [34] , three historical outbreak archive analyses [35] [36] [37] , and four event surveillance reports [38] [39] [40] [41] . Details for each of these studies are summarized in Table 4 . The 44 papers that were read but not included in the review are listed in Table 5 . One quasi-experimental study by Qureshi et al. [18] attempted to investigate the incidence of vaccine preventable influenza-like illness among Pakistani pilgrims to the Hajj religious gathering in 1999. The Hajj is an annual religious event that takes place over a number of days in a very small geographic area of Saudi Arabia usually involving 2 to 3 million pilgrims from all over the world. Accommodation is at a premium during this event and many pilgrims stay in tents specifically erected for the event and that are often over-crowded. Although primarily a vaccine efficacy study, the rates of influenza-like illness reported in vaccinated pilgrims were 36% compared with 62% in non-vaccinated pilgrims. However, these results were based on clinical endpoints without microbiologic confirmation; a non-randomized design was used, and the study was not designed to address the primary question of this review. Nine observational studies estimated the risk of acute respiratory illness and/or influenza-like illness associated with the Hajj pilgrimage by attempting to measure its occurrence in pilgrims. Four [23] [24] [25] 27] of these studies confirmed the cause of illness by laboratory testing, while the other five relied on specified symptom complexes as surrogate indicators. Among the nine observational studies were four cross-sectional studies. Balkhy and colleagues [24] tested 500 Hajj pilgrims in 2003 who presented with symptoms of upper respiratory tract infection in the second week of the event; 30 (6%) of the 500 pilgrims tested positive for influenza. Rashid et al. [23] assessed the burden of laboratory-confirmed influenza and respiratory syncytial virus (RSV) infections in symptomatic British Hajj pilgrims in the 2005 event. Of 202 symptomatic pilgrims who underwent nasal swab testing, 28 (about 14%) had confirmed influenza (mostly A type), while only 9 (4%) had RSV infection. In the 2006 Hajj, the same investigators [27] found comparable levels of laboratory confirmed influenza (10-11%) in both UK and Saudi pilgrims. These relatively low levels of infection contrasted with the findings in the cross-sectional study by Deris et al. [20] who based their assessment on syndromic influenza-like illness rather than laboratory-confirmed infection. They found an influenza-like illness prevalence of 40% in Malaysian pilgrims who had just completed the Hajj. The other five observational studies were similarly designed, involving groups of intending Hajj pilgrims who were recruited in their home regions or countries prior to the event, and then re-assessed This was a well-organized systematic prospective influenza surveillance program, described by the authors as the first of its type at a large Games event Limitations include: -No indication of total numbers of people at the event or in the city -No indication of the background ILI activity in the city or country; or whether this was during the local winter influenza season after the pilgrimage. Even though three reports were described by their respective authors as ''prospective cohort'' studies [19, 21, 22] , none of these five studies included an ''unexposed'' (non-Hajj attending) control group for comparison, indicating that they should be more accurately regarded as ''before and after'' studies. Choudhry et al. [19] assessed Saudi residents (attending the Hajj from a different part of the country) and found an incidence of influenza-like illness of about 40%. Three studies of French pilgrims by Gautret et al. [21, 22, 26] found rates of cough of between 48% and 61%; while in El-Bashir and colleaguesÕ serological study of UK pilgrims [25] , respiratory symptoms occurred in more than 80%, but the seroconversion rate was 38% of 115 participants. These variable data underline the difficulties of comparing different studies that employ contrasting measures of influenza. Interpretation needs to take account of the fact that studies using clinical outcomes suggest much higher levels of influenza-like conditions than the ones that involve laboratory confirmation. Even among the laboratory-based studies, differences in laboratory techniques may also be significant. There were four types of outbreaks in the reports that were reviewed. The first of those was a paper by Pang et al. [32] that described the experience of dealing with the SARS (severe acute respiratory The next group consists of four reports of influenza outbreaks occurring at a religious event in Australia and at three large, open-air music festivals in Europe. All of the events lasted several days and involved crowds ranging from 100,000 to 400,000 people. It is particularly relevant that the three music festivals occurred during the 2009 influenza pandemic-two at the beginning and one later during the pandemic. The report by Blyth et al. [28] described an outbreak of influenza at a large, 5-day religious event in Australia during July 2008 attended by over 400,000 participants from 170 countries. Over 100,000 of the pilgrims were accommodated in a variety of make-shift, overcrowded venues such as sports halls, community centers and schools. One hundred laboratory-confirmed cases of influenza were identified among attendees. Seven different strains of influenza were identified (four influenza A and three influenza B), highlighting the potential for the introduction of novel influenza strains. Loncarevic et al. [31] described an outbreak of influenza at a 4-day music festival in Serbia during July 2009 involving over 190,000 participants, with a number of them coming from other European countries. Many of the participants stayed at a large campsite where overcrowding was an issue. Sixtytwo laboratory-confirmed cases of H1N1 (2009) were identified; some of which were secondary cases. Although the virus was already present in Serbia at the time of the festival, the sudden increase in cases, in particular the secondary cases associated with the festival, suggests possible local spreading. The authors also reported on a small outbreak of influenza at an international sporting event held in Serbia in July over a period of 12 days and attended by over 500,000 spectators. Seven confirmed cases of H1N1 (2009) were identified in six athletes and a volunteer helping at the games. Although a much larger event, the numbers affected are considerably smaller and seem to be restricted to participants rather than those attending. Gutierrez et al. [30] described a 4-day music festival in Belgium during early July 2009 attended by an estimated 120,000 people from all over Europe. Twelve laboratory-confirmed cases of H1N1 (2009) were identified. Although sporadic cases of H1N1 (2009) had been detected in Belgium prior to the festival, an increase in cases was observed after the event and the decision to shift to mitigation was taken almost a week after the first festivalassociated cases were identified. The authors suggest that this festival highlights the potential seeding role for these events in the early stages of a pandemic. Presentation and discussion paper on data from the 1918-1919 influenza pandemic. The substantial research report arising from the study was included in the study [37] Memish Botelho-Nevers et al. [29] depict an outbreak of influenza at a 7-day music festival in Hungary during August 2009 attended by 390,000 people from all over Europe. Many of the participants were located on a campsite set up for the festival. Eight laboratory-confirmed cases of H1N1 (2009) were identified. Cases of pandemic influenza had already been identified in Hungary and at the time the community influenza-like illness rate was 7.8 per 100,000 against an estimated 3.6 per 100,000 at the music festival. The third type of outbreak report described by Saenz et al. [33] involved a large, international medical conference held in Iran during September 1968 at the early stages of the 1968/1969 pandemic. The 7-day conference was attended by over 1000 participants from all over the world. It was estimated that about a third of the participants developed an influenza-like illness with an overall attack rate of 36%. The virus was isolated from throat and nasal washings; this was found to be the pandemic A/Hong Kong/68 virus. There was evidence that close contacts of returning attendees were also affected, but none of the episodes led to a rapidly expanding focus of infection. The high attack rate raises the question of whether the indoor setting may represent a particularly high risk. Lastly, there was an innovative study examining the 2009 A(H1N1) outbreak in Mexico [34] . The authors described the details of 202 cases and then used a series of epidemiological tools to map the spread of the virus throughout the country. They identified two major contributory factors to the rapid spread of influenza: one was the very high population density in parts of Mexico City; the other was the massive religious festival involving more than 2 million people, which took place in the cityÕs Iztapalapa neighbourhood at the very early stage of the outbreak, shortly before the new virus was identified. It is suggested by the authors that this temporal association between [39] Low Schenkel [40] Low the mass gathering event and the subsequent increase in numbers of cases may reflect participants returning to their own neighbourhoods across the city, and from there to other parts of the country. Inevitably for a subject of research such as mass gathering restrictions, where prospective studies present serious practical challenges, researchers have sought to utilize historical data to try to draw out major lessons for current impact. This review included three historical analyses of the non-pharmaceutical responses to the 1918-1919 influenza pandemic. Markel et al. [37] examined the variety of nonpharmaceutical interventions that were deployed in 43 American cities during the 1918-1919 influenza pandemic. The combination of school closures and concurrent public gathering bans was implemented in 34 (79%) of the 43 cities and was the commonest combination of measures deployed. Applied early in the pandemic, this combination was significantly associated with reductions in the weekly excess death rates. Hatchett et al. [36] undertook a similar analysis on a smaller number of American cities where the timing of 19 different types of non-pharmaceutical interventions was available. They found that the early application of multiple interventions showed a trend towards lower cumulative excess mortality, but that no single intervention showed an association with improved aggregate outcomes for the pandemic. Both studies suggested that for non-pharmaceutical interventions to be beneficial, they should be applied early and in a sustained manner. A further review of the U.S. public health response to the 1918 pandemic by Aimone [35] gave conflicting results. This review examined the public health response in New York City. In New York during the 1918 pandemic, mass gatherings were not prohibited nor were schools closed; instead, the city opted for a policy of staggered business hours to avoid rush-hour crowding, enhanced surveillance so that cases were quickly identified and isolated, and an intensive program of health education. The reported outcome measures for New York City were comparable with those seen in other American cities, and New York City experienced one of the lowest excess death rates on the eastern seaboard of the United States. Surveillance reports from four major sporting events within the last decade were considered suit-able for review [38] [39] [40] [41] . The study by Gundlapalli et al. [38] reported the experience of influenza surveillance during the Winter Olympics at Salt Lake City in 2002. No indication of the numbers attending was given, but it is assumed that the numbers were large. Twenty-eight cases of confirmed influenza from three clusters of influenza-like illness (ILI) were identified and these were restricted to either participants in the Games or support staff for the Games. The clusters consisted of 12 members of a national team who trained and lived together, 8 participants of a sport and 13 law enforcement officers who worked and lived in close proximity. Lim et al. [39] reported on the experience of managing the Asian Youth Games at Singapore in June 2009. These games involved over 2000 athletes and officials from 43 countries. Although numbers of spectators are not given, it is assumed that the crowds were large. At the start of the Games, Singapore had already reported 600 confirmed cases of H1N1 (2009). Six laboratory-confirmed cases of H1N1 (2009) were identified during the 8 days of the event-four on one football team. No information on the numbers of confirmed H1N1 (2009) in the population after the Games was available. There was no increase in ILI activity during the Winter Olympics in Torino in 2006 [41] . The final study by Schenkel et al. [40] reported on the experience of syndromic surveillance during the FIFA World Cup in Germany during June/July 2006. At the time, Germany was experiencing a very large outbreak of measles. Measles is essentially spread by the respiratory route and is highly infectious. However, despite enhanced daily surveillance, no outbreaks of respiratory disease or measles associated with the World Cup were detected. As stated in Section 2.6, the approach to quality assessment of the reviewed papers was based on a pragmatic framework for categorizing studies into low-or high-risk for bias, depending on the presence or absence of significant methodological limitations. A high risk of bias was attributed to papers with at least two significant methodological problems as identified by the review authors (Table 6 ). The evidence to help address important public health questions around mass gatherings and influenza transmission is sparse, especially in the context of an influenza pandemic. In addition, the topic does not lend itself to ease of scientific investigation and there are probably many who may feel that it is self-evident that mass gatherings facilitate the transmission of infectious diseases. This systematic search of the literature identified a limited number of studies that addressed the review questions regarding whether mass gatherings are associated with influenza transmission and whether restricting mass gatherings reduces the spread of influenza within the community. In attempting to understand and describe a situation or intervention, a common understanding or definition is essential. There is currently no generally accepted definition of what constitutes a mass gathering. However, the literature on mass gathering medical care highlights an emerging consensus amongst those providing emergency medical care at organized events. In this setting, mass gatherings are considered to be organized events with more than 1000 people in attendance [4] [5] [6] . A recently published guidance document from the World Health Organisation (WHO) expanded the term to cover any organized or unplanned event involving enough people to ''strain the planning and response resources of the (host) community, State or nation'' [42] . The major limitation in trying to define mass gatherings is that any single definition would inevitably be too simplistic as it would need to incorporate events as diverse as the Hajj (lasting about 1 month and involving between 2 and 3 million people), and a football match (involving several thousand spectators over a period of about 2 h). A system for classifying mass gatherings on the basis of size and duration is lacking and may be required. In recognition of the difficulties of conducting hypothesis-based studies that directly implement and assess the effects of restrictions of mass gatherings in real life, an indirect approach was taken to address the review questions as follows: To address whether mass gatherings are associated with influenza transmission, evidence was derived from the following: -A quasi-experimental study that was primarily designed to quantify vaccine efficacy in the form of a non-randomized trial. -Observational studies that assessed participants before and after exposure to mass gathering events. -Reports of influenza outbreaks and other respiratory illnesses at mass gathering events. -Communicable disease surveillance reports from some major events. A number of studies [18] [19] [20] [21] [22] have consistently demonstrated, over a number of years, that respiratory virus transmission occurs amongst pilgrims attending the annual Hajj in Saudi Arabia, and it is recognized as an issue of international public health significance [43] [44] [45] [46] that could be particularly important in a pandemic situation. A significant proportion of pilgrims are affected by symptoms of either an influenza-like illness or an acute respiratory illness with the proportion affected reaching about 40% in some studies [19, 20] . The Hajj is, however, a unique event with almost 3 million people converging on a relatively small geographic area for a period of at least 5 days, extending up to 4 weeks. Crowd density is very high and overcrowding in the living accommodation is common. Given the unusual nature of this event, the applicability of these findings to other mass gatherings is therefore limited. There is also a question regarding the fact that several of these studies are based on clinical criteria that could be due to other viral respiratory illnesses besides influenza. In a small number of outbreak studies involving influenza-like illness and confirmed influenza at large music festivals, there is varying evidence about the extent to which influenza transmission occurs. Outbreaks were based on laboratory diagnosis, and transmission was confirmed in all, though they had varying infection rates ranging from roughly 3 to 25 per 100,000. Two recent studies undertaken during the 2009 pandemic suggest that at the beginning of a pandemic, these gatherings may act as seeding events [30] ; indeed it has been suggested at the early stages of the 1999 pandemic A(H1N1), a huge Easter season mass gathering involving 2 million people may have helped in propelling the first wave of the outbreak throughout Mexico [34] . There is no compelling evidence from event surveillance reports, such as international athletic events, the World Cup and the Winter Olympics, to indicate that these major events significantly increase community transmission of influenza. Outbreaks did occur in some cases, but these always seemed restricted to the actual competitors and staff rather than the crowds attending or the wider community. Together, all of these reports point to the potential for influenza outbreak and transmission in connection with large, multiple-day, open-air events. Thus there is some evidence to indicate that mass gatherings may be associated with an increased risk of influenza transmission, but it seems to be very variable. The type of mass gathering event seems to be of considerable importance in terms of the risk of influenza transmission ( Table 7) . Most of the evidence supporting the role of mass gatherings in the transmission of influenza comes from events where there are crowds with high crowd densities (which may be theoretically estimated at >5 people per square metre), and where the participants are likely to live close together for prolonged periods, e.g. the Hajj pilgrimage [18] [19] [20] [21] [22] and large musical festivals [28] [29] [30] . In these events, accommodations which are already likely crowded are also likely to be relatively basic, such as communal camp-style living, with the probable risk of suboptimal hygiene facilities. It seems apparent that events where close contact among participants extends beyond event venues and into accommodation areas are most associated with influenza. Event size, per se, does not seem to be a critical factor. In contrast, there is no convincing evidence that major organized sporting events are associated with significantly increased influenza transmission in those attending the event [38] [39] [40] . An important example of this contrast comes from Serbia, where two major events of different type and scale happened to coincide in 2009, providing a ''natural experimental'' opportunity for comparison [31] . In the larger event, only four event-linked confirmed influenza cases occurred at the World University Games held over a 12-day period and involving almost 25,000 athletes and staff with about 500,000 spectators. However, in a relatively smaller event held in the same month and within the same country, as many as 47 event-linked confirmed cases occurred at a 4-day music festival with around 190,000 participants. Furthermore, in surveillance reports from recent major international sports competitions, cases or small clusters of influenza were reported, but these were mainly among the event participants rather than among the overall population of people exposed to the events [38, 39] . This was true even for one major event that took place within a pandemic context [39] . These events showed no clear evidence of influenza transmission, indicating that influenza may not be a significant cause for concern at modern world sports events. This view is supported by the surveillance report from the 2006 World Cup in Germany [40] , where instances of transmission were not reported, meaning that they were either not detected or very low. This situation may in part be explained by the brief transitory nature of contact in the crowds in highly organized international sports festivals such as the Olympics and the World Cup, which are usually seated events with good spacing in-between seats and mostly in open-air settings with dilution of any infectious droplets that may be generated. The apparently low or absent influenza transmission at such events may also reflect the contemporary fact that many people who attend major sports championships tend to have planned their visit a long time ahead, as ticket sales usually start months or even years in advance. Spectators as well as participants tend to stay in more conventional accommodations such as hotels rather than tents or other forms of portable or camp-style quarters with highly crowded conditions. It is also important to note that contemporary major events are now deploying increasingly developed systems for infectious disease surveillance and control [47] , which are crucial for early detection and containment where possible. The other situation of note relates to indoor events such as large conferences, typified by the international medical conference held over 7 days in Iran during the early stages of the 1968/1969 pandemic [33] . During this meeting it was estimated that about a third of the participants developed an influenza-like illness with an overall attack rate of 36%; the pandemic virus was isolated from those cases where testing had been undertaken. This potentially highlights the role that ventilation may play in the reduction of influenza transmission and is another factor worthy of consideration. In summary, the type of mass gathering event seems to influence the risk of influenza transmission, key factors being the degree of crowdedness, the event duration and, possibly, whether the event is held indoors or outdoors. Multiple-day events with crowded communal accommodations may be the links to mass gatherings most associated with influenza. To address whether mass gathering restrictions can reduce influenza transmission, the mainly relevant papers found were archival studies of the 1918-1919 influenza pandemic [35] [36] [37] and an analysis of the 2003 SARS outbreak [32] . No relevant randomized controlled trials were found, reflecting the practical difficulties that such studies would involve. Mass gatherings of varying dimensions were restricted at a large number of American cities during the 1918-1919 period. The reports again highlighted the difficulty of interpreting what was meant by a mass gathering, e.g. including schools, cinemas, theatres and other public places. In general, evidence suggests that these measures had a beneficial effect, especially where implemented early in the course of the outbreak [36, 37] . However, these benefits were not universal across all the cities [35] . Restrictions were typically implemented as part of a set of interventions, e.g. combining quarantine and isolation policies with banning mass gatherings. As a result, it is extremely difficult to tease out the individual effects of mass gathering restrictions alone. Using multivariate techniques, investigators attempted to isolate the differential effects of individual restriction measures and found indications that certain interventions (such as closures of entertainment venues) had measurable specific impact [36, 37] , but this evidence is limited. An analysis of the 2003 SARS outbreak in China attempted to probe the impact of mass gathering restrictions that were applied in a contemporary setting [32] . However, as with the historical studies, it was not possible to distinguish the specific effects of mass gathering restrictions from amongst the broad range of other public health interventions that were applied. In summary, there is some evidence that when applied early and in tandem with other public health measures, such as isolation and quarantine and closures of educational institutions, mass gathering restrictions may help in reducing transmission. In a pandemic like that experienced during 2009, it is unlikely that the measures described above could be justified; however, in a much more severe pandemic, the cost-benefit equation could easily shift the other way. The application of bans on mass gatherings and other related public health measures are therefore highly dependent on an early indication of the severity as measured by its impact on individuals and society. There are two further, critical domains of uncertainty that need to be considered in the development of evidence-based guidance and policies regarding mass gatherings. The first domain relates to issues around the current understanding about how influenza is spread, and factors that can affect transmissibility (e.g. host factors, pathogen factors, environmental factors and particle size) [9] . Key questions remain in these areas, which may be important in making specific recommendations regarding particular types and scope of mass gathering restrictions. The second domain impinging on the potential effectiveness of any public policy on mass gatherings includes the whole range of factors affecting adherence and compliance. For instance, the experience of the 2009 pandemic has raised significant questions around how willing people might be to comply with bans imposed on mass gathering restrictions [48] [49] [50] [51] . Other challenging issues include the problematic ethical and legal frameworks for implementing restrictions for public health purposes [52, 53] , as well as considerable logistical and economic implications. If longplanned events were to be cancelled, who would be liable for the huge personal, corporate and national costs that such cancellations might incur? In considering policy recommendations within a pandemic context, the most practical approach for all but the more severe pandemics may be a strategy of encouraging voluntary restrictions. This would involve giving the public the best available information and advising rather than legislating that organizations and individuals avoid non-essential events where there is at least some evidence of transmission risk. For such a strategy to have a chance of succeeding, it would be most important to have in place a carefully and sensitively prepared communication strategy, since recommendations to avoid public gatherings are likely to run against powerful social pressures to do otherwise [54] . The success of any public health strategy-and this must be particularly true in relation to a potential or imminent pandemic situation-requires the building of trust [55] and an intelligent and purposeful engagement of the public even prior to the event [56] . There are other important issues to note. Although this review has focused on mass gatherings, limiting transmission of influenza clearly requires a multifaceted approach. Some studies in this review reflected such an approach; for example, in the historical outbreak investigations where restrictions on mass gatherings were combined with other non-pharmaceutical measures [32, 36, 37] . It would be prudent to apply the best evidence relating to other social distancing interventions in conjunction with any specific policies on mass gatherings. An additional question that should be considered is whether non-pharmaceutical health interven-tions such as mass gathering restrictions, actually reduce the health burden of influenza, or only modify the epidemiology by temporarily delaying the eventual impact of an event such as a pandemic. It is tempting to speculate on the possibility of a reduction in disease burden; historically, some of the American cities that implemented mass gathering restrictions during the 1918-1919 pandemic seemed to achieve significant reductions in peak morbidity and mortality that may well have reduced the overall burden. However, pragmatically, countries like the United Kingdom aim to achieve a slower spread, to prolong the troughs and to flatten the peaks of the epidemic curves to buy time for countermeasures to take effect and to enable services to cope with a lower volume of activity. In this context, the most important point to emphasize is that mass gathering restrictions must only be a part of a range of interventions. The synergistic effects of multiple interventions is what would allow the best chance to achieve significant reductions in overall burden. More evidence is needed on this subject. There is a need for well-designed studies to more accurately quantify the nature of the infections causing flu-like symptoms at mass gatherings, confirm the key parameters that influence the transmission of influenza in these settings, and to directly assess the impact of mass gathering restrictions. But as ''gold standard'' randomized comparison designs are extremely difficult to apply to this kind of intervention, attention needs to focus on optimal observational study options. From a UK perspective, British people travelling abroad for mass gatherings such as the Hajj or other large events could be approached for inclusion in prospective studies for comparison with appropriately matched, nontravelling controls, with care being taken to avoid drawbacks observed in existing studies. Within the UK, mass gatherings ranging from indoor events in theatres and cinemas, to outdoor events such as football matches and major musical events like the Glastonbury festival or TravellersÕ horse fairs represent potential opportunities for carefully designed prospective cohort studies to be undertaken. The biggest issue is persuading funders that given the current paucity of good studies, such further research is still needed. As previously noted, this review has examined an intervention area in which there are a limited num-ber of relevant studies and there is limited common understanding of what constitutes a mass gathering. Despite these challenges, it has been possible to extract limited strands of evidence that may be useful towards policy development. Also, within the boundaries of the inclusion criteria, and despite the limited work timescale, this review was able to capture all the relevant studies identified by recent systematic reviews investigating non-pharmaceutical interventions designed to limit transmission of influenza and/or other respiratory viral infections [7, 8, 57] . However, due to time constraints in carrying out this work, as described in Section 2.5, while every effort has been made to be as comprehensive as possible, it is acknowledged that the rapid evidence assessment process necessarily involved some limitations. The literature search is not necessarily exhaustive and there is therefore a possibility of incomplete retrieval of all potentially relevant studies. While a range of study designs were reviewed, there was not a single randomized controlled trial that was suitable for inclusion. This is of course not surprising, given the formidable logistical, cost and ethical hurdles that make large-scale experimental epidemiological studies of the restriction of mass gatherings impractical and probably impossible. Some of the included studies had significant design and quality issues as duly reflected in the individual paper summaries and the discussion, and highlighted in Tables 4 and 6. A common issue with a number of the studies included in the review is that they depended on clinical symptoms like cough or syndromes such as influenza-like illness, rather than laboratory diagnosis of influenza. In such studies it is not possible to isolate the impact of influenza as opposed to other respiratory viruses, and the risk of influenza could potentially be over-interpreted. In the studies where laboratory testing was undertaken, influenza was only confirmed in minority proportions of people with respiratory symptoms, ranging between 6% and 14% [23, 24, 27] , but possibly up to a roughly estimated 40% in one study [25] . This review did not include specific ''specialized'' settings that may arguably be regarded as mass gatherings, such as groups of people travelling for periods of time on cruise ships. The authors took the view that any transit-related settings would be best considered under a separate evidence review of influenza transmission through transportation. Modelling studies were also excluded, and it is acknowledged that their inclusion may offer an additional dimension in order to build a fuller picture. The application of quantitative techniques could have potentially enhanced the simple narrative approach that was adopted for the analysis. However, there are insufficient studies presenting quantitative data on this subject, and moreover, there is a high level of heterogeneity amongst the identified studies. In conclusion, there are limited data indicating that mass gatherings are associated with influenza transmission. Some evidence suggests that restricting mass gatherings together with other social distancing measures may help to reduce transmission. However, the evidence is not strong enough to advocate legislation or proscription. Therefore, in a pandemic situation a cautious policy of voluntary avoidance of mass gatherings would be prudent. None declared. Transmission of influenza A in human beings Questioning aerosol transmission of influenza Aerosol transmission of influenza A virus: a review of new studies Mass gathering medical care: a twenty-five year review Massgathering medical care: a review of the literature Evidence for excessive incidence of infectious diseases at mass gatherings with special reference to sporting events Physical interventions to interrupt or reduce the spread of respiratory viruses Nonpharmaceutical public health interventions for pandemic influenza: an evaluation of the evidence base CRDÔs guidance for undertaking reviews in health care The use and interpretation of quasi-experimental studies in medical informatics Types of epidemiologic studies Critical Appraisal Skills Programme, Public Health Resource Unit The ORION statement: guidelines for transparent reporting of outbreak reports and intervention studies of nosocomial infection Metaanalysis of observational studies in epidemiology: a proposal for reporting. meta-analysis of observational studies in epidemiology (MOOSE) group A. statement for reporting systematic reviews, meta-analyses of studies that evaluate health care interventions: explanation, elaboration Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement The incidence of vaccine preventable influenza-like illness and medication use among Pakistani pilgrims to the Haj in Saudi Arabia Hajj-associated acute respiratory infection among Hajjis from Riyadh The prevalence of acute respiratory symptoms and role of protective measures among Malaysian Hajj pilgrims Common health hazards in French pilgrims during the Hajj of 2007: a prospective cohort study Incidence of Hajj-associated febrile cough episodes among French pilgrims: a prospective cohort study on the influence of statin use and risk factors Influenza a common viral infection among Hajj pilgrims: time for routine surveillance and vaccination Influenza among U.K. pilgrims to Hajj Protective measures against acute respiratory symptoms in French pilgrims participating in the Hajj of Viral respiratory infections at the Hajj: comparison between UK and Saudi pilgrims Influenza outbreaks during World Youth Day 2008 mass gathering Travel-related influenza A/H1N1 infection at a rock festival in Hungary: one virus may hide another one Community transmission of influenza A (H1N1)v virus at a rock festival in Belgium Public health preparedness for two mass gathering events in the context of pandemic influenza (H1N1) 2009 -Serbia Evaluation of control measures implemented in the severe acute respiratory syndrome outbreak in Beijing Outbreak of A2-Hong Kong-68 influenza at an international medical conference Inside the outbreak of the 2009 influenza A (H1N1)v virus in Mexico The 1918 influenza epidemic in New York City: a review of the public health response Public health interventions and epidemic intensity during the 1918 influenza pandemic Nonpharmaceutical interventions implemented by US cities during the 1918-1919 influenza pandemic The influenza A (H1N1-2009) experience at the inaugural Asian Youth Games Singapore 2009: mass gathering during a developing pandemic Enhanced surveillance of infectious diseases: the 2006 FIFA World Cup experience Results from the integrated surveillance system for the 2006 Winter Olympic and Paralympic Games in Italy World Health Organisation. Communicable disease alert and response for mass gatherings: key considerations Health risks at the Hajj Prevention of pandemic influenza after mass gatherings -learning from Hajj Establishment of public health security in Saudi Arabia for the 2009 Hajj in response to pandemic influenza A H1N1 Pandemic influenza: mass gatherings and mass infection Should cities hosting mass gatherings invest in public health surveillance, planning? Reflections from a decade of mass gatherings in Human infection with new influenza A (H1N1) virus: WHO Consultation on suspension of classes and restriction of mass gatherings to mitigate the impact of epidemics caused by influenza A (H1N1) Listen to the people: public deliberation about social distancing measures in a pandemic Responses to pandemic (H1N1) SIP 5: Social distancing during a pandemic. Not sexy, but sometimes effective: social distancing and non-pharmaceutical interventions Influenza A(H1N1) and pandemic preparedness under the rule of international law Ethical and legal challenges posed by severe acute respiratory syndrome: implications for the control of severe infectious disease threats Easier said than done: behavioral conflicts in following social-distancing recommendations for influenza prevention Situational awareness, health protective responses to pandemic influenza A (H1N1) in Hong Kong: a cross-sectional study Including the public in pandemic planning: a deliberative approach Physical interventions to interrupt or reduce the spread of respiratory viruses: systematic review