key: cord-0852767-ze60qx69 authors: Soriano, Joan B; Murthy, Srinivas; Marshall, John C; Relan, Pryanka; Diaz, Janet V title: A clinical case definition of post-COVID-19 condition by a Delphi consensus date: 2021-12-21 journal: Lancet Infect Dis DOI: 10.1016/s1473-3099(21)00703-9 sha: f2e8e10e893097edd1a32f849bf6b0cc7879eb88 doc_id: 852767 cord_uid: ze60qx69 People with COVID-19 might have sustained postinfection sequelae. Known by a variety of names, including long COVID or long-haul COVID, and listed in the ICD-10 classification as post-COVID-19 condition since September, 2020, this occurrence is variable in its expression and its impact. The absence of a globally standardised and agreed-upon definition hampers progress in characterisation of its epidemiology and the development of candidate treatments. In a WHO-led Delphi process, we engaged with an international panel of 265 patients, clinicians, researchers, and WHO staff to develop a consensus definition for this condition. 14 domains and 45 items were evaluated in two rounds of the Delphi process to create a final consensus definition for adults: post-COVID-19 condition occurs in individuals with a history of probable or confirmed SARS-CoV-2 infection, usually 3 months from the onset, with symptoms that last for at least 2 months and cannot be explained by an alternative diagnosis. Common symptoms include, but are not limited to, fatigue, shortness of breath, and cognitive dysfunction, and generally have an impact on everyday functioning. Symptoms might be new onset following initial recovery from an acute COVID-19 episode or persist from the initial illness. Symptoms might also fluctuate or relapse over time. A separate definition might be applicable for children. Although the consensus definition is likely to change as knowledge increases, this common framework provides a foundation for ongoing and future studies of epidemiology, risk factors, clinical characteristics, and therapy. As of Dec 3, 2021, more than 263 million confirmed cases of COVID-19 and more than 5·2 million deaths have been reported to WHO, although estimates of 2020 greatly surpass these figures. 1 However, the natural history, clinical course, and long-term consequences of this new disease are still not completely understood. 2 Most patients with COVID-19 return to their baseline state of health after acute infection with SARS-CoV-2, but a proportion report ongoing health problems. The number of people affected with late sequelae after the acute COVID-19 episode remains unknown. Persistent symptoms are reported to be more prevalent in women, and risk of persistent symptoms is reported to be linearly related to age. 3,4 These effects appear to occur irrespective of the initial severity of infection, and are often linked to multiple organ systems. One study found that up to 70% of individuals at low risk of mortality from COVID-19 have impairment in one or more organs (ie, heart, lungs, kidneys, liver, pancreas, or spleen) 4 months after initial COVID-19 symptoms. 5 In September, 2020, and in response to requests from Member States, the WHO Classification and Terminologies unit created International Classification of Diseases 10 (ICD-10) and ICD-11 codes for post-COVID-19 condition. 6 Over the course of the pandemic, several definitions of post-COVID-19 condition have been proposed, including long COVID or long-haul COVID (appendix p 3). Absence of both a single terminology and a clinical case definition have been repeatedly signalled as drawbacks to advance on epidemiological reporting, research, policy making, and clinical management of affected patients. Standardisation of nomenclature and clinical case definition is required to facilitate global discussion and streamline research methods, management strategies, and policies. The objective of this Review is to establish the domains and variables for inclusion into a standardised clinical case definition for post-COVID-19 condition. This Review is a prospective, Delphi consensus-seeking exercise and mixed, iterative survey of internal and external experts, patients, and other stakeholders (the research protocol is available as a preprint). 7 The Delphi method is a structured communication technique originally developed as a systematic, interactive, forecasting method that relies on a panel of experts. 8, 9 It has been widely used for research and has certain advantages over other structured forecasting approaches. 10, 11 The primary users of the clinical case definition for the post-COVID-19 condition will include patients, relatives and caregivers, clinicians, researchers, advocacy groups, policy makers, health and disability insurance providers, and media. We therefore aimed to have a diverse representation of participants, including clinicians with expertise in a variety of disciplines such as quality improvement and research, patients who have had COVID-19 and its mid-term and longer-term effects, researchers, policy makers, and others from countries representing all WHO regions and World Bank income levels. There were no specific exclusion criteria for participants. A statement explaining implied consent was on the title page of the survey, with consent to participate in the survey implied by answering and returning the surveys. Participants could withdraw at any time. Participants were invited via an online recruitment letter soliciting participation and engagement, along with an explanation of study objectives, instructions, and outputs. The survey contained listed options regarding domains and variables to consider in the definition, which were initially kept as broad and comprehensive as possible. The domains and variables were followed by a series of questions relating to these variables with eventual values or thresholds related to each. Survey responses were anonymous and tabulated by groups only. Registration of panelists and the actual Delphi questionnaire (appendix pp 4-37) were accessible on the DelphiManager website. 12 All questions were evaluated on a nine-point Likert scale, from 1 (least important) to 9 (most important) and participants were asked to choose the level of importance for each variable in the definition. Whenever there was a value in the DelphiManager rating column that was something other than the Likert scale values of 1-9, the system coded as -9, the value allocated when an outcome had not been rated; or 10, the value allocated to the "Unable to rate" option. The first round of the Delphi exercise lasted 14 days, and participants were sent two reminders to complete the online survey. Participants had the opportunity to add comments for each item and to add new domains or variables. After review of the data from the first round, the WHO working group created a second round questionnaire, removing items that received low scores, clarifying terms and uncertainties in wording, and adding a new domain suggested by participants. The second round was done 5 weeks later, used a modified questionnaire based on iterative feedback and consensus during round one, and lasted 8 days, again with two reminders. In round two, participants from round one were provided with the number and percentage of respondents having chosen that answer, and a reminder of their individual answer in round one. In round two, The optimal sample size for a Delphi exercise is not well defined; however, there is general acceptance that 12-18 participants should be included in each group. 13 We sought views from a diverse sample of stakeholder groups and WHO regions (African region, region of the Americas, Eastern Mediterranean region, European region, South-East Asia region, and Western Pacific region). We defined five stakeholder groups: patients, patient-researchers, external experts, WHO staff, and others (advocacy groups, policy makers, health and disability insurance, and media). Considering that participants could be included in more than one category and that response rates might vary by group, we sent out participation invitations to a broad group of individuals identified through WHO resources. Although we sought a minimum number of participants per group, no maximum was established. The primary objective was to achieve consensus on the importance of the variables and values included in the definition. Consensus was achieved on a question if 70% or more of the responses fell within 7-9 on the nine-point Likert scale (appendix p 2). Disagreement was considered to occur if 35% or more of the responses fell within both of the two extreme ranges of possible options on the Likert scale (1-3 and 7-9). All other combinations of panel answers were considered as partial agreement. For each question, consensus proportions were considered on the basis of the number or percentage of respondents (excluding the category "Not my area of expertise"). Therefore, the denominator for the consensus included only participants with knowledge and expertise for that specific question. Participant responses, including baseline and demo graphic characteristics, were analysed with basic statistics such as mean (SD), median (IQR), and range. Responses on all other domains were analysed in proportions and illustrated with histograms. On May 11, 2021, 747 invitations were sent by email. There were 265 respondents in round one (demographics in 1 ). In round one, there were 61 (23%) patients, 18 (7%) patientresearchers, 138 (52%) external experts, 33 (12%) WHO staff, and 15 (6%) were in the "Other" category. There were 115 (43%) female partici pants, 147 (55%) male participants, one (<1%) non-binary participant, and two (1%) who preferred not to say in round one, with ages ranging from 20 years to 90 years or older, but most participants were in their 40s. Responses were received from participants in countries representing all WHO regions and World Bank income groups (figure 2). The subset of participants in round two did not differ from round one (table) . After the first round of responses, three of the 14 domains were excluded and a new domain added on the basis of participant comments; thus there were a total of 12 domains in round two ( figure 3) . Similarly, on the basis of the comments and after further discussion of the working group on results that reached borderline significance based on predefined thresholds, the domains were expanded with variables, such as new symptoms, for 45 items (appendix pp 38-42). During subsequent revision, two domains that did not fully reach prespecified thresholds were included in the clinical case definition after panel discussion-namely, "a minimum time period (in months) from the onset of COVID-19 to the presence of symptoms" and "duration of symptoms". Similarly, the "new onset" nature of symptoms was expanded to Review incorporate relapsing and fluctuating through patientpanel feedback. A clinical case definition was built and further expanded with those domains, thresholds, and values, and wording was trimmed in a dedicated quantitative and qualitative discussion with patients and patient-researchers (panel). Post-COVID-19 condition occurs in individuals with a history of probable or confirmed SARS-CoV-2 infection, usually 3 months from the onset of COVID-19 and with symptoms that last for at least 2 months and cannot be explained by an alternative diagnosis. Common symptoms include fatigue, shortness of breath, and cognitive dysfunction, but also others (appendix pp 38-42), and generally have an impact on everyday functioning. Symptoms might be new onset after initial recovery from an acute COVID-19 episode or persist from the initial illness. Symptoms might also fluctuate or relapse over time. A separate definition might be applicable for children. By means of a Delphi process involving two rounds, we identified domains and variables to be included in a clinical case definition of post-COVID-19 condition-the name proposed by WHO ICD-10 diagnosis code U09 in September, 2020. A definition based on these domains was created. This clinical case definition of post-COVID-19 condition is intended to be applied in the community and health-care setting to optimise recognition and care of individuals with post-COVID-19 condition; it is not meant to replace other terms but be used in a more standardised way. This definition was obtained by a robust, protocol-based methodology (Delphi consensus), engaging a diverse group of representative patients, caretakers, and other stakeholders from many areas. This definition is compatible and consistent with previous suggestions available elsewhere (appendix p 3), but is likely to change as new evidence emerges and our understanding of the consequences of COVID-19 continues to evolve. To date, there have been several attempts to define different COVID-19-related topics and outcomes, 15-18 but existing definitions do not take into account presentations in low and middle-income countries and often miss domains that are relevant to various groups of stakeholders. To our knowledge, ours is the first Delphi exercise to define post-COVID-19 condition with these stakeholder inputs. Strengths of this study include a robust protocol-based Delphi method and inclusiveness and representation of participants from five diverse stakeholder groups, from countries representing all WHO regions and World Post-COVID-19 condition occurs in individuals with a history of probable or confirmed SARS-CoV-2 infection, usually 3 months from the onset of COVID-19 with symptoms that last for at least 2 months and cannot be explained by an alternative diagnosis. Common symptoms include fatigue, shortness of breath, and cognitive dysfunction (other symptoms are listed in the appendix [p 4] and published literature 14 ) , and generally have an impact on everyday functioning. Symptoms might be new onset after initial recovery from an acute COVID-19 episode or persist from the initial illness. Symptoms might also fluctuate or relapse over time. A separate definition might be applicable for children. There is no minimum number of symptoms required for the diagnosis; symptoms involving different organs systems and clusters have been described. • Fluctuate: a change from time to time in quantity or quality • Relapse: return of disease manifestations after period of improvement • Cluster: two or more symptoms that are related to each other and that occur together; they are composed of a stable groups of symptoms, are relatively independent of other clusters, and might reveal specific underlying dimensions of symptoms 15 19, 20 Our study has several limitations. English language was selected for practicality issues, but subsequent Delphi exercises should include other languages. Response rates in both rounds could have been greater, which is not unexpected, given its conduct during a pandemic. Best practices for enhancing response rates were integrated throughout, 21 including introductory messages and reminder emails. Responses from the African and Eastern Mediterranean regions were especially sought and obtained, but their overall proportions were lower than from other regions. Additionally, participants older than 70 years are under-represented. Wording of some domains and addition of new items and values were modified from round one to round two. Our protocol called for only two rounds of consensus-building. Items addressing the timing and duration of symptoms did not reach prespecified criteria for consensus, and should be interpreted in the light of this limitation. Overall, as several pathophysiological mechanisms are in place and interplay during and after acute infection, 22 and different trajectories for recovery after COVID-19 exist, 23 producing a single, universal definition that might work well for clinical, research, policy and advocacy grounds, and for all care levels and severities might be overly ambitious. The definition presented in this Review (panel) might be considered a description based on opinion of those individuals participating, and difficult to operationalise in practice. Not only timing and duration, but the symptoms are susceptible to subjectivity and bias of participants. We strongly support that this is open discussion in an organised way and integration of emerging evidence, such as prospective cohort trials, should help to advance this field. As mentioned, this proposal of a clinical case definition is probably temporary, as new data continue to emerge. Initial reports describing post-COVID-19 condition were from small patient samples with an inherently short follow-up, and are likely to be subject to bias, 24 which will be unravelled in ongoing metaanalyses. 25 New research is exploring the use of electronic health records from representative samples of patients identified in primary care and elsewhere. 26 The use of comparator samples of individuals fully recovered after acute infection is envisaged. By use of cluster analysis and other mathematical tools to establish specific symptoms and their minimum number, they all could be formally identified and eventually clustered for different phenotypes. Notably, time thresholds from onset of infection or the duration of these symptoms possibly will be established. 27, 28 Conclusion COVID-19 will remain a challenge for the foreseeable future. 29 Many pending answers surrounding COVID-19 and its sequelae remain, with new questions constantly being formulated. [30] [31] [32] This global definition of post-COVID-19 condition will help to advance both advocacy and research, but will probably change as new evidence emerges and our understanding of the consequences of COVID-19 continues to evolve. We declare no competing interests. post-acute sequelae of SARSCoV-2 infection (PASC)". Cross-referencing of relevant published articles were also identified through searches in the authors' personal files and several WHO Expert Panels. Articles resulting from these searches and relevant references cited in those articles were reviewed Risk factors for long COVID: analyses of 10 longitudinal studies and electronic health records in the UK. medRxiv 2021 Persistent symptoms following SARS-CoV-2 infection in a random community sample of 508,707 people Multiorgan impairment in low-risk individuals with post-COVID-19 syndrome: a prospective, community-based study Emergency use ICD codes for COVID-19 disease outbreak A Delphi consensus to advance on a clinical case definition for post covid-19 condition: a WHO protocol An experimental application of the Delphi method to the use of experts Delphi process: a methodology used for the elicitation of opinions of experts Methods to elicit forecasts from groups: Delphi and prediction markets compared The Delphi technique as a forecasting tool: issues and analysis Consensus development methods, and their use in clinical guideline development: a review Characterizing long COVID in an international cohort: 7 months of symptoms and their impact The problem of 'long haul' COVID. Sci Am Coronavirus disease 2019 (COVID-19) surveillance system: development of COVID-19 minimum data set and interoperable reporting framework Expert consensus statements for the management of COVID-19-related acute respiratory failure using a Delphi method Essential emergency and critical care: a consensus among global clinical experts Scientific consensus on the COVID-19 pandemic: we need to act now Characterizing long COVID in an international cohort: 7 months of symptoms and their impact A guide for the design and conduct of self-administered surveys of clinicians The Lancet Respiratory Medicine. COVID-19 pathophysiology: looking beyond acute disease Natural history of asymptomatic SARS-CoV-2 infection Challenges in defining long COVID: striking differences across literature, electronic health records, and patient-reported information Characteristics and predictors of acute and chronic post-COVID syndrome: a systematic review and meta-analysis Sinuhe and clinical research assessing post COVID-19 condition Predicting COVID-19 disease progression and patient outcomes based on temporal deep learning Artificial intelligence for COVID-19: saviour or saboteur? COVID-19, nuclear war, and global warming: lessons for our vulnerable world Long COVID: tackling a multifaceted condition requires a multidisciplinary approach Toward understanding COVID-19 recovery: National Institutes of Health Workshop on Postacute COVID-19 Towards a universal understanding of post COVID-19 condition Copyright © 2021 World Health Organization This study was funded internally by WHO. There were no payments to participants. We thank all participants, and particularly the patients and patient-researchers with post-COVID-19 condition who contributed their time and expertise to this Delphi exercise. We also thank Paula Williamson (University of Liverpool, Liverpool, UK) for providing free access to the DelphiManager software and Bridget Griffith for her technical support in organising data from DelphiManager. JBS was a Senior Consultant from November, 2020, to July, 2021, at the COVID-19 Clinical Management Team, WHO Health Emergency Programme (World Health Organization, Geneva, Switzerland).