key: cord-285546-5tjhdczt
authors: Green, Manfred S.; Peer, Victoria; Schwartz, Naama; Nitzan, Dorit
title: The confounded crude case-fatality rates (CFR) for COVID-19 hide more than they reveal—a comparison of age-specific and age-adjusted CFRs between seven countries
date: 2020-10-21
journal: PLoS One
DOI: 10.1371/journal.pone.0241031
sha: 
doc_id: 285546
cord_uid: 5tjhdczt

BACKGROUND: Crude case-fatality rates (CFRs) for COVID-19 vary widely between countries. There are serious limitations in the CFRs when making comparisons. We examined how the age distribution of the cases is responsible for the COVID-19 CFR differences between countries. METHODS: COVID-19 cases and deaths, by ten-year age-groups, were available from the reports of seven countries. The overall and age-specific CFRs were computed for each country. The age-adjusted CFRs were computed by the direct method, using the combined number of cases in all seven countries in each age group as the standard population. A meta-analytic approach was used to obtain pooled age-specific CFRs. FINDINGS: The crude overall CFRs varied between 0.82% and 14.2% in the seven countries and the variation in the age-specific CFRs were much smaller. There was wide variation in the age distribution of the cases between countries. The ratio of the crude CFR for the country with the highest CFR to that with the lowest (6.28) was much lower for the age-adjusted CFRs rates (2.57). CONCLUSIONS: The age structure of the cases explains much of differences in the crude CFRs between countries and adjusting for age substantially reduces this variation. Other factors such as the definition of cases, coding of deaths and the standard of healthcare are likely to account for much of the residual variation. It is misleading to compare the crude COVID-19 CFRs between countries and should be avoided. At the very least, age-specific and age-adjusted CFRs should be used for comparisons.

, WHO declared COVID-19 as a pandemic. By October, 2020, almost all countries had been affected, and globally there were reports of more than 37 million cases and more than a million deaths. Early estimates indicated that the average proportion of deaths among the diagnosed cases, defined as the case-fatality rate (CFR), was around 2.3% [2] . However, subsequently, the reported crude COVID-19 CFRs varied widely between countries [3, 4] . The limitations of comparing crude CFRs in general, has been evaluated previously [5] . The strong positive association between the COVID-19 CFR and age has been demonstrated both in observational studies [6] and in a model-based analysis [7] , particularly over the age of 40.

The interpretation of the CFR depends on the context in which it is used. In a single cohort of patients, it can indicate the severity of the disease at a single point in time. It can also be used to assess trends in the impact of changes in health care over time. In the current context of the COVID-19 pandemic, CFRs are commonly compared between countries and that may lead to speculation on differences in healthcare. For example, it may be concluded that the CFRs somehow reflect the successes and failures of the different countries in the treatment of serious cases. In general a number of factors could impact on the both the numerator and denominator of the CFR. This is especially important for the CFR for COVID-19. There could be misclassification of causes of death and there are likely to be variations in the definition of cases in the denominator. Substantial confounding by age could impact on CFR comparisons between different groups. A related concept is the infection fatality rate (IFR) which includes asymptomatic cases in the denominator, which need to be identified by screening tests. Since the IFR is rarely available for COVID-19, in this paper we consider only the CFR. In this paper, we examined the contribution of the age distribution of the cases when comparing the COVID-19 CFRs between seven countries, with widely varying CFRs.

We studied published crude and age-specific CFRs in cohorts of cases of COVID-19 in seven countries, with varying periods of follow-up. The countries chosen were based on the accessibility of the data. The first case COVID-19 in Israel was confirmed on 21 February 2020. The first case in South Korea was announced on 20 January 2020.The COVID-19 spread from Hubei Province, China, after December 2019.SARS-CoV-2 was confirmed to have reached Spain, Sweden, Italy, and Canada on end of January 2020. The data on cases and deaths by age group were available from China on February 11, 2020. For South Korea cases and deaths were updated to the end of April. For Spain, the cases and deaths were updated to mid-May 2020. The information for Israel, Italy, Canada and Sweden were updated during August 2020. The data for each country were not necessarily updated to the time of the study, and the CFR's may have changed over time. Age-specific data on the cases and deaths by ten-year age groups (0-9, 10-19, . . ...80+), were available for seven countries: Italy [8] , Spain [9], Sweden [10] , China [11] , S Korea [12] , Israel (Ministry of Health, personal communication) and Canada [13] . The outcome variable was defined as the crude CFR defined as the number of deaths divided by the number of reported cases. The exposure variable was the individual country. Age-group was considered as a confounding variable. Age-adjustment was carried by the direct method, using the distribution of the combined cases of all six countries by age group as the standard population. 95% confidence intervals were computed for each age-adjusted rate using WinPepi [Version 11.65, Aug, 2016].

Open access aggregative and anonymous data were used and there was no need for ethics committee approval.

The age-specific number of cases, number of deaths and the crude CFRs by country are given in Table 1 . The distributions of the cases vary markedly between the countries. For example, Israel and South Korea are heavily weighted in the 20-39 age group, China has a more balanced distribution and Italy, Sweden and Canada are heavily weighted in the over 70 age groups.

The distributions of the cases for each country are shown in Fig 1. It is clear that distributions vary widely and are not necessarily related to the age distribution of the population of the country. For example, for South Korea, there is a relatively large number of cases in the age group 20-29, due to an outbreak affecting that age group in particular.

The age-specific CFRs are shown in Fig 2. While there are differences in the age-specific CFRs between countries, the trend of steeply increasing CFRs in the oldest age groups is evident. Age groups 0-9 and 10-19 were excluded from the figure, since there were almost no deaths.

The crude (%) and age-adjusted CFRs (%) are compared in Table 2 . The crude CFRs varied from 0.82% for Israel to 14.20% for Italy and the ratios of the crude CFRs compared with lowest CFR, varied between 0.36 and 6.28. The age-adjusted CFRs varied between 4.20% for China to 10.80% for Italy and the ratios of the age-adjusted CFRs for each country compared with the lowest CFR adjusted varied between 1.00 and 2.57. Fig 3 shows graphically the marked reduction in the differences between the crude (%) and age-adjusted CFRs (%) for the seven countries.

We used meta-analytic methods to obtain weighted pooled estimates of the CFR's by age group. The results of the meta-analysis are presented in the forest plot in Fig 4, 

In our study, we examined crude, age-specific and age-adjusted CFRs for COVID-19 in seven countries, with widely varying crude CFRs. The trends in the age-specific CFRs were remarkably similar in the seven countries, with the CFR's increasing steeply in those over 70. After adjusting for age, the marked differences in the crude CFRs were substantially reduced. These findings demonstrate the importance of accounting for age when comparing rates in general and CFRs in particular. The results of this study are strengthened by the use of national data or large datasets from a number of countries, with considerable differences in the extent of the pandemic in each country. It should be stressed that the age distribution of the cases was used to compute the age-adjusted CFRs and not the age distribution of the total population in each country.

In addition to the age distribution of the cases, the use of the CFR for comparisons between countries has other important limitations. Selection bias is clearly present when calculating the denominator on the basis of reported cases. As mentioned, the CFR must be distinguished from the IFR, which includes asymptomatic cases identified by deliberate or incidental screening with diagnostic tests. In addition, if only those with more severe symptoms are tested this will affect the denominator of the CFR and will depend on the testing strategy of each country. If more mild cases are identified, this is likely to reduce the CFR. there is a lag time between the reporting of the case and the death which can occur up to weeks later. In the country reports, cases and deaths are usually reported at the same time, so the cases in the denominator are usually an overestimate of the true denominator which should be the number of cases reported sometime earlier [14, 15] . This will have a more dramatic effect when the number of cases are rising rapidly. Selection bias may also affect the numerator if only deaths occurring in hospital are reported. Information bias can be present in both the numerator and denominator of the CFR. The definition of the cases may be biased due to the variability of the sensitivity and specificity of the diagnostic tests for COVID-19. Information bias in the numerator can occur when the cause of death is coded. This could be particularly problematic in elderly people with multiple co-morbidities. The purpose of this paper is to demonstrate the dramatic effect of confounding by the age distribution of the cases when using crude overall CFRs for country comparisons. This was shown in an earlier paper when comparing six countries, and we have extended it to a comparison of seven countries with widely different CFRs. The age structures of the population of the seven countries used in this study vary markedly. The percentage of the population age 65 and over is 12% in Israel, 23% in Italy 23%, 9.3% in S Korea, 19.6% in Spain, 20% in Sweden, 11% in China and 17.6% in Canada [16] . However, the main impact of confounding by age was due to the differences in the age distribution of the cases. This was largely due to the specific circumstances of exposure. For example, most of the cases in Italy occurred in an area of a particularly old population [3] . In some countries, many of the cases were medical personnel, a large number of whom were relatively young women [17] . In South Korea, a large percentage of the cases were young women associated with a specific religious group [18] . In Germany, many of the cases were relatively young people returning from skiing holidays in Austria and Italy [19] . In Israel, the largest outbreaks occurred in the ultra-orthodox Jewish community, where the number of children per family is much higher than in the general population. Other factors affecting the age distribution of the cases, depended on the frequency of outbreaks in homes for the elderly [20] .

The results of this study once again demonstrate the pitfalls of comparing unadjusted rates. The assumption that differences between countries in testing policies or standard of treatment accounted for the wide discrepancies in CFRs, is not well-founded. This does not mean that there are no differences. For example, it is possible that where the health services were overloaded, younger patients were more likely to be admitted to intensive care units with better chances of survival. Clearly, the data are incomplete and other factors affecting CFRs such as case definitions, use of different denominators, underlying health conditions and the standard of health services are likely to play important roles. In order to assess the impact of these factors, age-specific and age-adjusted CFRs must be used.

In addition to the selection and information biases inherent in computing CFRs, the age structure of the cases dramatically impacts on the differences in the crude CFRs between countries. Failure to account for this source of confounding markedly distorts the country comparisons. The substantial reduction in the differences in the age-adjusted CFRs suggest that differences in the standard of healthcare between these countries may not play as important a role in affecting the death rates, as some have hypothesized. Crude COVID-19 CFRs have no real use for between country comparisons and should be avoided. In general, for comparisons between groups and countries, age-adjusted CFRs can be used, but age-specific COVID-19 CFRs are generally far more meaningful.

Similarity in case fatality rates (CFR) of COVID-19/SARS-COV-2 in Italy and China

Case-fatality rate and characteristics of patients dying in relation to COVID-19 in Italy

Early estimation of the case fatality rate of COVID-19 in mainland China: a data-driven analysis

Potential biases in estimating absolute and relative case-fatality risks during outbreaks

Covid-19: death rate is 0.66% and increases with age, study estimates

Estimates of the severity of coronavirus disease 2019: a model-based analysis

Aggiornamento nazionale

The Epidemiological Characteristics of an Outbreak of 2019 Novel Coronavirus Diseases (COVID-19)-China, 2020. The Novel Coronavirus Pneumonia Emergency Response Epidemiology Team

a30501000000&bid = 0031&list_no = 367045&act = view

Coronavirus disease 2019 (COVID-19): Epidemiology update". Public Health Agency of Canada

Real estimates of mortality following COVID-19 infection

Estimating case fatality rates of COVID-19

Impact on mental health and perceptions of psychological care among medical and nursing staff in Wuhan during the 2019 novel coronavirus disease outbreak: A cross-sectional study

Korean Society of Infectious Diseases; Korean Society of Pediatric Infectious Diseases

Report on the epidemiological features of coronavirus disease 2019 (COVID-19) outbreak in the Republic of Korea from

A German Exception? Why the Country's Coronavirus Death Rate Is Low

We express our appreciation to the official institutions of all countries for the providing their data on Covid-19.

Conceptualization: Manfred S. Green, Dorit Nitzan.