key: cord-0842433-c4azg1wz
authors: Guan, Xiaojun; Yao, Liding; Tan, Yanbin; Shen, Zhujing; Zheng, Hanpeng; Zhou, Haisheng; Gao, Yuantong; Li, Yongchou; Ji, Wenbin; Zhang, Huangqi; Wang, Jun; Zhang, Minming; Xu, Xiaojun
title: Quantitative and semi-quantitative CT assessments of lung lesion burden in COVID-19 pneumonia
date: 2021-03-04
journal: Sci Rep
DOI: 10.1038/s41598-021-84561-7
sha: 5b9424673acaeb7e254d9039252b2ab74bea292d
doc_id: 842433
cord_uid: c4azg1wz

This study aimed to clarify and provide clinical evidence for which computed tomography (CT) assessment method can more appropriately reflect lung lesion burden of the COVID-19 pneumonia. A total of 244 COVID-19 patients were recruited from three local hospitals. All the patients were assigned to mild, common and severe types. Semi-quantitative assessment methods, e.g., lobar-, segmental-based CT scores and opacity-weighted score, and quantitative assessment method, i.e., lesion volume quantification, were applied to quantify the lung lesions. All four assessment methods had high inter-rater agreements. At the group level, the lesion load in severe type patients was consistently observed to be significantly higher than that in common type in the applications of four assessment methods (all the p < 0.001). In discriminating severe from common patients at the individual level, results for lobe-based, segment-based and opacity-weighted assessments had high true positives while the quantitative lesion volume had high true negatives. In conclusion, both semi-quantitative and quantitative methods have excellent repeatability in measuring inflammatory lesions, and can well distinguish between common type and severe type patients. Lobe-based CT score is fast, readily clinically available, and has a high sensitivity in identifying severe type patients. It is suggested to be a prioritized method for assessing the burden of lung lesions in COVID-19 patients.

www.nature.com/scientificreports/ assigned according to the percentage of involvement in each lobe or segment. All lobar or segmental scores are summed to calculate the overall score as a metric for the severity of opacifications. More recently, lesion volume measurement, as a quantitative method, has become a promising approach to quantifying the disease loads for COVID- 19 , and has been shown to have the ability to predict the disease progression 13, 14 . However, although researchers have claimed that these semi-quantitative or quantitative methods can be employed to evaluate the severity of lung inflammation in NCP patients, few studies have compared the effectiveness between these methods directly. Therefore, it remains largely unknown that whether these different methods would provide more details than the one another.

In the present study, we employed four different measurements, including semi-quantitative and quantitative methods, to evaluate the lung lesion burden in NCP patients that were recruited from three hospitals in Zhejiang Province, China. The purpose of this study is to clarify the effectiveness of different assessment methods in reflecting the severity of the NCP, and then provide evidence for the selection of clinically applicable methods.

A total of 244 patients were retrospectively recruited from three local hospitals in Zhejiang Province (81 patients from Site 1; 66 patients from Site 2; 97 patients from Site 3). This study was approved by the Medical Ethic Committee of Yueqing People's Hospital, Ruian People's Hospital and Taizhou Hospital of Zhejiang Province, and was also reviewed by the Medical Ethic Committee of the Second Affiliated Hospital of Zhejiang University School of Medicine. The written informed consent from the patients was waived, which was approved by the above institutes. All the methods were carried out in accordance with relevant guidelines and regulations.

For all the patients, the diagnosis of COVID-19 was confirmed by performing the real-time reverse transcriptase polymerase chain-reaction (RT-PCR) on nasal and pharyngeal swab specimens. Based on the Diagnosis and Treatment Plan of COVID-19 issued by the National Health Commission of China 15 , COVID-19 patients were divided into four types: (1) Mild type: mild clinical symptoms without pneumonia in imaging; (2) common type: fever, respiratory tract and other symptoms with pneumonia in imaging; (3) severe type: respiratory distress, respiratory rate ≥ 30 times/min; in resting state, oxygen saturation ≤ 93%; PaO 2 /FiO 2 ≤ 300 mmHg; (4) critical type: respiratory failure requiring mechanical ventilation, shock and other organ failure requiring ICU monitoring and treatment. According to the above criteria, 31 of the 244 patients were assigned to mild type, 175 patients were assigned to common types, 38 patients were assigned to severe type, and there were no critical type patients (Table 1 ).

CT scanning. All patients underwent chest CT scanning on admission. CT scans were obtained with the patients in the supine position, and scanning was performed at the end of clinical inspiration without intravenous contrast. The scanning range was from the apex to lung base. All the patients were scanned in one of three CT scanners (Somatom Perspective and Somatom Scope, Siemens Healthcare, Erlangen, Germany; uCT 530, United Imaging, Shanghai, China) with the following parameters: tube voltage, 100-120 kV; tube current, automatic tube current modulation or 175 mA; ref mAs, 70-130; pitch, 0.9-1.175; matrix, 512 × 512; and section thickness after reconstruction, 5.0 mm, with a sharp reconstruction kernel (B_SHARP_C) or a pulmonary B70s kernel.

Image analysis. Since patients with mild type of COVID-19 have no lesions on the lung images, only 213 patients with common type and severe type were included in the subsequent CT image analysis. Lung windows with window level at − 500 HU and window width at 1500 HU were used to display CT images.

Two experienced radiologists (radiologist 1, with 20 years of diagnostic radiology experience, and radiologist 2, with 10 years of experience) independently reviewed chest CT images of all the patients. Three semi-quantitative CT scoring methods were used to access the severity of lung disease according to the following criteria: (1) Segmental based assessment: each of the 18 lung segmentations was visually evaluated using a system attributing scores of 0, 1, and 2 (0, no parenchymal opacification; 1, parenchymal opacification involvement less than 50%; 2, involvement more than 50%). The total score was the sum of the individual segmentation scores and ranged from 0 (no involvement) to 36 (maximum involvement) 12 . (2) Lobar based assessment: each of the 5 lung lobes was subjectively scored from 0 to 5 (0, no involvement; 1, involvement < 5%; 2, involvement 6-25%; 3, involvement 26-50%; 4, involvement 51-75%; 5, involvement > 75%). The total score was the sum of the individual lobar scores and ranged from 0 to 25 9 . (3) Opacity-weighted segmental assessment: based on the segmental assessment, we further added ground glass opacity and consolidation opacity, ranging from 1 to 2. The total score was the sum of the opacity-weighted individual segmental scores and ranged from 0 to 72. www.nature.com/scientificreports/ Meanwhile, the quantitative assessment of lung lesions was performed by one of two radiologists (radiologist 3, with 6 years of diagnostic radiology experience; radiologist 4, with 8 years of experience). ITK-SNAP (http:// www.itksn ap.org) was used to manually segment the lung lesions on each slice of CT image along the edge of parenchymal opacification. The lung lesion volume of each patient was the sum of the lesion volume on each CT slice image. In order to confirm the robustness of manual segmentation ( Fig. 1 ), 10 patients were randomly picked out from the whole database and were segmented respectively by these two radiologists.

Statistical analysis. The age distribution among each type of patient was compared by using Analysis of Variance (ANOVA), while Chi-square was used to compare the gender distribution. Intra-class correlation coefficient (ICC) analysis was conducted to test the assessment reliability of semi-quantitative CT scoring between two radiologists, where ICC < 0.50 means poor reliability, between 0.50 and 0.75 indicates moderate reliability, between 0.75 and 0.90 means good reliability and > 0.90 means excellent reliability 16 . Dice similarity coefficient was calculated for testing the reliability of lesion segmentation between two radiologists, where the value of > 0.70 indicates an excellent agreement 17, 18 .

In the subsequent inter-group comparisons, a general linear model was performed to detect the differences of CT score and lesion volume between common type and severe type patients with age and gender as covariates. At the individual level, receiver operating characteristic curve (ROC) was computed to test the discriminative efficacy of different methods between common type and severe type patients. Sensitivity, specificity and area under the curve (AUC) were calculated, and the Youden index was used to determine the best discriminative result. P < 0.05 was regarded as statistically significant.

In order to clarify the effect of age on the disease severity of NCP patients, we further stratified patients into six groups (Group 1, 21-30 years old; Group 2, 31-40 years old; Group 3, 41-50 years old; Group 4, 51-60 years old; Group 5, 61-70 years old; Group 6, 71-86 years old). ANOVA with Least Significant Difference adjustment was conducted to observe the inter-group lesion load differences that were assessed by the four approaches mentioned above. P < 0.05 was regarded as statistically significant. www.nature.com/scientificreports/

Demographic information. The COVID-19 patients with severe type were significantly older than the patients with mild type and common type (both p < 0.001). No significant difference in the gender distribution was observed (p = 0.280) ( Table 2 ).

The reliability of semiquantitative methods. In the lobar lesion assessment, radiologist 1 and 2 achieved excellent agreement with a mean individual ICC of 0.919 (95% confidence interval, 0.877-0.944; p < 0.001). In the segmental lesion assessment, they also achieved excellent agreement with a mean individual ICC of 0.986 (95% confident interval, 0.979-0.990; p < 0.001) ( Fig. 1 and Table 3 ). In the opacity-weighted lesion assessment, similarly excellent agreement with a mean individual ICC of 0.937 was achieved (95% confident interval, 0.910-0.955; p < 0.001). Therefore, these data demonstrated that the reliability of semi-quantitative methods was high, and in the following analysis we calculated the averaged CT severity score instead of using either score made by radiologist 1 or radiologist 2.

The reliability of lesion segmentation. The Dice similarity coefficient was 0.815 ± 0.032, ranging from 0.758 to 0.857, indicating that the lesion segmentation was highly robust across the two radiologists (Fig. 2 ).

The discriminative ability to identify different types of COVID-19 patients. At the group level (Table 2 ), compared to common type, severe type patients had significantly higher lesion loads measured by lobar lesion assessment (p < 0.001), segmental lesion assessment (p < 0.001), opacity-weighted lesion assessment (p < 0.001), and lesion volume quantification (p < 0.001). At the individual level (Fig. 3) , we observed that, (1) a lobar disease severity score of 6.75 could discriminate between the two types of COVID-19 patients with AUC, sensitivity and specificity values of 0.904, 97.4% and 72.0%, respectively; (2) the segmental disease severity score of 9.75 could discriminate between the two types of COVID-19 patients with AUC, sensitivity and specificity values of 0.891, 94.7% and 69.7%, respectively; (3) a opacity-weighted disease severity score of 9.75 could discriminate the two types of COVID-19 patients with AUC, sensitivity and specificity values of 0.894, 94.7% and 61.1%, respectively; and (4) a lesion volume of 227,064.75 mm 3 could discriminate between the two types of COVID-19 patients with the AUC, sensitivity and specificity values of 0.903, 78.9%, and 89.1%, respectively.

Thus, the semiquantitative measurements, e.g., lobar disease severity, segmental disease severity, and opacityweighted disease severity, had high true positives and an excellent ability to identify severe type patients, while the quantitative measurement, lesion volume quantification, had high true negatives, indicating a good screening of common type patients.

were assigned to six groups according to ascending ages (Fig. 4) . In the lobar lesion assessment, patients in the Age 6 group had significantly higher lesion load than patients in the Age 3 (p = 0.032), Age 2 (p = 0.001) and Age 1 (p < 0.001) groups; patients the in Age 3, Age 4 and Age 5 groups had significantly higher lesion load than patients in the Age 2 (p = 0.050, 0.022 and 0.001, respectively) and Age 1 (p = 0.021, 0.011 and 0.001, respectively) groups. Opacity-weighted lesion assessment -9.0 ± 6.8 23.5 ± 10.0 1.6 × 10 -20

Lesion volume (mm 3 ) -9 × 10 4 ± 1.1 × 10 5 4.9 × 10 5 ± 3.4 × 10 5 3.1 × 10 -25 www.nature.com/scientificreports/ In the segmental lesion assessment, patients in Age 4, Age 5 and Age 6 groups had significantly higher lesion load than patients in the Age 2 (p = 0.046, 0.001 and 0.004, respectively) and Age 1 (p = 0.015, 0.001 and 0.001, respectively) groups. Moreover, patients in the Age 5 group had additionally higher lesion load than the patients in the Age 3 group (p = 0.040), while patients in the Age 3 group had more lesion load than the patients in the Age 1 group (p = 0.033).

In the opacity-weighted lesion assessment, patients in the Age 3-6 had significantly higher lesion load than patients in the Age 1 (p = 0.050, 0.033, 0.009, and 0.013) while patients in the Age 5 and Age 6 had significantly higher lesion load than patients in the Age 2 (p = 0.014 and 0.024).

In the lesion volume quantification, patients in the Age 6 group had larger lesion volume than patients in the Age 1-4 groups (p = 0.002, 0.001, 0.027 and 0.038, respectively). Besides, patients in the Age 3 and Age 4 groups were found to have larger lesion volume than patients in the Age 2 group (p = 0.045 and 0.037).

In summary, all four methods consistently demonstrated that COVID-19 patients with older ages were more susceptible to suffer from severe disease involvement.

Recently, the Fleischner Society 19 , European Society of Radiology 20 , European Society of Thoracic Imaging 21 , and British Society of Thoracic Imaging 22 have successively issued expert consensus or statements on the role of imaging in the COVID-19 epidemic. They clarified the essential role of chest CT in the evaluation of disease severity in NCP patients, which may help to predict patient outcome and to facilitate medical triage and associated decisions regarding disposition, infection control, and clinical management. Thus, the investigation of agreement among different methods of assessing lung lesion burden became very urgent, which would be of value in improving the consensus of radiologist clinical activity and facilitating research standardization, since potential discrepancies have not been disclosed.

In the present study, we employed three semi-quantitative methods based on lobar CT score, segmental CT score and opacity-weighted CT score respectively, and a quantitative method based on lesion volume quantification to assess the severity of lung lesions in COVID-19 patients. First of all, high agreement between radiologists (ICC and DICE similarity coefficient) for these four assessment methods in measuring lesion loads were demonstrated, indicating that all four evaluation results are highly repeatable. Then, we found that there were significant differences between the common type and severe type patients in the lobar CT score, segmental CT score, opacity-weighted CT score and lesion volume, suggesting that all four methods can distinguish the common type from severe type at the group level. Lastly, we found that, at the individual level, although all four www.nature.com/scientificreports/ methods had shown comparable AUC values, the results were different in that the semi-quantitative assessments had high true positives when discriminating severe type COVID-19 patients from common type, while the quantitative lesion volume had high true negatives. The semi-quantitative method for lung disease originated from the study of SARS more than 10 years ago 9,10 . Recently, many researchers have adopted these methods to assess the severity of lung lesions in NCP patients. They found that severity score based on visual inspection of the number and size involved within each lobe or segment correlated well with disease stages or durations 5, 6 . In this study, we observed these four different scoring methods had similar efficacy in distinguishing common type from severe type patients, which provided sufficient and direct evidence that the research outcomes from the previous researches 5,6 that employed either CT scoring method were highly comparable. Additionally, since scoring based on lung lobes is more convenient than that based on lung segments, we suggested that the lobar based assessment method may be more suitable for clinical application.

Semi-quantitative methods will inevitably encounter the ceiling effect on assessing lung lesions, leading to potentially biased results; however, no relevant evidence have been clarified. Recently, lesion volume measurement has become a promising approach for absolutely quantifying the disease burden for NCP, and has been shown to have the ability to predict the disease progression 13 . In theory, the measurement of lung lesion volume can accurately reflect the burden of the lesion and may be more helpful in distinguishing patients with different clinical severities. However, it was surprising that the quantitative method based on lesion volume measurement in this study did not show any advantage in distinguishing the severity of the disease. Compared with semi-quantitative methods, quantitative evaluation had higher specificity but lower sensitivity. We would like to www.nature.com/scientificreports/ argue that, since patients with severe NCP have high risk of disease progression and mortality, for the purpose of improving the prognosis, timely identifying patients with severe type should be prioritized, giving enough time for clinical interventions; therefore, the semi-quantitative method with relatively high sensitivity is more qualified. Moreover, the time-cost of lesion assessment is another important consideration. Very recently, Mei et al. proposed an artificial intelligence system to help rapidly diagnose COVID-19 patients by integrating chest CT findings, clinical symptoms, exposure history and laboratory testing 23 , which gives an innovative and timesaving application of deep learning to public emergent events. Likewise, a deep learning framework, specifically for automatic segmentation of inflammatory lesion, should have a promising potential to maximally reduce labor time. However, such artificial intelligence model is still undergoing development and only used locally 24, 25 , precise volume quantification is largely dependent on manual segmentation currently, which is consuming precious time and energy, making it difficult to be widely clinically applied. Taken together, these data disclosed that semiquantitative method, e.g., the lobar lesion assessment, is more optimal measurement for urgent usefulness in identifying severe COVID-19 patients with high diagnostic sensitivity and low time-cost.

As presented in the demographic information, the patients with severe type were older than the patients with mild type and common type. We searched for relevant evidence for such clinical status and further revealed that, the lung lesion loads in the old patients, measured by all the four methods, were higher than that in the young patients with an ascending tendency, indicating older patients may be more susceptible to be severely affected by the SARS-CoV-2 infection. Previous studies have reported that the elderly have a higher mortality rate among COVID-19 patients, and the elderly account for a larger proportion of deaths 2,26 . This phenomenon may be related to poor immunity and complicated underlying diseases (such as diabetes, coronary heart disease, etc.) in the elderly 2, 27 , which was also demonstrated during the SARS epidemic 28 . Therefore, we speculated that the higher lung lesion load in the older patients can be one of the important predictors reflecting the serious underlying inflammatory response leading to a poor prognosis in this special population. Of note, the timesaving methods, like the lobar lesion assessment, also performed well in the investigations compared with the time-costing method, volume quantification.

There were several limitations in this study. First, although patients from three hospitals were recruited, there was a lack of critical type patients among them. Therefore, it was impossible to assess whether the above methods could distinguish critical patients from other types. Second, because this was a retrospective study and a lot of patients were recruited from emergency clinic, thin-slice CT images were not commonly collected. Therefore, we www.nature.com/scientificreports/ used 5 mm-thick CT images for lesion interpretation and segmentation. Bias may be induced when comparing these results with that of thin-slice CT images. Third, this study only used the cross-sectional data and images of patients, and the value of the above methods in assessing longitudinal changes in lung lesion burden is not clear.

Both semi-quantitative and quantitative methods have excellent repeatability in measuring inflammatory lesions, and can well distinguish between common type and severe type patients. Lobar-based CT score with high sensitivity in identifying severe type patients, low time consumption and readily clinical availability is suggested to be a prioritized method for assessing the burden of lung lesions in COVID-19 patients.

Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia

Clinical characteristics of 113 deceased patients with coronavirus disease 2019: Retrospective study

CT imaging features of 2019 novel coronavirus (2019-nCoV)

Emerging coronavirus 2019-nCoV pneumonia

Chest CT findings in coronavirus disease-19 (COVID-19): Relationship to duration of infection

CT image visual quantitative evaluation and clinical classification of coronavirus disease (COVID-19)

Time course of lung changes at chest CT during recovery from coronavirus disease 2019 (COVID-19)

Evolution of CT findings in patients with mild COVID-19 pneumonia

Pulmonary sequelae in convalescent patients after severe acute respiratory syndrome: Evaluation with thinsection CT

Severe acute respiratory syndrome: Temporal lung changes at thin-section CT in 30 patients

Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: A descriptive study

Chest CT severity score: An imaging tool for assessing severe COVID-19

CT quantification of pneumonia lesions in early days predicts progression to severe illness in a cohort of COVID-19 patients

Lung Infection Quantification of COVID-19 in CT

General Office of National Health Committee C. Notice on the issuance of a program for the diagnosis and treatment of novel coronavirus

A guideline of selecting and reporting intraclass correlation coefficients for reliability research

Morphometric analysis of white matter lesions in MR images: Method and validation

Measurement and reliability: Statistical thinking considerations

The role of chest imaging in patient management during the COVID-19 pandemic: A multinational consensus statement from the Fleischner society

COVID-19 patients and the radiology department-Advice from the European Society of Radiology (ESR) and the European Society of Thoracic Imaging (ESTI)

The continuing evolution of COVID-19 imaging pathways in the UK: A British Society of Thoracic Imaging expert reference group update

A British Society of Thoracic Imaging statement: Considerations in designing local imaging diagnostic algorithms for the COVID-19 pandemic

Artificial intelligence-enabled rapid diagnosis of patients with COVID-19

The role of imaging in the detection and management of COVID-19: A review

Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for COVID-19

Epidemiology Working Group For NCIP Epidemic Response CCFD. The epidemiological characteristics of an outbreak of 2019 novel coronavirus diseases (COVID-19) in China

Clinical and immunological features of severe and moderate coronavirus disease 2019

Outcomes and prognostic factors in 267 patients with severe acute respiratory syndrome in Hong Kong

Anonymized data can be made available upon reasonable request to the corresponding author. 

X.G. designed the study, collected clinical data, performed statistical analyses, and wrote this manuscript; L.Y. designed the study, collected clinical data, performed statistical analyses and revised the manuscript; Y.T. and Z.S. collected clinical data and performed statistical analyses; H.Zhe., H.Zho., Y.G., Y.L., W.J. and H.Z. collected clinical data and the chest CT data; J.W. designed the study and performed statistical analyses. M.Z. and X.X. designed the study, guided the implementation of the study and revised the manuscript. All authors reviewed the manuscript and approved its content.

The authors declare no competing interests.

Correspondence and requests for materials should be addressed to M.Z. or X.X.Reprints and permissions information is available at www.nature.com/reprints.Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.