key: cord-0479751-t779ue86 authors: Afshar, Parnian; Heidarian, Shahin; Enshaei, Nastaran; Naderkhani, Farnoosh; Rafiee, Moezedin Javad; Oikonomou, Anastasia; Fard, Faranak Babaki; Samimi, Kaveh; Plataniotis, Konstantinos N.; Mohammadi, Arash title: COVID-CT-MD: COVID-19 Computed Tomography (CT) Scan Dataset Applicable in Machine Learning and Deep Learning date: 2020-09-28 journal: nan DOI: nan sha: 8bf3c04910faf77832bbf2d8a992ac79bd7a53d1 doc_id: 479751 cord_uid: t779ue86 Novel Coronavirus (COVID-19) has drastically overwhelmed more than 200 countries affecting millions and claiming almost 1 million lives, since its emergence in late 2019. This highly contagious disease can easily spread, and if not controlled in a timely fashion, can rapidly incapacitate healthcare systems. The current standard diagnosis method, the Reverse Transcription Polymerase Chain Reaction (RT- PCR), is time consuming, and subject to low sensitivity. Chest Radiograph (CXR), the first imaging modality to be used, is readily available and gives immediate results. However, it has notoriously lower sensitivity than Computed Tomography (CT), which can be used efficiently to complement other diagnostic methods. This paper introduces a new COVID-19 CT scan dataset, referred to as COVID-CT-MD, consisting of not only COVID-19 cases, but also healthy and subjects infected by Community Acquired Pneumonia (CAP). COVID-CT-MD dataset, which is accompanied with lobe-level, slice-level and patient-level labels, has the potential to facilitate the COVID-19 research, in particular COVID-CT-MD can assist in development of advanced Machine Learning (ML) and Deep Neural Network (DNN) based solutions. Since its first emergence in late 2019, novel Coronavirus (COVID-19) has drastically changed the world, impacting several aspects of the modern life. According to the World Health Organization (WHO), as of September 2020, more than 200 countries have confirmed positive COVID-19 cases, leading to more than 30 million cases and almost 1 million reported fatalities. Considering statistics and impacts together with the fact that COVID-19 can easily spread if infected cases are not isolated/treated in a timely fashion, sensitive and accessible diagnosis systems are of significant importance. Reverse Transcription Polymerase Chain Reaction (RT-PCR) 1, 2 , which is currently considered as the gold standard diagnosis technique, suffers from relatively low sensitivity 3 . Furthermore, It was not easily accessible in the beginning of epidemic in most of the countries . More importantly, this test is time consuming that is not desirable as time is a critical factor in isolating, treating, and preventing the transition of COVID-19. Being able to identify COVID-19-related respiratory complications, Chest Radiographs (CXR) 4 , can play an important complementary role for the RT-PCR test to asses complications. Although, CXR can act as a quantitative method to assess the extent of COVID-19 involvement and estimate the risk of Intensive Care Unit (ICU) admission, it still has lower sensitivity compared to Computed Tomography (CT) 5 . Due to high sensitivity and rapid access, chest CT plays a significant role in diagnosis and management of COVID-19 and has been recognized as the most sensitive imaging modality to detect complications. Despite the high potential of CT in contributing to the COVID-19 research and clinical usage, publicly available datasets are mostly limited to a few number of cases, are not accompanied with other types of respiratory diseases to facilitate comparisons, and are not associated with suitable labels. Furthermore, cases may be collected from different sources with different imaging protocols, limiting a unified study. In a few identified datasets, available CT scans are limited to only infected slices, rather than the complete volume. Another important aspect that should be considered in the available datasets is that whether labels are available in a patient-level, slice-level, and lobe-level fashion. The later can further contribute to identify the location of the COVID-19 infection. Finally, different types of labels and information, suitable for different tasks, are provided in identified datasets. Table 1 provides an overview of the available datasets along with the provided COVID-19 related information. The introduced COVID-19 CT scan dataset, referred to as the COVID-CT-MD, is applicable in Machine Learning (ML) and deep learning studies of COVID-19 classification. In particular, COVID-CT-MD dataset consists of 171 confirmed positive COVID-19 cases (gathered from 2020/02/23 to 2020/04/21), 76 normal cases (gathered from 2019/01/21 to 2020/05/29), and 60 Community Acquired Pneumonia (CAP) cases (gathered from 2018/04/03 to 2019/11/24). All these cases are collected from Babak Imaging Center in Tehran, Iran, and labeled by three experienced radiologists in patient-level, slice-level, and lobe-level manners. Patient-level label refers to a single diagnosis assigned to the subject, whereas slice-level and lobe-level refer to identifying slices and lobes demonstrating infection, respectively. More importantly, the whole CT volume is available for all the subjects. COVID-CT-MD is presented in Table 1 , along with the previous datasets, to highlight its differences. Regarding Reference 6 , we would like to mention that while this Reference provides only COVID-19 and normal cases, COVID-CT-MD provides CAP cases additionally. Furthermore, COVID-CT-MD is the only classification-related dataset that contains lobe-level information, which can significantly improve and contribute to the localization and analysis of the COVID-19 infection. This section provides a description of the data collection procedure, inclusion criteria, and de-identification. Furthermore, detailed statistics of the data is presented to facilitate its usage. More importantly, applicability of the COVID-CT-MD dataset for development of ML/DNN solutions is explained. This section is concluded by describing the possible limitations of the provided dataset. This research work is performed based on the policy certification number 30013394 of Ethical acceptability for secondary use of medical data approved by Concordia University, Montreal, Canada. Furthermore, informed consent is obtained from all the patients. The COVID-CT-MD dataset contains volumetric chest CT scans of 171 patients positive for COVID-19 infection, 60 patients with CAP, and 76 normal patients. COVID-19 cases are collected from February 2020 to April 2020, whereas CAP cases and normal cases are collected from April 2018 to December 2019 and January 2019 to May 2020, respectively, in Babak Imaging Center, Tehran, Iran. Diagnosis of COVID-19 infection is based on positive real-time Reverse Transcription Polymerase Chain Reaction (rRT-PCR) test results, clinical parameters, and CT scan manifestations identified by three thoracic radiologists, with more than 20, 18, and 25 years of experience in thoracic imaging, respectively. Labels provided by the three radiologists showed high degree of agreement (more than 90%). Diagnosis for CAP and normal cases was confirmed using clinical laboratory tests, and CT scans. A subset of 55 COVID-19, and 25 CAP cases were analyzed by the radiologists to identify and label slices with evidence of infection. The labeled subset of the data contains 4,993 number of slices demonstrating infection and 18,416 number of slices without infection. All images are axial, with a reconstruction matrix (output size of the images) of 512 × 512, and are obtained from a SIEMENS, SOMATOM Scope scanner. Table 2 shows different CT acquisition settings, where Peak KiloVoltage (kVp) and Exposure Time affect the radiation exposure dose, while slice thickness represents the axial resolution. As shown in Table 2 , slice thickness, kVP, and exposure time are almost the same with a few variations in a few CAP cases. Distance of Source to detector and Distance of Source to patient, which are traditionally referred to as SID and SOD, respectively, are also the same in all cases except for a few CAP cases. The minimum and maximum exposure value (in mAs) used in the scanning process is also presented in Table 2 . The exposure value determines the total radiation dose in CT scan. The distribution of the exposure values is illustrated by the violin plots for each disease type in Figure 1 . Accordingly, the mean and standard deviation of the exposure values are reported in Table 3 . As COVID-19 is highly contagious, all the staff of the medical imaging department involved in the CT acquisition are provided with personnel protective equipment (PPE). More importantly, there is a minimum of 5-minute time slack between two consecutive CT scans, allowing enough time to sanitize the CT scanner. All cases with confirmed clinical diagnosis are included in the dataset. Nevertheless, during the data collection procedure, there were some cases related to the late 2019, with manifestations similar to those of COVID-19. However, as the first COVID-19 case in Iran is reported in early February 2020, these cases were excluded from the dataset. Furthermore, according to the radiologists' assessment, images with poor quality and visible artifacts were excluded. To respect the patients' privacy, we de-identified all the CT studies by removing the patients' name, birthday, and the name and address of the imaging center, as well as the operators' name from their headers. Some helpful information including patients' gender and age, the scanner type, and the image acquisition settings has been kept to preserve the statistical characteristics of the dataset. The demographic distribution of the dataset describing the gender and age distributions is illustrated in Table 4 and Figure 2 . As shown in Figure 2(a) , males outnumbered females in this dataset. The boxplot in Figure 2 (b) represents the important statistical parameters of the patients' age distribution. As shown in this boxplot, normal cases are mainly distributed in lower ages, while CAP cases are distributed in a wide range of ages with a higher average age. As previously stated, part of the dataset is analyzed and the slice-level labels are extracted. The number of labeled cases and slices demonstrating infection are presented in Table 5 . Infection ratio in this table represents the ratio of the slices demonstrating infection to the total number of slices in a CT scan, which varies for different cases based on the severity and stage of the disease. The minimum and maximum values for the infection ratio in the labeled dataset are presented in Table 5 . The distribution of the Infection Ratio is also illustrated by the boxplots in Figure 3 (a), which demonstrate a higher infection ratio in COVID-19 cases compared to CAP cases. The histogram of the Infection Ratio values is illustrated in Figure 3(b) . In addition to the described slice-level labels, the detailed distribution of infection in each lobe of the lung is provided by the radiologists. Table 6 indicates the number of cases and slices with infection demonstrated in specific lung regions. Similar to Figure 3 , where the infection ratio was presented for the total slices with infection in the lung, the average of lobe infection ratios are presented in Figure 4 , illustrating the average ratio of slices demonstrating infection in a particular lobe to the total number of slices in a CT scan. As evident in Table 6 and Figure 4 , the average infection ratio in the lower lobes is higher in both COVID-19 and CAP cases compared to other lung regions in our labeled dataset. Although all cases and labels are confirmed by three experienced radiologists, we would like to describe a few limitations that the data users may encounter. These limitations are as follows: • The slice and lobe labeling processes focus more on regions with distinctive manifestations rather than minimal findings. • Not all the COVID-19 patients have confirmed positive RT-PCR result, as this test was not publicly accessible in Iran at the time of the first emergence of the COVID-19. Furthermore, the high load of patients in need of COVID-19 examination, did not allow for an inclusive RT-PCR test. The diagnosis of some patients in the COVID-CT-MD dataset is confirmed based on the CT findings, as well as the clinical results. • Although most of the cases with low quality CT scans are excluded, there may still be some cases with mild motion artifact which is inevitable, since COVID-19 patients suffer from dyspnea. • During the slice and lobe labeling process, some suspicious areas adjacent to the chest wall and diaphragm are not labeled as "infected", due to their poor distinction. The diagram in Figure 5 shows the structure of the COVID-CT-MD dataset shared through Figshare 1 . COVID-19, CAP and Normal subjects are placed in separate folders, within which patients are arranged in folders, followed by CT scan slices in DICOM format. "Index.csv" is related to the patients having slice-level and lobe-level labels. The indices given to patients in "Index.csv" file are then used in "Slice-level-labels.npy" and "Lobe-level-labels.npy" to indicate the slice and lobe labels. "Slice-level-labels.npy" is a 2D binary Numpy array in which the existence of infection in a specific slice is indicated by 1 and the lack of infection is shown by 0. In "Slice-level-labels.npy", the first dimension represents the case index and the second one represents the slice numbers. "Lobe-level-labels.npy" is a 3D binary Numpy array in which the existence of infection in a specific lobe and slice is determined by 1 in the corresponding element of the array. Like the slice-level array, in "Lobe-level-labels.npy", the two first dimensions represent the case index and slice numbers respectively. The third dimension shows the lobe indices which are specified as follows: Two noteworthy parameters in the studies using CT scans are the quality control and calibration of the scanning device. The longest time period between the scanner auto-calibration and the study in the COVID-CT-MD dataset is 1 day, which ensures calibrated and accurate performance of the scanning device. Furthermore, there is an annual SIEMENS quality control that ensures the absence of ring artifacts in the acquired CT scans. With the increasing number of COVID-19 patients, healthcare workers are overwhelmed with a heavy workload, lowering their concentration for a proper diagnosis. Accurate and timely COVID-19 diagnosis, on the other hand, is a critical factor in preventing the disease transition, treatment, and resource allocation. Machine Learning (ML), in particular Deep Learning (DL) based on Deep Neural Networks (DNN), is shown to be practical and effective in COVID-19 diagnosis and severity assessment. The COVID-CT-MD dataset is specifically designed to facilitate application of ML/DL in COVID-19-related tasks. In particular, this dataset can be used towards: • A patient-level binary classification 7, 8 to distinguish COVID-19 from all other cases. • A patient-level multi-class classification 7 to identify COVID-19, CAP, and normal subjects. • A slice-level 9 and lobe-level classification to separate infected slices and lobes from non-infected ones for further analysis. • Slice-level and lobe-level labels can be used as additional inputs to segmentation models 10 , to focus on only infected slices. • Slice-level and lobe-level labels can be used in generative models to generate artificial COVID-19 images, towards increasing the security of the healthcare systems and developing attack resilient solutions 11 . We have utilized the COVID-CT-MD dataset in a recent study 12 , to classify subjects as COVID-19 or non-COVID (Normal and CAP). The model proposed in this study, referred to as the COVID-FACT, consists of two stages. In the first stage, infected slices (COVID-19 and CAP) are separated from healthy ones, through a developed Capsule Network. Consequently, in the second stage, infected slices are used to classify patients as COVID-19 or non-COVID, through another Capsule Network and an average voting approach. While the first stage exploits the provided slice-level labels, the patient-level ones are used in the second stage. Data users are encouraged to train and test their methods on the COVID-CT-MD dataset and compare their results, accordingly. A deep learning system to screen novel coronavirus disease A deep learning algorithm using ct images to screen for corona virus disease (covid-19) Correlation of chest ct and rt-pcr testing for coronavirus disease 2019 (covid-19) in china: A report of 1014 cases Chest x-ray in new coronavirus disease 2019 (covid-19) infection: findings and correlation with clinical outcome. La radiologia medica Chest x-ray has poor diagnostic accuracy and prognostic significance in covid-19: A propensity matched database study A fully automated deep learning-based network for detecting covid-19 from a new and large lung ct scan dataset Automated detection of covid-19 cases using deep neural networks with x-ray images Covid-caps: A capsule network-based framework for identification of covid-19 cases from x-ray images Automatic distinction between covid-19 and common pneumonia using multi-scale convolutional neural network on chest ct scans Inf-net: Automatic covid-19 lung infection segmentation from ct images Ct-gan: Malicious tampering of 3d medical imagery using deep learning Covid-fact: A fully-automated capsule network-based framework for identification of covid-19 cases from chest ct scans Covid-19 segmentation dataset Covid-19 ct lung and infection segmentation dataset (version verson 1.0) Covid-19 image data collection Mosmeddata: Chest ct scans with covid-19 related findings dataset Covid-ct-dataset: a ct scan dataset about covid-19 Sars-cov-2 ct-scan dataset: A large dataset of real patients ct scans for sars-cov-2 identification Table 2. CT scan settings used to acquire the COVID-CT-MD dataset. Diagnosis Slice Thickness (mm) Peak Kilovoltage (kVp) Exposure Time (ms) X-ray Tube Current (mA) SID (mm) SOD (mm) Exposure values (mAs) The Python code used to generate the statistical analysis and plots is shared within the same Figshare link (https://figshare.com/s/c20215f3d42c98f09ad0). This work was partially supported by the Natural Sciences and Engineering Research Council (NSERC) of Canada through the NSERC Discovery Grant RGPIN-2016-04988. The authors declare no competing interests.