key: cord-0754768-4hxwo5kt
authors: R., Mohammadi; M., Salehi; H., Ghaffari; A. A, Rohani; R., Reiazi
title: Transfer Learning-Based Automatic Detection of Coronavirus Disease 2019 (COVID-19) from Chest X-ray Images
date: 2020-10-01
journal: J Biomed Phys Eng
DOI: 10.31661/jbpe.v0i0.2008-1153
sha: 4c4fbc4bf43a59561411fc4d5dd326986f6074bd
doc_id: 754768
cord_uid: 4hxwo5kt

BACKGROUND: Coronavirus disease 2019 (COVID-19) is an emerging infectious disease and global health crisis. Although real-time reverse transcription polymerase chain reaction (RT-PCR) is known as the most widely laboratory method to detect the COVID-19 from respiratory specimens. It suffers from several main drawbacks such as time-consuming, high false-negative results, and limited availability. Therefore, the automatically detect of COVID-19 will be required. OBJECTIVE: This study aimed to use an automated deep convolution neural network based pre-trained transfer models for detection of COVID-19 infection in chest X-rays. MATERIAL AND METHODS: In a retrospective study, we have applied Visual Geometry Group (VGG)-16, VGG-19, MobileNet, and InceptionResNetV2 pre-trained models for detection COVID-19 infection from 348 chest X-ray images. RESULTS: Our proposed models have been trained and tested on a dataset which previously prepared. The all proposed models provide accuracy greater than 90.0%. The pre-trained MobileNet model provides the highest classification performance of automated COVID-19 classification with 99.1% accuracy in comparison with other three proposed models. The plotted area under curve (AUC) of receiver operating characteristics (ROC) of VGG16, VGG19, MobileNet, and InceptionResNetV2 models are 0.92, 0.91, 0.99, and 0.97, respectively. CONCLUSION: The all proposed models were able to perform binary classification with the accuracy more than 90.0% for COVID-19 diagnosis. Our data indicated that the MobileNet can be considered as a promising model to detect COVID-19 cases. In the future, by increasing the number of samples of COVID-19 chest X-rays to the training dataset, the accuracy and robustness of our proposed models increase further.

I n the present time, coronavirus disease 2019 (COVID- 19) is an emerging infectious disease and global health crisis. Originally, this virus was identified in Wuhan, China in December 2019 [1] . To date (on 28 July, 2020 at 10:46 GMT), 16 ,672,569 cases are infected by COVID-19 around the world with 657,265 deaths and 10,263,092 recovered cases [2] . In more severe cases, CO-VID-19 causes acute respiratory distress syndrome (ARDS), pneumonia, and respiratory failure. In fact, high pathogenic COVID-19 mainly infects the lower respiratory tract and actives dendritic and epithelial cells, thereby resulting in expression of pro-inflammatory cytokines that cause pneumonia and ARDS, which can be fatal [3] .

Real-time reverse transcription polymerase chain reaction (RT-PCR) is known as the most widely laboratory method to detect the CO-VID-19 from respiratory specimens, such as nasopharyngeal or oropharyngeal swabs [4] . RT-PCR is a sensitive method for diagnosing of COVID-19, but it suffers from several main drawbacks, including time-consuming, high false-negative results, and limited availability [5] [6] [7] . To resolve these drawbacks, the medical imaging techniques such as chest X-ray and computed tomography (CT) scan of chest to detect and diagnose COVID-19 can be use as alternative tools [8, 9] . The radiologists consider chest X-ray images over CT-scan as primary radiography examination to detect the infection caused by COVID-19 [10] due to high availability of X-ray machines in most of the hospitals, low ionizing radiations, and low cost of X-ray machines compared to CT-scan machine. Hence, in the present study, we preferred chest X-ray images over CT-scan. Chest X-ray images can easily detect COVID-19 infection's radiological signatures. It must be analyzed and diagnosed from chest X-ray images by using an expert radiologist. Of note, it is time-consuming and has susceptibility to detect erroneously [11] . Therefore, the automatically detect of COVID-19 from chest Xray images is required.

To date, several studies have used deep learning based methods to automate the analysis of radiological images [12] . Deep learning based methods have been previously utilized to diagnosis tuberculosis disease from chest X-ray images [13] . It is possible that weights of networks initialized and trained on a large datasets by using deep learning based methods and then fine tuning these weights of pretrained networks on a small datasets [14] . Owing to the limited available dataset related to COVID-19, the pre-trained neural networks can be utilized for diagnosis of COVID-19. However, these approaches applied on chest X-ray images are very limited till now [15] . To this end, the present study aimed to use an automated deep convolution neural network based pre-trained transfer models for detection and diagnosis of COVID-19 infection in chest X-rays.

This study was designed as a retrospective study.

Transfer learning is a machine learning technique which reuse a pre-trained model that has been used for a problem, on a new related problem [16] . In fact, transfer learning applied pre-trained models for machine leaning. In the analysis of medical data, one of the major research challenges for health-care researchers can be attributed to the limited available dataset [7] . Besides, deep learning models have several drawbacks such as a lot of data for training and data labeling that is costly and time-consuming [7] . Using transfer learning provides the training of data with fewer datasets. In addition, the calculation cost of transfer learning models is less. Over the last decades, using deep learning algorithms and convolution neural networks (CNNs) resulted in many breakthroughs in many fields such as industry, agriculture, and medical disease diagnostic [17] [18] [19] . CNN architecture aims to mimic human visual cortex system [11] . Basically, there are three main layers in CNN, including the convolution layer, the pooling layer and the fully connected layer [20] . The learning of model is performed by the convolution layer, the pooling layer, whereas the role of the fully connected layer is the classification [20] . Herein, four well-known pre-trained CNN models were applied to detect infection in chest X-rays. So, X-rays images were classified into two groups, normal or COVID-19: 1-VGG16, 2-VGG-19, 3-MobileNet, and 4-InceptionResNetV2. VGG architectures have been designed by Oxford University's visual geometry group [21] . VGG-16 consists of 13 convolutional layers and 3 fully-connected layers, whereas VGG-19 is a combination of 16 convolutional layers and 3 fully-connected layers [21] . Therefore, VGG-19 is considered as a deeper CNN architecture in comparison with VGG-16. MobileNet architecture has proposed by Howard et al., in 2017 [22] . The MobileNet model is built on a streamlined architecture that applies depthwise separable convolutions to build light weight deep neural networks. Depthwise separable convolutions are consisted of following layers: 1-depthwise convolutions and 2-pointwise convolutions [22] . In 2016, Szegedy et al., have proposed InceptionResNetV2, as a combined architecture [23] . This model applies the idea of inception blocks and residual layers together. The use of residual connections results in preventing problem of degradation associated with deep networks; hence, it decreases the training time [23] . InceptionResNetV2 architecture is 164 layers deep and can assist us in our mission to classify X-ray images into normal or COVID-19.

In the present study, an open-source dataset was used. COVID-19 chest X-ray images are available at this GitHub repository (https:// github.com/ieee8023/covid-chestxray-dataset) that has been prepared by Cohen et al, [24] .

The repository of images is an open data set of COVID-19 cases containing both X-ray images and CT scans and new images is regularly added. In this study, we used chest X-ray images to classify the COVID-19. At the time of preparing this study, the dataset consisted of about 181 COVID-19 chest X-ray images. As displayed in Table 1 , the number of training pairs were 348, 236 negative and 112 positive COVID-19 chest X-ray images. Also, 55 negative and 33 positive X-ray images were used to create validation datasets, while 73 negative and 36 positive images were used for testing purpose. Figure 1 shows some examples of the chest X-ray images taken from dataset.

Owing to the lack of uniformity in the dataset and the X-rays images with various sizes, we rescaled all the chest X-ray images. Of note, the samples in the dataset are limited; hence, the data augmentation techniques were implemented to resolve this problem. In addition, the image augmentation methods can result in improved classification model performance.

In this study, the data augmentation parameters were performed with a rotation range of 20, a zoom range of 0.05, a width shift range of 0.1, height shift range 0.1, shear range of 0.05, horizontal/vertical filliping, and filling mode called "nearest".

As stated earlier, the dataset containing CO-VID-19 chest X-ray images was used in our study, which it is publicly available on GitHub. Since the dataset obtained from multiple hospitals, the image resolutions differ from each other; hence, we rescaled the images and nor- malized pixels values to a range between zero and one. In our study, we used CNN-based method; therefore, it is not affected by adverse effects of the data compression used in the present study.

In this study, a CNN-based model was used to detect COVID-19 from the chest X-ray images. We have used four pre-trained CNN models, including VGG16, VGG19, Mo-bileNet, and InceptionResNetV2. We have not explained these models in detail because a lot number of studies have been described previously the applied parameters in these models. In brief, the architecture of these models consists of convolution, pooling, flattening, and fully connected layers. The aforementioned models (i.e., VGG16, VGG19, MobileNet, and Incep-tionResNetV2) were used for feature extraction. Then, a transfer learning model consist of five different mentioned layers was trained and applied on the COVID-19 dataset. These five different layers are considered as main part of the model. In other words, we have built a new fully-connected layer head comprising following layers: AveragePooling2D, Flatten, Dense, Dropout, and a last Dense with the "two-element softmax (sigmoid)" activation to predict the distribution probability of classes. AveragePooling2D layer is the first layer and average pooling operation is performed by this layer with pool size of (4, 4). Then, a flatten layer was used to flat the input. Flatten layers allows to change the shape of the data from 2-dimentional (2D) matrix of features into a vector that can be import into a fully connected neural network classifier. The aim of the dense layer is to transform the data. In other words, the transformed vector in the previous layer is input into a fully dense connected layer. This layer decreases the vector of height 512 to a vector of 64 elements. Then, a dropout with a threshold of 0.5 is applied to ignore 50% neurons. The purpose of this layer is to improve generalization. Finally, the last dense layer is used to reduce the vector of height 64 to a vector of 2 elements. The output of the classification model in this problem is two-class classification or binary classification.

In the present study, a transfer learning approach is adopted to assess the performance of the CNN architectures described here and compare them. Because radiologists must first distinguish COVID-19 chest X-rays from normal images, we decided to choose a CNN design that can identify COVID-19 and healthy people.

The networks were trained using the binary cross-entropy loss function and Adam optimizer with learning rate of 0.0001, batch size of 15, and epoch value of 100. Other parameters and functions used in training phase have been described in the Materials and Methods subsection 2.3. As aforementioned, we have implemented data augmentation techniques to enhance training efficiency and prevent the model from overfitting. In our study, neural networks were implemented with Python on a GeForce GTX 8 GB NVIDIA and 32 GB RAM. We used the Holdout method, as the simplest type of cross validation to assess the performance of our binary classification models. Training curve of accuracy and loss for each transfer learning model is shown in Figures 2 and 3 , respectively. Although number of epochs were set equal to 100, the all models were reached the stability with a number of epochs ranged between 28 and 30 because we used callback, as a powerful tool to customize the behavior of transfer learning models during training.

We calculated the confusion matrix and area under curve (AUC) of receiver operating char-acteristics (ROC) to evaluate the performance of each transfer learning model.

Confusion matrix or table of confusion is a table with two rows and two columns reporting four primary parameters known as False Positives (FP), False Negatives (FN), True Positives (TP), and True Negatives (TN). Figure 3 shows the performance of each transfer learning model for binary classification in the form of confusion matrix, aimed to distinguish COVID-19 chest X-rays from healthy X-rays. As shown in Figure 3 , the MobileNet model has the best classification performance. Four different performance metrics, including accuracy, precision, recall, and F-measure (F1score) are used to evaluate the classification accuracy of each transfer learning model. The above-mentioned metrics are considered as most common measurement metrics in ma- Table 2 , the all proposed models provide accuracy greater than 90.0%. The pre-trained MobileNet model provides the highest classification performance of automat- ROC curve is a 2D graphical plot, plots between the true positive rate (sensitivity) and the false positive rate (specificity). In fact, the ROC curve represents the trade-off between sensitivity and specificity [25] . Herein, the ROC curve with true positive rate on the y-axis and false positive rate on the x-axis of each transfer learning model is plotted, as shown in Figure 4 . Also, we have calculated the AUC of ROC curve, as effective way indicating the accuracy of ROC produced by each transfer learning model. The AUC represents a measure of how well a parameter can discriminate between the COVID-19 and healthy groups. The plotted AUC of ROC of four different models is shown in Figure 4 . As displayed in Figure 4 , the plotted AUC of ROC of VGG-16, VGG-19, MobileNet, and InceptionResNetV2 models were 0.92, 0.91, 0.99, and 0.97, re-spectively. In the field of medical diagnosis, these values are considered to be "excellent".

In this study, we proposed four pre-trained deep CNN models, including VGG-16, VGG-19, MobileNet, and InceptionResNetV2 for discriminating COVID-19 cases from chest X-ray images. From our data, it can be seen that VGG-16, VGG-19, MobileNet, and In-ceptionResNetV2 achieved the overall accuracy 93.6%, 90.8%, 99.1%, and 96.8% for binary classification, respectively. In addition, our data show that the precision (positive predictive value) and recall (sensitivity) for CO-VID-19 cases are interesting results. It should be noted that an encouraging result is higher recall value that represents low FN case. This is important because the proposed models should be able to reduce missed COVID-19 cases as much as possible, as most important purpose of the present study. The results of our study show that VGG-16 and MobileNet achieve best precision of 97.0% and 100%, respectively. Furthermore, the MobileNet and InceptionResNetV2 models provided the same performance classification with recall of 98.0%, as shown in Table 2 . Table 3 summarizes the recent studies on the automated detection of COVID-19 from chest X-ray and CT images. As observable in Table  3 , the results achieved by our proposed models are similar or even superior compared to previous similar studies. Several group of researcher have attempted to develop an automated model to diagnose COVID-19 accurately. Hemdan et al., have proposed COVIDX-Net model to detect COVID-19 cases from chest X-ray images [26] . Their model achieved an accuracy equal to 90.0% using 25 COVID-19 positive and 25 healthy chest X-rays. In another study, a residual deep architecture called COVID-Net for COVID-19 diagnosis has been designed. The results of that study indicate that COV-ID-Net provides an accuracy of 92.4% using medical images obtained from various open access data [27] . Apostolopoulos Table 3 : Summary of the recent study on the automated COVID-19 detection for diagnosis of COVID-19 infection and has a very slow process. In contrast, the RT-PCR is relatively fast and can diagnose COVID-19 in around 4-6 hours. However, the RT-PCR testing has several limitations such as limited availability, high cost, shortage of the kit. As such, this molecular assay is time-consuming. Of note, when we consider the magnitude of COVID-19 pandemic throughout the world, the RT-PCR is not very fast. The aforementioned limitations can be resolved with our proposed pre-trained deep CNN models, in particular MobileNet. The proposed models in the present study are able to detect the COVID-19 positive case in less than 2 seconds. Our proposed models achieved the accuracy more than 90% with the limited patient data that we had. Furthermore, the MobileNet and InceptionResNetV2 models provide 98% true positive rate. From the discussions, it can be understood that our proposed models achieved the promising and encouraging results in detection of COVID-19 from chest X-ray images, as compared to recent methods proposed by the state-of-the-art. Data indicate that deep learning plays a great role in fighting COVID-19 pandemic in near future. Our model must be validated by adding more patient data to the training dataset. In this study, our proposed models based on chest X-ray images aimed to improve the CO-VID-19 detection. The proposed models can reduce clinician workload significantly.

In this study, we presented four pre-trained deep CNN models such as VGG16, VGG19, MobileNet, and InceptionResNetV2 are used for transfer learning to detect and classify COVID-19 from chest radiography. The all proposed models were able to perform binary classification with the accuracy more than 90.0% for COVID-19 diagnosis. MobileNet model achieved the highest classification performance of automated COVID-19 detection with 99.1% accuracy among the other three proposed models. Our data indicated that the MobileNet can be considered as a promising model to detect COVID-19 cases. This model can be helpful for medical diagnosis in radiology departments. A limitation of our study is the use of the insufficient number of COV-ID-19 chest X-ray images. In the future, by increasing the number of samples of COVID-19 chest X-rays to the training dataset, the accuracy and robustness of our proposed models increase further.

Lung infection quantification of covid-19 in ct images with deep learning

COVID-19 pathophysiology: A review

Detection of SARS-CoV-2 in Different Types of Clinical Specimens

Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases

Detection of Coronavirus Disease (COVID-19) Based on Deep Features

Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks

COVID-19): A Perspective from China

Essentials for Radiologists on COVID-19: An Update-Radiology Scientific Expert Panel

Deep learning approach for microarray cancer data classification

Problems of Deploying CNN Transfer Learning to Detect CO-VID-19 from Chest X-rays

Fusion of medical images using deep belief networks

Convolutional neural network based detection and judgement of environmental obstacle in vehicle operation

Efficient prediction of drug-drug interaction using deep learning models

COVID-DenseNet: A Deep Learning Architecture to Detect COVID-19 from Chest Radiology Images

A Study on CNN Transfer Learning for Image Classification. Springer International Publishing: Advances in Computational Intelligence Systems

Introduction of a new Dataset and Method for Detecting and Counting the Pistachios based on Deep Learning

Comprehensive electrocardiographic diagnosis based on deep learning

Deep learning for big data applications in CAD and PLM -Research review, opportunities and case study

Simple convolutional neural network on image classification. 2nd International Conference on Big Data Analysis

Very deep convolutional networks for large-scale image recognition

Mobilenets: Efficient convolutional neural networks for mobile vision applications

Going deeper with convolutions

Covid-19 image data collection: Prospective predictions are the future

What's under the ROC? An introduction to receiver operating characteristics curves

Covidxnet: A framework of deep learning classifiers to diagnose covid-19 in x-ray images

COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Images

Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks

A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19)

Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label

None