key: cord-0813652-mkf71ssg
authors: Shamila Ebenezer, A.; Deepa Kanmani, S.; Sivakumar, Mahima; Jeba Priya, S.
title: Effect of image transformation on EfficientNet model for COVID- 19 CT image classification
date: 2021-12-13
journal: Mater Today Proc
DOI: 10.1016/j.matpr.2021.12.121
sha: 4507f9482e92a5a139b766b1ae0d8bdf35cd8539
doc_id: 813652
cord_uid: mkf71ssg

The Novel Corona Virus 2019 has drastically affected millions of people all around the world and was a huge threat to the human race since its evolution in 2019. Chest CT images are considered to be one of the indicative sources for diagnosis of COVID-19 by most of the researchers in the research community. Several researchers have proposed various models for the prediction of Covid- 19 using CT images using Artificial Intelligence based algorithms [19], [20], [21]. EfficientNet is one of the powerful Convolutional Neural Network models proposed by Mingxing Tan and Quoc [18]. The objective of this study is to explore the effect of image enhancement algorithms such as Laplace transform, Wavelet transforms, Adaptive gamma correction and Contrast limited adaptive histogram equalization (CLAHE) on Chest CT images for the classification of Covid-19 using the EfficientNet algorithm. SARS- COV-2[14] dataset is used in this study. The images were preprocessed and brightness augmented. The EfficientNet algorithm is implemented and the performance is evaluated by adding the four image enhancement algorithms. The CLAHE based EfficientNet model yielded an accuracy of 94.56%, precision of 95%, recall of 91%, and F1 of 93%. This study shows that adding a CLAHE image enhancement to the EfficientNet model improves the performance of the powerful Convolutional Neural Network model in classifying the CT images for Covid-19.

Novel Coronavirus is a wide group of viruses that cause everything from a regular cold to more chronic infections like Middle East Respiratory Syndrome (MERS) and severe acute respiratory syndrome (SARS). In Wuhan, China, a new coronavirus (COVID-19) was found in 2019. This is a newly discovered coronavirus that has never been seen in people earlier. The majority of people affected with the COVID-19 virus will have minor to medium respiratory symptoms and this will recover fully without requiring additional care and treatment. Adults over the age of 65, including those with underlying health conditions such as cardiovascular disease, diabetes, chronic respiratory disease, and cancer, are at an increased risk of developing a serious illness. On January 30, 2020, the World Health Organization (WHO) announced a worldwide health emergency. To minimize the spread of illnesses, early treatment of illnesses is among the first lines of defense against this epidemic.

Presently, the starting point for diagnosing COVID-19 is a positive nucleic acid testing (NAT) report using reversetranscriptase polymerase-chain-reaction (RT-PCR) technology. The conventional testing tool, RT-PCR, is wellknown, but recent investigations have found that it has a significant risk of false negatives. The RT-PCR method for determining COVID-19 has a few shortcomings. As a result, chest CT has become an accurate imaging technique for COVID-19, which is performed in addition to clinical symptoms and epidemiological findings to identify the illness. CT scan images are also helpful for detecting COVID-19 with greater specificity and sensitivity, according to studies. To begin with RT-PCR, test kits are inadequately available, require additional time for testing, and checking sensitivity also varies. The CT scan images were effective in diagnosing COVID-19, resulting in more lives saved. In endemic Corresponding Author: A. Shamila Ebenezer Email: shamila_cse@karunya.edu areas, a CT scan of the chest is found to be crucial for COVID-19 identification. Due to the sensitivity and specificity results of CT scans, many different countries. now uses a clinical detection threshold based on optimal CT scan imaging symptoms. As a result, the images of the CT scan are a good replacement for the RT-PCR method. This paper aims to reduce the number of false-positive and false-negative where to try to save the human life and can provide better accuracy with other deep learning approaches.

Coronavirus is a subclass of RNA viruses that can cause dangerous serious diseases in people and animals. There have been more than 24.6 crore cases reported of coronavirus worldwide as of today, with around 44.3L of these instances leading to the death of the person infected. There are 216 countries, areas, or territories got affected by the coronavirus. The top four countries with the most instances are the United States, Brazil, India, and Russia. COVID-19 testing involves evaluating items that show the presence of severe acute respiratory syndrome-associated coronavirus. The state-of-the-art of Convolutional Neural Networks (CNNs) for diagnosing COVID-19 from chest Xrays automatically (CXRs) is presented in [12] . Different types of deep learning algorithms were investigated and identified the best algorithms were for the classification of CXR images. Investigations were done using 1345 viral images, 1341 healthy CXR images for deep analysis of COVID-19. From the observations, VGG16 and Mobile net were able to provide an accuracy of 98.28%. Still larger data set is required to weigh the performance of transfer deep learning with F1 score, specificity, sensitivity, and precision.

Automated detection of Covid-19 in X-ray and CT images using a machine learning approach is presented in [7] . For this approach, accurate feature extraction is playing a major role in learning. This method is considered a pool of methods of deep learning approaches. They are mobileNet, DenseNet, Xception, ResNet, IncepptionNet, NasNet,InceprtionResNet and VGNet. The extracted features were then fed into several machine learning classifiers to classify subjects as either a case of COVID-19 or a normal case. The findings of this research on a chest X-ray and CT dataset shows Densenet architecture trained by Bagging tree classifier was able to provide good accuracy on extracted features for classification of the images. The investigation on the elements that influence the quality of ImageNet pre-trained features by transfer learning [4] . The objective of this paper was to establish the importance of feature learning for training data, rather than to evaluate various neural network topologies. Using transfer learning, a significant reduction was observed in several images or the number of classes for training the data.

A new automatic prediction of COVID 19 disease using CT images with the integration of deep learning and machine learning techniques are developed in [10] . The DenseNet201 model has the best training results, with a good accuracy rate. The DenseNet201 model and KNN algorithm had the best result when combining pre-trained models with ML algorithms and were able to achieve very good accuracy. An integrated approach of five different transfer learning architectures such as Densenet 201, VGG19, Efficient Net, Mobile net, and ResNet to detect Covid-19 images [8] . The findings of this research reveal that transfer learning-based frameworks could be a viable alternative to the existing methods for detecting the occurrence of the infection in victims. The impact of using standard Histogram Equalization and Contrast Limited Adaptive Histogram Equalization on lung scans is also examined in the study. The VGG-19 architecture, when integrated with a dataset that uses Contrast Limited Adaptive Histogram Equalization, provided the highest overall results, with 95.75 percent accuracy.

KarNet, a simplified two-dimensional DL architecture, works well in identifying COVID-19 patients using lung CT scan images [3] . Karnet was a deep learning framework that combined the pre-trained models such as DenseNet201, VGG16, ResNet0V2, and MobileNet. This integrated model acted as the backbone of Karnet. Each model of this approach was developed and tested using both augmented and unaugmented datasets. Karnet model that utilized DenseNet201 produced a better identification ability when compared with other pre-trained models. DenseNet was able to produce 97% accuracy for the dataset. 

The SARS-CoV-2 computed tomography (CT) scan dataset [14] , which is openly accessible, is used in this study. The dataset comprises a collection of 2482 CT scans, out of which 1252 CT scans are of those positive for COVID-19 infection followed by 1230 CT scans for patients who are not infected by COVID-19. The information was gathered from genuine patients in a hospital in Sao Paulo, Brazil. The goal of this dataset is to promote the product development of artificial intelligence systems that can determine whether a person is affected with SARS-CoV-2 by analyzing his or her CT scans. Figure 1 illustrates a few samples obtained from the dataset for COVID and NON-COVID CT scans. 

The images were pre-processed and the dataset size is enhanced with brightness augmentation. Further, we applied the following five image transformation to enhance the images before it is fed to the EfficientNet algorithm. The adaptive gamma correction transformation technique is used to increase the visibility of the detailed information present in an image. This is done by increasing the brightness and contrast of an image without affecting any visual artifacts. The adaptive gamma correction defines the function which has intensity transformation based on the input image. It has several steps which include color transformation, image classification, and intensity transformation, enhancement of low-contrast image, and enhancement of the high-or moderate-contrast image.

The wavelet transform is to choose a function as the basic wavelet whose integral is zero in the time domain. We can obtain a family function by expanding and translating the fundamental wavelet, which could serve as a framework for the function space. By projecting the image onto the framework, we decompose the original image. Several scaling in the wavelet transform domain can give a time-scale expression to an image in the original time domain. Then we may get the most efficient image transformation domain. Figure 2 illustrates the original image with the output acquired from the four image transformation techniques. CLAHE is a histogram-based image enhancement method that limits amplification based on the clipping done in the histogram to limit it to a predefined level. It is a methodology for allocating projected intensity levels in medical data that has proven to be effective. The approach looks at a histogram of intensity in a contextual region focused on every pixel and adjusts the displayed brightness at that pixel to the ranking of that pixel's intensity in its histogram. The obtained histogram is a customized version of the standard histogram, in which the method's image contrast is shown at each intensity level [15] . CLAHE works by minimizing contrast enhancement, which is commonly achieved by a technique called Histogram Equalization [16] , which also results in noise augmentation. As a result, desired outcomes were attained in circumstances where noise became excessively noticeable by enhancing contrast, such as medical photos, by restricting contrast augmentation in Histogram Equalization. In simple terms, contrast enhancement is the slope of the function that connects the input picture intensity value to the desired resultant image intensities. The slope of this related function can be limited to reduce contrast [17] . In our work, the inclusion of CLAHE has aided in enhancing the overall accuracy rate.

The EfficientNet algorithm was originally introduced by [18] by offering an incredible method for scaling neural network models by enhancing depths, breadth, and precision. It is a convolutional neural network (CNN) design and scaling technique that applies a compounded coefficient to scale up all depth, width, and resolution dimensions evenly.

The EfficientNet scaling method consistently increases network breadth, depth, and resolution with a set of preset scaling parameters, contrasting standard practice, which adjusts these factors randomly The researchers started by creating a base network using a technique called neural architecture search, which automates the building of neural networks. On floating-point operations per second which in short is known as the "FLOPS" level, it optimizes both effectiveness and precision. The movable inversion bottleneck convolution called "MBConv" has been utilized in this architecture. Furthermore, the authors then scaled up the base network to create the EfficientNet class of deep learning methods. Figure 3 shows the EfficientNet-B0 setup, which is the most efficient. There are a total of 18 convolution layers, each having a k (3, 3) or k(3,3) kernel (5, 5) . The size of the input image is 224 by 224 pixels. The next layers are reduced in resolution to lower the size of the feature map but increased in width to improve accuracy. The second convolution layer, for example, has W = 16 filters, whereas the next convolution layer has W = 24 filters. For the last layer, which is sent to the fully connected layer, the maximum number of filters is D=1, 280.

The hyperparameters are set up during the model's training. To avoid overfitting during the training phase, an early stopping approach was adopted. At the moment where the validation loss value was the best, the models were registered. The models were trained using the Adam optimization technique. In this optimization, the learning rate is initially set to 0.0005. Figure 4 depicts the flow diagram carried out in our work. Initially, we have performed the necessary and requisite data processing methodology. This is followed by an image-enhancing step with the aid of the Contrast Limited Adaptive Histogram Equalization (CLAHE) technique. Once the enhancing process is completed, we load the reconstructed enhanced data into the EfficientNet algorithm. The obtained results for the proposed work are evaluated in terms of accuracy rate, precision, recall, and F1-score.

In this study, the effects of image transformation algorithms such as SMQT, Wavelet transform, Laplace transform and CLAHE were analyzed on the EfficientNet algorithm in the classification of the COVID-19 CT images. This study was conducted in a system with a corei5 processor 7th generation, 16 However, few of the evaluated image transforms showed a significant difference in the classification accuracy. Figure 6 shows the accuracy and loss of the EfficientNet algorithm with Laplace transformed images. The accuracy was comparatively lower than the EfficientNet algorithm without Laplace transformation. Figure 8 shows the accuracy and loss with adaptive gamma-corrected images. Though there is a slight increase in the accuracy there was no significant improvement. Figure 8 shows the accuracy and loss with Wavelet transform. Either the wavelet transform did not show a significant improvement. Figure 9 shows the accuracy and loss with CLAHE transformation. It is observed that there is a significant increase in accuracy compared to the other image transforms. Figure 5 shows the training and validation accuracy of the EfficientNet model. The model achieved a validation accuracy of 90.15%. The average of the 10 fold cross validation is given in Table 3 . As shown in Table 3 the performance metrics such as precision, recall and F1 for CLAHE transform are high compared to the other image transforms on the EfficientNet model.

This paper provides an efficient image classification using EfficientNet for COVID-19 detection using CT images. We used preprocessing to enrich the images before implementing the algorithm in this investigation. Our method can increase the visibility of the given image without affecting the visual artifacts of the image. Several transformation techniques were executed on EfficientNet such as Wavelet transform, Laplace transforms, adaptive gamma, and CLAHE. Among them, we were able to achieve an accuracy of 94.56% using CLAHE transformation on EfficientNet. Finally, chest CT imaging provides high sensitivity for COVID-19 diagnosis. To detect COVID-19 via CT images, we provide a very efficient approach using CLAHE transformation on EfficientNet strategy that outperforms state-ofthe-art approaches.

Explainable-by-design approach for covid-19 classification via ct-scan

Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CT

COVID-19 detection from lung CT-scan images using transfer learning approach

What makes ImageNet good for transfer learning?

Transfer learning methods for classification of COVID-19 chest x-ray images

Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning

Automatic Detection of Coronavirus Disease (COVID-19) in X-ray and CT Images: A Machine Learning Based Approach

Detection of COVID-19 from CT Lung Scans Using Transfer Learning

Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms

Detecting COVID-19 in chest images based on deep transfer learning and machine learning algorithms

Diagnosis of COVID-19 using CT scan images and deep learning techniques. Emergency Radiology

Transfer Learning to Detect COVID-19 Automatically from X-Ray Images Using Convolutional Neural Networks

A survey of transfer learning

SARS-CoV-2 CT-scan dataset: A large dataset of real patients CT scans for SARS-CoV-2 identification

Towards explainable deep neural networks (xDNN)

Contrast-limited adaptive histogram equalization: speed and effectiveness

Adaptive Histogram Equalization and Its Variations. Computer Vision, Graphics, and Image Processing

An approach for denoising and contrast enhancement of retinal fundus image using CLAHE. Optics & Laser Technology

EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

Artificial intelligence and machine learning to fight COVID-19

Identification of COVID-19 can be quicker through artificial intelligence framework using a mobile phone-based survey when cities and towns are under quarantine

Artificial intelligence (AI) applications for COVID-19 pandemic

Details of the 

☒ The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.☐The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: