key: cord-0906153-o0baleyt
authors: Al-ali, Afnan; Elharrouss, Omar; Qidwai, Uvais; Al-Maaddeed, Somaya
title: ANFIS-Net for automatic detection of COVID-19
date: 2021-08-27
journal: Sci Rep
DOI: 10.1038/s41598-021-96601-3
sha: a4e4a2049a4e056f1fa7e71cf32753b2a6f19fbe
doc_id: 906153
cord_uid: o0baleyt

Among the most leading causes of mortality across the globe are infectious diseases which have cost tremendous lives with the latest being coronavirus (COVID-19) that has become the most recent challenging issue. The extreme nature of this infectious virus and its ability to spread without control has made it mandatory to find an efficient auto-diagnosis system to assist the people who work in touch with the patients. As fuzzy logic is considered a powerful technique for modeling vagueness in medical practice, an Adaptive Neuro-Fuzzy Inference System (ANFIS) was proposed in this paper as a key rule for automatic COVID-19 detection from chest X-ray images based on the characteristics derived by texture analysis using gray level co-occurrence matrix (GLCM) technique. Unlike the proposed method, especially deep learning-based approaches, the proposed ANFIS-based method can work on small datasets. The results were promising performance accuracy, and compared with the other state-of-the-art techniques, the proposed method gives the same performance as the deep learning with complex architectures using many backbone.

www.nature.com/scientificreports/ For brain tumor detection [9] [10] [11] [12] [13] [14] [15] [16] [17] ANFIS achieved great results with an accuracy range of 96-99%, and for bone cancer detection 18 the accuracy was 93%. Breast cancer detection [19] [20] [21] [22] , the detection was never better and the ANFIS classifier achieved an accuracy of the range 91-99%. Finally, in chest diseases detection 23, 24 ,the performance accuracy was around 98%.

Currently, there is no existing classification on COVID-19 done by researchers using fuzzy system, rather it was used to predict an infected, individuals time series and the rate of deaths. As in 25 an improved model of ANFIS was proposed using both an enhanced flower pollination algorithm (FPA) and salp swarm algorithm (SSA) to predict the confirmed cases of COVID-19 within ten days. FPASSA-ANFIS performed better then the state-of-the-art prediction models in terms of all the evaluation metrics used for their tests.

A study of risk assessment of COVID-19 26 was proposed based on Fuzzy logic prediction system. It was successfully demonstrated to take into account the changes in risk over time.

In 27 an adaptive Neuro Fuzzy Inference System (ANFIS) classifier and multi-layered perceptron-imperialist competitive algorithm (MLP-ICA) was proposed to estimate the time series and the death rate of infected individuals.

Recent COVID-19 researches are either providing aid techniques for protection or for early diagnosis.Many significant studies are adopted for the first group like in telehealth services 28 , wearable technology 29 , breathing aid devices 30 and detection tool of unwearable mask people 31 .The other group also adopted some successful experiments for diagnosis and automated detection mostly depends on deep learning techniques. In 32 a model of deep learning was proposed for automatic detection of coronavirus from X-ray datasets and classify them for both binary and multi class using Dark Net model which consists of 17 CNN and YOLO object detection system. A drawback of this technique is the limitations of COVID-19 CXR images. Another deep CNN model in 33 was proposed for detecting COVID-19 from X-ray images by building a huge dataset of 13,975 CXR images named COVIDx dataset to evaluate their model which was among the first open access resource for detecting COVID-19 from X-ray images by designing an initial prototype using lightweight residual projectionexpansion projection-extension (PEPX) design pattern for analyzing the crucial features of the virus. Here the dataset is unbalanced with only 358 CXR images of COVID-19 compared with nearly 13,000 CXR images of the other two classes (pneumonia and Normal).

One more new framework of deep learning namely COVIDX-Net for diagnosing this virus from X-ray images was presented in 34 to assist radiologists. This system consists of seven different models of deep convolutional neural network they are: VGG19, DenseNet121, InceptionV3, ResNetV2, Inception-ResNet-V2, Xception, and MobileNetV2, where the accuracy was found to be around 60% to 90% and this still needs to be improved.

In 35 Deep transfer learning was proposed on the basis of the use of three forms of convolutionary neural networks (ResNet50, InceptionV3 and Inception-ResNetV2) using CXR images for automatic prediction of COVID-19 patients where ResNet50 showed the best classification results among the rest with accuracy of 98%.Despite the good performance, the dataset was very small with only 50 CXR images for both classes (COVID-19 vs Non-COVID). Another example of transfer learning in 36 which was a combination between CNN and RNN achieved high accuracy reached to 99.9 based on VGG19-RNN architecture for three classes (COVID, Pneumonia, non COVID), nevertheless, the dataset need to be updated as it is very small. For more efficient computing 37 , proposed a light CNN model with shallow structure to automatically detect COVID-19. The accuracy was promising compared with the state of the art at the time the research was done. However, the data set was small as well.

A combined model of deep learning and simple CNN was demonstrated 38 to be applied on mixed data set of CXR images and CT scan with an accuracy which reached to 94.4%, that can be improved more if the dataset was larger. A comparison among 9 fined tuned pre-trained models was demonstrated for automatic detection in pneumonia datasets 39 . This comparison was applied on mixed data set as well for CT scan and CXR images and the accuracy was around 80%-90%.

There are some other techniques other than deep learning which were used for the automatic detection of COVID-19 like in 40 where an ensemble classifier was used as an automatic screening system for diagnosing COVID-19 from the chest X-ray where the accuracy was around 98% but was tested on small size dataset. Another ensemble classifier was tested in 41 combining four binary machine learning classifiers (random forest, support vector machine, decision tree, and AdaBoost) with accuracy reached to 98.91%. Also, a kernel and linear kernel SVM classification model was developed in 42 to carry out 2 classifications (COVID and normal) and 3 classifications (COVID, pneumonia and normal) after a feature extraction procedure using several forms of convolutionary neural network. The results were promising which reached to 100% with 2 classes and 97.3% with 3 classes but still the slow processing time with neural network is the weakness here.

Another research that used CNN as feature extractor is in 43 combining this network with Long-Short term memory (LSTM) for automatic diagnosis of COVID-19 from chest X-ray data set with accuracy 99.4%.

With this it is clear that there's a need to test new model trained on a large dataset with better accuracy to detect COVID-19 which is explored here.

Several classification methods have been proposed for automatic detection of COVID-19 since it started, and almost all of them were built upon deep learning models. We chose to use the Fuzzy logic idea in this research for two reasons:

The first is that most concepts in medical field are fuzzy which make them difficult to measure or formalize and the fuzzy system seems a sufficient solution to deal with this type of dataset. The second reason is that, first part of the literature review showed how the Adaptive Neuro Fuzzy Inference system (ANFIS) classifier is effective in classification process with very high accuracy reaching to 99% and it is the time to use this classifier for COVID detection as this is the recent situation. The size of dataset used in related experiments of ANFIS in other medical fields were not larger than 500 images which is not the case of this experiment which has a very large dataset. www.nature.com/scientificreports/ In this research study, we use the adaptive Neuro Fuzzy Inference framework based on subtractive clustering technique to detect COVID-19 from a large data set of X-ray images. We used a Gray level Co-occurrence mathematical technique to extract the spatial features between image pixels, where four features are extracted: correlation, contrast, energy and homogeneity. We add two more features, they are mean and variance calculated from the image histogram. These six features were calculated for each image representing a raw image dataset for usefulness of accurate classification decision. After feature extraction, the dataset is prepared to be used as an input to the ANFIS -Net to be classified. The flow chart below in Fig. 1 describes the steps to accomplish this objective. And the latter subsections describes each move in more details.

For pre-processing, each image in the data set is converted to gray scale and resized to 512 × 512 then they were normalized to decrease the computational complexity.

To extract the required features, a gray-level co-occurrence matrix (GLCM) technique is performed. It is a mathematical method that considers the spatial pixel relationship in the image. This function computes how often a specific value of a pair of pixels occurring in an image (this characterizes the texture of the image) 18, 19 . This computing occurs within 45 degree interval in four specific directions: 0, 45, 90 and 135 and scalar distance (number of neighbour pixels). The first step of the GLCM algorithm is to calculate the GLCM matrix from the test image by initializing a two pixel GLCM matrix in any of the previously mentioned directions, and then generating a symmetric matrix by summing the latter with its transpose. Finally, divide each element of this matrix by the number of pixel pairs to get the normalized version of GLCM matrix. From this final version, the correlation, contrast, energy and homogeneity features are calculated 44 . Two more features, that are mean and variance were computed from the histogram distribution of each image representing another statistical information included in the image 45 . Algorithm 1 summarizes the procedure of feature extraction from GLCM matrix and from the image. The first four features are extracted from GLCM, they are: The Contrast (represents a measure of the intensity contrast between each pixel and its neighbor over full image), the Correlation (represents a measure of pixel correlation with its neighbor over the whole image),the Energy (it is the total amount of the GLCM square parameters) and Homogeneity (the distributed similarity of the elements in the GLCM to its diagonal). Mean and variance features are extracted from the histogram of the image, where mean is the image's intensity average value and variance represents the way the pixels are spread 18, 45, 46 . www.nature.com/scientificreports/ Here i, j in Algorithm 1 are the rows and columns respectively of the GLCM matrix and p (i, j) demonstrates the relative position of the pixels in the matrix. δ and µ depict the variance and the mean of the image itself. respectively 18,45 . Classification step. After the feature extraction step, a subtractive clustering technique based on neuro fuzzy logic classifier is adopted. The next sub sections will explain the structure of this classifier and the detail of its technique.

ANFIS classifier structure. The extracted features are applied to the adaptive neuro fuzzy inference system. ANFIS classifier is a mixture of neural and fuzzy inference system networks 18 and its architecture is constructed by five layers as shown in Fig. 2 45, 47 .

The input values enters the first layer (The Fuzzy layer) which determines the membership functions belonging to each one, that's why it is called fuzzification layer. In this step each input will have its own group of membership function or the set that it is transformed to, for example here x and y are the initial membership functions, A1 and B1 represent the values of these memberships. f1 is the output and the consequent parameters are p1,q1 and r1.These membership functions are computed by using the premise parameters a, b, c

The rules layer is the second layer which generates the firing strengths for the rules.The outcome of every node is represented by the product of all incoming signals 47 .

The third layer is the normalization layer, its role is to normalize these firing strengths by computing their sum and dividing each value on it

The fourth layer is the defuzzy layer that takes the normalized values as input as well as the consequence parameters p, q, r. In this fuzzy system, the output is the weighted sum of their inputs added by a constant. The output of this layer is the defuzzification parameters.

The fifth layer (The output layer) computes the average of each rule output giving the final output of the system.

(1) www.nature.com/scientificreports/ The default optimization algorithm for ANFIS parameters during the training part of this classification process is the hybrid learning algorithm. It is a mixture of two passes of back propagation and least squares methods: forward and backward. Each pass is used to update a type of parameter 24 . In the forward path, the premise parameters are modified using the gradient decent and during the backward pass the consequent variables are updated and the performance depends on them 48 . The selected features are provided as inputs to the first layer to be trained by ANFIS classifier during the training mode. The output of this part is a trained element 'f ' . During the testing part, this process is repeated on the features of the test dataset and produces a binary output corresponding to the classes from the fifth layer 45, 47 .

Subtractive clustering technique. There are two methods to implement the fuzzy parameters of ANFIS in MAT-LAB, the grid partitioning and subtractive clustering. The grid partitioning is the default method which used to generate rules based on the given membership function and divide the data set into arbitrary partition. For each membership function, a rule will be generated, so that if the total numbers of variables increase, the generated rules will be increased exponentially causing a problem of dimensionality and this technique is sufficient for small data set 24, 48, 49 .

On the other hand, subtractive clustering is another technique where each data point is labeled as a cluster center and the number of generated rules will be independent on the number of variables and will be linear to the data points 49, 50 . For each data point, the probability of the frequency of the neighbors data points will be determined, allowing the high potential to be chosen as the first cluster core. The influence range (cluster radius) is then used to delete all data points in the range of the first cluster core (the usually used values are between 0.2 and 0.5). The smaller ranges of this factor will produce more clusters.This process is repeated until all the cluster centers are chosen within the range of influence. There is also squash factor which is used to scale the range of influence and in order to generate more and small clusters,a small value of squash factor should be chosen because this will reduce the ability to consider the outlying points as part of the cluster (usually 1.25). Accept ratio is also used to consider all the data points above the first cluster center and reject ratio is defined as the value which is below the first cluster, is rejected as a cluster point, both these two later values are between 0 and 1 and the accept ratio should be higher than the reject value 50, 51 .

In this research study, we tested the impact of subtractive clustering parameters on classification process by applying 12 tests starting from the default values until we reached the best results in test 12 with 5 folds cross validation to avoid over fitting, as we will explain later in detail, and then compared our work with some of the state of the art techniques.

Data set description. The dataset which used in our experiment is the updated version of the dataset mentioned in 43 , but for our experiment of binary classification, we only selected two classes that consist of 2000 Images, 1000 of COVID-19 and 1000 of non COVID-19 and for this analysis, it is divided into 70% training (1400 images) and 30% for testing (600 images), Fig. 3 shows sample of the dataset. Two more evaluation metrics are used, they are: sensitivity: it is the capability of our model to efficiently recognize the positive cases of COVID-19 specificity: it is the capability of our model to efficiently recognize the Normal cases 

To analyze the performance of ANFIS for the classification process, 12 tests have been done to check the effect of the subclustering parameters to get a high accuracy without over-fitting the data and in short period of time. Table 1 shows the selected values for each test with its corresponding performance results.

In test 1, all the parameters' values used are default and it shows low accuracy about 0.688, while the generated rules were only 17; the only advantage is the short processing time. In test 2 and test 3, we reduced the radius of the clusters by reducing the range of influence to generate more clusters and the performance improved rapidly to be 0.955 in test 2. which inspired us to reduce more, so we got a significant improvement in performance to reach almost 0.998 in test 3, but the drawback in test3 is that it lasts for more than 6 hours (for both training and testing) which is very long time and unpractical. Figure 4 shows the impact of reducing the range of influence on accuracy starting from test 1, 2 and 3.

Test 4 and 5 were about checking the effect of decreasing the values of accept factor and reject factor and it seems from the testing results that neither reducing the accept factor nor the reject factor produce a noticeable effect on performance. and the accuracy is around 0.70 to 0.73 which is better than the accuracy when using the default values in test 1 but it can be improved more. Figure 5 shows the impact of changing these two factors on accuracy.

From test 6 till test 9, we checked the effect of squash factor while keeping the default values for the rest of the parameters. The model showed a progress in its performance and the processing time was also short, which is the goal of this experiment. Figure 6 displays this promising relation between Squash factor and model accuracy in these 4 tests. In test 10, we selected the best values of all the parameters from the previous tests and gathered them in one more experiment (0.2 for range of influence, 0.25 for squash factor, 0.2 for accept factor and 0.1 for www.nature.com/scientificreports/ reject factor), the accuracy was good and the processing time was acceptable, so in test 11, we added smaller value for the range of influence to be 0.1 as this factor has big effect on improving accuracy as we mentioned before, and the accuracy was promising with 0.978 as shown in Fig. 7 .

As a final experiment, and in order to improve the accuracy more, we did one last test with the previous selected values (in test 11) but changed only the value of Squash factor as it is considered as the second effected factor on enhancing the findings of the model in case of large data set,to be 0.1. The accuracy we got from this test was the best compared with all the other tests to be 0.9867 in 30 min.

The above experiments showed that the range of influence has a high impact on the performance of the model but it takes long time in training and for this reason, squash factor is an alternate choice to reach the good accuracy results and in short time of training. In addition, we noticed that decreasing these two factors, generates more rules but also increases the processing time as it is shown in Fig. 8 . An ROC cure for each test is www.nature.com/scientificreports/ shown in Figs. 9 and 10 and based on the findings of this study, clinicians are highly recommended to apply this technique as an appropriate option for early diagnosis of COVID-19 infection and we hope to be used within the clinical routine in the future. Despite the good accuracy obtained from using deep learning techniques in automatic detection of COVID-19, we decided to follow a new direction by using the Fuzzy system for classification process which proved its ability to compete the other techniques. Table 2 shows The efficiency of the proposed model compared to the state-of-the-art detection techniques. The performance measures showed a high accuracy that outperform many of the recent techniques used for classifying COVID-19 X-ray images.

The objective of this research is to use the Adaptive Neuro Fuzzy Inference System (ANFIS) based on subtractive clustering in classification and analyze the effect of its parameters in dealing with large data set of X-ray Images. To achieve this goal, 12 tests have been done until we reached the best performance of our model with 0.9867 accuracy. From these tests, we can conclude that small range of influence will produce large number of rules and more clusters and this results in high accuracy in classification but it takes long time in training which makes it insufficient for real applications, specifically with early diagnosis of diseases like COVID-19. On the other hand, Squash factor also has a valuable effect when its value is small which causes more clusters, and combining it with reasonable value of range of influence factor will lead to high accuracy in very short time.The other two parameters of this classifier which are the accept factor and the reject factor have no noticeable effect on accuracy of classification.

As a future work, it could be possible to try using ANFIS classifier in combination with other feature selection techniques and with optimization techniques to improve its performance specifically in terms of processing time which considered a remarkable limitation when using this classifier with large data set. www.nature.com/scientificreports/

We used the updated dataset mentioned by Islam et al. 43 which is publicly available dataset.

The code of this work will be provided on request.

Received: 1 February 2021; Accepted: 4 August 2021

Role of intelligent computing in COVID-19 prognosis: A state-of-the-art review

Almaadeed, N. & Al Maadeed S. BEMD-3DCNN-Based Method for COVID-19 Detection

A review on deep learning techniques for the diagnosis of novel coronavirus (COVID-19)

Deep learning applications to combat novel coronavirus (COVID-19) pandemic

Predictive data mining models for novel coronavirus (COVID-19) infected patients' recovery

An encoder-decoder-based method for COVID-19 lung infection segmentation

Fuzzy-based medical image processing

Handbook of Biomedical Imaging: Methodologies and Clinical Research

Brain tumor classification using adaptive neuro-fuzzy inference system from MRI

Brain tumor detection and diagnosis using ANFIS classifier

Brain cancer diagnosis and prediction based on neural gas network and adaptive neuro fuzzy

Optimal feature-level fusion based ANFIS classifier for brain MRI image classification

Glioma tumor detection in brain MRI image using ANFIS-based normalized graph cut approach

Performance analysis of ANFIS based brain tumor detection algorithm

Image registration-based brain tumor detection and segmentation using ANFIS classification approach

ANFIS to detect brain tumor using MRI

Bone cancer detection and classification using fuzzy clustering and neuro fuzzy classifier

Image registration based cervical cancer detection and segmentation using ANFIS classifier. Asian Pac

Adaptive clustering based breast cancer detection with ANFIS classifier using mammographic images

Computer aided segmentation and classification of mass in mammographic images using ANFIS

Screening and early identification of microcalcifications in breast using texture-based ANFIS classification

Lung cancer segmentation and diagnosis of lung cancer staging using MEM (modified expectation maximization) algorithm and artificial neural network fuzzy inference system (ANFIS)

Lung cancer recognition using radon transform and adaptive neuro fuzzy inference system

Optimization method for forecasting confirmed cases of COVID-19 in China

An interpretable mortality prediction model for covid-19 patients-alternative approach

COVID-19 pandemic prediction for Hungary; a hybrid machine learning approach

Scalable telehealth services to combat novel coronavirus (COVID-19) pandemic. SN

Wearable technology to assist the patients infected with novel coronavirus (COVID-19)

Breathing aid devices to support novel coronavirus (COVID-19) infected patients

An automated system to limit COVID-19 using facial mask detection in smart city network

Automated detection of COVID-19 cases using deep neural networks with X-ray images

COVIDNet-CT: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest CT images

A framework of deep learning classifiers to diagnose COVID-19 in X-ray images. arXiv arXiv-2003

Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks

Diagnosis of COVID-19 from X-rays using combined CNN-RNN architecture with transfer learning

Shallow convolutional neural network for COVID-19 outbreak screening using chest X-rays

Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms

Automated methods for detection and classification pneumonia based on X-ray images using deep learning

Coronavirus disease (COVID-19) detection in chest X-ray images using majority voting based classifier ensemble

Automated COVID-19 diagnosis from X-ray images using convolutional neural network and ensemble of machine learning classifiers

Detection of covid-19 chest x-ray using support vector machine and convolutional neural network

A combined deep CNN-LSTM network for the detection of novel coronavirus (COVID-19) using X-ray images

K-value effect for detecting stairs descent using combination GLCM and KNN

Adaptive neuro-fuzzy inference system used to classify the five major types of brain tumors

A combined multiple action recognition and summarization for surveillance video sequences

Adaptive network based fuzzy inference system (ANFIS) training approaches: A comprehensive survey

The role of dataset in training ANFIS system for course advisor

Adaptive neuro fuzzy system for modelling and prediction of distance pantograph catenary in railway transportation

Evolving rule-based explainable artificial intelligence for unmanned aerial vehicles

Application of ANFIS-based subtractive clustering algorithm in soil cation exchange capacity estimation using soil and remotely sensed data

This publication was made by NPRP Grant NPRP12S-0312-190332 from the Qatar National Research Fund (a member of the Qatar Foundation). The statements made herein are solely the responsibility of the authors. 

 Table 2 . Comparison of the proposed method with the state-of-the-art techniques for binary classification of COVID-19.

Osturk et al. 32 

The authors declare no competing interests.

Correspondence and requests for materials should be addressed to A.A.Reprints and permissions information is available at www.nature.com/reprints.Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.