key: cord-1035520-552lsjqq
authors: Huang, Shigao; Yang, Jie; Fong, Simon; Zhao, Qi
title: Artificial intelligence in the diagnosis of COVID-19: challenges and perspectives
date: 2021-04-10
journal: Int J Biol Sci
DOI: 10.7150/ijbs.58855
sha: 626ee81017f68094df0c42d40015adf39365f8db
doc_id: 1035520
cord_uid: 552lsjqq

Artificial intelligence (AI) is being used to aid in various aspects of the COVID-19 crisis, including epidemiology, molecular research and drug development, medical diagnosis and treatment, and socioeconomics. The association of AI and COVID-19 can accelerate to rapidly diagnose positive patients. To learn the dynamics of a pandemic with relevance to AI, we search the literature using the different academic databases (PubMed, PubMed Central, Scopus, Google Scholar) and preprint servers (bioRxiv, medRxiv, arXiv). In the present review, we address the clinical applications of machine learning and deep learning, including clinical characteristics, electronic medical records, medical images (CT, X-ray, ultrasound images, etc.) in the COVID-19 diagnosis. The current challenges and future perspectives provided in this review can be used to direct an ideal deployment of AI technology in a pandemic.

Coronavirus disease 2019 (COVID- 19) was firstly reported in December 2019 [1] [2] [3] . It has caused a large number of deaths and negatively impacted people's lives worldwide, with more than 100 million confirmed cases of the new coronavirus (SARS-Cov-2) and more than 200 million cumulative deaths worldwide as of late January 2021 [4, 5] . The patients experience flu-like symptoms such as fever, dry cough, tiredness, difficulty breathing. In more severe cases, the SARS-CoV-2 infection often causes fatal pneumonia in the patients [6] . Although the rapid progress in vaccines, the epidemic continues to spread out more than 200 countries and regions. In some countries, people have to face new lifestyles to combat COVID-19 [7] . Therefore, there is still an imminent need to develop antiviral drugs and medical practices to cure COVID-19 patients [5] . Many researchers from all over the world are seeking the effective techniques to cope with such challenges [8, 9] .

In severe infectious disease outbreaks, both hospitals and physicians are suffered with the increasing workloads that weaken their ability to classify and hospitalize the suspected patients. The previous reports indicated that some of patients with early coronaviral infection were negative for CT [10] , limiting the ability of radiologists to reliably rule out disease. While waiting 4-48 hours for confirmation of SARS-CoV-2 coronavirus by RT-PCR, the infected patients may transmit the virus to the close contacts if insufficient resources are used to separate positive patients with other suspected cases. In one report, the hospital-acquired infection was inferred in approximately 40% of cases [11] . It is imperative to speedily confirm patients for COVID-19 because initial false negative cases may increase the risk of transmission of the virus to others.

Artificial intelligence (AI) has been deployed at various levels of the health care system, including diagnosis, public health, clinical decision making, and therapeutics [12, 13] . Particularly, AI algorithm plays Ivyspring International Publisher an important role in the fast detection of COVID-19 patients during the current pandemic [14] . The number of studies using AI techniques to diagnose COVID-19 rapidly increased in 2020. Most reviews focus on describing diagnosis of COVID-19 from chest CT images using AI technology [15] . Therefore, we will comprehensively review the applications of AI for rapid diagnosis of COVID-19 with different medical analyses as well as discuss their challenges and perspectives in COVID-19. As shown in Fig. 1 , it is mainly compiled from two aspects: machine learning (ML) and deep learning (DL), including electronic medical records, and medical images (CT, X-ray, ultrasound images, etc.), in clinical COVID-19 diagnosis.

The potential applications of ML for COVID-19 have been previously described [14, [16] [17] [18] [19] [20] [21] [22] [23] [24] [25] [26] . The details are summarized in Table 1 .

The first priority of ML was suggested as technical support for early detection and diagnosis of infections. A recent study demonstrated that the more accurate diagnosis could be generated using a computational model trained on large clinical datasets [16] . An association between males and higher serum lymphocyte and neutrophil levels was identified by applying ML to reanalyze COVID- 19 [20] . A combination of seven ML algorithm based on data from UCLA Health System in United States was established to diagnose COVID-19 in the inpatient setting [21] . In the test set (n=392), the combined model achieved excellent diagnostic metrics compared to RT-PCR. An et al developed five ML algorithms for death prediction in a case dataset that was provided by the Korean National Health Insurance Service (KNHIS) [5] . In prediction of mortality, the sensitivity and specificity exceeded 90% while the areas under the curves (AUC) exceeded 96%. Chest CT has been used to evaluate the patients with suspected SARS-CoV-2 infection. AI system had equal sensitivity as compared to a senior thoracic radiologist. The radiologists with less expertise in chest imaging demand AI-assisted screening. In a test set of 279 patients, an AI algorithm combining chest CT presentation correctly identified 68%, while radiologists classified all of these patients as COVID-19 negative [14] . Monahan et al reported that two unique ML models were generated to predict the risk of the hemodialysis (HD) patients having the undetected SARS-CoV-2 infections [27] . Through analyzing more than ten thousand patients, they identified top predictor of an HD patient having a SARS-CoV-2 infection in the prior week.

DL, as a subset of ML, has been explored extensively in the diagnosis of COVID-19, especially in the field of lung detection images, including CT images, X-ray images and ultrasound images. The details are summarized in Table 2 .

Wu et al developed a DL-based screening framework for coronavirus through a multi-view chest CT imaging [28] . The framework trained on multi-view images of chest CT images from two different hospitals in China through a Convolutional Neural Network (CNN) Moreover, transfer learning has been applied for the early diagnosis of coronaviruses based on X-ray imaging. Apostolopoulos and Bessiana proposed a system for the automatic diagnosis of COVID-19 cases in which five CNN variants (VGG19, MobileNetv2, Inception, Xception, and Inception-ResNetv2) were used to analyze a dataset of X-ray images from patients with common bacterial pneumonia, confirmed Covid-19 disease, and normal incidents [33] . The dataset analysis suggests that DL with X-ray imaging has a high accuracy, sensitivity, and specificity (96.78%, 98.66%, and 96.46%, respectively). A generative adversarial network (GAN) with deep transfer learning has been proposed for coronavirus detection in chest X-ray images [34] . The total number of X-ray images in the collection was 307 and contained four categories: COVID-19, normal, pneumonia bacteria, and pneumonia virus. The models contain the Alexnet, Googlenet, and Restnet18. The accuracy of selecting Alexnet as the primary deep transfer model can reach 80.6% when four categories are included, while the accuracy of selecting Googlenet as the primary model can reach 85.2% when three classes are included. Another COVID-19 diagnosis-Net based on an X-ray image was proposed by Ucar and Korkmaz [35] . Image data from three public datasets obtained 98.26% accuracy, 98.25% specificity, and 97.39% F1-score in the proposed system. In another study, a DarkNet model for automatic COVID-19 detection using chest X-ray images has been developed [36] . The DarkNet model is a classifier used as a "you only look-once" (YOLO) real-time object detection system. The proposed model was evaluated for binary classification (COVID vs. No-Findings, the classification accuracy of 98.08%) and multi-class classification (COVID vs. No-Findings vs. Pneumonia. It has shown a classification accuracy of 98.08%. In addition, the generated heatmaps can assist the clinicians to locate the affected regions on chest X-rays. Lung Ultrasonography (LUS) has been used for the detection and management of acute respiratory disorders. A recent study shows that DL techniques may assist clinician for the analysis of LUS images from COVID-19 patients [37] . A model with three different tasks on LUS imaging: frame-based classification, video-level grading and pathological artifact segmentation, was proposed in the diagnosis of COVID-19. It demonstrated accurate prediction and localization of LUS imaging biomarkers in COVID-19 patients.

AI has great potential and opportunity for rapid analysis of large amounts of data. It has played an important role in the prevention of COVID-19 outbreak [38] . AI models may be as accurate as experienced radiologists to diagnose COVID-19 [38] .

It is noteworthy that although some patients infected with COVID-19 are asymptomatic, they have the potential to become transmitters of the virus [6, 39] . Although the infection can be confirmed by a polymerase chain reaction, COVID-19 patients with pneumonia symptoms may show a pattern on chest X-ray or CT images that are only moderately characteristic for the clinicians [40] . It is difficult to find people who are currently infected with COVID-19 but are asymptomatic [41] . The transmission rate of COVID-19 is determined with the ability to confidently recognize infected patients with low false-negative rates. Meanwhile, an effective control of false positives can avoid unnecessary quarantine of patients and thus further reduce the burden on the health care system.

Biomedical imaging (chest X-ray, CT scan, and ultrasound images, etc.) enables to visualize symptoms of pneumonia. Image processing techniques are attractive in the areas of biomedicine and cancer diagnosis [42] . It is well known that AI-based biomedical image diagnosis has achieved remarkable success. ML and DL methods have become valuable tools for the discovery of various diseases [40, [43] [44] [45] . For example, although some patients have already infected by SARS-Cov-2, they show the normal chest CT images. Therefore, the negative predictive value of chest CT images is limited and does not completely rule out infection. The accuracy of the solo AI diagnosis is still challenged. Therefore, to meet clinical needs, AI algorithms is required to combine chest imaging with clinical symptoms, exposure history, and laboratory tests in the diagnosis of COVID-19.

False negative rate is usually high with the laboratory tests, such as nucleotide RT-PCT [46] . Medical image screening can provide an intuitive and accurate diagnosis when it is used as the assisted testing method for COVID-19 [47] . In some epidemic countries, such China and United States, the AI model to diagnose negative sensitivity with CT has been used in the early infections [38] . This new strategy provides spare capacity for CT and X-ray imaging scans with the advantages of rapid COVID-19 diagnosis.

AI model may be as accurate as experienced physicians at diagnosing COVID-19. In this review, we discuss the challenges and perspectives of ML and DL in the COVID-19 as well as the need for further research. The clinical application of AI in the diagnosis of COVID-19 is promising, and additional extensive research is required. 50. Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chestx-ray8:

Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Proceedings of the IEEE conference on computer vision and pattern recognition; 2017. p. 2097-106. 51. Abbas A, Abdelsamea MM, Gaber MM. Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. Applied Intelligence. 2020: 1-11.

Perspectives on therapeutic neutralizing antibodies against the Novel Coronavirus SARS-CoV-2

COVID-19: what has been learned and to be learned about the novel coronavirus disease

The global battle against SARS-CoV-2 and COVID-19

World Health Organization declares global emergency: A review of the 2019 novel coronavirus (COVID-19)

Coronavirus disease 2019 (COVID-19): situation report

Asymptomatic transmission during the coronavirus disease 2019 pandemic and implications for public health strategies

Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey. Sustainable cities and society

Analysis and forecast of COVID-19 spreading in China, Italy and France

Early dynamics of transmission and control of COVID-19: a mathematical modelling study. The lancet infectious diseases

CT imaging features of 2019 novel coronavirus (2019-nCoV)

Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (COVID-19) implicate special control measures

Artificial Intelligence for COVID-19: Rapid Review

Artificial Intelligence (AI) applications for COVID-19 pandemic

Artificial intelligence-enabled rapid diagnosis of patients with COVID-19

Uzun Ozsahin D. Review on Diagnosis of COVID-19 from Chest CT Images Using Artificial Intelligence

Using machine learning of clinical data to diagnose COVID-19: a systematic review and meta-analysis. BMC medical informatics and decision making

A novel triage tool of artificial intelligence assisted diagnosis aid system for suspected COVID-19 pneumonia in fever clinics

Artificial intelligence application in COVID-19 diagnosis and prediction

An interpretable machine learning framework for accurate severe vs non-severe covid-19 clinical type classification. Available at SSRN 3638427

Machine learning-based prediction of COVID-19 diagnosis based on symptoms

A machine learning algorithm to increase COVID-19 inpatient diagnostic capacity

Classification of covid-19 coronavirus, pneumonia and healthy lungs in ct scans using q-deformed entropy and deep learning features

Chiavegatto Filho ADP. COVID-19 diagnosis prediction in emergency care patients: a machine learning approach. medRxiv

Estimating underdiagnosis of covid-19 with nowcasting and machine learning: Experience from brazil. medRxiv

Hemogram data as a tool for decision-making in COVID-19 management: applications to resource scarcity scenarios

Detection of COVID-19 infection from routine blood exams with machine learning: a feasibility study

Artificial intelligence for covid-19 risk classification in kidney disease: Can technology unmask an unseen disease? medRxiv

Deep learning-based multi-view fusion model for screening 2019 novel coronavirus pneumonia: a multicentre study

Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks

Deep learning model for diagnosis of corona virus disease from CT images

Classification of Covid-19 Coronavirus, Pneumonia and Healthy Lungs in CT Scans Using Q-Deformed Entropy and Deep Learning Features

Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation

Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks

Within the lack of chest COVID-19 X-ray dataset: a novel detection model based on GAN and deep transfer learning

A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2

Automated detection of COVID-19 cases using deep neural networks with X-ray images. Computers in biology and medicine

Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound

Artificial intelligence-enabled rapid diagnosis of patients with COVID-19

Covid-19: identifying and isolating asymptomatic people helped eliminate virus in Italian village

Artificial intelligence in cancer diagnosis and prognosis: Opportunities and challenges

How lethal is the novel coronavirus, and how many undetected cases there are? The importance of being tested. medRxiv

Blockchain technology, improvement suggestions, security challenges on smart grid and its application in healthcare for sustainable development

Broad Learning with Attribute Selection for Rheumatoid Arthritis

Mining Prognosis Index of Brain Metastases Using Artificial Intelligence

Distribution of ABO Blood Groups and Their Association With Low Risk of Severe COVID-19 Infection in Patients

Development and clinical application of a rapid IgM-IgG combined antibody test for SARS-CoV-2 infection diagnosis

Review of analytical performance of COVID-19 detection methods

Covid-19 image data collection: Prospective predictions are the future

Chest CT for typical coronavirus disease 2019 (COVID-19) pneumonia: relationship to negative RT-PCR testing

The study is supported by the Science and Technology Development Fund, Macau SAR (File no. 

The authors have declared that no competing interest exists.