key: cord-0726488-llg2jxru authors: Chen, Su title: Models of Artificial Intelligence-Assisted Diagnosis of Lung Cancer Pathology Based on Deep Learning Algorithms date: 2022-03-26 journal: J Healthc Eng DOI: 10.1155/2022/3972298 sha: 544e0de9eb94b1a4fb7a55923489dc11aeed7f9f doc_id: 726488 cord_uid: llg2jxru In this article, in order to explore the application of a diagnosis system for lung cancer, we use an auxiliary diagnostic system to predict and diagnose the good and evil attributes of chest CT pulmonary nodules. This research improves the new diagnosis method based on the convolutional neural network (CNN) and the recurrent neural network (RNN) and combines the dual effects of the two algorithms to process the classification of benign and malignant nodules. By collecting H-E-stained pathological slices of 652 patients' lung lesions from two hospitals between January 2018 and January 2019, the output results of the improved 3D U-net system and the consistent results of two-person reading were compared. This article analyzes the sensitivity, specificity, positive flammability rate, and negative flammability rate of different lung nodule detection methods. In addition, the artificial intelligence system's and the radiologist's judgment results of benign and malignant pulmonary nodules are used to draw ROC curves for further analysis. The improved model has an accuracy rate of 92.3% for predicting malignant lung nodules and an accuracy rate of 82.8% for benign lung nodules. The new diagnostic method using the convolutional neural network and the recurrent neural network can be very effective for improving the accuracy of predicting lung cancer diagnosis. It can play a very effective role in the disease prediction of lung cancer patients, thereby improving the treatment effect. In the last decade, the mortality and morbidity of malignant tumors have been increasing, which has led to a very serious situation in cancer prevention and cancer treatment. From the perspective of cancer incidence, lung cancer has the highest incidence among the top ten cancers, and deaths due to lung cancer ranks first among the top ten cancer deaths. After investigation, it is found that the symptoms of lung cancer are not so obvious in the early stage. e patient does not feel any abnormality in the body at the early stage. Only when the body is abnormal, it is diagnosed as lung cancer. e stage of the patient diagnosed with lung cancer is normally intermediate to advanced stage. For patients in the advanced stage, the current medical level of clinical surgery has no effect, so generally, patients in the late stage will give up treatment, and their survival rate is relative. However, for early lung cancer patients, it can be treated by clinical surgery, and there is a very high survival rate. Research on the diagnosis system for lung cancer based on text and images can provide reference value for clinicians. It can effectively reduce the workload of clinicians to screen early lung cancer patients manually and prevent missed screening due to fatigue and other factors. It can provide effective tools for the early detection and diagnosis and increase the chance of curing lung cancer patients. Pulmonary sarcoidosis is a multisystem and multiorgan granulomatous disease of unknown etiology, which often invades the lungs, bilateral hilar lymph nodes, eyes, skin, and other organs, and the chest invasion rate is as high as 80%-90%. In recent years, the application of deep learning algorithms in medicine has developed rapidly, and research in this area has also emerged in an endless stream. Zheng S applied MIP images to improve the efficiency of automatic lung nodule detection using the CNN [1] . Meanwhile, Koning H J investigated this issue and obtained relevant data from the registry. Data analysis showed that in high-risk trials, lung cancer mortality was significantly lower in patients screened with volumetric CT than in untested patients [2] . In the research of deep transfer learning, Zhao tested the deep learning model. For the external test set, the transferred model has good generalization ability [3] . Jae-Hong developed a new CNN-based system combining a pretrained deep CNN structure and a self-training network [4] . Wang proposed a new method for breast cancer screening and diagnosis based on the CNN model. is method produced a CNN-based breast cancer CT image detection model and a breast cancer screening model [5] . Artificial intelligence is also used for auxiliary diagnosis of cervical cancer. Zhu used the TBS report artificial intelligence cervical fluid thin layer cytology auxiliary diagnosis system jointly developed by Southern Medical University and Guangzhou Fuqiang Pathology Technology Co. Ltd. to diagnose all clinical specimens [6] . Although artificial intelligence can achieve good results in medical applications, there are still difficulties in application. Reliable deep learning models require additional effort and cost. To this end, Guo Ke proposed a new medical-aided diagnosis model as a service. is will help medical institutions obtain reliable medical aid diagnostic models quickly and efficiently [7] . Although deep learning is increasingly used in medical diagnosis, it is not without its drawbacks. Compared with traditional algorithms, when the amount of data processed is too large, deep learning algorithms are slower than traditional algorithms, and a series of problems are prone to occur in practical applications. erefore, we urgently need a more stable and processing power algorithm model [8] . e innovations of this article are as follows: (1) is article uses a multitask deep neural network technology based on three-dimensional convolution, and its advantage is that it can assign weights to similar structures. (2) is article uses an improved 3D U-net system and compares it with the original system. e improved sensitivity and specificity changes were investigated, and it was determined that the improved 3D U-net system is more suitable for lung nodule identification. (3) is article also uses an ROC curve to distinguish invasive adenocarcinoma from noninvasive lung cancer and discusses the further application of the artificial intelligence system in lung cancer diagnosis. In the medical field, lung cancer-related examinations mainly include CT images to detect lung nodules, CT image descriptions for analysis, and test reports to further test some information such as tumor markers. is section mainly introduces the lung nodules, the principle of CT imaging, the source of the examination description, and the related information of the examination report [9] . Pulmonary nodule is a disease of the lung tissue, it occurs in the early stage of lung cancer, it is a granulomatous disease, and the cause is unknown [10] . e CT image of the lung nodules is shown in Figure 1 . e expansion of CT is computed tomography. Generally speaking, CT in clinical practice uses X-rays as the radiation source to emit X-rays, and the final tomographic image is X-ray CT. What we need to know is that all processes that can create images and use computers to build tomograms can be called CT [11] [12] [13] . e absorption of X-rays by objects plays a major role in CT imaging. A specific detector is used to receive the X-rays that pass through this layer; the received X-rays are converted into visible light through a converter and then converted into digital signals by an analog/digital converter, which are then input to a computer for processing [14] . e principle of CT is shown in Figure 2 . e test report mainly includes sputum cytology, pleural fluid examination, blood routine examination, and tumor marker screening. Cytology examination of sputum and pleural fluid mainly determines whether there are tumor cells in the sputum and pleural fluid. Routine blood tests include determining the count of white blood cells, red blood cells, and platelets, as well as cell acidity and alkalinity [15] . e inspection items are shown in Table 1 . e relationship between white and black is divided into several levels according to the logarithmic relationship, which is called the "gray level". e range is generally from 0 to 255, where white is 255 and black is 0, so black and white images are also called grayscale images, which are widely used in the fields of medicine and image recognition. Image binarization is a necessary step in pre-image processing. It is mainly to set the gray value of the pixels on the image to 0 or 255, which can eliminate a lot of noise interference, and the entire image will show only black and white visual effects [16] [17] [18] . (1) Binary thresholding: e gray value is set greater than the threshold to maxval, and the threshold is set to 0 in other cases. (2) Anti-binary thresholding: e gray value is set greater than the threshold to 0, and the threshold is set to maxval in other cases. (3) reshold of truncation: e threshold to the gray value is set greater than the threshold, and the threshold setting remains unchanged in other cases. Pulmonary nodule CT scan Lung e gray value greater than the threshold is unchanged, and the gray value of the threshold is set to 0 in other cases. (5) Dethresholding to 0: e gray value not greater than the threshold is unchanged, and the threshold gray value is set to 0 in other cases. In simple terms, image filtering is a method of image noise reduction, which is mainly divided into linear noise reduction methods and nonlinear noise reduction methods. Linear noise reduction methods mainly include box, mean, and Gaussian methods [19] . e nonlinear noise reduction method is mainly median filtering. In the mean method in the linear noise reduction method, the mean filter using the neighborhood mean method is very suitable for removing grain noise in the image obtained by scanning. e domain averaging method can effectively suppress the noise, and at the same time, it also causes the blurring phenomenon due to averaging; the blurring degree is proportional to the radius of the neighborhood. e median noise reduction in the nonlinear noise reduction method is a commonly performed using a nonlinear smoothing filter. Its main function is to change the pixel with a large difference in the gray value of the surrounding pixels to a value close to the surrounding pixel value so as to eliminate the isolated noise points, so the median filter is very effective in filtering out the salt and pepper noise of the image. Image filtering can be calculated by the formula (I,j) is the position of the pixel in the picture; (m,n) is the position/coordinates in the convolution kernel, and the coordinates of its center point are (0,0). K(m,n) is the weight parameter on (m,n) in the convolution kernel. I(i + m,j + m) is the picture pixel value corresponding to K(m,n); o(i,j) is the filtering/convolution result of (i,j) pixels in the picture. (1) Box filtering. Box filtering is the simplest processing, where all pixels have the same weighting factor. e core is However, when normalize is true, it becomes a mean filter. (2) Mean filtering. e mean filtering method is a method that takes the average of the target pixel to achieve the purpose of filtering. For the pixels to be processed, the mean filtering method selects a template. e template is composed of several adjacent pixels. Its core is (3) Gaussian filtering. Gaussian filtering is a linear filtering and an important method for smoothing the image. e image processed by Gaussian filtering looks more natural than the image processed by the ordinary template [20, 21] . ere are two main functional forms of Gaussian filtering. e first is a one-dimensional Gaussian filtering function: e second is the two-dimensional Gaussian filter function: [23] . A restricted Boltzmann machine (RBM) is a generative stochastic artificial neural network that learns probability distribution over its input set. e first-generation neural network perception model is shown in Figure 3 . Further research on the RBM model is one of the core contents of deep learning and has very important significance [24] . e RBM power model is shown in Figure 4 . RBM is an undirected graph probability model, which is based on power. We combine the power function of the input layer vector x and the hidden layer vector h to define the joint probability distribution as Introducing free power changes (12) into (13), that is, θ is introduced to represent the parameters of the model; taking the logarithm of (13) and deriving it result in In order to deal with the difficult RBM calculation problem of the partition function, the approximate value of the log-likelihood gradient zlogO(x)/zθ is usually used for training. e sample x ∼ O(x) subject is used for data distribution and the free power gradient on the sample x ∼ O(x) subject is used for model distribution to define the model parameter update rule as Model. Convolutional neural networks (CNN) are feedforward neural networks, which are a feature extraction and classification method for images [25] . Figure 5 shows a simple convolutional neural network model. It can be seen from Figure 5 that, unlike the multilayer feedforward sensor, the convolutional neural network limits the network structure by using the local connection of the receiving area. (1) Before training, the ownership value of the convolutional neural network is initialized with different small random numbers for supervised training. ere are two stages to training a folded neural network: (a) In the prepropagation stage, samples are taken from the sample set and input X to the network, where E is the weight of the network and Y is the mapping function. e information is passed on Journal of Healthcare Engineering and the corresponding actual output is calculated: (b) In the retrospective phase, (2) Activation function. e sigmoid function and tanh function are the first nonlinear activation functions used in neural networks. e sigmoid function not only increases monotonically but its inverse function also increases monotonously. erefore, the sigmoid function is very suitable to be used as a threshold function of a neural network, and its function value is between 0 and 1. e analytical formula of the function is e output value of the tanh function can be scaled nonlinearly in the range of (-1, 1), which is convenient for normalizing the model characteristics. e analytical formula of the function is Network. e structure diagram of long short-term memory (LSTM) is shown in Figure 6 , and each line represents a vector. e yellow rectangle represents the activation function in this neural network layer. e pink circles represent point-bypoint operations between vectors, such as vector multiplication and vector addition. Compared with other models, the LSTM model can handle the semantics of long-distance context better in text. erefore, the LSTM model has become the current mainstream word segmentation task model. e deep learning algorithm used in this experiment is a 3D U-net model. In this model, each green cuboid is a module. Each module has a fixed network structure (Figure 7) , including 3D convolution, normalization, an activation function, and a pooling layer. is study retrospectively collected H-E-stained pathological sections of lung lesions in 652 patients from three tertiary hospitals, mainly Jiangxi Provincial People's Hospital, from January 2018 to January 2019. ere were 301 males (accounting for 46.2%) and 351 females (accounting for 53.8%), ranging from 24 to 92 years old, with an average age of (61.8 ± 10.5) years. Among them, 278 (41.2%) had malignant lesions, 396 (58.8%) had benign lesions, and 674 had lung nodules, where 488 had solid nodules, 186 had subsolid nodules, 124 had partial solid nodules, and 62 had ground glass nodules; 8 had tiny nodules with a diameter of less than 5 mm in the lung nodules, 74 had small nodules with a diameter of 5 mm ≤ 10 mm, and 592 had nodules with a diameter >10 mm. Among them, there were 387 nodules between 10 and 20 mm and 205 nodules between 20 and 30 mm. ere were 218 nodules in the upper lobe of the left lung, 99 nodules in the lower left lobe, 156 nodules in the upper right lung, 69 nodules in the middle right lung, and 132 nodules in the lower right lung (details are shown in Table 2 ). Of the 652 patients included, there were a total of 674 pulmonary nodules. ere were 633 cases of 1 target lung nodule and 20 cases of 2 target lung nodules. Among them, the improved 3D U-net networkassisted diagnosis system detected a total of 674 target nodules, with a detection rate of 100.0% (674/674). Radiologists reported a total of 673 target sections, with a detection rate of 99.9% (673/674), as shown in Table 3 . Figure 8 shows the difference between the AI model, pathologists, and pathology gold standard. e gold standard refers to the dispute between two pathologists with Table 4 . It can be seen that there are a total of 104 malignant lung nodules, and the model successfully predicted that 96 of them are malignant, accounting for 92.3% of the total. Among them, 8 were misdiagnosed, accounting for 7.7%. Among all 64 benign nodules, the model successfully predicted 53 benign nodules, accounting for 82.8%. 11 cases were misdiagnosed, accounting for 17.2%. e 3D U-net can be moved in all three directions (image height, width, and channels). At each position, element-wise multiplication and addition provide a numerical value. Because the filter slides through a 3D space, the output values are also arranged in 3D space. e improved 3D U-net, the original 3D U-net, and the doctor's sensitivity, specificity, negative likelihood ratio, and positive likelihood ratio for benign and malignant judgments are shown in Table 5 . e three sets of data are compared in pairs, and the two artificial intelligence systems have their own advantages and disadvantages in judging the benign and malignant pulmonary nodules. e improved 3D U-net system has high sensitivity, high specificity, and a positive likelihood ratio of the 3D U-net system, and the overall performance of Journal of Healthcare Engineering the latter is slightly stronger. e positive likelihood ratios of the three were 1.21, 2.13, and 2.81, among which that of radiologists was the highest, but none of the three had a high diagnostic value for benign and malignant pulmonary nodules. e flammability ratio is the ratio of the mass of air to fuel in the mixture. It is generally expressed in grams of air consumed per gram of fuel when burned. e two artificial intelligence systems are used to judge the benign and malignant pulmonary nodules, and the radiologist draws the ROC curve (Figure 9 ). e AUC area of the 3D U-net system was 0.583 [P � 0.02 (<0.05)]. e AUC area of the improved 3D U-net system was 0.729 [P � 0.02 (<0.05)]. e improved 3D U-net system has certain accuracy in the diagnosis of benign and malignant pulmonary nodules, and its performance is close to that of radiologists. e AUC area of the radiologist group was 0.794 [P � 0.01 (<0.05)]. e accuracy of manual image reading for the diagnosis of benign and malignant pulmonary nodules was higher than that of the two artificial intelligence systems, but the overall accuracy was average. e ROC curve is used for analysis, and the nodule diameter, CT value, and malignant probability are used as the cutting points for the differential diagnosis of invasive adenocarcinoma and noninvasive tissue (preinvasive lesion/microinvasive adenocarcinoma). ey are 11.38 mm, −377.2 HU, and 95%; the corresponding areas under the ROC curve are 0.931, 0.887, and 0.876, and the sensitivities are 87.9%, 79.5%, and 81.6%, respectively. e specificities were 87.5%, 91.4%, and 75.7%, and the accuracy was 88.2%, 85.3%, and 80.8%, respectively ( Figure 10) . CT value is a measurement unit for measuring the density of a local tissue or organ in the human body, usually called Heinz unit; for air, it is −1000, and for dense bone, it is +1000. e cleavage site is a commonly used linking sequence for fusion proteins in genetic engineering expression systems, and the target protein in the fusion protein can be separated from the peptide segments of the nontarget protein by drug treatment. In this study, the improved 3D U-net network-assisted diagnosis system detected 674 target nodules, with a detection rate of 100.0% (674/674). Radiologists detected 673 target sections, with a detection rate of 99.9% (673/674). What the radiologist missed was a solid pulmonary nodule located in the basal segment of the right lower lobe, with a diameter of 29 mm and an unclear boundary with the surrounding tissues. If the artificial intelligence system wants to accurately screen out lung nodules and judge their nature, it needs to go through lung parenchymal segmentation, lung nodule detection, lung nodule segmentation, and lung nodule diagnosis-a total of 4 steps. e first 3 steps are responsible for screening and segmenting lung nodules, and the fourth step is to distinguish between benign and malignant lung nodules. Any failure in any of the first 3 steps will result in missed or false detection of lung nodules. When artificial intelligence extracts nodules, compared with isolated solid nodules, the extraction of adhesion pleural nodules and adhesion vascular nodules is more difficult. Pulmonary nodules adhere to the pleura, blood vessels, and other tissues, and their CT values are similar to those of surrounding tissues, which brings great interference to the extraction of the nodules. In this study, the improved 3D U-net system's, the original 3D U-net system's, and the physician's sensitivity in judging benign and malignant lung nodules was 95.51%, 91.83%, and 85.1%, respectively. e specificities were 34.46%, 58.69%, and 70.15%, respectively. e positive likelihood ratios were 1.21, 2.13, and 2.81, respectively. e negative likelihood ratios were 0.20, 0.22, and 0.23, respectively. e positive likelihood ratios of the three are less than 10, which is of low value. Comparing the two artificial intelligence systems, the improved 3D U-net system has higher diagnostic sensitivity and poorer specificity than the 3D U-net system. Both artificial intelligence systems are based on the use scenarios of the 3D-CNN system to screen for lung nodules. It is designed to detect lung nodules; the algorithm is optimized for sensitivity, resulting in low specificity, and the ability to cut lung nodules is stronger. e improved algorithm has changed with respect to the optimization direction, so its performance is different. Comparing the two artificial intelligence systems to radiologists, the sensitivity of judging the nature of pulmonary nodules is higher than that of radiologists. In terms of specificity, radiologists lead. e AUC areas for judging benign and malignant pulmonary nodules are 0.583 AUC area of the original 3D U-net system and 0.729 AUC area of the improved 3D U-net system. e AUC area of the radiologist group was 0.794. e original 3D U-net system has low accuracy in judging benign and malignant pulmonary nodules. e improved 3D U-net system and radiologists have certain accuracy in judging benign and malignant pulmonary nodules. e use of the CNN helps improve the accuracy of CT volume measurement and nodule differentiation in patients with lung nodules in computer-aided detection. At this stage, artificial intelligence shows good performance in judging benign and malignant pulmonary nodules and has a very promising application prospect. e intelligent diagnosis system based on the improved 3D U-net network can automatically detect lung nodules through automatic segmentation of lesions, automatic measurement of quantitative and qualitative parameters, judgment of nodule types, automatic analysis of benign and malignant nodules, etc. is experiment detected 674 cases of pathological lung nodules. e results showed that mixed ground glass nodules and pure ground glass nodules were more common in adenocarcinoma and only solid nodules were seen in squamous cell carcinoma. e accuracy of distinguishing and diagnosing invasive adenocarcinoma and noninvasive adenocarcinoma in groups was based on the standard diameter of the nodule, CT value, and "malignant probability," which were 88.2%, 85.3%, and 80.8%, respectively. ere are many shortcomings in this study: because it is impossible to obtain the pathological results of all nodules, the gold standard for judging the true and false of nodules in this study was confirmed by three senior chest CT diagnostic physicians after reading the pictures. e comparative analysis with the artificial intelligence system is carried out by two intermediate-level doctors, and there may be more human errors. e detection method of pulmonary nodules is closely related to their density, location, and shape. e analysis of the detection efficiency of this study only considers the density of nodules, and the influence of factors such as the location of nodules is not included in the scope of the study; further experimental studies are needed in the future. It is believed that as the deep learning research driven by big data continues to deepen, new signs are constantly being explored, and new algorithms are constantly being developed; the auxiliary diagnosis value of artificial intelligence auxiliary diagnosis systems will definitely achieve satisfactory results. is paper improves the convolutional neural network model on the original basis and applies it to the diagnosis of benign and malignant lung nodules to assist in the diagnosis of lung cancer. In experiments on a large number of samples, it is verified that the improved model used in this study reduces the complexity of the algorithm while increasing the overall lung nodule detection rate and reducing the misdiagnosis rate. It proves that the artificial intelligence-assisted diagnosis system can help clinicians screen and diagnose patients, improve work efficiency, and reduce workload. In this study, a 3D U-net model obtained by fusion of the convolutional neural network (CNN) and the long short-term memory (LSTM) recurrent neural network (RNN) was used. Compared with the singlemodal learning method that scholars of comparative research only use CT images, this method can enable the network model to learn more subtle features. e accuracy of this model for predicting malignant pulmonary nodules can reach 92.3%, and the accuracy of predicting benign pulmonary nodules can reach 82.8%, which prove that the system is feasible and effective. Based on the prediction model designed in this paper, it can play a very important role in the diagnosis of lung cancer, and it can also indirectly improve the treatment of lung cancer in the future. No data were used to support this study. e author declares that there are no conflicts of interest with any financial organizations regarding the material reported in this article. Automatic pulmonary nodule detection in CT scans using convolutional neural networks based on maximum intensity projection Reduced lung-cancer mortality with volume CT screening in a randomized trial Pathological diagnosis of lung cancer based on deep transfer learning Diagnosis and prediction of periodontally compromised teeth using a deep learning-based convolutional neural network algorithm Application of artificial intelligence based on deep learning in breast cancer screening and imaging diagnosis Application of artificial intelligence-assisted diagnosis for cervical liquidbased thin-layer cytology MDMaaS: medicalassisted diagnosis model as a service with artificial intelligence and trust CA: A COVID-19 diagnosis using an enhanced inception-ResNetV2 deep learning model in CXR images Deep learning model as a new trend in computer-aided diagnosis of tumor pathology for lung cancer Appraisal of deep-learning techniques on computer-aided lung cancer diagnosis with computed tomography screening Secure medical data transmission model for IoT-based healthcare systems Red-Green-Blue multi-channel quantum representation of digital images Assessing the accuracy of a deep learning method to risk stratify indeterminate pulmonary nodules A critical study of classification algorithms for LungCancer disease detection and diagnosis Lung nodules: a comprehensive review on current approach and management VLSI implementation of a high-performance nonlinear image scaling algorithm Data analytics assisted internet of things towards building intelligent healthcare monitoring systems Lung nodule malignancy classification in chest computed tomography images using transfer learning and convolutional neural networks Lung nodule classification on CT images using deep convolutional neural network based on geometric feature extraction Design and synthesis of multi-mode bandpass filter for wireless applications Combination of generative adversarial network and convolutional neural network for automatic subcentimeter pulmonary adenocarcinoma classification An efficient coding network based feature extraction with support vector machine based classification model for CT lung images Overview of computer aided detection and computer aided diagnosis systems for lung nodule detection in computed tomography A narrative review of digital pathology and artificial intelligence: focusing on lung cancer