key: cord-0023967-8rlew2ee authors: Qurashi, Abdulaziz A; Alanazi, Rashed K; Alhazmi, Yasser M; Almohammadi, Ahmed S; Alsharif, Walaa M; Alshamrani, Khalid M title: Saudi Radiology Personnel’s Perceptions of Artificial Intelligence Implementation: A Cross-Sectional Study date: 2021-11-23 journal: J Multidiscip Healthc DOI: 10.2147/jmdh.s340786 sha: 0f336f01ec7296390111c0e679c29bde0f3e443c doc_id: 23967 cord_uid: 8rlew2ee PURPOSE: Artificial intelligence (AI) in radiology has been a subject of heated debate. The external perception is that algorithms and machines cannot offer better diagnosis than radiologists. Reluctance to implement AI maybe due to the opacity in how AI applications work and the challenging and lengthy validation process. In this study, Saudi radiology personnel’s familiarity with AI applications and its usefulness in clinical practice were investigated. METHODS: A cross-sectional study was conducted in Saudi Arabia among radiology personnel from March to April 2021. Radiology personnel nationwide were surveyed electronically using Google form. The questionnaire included 12-questions related to AI usefulness in clinical practice and participants’ knowledge about AI and their acceptance level to learn and implement this technology into clinical practice. Participants’ trust level was also measured; Kruskal–Wallis test was used to examine differences between groups. RESULTS: A total of 224 respondents from various radiology-related occupations participated in the survey. The lowest trust level in AI applications was shown by radiologists (p = 0.033). Eighty-two percent of participants (n = 184) had never used AI in their departments. Most respondents (n = 160, 71.4%) reported lack of formal education regarding AI-based applications. Most participants (n = 214, 95.5%) showed strong interest in AI education and are willing to incorporate it into the clinical practice of radiology. Almost half of radiography students (22/46, 47.8%) believe that their job might be at risk due to AI application (p = 0.038). CONCLUSION: Radiology personnel’s knowledge of AI has a significant impact on their willingness to learn, use and adapt this technology in clinical practice. Participants demonstrated a positive attitude towards AI, showed a reasonable understanding and are highly motivated to learn and incorporate it into clinical practice. Some participants felt that their jobs were threatened by AI adaptation, but this belief might change with good training and education programmes. Medical imaging has improved and become more accessible, increasing the radiology reporting workload in hospitals and clinics worldwide. The higher demand has primarily been seen in imaging modalities that are time-consuming, such as computed tomography (CT) and magnetic resonance imaging (MRI). 1 Therefore, radiologists will be challenged to handle an overwhelming number of cases and report them in a timely manner. 2 Over the last few years, artificial intelligence (AI) applications have become a subject of heated debate in radiological field. 3 AI is one of the distinct fields of the discipline of computer science that can simulate the cognitive functions of humans such as problem solving, in which the computer can perform a very complex task with high accuracy. 4 Although some of the radiologist's tasks may be complicated for AI-based applications, the practice of radiologists can improve since the performance of tedious and routine tasks and reading time can be achieved more efficiently with the help of AI-based applications. 4, 5 Reduction in reading time was observed in detecting pulmonary metastasis by suppressing vessels on CT thorax imaging. 6 Several additional studies have shown that automated quantification of nodules, bone age prediction, and knee assessment (eg, osteoarthritis) can help reduce radiologists' workload and improve diagnosis accuracy. [7] [8] [9] Additionally, AI-based applications may improve image interpretation in differentiating lung viruses such as COVID-19 from other pneumonia diseases. 10, 11 It remains to be seen whether AI will aid radiographers in clinical decision-making, such as scanning protocols or radiation doses. A study suggested that AI is poised to enhance the role of radiographers within radiology departments (eg, pre-examination assessment, examination planning, image processing). 12 Automation in radiography, however, might limit the radiographer's role and contribution on decision-making. 12, 13 Several tasks can be provided using AI, including processing, reporting, perception, and reasoning. 14 Perception and reasoning tasks can be divided into several functionalities including segmentation where boundaries of organs are designated. Extraction is the next step where unwanted organs in the image are isolated. Detecting and highlighting a specific abnormality and comparing it with patient's images to evaluate the changes over time. A few AI applications are also available to predict the prognosis (ie, predict the course of the disease). 15 There are several AI strengths highlighted in the literature; however, limitations of the existing prediction models have also been noted due to the lack of data and concerns with validation and promotion (Table 1) . 16, 17 Several studies in the literature showed that AI-based applications will not replace radiologist's role; in fact, it will improve radiology services and radiologists' performance. 18 However, other researchers were worried that AI-based applications could be influencing medical students' decisions from choosing radiology as aprofession. 19 Thus, the purpose of this study was to evaluate and contrast the current level of knowledge and perceptions among different categories of radiology staff in Saudi Arabia regarding the current and future AI applications and to describe future requirements for successful implementation. A cross-sectional, survey-based study was conducted among radiologists, radiographers, clinical application specialists and internship radiography students across Saudi Arabia using a non-probability convenience sampling technique. An online questionnaire was distributed among participants via Google Form for the period of March to April 2021. The questionnaire was designed by the research team. Initially, the study was piloted with four academic lecturers and two radiologists, and corrections were made based on the comments received. Demographic background information about participants' gender, years of experience, place of work, type institution and occupational was collected. The questionnaire contained eight closed questions (ie, yes/no) related to participants' familiarity with AI and its current Table 1 Strength and Limitations of Artificial Intelligence in Radiology • Automated lesions screening, detection, segmentation, and characterization by using input data from other modalities (eg, x-ray, CT, MRI). • AI-based applications not familiar with the global context of patients. • Classify images based on the presence or absence of abnormality. • Training data time, cost, and resource consuming. • Extract additional data from previous detected abnormality (eg, lesion) • Lack the power of supervised algorithms. • Identification of anatomical landmarks or organs, which are important for both image acquisition and analysis. • Lack of accurate validation of the AI applications during training which may lead to random noise than the actual data. • Detecting scan planes for rapid examination planning and minimum interindividual variability, bias and scanning time. • Lack of specific multidisciplinary road maps for AI-based application implementation in medical imaging field. application to assess radiology personnel current knowledge in relation to the AI and its application in radiology. The questionnaire contained additional four questions, which aimed to assess the level of agreement concerning the usefulness of AI-based applications in clinical practice. Participants were asked to score these four questions in a 5-point Likert scale (ie, 1 = strongly agree, 2 = agree, 3 = neither agree nor disagree, 4 = disagree, 5 = strongly disagree). An ethical approval has been obtained from the institutional review board in College of Applied Medical Science at Taibah University (Reference Number: 2020/85/314/ RAD). Participation in this study was voluntary and informed consent was obtained. Statistical analysis was performed using the IBM statistical package for social sciences (SPSS version 20, PASW, Chicago, IL). Kruskal-Wallis one-way analysis of variance test was used to examine differences between groups. Demographical characteristic analysis was performed for the whole study sample. A descriptive analysis of data was carried out using counts and percentages. A p-value of ≤0.05 was considered significant. The study sample included 224 respondents (61.6% males and 38.4% females); of which 120 (53.6%) were radiographers, 46 (20.5%) were internship radiography students, 40 (17.9%) were radiologists, while 18 (8%) were clinical application specialists. The demographic characteristics of the participants, such as age, years of experience and the departments are shown in Table 2 and Figure 1 . The perceptions and knowledge level of different radiology personnel in Saudi Arabia towards the current and future AI applications were analysed based on participants' profession as shown in Table 3 . Overall, most of the participants (n = 186, 83%) were familiar with the machine learning function and AI concept. Among the other three groups, radiologists had the most familiarity (p = 0.001). However, the results indicated that the lowest trust level in AI applications was shown by radiologists (p = 0.033). In response to the question related to the use of AI in participants' departments, 82.1% (n = 184) of the participants had never used it. Furthermore, the majority of respondents mentioned the lack of formal education and knowledge related to AI-based applications. Most of the participants (n = 214; 95.5%) showed high interest in using AI-based application in clinical practice For the question on whether AI will replace the participants' jobs, the answers showed that almost half of the students believed that their job is in danger due to this application (p = 0.038). The participants' level of agreement regarding the usefulness of AI-based application in clinical practice is listed in Table 4 . The percentage of participants who either agree or strongly agree that AI is useful in clinical decision making such as justification of examination is 69.7 (n = 156). Similarly, 66.1% (n = 148) of participants agree or strongly agree that AI is useful in automated imaging protocol selection according to clinical question and patient condition; whereas 75.1% (n = 168) and 69.6% (n = 156) of participants agree or strongly agree that AI will be useful in improving diagnosis and saving time and will assist in personalizing imaging for patients such as tracking radiation dose and follow-up examinations, respectively. No significant difference was found in level of agreement among study participants based on profession, academic qualification, years of experience and hospital types (p > 0.05). Diagnostic imaging is clearly undergoing a transformative change with artificial intelligence; therefore, this study was conducted to determine the knowledge and perception of Saudi radiology personnel about AI in the radiological field. On average, 70% of study participants either agree or strongly agree about the usefulness of the AI-based application in clinical decision making, setting scanning protocols, improving patient care and saving time. Although AI is being recently introduced in the field of radiology, 20 this study found that most of the participants had a good basic understanding of this technology. It should be noted, however, that there is no objective criterion to determine participants' understanding. Similar findings were found in different studies, 18,21 which may be due to the fact that AI has become a contentious topic of discussion in radiology. 22, 23 While all the four groups were familiar with the concept of AI in simulating the analytic functions of humans, radiologists tend to be more familiar with this concept than others. Indeed, AI development recently has specifically focused on image interpretation. 12 However, in this study, radiologists' trust level towards the concept of relying on machine learning ability in analysing data for decision making purposes is relatively limited. A potential reason to this finding might have a relationship to concerns regarding patients' own risk when it comes to AIbased interpretation. 4 The literature suggests that AI is not appropriate for the final image interpretation and should remain in the hands of humans, but it can facilitate realtime workflow management as well as urgent exam prioritization, 23 which both medical students and radiologists endorse. 24, 25 A potential occurrence of AI errors might raise concerns regarding legal issues, since it is the radiologists' responsibility to notice possible mistakes in AI-based interpretations. 26 The benefits of AI-based interpretation might greatly diminish if radiologists need to check each interpretation, especially with the surge in images that they have to read. This situation might worsen even with AI support, as the volume and complexity of reports might increase with more data generated in the future. An understanding of the implications associated with AI is crucial for medical practitioners, especially the meaning of the technology and its contribution to the radiology profession. Experts argue that AI-based applications will change the economic, scientific, clinical and ethical future of radiology. 22 However, there is a counter argument concerning the use of AI-based applications and their positive and/or negative impact on the radiology profession. In a study by Ryan et al, participants reported that AI implementation would lead to a decrease in staffing levels and the creation or integration of new roles. 21 However, no changes in radiologist staffing level were anticipated by different studies. Not only this, but they also expected an expansion in their roles. 1, 27 In the current study, only one-third of participants think that AI will replace their jobs in the future. However, almost half of the participated students in this study felt that they are threatened by AI applications. An explanation to this belief could be the absence of subject related to AI in radiography undergraduate programmes. Therefore, the basic of AI application functions could be misunderstood among students, especially due to the fact that they have never used this application in clinical practice. A similar finding was found in a study that was carried out in the UK, where students reported that they were less likely to consider a career in radiology due to AI. 28 It was evident in another study that there is a concern that increasing use of AI technology could result in negative perceptions being drawn towards the professions. 21 The availability of AI-based applications is limited worldwide, particularly in Saudi Arabia. The use of AI in radiology is unlikely to become widely adopted anytime soon. This is largely due to the high costs associated with training some of these tools independently for each disease and each condition, and also how AI is actually integrated into clinical practice, which is an extremely labour-intensive process. 29 Almost 95% of all participants showed interest in AI education. This is mirrored by most participants in previous studies. 30, 31 Therefore, introducing AI education into future curricula has become a must as per most studies' recommendations. 20 Only 26.8% of all participants had received education with regard to AI technology, suggesting that AI education is still at early stages, especially when knowing that this education is a self-effort as to the authors' knowledge, no formal education is being provided to radiology personnel at any level of their programmes. 20 Overall willingness in implementing AI technology into clinical practice was shown by all participants, which was consistent with the literature where positive attitudes towards AI implementations in radiological field were shown. 20, 32 The radiology community must, in fact, extend great effort to ensure AI's future role in this field is well supported. Training and education programmes should be established to teach radiology personnel how to use AI-based applications in their clinical practice. Not only this, but they also should be involved in AI development process. This study was designed to investigate Saudi radiology personnel's perceptions of Artificial Intelligence implementation in radiology department, and the findings may need to be interpreted with caution due to the small size of the sample, and consequently may not be generalised to the whole radiology population in Saudi Arabia. Another limitation of this study was sampling bias, online survey might be restricted to those who are more active online, especially those who have social media accounts (WhatsApp, Twitter); however, survey was distributed via various online channels to improve its visibility among participants such as emails and messages. Evaluating the knowledge of radiology personnel about AI application is of great importance as this technology has started to filter into clinical departments. The findings of this study showed overall positive attitude to AI and good knowledge base was shown by them. However, some participants felt that their jobs are threatened by this technology and this belief could change if good training and education programmes were designed to improve their understanding about AI application. A conclusion to the debate on whether AI will take over radiology personnel has not been drawn yet until this technology is fully implemented into clinical departments. The current state of artificial intelligence in medical imaging and nuclear medicine Artificial intelligence in radiology: does it impact medical students preference for radiology as their future career? BJR Open What the radiologist should know about artificial intelligence -an ESR white paper Ethics, artificial intelligence, and radiology Impact of vessel suppressed-CT on diagnostic accuracy in detection of pulmonary metastasis and reading time Pulmonary subsolid nodules: value of semi-automatic measurement in diagnostic accuracy, diagnostic reproducibility and nodule classification agreement Clinical application of automated greulich-pyle bone age determination in children with short stature Automated knee osteoarthritis assessment increases physicians' agreement rate and accuracy: data from the osteoarthritis initiative Artificial intelligence in radiology Effectiveness of COVID-19 diagnosis and management tools: a review Artificial intelligence in diagnostic imaging: impact on the radiography profession Practical guidelines for radiographers to improve computed radiography image quality Cognitive Technical Systems-What is the Role of Artificial Intelligence? Applications of artificial intelligence (AI) in diagnostic radiology: a technography study Predicting breast cancer 5-year survival using machine learning: a systematic review Strengths, weaknesses, opportunities, and threats analysis of artificial intelligence and machine learning applications in radiology Influence of artificial intelligence on Canadian medical students' preference for radiology specialty: a national survey study A survey on the future of radiology among radiologists, medical students and surgeons: students and surgeons tend to be more skeptical about artificial intelligence and radiologists may fear that other disciplines take over Artificial intelligence: the opinions of radiographers and radiation therapists in Ireland Attitudes toward artificial intelligence among radiologists, IT specialists, and industry Computerized system for safety verification of external beam radiation therapy planning Artificial intelligence: radiologists' expectations and opinions gleaned from a nationwide online survey Medical students' attitude towards artificial intelligence: a multicentre survey AI and ethics in medical radiation sciences Impact of the rise of artificial intelligence in radiology: what do radiologists think? Diagn Interv Imaging Attitudes and perceptions of UK medical students towards artificial intelligence and radiology: a multicentre survey Progress in fully automated abdominal CT interpretation Deep-learning-based detection and segmentation of organs at risk in nasopharyngeal carcinoma computed tomographic images for radiotherapy planning Perceptions of Canadian radiation oncologists, radiation physicists, radiation therapists and radiation trainees about the impact of artificial intelligence in radiation oncology-national survey Ten Haken RK. Artificial intelligence: reshaping the practice of radiological sciences in the 21st century The authors report no conflicts of interest in this work.