key: cord-0786632-66w163if authors: Mardani, Abbas; Saraji, Mahyar Kamali; Mishra, Arunodaya Raj; Rani, Pratibha title: A novel extended approach under hesitant fuzzy sets to design a framework for assessing the key challenges of digital health interventions adoption during the COVID-19 outbreak date: 2020-08-07 journal: Appl Soft Comput DOI: 10.1016/j.asoc.2020.106613 sha: ec5fbcfdf80261a1eb3df93f6b713cca80dda7be doc_id: 786632 cord_uid: 66w163if In recent years, Digital Technologies (DTs) are becoming an inseparable part of human lives. Thus, many scholars have conducted research to develop new tools and applications. Processing information, usually in the form of binary code, is the main task in DTs, which is happening through many devices, including computers, smartphones, robots, and applications. Surprisingly, the role of DTs has been highlighted in people’s life due to the COVID-19 pandemic. There are several different challenges to implement and intervene in DTs during the COVID-19 outbreak; therefore, the present study extended a new fuzzy approach under Hesitant Fuzzy Set (HFS) approach using Stepwise Weight Assessment Ratio Analysis (SWARA) and Weighted Aggregated Sum Product Assessment (WASPAS) method to evaluate and rank the critical challenges of DTs intervention to control the COVID-19 outbreak. In this regard, a comprehensive survey using literature and in-depth interviews have been carried out to identify the challenges under the SWOT (Strengths, Weaknesses, Opportunities, Threats) framework. Moreover, the SWARA procedure is applied to analyze and assess the challenges to DTs intervention during the COVID-19 outbreak, and the WASPAS approach is utilized to rank the DTs under hesitant fuzzy sets. Further, to demonstrate the efficacy and practicability of the developed framework, an illustrative case study has been analyzed. The results of this study found that Health Information Systems (HIS) was ranked as the first factor among other factors followed by a lack of digital knowledge, digital stratification, economic interventions, lack of reliable data, and cost inefficiency In conclusion, to confirm the steadiness and strength of the proposed framework, the obtained outputs are compared with other methods. The world has been challenged since late Dec. 2019 by the novel Coronavirus (COVID- 19) detected for the first time in Wuhan, China. It is eventually becoming a pandemic since the with the uncertainty and complexity of these situations. For instance, Fong et al. [14] designed a machine-learning-based model to forecast the future of the COVID-19 outbreak using a small dataset. Thirdly, in the field of health education, DTs can update people's knowledge via communications in various platforms. For example, many healthcare agencies are currently used both Facebook and Twitter to share the real and latest Information and news around COVID-19 with people [11] . Fourthly, AI and deep learning can ease the process of detecting new cases infected by COVID-19, while diagnosing new cases of the disease is a severe challenge due to the cost and accuracy of the tests [15] . On the surface, interventions of DTs have considerable effects on the healthcare system, education system, communications, and especially in dealing with the COVID-19 pandemic. Although there are several studies in the field of digital health interventions, there are a few previous studies focused on the key challenges and opportunities for adopting the healthcare system with DTs [16] . Regarding this, further studies and analyses are needed to explore the open issues stem from digital health interventions during the COVID-19 outbreak. To be more specific, there is a lack of study in which the challenges of digital health interventions during a disaster such as the COVID-19 pandemic has been evaluated; thus, the present study aims to bridge this research gap. The challenges comprise a wide range of issues, including what and how are the contributions of digital health interventions in dealing with training and awareness issues, economic and health hazard issues, treatment and procurement issues, and health hazard prediction issues. Furthermore, some challenges can arise worries or even can be considered as threats, including infodemic risk [17] , insecure applications [18] , unreliable information [19] , noneconomical interventions [20] , digital divide and illiteracy issue [21] , and psychological issues [22] . Besides, digital health interventions can provide several opportunities, including creating a health information system [23] , application of robots, and AI in the healthcare system, especially the medical diagnosis [24, 25] . According to this wide range of challenges, Furthermore, a new extended fuzzy approach is proposed to rank four DT systems to identify the critical challenges of DT interventions to control the COVID-19 outbreak. Fuzzy sets were proposed first by Zadeh (1965) to deal with uncertainty, while it has been using in different fields by scholars since then [26] . Besides, multi-criteria decision making (MCDM) approaches could deal with the real-world issues effectively which include a wide variety of methods, including Analytic Hierarchy Process (AHP), Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), Stepwise Weight Assessment Ratio Analysis (SWARA), and Weighted Aggregated Sum Product Assessment (WASPAS), and many other methods [27] . At present, the Hesitant Fuzzy Sets (HFSs) are proven as a potential structure to express the uncertainty and vagueness that eventually accessible in real-life complex MCDM problems [28] [29] [30] [31] . Because of its unique advantages, several authors have focused their attention on the development of new theories and methods related to HFSs. Driven by the richness of HFSs, the present paper explores within the context of HFSs. It is evident from the earlier researches that there has been no study on developing the integrated decision-making methodology based on SWARA and WASPAS approaches with hesitant fuzzy information. Besides, there has been no work in the literature regarding the proposed hesitant fuzzy-SWARA-WASPAS (HF-SWARA-WASPAS) framework in the assessment of digital health interventions during the COVID-19 outbreak. To the best of author's knowledge, this is the first study that presents an integrated HF-SWARA-WASPAS methodology based on SWARA and WASPAS methods under the HFSs environment. In this methodology, the SWARA approach is utilized to derive the subjective criteria, which is more consistent and has a simple calculation procedure than other weight-determination approaches. Furthermore, the WASPAS method provides easy computational steps with accurate and consistent results in the assessment of digital health interventions in the COVID-19 outbreak. The contributions of this work are explained as follows: • A novel fuzzy approach under the HFS approach is developed to tackle complex MCDM problems. • A new HF-SWARA-WASPAS approach is introduced to evaluate the key challenges of digital health using the SWOT framework. • SWARA procedure is utilized to determine the digital health interventions in dealing with the COVID-19 outbreak. J o u r n a l P r e -p r o o f • WASPAS approach is used to rank the DT systems during the COVID-19 outbreak. • A survey study using interviews and literature has been carried out to identify the challenges of digital health interventions during the COVID-19 pandemic. • A new SWOT framework is developed to classify the challenges into 'Strength,' 'weaknesses,' 'opportunities,' and 'threat.' • An empirical study is considered to prove the potentiality and usefulness of the proposed method within HFSs. The steadiness and strength of the introduced approach are analyzed through comparative analysis. The rest part of this study is arranged as follows: Section 2 presents a comprehensive review of digital health interventions, and it presents the outputs of the SWOT analysis. Next, the methodology of the research is discussed in Section 3, and a literature review around hesitant fuzzy sets, SWARA, and WASPAS methods is presented in this section. Section 4 develops the new extended hesitant fuzzy-SWARA-WASPAS approach. The outcomes of the research and a comparative analysis are discussed in Section 5. An overall conclusion and some research avenues for future work are presented in section 6. The advent of technology has dramatically influenced human lives and their communities. As mentioned, DTs comprise a wide range of technologies that Information and Communication Technology (ICT) systems, owing to their rapid advancing and multi-functionality, have the potential for severe impact. ICT systems include computers, cellular devices, and personal digital assistants [32] . Besides, many companies utilized DTs and network communications and communications widely. At the same time, technology plays a crucial role in forecasting a natural disaster such as earthquakes, eruptions, hurricanes, floods, tsunami, and disease pandemic, such as COVID-19 pandemic, and it can recommend the way to deal with these disasters [25] . In the healthcare system, the quality and the coverage of health services and practices can be enhanced in the light of DTs since they provide many opportunities to cope with healthcare issues [33] . As a result, DT interventions may be utilized to ease interaction with people to extend contact coverage and to generate demand. Also, they may be used to help health workers to gain Information about clinical protocols immediately through telemedicine consultations or decision-support systems. Put simply, DTs can improve the quality of Mahalakshmi [43] did assess the contribution of DTs to control the COVID-19 outbreak in India. The results indicated that DTs could improve the process of monitoring the patients, and they can ease communications among patients and health workers. Golinelli et al., [4] conducted a quick review to identify which digital health interventions can be better solutions for dealing with the COVID-19 pandemic. The results showed that AI is an appropriate technology for medical diagnosis, while social media is useful for surveillance measures and prevention. Hernandez-Orallo et al., [44] investigated the role of smartphones in reducing COVID-19 spreading. To this end, an epidemic model was proposed to assess the cost and efficiency of the measures. As mentioned, the identified challenges are classified on strengths, weaknesses, opportunities, and threats based on the SWOT framework. In the following, all four classifications and their sub-components are presented in detail. DTs, especially robotics, mobile application, and thermal imaging via AI, can be utilized for different purposes, including self-assessment for COVID-19, information circulation through social media, and identifying infected people [45, 46] . For instance, a mobile application named BlueDot is used to trace infected people in India, which works based on big data, machine learning, and AI [25] . Therefore, it is believed that DTs can bear out medical cures and boost them. As mentioned, DTs in the form of different platforms such as online learning portals, social media, and websites can boost awareness of people around COVID-19 news [20] . On top of that, many universities and institutions are utilizing DTs to resume their programs remotely [47] . Besides, Zaman et al., [48] mentioned that DTs, especially in the form of social media, provide Information around COVID-19 pandemic in various ways, including training of preventing measures, online education, data visualization, and monitoring healthcare system. Therefore, DTs' health interventions not only can increase social awareness around the J o u r n a l P r e -p r o o f COVID-19 pandemic but also can train people and health workers to deal with problems stemming from the COVID-19 pandemic. ICT interventions can benefit people in the field of hazard mapping and epidemic and pandemic prediction through data analytic and AI [49] . For instance, Zlatanova and Fabbri [50] integrated ICT with GIS to provide a risk map, and hazard map, and Zhong and Xiao [51] proposed a framework based upon ICT to enhance health prediction through big data and deep learning. Therefore, health hazard prediction is one of the invaluable strengths of ICT interventions having a significant role in controlling the COVID-19 outbreak [52] . DTs can help the healthcare system physically apart from their virtual support. Put simply, DTs in the form of drones, modern robots, and 3D Printers can improve the humanitarian supply management and logistics and medical transportation during COVID-19 outbreak [53, 54] . Also, Tavakoli, Carriere and Torabi [55] conducted a research to find how robots can help health workers by providing this opportunity to triage and monitor patients' symptoms from a safe distance, and to investigate the application telehealth and telepresence technologies in healthcare service delivery during COVID-19 pandemic. Therefore, it is believed that DTs can assist health workers so that face-to-face interaction will be reduced [56] . On top of that, robots can be employed in the healthcare system in forms of nurses, receptionists, serving robots, telemedicine robots, cleaning and spraying robots, and surgical robots [24] . DTs can be used to discover new drugs and vaccines in the form of biotechnical platforms. As a result, digital interventions can boost the progression in a different step of drug development, while they can optimize the process of drug designing through advanced analytics and algorithms [57] . Furthermore, Zaman et al., [48] mentioned that over 30% of participants in the research believe that in the light of AI and epidemiological analysis and Genome sequencing, the process of detecting infected people can be performed more precisely so that discovering vaccines and drugs for controlling COVID-19 will be more achievable. J o u r n a l P r e -p r o o f A majority of economists have mentioned that economic status has directly or indirectly affected by DTs, especially ICT [58] . Besides, DTs are mean of crisis prediction so that the economic crisis can be controlled through this ability. To be specific, DTs can visualize economic effects using data analytic tools. On top of that, it is believed that countries can bring back economic sustainability to their businesses after COVID-19 through ICT economic interventions [59] . A large amount of information is accessible in ICT domains such as social media and website. At the same time, a majority of individuals have propagated unreliable Information on the internet, primarily social media [19] . Besides, all the participants in a research conducted by Zaman et al., [48] mentioned that the critical weakness of ICT health interventions is the lack of reliable data in the ICT domains so that during the COVID-19 pandemic, it is necessary to hinder infodemic through data validation. One of the biggest problems in the field of crisis management is controlling unauthentic Information, misleading both individuals and medical personnel [60] . Also, the authenticity of data is considered as one of the weaknesses of ICT health interventions during COVID-19 pandemic Zaman et al., [48] since the unauthentic Information on the COVID-19 pandemic have circulating fast among people being rooted in myths and pretended cures [61] . A massive amount of time, energy, and money are required to employ DTs in different fields, including the healthcare system, education system, and supply chain management. Also, the cost-efficiency in developing countries and the least developed countries is a vital factor [20] . For example, two types of costs should be considered in online education, including the cost of online education technologies and the cost of distributing and receiving knowledge through the internet [62] . Digital literacy aids people in getting knowledge easy and fast through advanced technology. At the same time, they need to boost their technical skills to take full advantage of DTs in their daily works [63] . However, individuals who do not have enough digital knowledge cannot benefit from digital systems created by different companies for controlling the COVID-19 pandemic [64] . Many areas in the world are deprived of the internet and limited resources so that the digital divide is considered as another weakness of digital health interventions [21] . Also, the digital divide has increased due to the rapid applications of DTs during the COVID-19 outbreak. However, the demand for DTs saw an increase in response to the COVID-19 [65] . The governments have managed to use big data and tracing applications to trace movements of people during the COVID-19 pandemic so that people may be concerned about a lack of privacy [65] . The trace application has raised privacy concerns since service providers should store users' data on their central servers [18] . Besides, over half of participants in Zaman et al. [48] specified that the lack of security is one of the significant weaknesses observed in artificial intelligence and mobile applications. It is believed that countries can use data analytic and artificial intelligence to predict the imminent epidemic precisely [66] . Besides, it is vital to identify the main reasons for the epidemic and the bad sectors leading into pandemic such as COVID-19, so that countries can employ DTs to perform the identification processes more effectively [67, 68] . For instance, Ogundokun and Bamidele [66] used a neural network, linear regression, and support vector regression to predict COVID-19 disease precisely, or Dur-e-Ahmad and Imran [69] used a dynamic transmission model to predict the number of infected people during the COVID-19 in the five countries. There is a growing interest in the application of automation and robots in the healthcare system. Also, robots can boost the efficiency of healthcare practices, since not only do they reduce the workload of medical staff and physicians, but also aid them to cope with problematic situations more precisely [24] . Besides, Zaman et al., [48] specified that over 90% of participants in their research believed that "Robotic Process Automation (RPA)" can be considered as an opportunity to save loads of time and cost, and perform the repetitive processes behalf humans. Therefore, RPA enables medical staff and health workers to treat patients precisely so that it has a crucial role in controlling the COVID-19 pandemic. Health Information Systems (HIS) are considered as the interplay among the technologies, individuals, and processes to bear out practices and management in delivering vital information to boost the quality of healthcare performance [23] . Health information systems comprise health informatics, health information technology, and electronic medical records. Besides, the risk of social system collapse would be reduced during the COVID-19 pandemic if accessing the secured personal health record was maintained through the Health Information System [70] . Digital health applies ICT in health services through related internet-based technologies [71] . Surprisingly, some patients are not skillful and willing to utilize digital health services so that there is a necessity to educate them in digital health care [64] . On top of that, not only how to use digital health services should be thought, but also social engagement about the utilize of digital health services should be provided [72] . Therefore, this pandemic may create a window of opportunity for increasing the level of required knowledge in digital health services. Obtaining an accurate, swift various diagnosis of the source of human disease is a vital step of diagnostic medicine, specifically in viral infections, to boost the delivery of healthcare services [73] . Besides, a majority of COVID-19 diagnosis methods that are currently used are sluggish in nature, prolonging the pandemic period. Therefore, the application of ICT in J o u r n a l P r e -p r o o f medical diagnosis is another opportunity for ICT health interventions can be employed in the same situation as the COVID-19 pandemic in the future [74] . For instance, Saiz and Barandiaran [75] applied a deep learning method to detect the COVID-19 through chest X-RAY Images. Their findings indicated that the introduced model achieved a high sensibility and specificity in COVID-19 detection, which makes the proposed model suitable for this purpose. The most important lesson out of the COVID-19 pandemic is that the world does not have enough preparedness to cope with Coronavirus so that a comprehensive research framework is needed to deal with the COVID-19 and future pandemics [76, 77] . Also, it is believed that genetic analysis could be useful to discover which type of viruses may attack humans affecting the level of preparedness of the healthcare system [78] . Nevertheless, this can only be feasible through a robust collaborative research framework. Religions and political organizations may interfere with the rapid and free growth of ICT since there is a dichotomy between their beliefs and political value and DT [79] . As a result, controlling the pandemic may be clumsy and slow, owing to non-cooperative responses of such organizations that have negatively affected the process of data gathering [48] . Infodemic is as dangerous as pandemic since fake news and false rumors have significant adverse effects on society. Put simply, the epidemic and infodemic are two sides of a coin in the highly digitalized countries [17] . Besides, the discrepant differences in the data and a massive amount of data have confused people. Therefore, it is difficult for the majority of individuals to verify the trustworthiness and the sources of information [80] . Thus, effective interventions of the health services have threatened by infodemic risk. Many tasks have moved online in the light of the COVID-19 pandemic affecting the privacy of people. Although this pandemic is a temporary situation, it has long-lasting impacts on J o u r n a l P r e -p r o o f people's liberty, since a massive amount of health information is needed to control the COVID-19 pandemic [81] . In contrast, this Information is personal so that the expansion of personal information on the internet may have disruptive consequences [82] . Although the operational cost is improved through the application of DTs, especially the combination of AI and IoT, some scholars believe that it may not be affordable in some cases [56] . Put simply, and it is difficult to reap the advantages of ICT health interventions in some countries during the COVID-19 pandemic, especially underdeveloped and least developed countries, owing to the high cost of infrastructure and development [83] . The patients may stop utilizing ICT based health services, considering the cost-benefit trade-off. Therefore, a cost-effective ICT-based health system is required to deal with the unaffordability threat. A new type of phobia, namely "Corona phobia," has recently generated owing to the COVID-19 pandemic. The main reason for generating this phobia is infodemic, though the application of ICT health interventions may be another reason [22] . For instance, color codes are given to people through color-coded apps to segregate infected people from the rest. As a result, these situations have psychological impacts on people's minds boosting the exacerbation of paranoia among people [84] . Considering the wealth of nations, the diffusion rate of digital health services is wary in different nations. The reasons could be related to cost constraints and national policies or commitments. People are divided into different strata based on their social classes affecting the level of accessibility to DTs [21] . Therefore, the digital divide affects digital stratification being a threat to digital health interventions [85] . As mentioned, this study aims to introduce a new framework to evaluate the challenges of digital health intervention adoption during the COVID-19 outbreak. To this end, firstly, the related literature has been scrutinized to do not only observe the current status of digital health interventions in the world, especially during the COVID-19 pandemic but also to identify the challenges of digital health intervention adoption. Next, a survey study through interviews has J o u r n a l P r e -p r o o f been carried out to collect data concerning the identified challenges and alternatives. In this step, the experts have been asked to give their support in assessing the relative significances of attributes and alternatives using linguistic variables (See Table 1 and Table 2 ). The experts were chosen from different expertise, for instance, ICT experts and IT managers. Subsequently, a new extended hesitant fuzzy-SWARA-WASPAS approach (See section 4) has been proposed to assess the challenges of digital health interventions. At last, a comparative analysis has been conducted to evaluate the performance and robustness of the proposed method in comparison with the HF-COPRAS method. The notion of fuzzy sets (FSs) originated by Zadeh [26] has accomplished great success in different areas for handling such type of uncertainty. In several real-life examples, it is not an easy task to express the membership function of an FS due to increasing complexity, time boundedness, the vagueness of the human mind, and many other reasons. To deal with this issue, Torra [86] initiated the notion of the Hesitant Fuzzy Set (HFS), which permits the membership degree of an element to a given set, having a few different values. Torra [86] also conferred the associations between HFS and extended form of FSs, which are intuitionistic fuzzy set (Atanassov [87] ), type-2 fuzzy set [88, 89] and fuzzy multi-set (Yager [90] ). As the extension of FSs, HFSs have proven as accessible and useful tools to portray the imprecise and vague information that occurred in real-life applications. Due to the effectiveness of HFS in dealing with human hesitancy, many theories and applications have been introduced under the HFSs context [28, 31, 91, 92] . For example, Xu and Zhang [93] suggested the hesitant fuzzy TOPSIS model for solving MCDM problems with HFSs. Farhadinia [94] recommended the methodical transformation of the entropy into the similarity measure for HFSs and interval-valued hesitant fuzzy sets. Liao and Xu [95] designed a novel interactive technique to solve the MCDM problems with hesitant fuzzy (HF) information. Next, Thakur, Thakur, Singh and Engineering [96] proposed some new aggregation operators for HFSs. Ashtiani and Azgomi [97] suggested an innovative hesitant fuzzy-based computational trust model deal with the vagueness and hesitancy of trust MCDM problems. Faizi et al., [98] [101] suggested an integrated framework based on the combination of HF-AHP and HF-TOPSIS approaches for the evaluation of solar power plant location sites. Hussain and Yang [102] introduced HF-entropy measures based on the Harsdorf metric and applied them to construct an MCDM framework with HF-information. Mishra, Rani and Pardasani [103] developed the HF-COmplex PRoportional ASsessment (COPRAS) methodology based on Shapley's function to cope with the service quality selection problem within the HFSs context. Xu and Zhang [104] summarized the applications of HF-group decision making into three categories: theory, support, and methods. Mishra, et al., [105] evaluated the green supplier selection problem under the HFSs environment by employing the HF-WASPAS method. Wang [106] considered the aggregation of HF-similarity measures and then developed the synthetical similarity formula. Lalotra and Singh [107] developed the axiomatic definition of HFknowledge measure and presented an equation between the HF-knowledge and HF-entropy measures. Keršuliene, Zavadskas and Turskis [108] Further, Mishra et al., [110] presented an intuitionistic fuzzy MCDM method by integrating SWARA and COPRAS techniques for evaluating bioenergy production technology options. The results indicated that there is an excellent conformity between the proposed method and J o u r n a l P r e -p r o o f with IF-WASPAS. Furthermore, not only the calculations of the proposed are simple, but also it can determine the realistic criteria weight through a simple procedure, which makes the proposed method more stable. Rani et al., [111] developed a combined SWARA and VIKOR based methodology to assess and choose the most appropriate solar panel alternative with PFSs. The findings concluded that their methodology is more useful, robust, and practical in comparison with PF-TOPSIS. On top of that, the tangible sub-criteria can be enumerated successfully using the proposed method, and the significant degree of the decision experts can be estimated correctly and without any modification through the proposed method. With the increasing complexity and wide-spread changes in today's environment, several authors have focused their attention on the development of new MCDM methods. The WASPAS (Weighted Aggregated Sum Product Assessment) method pioneered by Zavadskas et al., [112] , is a utility degree-based technique that has been widely employed in numerous real-life MCDM problems. It is an integration of the Weighted Sum Model (WSM) and Weighted Product Model (WPM); hence, it is more accurate than WSM and WPM. The classical WASPAS technique has been employed for different purposes [113, 114] . A hybrid methodology based on AHP-WASPAS approaches with FSs were introduced by Turskis et al., [115] . The results indicated that the proposed hybrid method could practically rank the alternatives in the large scale problems concerning the multiple conflicting attributes. Ghorabaee et al., [116] This section firstly recalls the basic concepts related to HFSs. Step 4: Evaluating the criteria weights using SWARA approach The procedure for evaluating the relative weights of the criteria using the SWARA method is presented in the following steps: Step 4-A: Find the score degrees ( ) kj h S of HFEs by using Eq. (2). Step 4-B: Determine the criterion ranking order. According to DE's choice, all criteria are arranged from the best to the slightest essential degrees of criteria. Step 4-C: Assess the degree of comparative importance. The comparative importance is evaluated from a criterion which is mentioned at the 2 nd position, and succeeding importance degree is determined to compute the difference of criteria placed th j and ( 1) th j − positions, respectively. Step 4-D: Evaluate the coefficient j r as Eq. (9) 1, 1 1, 1, wherein tj denotes the comparative importance of score degree [108] . Step 4-E: Compute the weight qj by using Step 4-F: Compute the relative weights j w Step 5: Compute the normalized AHF-D matrix In order to normalize the AHF-D matrix , the formula is as follows: where b S and c S describe the benefit and non-benefit criteria sets, respectively. Step 6: Determine the degrees of weighted sum and product models The relative significance degree of th i option as the sum or additive aggregation measure, called as WSM, is evaluated as where j w denotes the weight of a criterion, 1. Step 7: Evaluate the WASPAS measure ι = then WASPAS converts to WSM). It has been examined that the accuracy and consistency of the WASPAS method are higher than the WSM and WPM. Step 8: Arrange the options as per their preference order and find the optimal one. Tables 1 and 2 express the Linguistic Variables (LVs) and their corresponding hesitant fuzzy numbers (HFNs) for the evaluation of relative significances of the criteria/attributes and the alternatives during the given MCDM process, respectively. Due to imprecise knowledge, the uncertainty of the human mind, restriction of time, and qualitative nature of chosen criteria, it is easy for the decision experts to articulate their opinions based on LVs [105] . Assume that the decision experts' weights are presented as . Now, to find the crisp form of decision experts' weights, we have utilized Table 1 and Eqs (6)-(7) and attained as . The individual decision opinions are given by the decision experts' Dk: k = 1, 2, 3 are presented in Table 3 . Further, with the use of Table 3 and Eq. (8), we have created the AHF-D matrix in Table 4 . In Table 5 , the score degrees of HFNs are calculated based on experts' knowledge and experiences. Based on Table 5 , the criterion with the utmost significant degree is depicted as the first rank, and the criterion with a less significant degree is mentioned in the last place (see Table 6 ). Hence, the subjective weights of criteria are computed with the use of Eqs (9)- (11) and Table 6 , and given as: With the help of Table 4 and Eq. (12), the normalized AHF-D matrix is determined and shown in Table 7 . By employing Table 7 and Eqs (13)- (14) , the degree of addition and product aggregation measures are evaluated. Next, by using Eq. (15), the HF-WASPAS measure (with 0.5 ι = ) is evaluated and shown in Table 8 . According to Table 8 J o u r n a l P r e -p r o o f In this section, we applied the HF-COPRAS method proposed by Mishra, Rani and Pardasani [103] to solve the above-discussed MCDM problem and compared it with the proposed HF-SWARA-WASPAS framework. Step 5: Sum of the cost-type and benefit-type criteria values In this step, each alternative is articulated with the addition of values for benefit-type criterion , i β and cost-type criterion , i κ respectively, which means optimization evaluations are maximization and minimization, respectively and defined as Let be a benefit-type criterion set, the higher degrees of which are better. Then, the benefit-type criterion , i β degree for each alternative is given as Let be cost-type criteria set, the lesser degrees of which are superior. The cost-type criterion , i κ degree for each alternative is described as In formulae (16) and (17), l is the number of beneficial criteria, and n is the whole criteria. Step 6: Assess the relative degree of option To compute the relative degree of each option, the formula is presented below: Step 8: Estimate the utility degree The utility degree is determined by using the formula ( ) max 100%, 1 1 . Here, i ο and max ο describe the relative significances of the options given by Eqs (18)- (19) . Considering the Eqs (16)-(20), the computational results of the HF-COPRAS method are presented in Table 9 . Table 9 , the ranking order of the options is 4 1 3 and thus, M4 is the best choice. It is clear from Table 8 and Table 9 that the desirable choice (M4) is the same as all the developed and existing models. Hence, it is obtained that the proposed HF-SWARA-WASPAS methodology is remarkably consistent with the HF-COPRAS approach (see Figure 1 ). In comparison with HF-COPRAS method [106] , the proposed methodology is more reliable, well-consistent, and has broader applicability. The main advantages of the proposed approach are listed as follows: • In the proposed approach, the subjective weights of the criteria during the process of digital health interventions are determined by the SWARA technique that makes the proposed framework a more capable, effective, and reasonable model. • The WASPAS model is the utility based MCDM approach that chooses an alternative that has the highest score (or the maximum utility). While the existing models, which are compromising models, choose an alternative that is closest to the ideal solution. • The WASPAS, integration of the WSM and WPM, is one of the robust new MCDM utility determining methods. The accuracy of this method is more consistent than WPM and WSM.WASPAS enables us to attain the highest accuracy of estimation, applying the suggested methodology for optimization of weighted aggregated function. • The WASPAS method has the potential to involve the decision experts' opinions into decision-making practices, while the COPRAS approach is unable to do so. In comparison with the COPRAS method, the WASPAS approach has fewer mathematical steps, well-consistent, and straightforward in terms of analysis and implementation. • The introduced methodology could provide a more precise explanation under uncertain conditions because of computing the criteria and decision-makers' weights and applying them in the procedure of the developed framework. Besides, two other considered as central features in the process of the developed framework lead the computational results to a reliable solution. These features include the last aggregation method to avoid the loss of data and to tailor the proposed approach based on HFSs Information. In this work, we have introduced a new decision-making model by integrating SWARA, and WASPAS approaches with HFSs. In the proposed framework, the HF-SWARA method has been utilized to weigh the criteria for DT intervention to control the COVID-19 outbreak. In addition, the WASPAS method has been employed to rank the DT systems. The comparative J o u r n a l P r e -p r o o f study has been discussed to validate the results, which shows the robustness of the proposed framework. The findings of this paper demonstrated that the HIS factor had the first rank in adopting the healthcare system with DTs, followed by the lack of digital knowledge, digital stratification, economic interventions, lack of reliable data, and cost inefficiency. The present model has many advantages in comparison with previous methods and models that applied to deal with the COVID-19 issues. For instance, Fong et al. [14] proposed a Monte-Carlo model for fuzzy decision making with incomplete information. However, they used the conventional fuzzy sets to deal with the uncertainty, while in the present paper, a new extension of fuzzy sets, named hesitant fuzzy sets, has been used to deal with complex MCDM issues. It is difficult to express the membership function of a conventional fuzzy set owing to time boundedness, the vagueness of the human mind, and increasing complexity; therefore, this study aimed to integrate HFSs with the proposed framework. Furthermore, Ren, Liao and Liu [123] proposed a new decision-making model to select the medication for the people being infected by the Coronavirus. Although they Generalized Z-numbers with HFSs to deal with uncertainty, their ranking method might not have enough novelty in comparison with the proposed framework in the present paper, named HF-SWARA-WASPAS. The integration of SWARA and WASPAS not only makes make the proposed framework a more capable, efficient, and sensible tool but also provides this opportunity to attain the highest accuracy of estimation. According to the current literature review and the best of our knowledge, we found that there is no study in the literature to provide a comprehensive framework DT intervention to control the COVID-19 outbreak. Therefore, the outcomes of this study will be useful for policymakers, governments, researchers, and practitioners to organize, use and develop the necessary initiatives for DT intervention to control the COVID-19 pandemic in adopting the healthcare system developing or infected countries. Moreover, the results of the study present several implications for further work. For example, to examine the main essential factors DT intervention to control the COVID-19 pandemic in the healthcare systems of the developed and developing nations. There are several limitations and opportunities for further work for adopting the healthcare system with DTs for DT intervention to control the COVID-19 outbreak. To doing so, in this study, we have tried to develop a new framework based on DT's intervention to control the COVID-19 outbreak. Also, this study attempted to provide comprehensive factors to find the main factors in adopting the healthcare system to control the COVID-19 pandemic. Therefore, it is recommended that future studies can consider the framework of this study to implement in their studies. Furthermore, this study investigates several factors in adopting the healthcare J o u r n a l P r e -p r o o f system with DTs for DT intervention to control the COVID-19 outbreak. Therefore, the future study would focus on the other aspects of DT intervention to control the COVID-19 outbreak. In addition, it is recommended that further study needs to identify the critical issues by Pandemics, tourism and global change: a rapid assessment of COVID-19 Information management research and practice in the post-COVID-19 world Strength, Weakness, Opportunity, Threat (SWOT) Analysis of the Adaptations to Anatomical Education in the United Kingdom and Republic of Ireland in Response to the COIVD-19 Pandemic How the COVID-19 pandemic is favoring the adoption of digital technologies in healthcare: a rapid literature review, medRxiv The serendipitous impact of COVID-19 pandemic: A rare opportunity for research and practice Mobile technology intervention for weight loss in rural men: protocol for a pilot pragmatic randomised controlled trial Media innovations in digital music distribution: the case of Beeptunes. com The effectiveness of digital technology interventions to reduce loneliness in adult people: A protocol for a systematic review and meta-analysis, medRxiv Digital entrepreneurship: Toward a digital technology perspective of entrepreneurship Impact of digital surge during Covid-19 pandemic: A viewpoint on research and practice Digital technology and COVID-19 Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study Forecasting models for coronavirus (covid-19): A survey of the state-of-the-art Finding an accurate early forecasting model from small dataset: A case of 2019-ncov novel coronavirus outbreak Considerations for development and use of AI in response to COVID-19 WHO led the digital transformation of your company? A reflection of IT related challenges during the pandemic Assessing the risks of "infodemics Coronavirus contact-tracing apps: can they slow the spread of COVID-19? Trust in Digital Technology: Reliability and Validity The COVID-19 pandemic and the challenge of using technology for medical education in low and middle income countries ICT diffusion as a determinant of human progress, Information Technology for Development Psychosocial impact of COVID-19 Concept and Technology Robotics Utilization for Healthcare Digitization in Global COVID ROLE OF DIGITAL TECHNOLOGIES AND APPLICATIONS AGAINST COVID-19 IN INDIA Fuzzy sets, Information and Control QoS based Web Service Selection and Multi-Criteria Decision Making Methods Multiple criteria group decision making method based on extended hesitant fuzzy sets with unknown weight information Extended TODIM method for CCUS storage site selection under probabilistic hesitant fuzzy environment A new hesitant fuzzy linguistic approach for multiple attribute decision making based on Dempster-Shafer evidence theory An improved structure learning algorithm of Bayesian Network based on the hesitant fuzzy information flow A sociotechnological model for family research and intervention: How information and communication technologies affect family life World Health Organization, WHO guideline: recommendations on digital interventions for health system strengthening: web supplement 2: summary of findings and GRADE tables, in, World Health Organization International Expert Forum on Patient Adherence Furthering patient adherence: a position paper of the international expert forum on patient adherence based on an internet forum discussion How health care professionals evaluate a digital intervention to improve medication adherence: qualitative exploratory study Evaluation of the Information and Communication Technology (ICT) Continuum of Care Services (CCS) Intervention in Bihar Mapping the risk of snakebite in Sri Lanka-a national survey with geospatial analysis Interventions for promoting information and communication technologies adoption in healthcare professionals Effects of clinical communication interventions in hospitals: a systematic review of information and communication technology adoptions for improved communication between clinicians Information and communication technologies for adherence to antiretroviral treatment in adults with HIV/AIDS A digital health intervention to lower cardiovascular risk: a randomized clinical trial Qualitative process study to explore the perceived burdens and benefits of a digital intervention for self-managing high blood pressure in Primary Care in the UK ROLE OF DIGITAL TECHNOLOGIES AND APPLICATIONS AGAINST COVID-19 IN INDIA Evaluating how smartphone contact tracing technology can reduce the spread of infectious diseases: the case of COVID-19 Containing COVID-19 in China: AI and the robotic restructuring of future cities Robotics Utilization for Healthcare Digitization in Global COVID-19 Management COVID-19: Strategies for Engaging Remote Learners in Medical Education ICT Intervention in the Containment of the Pandemic Spread of COVID-19: An Exploratory Study COVID-19: Modeling, Prediction, and Control Enhancing Health Risk Prediction with Deep Learning on Big Data and Revised Fusion Node Paradigm A Predictive Model for the Evolution of COVID-19, medRxiv Low-tech solutions for the COVID-19 supply chain crisis A digital supply chain twin for managing the disruption risks and resilience in the era of Industry 4.0, Production Planning & Control Robotics For COVID-19: How Can Robots Help Health Care in the Fight Against Coronavirus Role of Information Technology in Covid-19 Prevention The Prospects for the Use of Digital Technology Information communication technology (ICT) infrastructure and economic growth: A causality evinced by cross-country panel data The Post-Corona World and International Political Landscape: Emerging Challenges Exaggerated information and COVID-19 outbreak COVID-19 infodemic: More retweets for science-based information on coronavirus than for false information Papers and debates on the economics and costs of distance and online learning Digital Literacy Awareness among Students, Research Hub Technology Literacy as a Barrier to Telehealth During COVID-19 Digital Technologies and the COVID-19 pandemic MACHINE LEARNING PREDICTION FOR COVID 19 PANDEMIC IN INDIA A predictive model and scoring system combining clinical and CT characteristics for the diagnosis of COVID-19 A Novel Scoring System for Prediction of Disease Severity in COVID-19 Transmission Dynamics Model of Coronavirus COVID-19 for the Outbreak in Most Affected Countries of the World COVID-19 and the Need for a National Health Information Technology Infrastructure An Education in Digital Health Teleurology and digital health app in COVID-19 pandemic Emerging Technologies for the Diagnosis of Viral Infections and SARS-CoV-2 The global experience of digital health interventions in COVID-19 management COVID-19 Detection in Chest X-ray Images using a Deep Learning Approach A Systematic Review of COVID-19 Epidemiology Based on Current Evidence COVID-19 and digital epidemiology COVID 19: An Epidemiological and Host Genetics Appraisal Effects of culture and religion on the use of ICT in the Saudi education system Digital health and the COVID-19 epidemic: an assessment framework for apps from an epidemiological and legal perspective Tackling COVID-19 is a crucible for privacy Balancing health privacy, health information exchange, and research in the context of the COVID-19 pandemic The cost-effectiveness of digital health interventions on the management of cardiovascular diseases: systematic review The effects of social deprivation on adolescent development and mental health, The Lancet Child & Adolescent Health Impact of the digital divide in the age of COVID-19 Hesitant fuzzy sets Intuitionistic fuzzy sets, in: Intuitionistic fuzzy sets Fuzzy sets and systems: theory and applications The concept of a linguistic variable and its application to approximate reasoning-III, Information sciences On the theory of bags A new approach to DEMATEL based on interval-valued hesitant fuzzy sets Two new approaches based on ELECTRE II to solve the multiple criteria decision making problems with hesitant fuzzy linguistic term sets Hesitant fuzzy multi-attribute decision making based on TOPSIS with incomplete weight information, Knowledge-Based Systems Information measures for hesitant fuzzy sets and interval-valued hesitant fuzzy sets Satisfaction degree based interactive decision making under hesitant fuzzy environment with incomplete weights Engineering, New hesitant fuzzy operators A hesitant fuzzy model of computational trust considering hesitancy, vagueness and uncertainty Group Decision-Making for Hesitant Fuzzy Sets Based on Characteristic Objects Method Priority degrees for hesitant fuzzy sets: Application to multiple attribute decision making Necessary and possible hesitant fuzzy sets: A novel model for group decision making, Information Fusion A hybrid hesitant fuzzy decision-making approach for evaluating solar power plant location sites Entropy for hesitant fuzzy sets based on Hausdorff metric with construction of hesitant fuzzy TOPSIS Multiple-criteria decision-making for service quality selection based on Shapley COPRAS method under hesitant fuzzy sets An overview on the applications of the hesitant fuzzy sets in group decisionmaking: Theory, support and methods A novel hesitant fuzzy WASPAS method for assessment of green supplier problem based on exponential information measures Aggregation Similarity Measure Based on Hesitant Fuzzy Closeness Degree and Its Application to Clustering Analysis Knowledge measure of hesitant fuzzy set and its application in multiattribute decision-making Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (SWARA) Single-Valued Neutrosophic SWARA-VIKOR Framework for Performance Assessment of Eco-Industrial Thermal Power Plants Novel Multi-Criteria Intuitionistic Fuzzy SWARA-COPRAS Approach for Sustainability Evaluation of the Bioenergy Production Process Pythagorean Fuzzy SWARA-VIKOR Framework for Performance Evaluation of Solar Panel Selection Optimization of weighted aggregated sum product assessment An application of WASPAS method in risk qualitative analysis: a case study of a road construction project in Iran Applications of WASPAS method in manufacturing decision making A hybrid model based on fuzzy AHP and fuzzy WASPAS for construction site selection Multi-criteria evaluation of green suppliers using an extended WASPAS method with interval type-2 fuzzy sets Interval-valued intuitionistic fuzzy WASPAS method: application in reservoir flood control management policy, Group Decision and Negotiation WASPAS and TOPSIS based interval type-2 fuzzy MCDM method for a selection of a car sharing station Multi-criteria assessment of cellular mobile telephone service providers using intuitionistic fuzzy WASPAS method with similarity measures A novel WASPAS approach for multi-criteria physician selection problem with intuitionistic fuzzy type-2 sets Hesitant fuzzy information aggregation in decision making Multiplicative consistency of hesitant fuzzy preference relation and its application in group decision making Generalized Z-numbers with hesitant fuzzy linguistic information and its application to medicine selection for the patients with mild symptoms of the COVID-19