key: cord-0686480-ubzfof65
authors: Alvarado-Villa, Geovanny; KuonYeng-Escalante, Christian; Sagñay-Pinilla, Nicolás; Vera Paz, Carlos; Cherrez-Ojeda, Ivan
title: Perceptions and knowledge of telemedicine in Ecuadorian practicing physicians: an instrument adaptation, validation and translation from English to Spanish
date: 2021-10-02
journal: BMC Public Health
DOI: 10.1186/s12889-021-11826-1
sha: af1a93b591a95c89b4445e43c4e0f10642ac9480
doc_id: 686480
cord_uid: ubzfof65

BACKGROUND: During the COVID-19 pandemic, multiple countries have taken measures, such as isolation and quarantine, to prevent person-to-person spread of disease. These actions forced many physicians to adopt new techniques, such as telemedicine, to continue patient care, which has proven to be useful in continued care for those with non-COVID-19 pathologies. Various factors, such as security, confidentiality, cost-effectiveness, comfort, and the risk of malpractice, influence the perception of telemedicine among medical practitioners. The aim of this study was to adapt an existing instrument and validate it into a new Spanish version. The instrument is about the perceptions and knowledge of telemedicine in healthcare professionals. METHODS: The original questionnaire surveyed 6 domains with 40 questions, and each question was measured with a five-point Likert scale ranging from very high [5] to very low [1]. The survey was translated to Spanish using machine translation. The translation was reviewed independently, and then, a consensus was achieved regarding minor changes in the syntax of the survey to facilitate understanding. After expert feedback and questionnaire review, the research team members proposed reducing the instrument to 13 items in 4 domains due to the similarity of some questions. The sample was divided into 2randomly selected groups. Eligibility criteria included physicians providing private or public services with active medical/clinical practice. RESULTS: In total, 382 surveys were collected and separated into two random samples, S1 and S2 (198 and 184, respectively). In exploratory factor analysis (EFA), the 13 items were grouped into four theoretical domains, and item 7 presented cross loading between factors and was removed. Confirmatory factor analysis was performed to assess the scale reliability and interscale associations; three models were tested. Global Cronbach’s alpha for internal consistency was 0.76 for the EFA. The goodness of fit measures root mean square error of approximation and comparative fit index were 0.009 and 0.999, respectively, for the best model. CONCLUSIONS: The translated instrument was clear, with adequate internal consistency, readability, and appropriate for application in the physician setting. This validated questionnaire made it possible to evaluate physicians’ knowledge of telemedicine to increase its use, especially during the COVID-19 pandemic. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12889-021-11826-1.

The translated instrument was clear, with adequate internal consistency, readability, and appropriate for application in the physician setting. This validated questionnaire made it possible to evaluate physicians' knowledge of telemedicine to increase its use, especially during the COVID-19 pandemic.

Keywords: Telemedicine, Healthcare, Questionnaire, Perceptions

The use of information and communication technologies (ICTs) in healthcare has significantly changed the physician-patient relationship [1] . Telemedicine is the implementation of ICTs to deliver distant medical care [2] . During the COVID-19 pandemic, multiple countries took public health measures. Isolation and quarantine were community containment plans to prevent person-to-person spread of disease [3] . This unique situation forced many physicians to adopt new techniques to continue patient care [4] . Telemedicine has proven to be a useful tool during the pandemic. As a result, it has been used in the assessment and triage of patients with COVID-19 to reduce healthcare load. Nevertheless, it has proven to be useful for the continued care of those with non-COVID-19 pathologies [5] [6] [7] . In addition, telemedicine may reduce costs due to decreased prolonged hospital stays [8] .

Adaptation to new technologies is generally a process of constant cost-benefit evaluation [9] . For instance, various factors, such as security, confidentiality, costeffectiveness, comfort, and the risk of malpractice, influence the perception of medical practitioners [10] . Kuo et al. (2015) described several factors, such as attitude, subjective norms, and perceived behavioral control, that could affect the intention of physicians to adopt new technologies [11] .

There are some validated English instruments for evaluating physicians' perceptions that were not selected. These questionnaires focus on specialized subjects regarding perceptions and knowledge of telemedicine, such as telerehabilitation [12, 13] , and they are designed for specific medical specialties. Ayatollahi et al. [10] talks about the perceptions and knowledge of telemedicine in general terms, this is the reason why it was selected by the investigators for the adaptation into Spanish and generate a new instrument.

The appropriate assessment of clinician knowledge and perceptions of telemedicine is essential. Therefore, this study created a reliable tool that can detect changes in physicians' perceptions of the use of telemedicine in the future [14, 15] . The aim of this study was to adapt an existing instrument and validate it into a new Spanish version. The instrument is about the perceptions and knowledge of telemedicine in healthcare professionals.

All methods were carried out in accordance with relevant guidelines and regulations. The study was conducted in Ecuadorian physicians, for 6 weeks in a period between march 23rd to may 11th of 2020. Surveys collected were recorded in a standardized database for process and statistical analysis. Data security and protection was preserved at all points during the process. Eligibility criteria included physicians providing private or public services with active medical/clinical practice. The eligibility criteria excluded non-Ecuadorian physicians, because the aim was to adapt a questionnaire based on the region. The sample size was determined by multiplying the number of questions (13 items) by 5 (lower limit) and 20 (upper limit), yielding a needed sample size of 65 to 250 doctors, as proposed by Suhr (2005) and other validation studies in an Ecuadorian population [16] [17] [18] [19] . The population for this investigation was selected by a nondiscriminative selective snowball sampling method, because of social distancing due to COVID-19 pandemic. The instrument was provided on webinars and allowed the recruitment of 404 physicians.

The original questionnaire included 6 domains with 40 questions, and each question was measured with a fivepoint Likert scale ranging from very high [5] to very low [1] [10] . The authors do not consider demographic characteristics as a domain because they do not measure a construct. Yang et al. (2018) proposed a model for the adoption of machine translations (MTs) [20] . Consequently, the survey was translated into Spanish using MT. The translation was reviewed independently by each research team member, and then, a consensus was achieved regarding minor changes needed in the syntax of the survey to facilitate understanding.

The translated instrument was converted into a Google Form survey and was implemented as a pilot test among 65 physicians. The survey objective was to ensure that the vocabulary, understanding, design, and time needed to complete the survey were appropriate enough to ensure stability and comprehension [21] .

After the expert feedback and questionnaire indicators that resulted in the pilot test, the research team members proposed reducing the instrument to 13 items in 4 domains. Three domains were modified or excluded: "Clinicians' perception of the advantages of telemedicine technology", "Clinicians' perception of the telemedicine technology ease of use" and "Clinicians' perception of the necessity of telemedicine technology". The former was modified because physicians do not receive training on the use of ICTs and the similarity between some questions of this domains and some questions of the remain domains. The second one was modified and changed to "Perception of the utility of telemedicine". In the same way, questions that could not be used due to differences in administrative characteristics (budget management, conferences, training or guidelines) were excluded. From the original instrument "Clinicians' perception of the advantages of telemedicine technology" and "Clinicians' perception of the necessity of telemedicine technology" were excluded.

The questionnaire was completed by 404 participants, and 22 of them were excluded because they were not Ecuadorian. The sample was divided into 2 randomly selected groups. The first group consisted of 198 doctors for sample 1 (S1) to perform exploratory factor analysis (EFA). The second group included 184 doctors for sample 2 (S2) for confirmatory factor analysis (CFA).

A descriptive statistical analysis was implemented for sociodemographic data. Qualitative variables are presented as frequencies and percentages, and quantitative variables are presented as the means and standard deviations. Each item was measured using its mean response value. Age, sex, educational level, and workplace were used as independent variables in each analysis. They were examined using skewness and kurtosis for normality. Statistical significance was considered as a p < 0.05. All statistical analyses were performed using SPSS for Windows (version 25.0; SPSS Inc., Chicago, Illinois).

The Kaiser-Meyer-Olkin (KMO) measure was calculated to evaluate the sampling adequacy of each item on the anti-image of the correlation matrix [22] . All sampling measure cutoff points were set at 0.5 [22] . Bartlett's test of sphericity indicated that the analysis was suitable for the scale [23] . Commonality analysis was performed, and after this procedure, the questionnaire was reduced to ensure construct parsimony and usability.

The scale structure was determined by several indicators. Initially, eigenvalues were extracted. A factor structure with eigenvalues above 1 was selected as the criterion for EFA. Maximum likelihood estimation (MLE) was performed and supported the reduction of the instrument to 4 domains: "Knowledge about telemedicine", "Perception of the utility of telemedicine", "Perception of the disadvantages of telemedicine", and "Knowledge of the security of telemedicine". The chi square showed a nonsignificant result, supporting the MLE.

The internal consistency was calculated by Cronbach's alpha for both the full scale and for each of the subscales found in the EFA. Cronbach's alpha measures the interrelation of the items, with values ranging between 0 and 1 [24] . The results above the threshold of > 0.7 were considered acceptable. A value > 0.9 suggests redundancies, indicating that the instrument should be shortened [25] .

Other tests were used to indicate goodness of fit: Chi square, root mean square error of approximation (RMSEA: range 0-1, with a recommended result ≤0.06), normed fit index (NFI: range 0-1, with a recommended result > 0.90), Tucker Lewis index (TLI: 0-1, with a recommended result > 0.90), comparative fit index (CFI: range 0-1, with a recommended result > 0.90), parsimony ratio (range 0-1, with a recommended result of approximately 1), parsimony NFI (PNFI: range 0-1, with a recommended result > 0.50), and parsimony CFI (PCFI: range 0-1, with a recommended result > 0.50) [26, 27] .

The Fernandez-Huerta index and Crawford index were used to assess readability and estimate grade level, respectively. Scores were reported in a range of 0-100, with higher results indicating greater readability, and a result of 60-70 represented easy understanding for the population of~15 years old [28] .

With a response rate of 95%, 382 participants completed the survey. Two hundred twenty-four of the participants were male (58.6%). Most of the participants had a permanent job (88,7%). Approximately 66.8% of the physicians were medical specialists, and 22.3% are currently working as primary care physicians. Their workplace was separated in almost equal percentages: hospital with 23%, clinic 24.3%, both hospital and clinic with 23.6%, private practice with 20.9% and others with 8.1%. The 382 surveys were collected and separated into two random samples, S1 and S2 (198 and 184, respectively). EFA and CFA was performed in S1 and S2, respectively (see Table 1 ).

Individual items were expected to be non-normal. Consistent with this, the skewness ranged from − 1.13 (item 13) to 0.28 (item 2). The kurtosis ranged from − 1.03 (item 8) to 0.84 (item 13). Individual items also had median values ranging from 1.02 (item 13) to 1.28 (item 8).

The clinicians' knowledge about telemedicine is limited, according to item 1, 33% (average) and 25.4% (low), item 2, 30.1% (average) and 30.1% (low) and item 3, 32.7% (average) and 27.7% (low). The perceptions of the utility of telemedicine was average, according to item 4, 32.5% (high) and 28.5% (average), item 5, 35.6% (average) and 23.3% (high) and item 6, 343% (average) and 23.8% (very low) (see Table 2 ).

The Cronbach's alpha for the pilot test was 0.94. In the EFA, the 13 items were grouped into four theoretical domains, and item 7 "To what extent does ease of use of telemedicine technology facilitate its learning?" presented cross loading between factors and was removed. However, item removal at this stage did not improve the reliability statistics (see Table 3 ). The global Cronbach's alpha for internal consistency was 0.76.

CFA was performed to assess scale reliability and interscale associations. Three models (M1, M2, M3) were tested to determine the best reliability (see Tables 4 and 5 ). The removal of item 7 at this stage provided the best goodness of fit measures for the final model. Goodness of fit measures are shown in Table 5 (see Table 6 ). Figure 1 shows the results for model 3 with RMSEA and CFI values of 0.009 and CFI 0.999, respectively (see Fig. 1 ).

A readability analysis was conducted. The results showed a Fernandez-Huerta score of 52.6 and a Crawford grade level of 6.6 [29] . These results indicated that these items were likely to be understandable by a typical 14-to 15-year-old individual and required a minimum of 6 years of schooling.

The results of this validation study achieved a parsimonious and reliable instrument. The results can be used to rapidly assess perceptions of new technology using To what extent are you familiar with the medical applications of telemedicine technology?

3. ¿En qué medida está familiarizado con las herramientas de la telemedicina?

To what extent are you familiar with telemedicine tools?

Perception of the utility of telemedicine 4. En su opinión, ¿En qué medida la telemedicina es efectiva para reducir los costos de la atención al paciente en los hospitales?

In your opinion, to what extent is telemedicine effective in reducing the costs of patient care in hospitals?

In your opinion, to what extent does telemedicine technology save clinicians' time?

6. En su opinión, ¿En qué medida la tecnología de telemedicina proporciona una atención médica mejor y más rápida?

In your opinion, to what extent does telemedicine technology provide faster and better medical care?

Perception of the disadvantages of telemedicine 7. En su opinión, ¿En qué medida la tecnología de telemedicina pone en peligro la privacidad del paciente?

In your opinion, to what extent does telemedicine technology endanger patient privacy?

8. En su opinión, ¿En qué medida la tecnología de telemedicina reduce la eficiencia de la atención al paciente?

In your opinion, to what extent does telemedicine technology reduce the efficiency of patient care?

9. En su opinión, ¿En qué medida la tecnología de telemedicina aumenta la mala práctica médica?

In your opinion, to what extent may telemedicine technology increase malpractice in healthcare?

Knowledge of the security of telemedicine 10. ¿En qué medida se debe crear un marco para evitar la violación de la confidencialidad de los datos cuando se utiliza la telemedicina?

To what extent should a framework be created to prevent breaching data confidentiality when using telemedicine?

11. ¿En qué medida la tecnología de telemedicina requiere una aclaración legal para los pacientes?

To what extent does telemedicine technology require legal clarification for patients?

12. ¿En qué medida la tecnología de telemedicina requiere un marco formulado y claro para acceder a la información médica?

To what extent does telemedicine technology require a formulated and clear framework for access to medical information? data derived from a large cohort of medical practitioners. Several studies have concluded that the length of questionnaires has an inverse relation with the response rate [30, 31] . Due to the time constraints of physicians, the questionnaire was designed to be short and feasible.

Telemedicine has the potential to improve access to healthcare, especially in rural areas [32] . Regardless of its benefits, telemedicine has not been widely adopted. Readiness at various levels was the main factor determining the decision of health centers to not use telehealth "yet". Some centers stated that there were other priorities, such as building patient portals, and others were exploring the process of implementing telehealth [32] . Some patients have negative beliefs about telemedicine, with the main belief being that telemedicine can lead to medical errors [33] . Knowledge of telemedicine is an important key to identifying negative issues. Consequently, healthcare professionals need to learn and adapt their communication and technology for better results.

Evidence from the scientific literature shows that MT can be very useful for developing reliable instruments [34] . The syntax of the target questions was simple enough for rapid translation into a different language with acceptable results. In addition, participant characteristics and sample size ensure that this instrument was appropriate for validation. Another strength of the validation was the heterogeneity of the sample, with physicians with various medical specialties responding to the questionnaire.

The goodness of fit measures for model 3 were better than those for models 1 and 2. Our instrument had readability and validity according to the CFA. In contrast, the original instrument had only correlations between items.

A positive relationship between domains 1 and 2 was shown in the final model due to the positive selection in domain 2 but negative selection in domain 3. Likewise, there was a weaker positive relationship between domain 1 and domain 4 and a negative relationship of domain 3 with domains 1 and 2.

There were some limitations to our study that need to be discussed. First, our population included only Ecuadorian physicians, and the sample may not be representative of other Hispanic countries. The original questionnaire this study derives its initial question set from does not possess a robust theoretical background for feature and domain selection. However, the concise methodology used allows for an adequate baseline to create a Spanish instrument. The study process included the removal of items to offer a simpler construct to derive a solid theoretical background from. The performance of the model suggests that the features selected represent to an adequate degree the problems addressed by the questionnaire. In the traditional questionnaire validation process, backwards translation is used for verification without a doubt that the original translation was valid. Considering that we used a machine learning model to perform the translation, its validity can be verified by switching the input and output. Therefore, the process of backwards translation was not formally performed in this study. The original survey compiled 6 characteristic domains of the population and was validated using face and content validity methods. The original questionnaire had a Cronbach's alpha coefficient of 0.73 [9] . Additionally, our instrument exhibited an acceptable KMO and a significant Bartlett and explained the variance of the 4 dimensions with a strong significant association. Furthermore, our questionnaire, unlike the original questionnaire, was tested using chi square, RMSEA, TLI, NFI, PNFI, CFI, and PCFI, indicating goodness of fit.

Although the use of ICTs among clinicians is high [35] , according to the results of our study, clinicians' knowledge about telemedicine is limited. Still with these results about knowledge of telemedicine, clinicians perceived that it is necessarily the use of it. The security of telemedicine is very important, and most clinicians agree that a framework should be created to prevent breaching data confidentiality. Additionally, the requirement of a formulated and clear framework for access to medical information and legal clarification for patients is needed. Previous studies showed similar results. Ashfaq et al. and Ayatollahi et al. concluded that clinicians' knowledge was also low, and the majority of them thought that the usage of telemedicine was necessary [10, 36] .

Our study developed a translated and validated questionnaire to evaluate physician knowledge and perceptions of telemedicine. The translated instrument was clear, with adequate internal consistency, readability, and appropriate application in physician populations. We identified 12 items grouped into the four theoretical domains.

Our validated questionnaire could help to evaluate physicians' knowledge of telemedicine especially during the COVID-19 pandemic and thereby contribute to the development of tools that can increase the use of telemedicine technologies. We identified the perceptions and knowledge of Ecuadorian physician regarding Telemedicine and recommend that these should be validated in other Hispanic populations. 

The online version contains supplementary material available at https://doi. org/10.1186/s12889-021-11826-1.

Additional file 1.

OTs: a model of information and communication technology acceptance and utilisation by occupational therapists

Telemedicine for developing countries: a survey and some design issues

Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak

Telehealth transformation: COVID-19 and the rise of virtual care

Telemedicine in the era of COVID-19

Telehealth for Global Emergencies: Implications for Coronavirus Disease 2019 (COVID-19)

The majority of skin lesions in pediatric primary care attention could be managed by Teledermatology

Benefits and drawbacks of telemedicine

Teacher adoption of technology

Clinicians' Knowledge and Perception of Telemedicine Technology

The influence of telemedicine experience on physicians' perceptions regarding adoption. Telemed E-Health

Telemedicine and e-Health

Health care professionals' perceptions of home Telemonitoring in heart failure care: cross-sectional survey

Barriers and challenges in adopting Saudi telemedicine network: the perceptions of decision makers of healthcare facilities in Saudi Arabia

Barriers and benefits in telemedicine arising between a hightechnology hospital service provider and remote public healthcare units: a qualitative study in Brazil. Telemed E-Health

Exploratory or Confirmatory Factor Analysis? Cary: SAS Institute

Spanish validation of the revised depression attitude questionnaire (R-DAQ)

Spanish validation endorsement of SDM-Q-9

Psychometric properties of the Bern illegitimate tasks scale -Spanish version

Modeling the intention to use machine translation for student translators: an extension of technology acceptance model

The importance of pilot studies, how to write them and what they mean

Exploratory factor analysis: A five-step guide for novices

Determining the Number of Factors to Retain in EFA: Using the SPSS R-Menu v2 0 to Make More Judicious Estimations

The use of Cronbach's alpha when developing and reporting research instruments in science education

Making sense of Cronbach's alpha

Assessing goodness of fit in confirmatory factor analysis

Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodnessof-Fit Measures

Does length of questionnaire matter? A randomised trial of response rates to a mailed questionnaire

Response burden and questionnaire length: is shorter better? A Review and Meta-analysis. Value Health

Telehealth in health centers: key adoption factors, barriers, and opportunities. Health Aff (Millwood)

The beliefs of Senegal's physicians toward the use of telemedicine

Is machine translation a reliable tool for Reading German scientific databases and research articles?

Frequency of use, perceptions and barriers of information and communication technologies among Latin American physicians: an Ecuadorian cross-sectional study

Knowledge and Attitude Regarding Telemedicine Among Doctors in Karachi

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors acknowledge Ayatollahi H. et al. for allowing the use of the original questionnaire. Special thanks to all members of CENIT project Ecuador. Finally, we want to express our gratitude to Universidad Espiritu Santo for their continuous support.

Authors' contributions ICO and GA coordinated the study. The design, acquisition, analysis, and interpretation of data was performed with substantial contributions from all participating authors. CV, CKY and NSP drafted the manuscript. The statistical analysis was performed by GA and CV. All authors contributed to edited drafts of this manuscript. All authors read and approved the final version of the manuscript.

The funds for the development of this research were provided by Universidad de Especialidades Espíritu Santo.

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate This study was approved by Comité de ética e Investigación en Seres Humanos (CEISH), ethical review board, Guayaquil-Ecuador (#HCK-CEISH-18-0060). Informed consent was obtained from every participant.

Ayatollahi H. et al. gave written consent via e-mail for the use of the questionnaire.

The authors declare that they have no conflicts of interest.Received: 16 December 2020 Accepted: 20 September 2021