key: cord-1044616-h4y3relc
authors: Xie, Jim S.; Nanji, Keean; Khan, Mohammad; Khalid, Muhammad F.; Garg, Sunir J.; Thabane, Lehana; Sivaprasad, Sobha; Chaudhary, Varun
title: Publication trends in telemedicine research originating from Canada
date: 2022-01-27
journal: Healthc Manage Forum
DOI: 10.1177/08404704211070240
sha: 7a2b7010c74db0ff4ee5d00282441dc8552d616f
doc_id: 1044616
cord_uid: h4y3relc

Telemedicine modalities for patient care have seen significant global uptake during the COVID-19 pandemic. This study aimed to bibliometrically evaluate the evolution and current landscape of telemedicine literature in Canada. The Scopus database was searched to identify telemedicine publications for which the first or last author had a Canadian institutional affiliation. Study selection and data abstraction were conducted by two pairs of independent reviewers. Between 1976 and January 2021, 810 of 3,620 retrieved citations were telemedicine publications originating from Canada, including 29 randomized controlled trials and 6 systematic reviews. The annual publication output increased substantially from 1/year in 1976 to 80/year in 2020. Based on author keyword analysis, the most frequently investigated disciplines or disease entities were primary care, COVID-19, telepsychiatry, heart failure, and mental health. The insights this study provides will aid scientists, policy makers, and other stakeholders in identifying opportunities for future investigation and clinical application.

COVID-19 is an ongoing public health emergency of international concern. The disease is caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), a betacoronavirus that is primarily transmitted through respiratory particles. 1 Asymptomatic and presymptomatic people are infectious, 2,3 presenting a major challenge to curtailing spread. Strategies of reducing person-toperson contact, such as travel restrictions, stay-at-home directives, and social distancing mandates, have been implemented on a global scale to reduce transmission. Nonetheless, the rapid spread and high virulence of COVID-19 continue to place significant burden on Healthcare Providers (HCPs) and systems, limiting access to and quality of care.

Telemedicine has emerged as an effective and affordable solution to optimizing care provision while minimizing personto-person exposure. 4 The World Health Organization (WHO) defines telemedicine as "the delivery of healthcare services, where distance is a critical factor, by all healthcare professionals using information and communication technologies for the exchange of valid information for diagnosis, treatment, and prevention of diseases and injuries, research and evaluation, and for the continuing education of healthcare providers, all in the interests of advancing the health of individuals and their communities." 5 Telemedicine may be live (eg, videoconferencing) or asynchronous (eg, on-line patient portals) and may occur between HCPs and patients or other HCPs. 6 During the COVID-19 pandemic, virtual care modalities have been used across several medical disciplines and in every stage of care: triage, monitoring and assessment, consultation, treatment, follow-up, and on-line health services. 4, [7] [8] [9] [10] Increased uptake of telemedicine has facilitated continuous care to communities and decreased morbidity and mortality related to COVID-19. 4, 7 With the endorsement of major medical organizations worldwide, telemedicine will likely remain an integral component of healthcare post-pandemic. 5, 11 Permanent integration of telemedicine will give rise to numerous challenges that require innovative solutions and further research. In this context, understanding the evolutionary trajectory, current landscape, and key areas of strengths of telemedicine literature may allow stakeholders around the world to develop national strategies to fund and support future telemedicine research.

To date, no comprehensive reviews have examined the evolution of telemedicine research in Canada. Systematic investigations have been conducted to evaluate telemedicine publication trends in other countries. 12, 13 International progress in telemedicine research has also been examined extensively with bibliometric analyses. [14] [15] [16] [17] [18] [19] [20] [21] These studies used broad, search queries for telemedicine without implementing geographical specifications or formal screening of articles. [14] [15] [16] [17] [18] [19] [20] [21] Canada was consistently ranked among the top five countries with the highest telemedicine publication output, demonstrating that Canada remains a leader in telemedicine research. [13] [14] [15] 19 Mapping publication trends in telemedicine literature originating from Canada is vital for researchers, institutions, funding bodies, and policy stakeholders to evaluate research areas and clinical settings that require further academic and infrastructural investment. Since the rapid growth in virtual care infrastructure is likely to continue on a global scale postpandemic, it is currently an opportune time to evaluate the evolution of telemedicine research. This study aims to comprehensively assess trends in Canadian telemedicine research activity between 1976 and January 2021 using a systematic search strategy and bibliometric analysis.

The research question was designed according to the PICOT framework: Population: research in telemedicine in Canada; intervention: publication rate; comparator: none; outcome: publications indexed in Scopus; and time: 1976 to January 2021.

The Scopus scientific citation indexing service (Elsevier, Amsterdam, Netherlands) was searched from its inception up to and including January 2021 for telemedicine studies conducted in Canada. Scopus is the largest abstract and indexing database of peer-reviewed literature. The database contains more than 1.7 billion cited references dating back to 1970 and covers over 7,000 publishers and over 16 million author profiles. Web of Science (Clarivate Analytics, Philadelphia, PA, USA) is a similar international, multidisciplinary indexing database that permits in-depth citation analysis. 22, 23 Ultimately, Scopus was chosen for this study because it covers a wider range of journals. 22, 23 The beginning of the study period was determined by the year in which the earliest Scopus-indexed telemedicine record from Canada was published.

The search strategy was designed in consultation with a research librarian and involved keywords and Medical Subject Headings terms mapping to two concepts: (1) telemedicine and equivalents and (2) Canada and equivalents.

To ensure that all telemedicine publications could be identified, no restriction was placed on Scopus source type (ie, journal, book, book series, conference proceeding, report, and trade publication). The following document types were included: "article," "article in press," "book," "business article," "book chapter," "conference paper," "conference review," "editorial," "letter," "note," "press release," "review," and "short survey." Citations of the document-type "erratum" were excluded because they were not considered to represent research productivity.

This paper adopted the World Health Organization's definition of telemedicine. 5 Only modalities that involved direct information exchange between healthcare professionals or between healthcare professionals and patients across a distance were considered telemedicine. Accordingly, modalities such as self-management web programs, web sites, and mobile phone applications were considered components of telehealth rather than telemedicine.

Studies were eligible for inclusion if they originated from Canada and had at least one research objective involving telemedicine. Studies were considered to originate from Canada if any of the institutional affiliations of the first and last authors were based in Canada. The corresponding author was presumed to be either the first or last author. Publications were excluded if the full text was not available in English nor French.

Given the bibliometric nature of the study, all references underwent an integrated title, abstract, full-text screening stage. Screening was conducted by two pairs of independent reviewers using Covidence, an on-line systematic review software. A citation was included if both independent reviewers within a pair agreed that all criteria were met. If the title or abstract assessment of either reviewer was uncertain, the full text of the citation was screened using the same eligibility criteria. Disagreements between a pair of reviewers were resolved with arbitration by the other pair of reviewers.

The following data pertaining to all retrieved citations were extracted automatically from Scopus: document type, year of publication, name of the journal in which the article was published if applicable, institutional affiliations of all authors, author keywords, and index keywords. For included articles, two pairs of independent reviewers manually extracted the following data using a standardized, pilot-tested extraction sheet designed in Microsoft Excel for Mac (version 16.49, 2021): (1) whether publications indexed as "article," "article in press," or "conference paper" were Randomized Controlled Trials (RCTs); (2) whether publications indexed as "review" or "conference review" were systematic reviews; 

Data were synthesized using the Bibliometrix package (version 3.1.1, 2021) in R (version 4.0.1, 2021). Included publications were imported into R to create a bibliometric data object which was then evaluated for the following endpoints: (1) number of publications per year; (2) number of publications per author, further divided into number of publications per first author and last author; (3) number of publications per journal; (4) frequency with which unique affiliated institutions were cited; (5) number of publications per document type; and 6) frequency with which author keywords (ie, keywords chosen by authors) and index keywords (ie, keywords chosen by Scopus) were cited.

Data were extracted from R into an Excel spreadsheet to calculate summary statistics. Data analysis was performed on all included publications regardless of document type. Unless otherwise stated, medians are reported as median (interquartile range).

A total of 3,620 unique publications from 1976 to January 2021 were retrieved, 810 (22.4%) of which were included because they originated from Canada and pertained to telemedicine ( Figure 1 ). General characteristics of included studies are reported in Table 1 . Among the 810 included publications, 610 (75.3%) were indexed as articles, and the remaining publications were conference papers (8.8%), reviews (6.9%), notes (3.5%), editorials (2.1%), letters (1.2%), book chapters (1.2%), short surveys (.6%), conference reviews (.2%), and unlabelled (.1%). Most studies were only available in English (96.9%) and a minority were available in French (2.2%) or both English and French (.9%). Notably, there were only 29 RCTs (3.6%) and 6 systematic reviews (.7%). The yearly distribution of included publications is shown in Figure 2 . Excluding January 2021, the median number of publications per year was 12.5 (2-32). The median year-onyear growth in publication count was 6.3% (À26.8% to 60.0%) across the entire study period.

The number of individuals authoring Canadian telemedicine studies was 2,746. The median number of publications per author was 1 (1-1). The vast majority of authors (82.3%, n = 2,260) participated in only one publication; only 6.5% (n = 179) of authors had three or more publications. Analyses restricted to the 1,161 unique first and/or last authors in the 810-paper dataset demonstrated similar findings. The median number of publications per first and/or last author was 1 (1-1), and only 6.2% (n = 72) had three or more publications.

The cohort of telemedicine studies originating from Canada included a total of 425 unique institutional affiliations and 3,020 affiliation mentions. The median number of mentions per institution was 1 (1-3) . The top 20 most prolific institutions are listed in Table 2 The journal that published the most telemedicine studies from Canadian first or last authors was the Journal of Telemedicine and Telecare (11.6%, n = 94), followed by Telemedicine and e-Health (7.5%, n = 61) and the Canadian Medical Association Journal (4.2%, n = 34). Table 3 lists the 22 journals with the highest output representing the top 18 places; the next ten most prolific journals were tied for 19 th place. The 22 highest output journals accounted for 46.8% (n = 379) of the 810 publications in the dataset. The median JIF, which is the average number of times a study published within the last two years has been cited in the past year, of the top 22 journals was 1.9 (1.6-3.9). The median CiteScore, which is similar to JIF but spans a 3-year citation period, was 2.4 (1.7-4.0). Overall, the 810-paper dataset originated from 336 unique journals.

Author keyword analysis demonstrated that out of 1995 keywords, the top five most frequently used were telemedicine (6.5%), telehealth (5.0%), primary care (1.4%), COVID-19 (1.0%), and e-health (1.0%). Based on author keywords, the five most commonly investigated disciplines or diseases were primary care (1.4%), COVID-19 (1.0%), telepsychiatry (.9%), heart failure (.6%), and mental health (.6%). The terms that headed the list of 21,838 index Table 2 . Top 20 most productive institutions ranked by number of telemedicine research outputs during the period 1976 to 2020 inclusive. For institutions that were closely affiliated with each other or that were constituent bodies of another organization, publication counts were merged and categorized under the principal organization.

Institution City Total outputs (n)

Total outputs (% of dataset, n = 3020) keywords were more generalized: telemedicine (3.7%), Canada (2.9%), human (2.9%), humans (2.4%), and female (2.2%). The results of author and index keyword analyses are presented in Table 4 .

This study used a novel approach integrating systematic study identification and bibliometric analysis to delineate the most productive institutions and journals as well as the leading research themes of Canadian telemedicine literature over the past 45 years. While previous bibliometric studies have taken a broader and transnational approach, this study comprehensively assessed the evolution of telemedicine research in Canada.

Research productivity grew substantially from 1 publication per year in 1976 to 80 per year in 2020. The high year-on-year growth in publication count between 1976 and 1990 is largely attributable to the low annual publication output, which resulted in small denominators. In contrast, the overall rise in Canadian telemedicine research is likely due to multiple factors, including innovations in electronic communication, broader access to information and communication technology, and acceptance of technology into day-to-day life. 6, 19 Growth in production and citation of telemedicine research has especially increased since 2020, a trend that was catalyzed by COVID-19. 14 Indeed, COVID-19 was the fourth most frequently used author keyword in this study's 45-year dataset despite the pandemic being declared in early 2020.

The temporal course of telemedicine research productivity in Canada parallels increasing publication trends in telemedicine worldwide. 14-16,18-21 Armfield et al. found that annual publication output in telemedicine and telehealth literature remained consistently low until the mid-1990s, after which productivity grew exponentially; the period 1970-1995 was accordingly named the "early epoch." 20 This temporal pattern was corroborated by bibliometric studies of telemedicine and telehealth 16, 19 and of telemedicine in isolation. 15, 18 In alignment with global trends in telemedicine research, this study's Canadian dataset showed an exponential increase in annual publication output beginning in the mid-1990s (Figure 2 ). Fatehi and Wootton 21 (2012) analyzed telemedicine and telehealth publications separately, finding that research productivity in telemedicine increased earlier and to a greater degree than that in telehealth. A more recent bibliometric analysis found that both publication and citation output in telemedicine has increased steadily from 2010 to 2019. 14 No bibliometric studies of telemedicine publication trends during the COVID- 19 pandemic have yet been conducted, but a scoping review found that at least 543 articles on telehealth have been published in the first half of 2020 alone. 9 There is a general consensus that telemedicine will see rapidly increasing implementation and progress during and after the pandemic, 4,9,14 a prediction supported by Canadian publication trends. The accelerated growth of telemedicine infrastructure in Canada and around the world provides a unique opportunity for advancing research and clinical applications in the field. This study has demonstrated a particular need for higher-quality evidence on telemedicine interventions. Only 29 RCTs (3.6%) and 6 systematic reviews (.7%) were found in the 810-paper dataset, a paucity to which competing clinical interests (eg, prioritization of integrating telemedicine into day-to-day practice over interventional research) and the dynamic nature of the field may contribute.

Most institutions involved in telemedicine research were universities and affiliated academic (eg, research centres) and medical institutions (eg, public hospitals). The institutional distribution of publications indicates that the majority of telemedicine research in Canada is conducted in large urban and academic centres.

JIF and CiteScore of journals publishing telemedicine literature have not been examined in previous bibliometric analyses. [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] This study found that the median 2019 JIF and CiteScore of the 22 highest output journals were 1.9 (1.6-3.9) and 2.4 (1.7-4.0), respectively. Less than 30% of journals in the Healthcare Sciences and Services category of Journal Citation Reports had a JIF of 2.8 or higher in 2019. 24 Thus, telemedicine research originating from Canada has a relatively high overall impact in the field. Although citation metrics have been criticized for their lack of correlation to methodological quality and article importance, higher scores are generally indicative of greater dissemination and influence in the scientific community. 25, 26 Based on author keyword analysis, the predominant disciplines and disease entities studied in Canadian telemedicine literature were primary care, COVID-19, telepsychiatry, heart failure, and mental health. It is likely that the keyword "COVID-19" was frequently used to refer to general telemedicine visits during the pandemic, rather than specific visits involving COVID-19 infections. Nevertheless, these findings highlight potential for further telemedicine research in additional medical disciplines. Previous bibliometric analyses have found similar discipline-specific shifts around the turn of the 21 st century from traditionally dominant fields of teleradiology and telepathology to specialities such as telestroke, telecardiology, telepsychiatry, teledermatology, and primary care. 14, 19, 20 Shifting patterns in telemedicine research and uptake reinforce that telemedicine is a rapidly evolving field with increasingly diverse functions and applications. 19 This evolution has been catalyzed by the COVID-19 pandemic and is expected to increase even after the pandemic has resolved. 4, 9, 14 Given that telemedicine has been established as a clinical mainstay, health leaders and practitioners should seek to optimize implementation of virtual care modalities across institutions in all stages of care. Notably, there is high potential for growth of telemedicine in medical disciplines other than primary care. To support permanent integration of telemedicine, health researchers should seek to provide higherquality evidence in the form of RCTs and systematic reviews on the efficacy and utility of virtual care modalities.

Since research outputs were identified from a single citation database, analyses may not reflect the full depth and breadth of telemedicine literature. This study may have missed articles published prior to 1976, in non-indexed journals, and by Canadian institutions for which neither the first nor last author had a Canadian affiliation (eg, international collaboration studies). Furthermore, the search strategy did not include French terms, which may have precluded some Frenchlanguage telemedicine publications from analyses. To mitigate underestimation of telemedicine publications that do not explicitly state telemedicine but belong to the field nonetheless (eg, teleophthalmology), a thorough literature search was conducted with 29 terms mapped to telemedicine and 17 terms mapped to Canada. Retrieved studies were also formally screened based on prespecified eligibility criteria to exclude publications that are unrelated to telemedicine. These strategies minimized the number of missed and erroneously included studies.

Our analyses did not measure intra-or interdisciplinary collaboration, which may be an interesting avenue of future investigation considering that Canada is a global leader in telemedicine research. Furthermore, analyses did not classify articles based on discipline and/or study design beyond the identification of RCTs and systematic reviews. Classifying studies by these systems would provide deeper insight into research themes and evidence gaps.

Over the past 45 years, telemedicine research activity in Canada has increased in parallel with global publication trends. Telemedicine research and uptake have risen significantly in the past year due to the COVID-19 pandemic. This rapid growth is expected to increase post-pandemic, cementing telemedicine as an integral component of healthcare around the world. The majority of telemedicine research in Canada is conducted by large academic centres and their affiliated institutions. Based on the JIF and CiteScore of the most productive journals, telemedicine research originating from Canada has a relatively high overall impact in the field. A potential avenue of future research is exploring telemedicine in healthcare disciplines other than primary care. High-quality evidence on telemedicine interventions is also needed to ascertain efficacy. By assessing the content and evolution of Canadian telemedicine literature with a systematic, bibliometric approach, this study will aid clinicians, policy makers, and other stakeholders in developing a national strategy for telemedicine research.

Coronavirus disease 2019 patients in earlier stages exhaled millions of severe acute respiratory syndrome coronavirus 2 per hour

Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: a living systematic review and metaanalysis

Estimating the extent of asymptomatic COVID-19 and its potential for community transmission: systematic review and meta-analysis

The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence

A Health Telematics Policy in Support of WHO'S Health-For-All Strategy for Global Development

Telemedicine: opportunities and developments in member states

Stability analysis of the mathematical model on the control of HIV/AID pandemic in a heterogenous population

Global survey on telemedicine utilization for movement disorders during the COVID-19 pandemic

Use of telehealth during the COVID-19 pandemic: scoping review

Trends in outpatient care delivery and telemedicine during the COVID-19 pandemic in the US

Virtual Care in Canada: Discussion Paper

Publication output in telemedicine in Spain

The evolution of publication hotspots in the field of telemedicine from 1962 to 2015 and differences among six countries

Harnessing telemedicine for the provision of health care: bibliometric and scientometric analysis

A bibliometric analysis of telemedicine: remote healthcare delivery over the years

Trends and evolution of telemedicine research: a bibliometric approach

Visualizing the intellectual structure and evolution of electronic health and telemedicine research

Telemedicine -a scientometric and density equalizing analysis

Trends in the growth of literature of telemedicine: a bibliometric analysis

Telemedicine -a bibliometric and content analysis of 17,932 publication records

telehealth or e-health? A bibliometric analysis of the trends in the use of these terms

Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses

Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals

The impact factor fallacy

We would like to thank Denise Smith for her research methodology expertise and guidance in designing the search strategy. 

Jim Shenchu Xie  https://orcid.org/0000-0001-5014-561X Varun Chaudhary  https://orcid.org/0000-0002-9988-4146