key: cord-0925131-nb08uxku
authors: Raman, Raghu; Achuthan, Krishnashree; Nair, Vinith Kumar; Nedungadi, Prema
title: Virtual Laboratories- A historical review and bibliometric analysis of the past three decades
date: 2022-04-28
journal: Educ Inf Technol (Dordr)
DOI: 10.1007/s10639-022-11058-9
sha: 6a4f0ffce2b0bb3ccd38912b6a87eb537f2965b5
doc_id: 925131
cord_uid: nb08uxku

Online and virtual teaching–learning has been a panacea that most educational institutions adopted from the dire need created by COVID-19. We provide a comprehensive bibliometric study of 9523 publications on virtual laboratories in higher education covering the years 1991 to 2021. Influential bibliometrics such as publications and citations, productive countries, contributing institutions, funders, journals, authors, and bibliographic couplings were studied using the Scientific Procedures and Rationales for Systematic Literature Reviews (SPAR-4-SLR) protocol. A new metric to complement citations called Field Weighted Citation Impact was introduced that considers the differences in research behavior across disciplines. Findings show that 72% of the research work was published between 2011-and 2021, most likely due to digitalization, with the highest number of publications in 2020–2021 highlighting the impact of the pandemic. Top contributing institutions were from the developed economies of Spain, Germany, and the United States. The citation impact from publications with international co-authors is the highest, highlighting the importance of co-authoring papers with different countries. For the first time, Altmetrics in the context of virtual labs were studied though a very low correlation was observed between citations and Altmetrics Attention Score. Still, the overall percentage of publications with attention showed linear growth. Our work also highlights that virtual laboratory could play a significant role in achieving the United Nations Sustainable Development Goals, specifically SDG4-Quality Education, which largely remains under-addressed.

Experimentation in laboratories is vital in science, engineering, and technology education. Traditionally, the experiments are done in hands-on labs, which involve physical presence, procurement of equipment, and human resources to maintain them (Gomes & Bogosyan, 2009 ). Progressive technological developments and the ubiquity of the internet transformed lab experimentation in science, technology, and engineering, aiding distance learning or e-learning through virtual reality, virtual worlds, dynamics-based virtual systems, and virtual laboratories. Virtual experiments delivered with computer technology add value to physical experiments by allowing students to explore scientific phenomena; link observable and unobservable phenomena; point out salient information; enable learners to conduct multiple experiments in a short amount of time; and provide online, adaptive guidance (Ton de Jong et al., 2013) . Virtual laboratories direct students' attention to variables and the interaction of the variables that produce the outcomes (Toth, 2016) . As such, this technology has the potential for delivering a first-person experience that very closely approximates not just that of a teaching laboratory (Vrellis et al., 2016) . Virtual laboratories allow students to put theory into practice in appropriate experiments at a given level of advancement in a discipline or with specific topics within a course of study (Ural, 2016) . Compared to traditional hands-on laboratories, they can offer reduced cost, greater accessibility, time-saving, safe environments, and flexibility for self-regulated learning (Ali and Ullah, 2020; Alkhaldi et al., 2016) .

Virtual laboratories can be considered an alternative to hands-on laboratories, and they can be regarded as being as effective as hands-on laboratories (Kapici H.O. et al., 2019 ). An extensive pedagogical study through the development of two instruments towards assessing conceptual understanding and perception of platform effectiveness that was conducted both on physical laboratory and remotely triggerable Universal Testing Machine (RT-UTM) showed remote users conducted experiments three times more frequently, completed assignments in 30% less time and had over 200% improvement in scores when RT-UTM platform was integrated into mainstream learning (Achuthan et al., 2020) . Virtual laboratories are generally accepted as a viable alternative to traditional labs in imparting practical skills to students and professionals and positively affecting students' learning processes (Stegman, 2021) . As an innovation, virtual laboratories promote a resilient, inclusive, and sustainable approach to supplementing knowledge and training resources and common limitations to laboratory skill training (Achuthan et al., 2020) .

The virtual laboratories are based on concepts of remote access to simulated resource system. The researchers operate with an experimentation interface on a virtual system through the internet, a simulated system accessible by several users simultaneously (Heradio et al., 2016) . There are several benefits of virtual labs in higher education (Tawfik et al., 2012) . First, available anytime, anywhere. Second, multi-tasking and observability, for several researchers to work concurrently on an investigation through virtual labs. Third, it provides safety compared to physical labs due to non-exposure to the hazardous experimental setup. Finally, flexibility; is the ability to change experimental configurations and study their impact with little or no downtime. The virtual labs played a crucial role in the higher education sector during the COVID-19 pandemic. Using Google Analytics, Raman et al. (2021a Raman et al. ( , 2021b Raman et al. ( , 2021c found that users increasingly adopted online labs during the pandemic as a new learning pedagogy for performing lab experiments as indicated by parameters such as the number of users; the number of unique pages viewed per session; time spent on viewing content and bounce rate.

In the literature, a wide range of studies like the virtual and remote labs in education (Heradio et al., 2016; Tzafestas et al., 2006; Balamuralithara & Woods, 2009; Grosseck et al., 2019; Chandrashekhar et al., 2020; Sweileh, 2020; Meschede, 2020; Ray & Srivastava, 2020; Raman et al., 2021b) , Technology-enhanced learning (Shen & J. Ho, 2020) , e-learning (Jui-long Hung, 2012) , medical education (Nedungadi & Raman, 2016) , and Virtual Reality in Higher Education (Shaista et al., 2021) have been observed. Virtual labs have been studied as an alternative to in-person labs to determine if students will learn from the virtual lab experience (Davenport et al., 2018; Enneking et al., 2019; Miller et al., 2018) . These studies highlighted that the combined physical and virtual labs would be frequently needed, and a systematic blending would be required to suit specific learning objectives and learners (Achuthan et al., 2017) .

Our study addresses the gaps in the existing body of scientific literature, regarding virtual laboratories in higher education, in multiple ways. The earlier studies focused on science mapping and performance analysis, exploring current trends and critical issues in virtual laboratories. The three crucial gaps addressed in our work include: Firstly, we have studied the intellectual structure of virtual laboratories for over 30 years, giving comprehensive coverage to this important research topic. Secondly, we introduce new metrics like Field Weighted Citation Impact (Colledge & Verlinde, 2014) and alternate metrics based on social media platforms that have not been studied before in the context of virtual laboratories. Finally, we look at how virtual laboratories research contributes to the United Nations Sustainable Development Goals and the recent impact of COVID-19. Virtual Laboratories had been in use for years before the pandemic started. Still, the user adoption of virtual laboratories increased during the pandemic-imposed lockdowns, and learners were minor instructor-dependent (Radhamani et al., 2021) . These virtual laboratories have been used as a complement learning resource to in-person laboratories for both teachers and students since the early 2000s (Vasiliadou, 2020) . The National Mission on Education through Information and Communication Technology (NMEICT), an initiative of the Ministry of Education, Government of India, launched in 2009, is an excellent example of the adoption of virtual laboratories prepandemic. India's Ministry of Human Resources Development initiative has simulation-based virtual labs in various science and engineering disciplines based on multiple university syllabi. Another example of adoption is the EXPERES project in Morocco from 2016 to 2018. Moroccan universities developed virtual laboratories and implemented them in the 12 science faculties in Morocco. The study further observed that virtual laboratories support adopting the proposed learning environment in laboratory educational procedures as an alternative to physical laboratories (El Kharki et al., 2021) .

The analysis resulted in the key findings: SDG remains under-addressed, and countries worldwide should focus on virtual labs in higher education to achieve SDG, especially SDG4-Quality education. Virtual laboratories contribute the most to achieving SDG 4, and other SDGs are addressed in a mere 7% of all publications.

From our understanding, this work is the first in the entire literature to do so. Secondly, while prior work on virtual laboratories has shown its successful usage as a supplement to physical laboratories, the COVID pandemic significantly reversed this impetus for virtual laboratory usage. This reversal and its impact on various disciplines are vital to monitor as it adds significant value to future design and usage of virtual laboratories. Thirdly, our work is unique, while performance analysis has been done in existing studies using citation analysis. It presents a more extensive comprehensive overview using Altmetrics and Citation Impact that has not been explored before.

In this work, we conduct a systematic literature review of 9523 articles related to virtual laboratories in higher education published between 1991 and 2021. Our methodology consists of bibliometrics and Altmetrics analysis (Raman et al., 2021b) , (Raman et al., 2022) , and content analysis (Radhamani et al., 2021; Tibaná-Herrera et al., 2018) .

Specifically, in our study following research questions (RQ) are explored regarding virtual laboratories in higher education.

• RQ1: What are the bibliometric trends in publications, citations, and Altmetrics? • RQ2: Which are the top contributing institutions? • RQ3: Who are the prolific authors and their networks? • RQ4: Which are the most productive countries in terms of publications? • RQ5: Which are the influential publications based on citations and Altmetrics? • RQ6: Which are the top citing journals and their networks? • RQ7: What are the intellectual structure's major research themes, topics, and keyphrases? • RQ8: How is research on virtual laboratories contributing to UN SDG? • RQ9: What has been the impact of COVID-19 on the adoption of virtual laboratories?

This study analyses the virtual laboratories' research over three decades across different regions of the world and how virtual laboratories' research contributes to UN SDG and the recent impact of COVID-19 has been studied. Hence this article caters to an international readership. Most of the bibliometric studies in the area of virtual laboratories have been done till 2015 and follow conventional science mapping and performance analysis methods exploring current trends. Through these research questions, we are not only trying to measure the impact of research using Altmetrics, which addresses social media attention but also contributing to the UN SDG. This makes the study unique and essential to researchers. The other aspect is the impact of a pandemic like COVID-19, a once-in-a-century phenomenon on virtual laboratories. It is also explored, increasing the study's significance for a wider international readership.

The field of bibliometrics studies publication and citation patterns by using quantitative techniques. Bibliometrics can be either descriptive, such as looking at how many articles an organization has published, or evaluative, such as using citation analysis to examine how those articles influenced subsequent research by others. According to Narin and Hamilton (1996) , Noyons et al. (1999) bibliometrics can be characterized based on the type of analysis done i.,e. performance analysis and science mapping analysis. Typical performance analysis utilizes the cumulative publications, citations, ratio, yearly trend, and journal quality indicated by SCImago rank and impact factor. In this work, we have considered the h-index (Hirsch, 2005) , a popular metric used in bibliometric research (Gaviria-Marin et al., 2019) . The h-index indicates the number of documents that have received an 'h' number of citations or more.

We have introduced two new indicators as part of the performance analysis in our study. The first is Field Weighted Citation Impact (FWCI), an article-level metric from Scival. FWCI takes the form of a simple ratio: actual citations to a given publication divided by the expected rate for publications of similar age, subject, and type. It considers the differences in research behavior across disciplines. The second indicator is Altmetrics which attempts to capture research impact through non-traditional means like social media (Priem et al., 2012a) . The Altmetric Attention Score (AAS) is a weighted count of all the online attention found for a publication. This includes mentions in public policy documents and references in Wikipedia, mainstream news, social networks, Twitter, blogs, and more (Williams, 2016) . Most comments on the benefits of Altmetrics relate to their potential for measuring the broader impact of research, that is, beyond science (Priem et al., 2011 (Priem et al., , 2012b Weller et al., 2011) .

The second type of bibliometric study includes science mapping analysis, which evaluates a research field's cognitive and social structure (Small, 1999) . Visualization of Similarities (VOS) viewer is a software tool specifically designed for constructing and visualizing bibliometric networks ( van Eck & Waltman, 2010) and has been widely used in science mapping studies (Butt et al., 2020; Farooq et al., 2021; Khan et al., 2020; Saleem et al., 2021) . Such science mapping illustrates scientific research's structural and dynamic aspects (Cobo et al., 2011) . With VOSviewer, patterns of influence in co-citations have been illustrated. Co-citation occurs when two documents receive a citation from the same third document (Small, 1973 ). An author co-citation analysis (ACA) allows us to understand how authors, as topic experts, connect ideas between published articles (Chen et al., 2010) . Like co-citation, a similarity measure based on citation analysis, Bibliographical coupling is also used in our study (Kessler, 1963) .

The Dimensions tool from Digital Science, which is widely used in bibliometrics studies, was used for retrieving the bibliographic data of Virtual Laboratories (Bode et al., 2018; Herzog et al., 2020; Martín-Martín et al., 2021) .

For our study, we adopted the 3-stage Scientific Procedures and Rationales for Systematic Literature Reviews (SPAR-4-SLR) protocol developed by Paul et al. (2021) , as shown in Fig. 1 . The 3-stages include:

Assembling involves the identification and acquisition of publications for review. The bibliographic data of publications were collected from the Dimensions database, which is used in several bibliometric studies (Bornmann, 2018; Bornmann & Marx, 2018; Singh et al., 2021) . The search period was from 1991 to 2021, and the following keywords were used; Virtual lab*, online lab*, remote lab*, virtual experiment*, online experiment*, remote experiment*, UN SDG*, COVID-19* and higher education. A total of 9762 publications were returned.

The next stage is arranging, which involves the organization and purification of the publications. Publications were organized using the publication title, journal title, author name, country of affiliation, author & index keywords, funders, number of citations, number of publications, h-index, FWCI, and attention score. In terms of purification, only publication types were included: Articles, proceedings, book chapters, and edited books; publications type preprint and monograph were removed. After purification, 9523 publications were included for analysis.

The final stage is assessing, which involves evaluation and reporting. SPAR-4-SLR protocol provides valuable suggestions that can help scholars justify the logic (rationale, reason) behind review decisions (Paul et al., 2021) . The bibliometric review has been done in this article using bibliographic modeling and topic modeling, e.g., co-citation analysis, bibliographic coupling, and keyword co-occurrence analysis, to ensure rigor. The agenda proposal method has been used to identify the gaps based on a review of existing literature and suggest future research directions. No ethics clearance was required since the study is predicated on secondary data that can be accessed by anyone who has access to Dimensions. The reporting conventions of the review include figures, tables, and words, whereas the limitations and sources of support are acknowledged toward the end of this article. 

Review domain: Virtual laboratories in higher education Research questions:

• What are the bibliographic trends regarding publications, citations, authors, countries, and journals? • Which are the influential publications based on citations and Altmetrics?

• What are the major research themes in the intellectual structure?

• Is research on virtual laboratories contributing to UN SDGs? • What has been the impact of COVID-19? Source type: Conceptual and empirical "articles" Source quality: Dimensions.ai, Scival

Organizing codes: publication title, journal name, author name, country of affiliation, author keywords, index keywords, funders, number of citations, number of publications, number of publications with attention, attention score Organizing frameworks: Not applicable 

The bibliometric trends for 9523 publications and their citations for the period 1991 to 2021 are shown in Fig. 2 . Increased focus on the digitalization of education led to design, development, and usage of virtual laboratories in higher education from 2011-to 2021 (T3). During T3, there were 6883 publications accounting for more than 72% of the total publications. Specifically, the last two years had the highest number of yearly publications due to the massive adoption and new online and virtual learning models induced by COVID-19. Correspondingly the research influence of virtual laboratories as measured by citations also showed a significant increase in T3, accounting for 85% of the total citations received from 1991-to 2021. Table 1 shows the temporal evolution of virtual laboratories' performance across three time periods. The average TP showed a quantum jump from 31 in T1 to 626 in T3. The average TC also increased exponentially from 45 in T1 to 4952 in T3. The average TC/TP also has grown more than three times from T1 to T3.

In Table 2 , we observe how different forms of collaborations have contributed to citation impact (FWCI) of the publications. An FWCI of greater than 1.00 indicates that the publications have been cited more than expected based on the world average for similar publications. Though institutional collaboration contributed the most publications (51.1%), the citation impact from international collaborations is the highest, highlighting the importance of co-authoring papers with different countries.

Finally, we looked at the percentage of publications with attention and Altmetric Attention Scores (AAS) trend between 1991 and 2021 ( Fig. 3) . The mean value of AAS shows a linear upward trend, with the highest value in 2018. Similarly, the percentage of publications with attention shows a linear growth, possibly indicating that authors are actively promoting their research work on social media platforms.

It is essential to recognize the top contributing institutions researching virtual laboratories in higher education so that their work may be tracked to stay updated with the developments in the field. Bibliometric citation analysis was used to identify top institutions to address RQ2. Table 3 shows the leading institutions and their publications and citations. The results show these top institutions belong to the following countries: Spain (3), Germany (4), United States of America (2), Portugal (2), On further analysis of the growth of publications, it was visible that the number of publications from the USA was higher during the initial years, i.e. early 90 s compared to other countries. However, a steeper trajectory in the growth of publications between the period 2001 -2021 was attributed to a larger contribution by European authors. Spain emerged as the country with the highest number of publications. Considering the growth in citations, the average citation count for Spain was 53.1 over the last 10 year period while that for the USA was 72.9 over the same period indicative of a larger research impact of publications from the USA as shown in Fig. 4. 

The recognition of prolific authors is an accepted practice in bibliometrics (Marín et al., 2018) . The prolific authors in virtual labs were ranked based on publications (TP), citations (TC), and percentage of publications with attention (TPA) ( Table 4) .

The top authors publishing on virtual laboratories are Javier Garcia Zubia (TP:115) & Manuel Alonso Castro (TP:110). The research paper of Javier Garcia Zubia with the highest citations (TC:35) is "VISIR: Experiences and challenges" Till a decade ago the quality of publications was recognized mostly by way of citations, but this trend has changed with the popularity of social networking platforms such as Facebook, Twitter, LinkedIn, Mendeley etc. The penetration of ICT has given the emergence of a new area called Altmetrics. Priem and Hemminger (2010) first coined the term "Altmetrics" and subsequently published a manifesto . Bornmann (2014) proposed Altmetrics as an alternative and the extension of the traditional bibliometric indicators (such as Journal Impact Factor or h-index). Altmetrics enables to study the impact of a paper just a few days or weeks after it has appeared and the techniques include both "intrinsic" measures linked to the author's scientific community, and "extrinsic" measures from the broader context outside the research community (Poplašen & Grgić, 2017) . When we look at TC/TP to measure the research impact, Sebastian Dormido has the highest TC/TP (21.05) but Glen EP Ropella has more publications with attention (TPA: 54%). This indicates though an author may have more citations it does not necessarily mean higher attention.

To address RQ4, we ranked the most productive countries based on publications and citations (Table 5) Alternate metrics called Altmetrics have been proposed to obtain, evaluate, and characterize scientific information of most productive countries through data contained in social media such as Twitter, Facebook, Google + , blogs, Mendeley Readers, CiteULike, Reddit, and Wikipedia, among others (Priem et al., 2012a) . The percentage of Total Publications with Attention (TPA) reveals a different picture. It can be seen that New Zealand (TP:50, TC:183) and Israel (TP:2, TC:455) though have a fewer number of publications and citations have a higher TPA percentage (New Zealand TPA:50, Israel TPA: 48.2) which may be because of high visibility in social media platforms but not necessarily scholarly relevance (Trueger et al., 2015; Veeranjaneyulu, 2018 ).

Most productive countries based on publications, citations, and Altmetrics Table 6 shows influential publications ranked based on citations. Among the topcited publications, the following studies are literature reviews or bibliometrics reviews on the topic of virtual laboratories.

For example, the study of Ma and Nickerson (2006) is a detailed literature review on the topic of hand-on, simulated, and remote laboratories and their role in science education. They summarize, compare, and provide insights about literature related to three types of laboratories. They concluded the boundaries among the three labs i.e. hands-on, simulated and remote laboratories are blurred in the sense that most laboratories are mediated by computers, and that the psychology of presence may be as important as technology. de Jong et al. (2013) reviewed the literature to contrast the value of physical and virtual investigations and to offer recommendations for combining the two to strengthen science learning. Gomes and Bogosyan's (2009) study present the literature review and discusses virtual labs' role in student education. They provide the latest trends related to remote laboratories. In another study, Heradio et al. (2016) conducted a bibliometric analysis of the topic on virtual and remote laboratories. They provide an in-depth bibliometric analysis of virtual labs, but their study covers the period only until 2015.

The development process of virtual labs is explained and discussed by the authors (Ko et al., 2001a (Ko et al., , 2001b Nedungadi et al., 2018; Quesnel et al., 2009; Tetko et al., 2005) . The utilization of digital technologies in higher education has increased the demand for virtual labs for sciences and engineering students (Achuthan et al., 2020; Jara et al., 2011; Martín-Gutiérrez et al., 2017; Restivo et al., 2009; Sangeeth et al., 2015) . Virtual laboratories play a pivotal role in distance learning and the digital education system in science and engineering (Dalgarno et al., 2009 ). The effect of virtual laboratories is positive, and it results in higher learning outcomes of experiments in sciences and engineering (Lindsay & Good, 2005; Koretsky et al., 2008; Achuthan et al., 2011; Nedungadi et al., 2017a , 2017b , Post et al., 2019 .

Citation-based metrics have some limitations such as the delay from publication to bibliographic indexing into citation databases (Sud & Thelwall, 2014) . As a complement to this traditional measure of scholarly impact , while ranking the top ten influential publications, we also considered Altmetrics to address RQ5. The potential advantages of Altmetrics for research evaluation cannot be ignored and they may reflect impacts that may appear before citations.

The top ten influential publications based on Altmetric Attention Score (AAS) are highlighted in Table 7 . AAS gives the real-time impact of papers by including mentions on the internet and on social media (Dinsmore et al., 2014) . We observe that the publication titled Education online: The virtual lab published in Nature journal has the highest AAS (278). Ranked second is Simulated Interactive Research Experiments as Educational Tools for Advanced Science with an AAS of 110 though its citations are only 5. However, the publication titled Compiling and using (ii) presented future research directions and discussed the essentials of virtual labs in higher education Harward et al. (2008) Proceedings of the IEEE 291 The overview of the MIT iLab project developed a software toolkit for virtual labs through the internet (i) overview of iLab and their developed software kits for utilizing the Aktan et al. (1996) IEEE Transactions on Education 229 The discussion and analysis of distance learning application to virtual laboratories in the engineering discipline (i) overview of the application of distance learning tools through the internet to experiments of engineering students is presented in this study. (ii) overview of detailed past literature is provided Weiler & McDonnell (2004) Journal of Hydrology 220 The objective is to conceptualize the process of hillslope hydrology through virtual labs input-output frameworks through collaborative virtual laboratories has more citations (TC:146) but its AAS is only 32. Some publications like Remote Laboratory Exercise to Develop Micro pipetting Skills have zero citations, but the AAS is 53 which confirms that there may be a low correlation between AAS and citations (Haustein et al. , 2015 . Going one step further, we studied correlation between TC and AAS (Torres-Salinas et al. (2013)). Top 500 publications based on citations and their corresponding AAS scores were identified. Correlation analysis was performed with Microsoft Excel, and findings were interpreted using a predetermined p-value threshold of < 0.05. There were several publications with no AAS Score and we assigned a value of zero to them. The correlation between TC and AAS was found to be low (r = 0.12). Studies in the past have also reported a weak or negligible relationship between citations and Altmetrics attention score (Costas et al. 2014 ).

To address RQ6, we ranked the top citing journals based on publications and citations ( Once again we looked at alternate metrics-Total Publications with Attention (TPA). We observed that Journal of Chemical Education got the highest TPA (70.5%) though its publications (TP: 61) and citations (TP: 504) were far less compared to Lecture Notes in Computer Science (TP: 239 and TC: 881). The TPA of the Lecture Notes in Computer Science which has got the highest publications is only 0.9 percent. The journal which has the highest citations (TC:2513) has got lower TPA (19.7%) when compared to the Journal of Chemical Education (TC: 504).

There are several approaches to studying the network structure of a research topic such as bibliographic coupling (Boyack & Klavans, 2010) , co-words analysis (Igami et al., 2014) , and co-authorship analysis (Huang et al., 2015) .

We used VOSviewer for co-word analysis to get an insight into RQ7 i.e., the major research themes, topics, and keywords in the intellectual structure of our research topic. The main objective of the co-words analysis is to identify the research progress that has been achieved by previous researchers and future directions explored by researchers. The keyword of an article can represent its main content, and the frequency of occurrence and co-occurrence can reflect themes focused on a special field to some extent (Zong et al., 2013) . We used VOSviewer to visualize clusters with high similarities between nodes ( van Eck & Waltman, 2007 . Table 9 shows that the total number of keywords in the period 1991-2000 (T1) was 1738, increasing eight times to 12,020 during 2001-2010 (T2) and then more than two times to 31,725 in 2011-2021. Setting a threshold of 15 occurrences for each keyword resulted in cluster formation as detailed in Table 11 . During T1, there was a single cluster of 15 keywords like computer-aided instruction, computer simulation, engineering education, virtual laboratories, multimedia systems which correspond to the research theme of Computer-aided learning (Fig. 5) .

During T2, number of clusters increased to four as seen in Fig. 6 . We see cluster 1 (red) having 52 keywords laboratories; distance education; e-learning; remote laboratories; experiments leading to the research theme of Laboratories in the distance learning. cluster 2 (green) has 50 keywords like virtual laboratories, virtual reality, education, computer simulation, and problem solving leading to theme of virtual laboratories for problem solving. Cluster 3 (blue) with 30 keywords internet; computer software; user interface; multimedia systems; distance learning maps to research theme of Internet and computer software for distance learning. Finally, cluster 4 (yellow) with 19 keywords students; engineering education; teaching; learning systems; computer aided instruction Computer aided instruction in engineering education.

Finally, during T3, number of clusters increased to seven as seen in Fig. 7 . We see Cluster 1 (red) with 136 keywords such as virtual laboratory, internet computer, simulation, and world wide web leading to the theme of computer simulation and virtual laboratory. Cluster 2 (green) has 108 keywords like students; e-learning; engineering education; teaching; curricula mapping to the theme of teaching-learning in engineering education using e-learning. Cluster 3 (blue) has 90 keywords like remote laboratories; remote laboratory; user interfaces; remote experiments; labview which leads to the theme of remote access to the equipment in the labs. Cluster 4 (yellow) has 77 keywords like virtual laboratories; computer software; robotics; matlab; finite element method leading to the theme of computer software and virtual laboratories; Cluster 5 (purple) has 67 keywords like distance education; remote control; distance learning; automation; electrical engineering which leads to the theme distance learning and automation in engineering education. Cluster 6 (light blue) has 47 keywords with main keywords being virtual reality; virtual experiments; multimedia systems; information technology; java programming language mapping to the theme of virtual reality and virtual laboratories and cluster 7 (orange) has 12 keywords like virtual laboratory, remote laboratory, virtual reality, automation, virtualization leading to the theme computer programming and virtualisation.

Clusters representing countries were created using VOS viewer (Table 10) 

At the UN Sustainable Development Summit in September 2015, the world leaders adopted a new 2030 Agenda for Sustainable Development which is "a plan of action for people, planet, and prosperity designed to "shift the world onto a sustainable and resilient path (UN, 2015) . This agenda is mainly represented by the so-called sustainable development goals (SDGs) that encompass "grand challenges" for society at all its levels (George et al., 2016) . Contemporary technologies have been integrated into socio-economic, environmental, sustainable, and climate research applications to enhance the productivity and efficiency of a given system (Balogun et al., 2020; Ceipek et al., 2021) . Information and communication technologies are an enabler to more efficient resource usage, education, and business operations which is a critical success factor for achieving the SDGs (Tjoa et al., 2016) . Virtual laboratories accessible through the internet anytime anywhere can play a very crucial role in achieving United Nations Sustainable Development Goals (SDG), specifically UN SDG4 Quality Education (Benetazzo et al., 2000) . Ahmed & Hasegawa (2021) in their study found a positive relationship between the online virtual platform (OVLP) and SDG related to education. Another example of using educational technology in achieving SDG 4 is the Amrita Rural India Tablet enhanced Education which utilizes multilingual virtual labs that are adapted for rural areas to work with low-bandwidth Internet (Nedungadi et al., 2017a , Menon et al., 2021 . Table 11 shows the virtual laboratory's research related to UN SDG. It can be seen that virtual laboratories contribute the most to achieving SDG 4 (Quality Education), both in terms of TP and TC.

The findings give a new insight into that virtual laboratories are essential to attain the United Nations Sustainable Development Goals (Grosseck et al., 2019; Meschede, 2020) . Quality education is predominantly addressed in 19% of the Fig. 7 Co-occurrence of keywords for 2011 -2021 (T3) papers that reflect the important features virtual labs deliver towards SDG. The other SDG are addressed in a mere 7% of all publications. Thus, SDG remains underaddressed and countries worldwide should focus on virtual labs in higher education to achieve SDG, especially to attain SDG4-Quality education.

COVID-19 has sparked the importance of virtual labs substantially in higher education due to sporadic shutdowns, online coverage of technical content, and inaccessibility of physical labs. In this health-induced economic crisis, virtual labs play a crucial role in the experimentation, analysis, and higher education of students in the sciences field (Ray & Srivastava, 2020; Raman et al., 2021b) . Initially, before COVID, behavioral analysis on university students indicated the substantial popularity of virtual laboratories in education for skill training and instructor dependency. Usage adoption of virtual laboratories increased during the pandemic-imposed lockdowns and learners were being less instructor dependent (Radhamani et al., 2021) . Therefore, it is vital to analyze the role of virtual labs in higher education during COVID-19. By applying bibliometric citation analysis on the literature on virtual labs in higher education, we identified the top 10 influential publications thereby answering RQ9. Table 12 shows the details and list of these publications.

The top three influential studies which explore the role of virtual labs in higher education during COVID-19 were Ray and Srivastava (2020), Klein et al. (2021) , and Vasiliadou (2020) . These recent studies explored research questions like-what role virtual labs play in science and engineering education during COVID-19.

Altmetric Attention Score (AAS) was also retrieved to get a different perspective based on social media presence. AAS was highest (AAS:13) for the publication by Klein et al. (2021) published in Physical Review Physics Education Research. Interestingly the top-cited publication had the least AAS. 

Laboratory experimentation plays an essential role in engineering and scientific education. Virtual and remote labs reduce the costs associated with conventional handson labs due to their required equipment, space, and maintenance staff besides the additional benefits such as supporting distance learning, improving lab accessibility to handicapped people, and increasing safety for dangerous experimentation (Heradio et al., 2016) . This study uses bibliometrics to develop a comprehensive overview of the research contributions in Virtual Laboratories in higher education and uses bibliometric indicators (Garfield, 1956) to represent the bibliographic data, including the total number of publications and citations (Ding et al., 2014) . Our bibliometric analysis highlighted significant insights through analysis of 9523 publications over 30 years between 1991 and 2021. The Scientific Procedures and Rationales for Systematic Literature Reviews (SPAR-4-SLR) protocol was used in the study. Research on Virtual labs intensified between the period 2010 to 2021 due to the increased focus on digitalization of education. The highest number of yearly publications happened during the last two years between 2019 and 2021 with COVID-19 motivating researchers to study impact of online learning. Among the top contributing institutions in publications and citations, the National University of Distance Education (UNED) has the largest number of publications and citations followed by the University of Deusto. Our study shows that European researchers dominated as key authors in terms of the number of publications and citations. The The top citing journal source on virtual labs is the International Journal of Online Engineering (EOE). For the first time, in the context of virtual laboratories, Altmetrics has been included in this study and Altmetrics Attention Score (AAS) and Total Publications with Attention (TPA) have been used as an alternative and extension of the traditional bibliometric indicators. Top 500 publications on virtual labs with citation scores (TC) and AAS were identified and a low correlation was found between TC and AAS, similar to results from other studies. On analysis on virtual labs addressing the UNSDGs, SDG4 (Quality Education) had the highest number of publications and citations. However, only 25% of all publications addressed SDGs, which is quite low considering its significant contribution to accessibility, personalized learning and minimizing laboratory resources in a scalable environment. The co-occurrence of keywords analysis highlights the evolution of virtual laboratories as a field of study exposing the research emphasis over the three decades. Initially, the novel concept of computer-based instruction was explored followed by research in enhancements of methods especially in multiple disciplines towards designing and building these virtual laboratories. During 1991-2000, the studies were focused on simulation and computer aided instruction but the research focus in 2001-2010 shifting to remote access to the equipment's in the engineering labs. During 2010-2021, we see a gradual shift towards virtual reality in virtual laboratories, computer programming and virtualisation.

This study has some limitations. Some articles on virtual laboratories research may have been missed in case virtual laboratories are not mentioned in the title, abstract, or keywords. This could have resulted in some discrepancies in the statistical analysis. Moreover, the citation analysis tool which we have used in this study focuses only on the magnitude of the impact of the cited papers, and highly cited papers are not necessarily high-quality papers (Thompson & Walker, 2015) . There are some limitations with the tools used in this study as well i.e., Scival Field Weighted Citation Impact, h-index, Dimensions & Altmetrics. The main limitation of Citation-based metrics like Field Weighted Citation Impact is that it should not be interpreted as a direct measure of research quality and only the publications included in Scopus have FWCI. H-index is meaningless without a context within the author's discipline, and it should be used with care to make comparisons because of its bias against early career researchers and those who started late or had career breaks. It also discriminates against disciplines. As Dimensions is a relatively new database, many publishers have not indexed their publications with it. This might be impacting the total size of the corpus. And finally, the limitation of Altmetrics is that Attention does not necessarily indicate that the article is important or even of quality and may indicate popularity with the public. Complementing virtual labs with digital and classroom resources will provide comprehensive educational outcomes that will allow students to understand theoretical aspects and develop practical skills (Bencomo, 2004) . Studies show that "digital storytelling" and its associated components such as "virtual reality," "critical thinking,' and "serious games" are the emerging themes of the smart learning environments, and they need to be further developed to establish more ties with "smart learning" (Agbo et al., 2021) . In the future, studies may be carried out on the impact of Virtual Reality (VR) and Augmented Reality (AR) based virtual laboratories.

Author contribution All the authors were involved in conceptualization, formal analysis, methodology, writing-review & editing, and have read and approved the final manuscript.

The datasets generated and analyzed during the current study are not publicly available due to confidentiality but are available from the corresponding author on reasonable request.

Competing interests The authors declare that they have no conflict of interest.

A Guide for Remote Laboratory Instruction in an Instrumen

Virtual Laboratory: A Boon to the Mechanical Engineering Education During COVID-19 Pandemic

Developing Engaging Remote Laboratory Activities for a Nonmajors Chemistry Course During

Labventure": A Click-Through Story Approach to Online Laboratories during a Global Pandemic Journal of Chemical Education

Transforming Traditional Teaching Laboratories for Effective Remote Delivery -A Review Education for Chemical Engineers

Remote triggered dual-axis solar irradiance measurement system

The VALUE@ Amrita Virtual Labs Project: Using web technology to provide virtual laboratory access to students

Augmented reflective learning and knowledge retention perceived among students in classrooms involving virtual laboratories. Education and Information Technologies

Scientific production and thematic breakthroughs in smart learning environments: a bibliometric analysis

Development of online virtual laboratory platform for supporting real laboratory experiments in multi domains

Distance learning applied to control engineering laboratories

Review to analyze and compare virtual chemistry laboratories for their use in education

The effectiveness of prompts to promote engagement with digital interventions: a systematic review

Virtual laboratories in engineering education: The simulation lab and remote lab

Assessing the potentials of digitalization as a tool for climate change adaptation and sustainable development in urban centres

Control learning: present and future

A Webbased distributed virtual educational laboratory

A guide to the Dimensions data approach

Do Altmetrics point to the broader impact of research? An overview of benefits and disadvantages of Altmetrics

Field classification of publications in dimensions: A first case study testing its reliability and validity

Critical rationalism and the search for standard (field-normalized) indicators in Bibliometrics

Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately

Bibliometric analysis of road traffic injuries research in the Gulf Cooperation Council region

A motivation and ability perspective on engagement in emerging digital technologies: The case of Internet of Things solutions

Teacher perception of Olabs pedagogy

The structure and dynamics of co-citation clusters: A multiple-perspective co-citation analysis

Science mapping software tools: Review, analysis, and cooperative study among tools

Scival metrics guidebook

Does Altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective

Effectiveness of a virtual laboratory as a preparatory resource for distance education chemistry students

Whether and how authentic contexts using a virtual chemistry lab support learning

Physical and virtual laboratories in science and engineering education

Content-based citation analysis: The next generation of citation analysis

Alternative perspectives on impact: the potential of ALMs and Altmetrics to inform funders about research impact

Design and implementation of a virtual laboratory for physics subjects in Moroccan universities

The evaluation of a hybrid, general chemistry laboratory curriculum: Impact on students' cognitive, affective, and psychomotor learning

Bibliometric analysis of coronavirus disease (COVID-19) literature published in Web of Science

Response: Citation indexes for science

Knowledge management: A global examination based on bibliometric analysis

Understanding and tackling societal grand challenges through management research

Current trends in Remote Laboratories

Education for Sustainable Development: Evolution and perspectives: A bibliometric review of research

The iLab shared architecture: A web services infrastructure to build communities of internet accessible laboratories

Correction: Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns

Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature

Virtual and remote labs in education: A Bibliometric analysis

Dimensions: Bringing down barriers between scientometricians and data

An index to quantify an individual's scientific research output

A study of research collaboration in the pre-web and postweb stages: A coauthorship analysis of the information systems discipline: A Study of Research Collaboration in the Pre-web and Post-web Stages

Use of text mining and bibliometrics: Research trends of e-learning

A new model to identify the productivity of theses in terms of articles using co-word analysis

Hands-on experiences of undergraduate students in Automatics and Robotics using a virtual and remote laboratory

Using hands-on and virtual laboratories alone or togetherwhich works better for acquiring knowledge and skills

Bibliographic coupling between scientific papers

Bibliometric analysis of literature published on antibacterial dental adhesive from

Studying physics during the COVID-19 pandemic: Student assessments of learning achievement, perceived effectiveness of online recitations, and online laboratories

Development of a web-based laboratory for control experiments on a coupled tank apparatus

A webbased virtual laboratory on a frequency modulation experiment

Enhancement of student learning in experimental design using a virtual laboratory

Effects of laboratory access modes upon learning outcomes

Hands-on, simulated, and remote laboratories

Affective computing in virtual reality: emotion recognitionfrom brain and heartbeat dynamics using wearable sensors

Virtual technologies trends in education

Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: A multidisciplinary comparison of coverage via citations

Transforming attitudes to science in rural India through activity based learning

The Sustainable Development Goals in scientific literature: A bibliometric overview at the meta-level

To Go Virtual or Not to Go Virtual, That is the Question

Bibliometric performance measures

The medical virtual patient simulator (MedVPS) platform

AmritaRITE: A holistic model for inclusive education in rural India

Benefits of Activity Based Learning Pedagogy with Online Labs (OLabs)

Pedagogical support for collaborative development of virtual and remote labs: Amrita VLCAP

Integrating research performance analysis and science mapping

Demography of Altmetrics under the light of Dimensions: Locations, institutions, journals, disciplines, and funding bodies in the global research framework

Scientific procedures and rationales for systematic literature reviews (SPAR-4-SLR)

Altmetric and Bibliometric Scores: Does Open Access Matter

Effects of remote labs on cognitive, behavioral, and affective learning outcomes in higher education

Virtual Laboratories for Education in Science, Technology, and engineering: A Review

Scientometrics 2.0: New metrics of scholarly impact on the social Web

Neylon. C. Altmetrics: A manifesto

Uncovering impacts: CitedIn and total-impact, two new tools for gathering Altmetrics

Altmetrics in the wild: Using social media to explore scholarly impact

The Virtual Laboratory Environment-An operational framework for multi-modelling, simulation and analysis of complex dynamical systems

Virtual laboratory usage tells us about laboratory skill education pre-and post-COVID-19: Focus on usage, behavior, intention and adoption. Education and Information Technologies

Adoption of online proctored examinations by university students during COVID-19: Innovation diffusion study. Education and Information Technologies

Acquisition and user behavior in online science laboratories before and during the COVID-19 pandemic

Bibliometric analysis of SARS, MERS, and COVID-19 studies from India and connection to sustainable development goals

Understanding the Bibliometric Patterns of Publications in IEEE Access

Virtualization of Science Education: A Lesson from the COVID-19 pandemic

A remote laboratory in engineering measurement

Bibliometric analysis of green marketing research from

A remote code editing framework for AMRITA remote triggered WSN laboratory

Educational landscape of virtual reality in higher education: bibliometric evidences of publishing patterns and emerging trends

Technology-enhanced learning in higher education: A bibliometric analysis with latent semantic approach

The journal coverage of web of science, scopus and dimensions: A comparative analysis

Co-citation in the scientific literature: A new measure of the relationship between two documents

Visualizing science by citation mapping

Comment on Zacharia et al., A review of data about the effectiveness of guidance in computer supported, inquiry-based learning laboratories and simulations

Evaluating Altmetrics

Sustainable development goals" with emphasis on "good health and well-being" goal

State-of-the-art remote laboratories for Industrial Electronics Applications

Virtual computational chemistry laboratory-design and description

Do Altmetrics work? Twitter and Ten Other Social Web Services

A Descriptive and historical review of bibliometrics with applications to medical sciences

Categorization of e-learning as an emerging discipline in the world publication system: A bibliometric study in scopus

The role of ICT to achieve the UN Sustainable Development Goals (SDG)

Virtual experiments: A new approach for improving process conceptualization in Hillslope hydrology

Analyzing "real-world" anomalous data after experimentation with a virtual laboratory

Altmetrics: New indicators for scientific communication in web 2.0. Comunicar

The altmetric score: A new measure for article-level dissemination and impact

Virtual and remote robotic laboratory: Comparative experimental evaluation

The Effect of Guided-Inquiry Laboratory Experiments on Science Education Students' Chemistry Laboratory Attitudes

Software survey: VOSviewer, a computer program for bibliometric mapping

Text mining and visualization using VOSviewer

Virtual Laboratories during coronavirus (COVID -19) pandemic

Altmetrics: new tools to measure research impact in the digitally networked environment

Learning outcome, presence, and satisfaction from a science activity in Second Life

The altimetric score is now the altimetric attention score

Citation analysis in Twitter: Approaches for defining and measuring information flows within Tweets during scientific conferences

Doctoral dissertations of Library and Information Science in China: A co-word analysis