key: cord-0928016-3eec34gb authors: Guerrero, Graciela; da Silva, Fernando José Mateus; Fernández-Caballero, Antonio; Pereira, António title: Augmented Humanity: A Systematic Mapping Review date: 2022-01-10 journal: Sensors (Basel) DOI: 10.3390/s22020514 sha: d1315585ccb44076eb2d6df31aea7f5c9b2f95cd doc_id: 928016 cord_uid: 3eec34gb Augmented humanity (AH) is a term that has been mentioned in several research papers. However, these papers differ in their definitions of AH. The number of publications dealing with the topic of AH is represented by a growing number of publications that increase over time, being high impact factor scientific contributions. However, this terminology is used without being formally defined. The aim of this paper is to carry out a systematic mapping review of the different existing definitions of AH and its possible application areas. Publications from 2009 to 2020 were searched in Scopus, IEEE and ACM databases, using search terms “augmented human”, ”human augmentation” and “human 2.0”. Of the 16,914 initially obtained publications, a final number of 133 was finally selected. The mapping results show a growing focus on works based on AH, with computer vision being the index term with the highest number of published articles. Other index terms are wearable computing, augmented reality, human–robot interaction, smart devices and mixed reality. In the different domains where AH is present, there are works in computer science, engineering, robotics, automation and control systems and telecommunications. This review demonstrates that it is necessary to formalize the definition of AH and also the areas of work with greater openness to the use of such concept. This is why the following definition is proposed: “Augmented humanity is a human–computer integration technology that proposes to improve capacity and productivity by changing or increasing the normal ranges of human function through the restoration or extension of human physical, intellectual and social capabilities”. Humans are increasingly dependent on technology. Technology has changed not only humans' behavior and values but also the way they think, communicate and act [1] . However, recent scientific discoveries and inventions have demonstrated that technology is also beginning to modify human capabilities, pushing them beyond their natural limits [2] [3] [4] . With the advance of technology, the interaction between humans and machines has been "improved", "augmented" or even "redesigned" [5] [6] [7] [8] . This has made it not only interesting and intriguing but also viable and arising as a serious concept of scientific research and development [9, 10] . A term related to this technology advancement is Augmented Humanity (AH). The term AH was coined in 2010 at the Internationale Funk Ausstellung conference [11, 12] , indicating that different devices which at first glance seem unconnected to each other will in the future offer a convergence between technologies and devices that aim to interact naturally with the user. The Isobar Trend Report [13] introduces AH as technologies that can work in harmony with humans in ways that enrich life, enhance the human experience and drive sustainable progress for the benefit of people, which will involve investing and engaging underserved audiences in the process. Working together, human and artificial agents must learn and bring these terms into close collaboration between human and artificial agents. These dilemmas are largely due to the differences between human and artificial capabilities and potentialities, and the resulting tensions in their collaboration [14] [15] [16] . Some researchers directly interchange the terms AH and augmented reality (AR). For instance, when AR is deeper and augments the human being, it is called an augmented human [17] . Another article exposes AR as a means to create an augmented human [18] . AH is a discipline that is linked to AR, but the difference between both is not clear [19] . However, these concepts can be clarified with the example of glasses, which can be AR or AH. When the glasses complement the view, then this will be AH; if the glasses have an external functionality, for example to perform a calculation, then it is AR. Hence, the definition of AH is currently not concrete enough, because there are several "definitions" that are not interconnected one to another. Therefore, this research presents some of the definitions obtained from the analysis of works related to the term AH. Moreover, as many works indicate that they are based on AH and have proposed devices, systems, prototypes, etc., this paper fills the need to establish a systematic mapping review for a better understanding of AH. A systematic mapping review is a type of review that allows the contextualization of systematic literature reviews within a broad literature and the identification of gaps in scientific literature. It is a review that seeks to identify not only the results of the works but also the existing links between the works carried out [20] [21] [22] . Therefore, the aim of this paper is to offer a systematic mapping review in order to (1) obtain a precise definition of AH to clarify the concept and use of AH and that it is not misused and (2) list the potential areas of application of AH. This paper is structured as follows. In Section 2, we present the systematic mapping review methodology, research questions, study search strategy, data extraction and analysis and data collection efforts, providing the answers to the research questions posed. In Section 3, we discuss the results obtained from the research questions. Finally, in Section 4, we present the main conclusions of the paper and the risks that may have affected the quality of the study and how they have been mitigated or avoided. This section introduces information on the applied research methodology, including the research protocol related to the preliminary research questions, search strategy and selection criteria. It also includes inclusion and exclusion criteria used in the research and the applied search process. Regarding the research methodology, in the first instance, it is necessary to mention the existing interests and objectives intended to carry out the systematic mapping review. The systematic mapping review study has been reinforced with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [23] in conducting and reporting our review, ensuring a holistic and unbiased sampling of all published and peer-reviewed articles that are relevant to the proposed topic. In order to achieve the proposed objectives, this research work has been structured in the following steps: The first step in this research is to obtain, through a broad analysis of the literature, summaries of different works (publications) that have utilized AH as a solution to their proposals.In this regard, the search terms employed were "augmented human", "human augmentation" and "human 2.0". The second step is to obtain a trend through analysis of AH research over time. The third step is to obtain a definition that centralizes the characteristics of AH as expressed in the related works. The fourth step is to expose subthemes or research areas in AH for future research to work on from the present systematic mapping study. The objectives mentioned are presented in Figure 1 as a process to follow in the systematic mapping review of this work. The process consists of three phases. (1) The subject of the research work to be dealt with is defined, the objectives to be met are identified and then the preliminary research questions to be answered throughout the development of this work are posed. (2) The collection of the information presented by the relevant documents found after the execution of the search chains. (3) Finally, in phase 3, the results of the keywords obtained from the relevant articles are presented. After performing the above phases, the systematic mapping is formed with the existing literature in order to answer the questions posed in the research. Knowing the topic of study to be addressed (in this case, AH) and the objectives established, this phase proposes preliminary research questions, search strategy and selection criteria, including an overview of the selected papers in terms of their publication over time [24, 25] . Four research questions (RQ) have been defined for the present study, focused on obtaining information on the evaluation of AH applications in relation to time, proposed definitions of AH, main areas of interest in which the term AH is used, and exposure of new AH trends: For this study, the analysis of exclusion and inclusion of articles is performed by selecting customized search strings in indexed databases such as IEEE, ACM and Scopus. The filtering of information is done manually using inclusion and exclusion criteria based on a complete set of evaluation guidelines as established in the scientific rigor and industrial relevance [26] . To help building the search terms, a set of key documents that are directly related to the proposed research questions was identified as a first step. Relevant synonyms were identified, and variations of the keywords were considered and added to the search. Data from the last 10 years from three databases were used to formulate the search chain: ACM, IEEE and Scopus. These databases were selected based on previous experience and advice [27] . Furthermore, Scopus has been added, since it is considered the largest database of abstracts and citations [28] . The last 10 years were taken in relation to the date the term AH was coined [11, 12] . The search strings for the databases are shown in Table 1 . The information resulting from the search string shown in Table 1 has been extracted from articles in scientific journals, conferences and journals. The search of the string was carried out on 15 June 2021. Table 2 presents the numerical results obtained for each database. Once the articles had been retrieved from the databases, according to our search protocol, the next step was to examine their relevance. The first phase of this process consisted of examining the relevance of the articles based on their titles. Retrieved articles whose titles were relevant to our study were discarded. If a large number of studies are obtained, many of these may be noise or there may be duplication of works among databases [29] . In order to reduce the number of results that were obtained (16,914) by discarding duplicates and noisy data the process is carried out individually. The following inclusion criteria were applied to titles and abstracts: I1. Papers that focus on the subject of AH. I2. Papers published between 1 January 2009 and 31 December 2020. The following criteria were considered for the exclusion of documents: E1. Studies that present non-peer reviewed material. E2. Studies not published in English. E3. Non-formal documents that do not have a proven scientific basis. The relevant research articles from the literature were selected by following a usual process [30] . The process consisted of extracting some keywords and concepts that reflect the contributions from the abstracts of the articles. We then proceeded to read each article in detail. When it was observed that the article did not fit, it was discarded. In this stage of the systematic mapping process, information was extracted from the research articles for meta-analysis and to address the research questions. A total of 10 data items were extracted from each article, as shown in Table 3 . In the first six items, basic information about the article was extracted, including the article's year of publication, title, author(s), type of publication, etc. Items 7 and 8 extracted data about the areas of knowledge and categories in which the articles are classified; this is because WoS performs significantly better than Scopus in terms of the accuracy of its journal ranking system [31, 32] . In item 9, the relevant characteristics were extracted after detailed reading of the articles, and finally, item 10 is about the abstract of each article. Paper contributions Main contributions of the paper 10 Summary Our own summary or abstract of the paper After applying the search strings, 16,914 articles were retrieved from the three selected databases (see Table 2 ). The search process and the inclusion and exclusion criteria were applied to these data, resulting in a total of 133 articles (see Figure 2 ) that were eligible for analysis. This process was performed independently by two researchers who are coauthors of this review, allowing to cross-validate all the cases where there were doubts about the information. Finally, the complete content of the 133 articles was read independently by the authors to make the final decision on including or excluding them for the purpose of this research. The PRISMA flowchart [23] (see Figure 2 ) consists of three phases. (1) Identificationsearch for related papers using the proposed search string in the different databases mentioned above. Duplicate articles, articles whose text is illegible (e.g., scanned), keywords that are not used at all or very little, additional, the context is not focused on the applicability of this research, articles that could not be accessed, articles that are not complete and articles focused on other areas are eliminated (e.g., geosciences, astronomy and astrophysics, chemistry, evolutionary biology, history, etc.). (2) Screening-phase in which the inclusion and exclusion criteria are applied to the different related works obtained by the identification phase. (3) Inclusion-phase in which the inclusion and exclusion criteria are applied to the different related works obtained by the identification phase. Here, we have eliminated those articles that have been eliminated after evaluating the title, abstract and exclusion criteria. In order to know if there is any relationship between the articles obtained and the time line in which they have been published, a graph has been made (see As part of the answer to RQ1, we have also considered the number of papers obtained in relation to the databases searched, which, according to Figure 3 , contain similar publication numbers by year (after removing duplicates), leaving the IEEE as the database where a larger number of articles dealing with the subject of AH are indexed with 46 articles, followed by Scopus with 45 articles and ACM with 42 articles. The AH definitions that were obtained are shown in Table 5 , where only 17 articles out of 133 have been extracted, as they are the only ones that have provided definitions of AH. Definition [119] Augmented Humanity is the improvement of traditional human-human and human-machine interaction by augmenting humans with portable technology and developing new user interfaces. [105] Computers augmenting humans enable instant information access. Yet, interactions between these two sides, the augmented human within an augmented world, are still different from human-human and from device-device interactions. [83] Augmented human is a human whose physical, intellectual and social ability are enhanced by the augmented/virtual reality and the smart ICT technology. [100] Google CEO, Eric Schmidt, has called this "augmented humanity", where networked devices "just work and understand autonomously" [11] . Article Definition [87] Human augmentation amplifies and enhances human ability to do work. Encompasses many technologies: prosthetics, orthotics and physically assistive devices that replace missing or lost functions; exoskeletons that extend physical abilities; collaborative systems that work alongside people to fill in and complement human abilities; and socially assistive robots that monitor and motivate human work and effort. [135] Advanced human augmentation suggests technologies that augment human actions, senses and cognition in new, as yet unexplored ways, in order to enhance human senses, to provide assistive augmentation and to create a seamless technology environment for human interaction. [97] An augmented human is a person who is able to use AR effectively to expand the physical, intellectual and social abilities of the user. [162] Augmented humanity refers to the digital administration of the world, where the human converges with computer electronic devices and instruments, generating a natural environment for the user, where even the user is not aware of the new technologies that he is using for himself. [36] Augmented human refers to a research direction of enhancing or augmenting human abilities by human-computer integration. [132] Augmented human introduces a fundamental paradigm shift in HCI: from humancomputer interaction to human-computer integration, and abilities will be mutually connected through the networks (what we call IoA, or Internet of Abilities, as the next step of IoT, Internet of Things). [101] Human augmentation is a deliberate act. It is a permanent or temporary bodily intervention that changes or augments otherwise normal ranges of human function. [110] Technologies that enhance human productivity and improve or restore capabilities of the human body or mind are an area of computing we refer to as human augmentation. [116] Augmenting human intellect and amplifying perception and cognition as various technologies designed to augment the human intellect and amplify human perception and cognition. [35] Human-computer integration (HInt) is considered a new paradigm with the key property that computers integrate closely with the user. Such integration occurs primarily at the individual level through sensory fusion, with computers providing information directly to the human senses rather than through symbolic representations and understanding the implicit and precognitive needs of the user through biosensitization. However, there is also the observation that this integration occurs at a social level, where the human being and the interface agents make a coordinated effort to achieve a common goal. [95] Human augmentation is an interdisciplinary field that addresses methods, technologies and their applications for enhancing sensing, action and/or cognitive abilities of a human. This is achieved through sensing and actuation technologies, fusion and fission of information and artificial intelligence methods. [12] AH involves augmenting humans with devices that can collect data from the individual and the individuals' environment and transmit this data to an external device or service. [64] Human augmentation is an approach to enhancing and empowering human functions with information technologies utilizing robotics and sensing devices. In order to obtain a definition of AH that contains the context of the 17 articles that already define the subject, we considered the number of citations regardless of the fact that most of the articles were published in the last 11 years, justifying the need to consider the number of views of each one of them as well, as shown in Table 6 . Finally, the four articles whose definitions attempt to encompass the entire context of AH were selected. From these articles, those with the greatest number of views and citations were selected [35, 36, 87, 110, 116] , allowing us to propose the following definition: Augmented humanity is a human-computer integration technology that proposes to improve capacity and productivity by changing or increasing the normal ranges of human function, through the restoration or extension of human physical, intellectual and social capabilities. The justification of this new formal definition of AH is detailed next as regards the constituent parts of which it is made up: • Technology: In accordance with [163] , AH is described as a technology in relation to its "inputs" and "outputs", where the inputs of technology are knowledge, resources and labor, while the outputs are material culture and modification of the environment. Since technology is the immediate point of contact between people and environment, the consideration of the term technology acknowledges the limiting and shaping functions of the physical and social environment [164] . Furthermore, the content of technology can be conceived in terms of knowledge, applications or norms [164, 165] . • Human-computer integration: The definition also expounds on the concept of humancomputer integration, which is the symbiotic partnership or relationship in which humans and software give rise to patterns of behavior that must be considered holistically [35, 166] . • Improvement of capacity and productivity: Augmentation is the most common term in the interdisciplinary research community that focuses on interactive digital extensions of human capabilities [95] . The related concepts of augmented human and human 2.0 [167] refer to technologies that augment human productivity or capability or add to the human body or mind [168] . Human augmentation will serve the user by providing essential and timely information for common tasks [95] such as working, driving and so on. • Change or increase of normal ranges of human function: Human augmentation products and/or applications can be made for anyone, from healthy users who wish to improve their human capabilities to users who face temporary or permanent disabilities, physical disabilities or hazardous situations requiring their use [169] . • When referring to AH as improving the physical, intellectual and social capabilities of human beings, we allude to all possibilities that are framed in each main component of AH. More concretely: -Augmented physical capabilities are achieved through the interpretation of the augmented senses and the actions they produce. Vision, taste, touch, smell and hearing can be physically augmented. Augmented intellectual capacities are achieved through the acquisition of knowledge, cognitive processing and reasoning. Numerical aptitude, verbal comprehension, perceptual speed, inductive reasoning, deductive reasoning, spatial reasoning, abstract reasoning, memory, will and so on can be augmented intellectually. Augmented social skills are considered through the interpretation of basic and complex social skills. Empathy, emotional intelligence, assertiveness, listening skills, ability to communicate emotions, ability to define a problem and evaluate solutions, negotiation, presenting oneself and many more can be socially augmented. The total number of knowledge areas for the 133 articles is 18. In Figure 4 , it can be seen that there are five relevant areas in which the selected research works are focused: computer science (91), engineering (58) , robotics (40) , automation and control system (15) and telecommunications (12) . Of the 133 articles selected, the repetition rate of the keywords was extracted, the most repeated are: augmented reality; wearable computing; computer vision; human-robot interaction and mixed reality. In relation to the various areas of knowledge, it is clear that most of the articles selected are related to technology, of which the most relevant categories are: (i) computer science; (ii) engineering; (iii) robotics; (iv) automation and control systems; and (v) telecommunications. Figure 5 presents the relevant domains of AH in relation to the number of keyword repetitions per area. There are two relevant fields of study (y-axis) that are clearly outstanding: computer science and automation and control systems. Finally, the index terms of each one of the 133 selected articles are considered for this study. The total number of keywords is 200. The keywords selected for the grouping are those that have been repeated more than twice. Figure 7 shows the major topics covered (top ten) with the respective number of repetitions. Augmented reality is the most popular one, with 18 citations in the keywords of the scientific articles. The five following topics with the highest repetition rate are: wearable computing (13), human-robot interaction (11) , computer vision (11), human-computer interaction (10) and mixed reality (9). It is curious that the keyword human augmentation has a repetition rate of 7 times; this is because although in the titles and text of the publications the word exists, it does not exist as a keyword proposed by the authors. Finally, of the number of publications obtained, it is necessary to mention that they have been published in congresses and conferences with a high impact factor. We decided to present a compilation of the proposals for future works from the first five positions of the research (computer science, engineering, robotics, automation and control systems and telecommunications) according to Figure 4 (see Supplementary Materials Table S1 ). It was also considered to express in Supplementary Materials Table S1 the theme of the research work a brief description of the objective of the work and the proposals presented for future work. The reason why 37 articles are shown in Supplementary Materials Table S1 and not 133 is because we have taken those articles that have been cited in the key words by the authors: wearable computing, computer vision, human-robot interaction and mixed reality. Table 7 and Figure 8 expose the works related to the theme of AH until 2020. These works are focused on different areas. However there are works that somewhere in its structure mention "augmented humanity" as a feature of the development of the authors. This work has introduced a systematic mapping review of the definitions of AH as well as the published research that has been developed under this theme and that have been published in recent years (2009-2020). The results obtained are important and show a global vision of the current state of knowledge in this area. In relation to the definitions obtained about AH, it was not possible to obtain a single formal one from the analysis of the different proposals studied in the analysis of the related works. The results that we retrieved provide a global perception of the state of knowledge and study of the area on the subject of AH. A first certainty of this systematic review was that more research is still needed to characterize, organize and classify the AH terminology within its respective fields of study and translate it into other scientific contributions based on the new definition provided in this research paper. Indeed, our definition can be used not only in technology but in any field looking for human support through human-computer integration. It is important to emphasize that in relation to the publication venues, the great majority of works were disclosed in conferences (peer-review) and in journals of high impact factor. As for the temporal evolution, there has been the tendency of the slight growth (4.5 publications in average per year) of publications until the year 2016, when it increased (16 publications) , and in the year 2017, the peak of the curve was observed; then, for the years 2018 and 2019, the publications between 19 and 18 stabilized. For the year 2020, 21 publications were published up to December 31, compared to the two previous years the related articles went up. The increase is not equal or higher to year 2017. One of the possible reasons may be to the fact that in year 2020 the COVID-19 virus SARS-CoV-2 spread worldwide, causing a decrease of articles published. However, in recent years, there has been an increase in publications in general terms, and this may be an indicator that the AH terminology is gradually becoming a focus of interest to the research community. In the articles reviewed in this paper, it is appreciated that there are several terms in which AH exists. However, it is not directly linked to AH terminology; possible reasons could be lack of knowledge of a concrete definition, publications focus on the specific field and lack of knowledge of a classification of AH. The results obtained in the present review of systematic mapping on definitions of AH show that in some publications a macro concept of definition is emitted, without this one having been defined by means of a work similar to the present one. In other publications, even, it is only mentioned that some thematic is being done with AH, giving no notion about what it is. This systematic mapping review has introduced a series of scientific publications that define AH from different approaches or perspectives, some of these depending on the area in which the research is focused. All the existing definitions may cause confusion to the reader, hindering the understanding of an exact definition of AH. That is why four research questions were posed to resolve doubts about the number of related works that have used the term AH until December 2020, these being 16,914. However, they did not present a concrete definition on the subject. After applying inclusion and exclusion criteria, only 17 high impact related works presented definitions in which there were significant differences in approach. An analysis of the context of each proposed definition was carried out and we provided our proper definition. In the third question posed, the knowledge areas relevant to the subject of AH according to WOS, in which AH causes greater impact, being the five areas of study: computer science, engineering, robotics, automation and control systems and telecommunications, showing that AH is an interdisciplinary terminology. In this regard, only a few papers from the significant number of articles mentioning the term AH in the diverse knowledge areas have provided some definition of AH. This has probably lead to confusion about the orientation and purpose of the term. In fact, the term can be used in many areas of knowledge because AH encompasses any technological aspect supporting human beings, whether physically, intellectually or socially. However many researchers did not find it necessary to properly label their conception of AH. In the fourth research question, the related works closer to the topics about the repetition rate of the most used terms are analyzed and characteristics are extracted and proposals for future works are exposed, leaving open research proposals. These research proposals are focused on the areas of computer science (38.23%), engineering (24.36%), robotics (16.80%), automation and control systems (6.30%) and telecommunications (5.04%). There are other areas where the term is also used, for example: information science and library science, physics, neuroscience and neurology, optics, etc. Regardless of the knowledge areas and keyword repetition rate that indicate an increased use of AH terminology, probably not all users will fully accept human augmentation, which may have caused noise or bias suggestions with respect to augmented human capabilities. In other words, some constraints in defining AH may have arisen from user perception, considering the three main components suggested by our definition. (i) Physical capabilities: users may be slow to accept a physical augmentation, which may be due to habit, resistance to change, etc. (ii) Intellectual capabilities: users may take time to learn to manipulate or augmented humanity applications. This may occur for different reasons such as cognitive-affective management, either training time, prior knowledge of manipulating technological inter-faces, etc. (iii) Social capabilities: users do not tend to have a regular pattern; by nature, they are changeable in their tastes, behaviors, feelings, etc. The keywords with the highest repetition rate were also exposed, being the six main ones: augmented reality (14.4%), wearable computing (10.4%), human-robot interaction (8.8%), computer vision (8.8%), human-computer interaction (8%), mixed reality (7.2%) and others (42.4%). These data indicate the terminology with greater application used in AH research, clearly indicating an orientation with greater experience on the knowledge of what AH means. However, the 42.4% of most used keywords could reflect a lower AH approach, so we think that with the definition proposed in this document these percentages could be raised, opening or positioning those keywords to a greater extent. Yet, the term AH should not be confused with augmented reality, virtual reality and/or mixed reality. Although these can be the tools and/or means for implementing AH applications, AH may use any other means or technology capable of designing applications that contribute to improve or enhance the physical, intellectual or social capabilities of human beings. Throughout the development of this work, three possible risks that could have affected the systematic mapping review have been considered: • The first possible risk [170] , is the bias of selective information because the analyses of statistically significant differences are published more frequently. To minimize this risk, three scientific databases have been used as sources for the search process: IEEE, ACM and Scopus. These provide a complete list of articles covering the different aspects of this systematic mapping review. To avoid affecting the validity of the present study, literature from theses, reports, etc., has been excluded, since these types of documents do not have as rigorous of a review process as that of journals. • The second possible risk that could affect the study is selection bias. However, for this risk, the inclusion and exclusion criteria were clearly described. • The third possible risk that could have affected this research is related to the possibility of classifying a study in different ways. This risk was mitigated by the support and joint work of four researchers, so that when a researcher presented some doubt or there would be discrepancies between the classifications, it was discussed with the working group, allowing to improve the quality of the analysis. This systematic mapping review also has some limitations. Although the authors attempted to identify as many articles as possible, studies not published in English were excluded from the review, so that some other AH cues may have been missed. Another limitation of our review has to do with ethical issues, as we did not study this aspect in the articles searched. All AH applications are required to adopt ethical commitments since they deal with human beings. For example, they must take care of the privacy of personal data. In relation to the proposed new definition of AH, there may be a latent limitation due to the fact that the term is novel and AH is only taking its first steps. This means that it is likely that the use of our definition will not land until more researchers engage with the terminology. In addition to this, it may lead to self-interested negativity in the use of the AH definition, as AH is a term that can be used cross-cuttingly in many areas of knowledge and may give way to a desire to formulate more specific definitions focused on each field. Another limitation for the use of our definition is that the studied works emerged in the years where AH was only informally declared. However, in the course of time, studies using AH will continue to be proposed and developed and there may be a breaking point in which it will be necessary to revisit the definition and add additional features. Finally, it is proposed as future work to carry out a classification or taxonomy of the areas in which the different research approaches in which AH is applied are presented. Additionally, future works of different researchers are presented, whose approaches are based on developing applications, prototypes or research in augmented reality, wearable computing, computer vision, human-robot interaction (HRI), mixed reality and humancomputer interaction (HCI). For example, four possible augmented humanity works are cited: (i) Perform augmented writing using a transmissive head-mounted display, such as Microsoft's HoloLens, where only one user can experience the effects without showing anything in real space. (ii) Develop representative wearable 2.0 applications for health care including chronic disease monitoring, elderly care, medical and health care institution, smart training for athletes, emotion care, etc. These applications can be virtual reality/augmented reality applications based on smart wearables. (iii) Develop a theoretical framework that provides a structural basis for exploring intelligence augmentation. iv) Improve interaction metaphors (image, resolution, flight times, display field of view, etc.) of a drone for remote location visualization. Supplementary Materials: The following are available online at: https://www.mdpi.com/article/ 10.3390/s22020514/s1, Table S1 : Proposals for future work. Funding: This work has been partially supported by the Portuguese Fundação para a Ciência e a Tecnologia -FCT, I.P. under the project UIDB/04524/2020 and by Portuguese National funds through FITEC -Programa Interface, with reference CIT "INOV-INESC Inovação-Financiamento Base". Grants PID2020-115220RB-C21 and EQC2019-006063-P funded by MCIN/AEI/10.13039/501100011033 and by "ERDF A way to make Europe". This work was also partially supported by CIBERSAM of the Instituto de Salud Carlos III. Institutional Review Board Statement: Not applicable. Data Availability Statement: All data generated or analyzed during this study are included in this article. The review protocol is available on reasonable demand from the corresponding author The Human Use of Human Beings: Cybernetics and Society Fuzzy unordered rule induction algorithm based classification for reliable communication using wearable computing devices in healthcare Toward a user-centric classification scheme for extended reality paradigms We are super-humans: Towards a democratisation of the socio-ethical debate on augmented humanity Assist-As-Needed Exoskeleton for Hand Joint Rehabilitation Based on Muscle Effort Detection Spine Cop: Posture Correction Monitor and Assistant Comparison of RGB-D and IMU-based gesture recognition for human-robot interaction in remanufacturing Human-robot interaction in Industry 4.0 based on an Internet of Things real-time gesture control system Seeing through Events: Real-Time Moving Object Sonification for Visually Impaired People Using Event-Based Camera From augmented reality to augmented human Age of Augmented Humanity Augmented Humanity: Data, Privacy and Security. In Cyber Defence in the Age of AI, Smart Societies and Augmented Humanity Augmented Humanity-Isobar Insights & Whitepapers Toward a Science of Augmented Agency Augmented Humanity: Being and Remaining Agentic in a Digitalized World From Augmented Reality to Augmented Human Multi-sensorial virtual reality and augmented human food interaction Retrospect of Augmented Reality Opportunities and challenges for applying process mining in healthcare: A systematic mapping study Ubiquitous healthcare: A systematic mapping study What is a "mapping study? Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement Evidence-Based Software Engineering and Systematic Reviews Guidelines for performing Systematic Literature Reviews in Software Engineering A method for evaluating rigor and industrial relevance of technology evaluations Applying systematic reviews to diverse study types: An experience report What's up with software metrics?-A preliminary mapping study Systematic reviews in the social sciences: A practical guide. Sociol. Health Illn Systematic mapping studies in software engineering Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus Revisiting subject classification in academic databases: A comparison of the classification accuracy of web of science, scopus & dimensions The Robot-Arm Talks Back to Me"-Human Perception of Augmented Human-Robot Collaboration in Virtual Reality Complex Stiffness Model of Physical Human-Robot Interaction: Implications for Control of Performance Augmentation Exoskeletons Next steps for human-computer integration A conceptual framework for augmented smart coach based on quantified holistic self. In Distributed, Ambient, and Pervasive Interactions Concept learning through deep reinforcement learning with memory-augmented neural networks New Augmented Reality Taxonomy: Technologies and Features of Augmented Environment A Context-Aware Assistance Framework for Implicit Interaction with an Augmented Human Deep-Learning-Based Defective Bean Inspection with GAN-Structured Automated Labeled Data Augmentation in Coffee Industry On high-level control of power-augmentation lower extremity exoskeletons: Human walking intention A dynamic microtask scheduling approach for SLO based human-augmented computing Design and evaluation of an upper extremity wearable robot with payload balancing for human augmentation Predictive hierarchical human augmented map generation for itinerary perception A Gaze-Contingent Intention Decoding Engine for Human Augmentation Design and Study of a Multi-Channel Electrical Muscle Stimulation Toolkit for Human Augmentation Probabilistic human intention modeling for cognitive augmentation A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts Designing for Augmented Humans and Intelligence Probabilistic intention classification for human augmented cognition system A Research Agenda for Hybrid Intelligence: Augmenting Human Intellect With Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence Detecting Region Transitions for Human-Augmented Mapping Real-Time Workload Assessment as a Foundation for Human Performance Augmentation A Study of Micro-Augmentations: Personality, Gender, Emotions and Effects on Attention and Brain Waves Development of Visualizing Earphone and Hearing Glasses for Human Augmented Cognition Relevance of EEG Input Signals in the Augmented Human Reader Active glass-type human augmented cognition system considering attention and intention DIY Prosthetics Workshops: 'critical making' for public understanding of human augmentation Remembering through lifelogging: A survey of human memory augmentation Adaptive Robust Cascade Force Control of 1-DOF Hydraulic Exoskeleton for Human Performance Augmentation Drone-augmented human vision: Exocentric control for drones exploring hidden areas A Telepresence Robot Supporting Socially Acceptable Interactions and Human Augmentation through Vertical Actuation AHA: ADHD Augmented (Learning Environment) Dynamic Motor Skill Synthesis with Human-Machine Mutual Actuation Robotic musicianship and musical human augmentation Analysis and augmentation of human performance on telerobotic search problems Embedded System for Human Augmented Cognition Based on Face Selective Attention Using Eye Gaze Tracking Approach to improving training of human workers in industrial applications through the use of intelligence augmentation and human-in-the-loop Encoding Pose Features to Images With Data Augmentation for 3-D Action Recognition See-through and spatial augmented reality-A novel framework for human-robot interaction Assessing Augmented Creativity: Putting a Lovelace Machine for Interactive Title Generation Through a Human Creativity Test. In Computational Intelligence in Music, Sound, Art and Design Smart Bracelets for Augmenting Interpersonal Touch Interactions Service Innovation for Cyborgs -Human Augmentation as a Self-experiment. In Advances in the Human Side of Service Engineering Augmentation of human arm motor control by isotropic force manipulability Service-oriented context reasoning incorporating patterns and knowledge for understanding human-augmented situations Augmentation of Human Memory: Anticipating Topics That Continue in the Next Meeting Human Augmentation Using Multiple Telepresence Systems for Network Communication SitusCall: Location-based mobile communication for group calls and human augmentation Augmentation of Human Protection Functions Using Wearable and Sensing System Hierarchical Interactive Learning for a Human-Powered Augmentation Lower Exoskeleton Skeleton-Augmented Human Action Understanding by Learning with Progressively Refined Data Augmented feature-state sensors in human activity recognition Holistic quantified self framework for augmented human Smart wearable robot glasses for human visual augmentation based on human intention and scene understanding Augmented Human Interaction with Remote Devices Using Low Cost DTMF Technology Human Memory Augmentation with Mixed-Reality Technologies Socially assistive robotics: Human augmentation versus automation Augmented human mind: Case of reasoning Human Augmentation of UAV Cyber-Attack Detection Spectroscopic Influence of Virtual Reality and Augmented Reality Display Devices on the Human Nonvisual Characteristics and Melatonin Suppression Response Augmented Human State Estimation Using Interacting Multiple Model Particle Filters With Probabilistic Data Association The business of UX: Human Augmentation-Beyond Wearables. Interactions SpiderVision: Extending the Human Field of View for Augmented Awareness Augmented Human Technology Human augmentation: Past, present and future Stiffness Modulator: A Novel Actuator for Human Augmentation Augmented human: Augmented reality and beyond Human augmented mapping for indoor environments using a stereo camera Superhuman Sports: Applying Human Augmentation to Physical Exercise Augmented humanity Human by design: An ethical framework for human augmentation Supernumerary Robotic Limbs for Human Augmentation in Overhead Assembly Tasks Human force augmentation: Optimal control parameters tuning using structured H∞ synthesis System for augmented human-robot interaction through mixed reality and robot training by non-experts in customer service environments Augmented humans interacting with an augmented world Human Performance Augmentation in Context: Using Artificial Intelligence to Deal with Variability-An Example from Narrative Influence. In Augmented Cognition: Users and Contexts Technologies for social augmentations in userembodied virtual reality Augmented photoware interfaces for affective human-human interactions Human roles for robot augmented first response Technology for human augmentation Augmented typing: Augmentation of keyboard typing experience by adding visual and sound effects Human visual augmentation using wearable glasses with multiple cameras and information fusion of human eye tracking and scene understanding Wearable augmented reality for medical first response & situational awareness Human-system cooperative hybrid augmented intelligence based dynamic dispatching framework of semiconductor wafer fabrication facility The design of artifacts for augmenting intellect Augmenting human intellect and amplifying perception and cognition Illuminated focus: Vision augmentation using spatial defocusing via focal sweep eyeglasses and high-speed projector The Emotional Economy for the Augmented Human Augmenting human interaction capabilities with proximity, natural gestures, and eye gaze Inferring Travel Purpose from Crowd-Augmented Human Mobility Data The Tactile Internet: Automation or Augmentation of the Human? Augmenting human senses to improve the user experience in cars: Applying augmented reality and haptics approaches to reduce cognitive distances Interaction Force Convex Reduction for Smooth Gait Transitions on Human-Power Augmentation Lower Exoskeletons The wisdom innovation model -Adjusting new insights and hosting new perspectives to human augmented reality. In ENTERprise Information Systems Augmenting human with a tail Interaction patterns in human augmented mapping Towards visual augmentation of the television watching experience: Manifesto and agenda Augmenting Memory Recall in Work Meetings: Establishing a Quantifiable Baseline Interactive learning for sensitivity factors of a human-powered augmentation lower exoskeleton Transmission of Experiences with Augmented Human Techniques Augmenting Static Visualizations with PapARVis Designer Internet of abilities: Human augmentation, and beyond 2017 (keynote) Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace ACM/IEEE International Conference on Human-Robot Interaction Beacon authpath: Augmented human path authentication Introduction to the special session: Design and research for advanced human augmentation Variable stiffness spring actuators for low-energy-cost human augmentation Biomimetic Design in Augmented Cognition Integrating first-person View with out-of-body vision generation for human-human augmentation Virtual and Augmented Reality Animals in Smart and Playful Cities: (Invited Paper) Body Extender: Whole body exoskeleton for human power augmentation MagniFinger: Fingertip-mounted microscope for augmenting human perception Virtual humans in augmented reality: A first step towards real-world embedded virtual roleplayers Bridging the Skills Gap of Workers in Industry 4.0 by Human Performance Augmentation Tools: Challenges and Roadmap Making Sense of Human-Food Interaction Virtual performance augmentation in an immersive jump & run exergame Cascade force control of lower limb hydraulic exoskeleton for human performance augmentation Measuring the augmented sound localization ability of humans in the underwater environment Virtual/Mixed/Augmented Reality Laboratory Research for the Study of Augmented Human and Human-Machine Systems Children in 2077: Designing Children's Technologies in the Age of Transhumanism Mixed-initiative in human augmented mapping Closed-loop tactile augmentation by transcutaneous stimulation on either the foot sole or the palm to improve lateral postural balance Modified admittance control for maneuverable human-powered augmentation lower exoskeleton systems Wearable 2.0: Enabling human-cloud integration in next generation healthcare systems Activity Recognition Using Wearable Devices for Human Augmentation Movement augmentation to evaluate human control of locomotor stability Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant Co-creation and Risk-Taking-In Pursuit of New Technology for Human Augmentation: An Interview with Pranav Mistry Workshop on Amplification and Augmentation of Human Perception Collaborative human augmented SLAM Advancing Human Performance and Decision-Making through Adaptive Systems Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects From the Hand of Man: Primitive and Preindustrial Technologies Content as Variability, Result as Selection: Toward a Behavioral Definition of What is technology? The issue of its origins and definitions Human Computer Integration versus Powerful Tools An integrative introduction to human augmentation science The Operator 4.0: Human Cyber-Physical Systems & Adaptive Automation Towards Human-Automation Symbiosis Work Systems Structuring human augmentation within product design Assessing risk of bias in included studies The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.