key: cord-1018012-ihsyk95r authors: Amorim, Paula; Santos, Beatriz Sousa; Dias, Paulo; Silva, Samuel; Martins, Henrique title: Serious Games for Stroke Telerehabilitation of Upper Limb - A Review for Future Research date: 2020-12-08 journal: International journal of telerehabilitation DOI: 10.5195/ijt.2020.6326 sha: b17e1760f00d6d1ce60e268f12a90c3325caa7e0 doc_id: 1018012 cord_uid: ihsyk95r Maintaining appropriate home rehabilitation programs after stroke, with proper adherence and remote monitoring is a challenging task. Virtual reality (VR) - based serious games could be a strategy used in telerehabilitation (TR) to engage patients in an enjoyable and therapeutic approach. The aim of this review was to analyze the background and quality of clinical research on this matter to guide future research. The review was based on research material obtained from PubMed and Cochrane up to April 2020 using the PRISMA approach. The use of VR serious games has shown evidence of efficacy on upper limb TR after stroke, but the evidence strength is still low due to a limited number of randomized controlled trials (RCT), a small number of participants involved, and heterogeneous samples. Although this is a promising strategy to complement conventional rehabilitation, further investigation is needed to strengthen the evidence of effectiveness and support the dissemination of the developed solutions. Stroke is a leading cause of disability worldwide. As mortality decreases, the number of survivors with several handicaps that benefit from rehabilitation has significantly increased (Lawrence et al., 2001) . Six months after stroke, 50% of survivors have hemiparesis and 26% have disruption of activities of daily living (ADLs) (Go et al., 2013) . Although most of these disabilities will be permanent, rehabilitation programs implemented even years after injury are useful (Lloréns et al., 2015) , improving quality of life and reducing the longterm expense of care in stroke survivors (Aminov et al., 2018) . Patients can perform activities of daily living (ADLs) using only one limb, but this leads to a learned non-use phenomenon of the affected limb (Choi & Paik, 2018) , progressive deterioration of motor function, increase of spasticity, joint stiffness, and more pain. Activation of the affected upper limb cortical area is beneficial in such cases. The COVID-19 pandemic left many stroke survivors without rehabilitation and increased the use of telemedicine (Negrini et al., 2020) . Telehealth technologies seem to be a promising tool, useful to enable consultations and service delivery from the acute phase to home and outpatient monitoring, to treatment, rehabilitation and prevention (Blacquiere et al., 2017) . Compared to teleconsultations, rehabilitation program prescription of home exercises is much more challenging. The adherence to home exercises is usually low, whether due to fatigue, poor tolerance to effort, lack of motivation or musculoskeletal changes such as spasticity or joint limitations (Blacquiere et al., 2017) . There is also need of reliable noninvasive monitoring procedures that, combined with self-management, could provide the necessary clinical data for reliable telerehabilitation (TR) (Pericas et al., 2013) . Telerehabilitation research started about 20 years ago (Jafni et al., 2017 ) with a focus on information technologies to provide distant support, assessment, and information to people who have physical and/or cognitive impairments (Schwamm Lh Fau -Holloway et al., 2009) . The technology used includes videoconferencing platforms, wearable devices, audio and video communication, and social media, as well as many research-driven prototypes housed on a variety of platforms (Adamovich et al., 2009 ). More complex solutions incorporate robots (Garrett et al., 2018) and machine-learning-based systems (Lee et al., 2020) . Of the several forms of TR possible approaches tested for stroke, videogame-driven TR approach is a promising one. Serious games use VR for education, health, public policy, and strategic communication objectives (Zyda, 2005) . It might be also a useful tool for stroke rehabilitation as it potentiates neuroplasticity at an early stage and stimulates sensorimotor areas that slowly deteriorate by disuse in a chronic phase (Adamovich et al., 2009; Levin et al., 2015) . This approach also benefits pain therapy, depression treatment, and socialization after stroke (Castelnuovo et al., 2016; Maier et al., 2019; Mallari et al., 2019) . The sensorimotor cortex of the affected hemisphere can significantly increase simply by the feedback of the contralateral hand by stimulation of mirror neurons (Calabrò et al., 2017) . Another mechanism is Motor Imagery Therapy, where the imagination of executing a movement of a segment promotes stimulation of the respective cortical area (Vourganas et al., 2019) . VR-based serious games can activate the nucleus accumbens, with the release of dopamine, which is associated with reward-based learning, feelings of pleasure and motivation to perform specific behavior (Barrett et al., 2016 ). This appears to be a safe approach. In experiments where VR has been used to train motor abilities, there have been no reported occurrences of cybersickness in impaired populations (Levin et al., 2015) . Tracking technologies used in VR enables qualitative and quantitative assessment of stroke rehabilitation exercises (Lee et al., 2019) which are, otherwise, difficult to measure in home-based exercises. Machine Learning research using VR technology could develop intelligent decision support systems to identify salient features of assessment using reinforcement learning to assess the quality of motion and summarize patient specific analysis (Lee et al., 2020) . Compared to conventional rehabilitation, serious games also have the advantage of promoting motivation (Dias et al., 2019) . This work aimed to review and analyse the clinical research on upper limb stroke telerehabilitation using serious games. The final objective was to identify limitations and opportunities as well as provide avenues for future research. This review is based on research material obtained from PubMed and Cochrane until April 30, 2020. The search terms included («virtual reality» OR «serious games» OR «exergames») AND «stroke» AND «telerehabilitation». Only 75 records were identified through database searching (53 articles in PubMed and 22 in Cochrane). In addition, reference lists of relevant reviews were searched by hand and four more records were added. The review was conducted and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement (Moher et al., 2009) (Figure 1 ). Flow Diagram Adapted from Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Note. This diagram shows the process for identifying and screening the articles for inclusion and exclusion. Records identified through database searching (n=75) PubMed ( The question generated using the PICOS (Saaiq & Ashraf, 2017) components (Population, Intervention, Comparison, Outcomes, Study Design) was: «in stroke patients (P) are serious games for telerehabilitation (I) effective in upper limb rehabilitation (O) when compared with conventional rehabilitation (C)»? For qualitative synthesis, only randomised controlled trials (RCT) were included (S), as they are regarded as the best study design to test the efficacy of clinical intervention. After removing duplicates, authors independently analysed titles and abstracts of 66 papers. Disagreements were resolved through review team discussion. After this procedure, the review included 35 studies that met inclusion criteria: (1) involving stroke survivors; (2) describing a rehabilitation intervention using telerehabilitation and virtual reality in form of serious games; (3) focusing on upper limb rehabilitation; (4) human research; and (5) written in English. To analyse the clinical evidence only RCT with published results (n=5) were included. In order to analyse the quality of the included RCT, the first author used the Physiotherapy Evidence Database (PEDro scale) (de Morton, 2009) and discrepancies were resolved through discussion with co-authors. The PEDro scale was developed by the Physiotherapy Evidence Database to determine the quality of clinical trials. The PEDro scale consists of a checklist of 11 scored yes-or-no questions identified in Table 3 . The review with the PRISMA method retrieved 35 results identified in Table 1 . See Table 2 See Table 2 Other trials (not randomized and/or not controlled) Although reviews, systematic reviews, and metaanalyses of telerehabilitation after stroke have found either better or similar effects when compared with conventional in-person therapy, they have noted high heterogeneity in treatment content across studies (Chen et al., 2015a (Chen et al., , 2015b Lin et al., 2018; Sarfo et al., 2018) . Some studies reported that TR is less expensive, but more studies are needed to draw more definitive conclusions (Barak Ventura et al., 2019) . VR shows moderate to strong evidence for efficacy (Adamovich et al., 2009) , being enjoyable, and improving motivation and adherence (Valdés et al., 2018) . VR has the advantage of monitoring patient movements and allowing activities that are unsafe to practice in the real world, such as crossing the street, driving, or preparing food. In a recent meta-analysis VR appears to be more effective than conventional rehabilitation, improving 28.5% of the maximal possible improvement of upper extremity functionality (Karamians et al., 2020) . In constraint-induced movement therapy for rehabilitation of upper limb hemiparesis, which leads frequently to patient frustration in conventional rehabilitation, gamification through serious games seems to promote better acceptance by patients (Sheehy et al., 2019) . Besides VR serious games, augmented reality, which superimposes a computer-generated image on a user's view of the real world, also seems to have benefits in upper limb functionality training (Burdea, 2003) . In terms of efficacy, the purpose was to reveal non inferior solutions with a VR approach as compared with conventional therapy. A systematic review and metaanalysis showed that the outcome of stroke rehabilitation using game-based therapy could significantly outperform conventional therapy (Lohse et al., 2014) . From the review of articles included in Table 1 the authors identified features of serious games that are useful and practical for stroke rehabilitation. They should be easily portable to allow treatment anytime/anywhere, provide immediate feedback to the patient, and allow the monitoring of performance and progression in a quantitative and easily accessible way for the doctor/therapist (Proffitt & Lange, 2015) . When evaluating serious games for rehabilitation, additional factors must be considered: Attention: Training protocols can incorporate multisensory feedback (auditory/visual) as well as performance feedback on unwanted motor compensations. Some systems adopt force feedback, which employs haptic or exoskeleton devices (Kato et al., 2015) . Disability adaptation: Commercial gaming systems are designed for able-bodied participants and may not consider the physiological, motor, and cognitive aspects of recovery in rehabilitation. Designed with help of rehabilitation scientists, they may also lack the scalability of purpose-designed virtual environment systems (i.e., serious games) (Green & Wilson, 2012; Valdés et al., 2018) . If the game difficulty is set too high, it can lead to frustration and abandonment by players with disabilities. Another limitation is the possible inadequacy of devices used to mediate patient's interaction with spastic hands. For instance, Nintendo Wii® game controllers or Microsoft Kinect® are challenging to use by any stroke survivor without adaptation (Burdea et al., 2003; . targets that are realistic, manageable, and customized for the patient. However, the activities also need to be challenging enough for the patient to be engaged (Vourganas et al., 2019) . Pleasant and interesting scenarios support the performance of ADLs, including skills in the kitchen, reaching objects with the paretic arm, crossing streets, shopping, and social interaction. Despite the image of a smile or the phrase "well done", a sound and the knowledge of the score provide additional motivation (Dias et al., 2019) . Another method of game mechanism is referred to as scaffolding. After a participant masters a new motor skill, another new challenge is introduced into the game. The player learns how to safely perform and practice the new skill. The player must master this skill before moving onto the next skill (Fluet, 2019; Fluet et al., 2019) . Therapists must be able to calibrate the degree of difficulty. In this regard, artificial intelligence brings benefits to TR related to the speed of adaptation (Fluet, 2019) . Socialization: Serious games promote socialization when played by multiple users on cooperative or competitive virtual tasks (Thielbar et al., 2020) . Cost: Video games have been applied to upper limb rehabilitation since the 1980s. With the advent of less expensive and higher-fidelity technology, acceptance and clinical validity of games for serious purposes have been increasing (Barrett et al., 2016; James et al., 2018) . Nonimmersive or mobile VR do not require high-level graphic performance or expensive hardware, making them good candidates for providing low-cost, ubiquitous, and interesting treatment programs (Choi & Paik, 2018) . Adapting existing gaming frameworks as treatment protocols, rather than developing games from scratch, should be considered to foster richer gaming experience (Putrino, 2014) . When combined with remote monitoring (TR), the benefits of serious games are further strengthened (Garrett et al., 2018) . This combined approach has been increasingly investigated (Green & Wilson, 2012) . Despite the potential, systematic reviews and metaanalysis addressing VR and TR for rehabilitation after stroke show that most of the studies had limitations. A reduced number of participants resulted in limited statistical validation (Aramaki et al., 2019; Ayed et al., 2019; Chen et al., 2015b; Laver et al., 2020; Laver et al., 2017; Maier et al., 2019; Mekbib et al., 2020; Viñas-Diz & Sobrido-Prieto, 2016 ). Very few studies have systematically addressed stroke patients' requirements in the home environment (Chen et al., 2019) and almost none were designed with direct input from patient and provider end-users (Birckhead et al., 2019) . Measuring the effectiveness is crucial to assess the benefits of TR and VR on stroke rehabilitation. The primary outcome should be reported before and after the intervention and between study arms with accompanying 95% CI (Birckhead et al., 2019) . Yet, there is no consensus on what measures to employ to facilitate comparisons across interventions. Many different range of outcome measures have been used (Veras et al., 2015; Veras et al., 2017) . The focus is often the functionality of the upper limb, balance, and postural control. Less common is the evaluation of daily functioning, independence, quality of life, pain, depression, fatigue, and socialization, despite their relevance for health quality. The choice of adequate measures is crucial to assess the quality of care, identify gaps, and define priorities in stroke care (Veras et al., 2017) . Satisfaction is another important indicator of the efficacy of therapeutic interventions. A high level of satisfaction promotes the patient's motivation to engage in rehabilitation Piron et al., 2008) . Less used in this context is the holistic approach of the International Classification of Functioning (ICF) (Stucki et al., 2007) , which highlights the importance of the environmental and personal factors in the health of individuals from the perspective of their influence on Body Function and Structure, Activity, and Participation. The effects of VR on stroke rehabilitation based on the ICF framework in Body Function and Body Structure are most frequently measured, mainly through the Fugl-Meyer Test, Action Research Arm Test, Ashworth Assessment scale, and manual muscle power testing. Activity and Participation (Aminov et al., 2018) are less often assessed, though these features are proposed as vital when designing game systems for stroke survivors. Published survey papers, taxonomies and framework are unanimous about the need for promoting socialization (Palma et al., 2017; Veras et al., 2017) ; (Palma et al., 2017) . The results of VR-TR intervention were positive in all five studies with benefits for the patients. However, an analysis of the RCT included in this review ( Table 2) , indicates that all were preliminary studies with a limited number of adult participants. The information about the age at which the stroke occurred were not always available, nor was information about the severity and type of stroke. There was no homogeneity in inclusion and exclusion criteria. One RCT (Piron et al., 2008) used VR therapy in control and experimental groups and TR only in experimental groups; the others compared a VR and TR approach with conventional therapy. In one study (Piron et al., 2008) the experimental VR-TR group did not include conventional therapy; in other studies, both experimental and control groups received conventional therapy, perhaps causing a confounding bias. The TR component was not always clear. The authors assumed that all five studies used TR to monitor the results of VR intervention; however, two studies (Choi & Paik, 2018; Piron et al., 2008) (Fluet et al., 2012) and just one assessed patient satisfaction (Piron et al., 2008) . Results were presented in a descriptive way, without statistical analysis. Results suggested a greater improvement in the FMA-UE, Bstage, and manual muscle power testing post treatment with the mobile game-based VR upper extremity rehabilitation program than with conventional therapy. The effect was maintained until the one-month follow-up. Intrinsic motivation levels were better for the EM group and motivation levels were maintained for the 12-week protocol. making adjustments imperceptible. Both groups practiced « as much as possible," at least 20 minutes daily for 12 weeks. Piron et al., The PEDro scale was developed to quickly identify RCTs with internal validity and sufficient statistical information among the uploaded RCTs. The scoring of PEDro scale is significantly influenced by blinding since different types of blinding are scored by three items. Therefore, the quality score of RCTs related to disciplines in which blinding cannot be completely achieved is underestimated with this tool. PEDro total scores above 6 (including 6) were considered high quality (Moseley et al., 2002) ; scores below 6 were considered fair quality. Measures of at least one key outcome were obtained from more than 85% of the subjects initially allocated to groups. All subjects for whom outcome measures were available received the treatment or control condition as allocated or, where this was not the case, data for at least one key outcome was analyzed by "intention to treat." The results of between-group statistical comparisons are reported for at least one key outcome. Yes Yes Yes Yes The study provides both point measures and measures of variability for at least one key outcome. Total score 8 7 9 5 8 Note. NA: information not available or not enough to make conclusions on that item. According to this tool, the methodological quality of included studies in this systematic review was generally high (Table 3) , as four studies scored more than 6 points. Lack of information was a common feature in all studies. Information regarding the most important prognostic indicators was often omitted, as well as information about the initial functionality of the participants' upper limb. The heterogeneity of selection and intervention protocols and outcome measuring (many studies did not specify outcome measures) also weakened comparison between studies. The primary focus was the quality of research in virtual reality and telerehabilitation when used together in upper limb rehabilitation post stroke. This review used PRISMA guidelines, which was a strength. The findings, along with identified limitations, could be helpful to future investigations on this topic. Because RCT is considered the gold standard of clinical investigation, some software systems tested in non RCT studies may not have been included, reducing the pool of articles. Future reviews should include more databases, despite the risk of including more technical articles than clinical trials. The exclusion of articles not written in English may contribute to a limited and even biased perspective. Search terms might be refined to reveal more articles. As examples, "upper extremity" (not only "upper limb") and "home rehabilitation" OR "home exercises" (not only "telerehabilitation.)" TR could minimize the discontinuity of treatment after hospital discharge and bring stroke survivors closer to health professionals without geographical barriers, empowering survivors to manage their health via interaction with remote rehabilitation professionals. It is desirous that such teams are interdisciplinary and include end-users (i.e., clinicians and patients) and engineers who embrace a human-centred, holistic approach. With increasing numbers of stroke survivors, costeffective measures must be taken to improve their Activity and Participation as detailed in the ICF and strive toward holistic outcomes. VR-based serious games have the ability to scale levels of difficulty in the context of enriched environments and promote motivation. While telerehabilitation using serious games after stroke is a promising tool to complement current services, strong evidence of its benefits is still lacking. More RCT studies are needed with larger numbers of participants and narrower selection criteria (to obtain more homogeneous samples). Based on this literature review, and despite the lack of RCT studies, it appears that serious games are a valid solution for TR that can bring rehabilitation exercises to the patient's home during the chronic phase at a reasonable price empowering them to manage their health while under constant monitoring from physicians. Sensorimotor training in virtual reality: A review What do randomized controlled trials say about virtual rehabilitation in stroke? A systematic literature review and meta-analysis of upper-limb and cognitive outcomes Virtual reality in the rehabilitation of patients with stroke: An integrative review Vision-based serious games and virtual reality systems for motor rehabilitation: A review geared toward a research methodology The role of social interactions in motor performance: feasibility study toward enhanced motivation in telerehabilitation The use and effect of video game design theory in the creation of game-based systems for upper limb stroke rehabilitation Recommendations for Methodology of Virtual Reality Clinical Trials in Health Care by an International Working Group: Iterative Study Canadian Stroke Best Practice Recommendations: Telestroke Best Practice Guidelines Update What's new in new technologies for upper extremity rehabilitation? Assistive game controller for artificial intelligence-enhanced telerehabilitation post-stroke Virtual rehabilitation--benefits and challenges Feasibility of integrative games and novel therapeutic game controller for telerehabilitation of individuals chronic post-stroke living in the community Optimising engagement for stroke rehabilitation using serious games. The Visual Computer The role of virtual reality in improving motor performance as revealed by EEG: a randomized clinical trial Psychological treatments and psychotherapies in the neurorehabilitation of pain: Evidences and recommendations from the Italian Consensus Conference on Pain in Neurorehabilitation Telerehabilitation approaches for stroke patients: Systematic review and meta-analysis of randomized controlled Trials Telerehabilitation approaches for stroke patients Systematic review and meta-analysis of randomized controlled trials Home-based technologies for stroke rehabilitation: A systematic review A qualitative study on user acceptance of a homebased stroke telerehabilitation system Fuzzy logic-based mobile computing system for hand rehabilitation after neurological injury. Technology and Health Care Mobile game-based virtual reality program for upper extremity stroke rehabilitation VR system for rehabilitation based on hand gestural and olfactory interaction The PEDro scale is a valid measure of the methodological quality of clinical trials: A demographic study Using virtual reality to increase motivation in poststroke rehabilitation Kinect-based virtual rehabilitation and evaluation system for upper limb disorders: A case study Telerehabilitation upper extremity for neurological disorders Utilizing gaming mechanics to optimize telerehabilitation adherence in persons with stroke Robots integrated with virtual reality simulations for customized motor training in a person with upper extremity hemiparesis: A case study Autonomous use of the home virtual rehabilitation system: A feasibility and pilot study Virtual Reality clinical research: Promises and challenges Video Game Rehabilitation for Outpatient Stroke (VIGoROUS): protocol for a multi-center comparative effectiveness trial of inhome gamified constraint-induced movement therapy for rehabilitation of chronic upper extremity hemiparesis Heart disease and stroke statistics--2013 update: A report from the American Heart Association Use of virtual reality in rehabilitation of movement in children with hemiplegia--a multiple case study evaluation Virtual environments for motor rehabilitation: review Understanding the Implementation of telerehabilitation at preimplementation stage: A systematic literature review Post-stroke upper limb rehabilitation using telerehabilitation interactive virtual reality system in the patient's home Optimizing a home-based virtual reality exercise program for chronic stroke patients: A telerehabilitation approach Maximizing post-stroke upper limb rehabilitation using a novel telerehabilitation interactive virtual reality system in the patient's home: Study protocol of a randomized clinical trial Effectiveness of virtual reality-and gaming-based interventions for upper extremity rehabilitation poststroke: A meta-analysis Development and evaluation of a new telerehabilitation system based on VR technology using multisensory feedback for patients with stroke The effectiveness of reinforced feedback in virtual environment in the first 12 months after stroke The Rutgers Arm, a rehabilitation system in virtual reality: A pilot study Estimates of the prevalence of acute stroke impairments and disability in a multiethnic population Telerehabilitation services for stroke Virtual reality for stroke rehabilitation A further step to develop patient-friendly implementation strategies for virtual reality-based rehabilitation in patients with acute stroke Learning to assess the quality of stroke rehabilitation exercises Interactive hybrid approach to combine machine and human intelligence for personalized rehabilitation assessment Emergence of virtual reality as a tool for upper limb rehabilitation: Incorporation of motor control and motor learning principles New directions in treatments targeting stroke recovery Effectiveness, usability, and cost-benefit of a virtual realitybased telerehabilitation program for balance recovery after stroke: A randomized controlled trial Virtual reality therapy for adults post-stroke: A systematic review and meta-analysis exploring virtual environments and commercial games in therapy Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis Virtual reality as an analgesic for acute and chronic pain in adults: a systematic review and meta-analysis Virtual reality therapy for upper limb rehabilitation in patients with stroke: a meta-analysis of randomized clinical trials Preferred reporting items for systematic reviews and metaanalyses: the PRISMA statement Evidence for physiotherapy practice: a survey of the Physiotherapy Evidence Database (PEDro) Up to 2.2 million people experiencing disability suffer collateral damage each day of Covid-19 lockdown in Europe Effects of virtual reality for stroke individuals based on the International Classification of Functioning and Health: A systematic review Virtual TeleRehab: A case study Should alternatives to conventional hospitalisation be promoted in an era of financial constraint? Effective game use in neurorehabilitation: user-centered perspectives Virtual environment system for motor tele-rehabilitation Motor tele-rehabilitation in post-stroke patients Exercises for paretic upper limb after stroke: A combined virtual-reality and telemedicine approach Satisfaction with care in post-stroke patients undergoing a telerehabilitation programme at home Feasibility of a customized, in-home, game-based stroke exercise program using the Microsoft Kinect® Sensor Telerehabilitation and emerging virtual reality approaches to stroke rehabilitation A SWOT analysis of the field of virtual rehabilitation and therapy Validating ArmAssist Assessment as outcome measure in upper-limb post-stroke telerehabilitation Modifying "PICO" question into "PICOS" model for more robust and reproducible presentation of the methodology employed in a scientific study Tele-Rehabilitation after stroke: An updated systematic review of the literature A review of the evidence for the use of telemedicine within stroke systems of care: A scientific statement from the Homebased virtual reality training after discharge from hospitalbased stroke rehabilitation: A parallel randomized feasibility trial The International Classification of Functioning, Disability and Health (ICF): A unifying model for the conceptual description of the rehabilitation strategy Home-based upper extremity stroke therapy using a multiuser virtual reality environment: A randomized trial Development of a 3D, networked multi-user virtual reality environment for home therapy after stroke Application of commercial games for home-based rehabilitation for people with hemiparesis: challenges and lessons learned Outcome Measures in tele-rehabilitation and virtual reality for stroke survivors: Protocol for a scoping review Scoping review of outcome measures used in telerehabilitation and virtual reality for post-stroke rehabilitation Virtual reality for therapeutic purposes in stroke: A systematic review Factors that contribute to the use of stroke self-rehabilitation technologies: A review An IoT-enabled stroke rehabilitation system based on smart wearable armband and machine learning From visual simulation to virtual reality to games