Proposal of a game streaming based framework for a telerehabilitation system | Multimedia Tools and Applications Skip to main content

Advertisement

Springer Nature Link
Log in

Proposal of a game streaming based framework for a telerehabilitation system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Electronic games are being applied in diverse contexts beyond their conventional entertainment purposes. In academic discourse, they are known exergames when utilized to augment physical fitness or medical rehabilitation therapies. Exergames facilitate the advancement of rehabilitation treatments within clinical or hospital environments, as well as within the confines of a patient's domicile. Nonetheless, notwithstanding the advantages of leveraging exergames, they entail certain expenses for patients, encompassing the procurement of gaming devices and the accompanying controllers. An additional drawback lies in the limited oversight afforded to therapists, necessitating either patient visits to clinics or hospitals or therapist home visits to conduct sessions. To address these concerns, this research proposes the implementation of several innovative technologies as viable solutions to the complex issues identified in the existing literature. These cutting-edge technologies encompass the development of an input device utilizing video object tracking, which serves to regulate the execution of the exergames. The exergames themselves are executed on a remote game server, and their rendered frames are streamed to patients over the Internet through the implementation of a game streaming application. Moreover, to facilitate seamless interaction between patients and therapists during telerehabilitation sessions, a real-time audio and video communication channel is seamlessly integrated into this framework, enabling them to engage with each other regardless of their physical proximity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

All data generated or analyzed during this study are included in this published article.

References

  1. Burgos Pablo I, Lara Oriana, Lavado Alejandro, Rojas-Sepúlveda Ignacia, Delgado Carolina, Bravo Eusebio, Kamisato Cristian, Torres Julio, Castañeda Victor, Cerda Mauricio (2020) Exergames and Telerehabilitation on Smartphones to Improve Balance in Stroke Patients. Brain Sci 1–10. https://doi.org/10.3390/brainsci10110773

  2. Hoda M, El Saddik A, Phan P, Wai E (2020) Haptics in Rehabilitation, Exergames and Health. https://doi.org/10.1007/978-3-030-34230-2_5

  3. Nguyen A-V, Ong Y-L, Luo CX, Thuraisingam T, Rubino M, Levin MF, Kaizer F, Archambault PS (2019) Virtual reality exergaming as adjunctive therapy in a sub-acute stroke rehabilitation setting: facilitators and barriers. Disabil Rehabil Assist Technol 14(4):317–324. https://doi.org/10.1080/17483107.2018.1447608

    Article  PubMed  Google Scholar 

  4. Amorim P, Santos BS, Dias P, Silva S, Martins H (2020) Serious Games for Stroke Telerehabilitaton of Upper Limb - a Review for Future Research. Int J Telerehabil 12(2):1–12. https://doi.org/10.5195/ijt.2020.6326

    Article  Google Scholar 

  5. Mantovani Elisa, Zucchella Chiara, Bottiroli Sara, Federico Angela, Giugno Rosalba, Sandrini Giorgio, Chiamulera Cristiano, Tamburin Stefano (2020) Telemedicine and Virtual Reality for Cognitive Rehabilitation: A Roadmap for the COVID-19 Pandemic. Front Neurol 1–18. https://doi.org/10.3389/fneur.2020.00926

  6. Matamala-Gomez Marta, Maisto Marta, Montana Jessica Isbely, Mavrodiev Petar Aleksandrov, Baglio Francesca, Rossetto Federica, Mantovani Fabrizia, Riva Giuseppe, Realdon Olivia (2020).The Role of Engagement in Teleneurorehabilitation: A Systematic Review. Front Neurol 1–23. https://doi.org/10.3389/fneur.2020.00354

  7. Afyouni Imad, Murad Abdullah, Einea Anas (2020) Adaptive Rehabilitation Bots in Serious Games. Sensors 20(7037). https://doi.org/10.3390/s20247037

  8. Andrade Kleber de O, Fernandes Guilherme, Martins Junior Jose, Roma Viviane C, Joaquim Ricardo C, Caurin Glauco AP (2013) Rehabilitation Robotics and Serious Games: An Initial Architecture for Simultaneous Players. In: Biosignals and Biorobotics Conference (BRC), 2013 ISSNIP. https://doi.org/10.1109/BRC.2013.6487455

  9. Ali Karime, Al-Osman Hussein, Alja’am Jihad Mohamad, Gueaieb Wail, El Saddik Abdulmotaleb (2012) Tele-Wobble: a telerehabilitation wobble board for lower extremity therapy. IEEE Trans Instrum Meas 61(7):1816–24. https://doi.org/10.1109/TIM.2012.2192338

  10. Li H-J, Song A-G (2017) Architectural Design of a Cloud Robotic System for Upper-Limb Rehabilitation with Multimodal Interaction. J Comput Sci Technol 32(2):258–268. https://doi.org/10.1007/s11390-017-1720-4

    Article  MathSciNet  Google Scholar 

  11. Oliver M, Teruel MA, Molina JP, Romero-Ayuso D, González P (2018) Ambient Intelligence Environment for Home Cognitive Telerehabilitation. Sensors 18:1–30. https://doi.org/10.3390/s18113671

    Article  Google Scholar 

  12. Ioannis Th Paraskevopoulos, Tsekleves Emmanuel, Warland Alyson, Kilbride Cherry (2016) Virtual Reality-Based Holistic Framework: A Tool for Participatory Development of Customised Playful Therapy Sessions for Motor Rehabilitation. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES). IEEE, Barcelona, Spain. https://doi.org/10.1109/VS-GAMES.2016.7590378

  13. Pérez-Medina Jorge-Luis, Jimenes-Vargas Karina Beatriz, Leconte Louis, Villarreal Santiago, Rybarczyk Yves, Vanderdonckt Jean (2019) EPHoRt: Towards a Reference Architecture for Tele-Rehabilitation Systems. IEEE Access 1–18. https://doi.org/10.1109/ACCESS.2019.2927461

  14. Popescu VG, Burdea GC, Bouzit M, Hentz VR (2000) A Virtual-Reality-Based Telerehabilitation System with Force Feedback. IEEE Trans Inf Technol Biomed 4(1):45–51

    Article  CAS  PubMed  Google Scholar 

  15. Postolache O, Jude Hemanth D, Alexandre R, Gupta D, Geman O, Khanna A (2020) Remote Monitoring of Physical Rehabilitation of Stroke Patients Using IoT and Virtual Reality. IEEE J Sel Areas Commun 39(2):562–573. https://doi.org/10.1109/JSAC.2020.3020600

    Article  Google Scholar 

  16. Reinkensmeyer DJ, Pang CT, Nessler JA, Painter CC (2002) Web-Based Telerehabilitation for the Upper Extremity After Stroke. IEEE Trans Neural Syst Rehabil Eng 10(2):102–108

    Article  PubMed  Google Scholar 

  17. Triandafilou KM, Tsoupikova D, Barry AJ, Thielbar KN, Stoykov N, Kamper DG (2018) Development of a 3D, Networked Multi-User Virtual Reality Environment for Home Therapy after Stroke. J Neuroeng Rehabil 15(1):1–13. https://doi.org/10.1186/s12984-018-0429-0

    Article  Google Scholar 

  18. Varela-Aldás J, Palacios-Navarro G, Amariglio R, García-Magariño I (2020) Head-Mounted Display-Based Application for Cognitive Training. Sensors 20(6052):1–22. https://doi.org/10.3390/s20226552

    Article  Google Scholar 

  19. Vourvopoulos A, Faria AL, Cameirão MS, Bermúdez i Badia S (2013) RehabNet: A Distributed Architecture for Motor and Cognitive Neuro-Rehabilitation. In: 2013 IEEE 15th International Conference on E-Health Networking, Applications and Services (Healthcom 2013), 454–59. https://doi.org/10.1109/HealthCom.2013.6720719

  20. Athanasios Vourvopoulos, Faria Ana Lúcia, Cameirão Mónica S, Bermúdez i Badia Sergi (2013) RehabNet: A Distributed Architecture for Motor and Cognitive Neuro-Rehabilitation -Understanding the Human Brain through Virtual Environment Interaction. In: 2013 IEEE 15th International Conference on E-Health Networking, Applications and Services (Healthcom 2013), 454–59. Lisbon, Portugal https://doi.org/10.1109/HealthCom.2013.6720719

  21. Zedda A, Gusai E, Caruso M, Bertuletti S, Baldazzi G, Spanu S, Riboni D et al (2020) DoMoMEA: A Home-Based Telerehabilitation System for Stroke Patients. In: Annu Int Conf IEEE Eng Med Biol Soc., 5773–76. https://doi.org/10.1109/EMBC44109.2020.9175742. Accessed 20 June 2022

  22. Triandafilou Kristen M (2018b) Development of a 3D, Networked Multiuser Virtual Reality Environment for Home Therapy after Stroke. J NeuroEng Rehabil 15(88):1–13. https://doi.org/10.1186/s12984-018-0429-0

  23. Bamidis PD, Konstantinidis E, Billis AS, Sioundas A (2015) Reviewing home based assistive technologies. IGI Global. https://doi.org/10.4018/978-1-4666-8234-4.ch017. Accessed 10 Apr 2022

  24. Pareto L, Johansson B, Zeller S, Sunnerhagen KS, Rydmark M, Broeren J (2011) Virtual TeleRehab: A Case Study. Stud Health Technol Inf 169:676–680

    Google Scholar 

  25. Piron L, Tonin P, Atzori AM, Zanotti E, Massaro C, Trivello E, Dam M (2002) Virtual Environment System for Motor Tele-Rehabilitation. Stud Health Technol Inf 85:355–361

    Google Scholar 

  26. Hosseiniravandi M, Kahlaee AH, Karim H, Ghamkhar L, Safdari R (2020) Home-Based Telerehabilitation Software Systems for Remote Supervising: A Systematic Review. Int J Technol Assess Health Care 36(2):113–125. https://doi.org/10.1017/S0266462320000021

    Article  PubMed  Google Scholar 

  27. Silva Talita Dias da, da Silva Paula Lumy, de Jesus Valenzuela Elisa, Dias Eduardo Dati, Simcsik Amanda Orasmo, Giovanelli de Carvalho Mariana, Gomes Gonçalves Fontes Anne Michelli et al (2021) Serious Game Platform as a Possibility for Home-Based Telerehabilitation for Individuals with Cerebral Palsy during COVID-19 Quarantine--a Cross-Sectional Pilot Study. Front Psychol 12. https://doi.org/10.3389/fpsyg.2021.622678

  28. Tan Lu, Wang Neng (2010) Future Internet: The Internet of Things. In: 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE), 376–80

  29. Yang S, Gao T, Wang J, Deng B, Azghadi MR, Lei T, Linares-Barranco B (2022) SAM: A Unified Self-Adaptive Multicompartmental Spiking Neuron Model for Learning With Working Memory. Front Neurosci. https://doi.org/10.3389/fnins.2022.850945

    Article  PubMed  PubMed Central  Google Scholar 

  30. Yang Shuangming, Tan Jiangtong, Chen Badong (2022) Robust Spike-Based Continual Meta-Learning Improved by Restricted Minimum Error Entropy Criterion. Entropy 24(4) https://doi.org/10.3390/e24040455

  31. Ibáñez Manuel López, Romero-Hernández Alejandro, Manero Borja, Guijarro María (2021) Computer entertainment technologies for the visually impaired: an overview. Int J Interact Multimed Artif Intell 7(4):53–68. https://doi.org/10.9781/ijimai.2021.04.008

  32. Tlili A, Chang M, Moon J, Liu Z, Burgos D, Chen N-S (2021) A Systematic Literature Review of Empirical Studies on Learning Analytics in Educational Games. Int J Interact Multim Artif Intell. https://doi.org/10.9781/ijimai.2021.03.003

    Article  Google Scholar 

  33. Gauthier LV, Kane C, Borstad A, Strahl N, Uswatte G, Taub E, Morris D, Hall A, Arakelian M, Mark V (2017) Video Game Rehabilitation for Outpatient Stroke (VIGoROUS): Protocol for a Multi-Center Comparative Effectiveness Trial of in-Home Gamified Constraint-Induced Movement Therapy for Rehabilitation of Chronic Upper Extremity Hemiparesis. BMC Neurol 17(1):109. https://doi.org/10.1186/s12883-017-0888-0

    Article  PubMed  PubMed Central  Google Scholar 

  34. Dodakian L, McKenzie AL, Le Vu, See J, Pearson-Fuhrhop K, Quinlan EB, Zhou RJ et al (2017) A Home-Based Telerehabilitation Program for Patients With Stroke. Neurorehabil Neural Repair 31(10–11):923–933. https://doi.org/10.1177/1545968317733818

    Article  PubMed  PubMed Central  Google Scholar 

  35. Parsec (2023) Parsec WebSite. https://parsec.app/. Accessed 10 Jan 2022

  36. WebRTC (2023) Web RTC. https://webrtc.org/?hl=pt-br. Accessed 03 Jan 2022

  37. Peer JS (2023) Peer JS. https://peerjs.com/. Accessed 11 Jan 2022

  38. Imtiaz Parve, Rahmati Ali, Guvenc Ismail, Sarwat Arif I (2018) A survey on low latency towards 5G: RAN, core network and caching solutions. IEEE Commun Surv Tutorials 20(4). https://doi.org/10.1109/COMST.2018.2841349. Accessed 05 May 2022

  39. Zhang Liren, Zheng Li, Ngee Koh Soo (2002) Effect of Delay and Delay Jitter on Voice/Video over IP. Comput Commun 25(9):863–73. https://doi.org/10.1016/S0140-3664(01)00418-2

  40. Furber S (2016) Large-Scale Neuromorphic Computing Systems. J Neural Eng. https://doi.org/10.1088/1741-2560/13/5/051001

    Article  PubMed  Google Scholar 

  41. James Conrad D, Aimone Ames B, Miner Nadine E, Vineyard Craig M, Rothganger Fredrick H, Carlson Kristofor D (2017) A Historical Survey of Algorithms and Hardware Architectures for Neural-Inspired and Neuromorphic Computing Applications. Biol Inspired Cogn Archithttps://doi.org/10.1016/j.bica.2016.11.002

  42. Schuman Catherine D, Potok Thomas E, Patton Robert M, Birdwell J Douglas (2017) A Survey of Neuromorphic Computing and Neural Networks in Hardware. Neural Evol Comput. https://doi.org/10.48550/arXiv.1705.06963

  43. Yang Shuangming, Gao Tian, Wang Jiang, Deng Bin, Lansdell Benjamin, Linares-Barranco Bernabe (2021) Efficient spike-driven learning with dendritic event-based processing. Front Neurosci. 15:601109. https://doi.org/10.3389/fnins.2021.601109

  44. Shuangming Yang, Linares-Barranco Bernabe, Chen Badong (2022) Heterogeneous Ensemble-Based Spike-Driven Few-Shot Online Learning. Front Neurosci 16. https://doi.org/10.3389/fnins.2022.850932

Download references

Funding

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES). Finance Code 001.

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering - Postgraduate Program in Biomedical Engineering, Federal University of Uberlândia, Assistive Technology Group, Av Joao Naves de Avila, 2160 – Bloco 1A, Uberlandia, Brazil

    Guilherme Fernandes de Souza Miguel, Angela Abreu Rosa de Sá, Júlia Tannús & Eduardo Lázaro Martins Naves

Authors
  1. Guilherme Fernandes de Souza Miguel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Angela Abreu Rosa de Sá
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Júlia Tannús
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eduardo Lázaro Martins Naves
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GFSM, AARS and JT was involved in drafting the manuscript and revising it critically for important intellectual content. ELMN supervised, revised and gave the final approval of the manuscript. All authors were fully involved in the study and preparation of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Angela Abreu Rosa de Sá.

Ethics declarations

Ethics approval and Consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

de Souza Miguel, G.F., de Sá, A.A.R., Tannús, J. et al. Proposal of a game streaming based framework for a telerehabilitation system. Multimed Tools Appl 83, 33333–33350 (2024). https://doi.org/10.1007/s11042-023-16741-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16741-8

Keywords

Search

Navigation