Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method | Multimedia Tools and Applications
Skip to main content
Springer Nature Link
Log in

Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a novel evaluation method for assessing the effectiveness of virtual reality serious games (In our work, we used virtual reality as a simulated 3D environment, not immersive headsets) in post-stroke rehabilitation. Stroke, which is a leading cause of long-term disability, requires effective rehabilitation approaches to facilitate motor recovery and enhance patients’ quality of life. The study aims to investigate the potential benefits of incorporating VR technology into upper limb rehabilitation for post-stroke patients, with a specific focus on evaluating patient motivation and engagement. The proposed evaluation method provides insights into the effectiveness of VR serious games as a rehabilitation tool and contributes to the understanding of their impact on post-stroke recovery. This study involved the recruitment of a diverse sample of 20 patients, both male and female, who had experienced left hemiplegia as a result of an ischemic stroke. To ensure a representative sample, patients of different ages were included. Participants were divided into three groups, with each group invited to participate in different stages over a one-year period. During an eight-week period, all groups participated in a rehabilitation program consisting of virtual reality exercises twice a week, alongside five traditional rehabilitation sessions per week. Furthermore, this study introduces a novel approach using camera-based sensors to evaluate patient engagement in virtual reality exercises. By monitoring and analyzing facial expressions throughout each rehabilitation session, our objective is to leverage emotion recognition technology to understand patients’ emotional states and levels of motivation and engagement. The findings from this study indicate that a significant number of patients showed motivation during virtual reality rehabilitation exercises. The analysis of facial expressions utilizing camera-based sensors,yielded valuable insights into the emotional state and level of engagement exhibited by the participants. These findings substantiate the efficacy of virtual reality as a potent tool in fostering motivation among post-stroke patients, thereby actively involving them in rehabilitation exercises and facilitating their journey toward recovery.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Availability of data and materials

All the data and materials could be found at DPR Division of the Center for Development of Advanced Technologies (CDTA), Algiers, Algeria.

References

  1. National heart, lung, and blood institute, U.S. department of health and human services. https://www.nhlbi.nih.gov/health-topics/stroke

  2. Allodocteurs Africa (2019) Stroke in Algeria. https://www.allodocteurs.africa/avc-60.000-cas-en-algerie-1438.html

  3. Kwakkel G, Kollen B, Van der Grond J, Prevo A (2003) Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke 34:2181–2186

    Google Scholar 

  4. Cho KH, Lee KJ, Song CH (2012) Virtual-reality balance training with a video-game system improves dynamic balance in chronic stroke patients. Tohoku J Exp Med 228(1):69–74

    Google Scholar 

  5. Lee MM, Shin DC, Song CH (2016) Canoe game-based virtual reality training to improve trunk postural stability, balance, and upper limb motor function in subacute stroke patients: a randomized controlled pilot study. J Phys Ther Sci 28(7):2019–2024

    Google Scholar 

  6. Lee HC, Huang CL, Ho SH et al (2017) The effect of a virtual reality game intervention on balance for patients with stroke: a randomized controlled trial. Games Health J 6(5):303–311

    Google Scholar 

  7. Izountar Y, Benbelkacem S, Otmane S et al (2022) Vr-peer: a personalized exer-game platform based on emotion recognition. Electronics 11(3):455

    Google Scholar 

  8. Cheong MJ, Jeon BR, Noh S (2020) A protocol for systematic review and meta-analysis on psychosocial factors related to rehabilitation motivation of stroke patients. Medicine 99(38):22377

  9. Schuster-Amft C, Eng K, Suica Z, et al (2018) Effect of a four-week virtual reality-based training versus conventional therapy on upper limb motor function after stroke: a multicenter parallel group randomized trial. PLoS ONE 13(10):0204455

  10. Hadjadj Z, Masmoudi M, Meziane A, et al (2022) Leap motion controller for upper limbs physical rehabilitation in post-stroke patients: a usability evaluation. In: 2022 19th International multi-conference on systems, signals & devices (SSD), pp 1700–1709

  11. Ögün MN, Kurul R, Yaar MF, et al (2019) Effect of leap motion-based 3d immersive virtual reality usage on upper extremity function in ischemic stroke patients. Arq Neuropsiquiatr 77:681–688

  12. Masmoudi M, Zenati N, Benbelkacem S, et al (2021) Low-cost haptic glove for grasp precision improvement in virtual reality-based post-stroke hand rehabilitation. In: 2021 International Conference on Artificial Intelligence for Cyber Security Systems and Privacy (AI-CSP), pp 1–3

  13. Choi Y, Paik N (2018) Mobile game-based virtual reality program for upper extremity stroke rehabilitation. J Visualized Exp (133):56241

  14. De Mauro A (2011) Virtual reality based rehabilitation and game technology. In: EICS4Med, p 48

  15. Gueye T, Dedkova M, Rogalewicz V et al (2021) Early post-stroke rehabilitation for upper limb motor function using virtual reality and exoskeleton: equally efficient in older patients. Neurol Neurochir Pol 55(1):91–96

    Google Scholar 

  16. Montoya MF, Muñoz JE, Henao OA (2020) Enhancing virtual rehabilitation in upper limbs with biocybernetic adaptation: the effects of virtual reality on perceived muscle fatigue, game performance and user experience. IEEE Trans Neural Syst Rehabil Eng 28(3):740–747

    Google Scholar 

  17. Erhardsson M, Alt Murphy M, Sunnerhagen KS (2020) Commercial head-mounted display virtual reality for upper extremity rehabilitation in chronic stroke: a single-case design study. J Neuroengineering Rehabil 17:1–14

    Google Scholar 

  18. Marek K, Zubrycki I, Miller E (2022) Immersion therapy with head-mounted display for rehabilitation of the upper limb after stroke. Sensors 22(24):9962

    Google Scholar 

  19. Palacios-Navarro G, Hogan N (2021) Head-mounted display-based therapies for adults post-stroke: a systematic review and meta-analysis. Sensors 21(4):1111

    Google Scholar 

  20. Mehrfard A, Fotouhi J, Taylor G, Forster T, Navab N, Fuerst B (2019) A comparative analysis of virtual reality head-mounted display systems. arXiv:1912.02913

  21. Vlahovic S, Suznjevic M, Skorin-Kapov L (2022) A survey of challenges and methods for quality of experience assessment of interactive vr applications. J Multimodal User Interfaces 16(3):257–291

    Google Scholar 

  22. Francesco Z, Anna G, Antonia P, Marco D, Patrizia S (2022) A systematic review on the usability of robotic and virtual reality devices in neuromotor rehabilitation: patients and healthcare professionals perspective. BMC Health Serv Res (Web) 22(1):1–16

  23. Naro A, Calabro RS (2021) What do we know about the use of virtual reality in the rehabilitation field? a brief overview. Electronics 10(9):1042

    Google Scholar 

  24. Aguilera-Rubio n, Cuesta-Gómez A, Mallo-López A, et al (2022) Feasibility and efficacy of a virtual reality game-based upper extremity motor function rehabilitation therapy in patients with chronic stroke: A pilot study. Int J Environ Res Public Health 19(6):3381

  25. Epure P, Holte MB (2017) Analysis of motivation in virtual reality stroke rehabilitation. In: Interactivity, game creation, design, learning, and innovation, pp 282–293

  26. Iosa M, Morone G, Fusco A et al (2015) Leap motion controlled videogame-based therapy for rehabilitation of elderly patients with subacute stroke: a feasibility pilot study. Top Stroke Rehabil 22(4):306–316

    Google Scholar 

  27. Vanbellingen T, Filius SJ, Nyffeler T et al (2017) Usability of videogame-based dexterity training in the early rehabilitation phase of stroke patients: a pilot study. Front Neurol 8:654

    Google Scholar 

  28. Colombo R, Raglio A, Panigazzi M et al (2019) The sonic hand protocol for rehabilitation of hand motor function: A validation and feasibility study. IEEE Trans Neural Syst Rehabil Eng 27(4):664–672

    Google Scholar 

  29. Fluet GG, Qiu Q, Patel J et al (2019) Autonomous use of the home virtual rehabilitation system: a feasibility and pilot study. Games Health J 8(6):432–438

    Google Scholar 

  30. De Luca R, Russo M, Naro A et al (2018) Effects of virtual reality-based training with bts-nirvana on functional recovery in stroke patients: preliminary considerations. Int J Neurosci 128(9):791–796

    Google Scholar 

  31. Russo M, De Luca R, Naro A et al (2017) Does body shadow improve the efficacy of virtual reality-based training with bts nirvana?: a pilot study. Medicine 96(38):8096

    Google Scholar 

  32. Fan SC, Su FC, Chen SS et al (2014) Improved intrinsic motivation and muscle activation patterns in reaching task using virtual reality training for stroke rehabilitation: a pilot randomized control trial. J Med Biol Eng 34(4):399–407

    Google Scholar 

  33. Da Silva Ribeiro NM, Ferraz DD, Pedreira r, et al (2015) Virtual rehabilitation via nintendo wii and conventional physical therapy effectively treat post-stroke hemiparetic patients. Top Stroke Rehabil 22(4):299–305

  34. Carregosa AA, Dos Santos LRA, Masruha MR et al (2018) Virtual rehabilitation through nintendo wii in poststroke patients: follow-up. J Stroke Cerebrovasc Dis 27(2):494–498

    Google Scholar 

  35. Gonçalves MG, Piva MFL, Marques CLS et al (2018) Effects of virtual reality therapy on upper limb function after stroke and the role of neuroimaging as a predictor of a better response. Arq Neuropsiquiatr 76:654–662

    Google Scholar 

  36. Lee KH (2015) Effects of a virtual reality-based exercise program on functional recovery in stroke patients: part 1. J Phys Ther Sci 27(6):1637–1640

    Google Scholar 

  37. Morone G, Tramontano M, Iosa M, et al (2014) The efficacy of balance training with video game-based therapy in subacute stroke patients: a randomized controlled trial. BioMed Res Int 2014

  38. Turolla A, Dam M, Ventura L, Tonin P, Agostini M, Zucconi C et al (2013) Virtual reality for the rehabilitation of the upper limb motor function after stroke: a prospective controlled trial. J Neuroengineering Rehabil 10:85

    Google Scholar 

  39. Laver KE, Lange B, George S, et al (2017) Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev (11):008349

  40. Aminov A, Rogers JM, Middleton S et al (2018) What do randomized controlled trials say about virtual rehabilitation in stroke? a systematic literature review and meta-analysis of upper-limb and cognitive outcomes. J NeuroEngineering Rehabil 15(1):1–24

    Google Scholar 

  41. Tatla SK, Sauve K, VirjiBabul N et al (2013) Evidence for outcomes of motivational rehabilitation interventions for children and adolescents with cerebral palsy: an american academy for cerebral palsy and developmental medicine systematic review. Dev Med Child Neurol 55(7):593–601

    Google Scholar 

  42. Sin H, Lee G (2013) Additional virtual reality training using xbox kinect in stroke survivors with hemiplegia. Am J Phys Med Rehabil 92(10):871–880

    Google Scholar 

  43. Viana RT, Laurentino GEC, Souza RJP et al (2014) Effects of the addition of transcranial direct current stimulation to virtual reality therapy after stroke: a pilot randomized controlled trial. NeuroRehabilitation 34(3):437–446

    Google Scholar 

  44. Saposnik G, Cohen LG, Mamdani M et al (2016) Efficacy and safety of non-immersive virtual reality exercising in stroke rehabilitation (evrest): a randomised, multicentre, single-blind, controlled trial. Lancet Neurol 15(10):1019–1027

    Google Scholar 

  45. Rutkowski S, Kiper P, Cacciante L et al (2020) Use of virtual reality-based training in different fields of rehabilitation: a systematic review and meta-analysis. J Rehabil Med 52(11):1–16

    Google Scholar 

  46. Zr Wang, Wang P, Xing L et al (2017) Leap motion-based virtual reality training for improving motor functional recovery of upper limbs and neural reorganization in subacute stroke patients. Neural Regen Res 12(11):1823

    Google Scholar 

  47. Yu N, Xu C, Li H et al (2016) Fusion of haptic and gesture sensors for rehabilitation of bimanual coordination and dexterous manipulation. Sensors 16(3):395

    Google Scholar 

  48. Saposnik G, Teasell R, Mamdani M et al (2010) Effectiveness of virtual reality using wii gaming technology in stroke rehabilitation: a pilot randomized clinical trial and proof of principle. Stroke 41(7):1477–1484

    Google Scholar 

  49. Calabró RS, Naro A, Russo M et al (2017) The role of virtual reality in improving motor performance as revealed by eeg: a randomized clinical trial. J NeuroEngineering Rehabil 14(1):1–16

    Google Scholar 

  50. Lin M, Huang J, Fu J, et al (2022) A vr-based motor imagery training system with emg-based real-time feedback for post-stroke rehabilitation. IEEE Trans Neural Syst Rehabil Eng

  51. Leiker AM, Miller M, Brewer L et al (2016) The relationship between engagement and neurophysiological measures of attention in motion-controlled video games: a randomized controlled trial. JMIR Serious Games 4(1):5460

    Google Scholar 

  52. Bergen N, Labonté R (2020) “everything is perfect, and we have no problems: detecting and limiting social desirability bias in qualitative research. Qual Health Res 30(5):783–792

  53. Grimm P (2010) Social desirability bias. Wiley international encyclopedia of marketing

  54. Johnson TP, Van de Vijver FJ (2003) Social desirability in cross-cultural research. Cross-Cult Surv Methods 325:195–204

    Google Scholar 

  55. Stein A, Yotam Y, Puzis R et al (2018) Eeg-triggered dynamic difficulty adjustment for multiplayer games. Entertain Comput 25:14–25

    Google Scholar 

  56. Liu Y, Sourina O (2014) Real-time subject-dependent eeg-based emotion recognition algorithm. Special Issue on Cyberworlds, Transactions on Computational Science XXIII, pp 199–223

    Google Scholar 

  57. Ninaus M, Tsarava K, Moeller K (2019) A pilot study on the feasibility of dynamic difficulty adjustment in game-based learning using heart-rate. In: Games and learning alliance: 8th international conference, GALA 2019, Athens, Greece, November 27–29, 2019, Proceedings 8, pp 117–128

  58. Taigman Y, Yang M, Ranzato M, et al (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1701–1708

  59. Mood me. https://www.Mood-Me.Com/Products/Unity-Face-Ai-Ar-Sdk/

  60. Russell JA, Mehrabian A (1977) Evidence for a three-factor theory of emotions. J Res Pers 11(3):273–294

    Google Scholar 

  61. Toisoul A, Kossaifi J, Bulat A, Tzimiropoulos G, Pantic M (2021) Estimation of continuous valence and arousal levels from faces in naturalistic conditions. Nat Mach Intell 3(1):42–50

    Google Scholar 

  62. Bălan O, Moise G, Petrescu L, Moldoveanu A, Leordeanu M, Moldoveanu F (2019) Emotion classification based on biophysical signals and machine learning techniques. Symmetry 12(1):21

    Google Scholar 

  63. Hussain MS, AlZoubi O, Calvo RA, DMello SK (2011) Affect detection from multichannel physiology during learning sessions with autotutor. In: Artificial intelligence in education: 15th international conference, AIED 2011, Auckland, New Zealand, June 28–July 2011 15, Springer, pp 131–138

  64. Jin X, Wang Z (2005) An emotion space model for recognition of emotions in spoken chinese. In: International conference on affective computing and intelligent interaction, Springer, pp 397–402

  65. Ekman P, Friesen WV (1978) Facial action coding system. Environ Psychol Nonverbal Behav

  66. Leung RCC, Zhang H, Tao X et al (2017) Serious game design for stroke rehabilitation. Int J Inf Technol 23(1):1–25

    Google Scholar 

  67. Poubelle MP (1984) Adaptation de la métacarpo-phalangienne de l’index en inclinaison dans les différents types de préhension. Ann Kinésithér 11(9)

  68. Bensmail D, Robertson J, Fermanian C, Roby-Brami A (2010) Botulinum toxin to treat upper-limb spasticity in hemiparetic patients: grasp strategies and kinematics of reach-to-grasp movements. Neurorehabil Neural Repair 24(2):141–151

    Google Scholar 

  69. Wang Q, Sourina O, Nguyen MK (2010) Eeg-based “serious” games design for medical applications. In: 2010 international conference on cyberworlds, IEEE, pp 270–276

  70. Burke JW, McNeill M, Charles DK, Morrow PJ, Crosbie JH, McDonough SM (2009) Optimising engagement for stroke rehabilitation using serious games. Vis Comput 25:1085–1099

    Google Scholar 

  71. Zhang H, Shen Z, Lin J, Chen Y, Miao Y (2016) Familiarity design in exercise games for elderly. Int J Inf Technol 22:1–19

    Google Scholar 

  72. Rohrbach N, Chicklis E, Levac DE (2019) What is the impact of user affect on motor learning in virtual environments after stroke? a scoping review. J Neuroengineering Rehabil 16:1–14

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Robotics and Industrial Automation, Human Interaction System, Virtual Reality and Augmented “IRVA”, Center for Development of Advanced Technologies, Baba Hassen, Algiers, 16303, Algeria

    Mostefa Masmoudi, Nadia Zenati, Yousra Izountar, Samir Benbelkacem, Mohamed Amine Guerroudji & Adel Oulefki

  2. Functional rehabilitation center, University Hospital Pr Boukhroufa Abdelkader, Ben Aknoun, Algiers, 16306, Algeria

    Wassila Haicheur

  3. IMT Atlantique Bretagne, Paysdela Loire, Brest, France

    Chafiaa Hamitouche

  4. LaTIM Laboratory of Medical information Processing, Brest, France

    Chafiaa Hamitouche

Authors
  1. Mostefa Masmoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nadia Zenati
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yousra Izountar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Samir Benbelkacem
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wassila Haicheur
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mohamed Amine Guerroudji
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Adel Oulefki
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Chafiaa Hamitouche
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mostefa Masmoudi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Masmoudi, M., Zenati, N., Izountar, Y. et al. Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method. Multimed Tools Appl 83, 36175–36202 (2024). https://doi.org/10.1007/s11042-023-17980-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17980-5

Keywords

Search

Navigation