Abstract
This paper presents the evaluation methods and techniques applied to the serious game developed within the VirtualSign project as well as the results achieved through those methods. VirtualSign is a Portuguese sign language bi-directional translator with three main components. The components are a gesture to text translator, a text to gesture translator and a serious game. The serious game aims to make the process of learning sign language easier and enjoyable using the VirtualSign bi-directional translator. The method used to evaluate the VirtualSign was the Quantitative Evaluation Framework (QEF). The translator undertakes a rigid validation process by both sign language experts and the deaf community. The evaluation process was also supported by questionnaires. The precision of the translator has a direct impact on the game performance. To evaluate the precision of the automatic translator we have used QEF and 10-fold cross validation to estimate the accuracy of the translator. The experimental results show a precision above 90%. In the identification of the Portuguese Sign Language terms As for the game the quality rate is 88% based on the QEF evaluation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Salen, K., Zimmerman, E.: Rules of Play: Game Design Fundamentals. MIT Press, Cambridge (2004)
Escudeiro, P., Bidarra, J.: Quantitative evaluation framework (QEF). Conselho Editorial/Consejo Editorial, p. 16 (2008)
Escudeiro, P., Escudeiro, N., Norberto, M., Lopes, J.: VirtualSign in serious games. In: de Carvalho, C.V., Escudeiro, P., Coelho, A. (eds.) Serious Games, Interaction, and Simulation, pp. 42–49. Springer, Heidelberg (2016)
Zafrulla, Z., Brashear, H., Yin, P., Presti, P., Starner, T., Hamilton, H.: American sign language phrase verification in an educational game for deaf children. In: 2010 20th International Conference on Pattern Recognition (ICPR), pp. 3846–3849. IEEE (2010)
Blunsom, P.: Hidden markov models. Lecture notes, pp. 18–19, 15 August 2004
HandTalk. https://www.handtalk.me/sobre
Savur, C., Sahin, F.: Real-time american sign language recognition system using surface EMG signal. In: 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA), pp. 497–502. IEEE, December 2015
Pugeault, N., Bowden, R.: Spelling it out: real-time ASL fingerspelling recognition. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1114–1119. IEEE, November 2011
Scalet, D., Yokohama, A., Koscianski, A., Rêgo, C.M., Asanome, C., Romero, D., Vostoupal, T.M.: ISO/IEC 9126 and 14598 integration aspects: a Brazilian viewpoint. In: The Second World Congress on Software Quality (2000)
Le Gall, J.F.: Random trees and applications. Probab. Surv. 2(245), 10–1214 (2005)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, pp. 1–511 (2001)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, Upper Saddle River (2004)
Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theor. 13(1), 21–27 (1967)
Rish, I.: An empirical study of the naive Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, vol. 3, pp. 41–46. IBM, New York (2001)
Steinwart, I., Christmann, A.: Support vector machines. In: Izenman, A.J. (ed.) Modern Multivariate Statistical Techniques: Regression, Classification, and Manifold Learning. Springer Texts in Statistics. Springer, New York (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Escudeiro, P., Escudeiro, N., Norberto, M., Lopes, J. (2017). VirtualSign Game Evaluation. In: Vaz de Carvalho, C., Escudeiro, P., Coelho, A. (eds) Serious Games, Interaction and Simulation. SGAMES 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 176. Springer, Cham. https://doi.org/10.1007/978-3-319-51055-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-51055-2_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51054-5
Online ISBN: 978-3-319-51055-2
eBook Packages: Computer ScienceComputer Science (R0)