Abstract
In the rapidly evolving field of virtual reality (VR), user experience issues in VR home interfaces are increasingly prominent as the user base expands. This study focuses on the VR home interface’s tab menu, the initial point of user interaction with the VR system, pivotal in shaping first impressions and user motivation. The prevalent design approach extends traditional 2D interface methodologies, notably in menu card feedback representations, crucial for user navigation and understanding of VR environments. However, replicating 2D designs in VR often falls short of user expectations and the unique spatial nature of VR interfaces, highlighting the need for optimized design methods tailored to VR’s interaction characteristics. This paper investigates user perceptions of different feedback representations in VR home interface menu cards. In a between-subjects experiment (N = 30), participants engaged with various feedback combinations in VR home interface menu cards and evaluated their experiences. Results indicate that while visual, auditory, and haptic feedback combination offers the highest immersion, the visual and auditory feedback mix scores best in user experience and usability, providing a balanced immersive experience. These findings suggest the visual-auditory combination as the optimal feedback representation for VR home interface menu selections, offering insights for future VR interface design.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bao, A., Wei, Q., Sun, Y.: Overview of research on the application of virtual reality to spatial cognitive ability. In: SHS Web of Conferences, vol. 145, p. 01018. EDP Sciences (2022)
Jianwu, Z., Hongju, K.: Application of virtual reality technology in practical training teaching. e-Educ. Res. (4), 109–112 (2010)
Hongbo, G.: Development status, issues and trends of China’s virtual reality industry. Mod. Commun. (J. Commun. Univ. China) 39(02), 8–12 (2017)
Yiyu, H.: A review of research on virtual reality applications in education. Chin. J. ICT Educ. 01, 11–16 (2018)
Burdea, G., Coiffet, P.: Virtual Reality Technology, 2nd edn., pp. 3–4. Wiley, New York (2003)
Manjoo, F.: How Google Taught Itself Good Design? International New York Times, NA-NA (2013)
Sagnier, C., Loup-Escande, E., Valléry, G.: Effects of gender and prior experience in immersive user experience with virtual reality. In: Ahram, T., Falcão, C. (eds.) Advances in Usability and User Experience. AISC, vol. 972, pp. 305–314. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-19135-1_30
Tong, Y., Liang, Y., Liu, Y., et al.: Integrating hedonic quality for user experience modelling. In: International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 85376: V002T02A052. American Society of Mechanical Engineers (2021)
Yi, D., Fu, G., Mingcai, H.: A review of domestic and international research on user experience. Ind. Eng. Manag. 19(04), 92–97+114 (2014)
Park, H., Jeong, S., Kim, T., et al.: Visual representation of gesture interaction feedback in virtual reality games. In: 2017 International Symposium on Ubiquitous Virtual Reality (ISUVR), pp. 20–23. IEEE (2017)
Franzluebbers, A., Johnsen, K.: Performance benefits of high-fidelity passive haptic feedback in virtual reality training. In: Proceedings of the 2018 ACM Symposium on Spatial User Interaction, pp. 16–24 (2018)
Matulic, F., Ganeshan, A., Fujiwara, H., et al.: Phonetroller: visual representations of fingers for precise touch input with mobile phones in VR. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2021)
Dirin, A.: User experience of mobile virtual reality: experiment on changes in students’ attitudes. Turk. Online J. Educ. Technol.-TOJET 19(3), 80–93 (2020)
Hao, F., Chuqi, Z., Weixi, L.: A study on the design of a virtual reality intervention game for children with ADHD. Chin. J. Ergon. 29(02), 1–7 (2023)
Chenglong, D., Ming, Z., Shu-Guang, K.: The effect of body tilt on the head-gaze interaction in virtual reality. Chin. J. Ergon. 28(04), 24–30+67 (2022)
Xiu, M., Wenjun, H., Yanan, X.: Digital innovation of intangible cultural heritage based on virtual reality technology. Packag. Eng. 43(16), 303–310+409 (2022)
Houran, Z.: Research on VR interface design based on emotional imagery. Nanjing Forestry University (2022)
Jiang, B., Zhao, Y.: Cognitive-psychology-based study on interactive design of preschool children’s picture books. In: Stephanidis, C. (ed.) HCI International 2018 – Posters’ Extended Abstracts. CCIS, vol. 852, pp. 59–64. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92285-0_9
Somrak, A., Pogačnik, M., Guna, J.: Suitability and comparison of questionnaires assessing virtual reality-induced symptoms and effects and user experience in virtual environments. Sensors 21(4), 1185 (2021)
Saidon, Z.L., Safian, A.R., Nasrifan, M.N.: Usability evaluation of a virtual reality interactive music appreciation module (E-Marz) for secondary school (2021)
Jiahui, L., Xiaoxiao, K., Yamin, W.: The reliability and validity of Chinese version of lgroup presence questionnaire. Chin. J. Ergon. 27(02), 39–44+80 (2021)
Sophie, G., Vincent, B.: Video games in adolescence and emotional functioning: emotion regulation, emotion intensity, emotion expression, and alexithymia. Comput. Hum. Behav. 61(5), 344–349 (2016)
Martinez-Hernandez, U., Boorman, L.W., Prescott, T.J.: Multisensory wearable interface for immersion and telepresence in robotics. IEEE Sens. J. 17(8), 2534–2541 (2017)
Chen, H., Dey, A., Billinghurst, M., Lindeman, R.W.: Exploring the design space for multi-sensory heart rate feedback in immersive virtual reality. In: Proceedings of the 29th Australian Conference on Computer-Human Interaction, OZCHI 2017, pp. 108–116. ACM, New York, NY, USA (2017)
Dey, A., Chen, H., Zhuang, C., Billinghurst, M., Lindeman, R.W.: Effects of sharing real-time multi-sensory heart rate feedback in different immersive collaborative virtual environments. In: 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 165–173. IEEE, October 2018
Santangelo, V., Ho, C., Spence, C.: Capturing spatial attention with multisensory cues. Psychon. Bull. Rev. 15, 398–403 (2008)
Acknowledgments
This paper is supported by the National Nature Science Foundation of China Grant No. 72201128, the China Postdoctoral Science Foundation No. 2023M730483 and the Collaborative Education Program of the Chinese Education Ministry No. 202102298009.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors have no competing interests relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, S., Zhang, J., Di, X., Xue, C. (2024). Research on the Multisensory Feedback Representation of the Menu Cards in VR Home Interface. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. HCII 2024. Lecture Notes in Computer Science, vol 14707. Springer, Cham. https://doi.org/10.1007/978-3-031-61044-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-61044-8_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-61043-1
Online ISBN: 978-3-031-61044-8
eBook Packages: Computer ScienceComputer Science (R0)