Abstract
In mobile contexts, the consideration of the usage situation is important for the usability and user experience of interactive systems. When developing passenger communication systems for public transportation, it is therefore particularly relevant to take context-specific situations into account. This paper shows the challenge of designing context-specific test environments for mobile areas and analyzes their influence on user engagement and user-centered test results. Therefore, a user study with 24 participants in two independent test groups is conducted in a standard usability test environment and a context-specific test environment. In addition to single items related to the test environment, the quantitative analysis primarily reveals correlations between user engagement and the user-centered results. In contrast, the qualitative analysis, identifies differences in the content of user interactions for different situations and the resulting usability problems. In this way, the study confirms the assumption that context-specific environmental elements influence test quality, in particular for emergency situations and highly situational user needs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
https://bmdv.bund.de/SharedDocs/DE/Artikel/DG/AVF-projekte/oev-leitmotif-ki.html (German), Accessed March 2024.
- 2.
https://easymile.com/vehicle-solutions/ez10-passenger-shuttle, Accessed March 2024.
References
Andrzejczak, C., Liu, D.: The effect of testing location on usability testing performance, participant stress levels, and subjective testing experience. J. Syst. Softw. 83(7), 1258–1266 (2010). https://doi.org/10.1016/j.jss.2010.01.052
Brooke, J.: SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995)
Duh, H.B.L., Tan, G.C., Chen, V.H.h.: Usability evaluation for mobile device: a comparison of laboratory and field tests. In: Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 181–186 (2006)
Karat, J.: Chapter 28 - User-centered software evaluation methodologies. In: Helander, M.G., Landauer, T.K., Prabhu, P.V. (eds.) Handbook of Human-Computer Interaction, 2nd edn., pp. 689–704. North-Holland, Amsterdam (1997). https://doi.org/10.1016/B978-044481862-1.50094-7, https://www.sciencedirect.com/science/article/pii/B9780444818621500947
Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire, vol. 5298, pp. 63–76 (Nov 2008). https://doi.org/10.1007/978-3-540-89350-9_6
Lengkong, C.R., Mayas, C., Krömker, H., Hirth, M.: The development of human-centered design in public transportation: a literature review. In: International Conference on Human-Computer Interaction. Springer (2024)
Mayas, C., Hörold, S., Rosenmöller, C., Krömker, H.: Evaluating methods and equipment for usability field tests in public transport. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8510, pp. 545–553. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07233-3_50
Nielsen, J.: Severity Ratings for Usability Problems: Article by Jakob Nielsen (Nov 1994). https://www.nngroup.com/articles/how-to-rate-the-severity-of-usability-problems/
Regenbrecht, H.: Factors for the sense of presence within virtual architecture. doctoralthesis, Bauhaus-Universität Weimar (2004). https://doi.org/10.25643/bauhaus-universitaet.33
Rowley, D.E.: Usability testing in the field: bringing the laboratory to the user. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 252–257 (1994)
Salzman, M.C., David Rivers, S.: Smoke and mirrors: Setting the stage for a successful usability test. Behav. Inform. Technol. 13(1–2), 9–16 (1994)
Schnöll, P.: User-oriented cockpits for automated driving: a framework for the technical specification of test environments. TU Ilmenau (2022)
Sonderegger, A., Sauer, J.: The influence of laboratory set-up in usability tests: effects on user performance, subjective ratings and physiological measures. Ergonomics 52(11), 1350–1361 (2009)
Sun, X., May, A.: A comparison of field-based and lab-based experiments to evaluate user experience of personalised mobile devices. Adv. Hum.-Comput. Interact. 2013, 2–2 (2013)
Acknowledgments
Parts of this work were funded by the German Federal Ministry for Digital and Transport (BMDV) grant number 45AVF3004G within the project OeV-LeitmotiF-KI.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mayas, C., Steinert, T., Reif, B., Krömker, H., Hirth, M. (2024). Pimp My Lab? The Impact of Context-Specific Usability Laboratory Environments in Public Transport. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. HCII 2024. Lecture Notes in Computer Science, vol 14733. Springer, Cham. https://doi.org/10.1007/978-3-031-60480-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-60480-5_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60479-9
Online ISBN: 978-3-031-60480-5
eBook Packages: Computer ScienceComputer Science (R0)