Abstract
We examine the possibilities of conversation analysis (CA) in usability testing. The goal is to examine how usability test setups serve as source for the CA analysis. We used video data from two earlier usability tests. Our results indicate that traditional test setup does not serve as a sufficient source for CA. The actions in the user interface were unclear, the user’s facial reactions were not visible, and the user is occasionally having more conversation with the moderator than the system. CA approach can be taken towards two separate directions regarding usability tests: Analysis can be focused to the dialogue between the moderator and the user or on the user-system interaction. There is a need to fine-tune data gathering with detailed level recording of keypresses and system outputs. However, CA-enhanced usability testing allows in-depth analysis of usability problems as well as analysis of holistic interaction between user and system.
Chapter PDF
Similar content being viewed by others
References
Bias, R., Mayhew, D.: Cost-justifying usability. Academic Press, Boston (1994)
Nielsen, J.: Usability Engineering. Academic Press, London (1993)
Riihiaho, S.: Experiences with usability evaluation menthods. Licentiate’s thesis. Helsinki University of Technology, Department of computer science and engineering (2000)
Koivunen, M., Nieminen, M., Riihiaho, S.: Launching the Usability Approach: Experience at Helsinki University of Technology. SIGCHI Bulletin 27(2), 54–60 (1995)
Nieminen, M., Koivunen, M.R.: Visual Walkthrough. In: Allen, G., Wilkinson, J., Wright, P. (eds.) HCI 1995, People and Computers, Adjunct Proceedings. The School of Computing & Mathematics, The University of Huddersfield, pp. 86–89 (1995)
Nieminen, M.P.: Designing user interface concepts for multimedia services. Master’s thesis, Helsinki University of Technology (1996)
Gomoll, K., Nicol, A.: Discussion of guidelines for user observation. User Observation: Guidelines for Apple Developers (1990)
Goodwin, C., Heritage, J.: Conversation Analysis. Annual Review of Anthropology 19, 283–307 (1990)
Goodwin, C.: Action and embodiment within situated human interaction. Journal of Pragmatics 32(10), 1489–1522 (2000)
Have, P.T.: Doing conversation analysis: a practical guide. Sage, London (1999)
Atkinson, M., Heritage, J.: Structures of social action: Studies in conversation analysis. Cambridge University Press, Cambridge (1984)
Karjalainen, S.: Multimodal Resources in Co - Constructing Topical Flow: Case of “Father’s Foot”. In: Esposito, A., Bratanic, M., Keller, E., Marinaro, M. (eds.) Fundamentals of verbal and nonverbal communication and the biometrical issue. IOS press, The Netherlands (2007)
Suchman, L.: Human-Machine Reconfigurations: Plans and Situated Actions, 2nd edn. Cambridge University press, Cambridge (2007)
Luff, P., Gilbert, G.N., Frohlich, D.M. (eds.): Computers and conversation. Academic Press, London (1990)
Button, G., Sharrock, W.: On simulacrums of conversation: toward a clarification of the relevance of conversation analysis for human-computer interaction. In: Thomas, P. (ed.) The Social and Interactional Dimensions of HumanComputer Interfaces, pp. 107–125. Cambridge University Press, Cambridge (1995)
Luff, P., Hindmarsh, J., Heath, C.C. (eds.): Workplace Studies: Recovering work practice and informing system design. Cambridge University Press, Cambridge (2000)
Woodruff, A., Aoki, P.M.: Conversation analysis and user experience. Digital Creativity 15(4), 232–238 (2004)
Dumas, J., Loring, B.: Moderating usability tests: Principles and practices for interacting. Morgan Kaufmann/ Elsevier (2008)
Raudaskoski, P.: Repair work in human computer interaction. In: Luff, P., Gilbert, G.N., Frohlich, D.M. (eds.) Computers and conversation, pp. 151–172. Academic Press, London (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nieminen, M., Karjalainen, S., Riihiaho, S., Mannonen, P. (2009). Towards Fine-Grained Usability Testing: New Methodological Directions with Conversation Analysis. In: Kurosu, M. (eds) Human Centered Design. HCD 2009. Lecture Notes in Computer Science, vol 5619. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02806-9_101
Download citation
DOI: https://doi.org/10.1007/978-3-642-02806-9_101
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02805-2
Online ISBN: 978-3-642-02806-9
eBook Packages: Computer ScienceComputer Science (R0)