Abstract
We describe the recording and annotation of a corpus of role-playing dialogues in the domain of the COMIC multimodal dialogue system. We give some generalisations about the use of deictic gesture in this task, and show how those findings are currently used in the presentation-planning module of the dialogue system prototype. Finally, we describe how the use of gestures in the system will be evaluated, and outline the next steps in the development of the module.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
COMIC project: Homepage, http://www.hcrc.ed.ac.uk/comic/
den Os, E., Boves, L.: Towards ambient intelligence: Multimodal computers that understand our intentions. In: Proceedings of eChallenges e-2003 (2003)
Foster, M.E.: Description of Wizard of Oz recordings. Deliverable 6.4, COMIC project (2003)
Kipp, M.: Anvil homepage, http://www.dfki.de/~kipp/anvil/
de Ruiter, J.P.: The production of gesture and speech. In: McNeill, D. (ed.) Language and Gesture, pp. 284–311. Cambridge University Press, Cambridge (2000)
Kranstedt, A., Kühnlein, P., Wachsmuth, I.: Deixis in multimodal human computer interaction: An interdisciplinary approach. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 112–123. Springer, Heidelberg (2004)
Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH 2001, pp. 477–486 (2001)
Wachsmuth, I., Kopp, S.: Lifelike gesture synthesis and timing for conversational agents. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 120–133. Springer, Heidelberg (2002)
Kopp, S., Wachsmuth, I.: Model-based animation of coverbal gesture. In: Proceedings of Computer Animation 2002, pp. 252–257 (2002)
Cunningham, D.W., de Ruiter, J.P.: Research on modality effects in mutual trust and interactive comfort. Deliverable 2.4, COMIC project (2003)
Varges, S., Mellish, C.: Instance-based natural language generation. In: Proceedings of NAACL 2001 (2001)
Hunt, A.J., Black, A.W.: Unit selection in a concatenative speech synthesis system using a large speech database. In: Proceedings of ICASS 1996, vol. 1, pp. 373–376 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Foster, M.E. (2004). Corpus-Based Planning of Deictic Gestures in COMIC. In: Belz, A., Evans, R., Piwek, P. (eds) Natural Language Generation. INLG 2004. Lecture Notes in Computer Science(), vol 3123. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27823-8_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-27823-8_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22340-5
Online ISBN: 978-3-540-27823-8
eBook Packages: Springer Book Archive