Abstract
Establishing a clean relationship between a robot’s spatial model and natural language components is a non-trivial task, but is key to designing verbally controlled, navigating service robots. In this paper we examine the issues involved in the development of dialogue controlled navigating robots. In particular, we treat our robots as so-called Shared Control Systems, where robot and user cooperate to achieve a shared goal. We begin by characterising four categories of Shared Control Problems that affect verbally controlled navigating robots. Producing solutions to these problems requires a clear methodology in the linking of ’common-sense’ representations of space used by the robots, and the language interface. To this end, we present the SharC Cognitive Control Architecture as a general purpose, agent-based dialogue control system that provides a suitable framework for relating spatial information to natural language communication. To illustrate our approach, we focus in particular on natural language understanding, and show how natural language utterances may be mapped to formally modelled spatial concepts, thus helping to overcome problems in shared control.
We gratefully acknowledge the support of the Deutsche Forschungsgemeinschaft (DFG) through the Collaborative Research Centre SFB/TR 8 Spatial Cognition, Project I3-[SharC].
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Konolige, K., Myers, K.L., Ruspini, E.H., Saffiotti, A.: The Saphira Architecture: A Design for Autonomy. Journal of experimental & theoretical artificial intelligence: JETAI 9, 215–235 (1997)
Peters II, R.A., Wilkes, D., Gaines, D., Kawamura, K.: A software agent based control system for human-robot interaction. In: Proc. Second International Symposium on Humanoid Robotics, Tokyo, Japan (1999)
Allen, J., Ferguson, G., Stent, A.: An architecture for more realistic conversational systems. In: Proceedings of Intelligent User Interfaces 2001 (IUI 2001), Sante Fe, New Mexico, pp. 1–8. Association for Computing Machinery (2001)
Lemon, O., Gruenstein, A., Peters, S.: Collaborative activities and multi-tasking in dialogue systems. Traitement Automatique des Langues (TAL) 43, 131–154 (2002); Special issue on dialogue
Nilsson, N.J.: A mobile automaton: An application of artificial intelligence techniques. In: Walker, D.E., Norton, L.M. (eds.) Proceedings of the 1st International Joint Conference on Artificial Intelligence, pp. 509–520. William Kaufmann, Washington (1969)
Winograd, T.: Understanding Natural Languages, 2nd edn. Academic Press, New York (1976)
Matsui, T., Asoh, H., Fry, J., Motomura, Y., Asano, F., Kurita, T., Hara, I., Otsu, N.: Integrated Natural Spoken Dialogue System of Jijo-2 Mobile Robot for Office Services. In: AAAI/IAAI, pp. 621–627 (1999)
Bischoff, R., Jain, T.: Natural Communication and Interaction with Humanoid Robots. In: Proceedings of The Second International Symposium on Humanoid Robots, Tokyo, Japan (1999)
Roy, N., Pineau, J., Thrun, S.: Spoken Dialog Management for Robots. In: Proceedings of the ACL 2000 (2000)
Bugmann, G., Klein, E., Lauria, S., Kyriacou, T.: Corpus-Based Robotics: A Route Instruction Example. In: In Proceedings of IAS (2004)
Porzel, R., Gurevych, I.: Towards context adaptive utterance interpretation. In: Proceedings of the 3rd SIGDial Workshop on Discourse and Dialogue, Association for Computational Linguistics, Philadelphia (2002)
Bugmann, G.: Challenges in Verbal Instruction of Domestic Robots. In: Proceeding of the ASER 2003, the 1st International Workshop on Advances in Service Robotics (2003)
Stopp, E., Blocher, A.: Spatial information in instructions and questions to an autonomous system. Technical report, Universität des Saarlandes (1997)
Fong, T., Thorpe, C., Baur, C.: Collaboration, dialogue, and human-robot interaction. In: 10th Int’l Symp. of Robotics Research (2001)
Lankenau, A., Röfer, T.: A versatile and safe mobility assistant. IEEE Robotics and Automation Magazine 7, 29–37 (2001)
Copestake, A., Flickinger, D.P., Sag, I.A.: Minimal recursion semantics: An introduction. Stanford University: CSLI (1999) (Manuscript)
Starter, N., Woods, D.: How in the world did we ever get into that mode? mode error and awareness in supervisory control 37(1), 5–19 (1995)
Leveson, N., et al.: Analyzing software specifications for mode confusion potential. In: Johnson, C.W. (ed.) Workshop on Human Error and System Development, Glasgow Accident Analysis Group. GAAG-TR, vol. 97(2), pp. 132–146 (1997)
Degani, A., Heymann, M.: Pilot-autopilot interaction: A formal perspective. In: Abbott, K., Boy, S.J.J.,, G. (eds.) International Cnference on Human-Computer Interaction in Aeronautics: HCI-Aero 2000, pp. 157–168 (2000)
Rushby, J.: Using model checking to help discover mode confusions and other automation surprises. 75(2), 167–177 (2002)
Bredereke, J., Lankenau, A.: A rigouous view of mode confusion. In: Anderson, S., Bologna, S., Felici, M. (eds.) SAFECOMP 2002. LNCS, vol. 2434, p. 19. Springer, Heidelberg (2002)
Shi, H., Peleska, J., Kouvaras, M.: Combining methods for the analysis of a fault-tolerant system. In: Pacific Rim International Symposium on Dependable Computing (PRDC), pp. 135–142. IEEE Computer Society, Los Alamitos (1999)
Werner, S., Krieg-Brückner, B., Herrmann, T.: Modelling navigational knowledge by route graphs. In: Habel, C., Brauer, W., Freksa, C., Wender, K.F. (eds.) Spatial Cognition 2000. LNCS (LNAI), vol. 1849, pp. 295–317. Springer, Heidelberg (2000)
Krieg-Brückner, B., Frese, U., Lüttich, K., Mandel, C., Mossakowski, T., Ross, R.J.: Specification of route graphs via an ontology. In: Proceedings of Spatial Cognition 2004, Chiemsee, Germany (2004)
Smith, B., Grenon, P.: The cornucopia of formal-ontological relations (Technical report)
Krieg-Bruckner, B., Shi, H., Ross, R.: A safe and robust approach to shared-control via dialogue (Submitted to the Chinese Journal of Software, Beijing, China)
Ross, R., Collier, R., O’Hare, G. (af-apl): Bridging princples & practices in agent oriented languages. In: Bordini, R.H., Dastani, M.M., Dix, J., El Fallah Seghrouchni, A. (eds.) PROMAS 2004. LNCS (LNAI), vol. 3346, pp. 66–88. Springer, Heidelberg (2005)
Ross, R.: MARC - applying multiagent systems to service robot control. Master’s thesis, University College Dublin (2004)
Bateman, J., Farrar, S.: Spatial ontology baseline. SFB/TR8 internal report I1-(OntoSpace): D2, Collaborative Research Center for Spatial Cognition, Universität Bremen, Germany (2004)
Mossakowski, T., Lüttich, K., Kried-Brückner, B.: Ontologies for the semantic web in casl. Submitted to WADT 2004 (2004)
Bateman, J.A., Kasper, R.T., Moore, J.D., Whitney, R.A.: A general organization of knowledge for natural language processing: the PENMAN upper model. Technical report, USC/Information Sciences Institute, Marina del Rey, California (1990)
Schröder, M., Trouvain, J.: The German text-to-speech synthesis system MARY: A tool for research, development and teaching. In: Proceedings of the 4th ISCA Tutorial and Research Workshop on Speech Synthesis, Perthshire, Scotland, August 29 - September 1, pp. 131–136 (2001)
Just, M., Carpenter, P.: The psychology of reading and language comprehension. Allyn and Bacon, Boston (1987)
Shieber, S.M.: An Introduction to Unification Based Grammar. Center for the Study of Linguistics and Information (1986)
Kim, A.: Graded unification: A framework for interactive processing (1994)
Steedman, M.: The Syntactic Process. MIT Press, Cambridge (2000)
Joshi, A., Vijay-Shanker, W.D.: The convergence of mildly context-sensitive grammar formalisms. In: Sells, P., Shieber, S., Wasow, T. (eds.) Foundational Issues in Natural Language Processing, Cambridge, MA (1991)
Vierhuff, T., Hildebrandt, B., Eikmeyer, H.J.: Effiziente Verarbeitung deutscher Konstituentenstellung mit der Combinatorial Categorial Grammar. Linguistische Berichte 194, 213–237 (2003)
Bateman, J.A., Henschel, R., Rinaldi, F.: Generalized upper model 2.0: documentation. Technical report, GMD/Institut für Integrierte Publikations- und Informationssysteme, Darmstadt, Germany (1995)
Kasper, R., Whitney, R.: SPL: A sentence plan language for text generation. Technical Report forthcoming, Information Sciences Institute, 4676 Admiralty Way, Marina del Rey, California 90292-6695 (1989)
Moratz, R., Fischer, K., Tenbrink, T.: Cognitive modelling of spatial reference for human-robot interaction. International Journal On Artificial Intelligence Tools 10 (2001)
Bateman, J.A.: Enabling technology for multilingual natural language generation: the KPML development environment. Journal of Natural Language Engineering 3, 15–55 (1997)
Halliday, M.A.K.: An Introduction to Functional Grammar. Edward Arnold, London (1985) (2nd edn.1994)
Matthiessen, C.M.I.M., Bateman, J.A.: Text generation and systemic-functional linguistics: experiences from English and Japanese. Frances Pinter Publishers and St. Martin’s Press, London and New York (1991)
Teich, E., Hagen, E., Grote, B., Bateman, J.A.: From communicative context to speech: integrating dialogue processing, speech production and natural language generation. Speech Communication 21, 73–99 (1997)
Buth, B., Kouvaras, M., Peleska, J., Shi, H.: Deadlock analysis for a fault-tolerant system. In: Johnson, M. (ed.) AMAST 1997. LNCS, vol. 1349, pp. 60–75. Springer, Heidelberg (1997)
Buth, B., Peleska, J., Shi, H.: Livelock analysis for a fault-tolerant system. In: Haeberer, A.M. (ed.) AMAST 1998. LNCS, vol. 1548, pp. 124–135. Springer, Heidelberg (1998)
Holzmann, G.: Design and Validation of Computer Protocols. Prentice-Hall, Englewood Cliffs (1991)
Daws, C., Yovine, S.: Two examples of verification of multirate timed automated with kronos. In: 1995 IEEE Real-Time Systems Symposium, pp. 66–77. IEEE Computer Society Press, Los Alamitos (1995)
Henzinger, T., Nicollin, X., Sifakis, J., Yovine, S.: Symbolic model checking for real-time system. 111, 193–244 (1994)
McMillan, K.: Symbolic Model Checking: An Approach to the State Explosion Problem. Kluwer Academic Publishers, Dordrecht (1993)
daVinci: http://www.tzi.de/~davinci
Cycorp: Opencyc 0.7.0. Technical report (2004)
Niles, I., Pease, A.: Toward a standard upper ontology. In: Welty, C., Smith, B. (eds.) Proceedings of the 2nd International Conference on Formal Ontology in Information Systems (FOIS 2001). Association for Computing Machinery, Ogunquit (2001)
Masolo, C., Borgo, S., Gangemi, A., Guarino, N., Oltramari, A., Schneider, L.: The WonderWeb library of foundational ontologies: preliminary report. WonderWeb Deliverable D17, ISTC-CNR, Padova, Italy (2002)
Guarino, N.: The ontological level. In Casati, R., Smith, B., White, G., eds.: Philosophy and the Cognitive Sciences. Hölder-Pichler-Tempsky, Vienna (1994)
Bateman, J., Farrar, S.: Modelling models of robot navigation using formal spatial ontology. In: Proceedings of Spatial Cognition 2004, Chiemsee, Germany (2004)
Randell, D., Cui, Z., Cohn, A.: A spatial logic based on regions and connection. In: Proceedings of the 3rd. International Conference on Knowledge Representation and Reasoning, pp. 165–176. Morgan Kaufmann, San Mateo (1992)
Moratz, R., Wallgrün, J.O.: Spatial reasoning about relative orientation and distance for robot exploration. In: Kuhn, W., Worboys, M.F., Timpf, S. (eds.) COSIT 2003. LNCS, vol. 2825, pp. 61–74. Springer, Heidelberg (2003), http://www.springer.de
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ross, R.J., Shi, H., Vierhuff, T., Krieg-Brückner, B., Bateman, J. (2005). Towards Dialogue Based Shared Control of Navigating Robots. In: Freksa, C., Knauff, M., Krieg-Brückner, B., Nebel, B., Barkowsky, T. (eds) Spatial Cognition IV. Reasoning, Action, Interaction. Spatial Cognition 2004. Lecture Notes in Computer Science(), vol 3343. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-32255-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-32255-9_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25048-7
Online ISBN: 978-3-540-32255-9
eBook Packages: Computer ScienceComputer Science (R0)