Abstract
Anticipation is one of the key aspects involved in flexible and adaptive behavior. The ability for an autonomous agent to extract a relevant model of its coupling with the environment and of the environment itself can provide it with a strong advantage for survival. In this work we develop an event-based anticipation framework for performing latent learning and we provide two mathematical tools to identify relevant relationships between events. These tools allow us to build a predictive model which is then embedded in an action-selection architecture to generate adaptive behavior. We first analyze some of the properties of the model in simple learning tasks. Its efficiency is evaluated in a more complex task where the agent has to adapt to a changing environment. In the last section we discuss extensions of the model presented.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Butz, M.V., Sigaud, O., Gérard, P.: Internal models and anticipations in adaptive learning systems. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, Springer, Heidelberg (2003)
Capdepuy, P., Polani, D., Nehaniv, C.L.: Construction of an internal predictive model by event anticipation. In: Proc. of the 3rd Workshop on Anticipatory Behavior in Adaptive Learning Systems (2006)
Nehaniv, C.L., Polani, D., Dautenhahn, K., te Beokhorst, R., Cañamero, L.: Meaningful information, sensor evolution, and the temporal horizon of embodied organisms. In: ICAL 2003: Proc. of the 8th int. conf. on Art. life, pp. 345–349. MIT Press, Cambridge (2003)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998), citeseer.ist.psu.edu/sutton98reinforcement.html
Tolman, E.C., Honzik, E.C.: “insight” in rats. University of California Publications in Psychology 4, 215–232 (1930)
Waddell, J., Dzakpasu, R., Booth, V., Riley, B., Reasor, J., Poe, G., Zochowski, M.: Causal entropies-a measure for determining changes in the temporal organization of neural systems. J. Neurosci. Methods (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Capdepuy, P., Polani, D., Nehaniv, C.L. (2007). Grounding Action-Selection in Event-Based Anticipation. In: Almeida e Costa, F., Rocha, L.M., Costa, E., Harvey, I., Coutinho, A. (eds) Advances in Artificial Life. ECAL 2007. Lecture Notes in Computer Science(), vol 4648. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74913-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-74913-4_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74912-7
Online ISBN: 978-3-540-74913-4
eBook Packages: Computer ScienceComputer Science (R0)