Abstract
In this paper, a decentralised self-organisation mechanism in an agent network is proposed. The aim of this mechanism is to achieve efficient task allocation in the agent network via dynamically altering the structural relations among agents, i.e. changing the underlying network structure. The mechanism enables agents in the network to reason with whom to adapt relations and to learn how to adapt relations by using only local information. The local information is accumulated from agents’ historical interactions with others. The proposed mechanism is evaluated through a comparison with a centralised allocation method and the K-Adapt method. Experimental results demonstrate the decent performance of the proposed mechanism in terms of several evaluation criteria.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Serugendo, G.D.M., Gleizes, M.P., Karageorgos, A.: Self-organization in multi-agent systems. The Knowledge Engineering Review 20(2), 165–189 (2005)
Mathieu, P., Routier, J.C., Secq, Y.: Principles for dynamic multi-agent organizations. In: Kuwabara, K., Lee, J. (eds.) PRIMA 2002. LNCS (LNAI), vol. 2413, pp. 109–122. Springer, Heidelberg (2002)
Horling, B., Benyo, B., Lesser, V.: Using self-diagnosis to adapt organizational structures. In: AGENTS 2001, Montreal, Quebec, Canada, pp. 529–536 (May 2001)
Hoogendoorn, M.: Adaptation of organizational models for multi-agent systems based on max flow networks. In: IJCAI 2007, Hyderabad, India, pp. 1321–1326 (January 2007)
Kamboj, S., Decker, K.S.: Organizational self-design in semi-dynamic environments. In: AAMAS 2007, Honolulu, Hawai’i, USA, pp. 1228–1235 (May 2007)
Gaston, M.E., des Jardins, M.: Agent-organized networks for dynamic team formation. In: AAMAS 2005, Utrecht, Netherlands, pp. 230–237 (July 2005)
Glinton, R., Sycara, K., Scerri, P.: Agent organized networks redux. In: AAAI 2008, Chicago, Illinois, USA, pp. 83–88 (July 2008)
Abdallah, S., Lesser, V.: Multiagent reinforcement learning and self-organization in a network of agents. In: AAMAS 2007, Honolulu, Hawai’i, USA, pp. 172–179 (May 2007)
Kota, R., Gibbins, N., Jennings, N.R.: Decentralised structural adaptation in agent organisations. In: AAMAS 2008 Workshop on Organized Adaption in Multi-Agent Systems, Estoril, Portugal, pp. 1–16 (May 2008)
Kota, R., Gibbins, N., Jennings, N.R.: Self-organising agent organisations. In: AAMAS 2009, Budapest, Hungary, pp. 797–804 (May 2009)
Xu, Y., Scerri, P., Yu, B., Okamoto, S., Lewis, M., Sycara, K.: An integrated token-based algorithm for scalable coordination. In: AAMAS 2005, Utrecht, Netherlands, pp. 407–414 (July 2005)
Gomes, E.R., Kowalczyk, R.: Dynamic analysis of multiagent q-learning with e-greedy exploration. In: ICML 2009, Montreal, Canada, pp. 369–376 (June 2009)
Watts, D.J., Strogatz, S.H.: Collective dynamics of ‘small-world’ networks. Nature 393, 440–442 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ye, D., Zhang, M., Bai, Q., Ito, T. (2010). Self-organisation in an Agent Network via Multiagent Q-Learning. In: Kang, BH., Richards, D. (eds) Knowledge Management and Acquisition for Smart Systems and Services. PKAW 2010. Lecture Notes in Computer Science(), vol 6232. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15037-1_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-15037-1_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15036-4
Online ISBN: 978-3-642-15037-1
eBook Packages: Computer ScienceComputer Science (R0)