Abstract
Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The model, implemented in C++, can be downloaded from https://github.com/gfrances/model-based-social-simulations/releases/tag/eumas2014.
References
Axelrod, R.: An evolutionary approach to norms. Am. Polit. Sci. Rev. 80(4), 1095–1111 (1986)
Bandini, S., Manzoni, S., Vizzari, G.: Agent based modeling and simulation: an informatics perspective. J. Artifi. Soc. Soc. Simul. 12(4), 4 (2009). http://jasss.soc.surrey.ac.uk/12/4/4.html
Bonet, B., Geffner, H.: Action selection for MDPs: anytime AO* versus UCT. In: Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (2012)
Boutilier, C., Dean, T., Hanks, S.: Decision-theoretic planning: structural assumptions and computational leverage. J. Artif. Intell. Res. 1, 1–93 (1999)
Browne, C.B., Powley, E., Whitehouse, D., Lucas, S.M., Cowling, P.I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., Colton, S.: A survey of monte carlo tree search methods. IEEE Trans. Comput. Intell. AI. Games 4(1), 1–43 (2012)
Epstein, J.M.: Generative Social Science: Studies in Agent-Based Computational Modeling. Princeton University Press, Princteon (2006)
Epstein, J.M., Axtell, R.: Growing Artificial Societies: Social Science From the Bottom Up. Brookings Institution Press, Washington, D.C. (1996)
Geffner, H., Bonet, B.: A concise introduction to models and methods for automated planning. Synt. Lect. Artif. Intell. Mach. Learn. 8(1), 1–141 (2013)
Kocsis, L., Szepesvári, C.: Bandit based monte-carlo planning. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS (LNAI), vol. 4212, pp. 282–293. Springer, Heidelberg (2006)
Lake, M.: Trends in archaeological simulation. J. Archaeol. Meth. Theory 21(2), 258–287 (2014)
Legendre, P.: Spatial autocorrelation: trouble or new paradigm? Ecology 74(6), 1659–1673 (1993)
Newell, A., Shaw, J.C., Simon, H.A.: Report on a general problem-solving program. In: Proceeding of the International Conference on Information Processing, pp. 256–264 (1959)
O’Sullivan, D.: Complexity science and human geography. Trans. Inst. Br. Geogr. 29(3), 282–295 (2004)
Papadimitriou, C.H., Yannakakis, M.: On complexity as bounded rationality. In: Proceeding of the 26th ACM Symposium on Theory of Computing, pp. 726–733 (1994)
Pebesma, E.J.: Multivariable geostatistics in S: the gstat package. Comput. Geosci. 30, 683–691 (2004)
R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2008). http://www.R-project.org, ISBN: 3-900051-07-0
Rubio-Campillo, X.: Pandora: a versatile ABM platform for social simulation. In: Sixth International Conference on Advances in System Simulation. IARIA (2014)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall, Englewood Cliffs (2010)
Schelling, T.C.: Dynamic models of segregation. J. Math. Sociol. 1(2), 143–186 (1971)
Tesfatsion, L.: Agent-based computational economics: a constructive approach to economic theory. In: Handbook of Computational Economics, vol. 2, pp. 831–880 (2006)
Wellman, M.P.: Putting the agent in Agent-Based Modeling (2014). http://web.eecs.umich.edu/srg/wp-content/uploads/2014/08/transcript.pdf, talk from the 13th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2014)
Acknowledgments
This research is part of the SimulPast Project (CSD2010-00034) funded by the CONSOLIDER-INGENIO2010 program of the Spanish Ministry of Science and Innovation. The implementation of MDP agents relies on Blai Bonet’s mdp-engine library (Available at https://code.google.com/p/mdp-engine/, the implementation of the UCT algorithm that we use is described in [3]). Resource maps were generated using the R statistical environment [16] and gstat package for geostatistical analysis [15].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Francès, G., Rubio-Campillo, X., Lancelotti, C., Madella, M. (2015). Decision Making in Agent-Based Models. In: Bulling, N. (eds) Multi-Agent Systems. EUMAS 2014. Lecture Notes in Computer Science(), vol 8953. Springer, Cham. https://doi.org/10.1007/978-3-319-17130-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-17130-2_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-17129-6
Online ISBN: 978-3-319-17130-2
eBook Packages: Computer ScienceComputer Science (R0)