{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:56:52Z","timestamp":1740149812889,"version":"3.37.3"},"reference-count":38,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T00:00:00Z","timestamp":1606694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"RealTimeBattle is an environment in which robots controlled by programs fight each other. Programs control the simulated robots using low-level messages (e.g., turn radar, accelerate). Unlike other tools like Robocode, each of these robots can be developed using different programming languages. Our purpose is to generate, without human programming or other intervention, a robot that is highly competitive in RealTimeBattle. To that end, we implemented an Evolutionary Computation technique: Genetic Programming. The robot controllers created in the course of the experiments exhibit several different and effective combat strategies such as avoidance, sniping, encircling and shooting. To further improve their performance, we propose a function-set that includes short-term memory mechanisms, which allowed us to evolve a robot that is superior to all of the rivals used for its training. The robot was also tested in a bout with the winner of the previous \u201cRealTimeBattle Championship\u201d, which it won. Finally, our robot was tested in a multi-robot battle arena, with five simultaneous opponents, and obtained the best results among the contenders.<\/jats:p>","DOI":"10.3390\/e22121362","type":"journal-article","created":{"date-parts":[[2020,12,1]],"date-time":"2020-12-01T01:10:22Z","timestamp":1606785022000},"page":"1362","source":"Crossref","is-referenced-by-count":2,"title":["A Genetic Programming-Based Low-Level Instructions Robot for Realtimebattle"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5566-5382","authenticated-orcid":false,"given":"Juan","family":"Romero","sequence":"first","affiliation":[{"name":"CITIC-Research Center of Information and Communication Technologies, University of A Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Department of Computer Science and Information Technologies, Faculty of Communication Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3646-8145","authenticated-orcid":false,"given":"Antonino","family":"Santos","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2963-7318","authenticated-orcid":false,"given":"Adrian","family":"Carballal","sequence":"additional","affiliation":[{"name":"CITIC-Research Center of Information and Communication Technologies, University of A Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1412-5253","authenticated-orcid":false,"given":"Nereida","family":"Rodriguez-Fernandez","sequence":"additional","affiliation":[{"name":"CITIC-Research Center of Information and Communication Technologies, University of A Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Department of Computer Science and Information Technologies, Faculty of Communication Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4910-3890","authenticated-orcid":false,"given":"Iria","family":"Santos","sequence":"additional","affiliation":[{"name":"CITIC-Research Center of Information and Communication Technologies, University of A Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Department of Computer Science and Information Technologies, Faculty of Communication Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5774-927X","authenticated-orcid":false,"given":"Alvaro","family":"Torrente-Pati\u00f1o","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"given":"Juan","family":"Tu\u00f1as","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coru\u00f1a, Campus Elvi\u00f1a s\/n, 15071 A Coru\u00f1a, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6308-6484","authenticated-orcid":false,"given":"Penousal","family":"Machado","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), DEI, University of Coimbra, 3030-790 Coimbra, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,30]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Fogel, D.B. (2001). Blondie24: Playing at the Edge of AI, Elsevier.","key":"ref_1","DOI":"10.1016\/B978-155860783-5\/50016-7"},{"doi-asserted-by":"crossref","unstructured":"Nolfi, S., Floreano, D., and Floreano, D.D. (2000). Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines, MIT Press.","key":"ref_2","DOI":"10.7551\/mitpress\/2889.001.0001"},{"doi-asserted-by":"crossref","unstructured":"Vargas, P., Di Paolo, E., Harvey, I., and Husbands, P. (2014). The Horizons of Evolutionary Robotics, MIT Press.","key":"ref_3","DOI":"10.7551\/mitpress\/8493.001.0001"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1093\/icb\/ics107","article-title":"Darwin\u2019s Devices: What Evolving Robots can Teach Us about the History of Life and the Future of Technology. John Long","volume":"52","author":"Fish","year":"2012","journal-title":"Integr. Comp. Biol."},{"unstructured":"Fogel, L., Owens, A., and Walsh, M. (1966). Artificial Intelligence Through Simulated Evolution, Wiley.","key":"ref_5"},{"doi-asserted-by":"crossref","unstructured":"Fogel, D.B. (1998). Evolutionary Computation: The Fossil Record, Wiley-IEEE Press.","key":"ref_6","DOI":"10.1109\/9780470544600"},{"unstructured":"Fogel, D.B. (1999). Evolutionary Computation: Towards a New Philosophy of Machine Intelligence, Wiley-IEEE Press. [2nd ed.].","key":"ref_7"},{"unstructured":"Rechenberg, I. (1973). Evolutionsstrategie: Optimierung Technischer Systeme Nach Prinzipien Der Biologischen Evolution, Frommann\u2013Holzboog.","key":"ref_8"},{"unstructured":"Holland John, H. (1975). Adaptation in Natural and Artificial Systems, University of Michigan Press.","key":"ref_9"},{"unstructured":"Koza, J.R., and Koza, J.R. (1992). Genetic Programming: On the Programming of Computers by Means of Natural Selection, MIT Press.","key":"ref_10"},{"unstructured":"Koza, J.R. (1994). Genetic programming II: Automatic discovery of reusable subprograms, The MIT Press.","key":"ref_11"},{"doi-asserted-by":"crossref","unstructured":"Koza, J.R., Andre, D., Keane, M.A., and Bennett III, F.H. (1999). Genetic Programming III: Darwinian Invention and Problem Solving, Morgan Kaufmann.","key":"ref_12","DOI":"10.1109\/TEVC.1999.788530"},{"key":"ref_13","first-page":"95119","article-title":"Genetic programming and data structures: Genetic programming data structures automatic programming","volume":"Volume 1","author":"Langdon","year":"1998","journal-title":"WB (2000) Size Fair and Homologous Tree Crossovers for Tree Genetic Programming. Genet Program Evolvable Mach"},{"unstructured":"Banzhaf, W., Francone, F.D., Keller, R.E., and Nordin, P. (1998). Genetic Programming: An Introduction: On the Automatic Evolution of Computer Programs and Its Applications, Morgan Kaufmann Publishers Inc.","key":"ref_14"},{"unstructured":"Trudeau, A., and Clark, C.M. (2019). Multi-Robot Path Planning Via Genetic Programming. arXiv.","key":"ref_15"},{"unstructured":"Bi, Y., Bhatia, R., and Kapoor, S. (2020). Automation of Synthesized Optimal Control Problem Solution for Mobile Robot by Genetic Programming. Intelligent Systems and Applications, Springer International Publishing.","key":"ref_16"},{"key":"ref_17","first-page":"205","article-title":"Cartesian Genetic Programming for Synthesis of Optimal Control System","volume":"Volume 2","author":"Arai","year":"2021","journal-title":"Proceedings of the Future Technologies Conference (FTC) 2020"},{"doi-asserted-by":"crossref","unstructured":"Macedo, J., Marques, L., and Costa, E. (2017, January 26\u201328). Robotic odour search: Evolving a robot\u2019s brain with Genetic Programming. Proceedings of the 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Coimbra, Portugal.","key":"ref_18","DOI":"10.1109\/ICARSC.2017.7964058"},{"doi-asserted-by":"crossref","unstructured":"Diveev, A. (2020, January 15\u201318). Cartesian Genetic Programming for Synthesis of Control System for Group of Robots. Proceedings of the 2020 28th Mediterranean Conference on Control and Automation (MED), Saint-Rapha\u00ebl, France.","key":"ref_19","DOI":"10.1109\/MED48518.2020.9183180"},{"doi-asserted-by":"crossref","unstructured":"Kilyen, A.O., and Letia, T.S. (2018, January 24\u201326). Hybrid robot controller synthesis with GP and UETPN. Proceedings of the 2018 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR), Cluj-Napoca, Romania.","key":"ref_20","DOI":"10.1109\/AQTR.2018.8402728"},{"unstructured":"Ouchterlony, E., and Ouchterlony, R. (2020, January 12). Realtimebattle User Manual, Version 1.0.8. Available online: http:\/\/realtimebattle.sourceforge.net\/Documentation\/RealTimeBattle.html.","key":"ref_21"},{"unstructured":"Eisenstein, J. (2003). Evolving Robocode Tank Fighters, MIT Press.","key":"ref_22"},{"doi-asserted-by":"crossref","unstructured":"Kaelbling, L. (1987, January 7\u20139). Rex-A symbolic language for the design and parallel implementation of embedded systems. Proceedings of the 6th Computers in Aerospace VI Conference, Wakefield, MA, USA.","key":"ref_23","DOI":"10.2514\/6.1987-2822"},{"unstructured":"Gade, M., Knudsen, M., Kj\u00e6r, R., Christensen, T., Larsen, C., Pedersen, M., and Andersen, J. (2003). Applying Machine Learning to Robocode, Aalborg University.","key":"ref_24"},{"doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Introduction to Reinforcement Learning, MIT Press.","key":"ref_25","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1145\/367177.367199","article-title":"Recursive Functions of Symbolic Expressions and Their Computation by Machine, Part I","volume":"3","author":"McCarthy","year":"1960","journal-title":"Commun. ACM"},{"unstructured":"Hong, J.H., and Cho, S.B. (2004, January 19\u201323). Evolution of emergent behaviors for shooting game characters in robocode. Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No. 04TH8753), Portland, OR, USA.","key":"ref_27"},{"unstructured":"Li, S. (2011, June 02). Rock em, sock em Robocode. Available online: http:\/\/www.ibm.com\/developerworks\/java\/library\/jrobocode\/.","key":"ref_28"},{"doi-asserted-by":"crossref","unstructured":"Shichel, Y., Ziserman, E., and Sipper, M. (2005). GP-robocode: Using genetic programming to evolve robocode players. European Conference on Genetic Programming, Springer.","key":"ref_29","DOI":"10.1007\/978-3-540-31989-4_13"},{"unstructured":"Sipper, M. (2020, January 12). Evolved to Win; Lulu: 2011. Available online: https:\/\/www.moshesipper.com\/evolved-to-win.html.","key":"ref_30"},{"doi-asserted-by":"crossref","unstructured":"Nidorf, D.G., Barone, L., and French, T. (2010, January 5\u20138). A comparative study of NEAT and XCS in Robocode. Proceedings of the IEEE Congress on Evolutionary Computation, New Orleans, LA, USA.","key":"ref_31","DOI":"10.1109\/CEC.2010.5586087"},{"doi-asserted-by":"crossref","unstructured":"Harper, R. (2011, January 12\u201316). Co-evolving Robocode tanks. Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, Dublin, Ireland.","key":"ref_32","DOI":"10.1145\/2001576.2001770"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1109\/4235.942529","article-title":"Grammatical evolution","volume":"5","author":"Ryan","year":"2001","journal-title":"IEEE Trans. Evol. Comput."},{"doi-asserted-by":"crossref","unstructured":"Harper, R. (2010, January 18\u201323). Spatial co-evolution in age layered planes (SCALP). Proceedings of the IEEE Congress on Evolutionary Computation, Barcelona, Spain.","key":"ref_34","DOI":"10.1109\/CEC.2010.5586342"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1007\/s10710-014-9224-2","article-title":"Evolving Robocode tanks for Evo Robocode","volume":"15","author":"Harper","year":"2014","journal-title":"Genet. Program. Evolvable Mach."},{"key":"ref_36","first-page":"43","article-title":"Recent patents on genetic programming","volume":"2","author":"Brabazon","year":"2009","journal-title":"Recent Patents Comput. Sci. (Discontin.)"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/s10404-014-1434-7","article-title":"Computational models in microfluidic bubble logic","volume":"18","author":"Anandan","year":"2014","journal-title":"Microfluid. Nanofluidics"},{"doi-asserted-by":"crossref","unstructured":"Gagliano, S., Cairone, F., Amenta, A., and Bucolo, M. (2019). A Real Time Feed Forward Control of Slug Flow in Microchannels. Energies, 12.","key":"ref_38","DOI":"10.3390\/en12132556"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/12\/1362\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,6]],"date-time":"2024-07-06T01:48:26Z","timestamp":1720230506000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/12\/1362"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,30]]},"references-count":38,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["e22121362"],"URL":"https:\/\/doi.org\/10.3390\/e22121362","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,11,30]]}}}