{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,9,15]],"date-time":"2022-09-15T19:31:09Z","timestamp":1663270269249},"reference-count":7,"publisher":"World Scientific Pub Co Pte Lt","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Bifurcation Chaos"],"published-print":{"date-parts":[[2006,10]]},"abstract":" Reinforcement learning is usually required in the process of trial and error called exploration, and the uniform pseudorandom number generator is considered effective in that process. As a generator for the exploration, chaotic sources are also useful in creating a random-like sequence such as in the case of stochastic sources. In this research, we investigate the efficiency of the deterministic chaotic generator for the exploration in learning a nonstationary shortcut maze problem. As a result, it is found that the deterministic chaotic generator based on the logistic map is better in the performance of the exploration than in the stochastic random generator. This has been made clear by analyzing the difference of the performances between the two generators in terms of the patterns of exploration occurrence. We also examine the tent map, which is homeomorphic to the logistic map, compared with other generators. <\/jats:p>","DOI":"10.1142\/s0218127406016616","type":"journal-article","created":{"date-parts":[[2006,12,8]],"date-time":"2006-12-08T06:26:15Z","timestamp":1165559175000},"page":"3015-3022","source":"Crossref","is-referenced-by-count":3,"title":["CHAOTIC EXPLORATION EFFECTS ON REINFORCEMENT LEARNING IN SHORTCUT MAZE TASK"],"prefix":"10.1142","volume":"16","author":[{"given":"KOICHIRO","family":"MORIHIRO","sequence":"first","affiliation":[{"name":"Hyogo University of Teacher Education, Hyogo 673-1494, Japan"},{"name":"Himeji Institute of Technology, Hyogo 671-2201, Japan"}]},{"given":"NOBUYUKI","family":"MATSUI","sequence":"additional","affiliation":[{"name":"Himeji Institute of Technology, Hyogo 671-2201, Japan"},{"name":"Graduate School of Engineering, University of Hyogo, Hyogo 671-2201, Japan"}]},{"given":"HARUHIKO","family":"NISHIMURA","sequence":"additional","affiliation":[{"name":"Graduate School of Applied Informatics, University of Hyogo, Hyogo 650-0044, Japan"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"rf3","volume-title":"Coping with Chaos: Analysis of Chaotic Data and the Exploitation of Chaotic Systems","author":"Ott E.","year":"1998"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-3486-9"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1142\/S0129183100001309"},{"key":"rf7","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"rf9","volume-title":"Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches","author":"Thrun S. B.","year":"1992"},{"key":"rf11","first-page":"279","volume":"8","author":"Watkins C.","journal-title":"Mach. Learn."}],"container-title":["International Journal of Bifurcation and Chaos"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218127406016616","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T11:04:14Z","timestamp":1565175854000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218127406016616"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,10]]},"references-count":7,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[2006,10]]}},"alternative-id":["10.1142\/S0218127406016616"],"URL":"https:\/\/doi.org\/10.1142\/s0218127406016616","relation":{},"ISSN":["0218-1274","1793-6551"],"issn-type":[{"value":"0218-1274","type":"print"},{"value":"1793-6551","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,10]]}}}