{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T16:47:08Z","timestamp":1733330828325,"version":"3.30.1"},"update-to":[{"updated":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T00:00:00Z","timestamp":1674086400000},"DOI":"10.1371\/journal.pcbi.1010829","type":"new_version","label":"New version"}],"reference-count":89,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["945539"],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["820213"],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"When faced with navigating back somewhere we have been before we might either retrace our steps or seek a shorter path. Both choices have costs. Here, we ask whether it is possible to characterize formally the choice of navigational plans as a bounded rational<\/jats:italic> process that trades off the quality of the plan (e.g., its length) and the cognitive cost required to find and implement it. We analyze the navigation strategies of two groups of people that are firstly trained to follow a \"default policy\" taking a route in a virtual maze and then asked to navigate to various known goal destinations, either in the way they want (\"Go To Goal\") or by taking novel shortcuts (\"Take Shortcut\"). We address these wayfinding problems using InfoRL: an information-theoretic approach that formalizes the cognitive cost of devising a navigational plan, as the informational cost to deviate from a well-learned route (the \"default policy\"). In InfoRL, optimality refers to finding the best trade-off between route length and the amount of control information required to find it. We report five main findings. First, the navigational strategies automatically identified by InfoRL correspond closely to different routes (optimal or suboptimal) in the virtual reality map, which were annotated by hand in previous research. Second, people deliberate more in places where the value of investing cognitive resources (i.e., relevant goal information) is greater. Third, compared to the group of people who receive the \"Go To Goal\" instruction, those who receive the \"Take Shortcut\" instruction find shorter but less optimal solutions, reflecting the intrinsic difficulty of finding optimal shortcuts. Fourth, those who receive the \"Go To Goal\" instruction modulate flexibly their cognitive resources, depending on the benefits of finding the shortcut. Finally, we found a surprising amount of variability in the choice of navigational strategies and resource investment across participants. Taken together, these results illustrate the benefits of using InfoRL to address navigational planning problems from a bounded rational perspective.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010829","type":"journal-article","created":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T18:56:32Z","timestamp":1673031392000},"page":"e1010829","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":10,"title":["Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8773-1727","authenticated-orcid":true,"given":"Gian Luca","family":"Lancia","sequence":"first","affiliation":[]},{"given":"Mattia","family":"Eluchans","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3596-5780","authenticated-orcid":true,"given":"Marco","family":"D\u2019Alessandro","sequence":"additional","affiliation":[]},{"given":"Hugo J.","family":"Spiers","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6813-8282","authenticated-orcid":true,"given":"Giovanni","family":"Pezzulo","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2023,1,6]]},"reference":[{"issue":"10","key":"pcbi.1010829.ref001","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1038\/s43588-021-00130-y","article-title":"Vector-based pedestrian navigation in cities","volume":"1","author":"C Bongiorno","year":"2021","journal-title":"Nat Comput Sci.Oct"},{"issue":"1","key":"pcbi.1010829.ref002","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/hipo.23395","article-title":"London taxi drivers: A review of neurocognitive studies and an exploration of how they build their cognitive map of London.","volume":"32","author":"EM Griesbauer","year":"2022","journal-title":"Hippocampus"},{"issue":"1","key":"pcbi.1010829.ref003","doi-asserted-by":"crossref","first-page":"3299","DOI":"10.1038\/s41598-020-60302-0","article-title":"Large-scale assessment of human navigation ability across the lifespan.","volume":"10","author":"IJM van der Ham","year":"2020","journal-title":"Sci Rep."},{"key":"pcbi.1010829.ref004","article-title":"Exploration patterns shape cognitive map learning [Internet]","author":"I Brunec","year":"2022","journal-title":"OSF Preprints"},{"issue":"17","key":"pcbi.1010829.ref005","doi-asserted-by":"crossref","first-page":"2861","DOI":"10.1016\/j.cub.2018.06.009","article-title":"Global Determinants of Navigation Ability","volume":"28","author":"A Coutrot","year":"2018","journal-title":"Curr Biol CB"},{"key":"pcbi.1010829.ref006","article-title":"Human spatial navigation.","author":"AD Ekstrom","year":"2018","journal-title":"Princeton University Press"},{"issue":"5","key":"pcbi.1010829.ref007","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1016\/j.neurobiolaging.2013.10.086","article-title":"How age-related strategy switching deficits affect wayfinding in complex environments","volume":"35","author":"MA Harris","year":"2014","journal-title":"Neurobiol Aging"},{"key":"pcbi.1010829.ref008","article-title":"Understanding Differences in Wayfinding Strategies.","author":"M Hegarty","year":"2022","journal-title":"Top Cogn Sci [Internet]"},{"issue":"3","key":"pcbi.1010829.ref009","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1037\/a0035261","article-title":"Variations in cognitive maps: understanding individual differences in navigation.","volume":"40","author":"SM Weisberg","year":"2014","journal-title":"J Exp Psychol Learn Mem Cogn."},{"issue":"4","key":"pcbi.1010829.ref010","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/j.neuron.2016.03.037","article-title":"Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network","volume":"90","author":"J Balaguer","year":"2016","journal-title":"Neuron"},{"issue":"3","key":"pcbi.1010829.ref011","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.neuron.2021.12.012","article-title":"Spatial goal coding in the hippocampal formation","volume":"110","author":"N Nyberg","year":"2022","journal-title":"Neuron"},{"issue":"1655","key":"pcbi.1010829.ref012","doi-asserted-by":"crossref","first-page":"20130478","DOI":"10.1098\/rstb.2013.0478","article-title":"The algorithmic anatomy of model-based evaluation.","volume":"369","author":"ND Daw","year":"2014","journal-title":"Philos Trans R Soc B Biol Sci"},{"issue":"8","key":"pcbi.1010829.ref013","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1038\/s41593-021-00866-w","article-title":"Formalizing planning and information search in naturalistic decision-making","volume":"24","author":"LT Hunt","year":"2021","journal-title":"Nat Neurosci"},{"issue":"5","key":"pcbi.1010829.ref014","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1016\/j.neuron.2018.08.018","article-title":"Prospection, Perseverance, and Insight in Sequential Behavior","volume":"99","author":"N Kolling","year":"2018","journal-title":"Neuron"},{"issue":"10","key":"pcbi.1010829.ref015","doi-asserted-by":"crossref","first-page":"3098","DOI":"10.1073\/pnas.1414219112","article-title":"Interplay of approximate planning strategies","volume":"112","author":"QJM Huys","year":"2015","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"3","key":"pcbi.1010829.ref016","doi-asserted-by":"crossref","first-page":"e1002410","DOI":"10.1371\/journal.pcbi.1002410","article-title":"Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees.","volume":"8","author":"QJM Huys","year":"2012","journal-title":"PLOS Comput Biol"},{"issue":"11","key":"pcbi.1010829.ref017","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1016\/j.artint.2011.03.007","article-title":"Monte-Carlo tree search and rapid action value estimation in computer Go","volume":"175","author":"S Gelly","year":"2011","journal-title":"Artif Intell"},{"issue":"45","key":"pcbi.1010829.ref018","doi-asserted-by":"crossref","first-page":"12868","DOI":"10.1073\/pnas.1609094113","article-title":"Adaptive integration of habits into depth-limited planning defines a habitual-goal\u2013directed spectrum","volume":"113","author":"M Keramati","year":"2016","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"4","key":"pcbi.1010829.ref019","doi-asserted-by":"crossref","first-page":"e1004864","DOI":"10.1371\/journal.pcbi.1004864","article-title":"Problem Solving as Probabilistic Inference with Subgoaling: Explaining Human Successes and Pitfalls in the Tower of Hanoi.","volume":"12","author":"F Donnarumma","year":"2016","journal-title":"PLOS Comput Biol."},{"issue":"8","key":"pcbi.1010829.ref020","doi-asserted-by":"crossref","first-page":"e1003779","DOI":"10.1371\/journal.pcbi.1003779","article-title":"Optimal Behavioral Hierarchy","volume":"10","author":"A Solway","year":"2014","journal-title":"PLOS Comput Biol."},{"issue":"4","key":"pcbi.1010829.ref021","doi-asserted-by":"crossref","first-page":"e1007594","DOI":"10.1371\/journal.pcbi.1007594","article-title":"Discovery of hierarchical representations for efficient planning.","volume":"16","author":"MS Tomov","year":"2020","journal-title":"PLOS Comput Biol."},{"key":"pcbi.1010829.ref022","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/978-3-642-24647-0_3","volume-title":"Decision Making with Imperfect Decision Makers [Internet]","author":"J Rubin","year":"2012"},{"key":"pcbi.1010829.ref023","first-page":"856849","article-title":"Linear reinforcement learning: Flexible reuse of computation in planning, grid fields, and cognitive control.","author":"P Piray","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1010829.ref024","first-page":"1369","author":"E. Todorov","year":"2006","journal-title":"Linearly-solvable Markov decision problems"},{"key":"pcbi.1010829.ref025","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/bs.plm.2021.02.004","volume-title":"Psychology of Learning and Motivation [Internet]","author":"L Lai","year":"2021"},{"issue":"2153","key":"pcbi.1010829.ref026","article-title":"Thermodynamics as a theory of decision-making with information-processing costs","volume":"469","author":"PA Ortega","year":"2013","journal-title":"Proc R Soc Math Phys Eng Sci [Internet]"},{"key":"pcbi.1010829.ref027","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.neuropsychologia.2018.09.013","article-title":"An information-theoretic perspective on the costs of cognition.","volume":"123","author":"A Z\u00e9non","year":"2019","journal-title":"Neuropsychologia"},{"key":"pcbi.1010829.ref028","article-title":"InfoBot: Transfer and Exploration via the Information Bottleneck [Internet].","author":"A Goyal","year":"2019","journal-title":"arXiv"},{"key":"pcbi.1010829.ref029","first-page":"601","volume-title":"Perception-Action Cycle: Models, Architectures, and Hardware [Internet].","author":"Springer","year":"2011"},{"key":"pcbi.1010829.ref030","doi-asserted-by":"crossref","first-page":"e66175","DOI":"10.7554\/eLife.66175","article-title":"Mice in a labyrinth show rapid learning, sudden insight, and efficient exploration.","volume":"10","author":"M Rosenberg","year":"2021","journal-title":"eLife"},{"issue":"2","key":"pcbi.1010829.ref031","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","article-title":"Goals and habits in the brain","volume":"80","author":"RJ Dolan","year":"2013","journal-title":"Neuron"},{"key":"pcbi.1010829.ref032","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.pneurobio.2015.09.001","article-title":"Active Inference, homeostatic regulation and adaptive behavioural control","volume":"136","author":"G Pezzulo","year":"2015","journal-title":"Prog Neurobiol"},{"issue":"7","key":"pcbi.1010829.ref033","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.3758\/s13421-019-00941-5","article-title":"Instructions matter: Individual differences in navigation strategy and ability.","volume":"47","author":"AP Boone","year":"2019","journal-title":"Mem Cognit."},{"issue":"43","key":"pcbi.1010829.ref034","doi-asserted-by":"crossref","first-page":"15264","DOI":"10.1523\/JNEUROSCI.3634-11.2011","article-title":"Cognitive Mappers to Creatures of Habit: Differential Engagement of Place and Response Learning Mechanisms Predicts Human Navigational Behavior","volume":"31","author":"SA Marchette","year":"2011","journal-title":"J Neurosci"},{"first-page":"105","volume-title":"2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL) [Internet]","author":"IEEE","key":"pcbi.1010829.ref035"},{"issue":"6","key":"pcbi.1010829.ref036","doi-asserted-by":"crossref","first-page":"909","DOI":"10.3758\/s13421-018-0811-y","article-title":"Sex differences in navigation strategy and efficiency.","volume":"46","author":"AP Boone","year":"2018","journal-title":"Mem Cognit.Aug"},{"key":"pcbi.1010829.ref037","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/ADPRL.2011.5967384","volume-title":"2011 IEEE Symposium on Adaptive Dynamic Programming And Reinforcement Learning (ADPRL)","author":"SG van Dijk","year":"2011"},{"journal-title":"Empowerment and Relevant Goal Information as Alternatives to Graph-Theoretic Centrality for Navigational Decision Making.","year":"2020","author":"M Clements","key":"pcbi.1010829.ref038"},{"issue":"3","key":"pcbi.1010829.ref039","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1038\/nrn.2015.30","article-title":"Vicarious trial and error.","volume":"17","author":"AD Redish","year":"2016","journal-title":"Nat Rev Neurosci."},{"key":"pcbi.1010829.ref040","doi-asserted-by":"crossref","first-page":"237","DOI":"10.3389\/fnbeh.2018.00237","article-title":"Human Vicarious Trial and Error Is Predictive of Spatial Navigation Performance","volume":"12","author":"D Santos-Pata","year":"2018","journal-title":"Front Behav Neurosci"},{"issue":"4","key":"pcbi.1010829.ref041","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1037\/h0057054","article-title":"Prediction of vicarious trial and error by means of the schematic sowbug.","volume":"46","author":"EC Tolman","year":"1939","journal-title":"Psychol Rev"},{"key":"pcbi.1010829.ref042","article-title":"The road towards understanding embodied decisions.","author":"J Gordon","year":"2021","journal-title":"Neurosci Biobehav Rev [Internet]."},{"issue":"1819","key":"pcbi.1010829.ref043","doi-asserted-by":"crossref","first-page":"20190664","DOI":"10.1098\/rstb.2019.0664","article-title":"Continuous decisions.","volume":"376","author":"SBM Yoo","year":"2021","journal-title":"Philos Trans R Soc B Biol Sci."},{"issue":"3","key":"pcbi.1010829.ref044","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.jenvp.2008.02.006","article-title":"The dynamic nature of cognition during wayfinding","volume":"28","author":"HJ Spiers","year":"2008","journal-title":"J Environ Psychol"},{"issue":"2","key":"pcbi.1010829.ref045","doi-asserted-by":"crossref","first-page":"61","DOI":"10.3390\/e18020061","article-title":"Nonparametric Problem-Space Clustering: Learning Efficient Codes for Cognitive Control Tasks","volume":"18","author":"D Maisto","year":"2016","journal-title":"Entropy"},{"journal-title":"Top Cogn Sci","article-title":"Importance of Path Planning Variability: A Simulation Study.","author":"JL Krichmar","key":"pcbi.1010829.ref046"},{"issue":"2","key":"pcbi.1010829.ref047","doi-asserted-by":"crossref","first-page":"e0116193","DOI":"10.1371\/journal.pone.0116193","article-title":"Tracking Second Thoughts: Continuous and Discrete Revision Processes during Visual Lexical Decision.","volume":"10","author":"L Barca","year":"2015","journal-title":"PLOS ONE."},{"key":"pcbi.1010829.ref048","article-title":"Changes of Mind after Movement Onset Depend on the State of the Motor System","author":"I Cos","year":"2021","journal-title":"eNeuro"},{"issue":"2","key":"pcbi.1010829.ref049","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.cognition.2011.06.005","article-title":"Would you follow your own route description? Cognitive strategies in urban route planning","volume":"121","author":"C H\u00f6lscher","year":"2011","journal-title":"Cognition"},{"key":"pcbi.1010829.ref050","article-title":"Embodied Choice: How action influences perceptual decision making.","author":"NF Lepora","year":"2015","journal-title":"PLoS Comput Biol."},{"issue":"3","key":"pcbi.1010829.ref051","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1152\/jn.00613.2019","article-title":"Reaching decisions during ongoing movements","volume":"123","author":"J Michalski","year":"2020","journal-title":"J Neurophysiol"},{"key":"pcbi.1010829.ref052","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.cobeha.2021.02.015","article-title":"Resource-rational decision making.","volume":"41","author":"R Bhui","year":"2021","journal-title":"Curr Opin Behav Sci."},{"issue":"5","key":"pcbi.1010829.ref053","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2976\/1.3171566","article-title":"Information: currency of life?","volume":"3","author":"D. Polani","year":"2009","journal-title":"HFSP J."},{"issue":"3","key":"pcbi.1010829.ref054","doi-asserted-by":"crossref","first-page":"513","DOI":"10.3758\/s13415-012-0097-7","article-title":"Interactions between deliberation and delay-discounting in rats.","volume":"12","author":"AE Papale","year":"2012","journal-title":"Cogn Affect Behav Neurosci."},{"issue":"45","key":"pcbi.1010829.ref055","doi-asserted-by":"crossref","first-page":"12176","DOI":"10.1523\/JNEUROSCI.3761-07.2007","article-title":"Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point","volume":"27","author":"A Johnson","year":"2007","journal-title":"J Neurosci"},{"issue":"4","key":"pcbi.1010829.ref056","first-page":"342","article-title":"Information Processing in Decision-Making Systems.","volume":"18","author":"M van der Meer","year":"2012","journal-title":"Neurosci Rev J Bringing Neurobiol Neurol Psychiatry."},{"key":"pcbi.1010829.ref057","article-title":"Internally generated sequences in learning and executing goal-directed behavior.","author":"G Pezzulo","year":"2014","journal-title":"Trends Cogn Sci [Internet]."},{"key":"pcbi.1010829.ref058","article-title":"An information-theoretic perspective on the costs of cognition.","author":"A Zenon","year":"2017","journal-title":"bioRxiv"},{"issue":"6245","key":"pcbi.1010829.ref059","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1126\/science.aac6076","article-title":"Computational rationality: A converging paradigm for intelligence in brains, minds, and machines","volume":"349","author":"SJ Gershman","year":"2015","journal-title":"Science"},{"issue":"4","key":"pcbi.1010829.ref060","doi-asserted-by":"crossref","first-page":"375","DOI":"10.3390\/e21040375","article-title":"Bounded Rational Decision-Making from Elementary Computations That Reduce Uncertainty.","volume":"21","author":"S Gottwald","year":"2019","journal-title":"EntropyApr"},{"key":"pcbi.1010829.ref061","first-page":"43","article-title":"Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources.","author":"F Lieder","year":"2020","journal-title":"Behav Brain Sci [Internet]"},{"issue":"2","key":"pcbi.1010829.ref062","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1037\/h0042769","article-title":"Rational choice and the structure of the environment","volume":"63","author":"HA Simon","year":"1956","journal-title":"Psychol Rev"},{"key":"pcbi.1010829.ref063","first-page":"15","article-title":"Vicarious Trial-and-Error Is Enhanced During Deliberation in Human Virtual Navigation in a Translational Foraging Task.","author":"T Huynh","year":"2021","journal-title":"Front Behav Neurosci [Internet]"},{"issue":"1","key":"pcbi.1010829.ref064","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s11199-010-9877-0","article-title":"Gender differences in the effects of acute stress on spatial ability.","volume":"64","author":"KI Gabriel","year":"2011","journal-title":"Sex Roles"},{"key":"pcbi.1010829.ref065","article-title":"A space of goals: the cognitive geometry of informationally bounded agents.","author":"K Archer","year":"2021","journal-title":"ArXiv211103699 Cs Eess Math [Internet]"},{"key":"pcbi.1010829.ref066","article-title":"Principled Option Learning in Markov Decision Processes.","author":"R Fox","year":"2017","journal-title":"ArXiv160905524 Cs Stat [Internet]"},{"key":"pcbi.1010829.ref067","article-title":"Information asymmetry in KL-regularized RL","author":"A Galashov","year":"2019","journal-title":"ArXiv190501240 Cs Stat [Internet]"},{"key":"pcbi.1010829.ref068","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3389\/frobt.2015.00027","article-title":"Bounded Rationality, Abstraction, and Hierarchical Decision-Making: An Information-Theoretic Optimality Principle.","volume":"2","author":"T Genewein","year":"2015","journal-title":"Front Robot AI."},{"key":"pcbi.1010829.ref069","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1109\/CDC.2017.8263809","article-title":"Hierarchical state abstractions for decision-making problems with computational constraints","author":"DT Larsson","year":"2017","journal-title":"2017 IEEE 56th Annual Conference on Decision and Control (CDC)"},{"issue":"4","key":"pcbi.1010829.ref070","doi-asserted-by":"crossref","first-page":"7651","DOI":"10.1109\/LRA.2021.3099995","article-title":"Information-Theoretic Abstractions for Planning in Agents With Computational Constraints.","volume":"6","author":"DT Larsson","year":"2021","journal-title":"IEEE Robot Autom Lett."},{"key":"pcbi.1010829.ref071","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/12441.001.0001","volume-title":"Active Inference: The Free Energy Principle in Mind, Brain, and Behavior.","author":"T Parr","year":"2022"},{"key":"pcbi.1010829.ref072","article-title":"Computing Complexity-aware Plans Using Kolmogorov Complexity.","author":"E Stefansson","year":"2021","journal-title":"ArXiv210910303 Cs Eess Math [Internet]"},{"journal-title":"A Unified Bellman Equation for Causal Information and Value in Markov Decision Processes","year":"2017","author":"S Tiomkin","key":"pcbi.1010829.ref073"},{"key":"pcbi.1010829.ref074","article-title":"Behavior Priors for Efficient Reinforcement Learning.","author":"D Tirumala","year":"2020","journal-title":"ArXiv201014274 Cs [Internet]"},{"issue":"18","key":"pcbi.1010829.ref075","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1073\/pnas.1618228114","article-title":"Coding of navigational affordances in the human visual system","volume":"114","author":"MF Bonner","year":"2017","journal-title":"Proc Natl Acad Sci"},{"issue":"6","key":"pcbi.1010829.ref076","first-page":"414","article-title":"Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition.","volume":"20","author":"G Pezzulo","year":"2016"},{"issue":"3","key":"pcbi.1010829.ref077","doi-asserted-by":"crossref","first-page":"167","DOI":"10.3390\/bs4030167","article-title":"Seeing the Axial Line: Evidence from Wayfinding Experiments.","volume":"4","author":"B. Emo","year":"2014","journal-title":"Behav Sci."},{"issue":"12","key":"pcbi.1010829.ref078","doi-asserted-by":"crossref","first-page":"e1008497","DOI":"10.1371\/journal.pcbi.1008497","article-title":"Value-complexity tradeoff explains mouse navigational learning.","volume":"16","author":"N Amir","year":"2020","journal-title":"PLOS Comput Biol."},{"key":"pcbi.1010829.ref079","article-title":"Predictive maps in rats and humans for spatial navigation","author":"W de Cothi","year":"2022","journal-title":"Curr Biol [Internet]"},{"key":"pcbi.1010829.ref080","doi-asserted-by":"crossref","first-page":"e73097","DOI":"10.7554\/eLife.73097","article-title":"Eye movements reveal spatiotemporal dynamics of visually-informed planning in navigation.","volume":"11","author":"S Zhu","year":"2022","journal-title":"eLife"},{"issue":"2","key":"pcbi.1010829.ref081","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1523\/JNEUROSCI.1327-21.2021","article-title":"Predictive Representations in Hippocampal and Prefrontal Hierarchies","volume":"42","author":"IK Brunec","year":"2022","journal-title":"J Neurosci"},{"key":"pcbi.1010829.ref082","doi-asserted-by":"crossref","first-page":"ncomms14652","DOI":"10.1038\/ncomms14652","article-title":"Hippocampal and prefrontal processing of network topology to simulate the future.","volume":"8","author":"AH Javadi","year":"2017","journal-title":"Nat Commun."},{"key":"pcbi.1010829.ref083","doi-asserted-by":"crossref","first-page":"102545","DOI":"10.1016\/j.conb.2022.102545","article-title":"Extending neural systems for navigation to hunting behavior","volume":"73","author":"SC Goodroe","year":"2022","journal-title":"Curr Opin Neurobiol"},{"issue":"3","key":"pcbi.1010829.ref084","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication.","volume":"27","author":"CE Shannon","year":"1948","journal-title":"Bell Syst Tech J."},{"key":"pcbi.1010829.ref085","article-title":"The information bottleneck method","author":"N Tishby","year":"2000","journal-title":"ArXiv Prepr Physics0004057"},{"issue":"3","key":"pcbi.1010829.ref086","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/S0019-9958(58)80003-0","article-title":"Dynamic programming and stochastic control processes.","volume":"1","author":"R. Bellman","year":"1958","journal-title":"Inf Control."},{"issue":"1","key":"pcbi.1010829.ref087","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIT.1972.1054753","article-title":"An algorithm for computing the capacity of arbitrary discrete memoryless channels","volume":"18","author":"S. Arimoto","year":"1972","journal-title":"IEEE Trans Inf Theory"},{"issue":"4","key":"pcbi.1010829.ref088","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"R. Blahut","year":"1972","journal-title":"IEEE Trans Inf Theory"},{"issue":"9","key":"pcbi.1010829.ref089","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1016\/j.neunet.2005.08.009","article-title":"Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model","volume":"18","author":"A Johnson","year":"2005","journal-title":"Neural Netw"}],"updated-by":[{"updated":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T00:00:00Z","timestamp":1674086400000},"DOI":"10.1371\/journal.pcbi.1010829","type":"new_version","label":"New version"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010829","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T18:48:29Z","timestamp":1674154109000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010829"}},"subtitle":[],"editor":[{"given":"Samuel J.","family":"Gershman","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2023,1,6]]},"references-count":89,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1,6]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010829","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.08.06.503020","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"type":"electronic","value":"1553-7358"}],"subject":[],"published":{"date-parts":[[2023,1,6]]}}}