{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T20:10:34Z","timestamp":1726258234327},"reference-count":46,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2014,3,1]]},"abstract":"Abstract<\/jats:title>\n In decision-making processes, the relevance of the information yielded by outcomes varies across time and situations. It increases when previous predictions are not accurate and in contexts with high environmental uncertainty. Previous fMRI studies have shown an important role of medial pFC in coding both reward prediction errors and the impact of this information to guide future decisions. However, it is unclear whether these two processes are dissociated in time or occur simultaneously, suggesting that a common mechanism is engaged. In the present work, we studied the modulation of two electrophysiological responses associated to outcome processing\u2014the feedback-related negativity ERP and frontocentral theta oscillatory activity\u2014with the reward prediction error and the learning rate. Twenty-six participants performed two learning tasks differing in the degree of predictability of the outcomes: a reversal learning task and a probabilistic learning task with multiple blocks of novel cue\u2013outcome associations. We implemented a reinforcement learning model to obtain the single-trial reward prediction error and the learning rate for each participant and task. Our results indicated that midfrontal theta activity and feedback-related negativity increased linearly with the unsigned prediction error. In addition, variations of frontal theta oscillatory activity predicted the learning rate across tasks and participants. These results support the existence of a common brain mechanism for the computation of unsigned prediction error and learning rate.<\/jats:p>","DOI":"10.1162\/jocn_a_00516","type":"journal-article","created":{"date-parts":[[2013,11,4]],"date-time":"2013-11-04T15:02:53Z","timestamp":1383577373000},"page":"447-458","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":63,"title":["Frontal Theta Oscillatory Activity Is a Common Mechanism for the Computation of Unexpected Outcomes and Learning Rate"],"prefix":"10.1162","volume":"26","author":[{"given":"Ernest","family":"Mas-Herrero","sequence":"first","affiliation":[{"name":"1L'Hospitalet de Llobregat, Barcelona, Spain"}]},{"given":"Josep","family":"Marco-Pallar\u00e9s","sequence":"additional","affiliation":[{"name":"1L'Hospitalet de Llobregat, Barcelona, Spain"},{"name":"2University of Barcelona"}]}],"member":"281","published-online":{"date-parts":[[2014,3,1]]},"reference":[{"key":"2021073000380100100_R1","doi-asserted-by":"crossref","first-page":"1338","DOI":"10.1038\/nn.2921","article-title":"Medial prefrontal cortex as an action-outcome predictor.","volume":"14","author":"Alexander","year":"2011","journal-title":"Nature Neuroscience"},{"key":"2021073000380100100_R2","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.neuro.28.061604.135709","article-title":"An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance.","volume":"28","author":"Aston-Jones","year":"2005","journal-title":"Annual Review of Neuroscience"},{"key":"2021073000380100100_R3","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world.","volume":"10","author":"Behrens","year":"2007","journal-title":"Nature Neuroscience"},{"key":"2021073000380100100_R4","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1037\/0033-295X.108.3.624","article-title":"Conflict monitoring and cognitive control.","volume":"108","author":"Botvinick","year":"2001","journal-title":"Psychological Review"},{"key":"2021073000380100100_R5","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1002\/hbm.20491","article-title":"Directional functional coupling of cerebral rhythms between anterior cingulate and dorsolateral prefrontal areas during rare stimuli: A directed transfer function analysis of human depth EEG signal.","volume":"30","author":"Br\u00e1zdil","year":"2009","journal-title":"Human Brain Mapping"},{"key":"2021073000380100100_R6","doi-asserted-by":"crossref","first-page":"18266","DOI":"10.1523\/JNEUROSCI.4715-11.2011","article-title":"Attention for learning signals in anterior cingulate cortex.","volume":"31","author":"Bryden","year":"2011","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R7","doi-asserted-by":"crossref","first-page":"1926","DOI":"10.1126\/science.1099745","article-title":"Neuronal oscillations in cortical networks.","volume":"304","author":"Buzs\u00e1ki","year":"2004","journal-title":"Science"},{"key":"2021073000380100100_R8","doi-asserted-by":"crossref","first-page":"2575","DOI":"10.1093\/cercor\/bhr332","article-title":"Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation.","volume":"22","author":"Cavanagh","year":"2011","journal-title":"Cerebral Cortex"},{"key":"2021073000380100100_R9","doi-asserted-by":"crossref","first-page":"3198","DOI":"10.1016\/j.neuroimage.2009.11.080","article-title":"Frontal theta links prediction errors to behavioral adaptation in reinforcement learning.","volume":"49","author":"Cavanagh","year":"2010","journal-title":"Neuroimage"},{"key":"2021073000380100100_R10","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1111\/j.1469-8986.2011.01293.x","article-title":"Theta lingua franca: A common mid-frontal substrate for action monitoring processes.","volume":"49","author":"Cavanagh","year":"2012","journal-title":"Psychophysiology"},{"key":"2021073000380100100_R11","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1162\/jocn.2010.21456","article-title":"Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning.","volume":"23","author":"Chase","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000380100100_R12","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1016\/j.neuroimage.2006.11.056","article-title":"Reward expectation modulates feedback-related negativity and EEG spectra.","volume":"35","author":"Cohen","year":"2007","journal-title":"Neuroimage"},{"key":"2021073000380100100_R13","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1523\/JNEUROSCI.4421-06.2007","article-title":"Reinforcement learning signals predict future decisions.","volume":"27","author":"Cohen","year":"2007","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R14","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.brainres.2008.07.114","article-title":"Medial frontal cortex and response conflict: Evidence from human intracranial EEG and medial frontal cortex lesion.","volume":"1238","author":"Cohen","year":"2008","journal-title":"Brain Research"},{"key":"2021073000380100100_R15","doi-asserted-by":"crossref","first-page":"4563","DOI":"10.1523\/JNEUROSCI.22-11-04563.2002","article-title":"Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging.","volume":"22","author":"Cools","year":"2002","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R16","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1162\/jocn.2007.19.1.158","article-title":"Distinction between perceptual and attentional processing in working memory tasks: A study of phase-locked and induced oscillatory brain dynamics.","volume":"19","author":"Deiber","year":"2007","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000380100100_R17","doi-asserted-by":"crossref","first-page":"12087","DOI":"10.1523\/JNEUROSCI.1410-12.2012","article-title":"The processing of unexpected positive response outcomes in the mediofrontal cortex.","volume":"32","author":"Ferdinand","year":"2012","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R18","doi-asserted-by":"crossref","first-page":"2279","DOI":"10.1126\/science.1066893","article-title":"The medial frontal cortex and the rapid processing of monetary gains and losses.","volume":"295","author":"Gehring","year":"2002","journal-title":"Science"},{"key":"2021073000380100100_R19","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1093\/cercor\/7.4.374","article-title":"High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice.","volume":"7","author":"Gevins","year":"1997","journal-title":"Cerebral Cortex"},{"key":"2021073000380100100_R20","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1016\/j.neuron.2010.04.016","article-title":"States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.","volume":"66","author":"Gl\u00e4scher","year":"2010","journal-title":"Neuron"},{"key":"2021073000380100100_R21","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1111\/psyp.12040","article-title":"Frontal midline theta and N200 amplitude reflect complementary information about expectancy and outcome evaluation.","volume":"50","author":"Hajihosseini","year":"2013","journal-title":"Psychophysiology"},{"key":"2021073000380100100_R22","doi-asserted-by":"crossref","first-page":"4178","DOI":"10.1523\/JNEUROSCI.4652-10.2011","article-title":"Surprise signals in anterior cingulate cortex: Neuronal encoding of unsigned reward prediction errors driving adjustment in behavior.","volume":"31","author":"Hayden","year":"2011","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R23","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1037\/0033-295X.109.4.679","article-title":"The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.","volume":"109","author":"Holroyd","year":"2002","journal-title":"Psychological Review"},{"key":"2021073000380100100_R24","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1046\/j.1460-9568.2002.01975.x","article-title":"Frontal theta activity in humans increases with memory load in a working memory task.","volume":"15","author":"Jensen","year":"2002","journal-title":"The European Journal of Neuroscience"},{"key":"2021073000380100100_R25","doi-asserted-by":"crossref","first-page":"7489","DOI":"10.1523\/JNEUROSCI.0349-09.2009","article-title":"Adaptive coding of action values in the human rostral cingulate zone.","volume":"29","author":"Jocham","year":"2009","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R26","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes factors.","volume":"90","author":"Kass","year":"1995","journal-title":"Journal of the American Statistical Association"},{"key":"2021073000380100100_R27","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/j.neuroimage.2006.06.012","article-title":"Anterior cingulate and prefrontal cortex activity in an fMRI study of trial-to-trial adjustments on the Simon task.","volume":"33","author":"Kerns","year":"2006","journal-title":"Neuroimage"},{"key":"2021073000380100100_R28","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1126\/science.1089910","article-title":"Anterior cingulate conflict monitoring and adjustments in control.","volume":"303","author":"Kerns","year":"2004","journal-title":"Science"},{"key":"2021073000380100100_R29","doi-asserted-by":"crossref","first-page":"17951","DOI":"10.1073\/pnas.0905191106","article-title":"Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions.","volume":"106","author":"Krugel","year":"2009","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021073000380100100_R30","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1111\/1467-9280.01417","article-title":"Electrophysiological responses to errors and feedback in the process of action regulation.","volume":"14","author":"Luu","year":"2003","journal-title":"Psychological Science"},{"key":"2021073000380100100_R31","doi-asserted-by":"crossref","first-page":"1821","DOI":"10.1016\/j.clinph.2004.03.031","article-title":"Frontal midline theta and the error-related negativity: Neurophysiological mechanisms of action regulation.","volume":"115","author":"Luu","year":"2004","journal-title":"Clinical Neurophysiology"},{"key":"2021073000380100100_R32","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.neuropsychologia.2007.07.016","article-title":"Human oscillatory activity associated to reward processing in a gambling task.","volume":"46","author":"Marco-Pallares","year":"2008","journal-title":"Neuropsychologia"},{"key":"2021073000380100100_R33","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1162\/jocn.2007.19.12.1994","article-title":"Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations.","volume":"19","author":"Oliveira","year":"2007","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000380100100_R34","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/35077500","article-title":"Primate anterior cingulate cortex: Where motor control, drive and cognition interface.","volume":"2","author":"Paus","year":"2001","journal-title":"Nature Reviews Neuroscience"},{"key":"2021073000380100100_R35","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1037\/0033-295X.87.6.532","article-title":"A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.","volume":"87","author":"Pearce","year":"1980","journal-title":"Psychological Review"},{"key":"2021073000380100100_R36","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.neuroimage.2010.05.052","article-title":"Temporal dynamics of prediction error processing during reward-based decision making.","volume":"53","author":"Philiastides","year":"2010","journal-title":"Neuroimage"},{"key":"2021073000380100100_R37","doi-asserted-by":"crossref","first-page":"4370","DOI":"10.1523\/JNEUROSCI.4437-04.2005","article-title":"Noradrenergic stimulation enhances human action monitoring.","volume":"25","author":"Riba","year":"2005","journal-title":"The Journal of Neuroscience"},{"key":"2021073000380100100_R38","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1016\/j.tics.2004.07.009","article-title":"Action sets and decisions in the medial frontal cortex.","volume":"8","author":"Rushworth","year":"2004","journal-title":"Trends in Cognitive Sciences"},{"key":"2021073000380100100_R39","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/S0959-4388(97)80007-4","article-title":"Dopamine neurons and their role in reward mechanisms.","volume":"7","author":"Schultz","year":"1997","journal-title":"Current Opinion in Neurobiology"},{"key":"2021073000380100100_R40","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/nrn2994","article-title":"The integration of negative affect, pain and cognitive control in the cingulate cortex.","volume":"12","author":"Shackman","year":"2011","journal-title":"Nature Reviews Neuroscience"},{"key":"2021073000380100100_R41","volume-title":"Reinforcement learning: An introduction.","author":"Sutton","year":"1998"},{"key":"2021073000380100100_R42","doi-asserted-by":"crossref","first-page":"T142","DOI":"10.1016\/j.neuroimage.2007.03.029","article-title":"Adaptive decision making and value in the anterior cingulate cortex.","volume":"36(Suppl. 2)","author":"Walton","year":"2007","journal-title":"Neuroimage"},{"key":"2021073000380100100_R43","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1038\/nn1339","article-title":"Interactions between decision making and performance monitoring within prefrontal cortex.","volume":"7","author":"Walton","year":"2004","journal-title":"Nature Neuroscience"},{"key":"2021073000380100100_R44","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning.","volume":"8","author":"Watkins","year":"1992","journal-title":"Machine Learning"},{"key":"2021073000380100100_R45","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.brainres.2009.06.032","article-title":"The P300 and reward valence, magnitude, and expectancy in outcome evaluation.","volume":"1286","author":"Wu","year":"2009","journal-title":"Brain Research"},{"key":"2021073000380100100_R46","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.neuron.2006.05.006","article-title":"Resolution of uncertainty in prefrontal cortex.","volume":"50","author":"Yoshida","year":"2006","journal-title":"Neuron"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/26\/3\/447\/1946861\/jocn_a_00516.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/26\/3\/447\/1946861\/jocn_a_00516.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T00:41:29Z","timestamp":1627605689000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/26\/3\/447\/28086\/Frontal-Theta-Oscillatory-Activity-Is-a-Common"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,3,1]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2014,3,1]]},"published-print":{"date-parts":[[2014,3,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00516","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2014,3]]},"published":{"date-parts":[[2014,3,1]]}}}