States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.
paper
Cited
Public
- Authors
- GlΓ€scher, Jan; Daw, Nathaniel; Dayan, Peter; O'Doherty, John P
- Year
- 2010
- Journal
- Neuron
- PMID
- 20510862
- DOI
- 10.1016/j.neuron.2010.04.016
- PMCID
- PMC2895323
Reinforcement learning (RL) uses sequential experience with situations ("states") and outcomes to assess actions. Whereas model-free RL uses this experience directly, in the form of a reward prediction error (RPE), model-based RL uses it indirectly, building a model of the state transition and outcome structure of the environment, and evaluating actions by searching this model. A state prediction error (SPE) plays a central role, reporting discrepancies between the current model and the observed state transitions. Using functional magnetic resonance imaging in humans solving a probabilistic Markov decision task, we found the neural signature of an SPE in the intraparietal sulcus and lateral prefrontal cortex, in addition to the previously well-characterized RPE in the ventral striatum. This finding supports the existence of two unique forms of learning signal in humans, which may form the basis of distinct computational strategies for guiding behavior.
No figures extracted from this document.
| Name | Type |
|---|---|
| 18 subjects local | cohort |
| abs(RPE) local | phenotype |
| abs(RPE) signal local | phenotype |
| action selection local | phenotype |
| angular gyrus | anatomy |
| anterior commissure | anatomy |
| anterior medial striatum local | anatomy |
| Anterior Medial Striatum local | anatomy |
| Bayesian belief states local | phenotype |
| Behavioral choices local | phenotype |
| BOLD signal | phenotype |
| brain volume | anatomy |
| Caltech student population local | cohort |
| causal learning local | phenotype |
| Cholinergic Pathway local | drug |
| control | cohort |
| cortex | anatomy |
| decision-making | phenotype |
| dopaminergic neurons | anatomy |
| dopaminergic-striatal pathways local | anatomy |
| Dopaminergic-Striatal Pathways local | phenotype |
| dynamic competitive games performance local | phenotype |
| executive function | phenotype |
| FORWARD local | phenotype |
| FORWARD learner local | drug |
| FORWARD learner local | phenotype |
| frontal cortex | anatomy |
| habit local | phenotype |
| HYBRID learner local | drug |
| inferior temporal gyrus | anatomy |
| intermediate progenitors | anatomy |
| intraparietal sulcus | anatomy |
| lateral prefrontal cortex | anatomy |
| learning state transitions local | phenotype |
| left intraparietal sulcus local | anatomy |
| left lateral prefrontal cortex local | anatomy |
| left latPFC local | anatomy |
| LIP local | anatomy |
| minimal learning local | phenotype |
| Model-based FORWARD learner local | phenotype |
| model-based learning local | phenotype |
| Model-based learning local | phenotype |
| model-based reinforcement learning local | phenotype |
| model-based system local | phenotype |
| Model-Based System local | phenotype |
| model-free learning local | phenotype |
| Model-free learning local | phenotype |
| model-free reinforcement learning local | phenotype |
| model-free system local | phenotype |
| Model-Free System local | phenotype |
| movement modalities local | phenotype |
| optimal choice behavior local | phenotype |
| orbitofrontal cortex | anatomy |
| Orienting/Salience local | phenotype |
| parietal cortex | anatomy |
| participants | cohort |
| percent correct choices local | phenotype |
| perceptual learning local | phenotype |
| pIPS local | anatomy |
| pIPS/angular gyrus local | anatomy |
| posterior commissure | anatomy |
| posterior inferior frontal gyrus local | anatomy |
| posterior intraparietal sulcus local | anatomy |
| Posterior Intraparietal Sulcus local | anatomy |
| prediction errors local | phenotype |
| prefrontal cortex | anatomy |
| probabilistic stimulus-stimulus associations local | phenotype |
| reward | phenotype |
| reward prediction error local | phenotype |
| Reward prediction error local | phenotype |
| Reward Prediction Error local | phenotype |
| right latPFC local | anatomy |
| right pIPS local | anatomy |
| right posterior intraparietal sulcus local | anatomy |
| RPE local | phenotype |
| saccadic decision-making local | phenotype |
| SARSA learner local | drug |
| SARSA learner local | phenotype |
| sequential planning behavior local | phenotype |
| Siemens Trio scanner local | drug |
| SPE local | phenotype |
| SPE signal local | drug |
| SPE signal local | phenotype |
| state prediction error local | phenotype |
| State prediction error local | phenotype |
| State Prediction Error local | phenotype |
| striatum | anatomy |
| subjects | cohort |
| successful choice behavior local | phenotype |
| superior parietal cortex | anatomy |
| Transition probabilities local | phenotype |
| ventral striatum | anatomy |
No uploaded files.
Not in any collection.
In this knowledge base
| Title | Year | PMID |
|---|---|---|
| Reward processing deficits and impulsivity in high-risk offspring of alcoholics: A study of event-related potentials during a monetary gambling task. | 2015 | 26388585 |
External
| Title | Authors | Journal | Year | Link |
|---|---|---|---|---|
| Annual Research Review: Neural mechanisms of eating disorders in youth - from current theory and findings to future directions. | Hagan K et al. | β | 2026 | β |
| Cathodal tDCS over right orbitofrontal cortex enhances the ability in subclinical obsessive-compulsive disorder to shift to model-based control. | Ruan Z et al. | β | 2026 | β |
| Day-to-day fluctuations in cognitive precision predict the domain-general intention-behavior gap. | Wilson DJ et al. | β | 2026 | β |
| Deciding for others diminishes model-based decision-making but depends on individual prosociality. | Huang Y et al. | β | 2026 | β |
| Information uncertainty influences learning strategy from sequentially delayed rewards. | Maulhardt SR et al. | β | 2026 | β |
| Looking deeper into the algorithms underlying human planning. | Kuperwajs I et al. | β | 2026 | β |
| Neurocomputational modeling of rule abstraction and memorization during probabilistic stimulus-reward learning. | Schlegelmilch R et al. | β | 2026 | β |
| Shaping Memory from the Start: Initial Prediction Errors during First Encoding. | Liedtke N et al. | β | 2026 | β |
| The prefrontal-striatal signatures of reduced model-based learning in depressed patients. | Wang X et al. | β | 2026 | β |
| When models matter: Environmental demand guides the arbitration between model-based and model-free control. | Held LK et al. | β | 2026 | β |
| Where learning paths meet: Convergence and divergence of statistical and reinforcement learning. | Ferrari A et al. | β | 2026 | β |
| A corticostriatal learning mechanism linking excess striatal dopamine and auditory hallucinations | Lakshminarasimhan K et al. | β | 2025 | β |
| Altered model-based prediction error signaling in the lateral orbitofrontal cortex in patients with obsessive-compulsive disorder: An fMRI study. | Sen P et al. | β | 2025 | β |
| An experimental and computational investigation of executive functions and inner speech in schizophrenia spectrum disorders. | Granato G et al. | β | 2025 | β |
| Cognitive computational model reveals repetition bias in a sequential decision-making task. | Legler E et al. | β | 2025 | β |
| Computational modelling and neural correlates of reinforcement learning following three-week escitalopram: a double-blind, placebo-controlled semi-randomised study. | Langley C et al. | β | 2025 | β |
| Construction and use of mental models: Organizing principles for the science of brain and mind. | Duncan J | β | 2025 | β |
| Differences in resting state functional connectivity in striatal and frontal networks associated with task-behaviour elicited by gamified two-stage decision task. | Brydevall M et al. | β | 2025 | β |
| Diminished State Space Theory of Human Aging. | Eppinger B et al. | β | 2025 | β |
| Distributional dual-process model predicts strategic shifts in decision-making under uncertainty. | Hu M et al. | β | 2025 | β |
| Exploring replay. | Antonov G et al. | β | 2025 | β |
| Exploring the specificity of linguistic rule learning through reinforcement learning: Semantic and syntactic perspectives. | Li Y et al. | β | 2025 | β |
| Factorized embedding of goal and uncertainty in the lateral prefrontal cortex guides stably flexible learning. | Sung Y et al. | β | 2025 | β |
| Finding the sweet spot of memory modification: An fMRI study on episodic prediction error strength and type. | Liedtke N et al. | β | 2025 | β |
| Fragmentation and multithreading of experience in the default-mode network. | Yazin F et al. | β | 2025 | β |
| Goal-directed behavior and hippocampal activity predict real-life impact of drinking intentions in alcohol use disorder. | Ebrahimi C et al. | β | 2025 | β |
| Higher motivation and pleasure scores predict more reliance on model-free decision making. | Karthik SK et al. | β | 2025 | β |
| Higher-order and distributed synergistic functional interactions encode information gain in goal-directed learning. | Combrisson E et al. | β | 2025 | β |
| How prediction error drives memory updating: role of locus coeruleus-hippocampal interactions. | Groves I et al. | β | 2025 | β |
| Impaired arbitration between reward-related decision-making strategies in Alcohol Users compared to Alcohol Non-Users: a computational modeling study. | Ramakrishnan SA et al. | β | 2025 | β |
| Internally Formed Preferences for Options only Influence Initial Decisions in Gambling Tasks, while the Gambling Outcomes do not Alter these Preferences. | Zhu J et al. | β | 2025 | β |
| Locus coeruleus norepinephrine neurons facilitate orbitofrontal cortex remapping and behavioral flexibility. | Ogg MC et al. | β | 2025 | β |
| Modeling natural neural networks of decision making with artificial neural networks. | Funamizu A et al. | β | 2025 | β |
| Neural correlates of reduced sensitivity to information about uncertainty during valuation in older adults: An fNIRS study. | Peng XR et al. | β | 2025 | β |
| Neural correlates of trial outcome monitoring during long-term learning in primate posterior parietal cortex. | Liu Z et al. | β | 2025 | β |
| Non-invasive ultrasonic neuromodulation of the human nucleus accumbens impacts reward sensitivity. | Yaakub SN et al. | β | 2025 | β |
| Novelty as a drive of human exploration in complex stochastic environments. | Modirshanechi A et al. | β | 2025 | β |
| Reconciling flexibility and efficiency: medial entorhinal cortex represents a compositional cognitive map. | Piray P et al. | β | 2025 | β |
| Reinforcement learning at the interface of artificial intelligence and cognitive science. | Alkam T et al. | β | 2025 | β |
| Striatal arbitration between choice strategies guides few-shot adaptation. | Yang MA et al. | β | 2025 | β |
| Thalamic regulation of reinforcement learning strategies across prefrontal-striatal networks. | Wang BA et al. | β | 2025 | β |
| The distinct functions of working memory and intelligence in model-based and model-free reinforcement learning. | Yang C et al. | β | 2025 | β |
| The neural basis for uncertainty processing in hierarchical decision making. | Wang MB et al. | β | 2025 | β |
| The neural correlates of novelty and variability in human decision-making under an active inference framework. | Zhang S et al. | β | 2025 | β |
| Transition ability to safe states reduces fear responses to height. | Fujino M et al. | β | 2025 | β |
| Working Memory Guides Action Valuation in Model-based Decision-making Strategy. | Zuo Z et al. | β | 2025 | β |
| Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts. | Colas JT et al. | β | 2024 | β |
| Characterizing Human Habits in the Lab. | Nebe S et al. | β | 2024 | β |
| Computational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers. | Burk DC et al. | β | 2024 | β |
| Cortical and subcortical substrates of minutes and days-long object value memory in humans. | Farmani S et al. | β | 2024 | β |
| Corticostriatal activity related to performance during continuous de novo motor learning. | Park S et al. | β | 2024 | β |
| Cortico-striatal white-matter connectivity underlies the ability to exert goal-directed control. | van Timmeren T et al. | β | 2024 | β |
| Direct serotonin release in humans shapes aversive learning and inhibition. | Colwell MJ et al. | β | 2024 | β |
| Disorders of compulsivity: Deficits in arbitrating learning strategies. | Ruan Z et al. | β | 2024 | β |
| Distinct processing of the state prediction error signals in frontal and parietal correlates in learning the environment model. | Xu S et al. | β | 2024 | β |
| Doubling down on dual systems: A cerebellum-amygdala route towards action- and outcome-based social and affective behavior. | Terburg D et al. | β | 2024 | β |
| Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning. | Aquino TG et al. | β | 2024 | β |
| Enhanced "learning to learn" through a hierarchical dual-learning system: the case of action video game players. | Gao YY et al. | β | 2024 | β |
| Evaluating the Influence of Musical and Monetary Rewards on Decision Making through Computational Modelling. | Kopytin G et al. | β | 2024 | β |
| From brain to body: exploring the connection between altered reward processing and physical fitness in schizophrenia. | Hamzehpour L et al. | β | 2024 | β |
| Global neural encoding of behavioral strategies in mice during perceptual decision-making task with two different sensory patterns. | Wang S et al. | β | 2024 | β |
| Heterogeneity in strategy use during arbitration between experiential and observational learning. | Charpentier CJ et al. | β | 2024 | β |
| Hippocampus and striatum show distinct contributions to longitudinal changes in value-based learning in middle childhood. | Falck J et al. | β | 2024 | β |
| How do anxiety and stress affect soccer referees? An ERPs study. | Zhang L et al. | β | 2024 | β |
| Joint Modelling of Latent Cognitive Mechanisms Shared Across Decision-Making Domains. | Stevenson N et al. | β | 2024 | β |
| Latent-state and model-based learning in PTSD. | Cisler JM et al. | β | 2024 | β |
| Leveraging individual differences in cue-reward learning to investigate the psychological and neural basis of shared psychiatric symptomatology: The sign-tracker/goal-tracker model. | Felix PC et al. | β | 2024 | β |
| Machine learning and artificial intelligence in neuroscience: A primer for researchers. | Badrulhisham F et al. | β | 2024 | β |
| Making sense of feelings. | Key B et al. | β | 2024 | β |
| Midbrain signaling of identity prediction errors depends on orbitofrontal cortex networks. | Liu Q et al. | β | 2024 | β |
| Model-free decision-making underlies motor errors in rapid sequential movements under threat. | Sankhe P et al. | β | 2024 | β |
| Modelling cognitive flexibility with deep neural networks. | Sandbrink K et al. | β | 2024 | β |
| Multiple timescales of temporal context in risky choice: Behavioral identification and relationships to physiological arousal. | Brooks HR et al. | β | 2024 | β |
| Neural correlates of model-based behavior inΒ internet gaming disorder and alcohol useΒ disorder. | Kwon M et al. | β | 2024 | β |
| Neurocomputational model of compulsivity: deviating from an uncertain goal-directed system. | Kim T et al. | β | 2024 | β |
| Observational reinforcement learning in children and young adults. | Rodriguez Buritica JM et al. | β | 2024 | β |
| On the effects of impulsivity and compulsivity on neural correlates of model-based performance. | DΓΌck K et al. | β | 2024 | β |
| Revisiting the role of computational neuroimaging in the era of integrative neuroscience. | Loosen AM et al. | β | 2024 | β |
| Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space. | Hallquist MN et al. | β | 2024 | β |
| Reward Bases: A simple mechanism for adaptive acquisition of multiple reward types. | Millidge B et al. | β | 2024 | β |
| Surprise-minimization as a solution to the structural credit assignment problem. | Wurm F et al. | β | 2024 | β |
| Synergizing habits and goals with variational Bayes. | Han D et al. | β | 2024 | β |
| The construction and use of cognitive maps in model-based control. | Karagoz AB et al. | β | 2024 | β |
| The effect of transcranial Direct Current Stimulation on the Iowa Gambling Task: a scoping review. | Salice S et al. | β | 2024 | β |
| The role of training variability for model-based and model-free learning of an arbitrary visuomotor mapping. | VelΓ‘zquez-Vargas CA et al. | β | 2024 | β |
| Understanding dual process cognition via the minimum description length principle. | Moskovitz T et al. | β | 2024 | β |
| What's in a name: The role of verbalization in reinforcement learning. | Schaaf JV et al. | β | 2024 | β |
| A neuro-computational social learning framework to facilitate transdiagnostic classification and treatment across psychiatric disorders. | Rosenblau G et al. | β | 2023 | β |
| A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study. | Lee RSC et al. | β | 2023 | β |
| A self-adaptive hardware with resistive switching synapses for experience-based neurocomputing. | Bianchi S et al. | β | 2023 | β |
| Auditory and reward structures reflect the pleasure of musical expectancies during naturalistic listening. | Gold BP et al. | β | 2023 | β |
| Can we manipulate brain connectivity? A systematic review of cortico-cortical paired associative stimulation effects. | Hernandez-Pavon JC et al. | β | 2023 | β |
| Computational and behavioral markers of model-based decision making in childhood. | Smid CR et al. | β | 2023 | β |
| Corrective feedback guides human perceptual decision-making by informing about the world state rather than rewarding its choice. | Lee HJ et al. | β | 2023 | β |
| Cortical Grey Matter Mediates Increases in Model-Based Control and Learning from Positive Feedback from Adolescence to Adulthood. | Scholz V et al. | β | 2023 | β |
| Disrupted state transition learning as a computational marker of compulsivity. | Sharp PB et al. | β | 2023 | β |
| Distinct reinforcement learning profiles distinguish between language and attentional neurodevelopmental disorders. | Nissan N et al. | β | 2023 | β |
| Dopaminergic prediction errors in the ventral tegmental area reflect a multithreaded predictive model. | Takahashi YK et al. | β | 2023 | β |
| Dynamic Feedback Between Antidepressant Placebo Expectancies and Mood. | PeciΓ±a M et al. | β | 2023 | β |
| Emotions as computations. | Emanuel A et al. | β | 2023 | β |
| Experience-driven recalibration of learning from surprising events. | Bakst L et al. | β | 2023 | β |
| Food reinforcement architecture: A framework for impulsive and compulsive overeating and food abuse. | Burger KS | β | 2023 | β |
| Goal-directed and habitual decision making under stress in gambling disorder: An fMRI study. | van Timmeren T et al. | β | 2023 | β |
| Impairment of arbitration between model-based and model-free reinforcement learning in obsessive-compulsive disorder. | Ruan Z et al. | β | 2023 | β |
| Intrinsic rewards explain context-sensitive valuation in reinforcement learning. | Molinaro G et al. | β | 2023 | β |
| Learning when effort matters: neural dynamics underlying updating and adaptation to changes in performance efficacy. | Grahek I et al. | β | 2023 | β |
| Neural correlates of valence-dependent belief and value updating during uncertainty reduction: An fNIRS study. | Peng XR et al. | β | 2023 | β |
| Neural substrates of parallel devaluation-sensitive and devaluation-insensitive Pavlovian learning in humans. | Pool ER et al. | β | 2023 | β |
| Neurocognitive basis of model-based decision making and its metacontrol in childhood. | Smid CR et al. | β | 2023 | β |
| Prediction errors drive dynamic changes in neural patterns that guide behavior. | MΓΆhring L et al. | β | 2023 | β |
| Proselfs depend more on model-based than model-free learning in a non-social probabilistic state-transition task. | Oguchi M et al. | β | 2023 | β |
| Quantifying aberrant approach-avoidance conflict in psychopathology: A review of computational approaches. | Letkiewicz AM et al. | β | 2023 | β |
| Reinforcement Learning for Load-Balanced Parallel Particle Tracing. | Xu J et al. | β | 2023 | β |
| Resource limitations: A taxonomy. | Young ME et al. | β | 2023 | β |
| Rethinking model-based and model-free influences on mental effort and striatal prediction errors. | Feher da Silva C et al. | β | 2023 | β |
| Successor-like representation guides the prediction of future events in human visual cortex and hippocampus. | Ekman M et al. | β | 2023 | β |
| Surprise and novelty in the brain. | Modirshanechi A et al. | β | 2023 | β |
| The influence of aerobic exercise on model-based decision making in women with posttraumatic stress disorder. | Crombie KM et al. | β | 2023 | β |
| The neural architecture of theory-based reinforcement learning. | Tomov MS et al. | β | 2023 | β |
| The neural substrates of how model-based learning affects risk taking: Functional coupling between right cerebellum and left caudate. | Huo H et al. | β | 2023 | β |
| The right superior temporal gyrus plays a role in semantic-rule learning: Evidence supporting a reinforcement learning model. | Liu L et al. | β | 2023 | β |
| Towards a neurocomputational account of social controllability: From models to mental health. | Na S et al. | β | 2023 | β |
| A comparison of reinforcement learning models of human spatial navigation. | He Q et al. | β | 2022 | β |
| A Computational Model of Hopelessness and Active-Escape Bias in Suicidality. | Karvelis P et al. | β | 2022 | β |
| A computational model of inner speech supporting flexible goal-directed behaviour in Autism. | Granato G et al. | β | 2022 | β |
| An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits. | Guida P et al. | β | 2022 | β |
| Animal models of action control and cognitive dysfunction in Parkinson's disease. | Balleine BW | β | 2022 | β |
| An insula hierarchical network architecture for active interoceptive inference. | Fermin ASR et al. | β | 2022 | β |
| Beyond Description and Deficits: How Computational Psychiatry Can Enhance an Understanding of Decision-Making in Anorexia Nervosa. | Haynos AF et al. | β | 2022 | β |
| Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making. | Liakoni V et al. | β | 2022 | β |
| Communicative roots of complex sociality and cognition: neuropsychological mechanisms underpinning the processing of social information. | Roberts SGB et al. | β | 2022 | β |
| Computational approaches to treatment response prediction in major depression using brain activity and behavioral data: A systematic review. | Karvelis P et al. | β | 2022 | β |
| Conflict and competition between model-based and model-free control. | Lei Y et al. | β | 2022 | β |
| Control becomes habitual early on when learning a novel motor skill. | Yang CS et al. | β | 2022 | β |
| Dopaminergic challenge dissociates learning from primary versus secondary sources of information. | Rybicki AJ et al. | β | 2022 | β |
| Effort, success, and side of lesion determine arm choice in individuals with chronic stroke. | Kim S et al. | β | 2022 | β |
| Explicit knowledge of task structure is a primary determinant of human model-based action. | Castro-Rodrigues P et al. | β | 2022 | β |
| Exploration in neo-Hebbian reinforcement learning: Computational approaches to the exploration-exploitation balance with bio-inspired neural networks. | Triche A et al. | β | 2022 | β |
| Frontoparietal network activity during model-based reinforcement learning updates is reduced among adolescents with severe sexual abuse. | Letkiewicz AM et al. | β | 2022 | β |
| Hippocampal Contribution to Probabilistic Feedback Learning: Modeling Observation- and Reinforcement-based Processes. | Patt VM et al. | β | 2022 | β |
| Honeycomb: a template for reproducible psychophysiological tasks for clinic, laboratory, and home use. | Provenza NR et al. | β | 2022 | β |
| Importance of prefrontal meta control in human-like reinforcement learning. | Lee JH et al. | β | 2022 | β |
| Large-scale neural network computations and multivariate representations during approach-avoidance conflict decision-making. | Moughrabi N et al. | β | 2022 | β |
| Meta-control of social learning strategies. | Yaman A et al. | β | 2022 | β |
| Mixing memory and desire: How memory reactivation supports deliberative decision-making. | Wang S et al. | β | 2022 | β |
| Model-based learning retrospectively updates model-free values. | Doody M et al. | β | 2022 | β |
| Model Sharing in the Human Medial Temporal Lobe. | Glitz L et al. | β | 2022 | β |
| Need for cognition does not account for individual differences in metacontrol of decision making. | Bolenz F et al. | β | 2022 | β |
| Neurocomputations of strategic behavior: From iterated to novel interactions. | Jiang Y et al. | β | 2022 | β |
| Neuroprotection in late life attention-deficit/hyperactivity disorder: A review of pharmacotherapy and phenotype across the lifespan. | Dutta CN et al. | β | 2022 | β |
| On what motivates us: a detailed review of intrinsic <i>v.</i> extrinsic motivation. | Morris LS et al. | β | 2022 | β |
| People construct simplified mental representations to plan. | Ho MK et al. | β | 2022 | β |
| Planning in the brain. | Mattar MG et al. | β | 2022 | β |
| Post-error Slowing During Instrumental Learning is Shaped by Working Memory-based Choice Strategies. | McDougle SD | β | 2022 | β |
| Rational arbitration between statistics and rules in human sequence processing. | Maheu M et al. | β | 2022 | β |
| Reinforcement-learning in fronto-striatal circuits. | Averbeck B et al. | β | 2022 | β |
| Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3Β T and 7Β T. | Colas JT et al. | β | 2022 | β |
| Search for solutions, learning, simulation, and choice processes in suicidal behavior. | Dombrovski AY et al. | β | 2022 | β |
| Stress-sensitive inference of task controllability. | Ligneul R et al. | β | 2022 | β |
| The Neural Bases of Action-Outcome Learning in Humans. | Morris RW et al. | β | 2022 | β |
| The neuroanatomy of social trust predicts depression vulnerability. | Fermin ASR et al. | β | 2022 | β |
| The role of reinforcement learning and value-based decision-making frameworks in understanding food choice and eating behaviors. | Pearce AL et al. | β | 2022 | β |
| Understanding cingulotomy's therapeutic effect in OCD through computer models. | Sherif MA et al. | β | 2022 | β |
| Value estimation and latent-state update-related neural activity during fear conditioning predict posttraumatic stress disorder symptom severity. | Letkiewicz AM et al. | β | 2022 | β |
| What Happened When? Cerebral Processing of Modified Structure and Content in Episodic Cueing. | Siestrup S et al. | β | 2022 | β |
| A cortical circuit mechanism for structural knowledge-based flexible sensorimotor decision-making. | Liu Y et al. | β | 2021 | β |
| Addiction history moderates the effect of prefrontal 10-Hz transcranial alternating current stimulation on habitual action selection. | McKim TH et al. | β | 2021 | β |
| Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors. | Hong SI et al. | β | 2021 | β |
| Behavioral determinants in the expression of the Kamin blocking effect: Implications for associative learning theory. | Aggarwal M et al. | β | 2021 | β |
| Children's automatic evaluation of self-generated actions is different from adults. | Denervaud S et al. | β | 2021 | β |
| Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learning. | Iglesias S et al. | β | 2021 | β |
| Cross-species studies on orbitofrontal control of inference-based behavior. | Kahnt T et al. | β | 2021 | β |
| Deficient Goal-Directed Control in a Population Characterized by Extreme Goal Pursuit. | Foerde K et al. | β | 2021 | β |
| Design of complex neuroscience experiments using mixed-integer linear programming. | Slivkoff S et al. | β | 2021 | β |
| Dopamine, Prediction Error and Beyond. | Diederen KMJ et al. | β | 2021 | β |
| Effects of subclinical depression on prefrontal-striatal model-based and model-free learning. | Heo S et al. | β | 2021 | β |
| Efficiency and prioritization of inference-based credit assignment. | Moran R et al. | β | 2021 | β |
| Executive Function Assigns Value to Novel Goal-Congruent Outcomes. | McDougle SD et al. | β | 2021 | β |
| Fronto-striatal structures related with model-based control as an endophenotype for obsessive-compulsive disorder. | Kasal MI et al. | β | 2021 | β |
| Habit, choice, and addiction. | Vandaele Y et al. | β | 2021 | β |
| Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning. | PrΓ©vel A et al. | β | 2021 | β |
| Hippocampal contributions to social and cognitive deficits in autism spectrum disorder. | Banker SM et al. | β | 2021 | β |
| Hippocampus Guides Adaptive Learning during Dynamic Social Interactions. | FeldmanHall O et al. | β | 2021 | β |
| How social learning amplifies moral outrage expression in online social networks. | Brady WJ et al. | β | 2021 | β |
| Human subjects exploit a cognitive map for credit assignment. | Moran R et al. | β | 2021 | β |
| Humans use forward thinking to exploit social controllability. | Na S et al. | β | 2021 | β |
| Hunger improves reinforcement-driven but not planned action. | van Swieten MMH et al. | β | 2021 | β |
| Increased Ventromedial Prefrontal Cortex Activity in Adolescence Benefits Prosocial Reinforcement Learning. | Westhoff B et al. | β | 2021 | β |
| Individual Differences in Reward-Based Learning Predict Fluid Reasoning Abilities. | Stocco A et al. | β | 2021 | β |
| Individual differences in the perception of probability. | Khaw MW et al. | β | 2021 | β |
| Internality and the internalisation of failure: Evidence from a novel task. | Mancinelli F et al. | β | 2021 | β |
| Internal manipulation of perceptual representations in human flexible cognition: A computational model. | Granato G et al. | β | 2021 | β |
| Mapping Disease Course Across the Mood Disorder Spectrum Through a Research Domain Criteria Framework. | Whitton AE et al. | β | 2021 | β |
| Mnemonic prediction errors promote detailed memories. | Bein O et al. | β | 2021 | β |
| Model-Based and Model-Free Control Predicts Alcohol Consumption Developmental Trajectory in Young Adults: A 3-Year Prospective Study. | Chen H et al. | β | 2021 | β |
| Model based planners reflect on their model-free propensities. | Moran R et al. | β | 2021 | β |
| Modeling changes in probabilistic reinforcement learning during adolescence. | Xia L et al. | β | 2021 | β |
| Motor adaptation via distributional learning. | Mitchell BA et al. | β | 2021 | β |
| Negative urgency as a risk factor for hazardous alcohol use: Dual influences of cognitive control and reinforcement processing. | Rawls E et al. | β | 2021 | β |
| Neural Mechanisms of Human Decision-Making. | Herd S et al. | β | 2021 | β |
| Neural representation of prediction error signals in substance users. | Tolomeo S et al. | β | 2021 | β |
| Neurocognitive Mechanisms of Social Inferences in Typical and Autistic Adolescents. | Rosenblau G et al. | β | 2021 | β |
| New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds. | Wood AN | β | 2021 | β |
| Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making. | Xu HA et al. | β | 2021 | β |
| Orbitofrontal cortex and learning predictions of state transitions. | Chan SCY et al. | β | 2021 | β |
| Posttraumatic Stress Disorder and the Developing Adolescent Brain. | Cisler JM et al. | β | 2021 | β |
| Potential roles of the rodent medial prefrontal cortex in conflict resolution between multiple decision-making systems. | McLaughlin AE et al. | β | 2021 | β |
| Predicting Response to Brain Stimulation in Depression: a Roadmap for Biomarker Discovery. | Nord CL | β | 2021 | β |
| Prefrontal solution to the bias-variance tradeoff during reinforcement learning. | Kim D et al. | β | 2021 | β |
| Reward and fictive prediction error signals in ventral striatum: asymmetry between factual and counterfactual processing. | Santo-Angles A et al. | β | 2021 | β |
| Reward prediction errors drive declarative learning irrespective of agency. | Ergo K et al. | β | 2021 | β |
| Sign- and goal-tracking score does not correlate with addiction-like behavior following prolonged cocaine self-administration. | PohoΕalΓ‘ V et al. | β | 2021 | β |
| Signed Reward Prediction Errors in the Ventral Striatum Drive Episodic Memory. | Calderon CB et al. | β | 2021 | β |
| Stress reduces both model-based and model-free neural computations during flexible learning. | Cremer A et al. | β | 2021 | β |
| Temporal and state abstractions for efficient learning, transfer, and composition in humans. | Xia L et al. | β | 2021 | β |
| The Bayesian brain in imbalance: Medial, lateral and descending pathways in tinnitus and pain: A perspective. | De Ridder D et al. | β | 2021 | β |
| The neural basis of consciousness. | Frith CD | β | 2021 | β |
| The Versatile Wayfinder: Prefrontal Contributions to Spatial Navigation. | Patai EZ et al. | β | 2021 | β |
| Validating Habitual and Goal-Directed Decision-Making Performance Online in Healthy Older Adults. | Ito KL et al. | β | 2021 | β |
| Value network engagement and effects of memory-related processing during encoding and retrieval of value. | Conner LB et al. | β | 2021 | β |
| A Bayesian Account of Generalist and Specialist Formation Under the Active Inference Framework. | Chen AG et al. | β | 2020 | β |
| A computational model of language functions in flexible goal-directed behaviour. | Granato G et al. | β | 2020 | β |
| A neurally plausible schema-theoretic approach to modelling cognitive dysfunction and neurophysiological markers in Parkinson's disease. | Caso A et al. | β | 2020 | β |
| A Neuro-computational Account of Arbitration between Choice Imitation and Goal Emulation during Human Observational Learning. | Charpentier CJ et al. | β | 2020 | β |
| Anxiety, avoidance, and sequential evaluation. | Zorowitz S et al. | β | 2020 | β |
| Beyond dichotomies in reinforcement learning. | Collins AGE et al. | β | 2020 | β |
| Cell-Type-Specific Outcome Representation in the Primary Motor Cortex. | Levy S et al. | β | 2020 | β |
| "Chasing the first high": memory sampling in drug choice. | Bornstein AM et al. | β | 2020 | β |
| Combined model-free and model-sensitive reinforcement learning in non-human primates. | Miranda B et al. | β | 2020 | β |
| Competitive and cooperative interactions between medial temporal and striatal learning systems. | Freedberg M et al. | β | 2020 | β |
| Context effectsΒ on probability estimation. | Lin WH et al. | β | 2020 | β |
| Deep Reinforcement Learning and Its Neuroscientific Implications. | Botvinick M et al. | β | 2020 | β |
| Dissociating neural learning signals in human sign- and goal-trackers. | Schad DJ et al. | β | 2020 | β |
| EEG correlates of physical effort and reward processing during reinforcement learning. | Palidis DJ et al. | β | 2020 | β |
| Effort shapes social cognition and behaviour: A neuro-cognitive framework. | Contreras-Huerta LS et al. | β | 2020 | β |
| fMRI reveals language-specific predictive coding during naturalistic sentence comprehension. | Shain C et al. | β | 2020 | β |
| Goal-oriented and habitual decisions: Neural signatures of model-based and model-free learning. | Huang Y et al. | β | 2020 | β |
| Hierarchical models of pain: Inference, information-seeking, and adaptive control. | Seymour B et al. | β | 2020 | β |
| Improving the Reliability of Computational Analyses: Model-Based Planning and Its Relationship With Compulsivity. | Brown VM et al. | β | 2020 | β |
| Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems. | Rusu SI et al. | β | 2020 | β |
| Learning to lose control: A process-based account of behavioral addiction. | Perales JC et al. | β | 2020 | β |
| Mapping sign-tracking and goal-tracking onto human behaviors. | Colaizzi JM et al. | β | 2020 | β |
| Meta-analytic clustering dissociates brain activity and behavior profiles across reward processing paradigms. | Flannery JS et al. | β | 2020 | β |
| Model-free decision making is prioritized when learning to avoid harming others. | Lockwood PL et al. | β | 2020 | β |
| Mouse tracking reveals structure knowledge in the absence of model-based choice. | Konovalov A et al. | β | 2020 | β |
| Multiple systems in macaques for tracking prediction errors and other types of surprise. | Grohn J et al. | β | 2020 | β |
| Mutual benefits: Combining reinforcement learning with sequential sampling models. | MiletiΔ S et al. | β | 2020 | β |
| Neural encoding of task-dependent errors during adaptive learning. | Kao CH et al. | β | 2020 | β |
| Neurobiologically Inspired Self-Monitoring Systems. | Chiba AA et al. | β | 2020 | β |
| Neurocomputational Changes in Inhibitory Control Associated With Prolonged Exposure Therapy. | HarlΓ© KM et al. | β | 2020 | β |
| Parallel model-based and model-free reinforcement learning for card sorting performance. | Steinke A et al. | β | 2020 | β |
| Prefrontal Cortex Predicts State Switches during Reversal Learning. | Bartolo R et al. | β | 2020 | β |
| Quantifying the immediate computational effects of preceding outcomes on subsequent risky choices. | Brooks HR et al. | β | 2020 | β |
| Rationalization as representational exchange: Scope and mechanism. | Cushman F | β | 2020 | β |
| Reinforcement Learning-Based Control and Networking Co-design for Industrial Internet of Things. | Xu H et al. | β | 2020 | β |
| Social training reconfigures prediction errors to shape Self-Other boundaries. | Ereira S et al. | β | 2020 | β |
| Spatial planning with long visual range benefits escape from visual predators in complex naturalistic environments. | Mugan U et al. | β | 2020 | β |
| Striatal and hippocampal contributions to flexible navigation in rats and humans. | Gahnstrom CJ et al. | β | 2020 | β |
| The brain produces mind by modeling. | Shiffrin RM et al. | β | 2020 | β |
| The Differential Impact of a Response's Effectiveness and its Monetary Value on Response-Selection. | Karsh N et al. | β | 2020 | β |
| The influence of internal models on feedback-related brain activity. | Wurm F et al. | β | 2020 | β |
| The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals. | Groman SM | β | 2020 | β |
| The neurochemical substrates of habitual and goal-directed control. | Voon V et al. | β | 2020 | β |
| Theory of mind and decision science: Towards a typology of tasks and computational models. | Rusch T et al. | β | 2020 | β |
| The roles of online and offline replay in planning. | Eldar E et al. | β | 2020 | β |
| The value of what's to come: Neural mechanisms coupling prediction error and the utility of anticipation. | Iigaya K et al. | β | 2020 | β |
| The ventral striatum dissociates information expectation, reward anticipation, and reward receipt. | Filimon F et al. | β | 2020 | β |
| Toward a Computational Neuropsychology of Cognitive Flexibility. | Steinke A et al. | β | 2020 | β |
| Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices. | Zhang L et al. | β | 2020 | β |
| When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey. | Zhang C et al. | β | 2020 | β |
| Action in auctions: neural and computational mechanisms of bidding behaviour. | Martinez-Saito M et al. | β | 2019 | β |
| A flexible and generalizable model of online latent-state learning. | Cochran AL et al. | β | 2019 | β |
| A Novel Model for Arbitration Between Planning and Habitual Control Systems. | Sheikhnezhad Fard F et al. | β | 2019 | β |
| Artificial Development by Reinforcement Learning Can Benefit From Multiple Motivations. | Palm G et al. | β | 2019 | β |
| Assessing inter-individual differences with task-related functional neuroimaging. | Lebreton M et al. | β | 2019 | β |
| Balancing model-based and memory-free action selection under competitive pressure. | Kikumoto A et al. | β | 2019 | β |
| Bayesian computational markers of relapse in methamphetamine dependence. | HarlΓ© KM et al. | β | 2019 | β |
| Bayesian modeling of temporal expectations in the human brain. | Visalli A et al. | β | 2019 | β |
| Dopamine neuron ensembles signal the content of sensory prediction errors. | Stalnaker TA et al. | β | 2019 | β |
| Encoding prediction signals during appetitive and aversive Pavlovian conditioning in the primate lateral hypothalamus. | Noritake A et al. | β | 2019 | β |
| Entorhinal transformations in abstract frames of reference. | Kaplan R et al. | β | 2019 | β |
| Evidence for model-based encoding of Pavlovian contingencies in the human brain. | Pauli WM et al. | β | 2019 | β |
| Fast and Flexible Multi-Step Cloth Manipulation Planning Using an Encode-Manipulate-Decode Network (EM*D Net). | Arnold S et al. | β | 2019 | β |
| Fractionating adaptive learning: A meta-analysis of the reversal learning paradigm. | Yaple ZA et al. | β | 2019 | β |
| Hippocampal Contributions to Model-Based Planning and Spatial Memory. | Vikbladh OM et al. | β | 2019 | β |
| How We Know What Not To Think. | Phillips J et al. | β | 2019 | β |
| Impulsivity and Active Inference. | Mirza MB et al. | β | 2019 | β |
| L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action. | Kroemer NB et al. | β | 2019 | β |
| Learning and forgetting using reinforced Bayesian change detection. | Moens V et al. | β | 2019 | β |
| Learning to use past evidence in a sophisticated world model. | Ahilan S et al. | β | 2019 | β |
| Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model. | Sales AC et al. | β | 2019 | β |
| Loss Aversion Correlates With the Propensity to Deploy Model-Based Control. | Solway A et al. | β | 2019 | β |
| Macaque anterior cingulate cortex deactivation impairs performance and alters lateral prefrontal oscillatory activities in a rule-switching task. | Ma L et al. | β | 2019 | β |
| Metacontrol of decision-making strategies in human aging. | Bolenz F et al. | β | 2019 | β |
| Model-Free and Model-Based Influences in Addiction-Related Behaviors. | Groman SM et al. | β | 2019 | β |
| Model-Free RL or Action Sequences? | Morris A et al. | β | 2019 | β |
| Monetary feedback modulates performance and electrophysiological indices of belief updating in reward learning. | Bennett D et al. | β | 2019 | β |
| Musical reward prediction errors engage the nucleus accumbens and motivate learning. | Gold BP et al. | β | 2019 | β |
| Neural computations underlying strategic social decision-making in groups. | Park SA et al. | β | 2019 | β |
| Neural modulation of social reinforcement learning by intranasal oxytocin in male adults with high-functioning autism spectrum disorder: a randomized trial. | Kruppa JA et al. | β | 2019 | β |
| Neurochemical and Behavioral Dissections of Decision-Making in a Rodent Multistage Task. | Groman SM et al. | β | 2019 | β |
| No substantial change in the balance between model-free and model-based control via training on the two-step task. | Grosskurth ED et al. | β | 2019 | β |
| One-shot learning and behavioral eligibility traces in sequential decision making. | Lehmann MP et al. | β | 2019 | β |
| Reinforcement Learning, Fast and Slow. | Botvinick M et al. | β | 2019 | β |
| Reply to de Fleurian et al.: Toward a fuller understanding of reward prediction errors and their role in musical pleasure. | Gold BP et al. | β | 2019 | β |
| Retrospective model-based inference guides model-free credit assignment. | Moran R et al. | β | 2019 | β |
| Revisiting the relationship between the P3b and working memory updating. | Rac-Lubashevsky R et al. | β | 2019 | β |
| Sensitivity to structure in action sequences: An infant event-related potential study. | Monroy CD et al. | β | 2019 | β |
| Substance use is associated with reduced devaluation sensitivity. | Byrne KA et al. | β | 2019 | β |
| Task complexity interacts with state-space uncertainty in the arbitration between model-based and model-free learning. | Kim D et al. | β | 2019 | β |
| Task-specific prioritization of reward and effort information: Novel insights from behavior and computational modeling. | Vassena E et al. | β | 2019 | β |
| The effect of frontoparietal paired associative stimulation on decision-making and working memory. | Nord CL et al. | β | 2019 | β |
| The roles of supervised machine learning in systems neuroscience. | Glaser JI et al. | β | 2019 | β |
| Translational tests involving non-reward: methodological considerations. | Phillips BU et al. | β | 2019 | β |
| Uncovering the structure of self-regulation through data-driven ontology discovery. | Eisenberg IW et al. | β | 2019 | β |
| A Control Theoretic Model of Adaptive Learning in Dynamic Environments. | Ritz H et al. | β | 2018 | β |
| Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task. | Viejo G et al. | β | 2018 | β |
| Agent-specific learning signals for self-other distinction during mentalising. | Ereira S et al. | β | 2018 | β |
| Altered neural encoding of prediction errors in assault-related posttraumatic stress disorder. | Ross MC et al. | β | 2018 | β |
| A model of risk and mental state shifts during social interaction. | Hula A et al. | β | 2018 | β |
| A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning. | Zhang Z et al. | β | 2018 | β |
| Behavioural signatures of backward planning in animals. | Afsardeir A et al. | β | 2018 | β |
| Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning. | Ballard I et al. | β | 2018 | β |
| Compositional clustering in task structure learning. | Franklin NT et al. | β | 2018 | β |
| Computational neuroscience approaches to social cognition. | Hackel LM et al. | β | 2018 | β |
| Contrasting temporal difference and opportunity cost reinforcement learning in an empirical money-emergence paradigm. | Lefebvre G et al. | β | 2018 | β |
| Contribution of explicit processes to reinforcement-based motor learning. | Holland P et al. | β | 2018 | β |
| Decoding Cognitive Processes from Neural Ensembles. | Wallis JD | β | 2018 | β |
| Defining the place of habit in substance use disorders. | Vandaele Y et al. | β | 2018 | β |
| Deliberation and Procedural Automation on a Two-Step Task for Rats. | Hasz BM et al. | β | 2018 | β |
| Dissociable learning processes in comparative psychology. | Smith JD et al. | β | 2018 | β |
| Distal Functional Connectivity of Known and Emerging Cortical Targets for Therapeutic Noninvasive Stimulation. | DoΓ±amayor N et al. | β | 2018 | β |
| Dopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia. | Nour MM et al. | β | 2018 | β |
| Encoding of Multiple Reward-Related Computations in Transient and Sustained High-Frequency Activity in Human OFC. | Saez I et al. | β | 2018 | β |
| Enhanced transformation of incidentally learned knowledge into explicit memory by dopaminergic modulation. | Clos M et al. | β | 2018 | β |
| Formalizing the Function of Anterior Insula in Rapid Adaptation. | Bossaerts P | β | 2018 | β |
| Frontal cortex function as derived from hierarchical predictive coding. | Alexander WH et al. | β | 2018 | β |
| Habit strength is predicted by activity dynamics in goal-directed brain systems during training. | Zwosta K et al. | β | 2018 | β |
| Heuristic and optimal policy computations in the human brain during sequential decision-making. | Korn CW et al. | β | 2018 | β |
| Identity prediction errors in the human midbrain update reward-identity expectations in the orbitofrontal cortex. | Howard JD et al. | β | 2018 | β |
| Information processing biases in the brain: Implications for decision-making and self-governance. | Sali AW et al. | β | 2018 | β |
| Interaction of the Left Dorsolateral Prefrontal Cortex (l-DLPFC) and Right Orbitofrontal Cortex (OFC) in Hot and Cold Executive Functions: Evidence from Transcranial Direct Current Stimulation (tDCS). | Nejati V et al. | β | 2018 | β |
| Interactions of spatial strategies producing generalization gradient and blocking: A computational approach. | DollΓ© L et al. | β | 2018 | β |
| Learning what to approach. | Eshel N et al. | β | 2018 | β |
| Manipulating memory efficacy affects the behavioral and neural profiles of deterministic learning and decision-making. | Tremel JJ et al. | β | 2018 | β |
| Model-based and model-free pain avoidance learning. | Wang O et al. | β | 2018 | β |
| Model-based predictions for dopamine. | Langdon AJ et al. | β | 2018 | β |
| Model-free and model-based reward prediction errors in EEG. | Sambrook TD et al. | β | 2018 | β |
| Neural Computations Underlying Causal Structure Learning. | Tomov MS et al. | β | 2018 | β |
| Neural signatures of reinforcement learning correlate with strategy adoption during spatial navigation. | Anggraini D et al. | β | 2018 | β |
| Offline replay supports planning in human reinforcement learning. | Momennejad I et al. | β | 2018 | β |
| Orbitofrontal neurons signal reward predictions, not reward prediction errors. | Stalnaker TA et al. | β | 2018 | β |
| Planning Complexity Registers as a Cost in Metacontrol. | Kool W et al. | β | 2018 | β |
| Propagation of Economic Inequality Through Reciprocity and Reputation. | Hackel LM et al. | β | 2018 | β |
| Recalibrating timing behavior via expected covariance between temporal cues. | De Corte BJ et al. | β | 2018 | β |
| Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences. | Bavard S et al. | β | 2018 | β |
| Rethinking dopamine as generalized prediction error. | Gardner MPH et al. | β | 2018 | β |
| Roles of centromedian parafascicular nuclei of thalamus and cholinergic interneurons in the dorsal striatum in associative learning of environmental events. | Yamanaka K et al. | β | 2018 | β |
| Separate neural representations of prediction error valence and surprise: Evidence from an fMRI meta-analysis. | Fouragnan E et al. | β | 2018 | β |
| Spontaneous integration of temporal information: implications for representational/computational capacity of animals. | GΓΌr E et al. | β | 2018 | β |
| The alcoholic brain: neural bases of impaired reward-based decision-making in alcohol use disorders. | Galandra C et al. | β | 2018 | β |
| The control of tonic pain by active relief learning. | Zhang S et al. | β | 2018 | β |
| The involuntary nature of binge drinking: goal directedness and awareness of intention. | DoΓ±amayor N et al. | β | 2018 | β |
| The multiple effects of practice: skill, habit and reduced cognitive load. | Haith AM et al. | β | 2018 | β |
| The relationship between reinforcement and explicit control during visuomotor adaptation. | Codol O et al. | β | 2018 | β |
| Understanding psychiatric disorder by capturing ecologically relevant features of learning and decision-making. | Scholl J et al. | β | 2018 | β |
| A map of abstract relational knowledge in the human hippocampal-entorhinal cortex. | Garvert MM et al. | β | 2017 | β |
| A simple computational algorithm of model-based choice preference. | Toyama A et al. | β | 2017 | β |
| Basic reversal-learning capacity in flies suggests rudiments of complex cognition. | Foley BR et al. | β | 2017 | β |
| CACNA1C gene regulates behavioral strategies in operant rule learning. | Koppe G et al. | β | 2017 | β |
| Cognitive components underpinning the development of model-based learning. | Potter TCS et al. | β | 2017 | β |
| Computational neuroimaging strategies for single patient predictions. | Stephan KE et al. | β | 2017 | β |
| Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex. | Caligiore D et al. | β | 2017 | β |
| Cost-Benefit Arbitration Between Multiple Reinforcement-Learning Systems. | Kool W et al. | β | 2017 | β |
| Developmental Changes in Learning: Computational Mechanisms and Social Influences. | Bolenz F et al. | β | 2017 | β |
| Distinct cortico-striatal connections with subthalamic nucleus underlie facets of compulsivity. | Morris LS et al. | β | 2017 | β |
| Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI. | Colas JT et al. | β | 2017 | β |
| Dopamine transients are sufficient and necessary for acquisition of model-based associations. | Sharpe MJ et al. | β | 2017 | β |
| Effects of inference on dopaminergic prediction errors depend on orbitofrontal processing. | Takahashi YK et al. | β | 2017 | β |
| Electrophysiological correlates reflect the integration of model-based and model-free decision information. | Eppinger B et al. | β | 2017 | β |
| Explicit and implicit reinforcement learning across the psychosis spectrum. | Barch DM et al. | β | 2017 | β |
| Exploration and recency as the main proximate causes of probability matching: a reinforcement learning analysis. | Feher da Silva C et al. | β | 2017 | β |
| Exploring Feature Dimensions to Learn a New Policy in an Uninformed Reinforcement Learning Task. | Choung OH et al. | β | 2017 | β |
| Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans. | Lee JJ et al. | β | 2017 | β |
| Functions of Learning Rate in Adaptive Reward Learning. | Wu X et al. | β | 2017 | β |
| Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation. | Howard JD et al. | β | 2017 | β |
| Imaginative Reinforcement Learning: Computational Principles and Neural Mechanisms. | Gershman SJ et al. | β | 2017 | β |
| Integrative Modeling of Prefrontal Cortex. | Alexander WH et al. | β | 2017 | β |
| Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia. | Collins AGE et al. | β | 2017 | β |
| Lateral orbitofrontal cortex anticipates choices and integrates prior with current information. | Nogueira R et al. | β | 2017 | β |
| Learning about Expectation Violation from Prediction Error Paradigms - A Meta-Analysis on Brain Processes Following a Prediction Error. | D'Astolfo L et al. | β | 2017 | β |
| Learning, Reward, and Decision Making. | O'Doherty JP et al. | β | 2017 | β |
| Minimizing endpoint variability through reinforcement learning during reaching movements involving shoulder, elbow and wrist. | Mehler DMA et al. | β | 2017 | β |
| Model-Based Control in Dimensional Psychiatry. | Voon V et al. | β | 2017 | β |
| Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty. | Kobayashi K et al. | β | 2017 | β |
| Neural substrates of updating the prediction through prediction error during decision making. | Wang Y et al. | β | 2017 | β |
| Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features. | Chang CY et al. | β | 2017 | β |
| Predictive representations can link model-based reinforcement learning to model-free mechanisms. | Russek EM et al. | β | 2017 | β |
| Reconsidering the Imaging Evidence Used to Implicate Prediction Error as the Driving Force behind Learning. | Δevora J et al. | β | 2017 | β |
| Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework. | Gershman SJ et al. | β | 2017 | β |
| Reminders of past choices bias decisions for reward in humans. | Bornstein AM et al. | β | 2017 | β |
| Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package. | Ahn WY et al. | β | 2017 | β |
| Reversal learning reveals cognitive deficits and altered prediction error encoding in the ventral striatum in Huntington's disease. | Nickchen K et al. | β | 2017 | β |
| Reversal learning strategy in adolescence is associated with prefrontal cortex activation. | Boehme R et al. | β | 2017 | β |
| Short-term reward experience biases inference despite dissociable neural correlates. | Fischer AG et al. | β | 2017 | β |
| Simulating future value in intertemporal choice. | Solway A et al. | β | 2017 | β |
| Social learning through prediction error in the brain. | Joiner J et al. | β | 2017 | β |
| Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans. | Fouragnan E et al. | β | 2017 | β |
| Statistical learning in social action contexts. | Monroy C et al. | β | 2017 | β |
| Suppression of Striatal Prediction Errors by the Prefrontal Cortex in Placebo Hypoalgesia. | Schenk LA et al. | β | 2017 | β |
| The hierarchical basis of neurovisceral integration. | Smith R et al. | β | 2017 | β |
| The hippocampus as a predictive map. | Stachenfeld KL et al. | β | 2017 | β |
| The successor representation in human reinforcement learning. | Momennejad I et al. | β | 2017 | β |
| Toddlers' action prediction: Statistical learning of continuous action sequences. | Monroy CD et al. | β | 2017 | β |
| Top-down control over feedback processing: The probability of valid feedback affects feedback-related brain activity. | Ernst B et al. | β | 2017 | β |
| Variation in Event-Related Potentials by State Transitions. | Higashi H et al. | β | 2017 | β |
| What to Choose Next? A Paradigm for Testing Human Sequential Decision Making. | Tartaglia EM et al. | β | 2017 | β |
| When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence. | Sebold M et al. | β | 2017 | β |
| Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia. | Segarra N et al. | β | 2016 | β |
| Active inference and learning. | Friston K et al. | β | 2016 | β |
| Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum. | Keramati M et al. | β | 2016 | β |
| Altered behavioral and neural responsiveness to counterfactual gains in the elderly. | Tobia MJ et al. | β | 2016 | β |
| Analysis of complex neural circuits with nonlinear multidimensional hidden state models. | Friedman A et al. | β | 2016 | β |
| Computational substrates of social norm enforcement by unaffected third parties. | Zhong S et al. | β | 2016 | β |
| De Novo Emergence of Odor Category Representations in the Human Brain. | Qu LP et al. | β | 2016 | β |
| Don't Think, Just Feel the Music: Individuals with Strong Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning. | Sebold M et al. | β | 2016 | β |
| Dopamine dependence in aggregate feedback learning: A computational cognitive neuroscience approach. | Valentin VV et al. | β | 2016 | β |
| Feedback learning and behavior problems after pediatric traumatic brain injury. | KΓΆnigs M et al. | β | 2016 | β |
| Frontostriatal anatomical connections predict age- and difficulty-related differences in reinforcement learning. | van de Vijver I et al. | β | 2016 | β |
| Fronto-striatal organization: Defining functional and microstructural substrates of behavioural flexibility. | Morris LS et al. | β | 2016 | β |
| Functional connectivity between prefrontal cortex and striatum estimated by phase locking value. | Zhang Y et al. | β | 2016 | β |
| Gaze data reveal distinct choice processes underlying model-based and model-free reinforcement learning. | Konovalov A et al. | β | 2016 | β |
| Getting to know you: general and specific neural computations for learning about people. | Stanley DA | β | 2016 | β |
| Goal-Directed Decision Making with Spiking Neurons. | Friedrich J et al. | β | 2016 | β |
| How learning shapes the empathic brain. | Hein G et al. | β | 2016 | β |
| Human Choice Strategy Varies with Anatomical Projections from Ventromedial Prefrontal Cortex to Medial Striatum. | Piray P et al. | β | 2016 | β |
| Imagery May Arise from Associations Formed through Sensory Experience: A Network of Spiking Neurons Controlling a Robot Learns Visual Sequences in Order to Perform a Mental Rotation Task. | McKinstry JL et al. | β | 2016 | β |
| Intact Ventral Striatal Prediction Error Signaling in Medicated Schizophrenia Patients. | Culbreth AJ et al. | β | 2016 | β |
| Interaction of Instrumental and Goal-Directed Learning Modulates Prediction Error Representations in the Ventral Striatum. | Guo R et al. | β | 2016 | β |
| Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia. | Barch DM et al. | β | 2016 | β |
| Model-based action planning involves cortico-cerebellar and basal ganglia networks. | Fermin AS et al. | β | 2016 | β |
| Motor-evoked potentials reveal a motor-cortical readout of evidence accumulation for sensorimotor decisions. | Hadar AA et al. | β | 2016 | β |
| Network mechanisms of intentional learning. | Hampshire A et al. | β | 2016 | β |
| Neural Basis of Strategic Decision Making. | Lee D et al. | β | 2016 | β |
| Neural correlates of state-based decision-making in younger and older adults. | Worthy DA et al. | β | 2016 | β |
| Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network. | Balaguer J et al. | β | 2016 | β |
| Neural signatures of experience-based improvements in deterministic decision-making. | Tremel JJ et al. | β | 2016 | β |
| Neural substrates of cognitive biases during probabilistic inference. | Soltani A et al. | β | 2016 | β |
| Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex. | Wikenheiser AM et al. | β | 2016 | β |
| Prefrontal executive function and adaptive behavior in complex environments. | Koechlin E | β | 2016 | β |
| 'Proactive' use of cue-context congruence for building reinforcement learning's reward function. | Zsuga J et al. | β | 2016 | β |
| Probabilistic Models and Generative Neural Networks: Towards an Unified Framework for Modeling Normal and Impaired Neurocognitive Functions. | Testolin A et al. | β | 2016 | β |
| Psychosurgery Reduces Uncertainty and Increases Free Will? A Review. | De Ridder D et al. | β | 2016 | β |
| Reduced model-based decision-making in schizophrenia. | Culbreth AJ et al. | β | 2016 | β |
| Social Cognition as Reinforcement Learning: Feedback Modulates Emotion Inference. | Zaki J et al. | β | 2016 | β |
| Striatal Associative Learning Signals Are Tuned to In-groups. | Powers KE et al. | β | 2016 | β |
| Striatal prediction errors support dynamic control of declarative memory decisions. | Scimeca JM et al. | β | 2016 | β |
| The Computational Complexity of Valuation and Motivational Forces in Decision-Making Processes. | Redish AD et al. | β | 2016 | β |
| The Computational Development of Reinforcement Learning during Adolescence. | Palminteri S et al. | β | 2016 | β |
| The fate of memory: Reconsolidation and the case of Prediction Error. | FernΓ‘ndez RS et al. | β | 2016 | β |
| The Feedback-related Negativity Codes Components of Abstract Inference during Reward-based Decision-making. | Reiter AM et al. | β | 2016 | β |
| The interaction of perceived control and Gambler's fallacy in risky decision making: An fMRI study. | Shao R et al. | β | 2016 | β |
| The involvement of model-based but not model-free learning signals during observational reward learning in the absence of choice. | Dunne S et al. | β | 2016 | β |
| The left hemisphere learns what is right: Hemispatial reward learning depends on reinforcement learning processes in the contralateral hemisphere. | Aberg KC et al. | β | 2016 | β |
| The Response of the Left Ventral Attentional System to Invalid Targets and its Implication for the Spatial Neglect Syndrome: a Multivariate fMRI Investigation. | Silvetti M et al. | β | 2016 | β |
| The role of habit in compulsivity. | Gillan CM et al. | β | 2016 | β |
| The role of time in conflict-triggered control: Extending the theory of response-conflict monitoring. | Zendehrouh S et al. | β | 2016 | β |
| Toward isolating the role of dopamine in the acquisition of incentive salience attribution. | Chow JJ et al. | β | 2016 | β |
| Towards an understanding of the neural dynamics of intentional learning: Considering the timescale. | Ruge H et al. | β | 2016 | β |
| Translatable and Back-Translatable Measurement of Impulsivity and Compulsivity: Convergent and Divergent Processes. | Voon V et al. | β | 2016 | β |
| Two Anatomically and Computationally Distinct Learning Signals Predict Changes to Stimulus-Outcome Associations in Hippocampus. | Boorman ED et al. | β | 2016 | β |
| Using fMRI to study reward processing in humans: past, present, and future. | Wang KS et al. | β | 2016 | β |
| Valence-dependent influence of serotonin depletion on model-based choice strategy. | Worbe Y et al. | β | 2016 | β |
| Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning. | Doll BB et al. | β | 2016 | β |
| Ventral striatal lesions disrupt dopamine neuron signaling of differences in cue value caused by changes in reward timing but not number. | Takahashi YK et al. | β | 2016 | β |
| When Does Model-Based Control Pay Off? | Kool W et al. | β | 2016 | β |
| A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders. | Story GW et al. | β | 2015 | β |
| Active Inference, homeostatic regulation and adaptive behavioural control. | Pezzulo G et al. | β | 2015 | β |
| Age-related prefrontal impairments implicate deficient prediction of future reward in older adults. | Eppinger B et al. | β | 2015 | β |
| A new computational account of cognitive control over reinforcement-based decision-making: Modeling of a probabilistic learning task. | Zendehrouh S | β | 2015 | β |
| Anticipating conflict: Neural correlates of a Bayesian belief and its motor consequence. | Hu S et al. | β | 2015 | β |
| Characterizing the associative content of brain structures involved in habitual and goal-directed actions in humans: a multivariate FMRI study. | McNamee D et al. | β | 2015 | β |
| Character studies. | Hsu M et al. | β | 2015 | β |
| Chronic motivational state interacts with task reward structure in dynamic decision-making. | Cooper JA et al. | β | 2015 | β |
| Cognitive control predicts use of model-based reinforcement learning. | Otto AR et al. | β | 2015 | β |
| Cognitive flexibility in adolescence: neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development. | Hauser TU et al. | β | 2015 | β |
| Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times. | Cavanagh JF | β | 2015 | β |
| Disorders of compulsivity: a common bias towards learning habits. | Voon V et al. | β | 2015 | β |
| Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum. | Tanaka S et al. | β | 2015 | β |
| Dissociating contributions of ventral and dorsal striatum to reward learning. | Chen C et al. | β | 2015 | β |
| Distinct fronto-striatal couplings reveal the double-faced nature of response-outcome relations in instruction-based learning. | Ruge H et al. | β | 2015 | β |
| Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex. | Donahue CH et al. | β | 2015 | β |
| Evidence integration in model-based tree search. | Solway A et al. | β | 2015 | β |
| Explicit and Implicit Processes Constitute the Fast and Slow Processes of Sensorimotor Learning. | McDougle SD et al. | β | 2015 | β |
| Goal-directed, habitual and Pavlovian prosocial behavior. | GΔsiarz F et al. | β | 2015 | β |
| Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences. | Desrochers TM et al. | β | 2015 | β |
| Habitual control of goal selection in humans. | Cushman F et al. | β | 2015 | β |
| Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex. | Alexander WH et al. | β | 2015 | β |
| How self-determined choice facilitates performance: a key role of the ventromedial prefrontal cortex. | Murayama K et al. | β | 2015 | β |
| Human and machine learning in non-Markovian decision making. | Clarke AM et al. | β | 2015 | β |
| Human Frontal-Subcortical Circuit and Asymmetric Belief Updating. | Moutsiana C et al. | β | 2015 | β |
| Implicit Value Updating Explains Transitive Inference Performance: The Betasort Model. | Jensen G et al. | β | 2015 | β |
| Lateral prefrontal model-based signatures are reduced in healthy individuals with high trait impulsivity. | Deserno L et al. | β | 2015 | β |
| Model-based choices involve prospective neural activity. | Doll BB et al. | β | 2015 | β |
| Model-based learning protects against forming habits. | Gillan CM et al. | β | 2015 | β |
| Model-Based Reasoning in Humans Becomes Automatic with Training. | Economides M et al. | β | 2015 | β |
| Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning. | Viejo G et al. | β | 2015 | β |
| Modeling the Evolution of Beliefs Using an Attentional Focus Mechanism. | MarkoviΔ D et al. | β | 2015 | β |
| Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange. | Hula A et al. | β | 2015 | β |
| Multiple brain networks contribute to the acquisition of bias in perceptual decision-making. | Chen MY et al. | β | 2015 | β |
| Multiple memory systems as substrates for multiple decision systems. | Doll BB et al. | β | 2015 | β |
| Neural mechanisms underlying human consensus decision-making. | Suzuki S et al. | β | 2015 | β |
| Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum. | Ito M et al. | β | 2015 | β |
| Reinforcement learning in depression: A review of computational research. | Chen C et al. | β | 2015 | β |
| Reward feedback accelerates motor learning. | Nikooyan AA et al. | β | 2015 | β |
| Reward processing deficits and impulsivity in high-risk offspring of alcoholics: A study of event-related potentials during a monetary gambling task. | Kamarajan C et al. | β | 2015 | β |
| Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task. | Akam T et al. | β | 2015 | β |
| Single-Trial Event-Related Potential Correlates of Belief Updating(1,2,3). | Bennett D et al. | β | 2015 | β |
| Solving the detour problem in navigation: a model of prefrontal and hippocampal interactions. | Spiers HJ et al. | β | 2015 | β |
| Structural Connectivity Changes Underlying Altered Working Memory Networks in Mild Cognitive Impairment: A Three-Way Image Fusion Analysis. | Teipel S et al. | β | 2015 | β |
| The neural correlates of emotion alignment in social interaction. | Prehn K et al. | β | 2015 | β |
| The Virtual Teacher (VT) Paradigm: Learning New Patterns of Interpersonal Coordination Using the Human Dynamic Clamp. | Kostrubiec V et al. | β | 2015 | β |
| Valence and agency influence striatal response to feedback in patients with major depressive disorder. | SpΓ€ti J et al. | β | 2015 | β |
| Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. | Deserno L et al. | β | 2015 | β |
| Walking bundles of habits (and response-outcome associations) (Commentary on Liljeholm et al.). | Bornstein AM et al. | β | 2015 | β |
| Action-value comparisons in the dorsolateral prefrontal cortex control choice between goal-directed actions. | Morris RW et al. | β | 2014 | β |
| Adult age differences in learning on a sequentially cued prediction task. | Seaman KL et al. | β | 2014 | β |
| A general role for medial prefrontal cortex in event prediction. | Alexander WH et al. | β | 2014 | β |
| Age-related variations of visuo-motor adaptation beyond explicit knowledge. | Heuer H et al. | β | 2014 | β |
| Altruism costs-the cheap signal from amygdala. | Gospic K et al. | β | 2014 | β |
| Anterior cingulate cortex instigates adaptive switches in choice by integrating immediate and delayed components of value in ventromedial prefrontal cortex. | Economides M et al. | β | 2014 | β |
| Attentional modulation of reward processing in the human brain. | Rothkirch M et al. | β | 2014 | β |
| A universal role of the ventral striatum in reward-based learning: evidence from human studies. | Daniel R et al. | β | 2014 | β |
| Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task. | Gu X et al. | β | 2014 | β |
| Computational approaches to psychiatry. | Stephan KE et al. | β | 2014 | β |
| Computational psychiatry. | Wang XJ et al. | β | 2014 | β |
| Cultural influences on social feedback processing of character traits. | Korn CW et al. | β | 2014 | β |
| Decisions about decisions. | Yoshida W et al. | β | 2014 | β |
| Devaluation and sequential decisions: linking goal-directed and model-based behavior. | Friedel E et al. | β | 2014 | β |
| Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective. | Story GW et al. | β | 2014 | β |
| Dopamine modulates the neural representation of subjective value of food in hungry subjects. | Medic N et al. | β | 2014 | β |
| Effects of emotion on prospection during decision-making. | Worthy DA et al. | β | 2014 | β |
| Emotion and decision making: multiple modulatory neural circuits. | Phelps EA et al. | β | 2014 | β |
| Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. | Wimmer GE et al. | β | 2014 | β |
| Excessive state switching underlies reversal learning deficits in cocaine users. | Patzelt EH et al. | β | 2014 | β |
| Expectation mismatch: differences between self-generated and cue-induced expectations. | Gaschler R et al. | β | 2014 | β |
| Finding minimal action sequences with a simple evaluation of actions. | Shah A et al. | β | 2014 | β |
| From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex. | Silvetti M et al. | β | 2014 | β |
| Frontal theta oscillatory activity is a common mechanism for the computation of unexpected outcomes and learning rate. | Mas-Herrero E et al. | β | 2014 | β |
| Mediofrontal negativity signals unexpected omission of aversive events. | Garofalo S et al. | β | 2014 | β |
| Model-based and model-free Pavlovian reward learning: revaluation, revision, and revelation. | Dayan P et al. | β | 2014 | β |
| Model-based hierarchical reinforcement learning and human action control. | Botvinick M et al. | β | 2014 | β |
| Modelling individual differences in the form of Pavlovian conditioned approach responses: a dual learning systems approach with factored representations. | Lesaint F et al. | β | 2014 | β |
| Multiplexing signals in reinforcement learning with internal models and dopamine. | Nakahara H | β | 2014 | β |
| Navigating complex decision spaces: Problems and paradigms in sequential choice. | Walsh MM et al. | β | 2014 | β |
| Neural computations underlying arbitration between model-based and model-free learning. | Lee SW et al. | β | 2014 | β |
| Neural evidence for adaptive strategy selection in value-based decision-making. | Gluth S et al. | β | 2014 | β |
| Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning. | Atallah HE et al. | β | 2014 | β |
| Physiological and behavioral signatures of reflective exploratory choice. | Otto AR et al. | β | 2014 | β |
| Rationalizable irrationalities of choice. | Dayan P | β | 2014 | β |
| Reinforcement learning and human behavior. | Shteingart H et al. | β | 2014 | β |
| Reward expectation and prediction error in human medial frontal cortex: an EEG study. | Silvetti M et al. | β | 2014 | β |
| SAwSu: an integrated model of associative and reinforcement learning. | Veksler VD et al. | β | 2014 | β |
| Sequential decisions: a computational comparison of observational and reinforcement accounts. | Mohammadi Sepahvand N et al. | β | 2014 | β |
| State-based versus reward-based motivation in younger and older adults. | Worthy DA et al. | β | 2014 | β |
| Sticking with the nice guy: trait warmth information impairs learning and modulates person perception brain network activity. | Lee VK et al. | β | 2014 | β |
| Surprise beyond prediction error. | Chumbley JR et al. | β | 2014 | β |
| The algorithmic anatomy of model-based evaluation. | Daw ND et al. | β | 2014 | β |
| The anatomy of choice: dopamine and decision-making. | Friston K et al. | β | 2014 | β |
| The feedback-related negativity (FRN) revisited: new insights into the localization, meaning and network organization. | Hauser TU et al. | β | 2014 | β |
| The Michelin red guide of the brain: role of dopamine in goal-oriented navigation. | Retailleau A et al. | β | 2014 | β |
| The role of habits and motivation in human drug addiction: a reflection. | Sjoerds Z et al. | β | 2014 | β |
| The role of learning-related dopamine signals in addiction vulnerability. | Huys QJ et al. | β | 2014 | β |
| The why, what, where, when and how of goal-directed choice: neuronal and computational principles. | Verschure PF et al. | β | 2014 | β |
| Transcranial direct current stimulation of right dorsolateral prefrontal cortex does not affect model-based or model-free reinforcement learning in humans. | Smittenaar P et al. | β | 2014 | β |
| Using Neural Data to Test A Theory of Investor Behavior: An Application to Realization Utility. | Frydman C et al. | β | 2014 | β |
| Ventral striatum and the evaluation of memory retrieval strategies. | Badre D et al. | β | 2014 | β |
| Action, outcome, and value: a dual-system framework for morality. | Cushman F | β | 2013 | β |
| Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized. | Dezfouli A et al. | β | 2013 | β |
| Activity in inferior parietal and medial prefrontal cortex signals the accumulation of evidence in a probability learning task. | d'Acremont M et al. | β | 2013 | β |
| Agency modulates the lateral and medial prefrontal cortex responses in belief-based decision making. | Xue G et al. | β | 2013 | β |
| Bayesian prediction and evaluation in the anterior cingulate cortex. | Ide JS et al. | β | 2013 | β |
| Brain systems for probabilistic and dynamic prediction: computational specificity and integration. | O'Reilly JX et al. | β | 2013 | β |
| Categorization = decision making + generalization. | Seger CA et al. | β | 2013 | β |
| Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans. | Bornstein AM et al. | β | 2013 | β |
| Decision making: from neuroscience to psychiatry. | Lee D | β | 2013 | β |
| Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. | Smittenaar P et al. | β | 2013 | β |
| Dopamine restores reward prediction errors in old age. | Chowdhury R et al. | β | 2013 | β |
| Electrophysiological indicators of surprise and entropy in dynamic task-switching environments. | Kopp B et al. | β | 2013 | β |
| Electrophysiological responses to feedback during the application of abstract rules. | Walsh MM et al. | β | 2013 | β |
| Evidence for model-based computations in the human amygdala during Pavlovian conditioning. | PrΓ©vost C et al. | β | 2013 | β |
| Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task. | Skatova A et al. | β | 2013 | β |
| Goal-proximity decision-making. | Veksler VD et al. | β | 2013 | β |
| Goals and habits in the brain. | Dolan RJ et al. | β | 2013 | β |
| Hierarchical learning induces two simultaneous, but separable, prediction errors in human basal ganglia. | Diuk C et al. | β | 2013 | β |
| Hierarchical prediction errors in midbrain and basal forebrain during sensory learning. | Iglesias S et al. | β | 2013 | β |
| Insights from the application of computational neuroimaging to social neuroscience. | Dunne S et al. | β | 2013 | β |
| Ketamine effects on memory reconsolidation favor a learning model of delusions. | Corlett PR et al. | β | 2013 | β |
| Model-based and model-free mechanisms of human motor learning. | Haith AM et al. | β | 2013 | β |
| Neural and behavioral evidence for an intrinsic cost of self-control. | Kool W et al. | β | 2013 | β |
| Neural correlates of the divergence of instrumental probability distributions. | Liljeholm M et al. | β | 2013 | β |
| Neurons in the cingulate motor area signal context-based and outcome-based volitional selection of action. | Iwata J et al. | β | 2013 | β |
| Of goals and habits: age-related and individual differences in goal-directed decision-making. | Eppinger B et al. | β | 2013 | β |
| Online evaluation of novel choices by simultaneous representation of multiple memories. | Barron HC et al. | β | 2013 | β |
| Perceptual bias in pain: a switch looks closer when it will relieve pain than when it won't. | Tabor A et al. | β | 2013 | β |
| Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group? | Deserno L et al. | β | 2013 | β |
| Reinforcement learning and Tourette syndrome. | Palminteri S et al. | β | 2013 | β |
| Separate amygdala subregions signal surprise and predictiveness during associative fear learning in humans. | Boll S et al. | β | 2013 | β |
| Sources of uncertainty in intuitive physics. | Smith KA et al. | β | 2013 | β |
| The anatomy of choice: active inference and agency. | Friston K et al. | β | 2013 | β |
| The basal ganglia. | Braunlich K et al. | β | 2013 | β |
| The behavioral and neural mechanisms underlying the tracking of expertise. | Boorman ED et al. | β | 2013 | β |
| The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. | Otto AR et al. | β | 2013 | β |
| The effect of novelty on reinforcement learning. | Houillon A et al. | β | 2013 | β |
| The human brain encodes event frequencies while forming subjective beliefs. | d'Acremont M et al. | β | 2013 | β |
| The many faces of precision (Replies to commentaries on "Whatever next? Neural prediction, situated agents, and the future of cognitive science"). | Clark A | β | 2013 | β |
| The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. | Pezzulo G et al. | β | 2013 | β |
| The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. | Bradfield LA et al. | β | 2013 | β |
| Understanding decision neuroscience: a multidisciplinary perspective and neural substrates. | Miyapuram KP et al. | β | 2013 | β |
| Working-memory capacity protects model-based learning from stress. | Otto AR et al. | β | 2013 | β |
| Acetylcholine-based entropy in response selection: a model of how striatal interneurons modulate exploration, exploitation, and response variability in decision-making. | Stocco A | β | 2012 | β |
| Active inference and agency: optimal control without cost functions. | Friston K et al. | β | 2012 | β |
| Aversive pavlovian responses affect human instrumental motor performance. | Rigoli F et al. | β | 2012 | β |
| Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms. | Summerfield C et al. | β | 2012 | β |
| Category representation and generalization in the prefrontal cortex. | Pan X et al. | β | 2012 | β |
| Computational psychiatry. | Montague PR et al. | β | 2012 | β |
| Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior. | Gruber AJ et al. | β | 2012 | β |
| Decreasing ventromedial prefrontal cortex activity during sequential risk-taking: an FMRI investigation of the balloon analog risk task. | Schonberg T et al. | β | 2012 | β |
| Dissociating hippocampal and striatal contributions to sequential prediction learning. | Bornstein AM et al. | β | 2012 | β |
| Don'T let me do that! - models of precommitment. | Kurth-Nelson Z et al. | β | 2012 | β |
| Dopamine enhances model-based over model-free choice behavior. | Wunderlich K et al. | β | 2012 | β |
| Frontostriatal mechanisms in instruction-based learning as a hallmark of flexible goal-directed behavior. | Wolfensteller U et al. | β | 2012 | β |
| Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. | Solway A et al. | β | 2012 | β |
| Go and no-go learning in reward and punishment: interactions between affect and effect. | Guitart-Masip M et al. | β | 2012 | β |
| How to set the switches on this thing. | Dayan P | β | 2012 | β |
| Human dorsal striatum encodes prediction errors during observational learning of instrumental actions. | Cooper JC et al. | β | 2012 | β |
| Instrumental vigour in punishment and reward. | Dayan P | β | 2012 | β |
| Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. | Khamassi M et al. | β | 2012 | β |
| l-DOPA changes ventral striatum recruitment during motor sequence learning in Parkinson's disease. | Kwak Y et al. | β | 2012 | β |
| Learning to represent reward structure: a key to adapting to complex environments. | Nakahara H et al. | β | 2012 | β |
| Learning to simulate others' decisions. | Suzuki S et al. | β | 2012 | β |
| Mapping value based planning and extensively trained choice in the human brain. | Wunderlich K et al. | β | 2012 | β |
| Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. | McDannald MA et al. | β | 2012 | β |
| Neural basis of reinforcement learning and decision making. | Lee D et al. | β | 2012 | β |
| Neurobiological mechanisms underlying the blocking effect in aversive learning. | Eippert F et al. | β | 2012 | β |
| Planning for uncertainty. | Yu EC | β | 2012 | β |
| Positively biased processing of self-relevant social feedback. | Korn CW et al. | β | 2012 | β |
| Prediction and control in a dynamic environment. | Osman M et al. | β | 2012 | β |
| Real-time fMRI: a tool for local brain regulation. | Caria A et al. | β | 2012 | β |
| Reduced caudate volume and enhanced striatal-DMN integration in chess experts. | Duan X et al. | β | 2012 | β |
| Reward-related learning via multiple memory systems. | Delgado MR et al. | β | 2012 | β |
| Social network modulation of reward-related signals. | Fareri DS et al. | β | 2012 | β |
| Striatal contributions to declarative memory retrieval. | Scimeca JM et al. | β | 2012 | β |
| Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. | van den Bos W et al. | β | 2012 | β |
| The functional neuroanatomy of decision making: prefrontal control of thought and action. | Coutlee CG et al. | β | 2012 | β |
| The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. | Saunders BT et al. | β | 2012 | β |
| The role of the rat medial prefrontal cortex in adapting to changes in instrumental contingency. | Coutureau E et al. | β | 2012 | β |
| The successor representation and temporal context. | Gershman SJ et al. | β | 2012 | β |
| The ubiquity of model-based reinforcement learning. | Doll BB et al. | β | 2012 | β |
| Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats. | Funamizu A et al. | β | 2012 | β |
| Value normalization in decision making: theory and evidence. | Rangel A et al. | β | 2012 | β |
| Are people successful at learning sequences of actions on a perceptual matching task? | Yakushijin R et al. | β | 2011 | β |
| Contributions of the ventromedial prefrontal cortex to goal-directed action selection. | O'Doherty JP | β | 2011 | β |
| Differential roles of caudate nucleus and putamen during instrumental learning. | Brovelli A et al. | β | 2011 | β |
| Dissociable reward and timing signals in human midbrain and ventral striatum. | Klein-FlΓΌgge MC et al. | β | 2011 | β |
| Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. | Abe H et al. | β | 2011 | β |
| Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. | Takahashi YK et al. | β | 2011 | β |
| Feedback timing modulates brain systems for learning in humans. | Foerde K et al. | β | 2011 | β |
| How instructed knowledge modulates the neural systems of reward learning. | Li J et al. | β | 2011 | β |
| Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy. | Jessup RK et al. | β | 2011 | β |
| Human reversal learning under conditions of certain versus uncertain outcomes. | D'Cruz AM et al. | β | 2011 | β |
| Interactions within and between corticostriatal loops during component processes of category learning. | Lopez-Paniagua D et al. | β | 2011 | β |
| Learning and motivation in the human striatum. | Shohamy D | β | 2011 | β |
| Learning: not just the facts, ma'am, but the counterfactuals as well. | Platt ML et al. | β | 2011 | β |
| Limbic justice--amygdala involvement in immediate rejection in the Ultimatum Game. | Gospic K et al. | β | 2011 | β |
| Medial prefrontal cortex as an action-outcome predictor. | Alexander WH et al. | β | 2011 | β |
| Model-based influences on humans' choices and striatal prediction errors. | Daw ND et al. | β | 2011 | β |
| Modulation of the feedback-related negativity by instruction and experience. | Walsh MM et al. | β | 2011 | β |
| Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit. | Ito M et al. | β | 2011 | β |
| Multiplicity of control in the basal ganglia: computational roles of striatal subregions. | Bornstein AM et al. | β | 2011 | β |
| Neural correlates of forward planning in a spatial decision task in humans. | Simon DA et al. | β | 2011 | β |
| Parietal cortex and insula relate to evidence seeking relevant to reward-related decisions. | Furl N et al. | β | 2011 | β |
| Perceptual classification in a rapidly changing environment. | Summerfield C et al. | β | 2011 | β |
| Prediction error associated with the perceptual segmentation of naturalistic events. | Zacks JM et al. | β | 2011 | β |
| Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. | Huang VS et al. | β | 2011 | β |
| Separate encoding of model-based and model-free valuations in the human brain. | Beierholm UR et al. | β | 2011 | β |
| The brain's rose-colored glasses. | Izuma K et al. | β | 2011 | β |
| The feeling of action tendencies: on the emotional regulation of goal-directed behavior. | Lowe R et al. | β | 2011 | β |
| The neural basis of predicting the outcomes of imagined actions. | Jahn A et al. | β | 2011 | β |
| The prefrontal cortex and hybrid learning during iterative competitive games. | Abe H et al. | β | 2011 | β |
| The value of foresight: how prospection affects decision-making. | Pezzulo G et al. | β | 2011 | β |
| Time scales of representation in the human brain: weighing past information to predict future events. | Harrison LM et al. | β | 2011 | β |
| Ubiquity and specificity of reinforcement signals throughout the human brain. | Vickery TJ et al. | β | 2011 | β |
| Unblocking the neural substrates of model-based value. | Bornstein AM et al. | β | 2011 | β |
| Value and prediction error in medial frontal cortex: integrating the single-unit and systems levels of analysis. | Silvetti M et al. | β | 2011 | β |
| Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. | McDannald MA et al. | β | 2011 | β |
| What is optimal about motor control? | Friston K | β | 2011 | β |
| With age comes wisdom: decision making in younger and older adults. | Worthy DA et al. | β | 2011 | β |
| A pallidus-habenula-dopamine pathway signals inferred stimulus values. | Bromberg-Martin ES et al. | β | 2010 | β |
| A reinforcement learning model of precommitment in decision making. | Kurth-Nelson Z et al. | β | 2010 | β |