Adaptive coding of action values in the human rostral cingulate zone.

Full Abstract

Correctly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associations across multiple trials and in coding the subjective value of each action. During functional magnetic resonance imaging, healthy volunteers performed two versions of a probabilistic reversal learning task with high (HP) or low (LP) reward probabilities that required them to integrate action-outcome relations over lower or higher numbers of trials, respectively. In the HP session, subjects needed fewer trials to adjust their behavior in response to a reversal of response-reward contingencies. Similarly, the learning rate derived from a reinforcement learning model was higher in the HP condition. This was accompanied by a stronger response of the RCZ to negative feedback upon reversals in the HP condition. Furthermore, RCZ activity related to negative reward prediction errors varied as a function of the learning rate, which determines to what extent the prediction error is used to update action values. These data show that RCZ responses vary as a function of the information content provided by the environment. The more likely a negative event indicates the need for behavioral adaptations, the more prominent is the response of the RCZ. Thus, both the window of trials over which reinforcement information is integrated and adjustment of action values in the RCZ covary with the stochastics of the environment.

Author information

Author/s: Jocham, Gerhard (G); Neumann, Jane (J); Klein, Tilmann A (TA); Danielmeier, Claudia (C); Ullsperger, Markus (M);

Affiliation: Cognitive Neurology Research Group, Max Planck Institute for Neurological Research, D-50931 Cologne, Germany. jocham(-atsign-)nf.mpg.de

Grants: R01 MH74457 (Agency:NIMH NIH HHS)

Journal and publication information

Publication Type: Journal Article; Research Support, N.I.H., Extramural

Journal: The Journal of neuroscience : the official journal of the Society for Neuroscience (J Neurosci), published in United States. (Language: eng)

Reference: 2009-Jun; vol 29 (issue 23) : pp 7489-96

Dates: Created 2009/06/11; Completed 2009/06/29; Revised 2009/09/01;

PMID: 19515916, status: MEDLINE (last retrieval date: 9/4/2009, IMS Date: 04 Sep 2009 00:00:00)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

External Links for this article
(including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.

MeSH headings (categories)

This article was linked to the MESH Headings shown below.

This article has not been indexed for related articles as yet, however you can still use the live related article search links below.

See 100+ related articles.

See a large map of 100+ related articles.