Research article summary (published 17 Apr 2009):

Reinforcement learning can account for associative and perceptual learning on a visual-decision task.

Full Abstract

We recently showed that improved perceptual performance on a visual motion direction-discrimination task corresponds to changes in how an unmodified sensory representation in the brain is interpreted to form a decision that guides behavior. Here we found that these changes can be accounted for using a reinforcement-learning rule to shape functional connectivity between the sensory and decision neurons. We modeled performance on the basis of the readout of simulated responses of direction-selective sensory neurons in the middle temporal area (MT) of monkey cortex. A reward prediction error guided changes in connections between these sensory neurons and the decision process, first establishing the association between motion direction and response direction, and then gradually improving perceptual sensitivity by selectively strengthening the connections from the most sensitive neurons in the sensory population. The results suggest a common, feedback-driven mechanism for some forms of associative and perceptual learning.

Author information

Author/s: Law, Chi-Tat (CT); Gold, Joshua I (JI);

Affiliation: Department of Neuroscience, University of Pennsylvania, Philadelphia, USA.

Grants: R01 EY015260-01A1 (Agency:NEI NIH HHS) ; R01 EY015260-02 (Agency:NEI NIH HHS) ; R01 EY015260-03 (Agency:NEI NIH HHS) ; R01 EY015260-04 (Agency:NEI NIH HHS) ; R01 EY015260-05 (Agency:NEI NIH HHS) ; R01-EY015260 (Agency:NEI NIH HHS) ; T32 EY007035-26 (Agency:NEI NIH HHS) ; T32 EY007035-27 (Agency:NEI NIH HHS) ; T32 EY007035-28 (Agency:NEI NIH HHS) ; T32 EY007035-29 (Agency:NEI NIH HHS) ; T32 EY007035-30 (Agency:NEI NIH HHS) ; T32-EY007035 (Agency:NEI NIH HHS)

Journal and publication information

Publication Type: Journal Article; Research Support, N.I.H., Extramural; Research Support, Non-U.S. Gov't

Journal: Nature neuroscience (Nat Neurosci), published in United States. (Language: eng)

Reference: 2009-May; vol 12 (issue 5) : pp 655-63

Dates: Created 2009/04/27; Completed 2009/06/24; Revised 2009/11/03;

PMID: 19377473, status: MEDLINE (last retrieval date: 11/4/2009, IMS Date: 04 Nov 2009 00:00:00)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

External Links for this article
(including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.

MeSH headings (categories)

This article was linked to the MESH Headings shown below.

Animals Association Learning - physiology Computer Simulation Decision Making - physiology Feedback - physiology Haplorhini Models, Neurological Motion Perception - physiology

Neural Networks (Computer) Neural Pathways - physiology Neuropsychological Tests Photic Stimulation Psychomotor Performance - physiology Reinforcement (Psychology) Reward Visual Perception - physiology

Related articles

This article has not been indexed for related articles as yet, however you can still use the live related article search links below.

See 100+ related articles.

See a large map of 100+ related articles.