Research article summary (published 30 Mar 2006):

The role of the basal ganglia in exploration in a neural model based on reinforcement learning.

Full Abstract

We present a computational model of basal ganglia as a key player in exploratory behavior. The model describes exploration of a virtual rat in a simulated water pool experiment. The virtual rat is trained using a reward-based or reinforcement learning paradigm which requires units with stochastic behavior for exploration of the system's state space. We model the Subthalamic Nucleus-Globus Pallidus externa (STN-GPe) segment of the basal ganglia as a pair of neuronal layers with oscillatory dynamics, exhibiting a variety of dynamic regimes such as chaos, traveling waves and clustering. Invoking the property of chaotic systems to explore state-space, we suggest that the complex exploratory dynamics of STN-GPe system in conjunction with dopamine-based reward signaling from the Substantia Nigra pars compacta (SNc) present the two key ingredients of a reinforcement learning system.

Learn Faster Today      Improve your study skills

Author information

Author/s: Sridharan, D (D); Prashanth, P S (PS); Chakravarthy, V S (VS);

Affiliation: Program in Neuroscience, Stanford University School of Medicine, California 94305, USA. dsridhar(-atsign-)stanford.edu

Journal and publication information

Publication Type: Journal Article

Journal: International journal of neural systems (Int J Neural Syst), published in Singapore. (Language: eng)

Reference: 2006-Apr; vol 16 (issue 2) : pp 111-24

Dates: Created 2006/05/11; Completed 2006/07/31; Revised 2006/10/19;

PMID: 16688851, status: MEDLINE (last retrieval date: 12/26/2008)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

Comments and Corrections

ErratumIn: Int J Neural Syst. 2006 Jun;16(3):227.

External Links for this article (including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.

MeSH headings (categories)

This article was linked to the MESH Headings shown below.

Animals Basal Ganglia - physiology Computer Simulation Conditioning (Psychology) Dopamine - physiology Exploratory Behavior - physiology Models, Neurological

Models, Neurological Nonlinear Dynamics Rats Reinforcement (Psychology) Reward Stochastic Processes User-Computer Interface

Associated Chemicals: Dopamine (51-61-6)

Related articles

These are the highest related articles currently in the database:

• Computational models of the basal ganglia. 30 Aug 2000
• Is the short-latency dopamine response too short to signal reward error? 30 Mar 1999
• Dynamic changes in the cortex-basal ganglia network after dopamine depletion in the rat. 19 May 2008
• Aniracetam restores object recognition impaired by age, scopolamine, and nucleus basalis lesions. 30 Jan 1996
• A simple model of transmitter release and facilitation. 30 Mar 1997
• Excitotoxic lesions of the subthalamic nucleus ameliorate asymmetry induced by striatal dopamine depletion in the rat. 30 Dec 1997
• A novel neurotransmitter system involved in the control of motor behavior by the basal ganglia. 14 Nov 1998
• Neural encoding in ventral striatum during olfactory discrimination learning. 20 May 2003
• Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix. 5 Apr 2007
• Multiple representations of belief states and action values in corticobasal ganglia loops. 11 Apr 2007

See 100+ related articles.

Related Article Map

Legend: - FREE Full text Article. - Abstract only. - Title only. More help.

See a large map of 100+ related articles.