The effect of temporal asynchrony on the multisensory integration of letters and speech sounds.

Full Abstract

Temporal proximity is a critical determinant for cross-modal integration by multisensory neurons. Information content may serve as an additional binding factor for more complex or less natural multisensory information. Letters and speech sounds, which form the basis of literacy acquisition, are not naturally related but associated through explicit learning. We investigated the relative importance of temporal proximity and information content on the integration of letters and speech sounds by manipulating both factors within the same functional magnetic resonance imaging (fMRI) design. The results reveal significant interactions between temporal proximity and content congruency in anterior and posterior auditory association cortex, indicating that temporal synchrony is critical for the integration of letters and speech sounds. The temporal profiles for multisensory integration in the auditory association cortex resemble those demonstrated for single multisensory neurons in different brain structures and animal species. This similarity suggests that basic neural integration rules apply to the binding of multisensory information that is not naturally related but overlearned during literacy acquisition. Furthermore, the present study shows the suitability of fMRI to study temporal aspects of multisensory neural processing.

Learn Faster Today Improve your study skills

Author information

Author/s: van Atteveldt, Nienke M (NM); Formisano, Elia (E); Blomert, Leo (L); Goebel, Rainer (R);

Affiliation: Department of Cognitive Neuroscience, University of Maastricht, 6200 MD Maastricht, The Netherlands. N.vanAtteveldt(-atsign-)psychology.unimaas.nl

Journal and publication information

Publication Type: Journal Article; Research Support, Non-U.S. Gov't

Journal: Cerebral cortex (New York, N.Y. : 1991) (Cereb Cortex), published in United States. (Language: eng)

Reference: 2007-Apr; vol 17 (issue 4) : pp 962-74

Dates: Created 2007/03/12; Completed 2007/04/24;

PMID: 16751298, status: MEDLINE (last retrieval date: 12/26/2008)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

External Links for this article (including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.

MeSH headings (categories)

This article was linked to the MESH Headings shown below.

Acoustic Stimulation - methods
Adult
Auditory Cortex - physiology
Auditory Perception - physiology
Evoked Potentials, Auditory - physiology
Evoked Potentials, Visual - physiology
Female

Female
Humans
Male
Photic Stimulation - methods
Speech Perception - physiology
Time Factors
Visual Cortex - physiology

These are the highest related articles currently in the database:

See 100+ related articles.