The dog's meow: Asymmetrical interaction in cross-modal object recognition

Shlomit Yuval-Greenberg*, Leon Y. Deouell

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Little is known on cross-modal interaction in complex object recognition. The factors influencing this interaction were investigated using simultaneous presentation of pictures and vocalizations of animals. In separate blocks, the task was to identify either the visual or the auditory stimulus, ignoring the other modality. The pictures and the sounds were congruent (same animal), incongruent (different animals) or neutral (animal with meaningless stimulus). Performance in congruent trials was better than in incongruent trials, regardless of whether subjects attended the visual or the auditory stimuli, but the effect was larger in the latter case. This asymmetry persisted with addition of a long delay after the stimulus and before the response. Thus, the asymmetry cannot be explained by a lack of processing time for the auditory stimulus. However, the asymmetry was eliminated when low-contrast visual stimuli were used. These findings suggest that when visual stimulation is highly informative, it affects auditory recognition more than auditory stimulation affects visual recognition. Nevertheless, this modality dominance is not rigid; it is highly influenced by the quality of the presented information.

Original languageEnglish
Pages (from-to)603-614
Number of pages12
JournalExperimental Brain Research
Volume193
Issue number4
DOIs
StatePublished - Mar 2009
Externally publishedYes

Keywords

  • Auditory
  • Conflict
  • Human
  • Multisensory
  • Object recognition
  • Visual

Fingerprint

Dive into the research topics of 'The dog's meow: Asymmetrical interaction in cross-modal object recognition'. Together they form a unique fingerprint.

Cite this