Show simple item record Stevenson, Ryan A. Bushmakin, Maxim Kim, Sunah Wallace, Mark T. Puce, Aina James, Thomas W. 2019-03-04T17:20:53Z 2019-03-04T17:20:53Z 2012-02
dc.identifier.citation Stevenson RA, Bushmakin M, Kim S, Puce A, James TW. (2012) Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech. Brain Topography 25: 308-326. en
dc.description Posptrint, author's accepted manuscript en
dc.description.abstract In recent years, it has become evident that neural responses previously considered to be unisensory can be modulated by sensory input from other modalities. In this regard, visual neural activity elicited to viewing a face is strongly influenced by concurrent incoming auditory information, particularly speech. Here, we applied an additive-factors paradigm aimed at quantifying the impact that auditory speech has on visual event-related potentials (ERPs) elicited to visual speech. These multisensory interactions were measured across parametrically varied stimulus salience, quantified in terms of signal to noise, to provide novel insights into the neural mechanisms of audiovisual speech perception. First, we measured a monotonic increase of the amplitude of the visual P1-N1-P2 ERP complex during a spoken-word recognition task with increases in stimulus salience. ERP component amplitudes varied directly with stimulus salience for visual, audiovisual, and summed unisensory recordings. Second, we measured changes in multisensory gain across salience levels. During audiovisual speech, the P1 and P1-N1 components exhibited less multisensory gain relative to the summed unisensory components with reduced salience, while N1-P2 amplitude exhibited greater multisensory gain as salience was reduced, consistent with the principle of inverse effectiveness. The amplitude interactions were correlated with behavioral measures of multisensory gain across salience levels as measured by response times, suggesting that change in multisensory gain associated with unisensory salience modulations reflects an increased efficiency of visual speech processing. en
dc.language.iso en en
dc.publisher Brain Topography en
dc.relation.isversionof en
dc.subject Multisensory integration en
dc.subject Inverse effectiveness en
dc.subject ERPs en
dc.subject P1-N1-P2 en
dc.subject N170 en
dc.subject Speech perception en
dc.subject Face perception en
dc.title Inverse Effectiveness and Multisensory Interactions in Visual Event-Related Potentials with Audiovisual Speech en
dc.type Article en
dc.identifier.doi 10.1007/s10548-012-0220-7

Files in this item

This item appears in the following Collection(s)

Show simple item record

Search IUScholarWorks

Advanced Search


My Account