"Slight" of hand: the processing of visually degraded gestures with speech.
Co-speech hand gestures influence language comprehension. The present experiment explored what part of the visual processing system is optimized for processing these gestures. Participants viewed short video clips of speech and gestures (e.g., a person saying "chop" or "twist" wh...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2012-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC3415388?pdf=render |
| _version_ | 1828407313947426816 |
|---|---|
| author | Spencer D Kelly Bruce C Hansen David T Clark |
| author_facet | Spencer D Kelly Bruce C Hansen David T Clark |
| author_sort | Spencer D Kelly |
| collection | DOAJ |
| description | Co-speech hand gestures influence language comprehension. The present experiment explored what part of the visual processing system is optimized for processing these gestures. Participants viewed short video clips of speech and gestures (e.g., a person saying "chop" or "twist" while making a chopping gesture) and had to determine whether the two modalities were congruent or incongruent. Gesture videos were designed to stimulate the parvocellular or magnocellular visual pathways by filtering out low or high spatial frequencies (HSF versus LSF) at two levels of degradation severity (moderate and severe). Participants were less accurate and slower at processing gesture and speech at severe versus moderate levels of degradation. In addition, they were slower for LSF versus HSF stimuli, and this difference was most pronounced in the severely degraded condition. However, exploratory item analyses showed that the HSF advantage was modulated by the range of motion and amount of motion energy in each video. The results suggest that hand gestures exploit a wide range of spatial frequencies, and depending on what frequencies carry the most motion energy, parvocellular or magnocellular visual pathways are maximized to quickly and optimally extract meaning. |
| first_indexed | 2024-12-10T11:23:48Z |
| format | Article |
| id | doaj.art-fb5a9d2ecc764fb6ab29436fa78a3800 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-10T11:23:48Z |
| publishDate | 2012-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-fb5a9d2ecc764fb6ab29436fa78a38002022-12-22T01:50:51ZengPublic Library of Science (PLoS)PLoS ONE1932-62032012-01-0178e4262010.1371/journal.pone.0042620"Slight" of hand: the processing of visually degraded gestures with speech.Spencer D KellyBruce C HansenDavid T ClarkCo-speech hand gestures influence language comprehension. The present experiment explored what part of the visual processing system is optimized for processing these gestures. Participants viewed short video clips of speech and gestures (e.g., a person saying "chop" or "twist" while making a chopping gesture) and had to determine whether the two modalities were congruent or incongruent. Gesture videos were designed to stimulate the parvocellular or magnocellular visual pathways by filtering out low or high spatial frequencies (HSF versus LSF) at two levels of degradation severity (moderate and severe). Participants were less accurate and slower at processing gesture and speech at severe versus moderate levels of degradation. In addition, they were slower for LSF versus HSF stimuli, and this difference was most pronounced in the severely degraded condition. However, exploratory item analyses showed that the HSF advantage was modulated by the range of motion and amount of motion energy in each video. The results suggest that hand gestures exploit a wide range of spatial frequencies, and depending on what frequencies carry the most motion energy, parvocellular or magnocellular visual pathways are maximized to quickly and optimally extract meaning.http://europepmc.org/articles/PMC3415388?pdf=render |
| spellingShingle | Spencer D Kelly Bruce C Hansen David T Clark "Slight" of hand: the processing of visually degraded gestures with speech. PLoS ONE |
| title | "Slight" of hand: the processing of visually degraded gestures with speech. |
| title_full | "Slight" of hand: the processing of visually degraded gestures with speech. |
| title_fullStr | "Slight" of hand: the processing of visually degraded gestures with speech. |
| title_full_unstemmed | "Slight" of hand: the processing of visually degraded gestures with speech. |
| title_short | "Slight" of hand: the processing of visually degraded gestures with speech. |
| title_sort | slight of hand the processing of visually degraded gestures with speech |
| url | http://europepmc.org/articles/PMC3415388?pdf=render |
| work_keys_str_mv | AT spencerdkelly slightofhandtheprocessingofvisuallydegradedgestureswithspeech AT brucechansen slightofhandtheprocessingofvisuallydegradedgestureswithspeech AT davidtclark slightofhandtheprocessingofvisuallydegradedgestureswithspeech |