Gestures Cued by Demonstratives in Speech Guide Listeners' Visual Attention During Spatial Language Comprehension

Loading...
Thumbnail Image

Date

2023

Authors

Karadoller, Dilay Z.
Ozyurek, Asli
Goksun, Tilbe

Journal Title

Journal ISSN

Volume Title

Publisher

Amer Psychological Assoc

Research Projects

Organizational Units

Journal Issue

Abstract

Gestures help speakers and listeners during communication and thinking, particularly for visual-spatial information. Speakers tend to use gestures to complement the accompanying spoken deictic constructions, such as demonstratives, when communicating spatial information (e.g., saying The candle is here and gesturing to the right side to express that the candle is on the speaker's right). Visual information conveyed by gestures enhances listeners' comprehension. Whether and how listeners allocate overt visual attention to gestures in different speech contexts is mostly unknown. We asked if (a) listeners gazed at gestures more when they complement demonstratives in speech (here) compared to when they express redundant information to speech (e.g., right) and (b) gazing at gestures related to listeners' information uptake from those gestures. We demonstrated that listeners fixated gestures more when they expressed complementary than redundant information in the accompanying speech. Moreover, overt visual attention to gestures did not predict listeners' comprehension. These results suggest that the heightened communicative value of gestures as signaled by external cues, such as demonstratives, guides listeners' visual attention to gestures. However, overt visual attention does not seem to be necessary to extract the cued information from the multimodal message.

Description

Keywords

Iconic Hand Gestures, Individual-Differences, Semantic Information, Mental Rotation, Integration, Conversation, Coordination, Perspective, Perception, Insights, Iconic Hand Gestures, Individual-Differences, Semantic Information, Mental Rotation, Integration, Conversation, Coordination, overt visual attention to gestures, Perspective, gesture processing, Perception, spatial language, Insights, gestures with demonstratives

Turkish CoHE Thesis Center URL

Citation

1

WoS Q

Q1

Scopus Q

Q1

Source

Journal of Experimental Psychology-General

Volume

Issue

Start Page

End Page