High verbal working memory load impairs gesture-speech integration: Evidence from a dual task paradigm

Kandana-Arachchige, Kendra Gimhani; Holle, Henning; Rossignol, Mandy; Loureiro, Isabelle Simoes; Lefebvre, Laurent

Abstract

While previous studies have shown the importance of visuo-spatial working memory in the processing of co-speech iconic gestures, clear evidence for a potential involvement of the verbal working memory (vWM) is currently lacking. To address this issue, participants in the present study were presented with a dual task paradigm. The main outcome variable was the performance on a Stroop-like gesture task which provides a behavioural index of gesture-speech integration. Participants performed this task under conditions of either high or low concurrent vWM load. Unlike in previous studies, the number of words to remember in the high load condition was determined by their individual verbal span rather than being fixed. Results showed reaction time costs in the form of longer reaction times for semantically incongruent gesture-speech combinations as compared to congruent combinations. However, this semantic congruency effect disappeared when the vWM load increased. This result suggests a causal involvement of verbal working memory capacity in gesture-speech integration.

Citation

Kandana-Arachchige, K. G., Holle, H., Rossignol, M., Loureiro, I. S., & Lefebvre, L. (2021). High verbal working memory load impairs gesture-speech integration: Evidence from a dual task paradigm. Gesture, 20(3), 354-375. https://doi.org/10.1075/gest.20028.kan

• Journal Article Type: Article
• Acceptance Date: May 31, 2021
• Publication Date: Dec 31, 2021
• Deposit Date: Jun 1, 2021
• Publicly Available Date: Aug 23, 2021
• Journal: Gesture
• Print ISSN: 1568-1475
• Electronic ISSN: 1569-9773
• Publisher: John Benjamins Publishing
• Peer Reviewed: Peer Reviewed
• Volume: 20
• Issue: 3
• Pages: 354-375
• DOI: https://doi.org/10.1075/gest.20028.kan
• Keywords: Gesture-speech integration; Verbal resources hypothesis; Iconic gestures; Gesture-speech comprehension; Verbal working memory; Manuscript Classifications: comprehension; memory
• Public URL: https://hull-repository.worktribe.com/output/3777942
• Publisher URL: https://www.benjamins.com/catalog/gest