An exploration of the integration of speech with co-speech gesture with non-invasive brain stimulation

Zhao, Wanying

Abstract

The current PhD project focuses on the integration of gesture with their co-occurring speech with the use of non-invasive brain stimulation. The project investigated ‘where’ and ‘when’ gesture-speech integration takes place. Building on the paradigm of Kelly et al., (2010) which provides a reaction time index of automatic gesture-speech integration, it was tested whether left middle temporal gyrus (pMTG) as well as left Inferior frontal gyrus (LIFG) are causally involved in gesture-speech integration. A follow-up study investigated the time window for this integration of gesture and speech in pMTG. This study found that gesture has a priming effect on the semantic retrieval of speech. This effect only manifested itself after gesture had been clearly understood and before the semantic analysis of speech. Based on the common coding hypothesis, this finding was interpreted in terms of gesture and speech originating from a common coding system, with both LIFG and pMTG as its neural underpining, enabling bi-directional influences between both domains.

Citation

Zhao, W. (2017). An exploration of the integration of speech with co-speech gesture with non-invasive brain stimulation. (Thesis). University of Hull. Retrieved from https://hull-repository.worktribe.com/output/4220574

• Thesis Type: Thesis
• Deposit Date: Aug 13, 2018
• Publicly Available Date: Feb 23, 2023
• Keywords: Psychology
• Public URL: https://hull-repository.worktribe.com/output/4220574
• Additional Information: Department of Psychology, The University of Hull
• Award Date: Sep 1, 2017