Dr Nina Dethlefs N.Dethlefs@hull.ac.uk
Senior Lecturer
Dr Nina Dethlefs N.Dethlefs@hull.ac.uk
Senior Lecturer
Helen Hastie
Heriberto Cuayáhuitl
Yanchao Yu
Verena Rieser
Oliver Lemon
Incremental dialogue systems are often perceived as more responsive and natural because they are able to address phenomena of turn-taking and overlapping speech, such as backchannels or barge-ins. Previous work in this area has often identified distinctive prosodic features, or features relating to syntactic or semantic completeness, as marking appropriate places of turn-taking. In a separate strand of work, psycholinguistic studies have established a connection between information density and prominence in language—the less expected a linguistic unit is in a particular context, the more likely it is to be linguistically marked. This has been observed across linguistic levels, including the prosodic, which plays an important role in predicting overlapping speech. In this article, we explore the hypothesis that information density (ID) also plays a role in turn-taking. Specifically, we aim to show that humans are sensitive to the peaks and troughs of information density in speech, and that overlapping speech at ID troughs is perceived as more acceptable than overlaps at ID peaks. To test our hypothesis, we collect human ratings for three models of generating overlapping speech based on features of: (1) prosody and semantic or syntactic completeness, (2) information density, and (3) both types of information. Results show that over 50% of users preferred the version using both types of features, followed by a preference for information density features alone. This indicates a clear human sensitivity to the effects of information density in spoken language and provides a strong motivation to adopt this metric for the design, development and evaluation of turn-taking modules in spoken and incremental dialogue systems.
Dethlefs, N., Hastie, H., Cuayáhuitl, H., Yu, Y., Rieser, V., & Lemon, O. (2016). Information density and overlap in spoken dialogue. Computer speech & language, 37, 82-97. https://doi.org/10.1016/j.csl.2015.11.001
Journal Article Type | Article |
---|---|
Acceptance Date | Nov 2, 2015 |
Online Publication Date | Nov 10, 2015 |
Publication Date | May 1, 2016 |
Deposit Date | Jan 20, 2016 |
Publicly Available Date | Oct 27, 2022 |
Journal | Computer speech & language |
Print ISSN | 0885-2308 |
Electronic ISSN | 1095-8363 |
Publisher | Elsevier |
Peer Reviewed | Peer Reviewed |
Volume | 37 |
Pages | 82-97 |
DOI | https://doi.org/10.1016/j.csl.2015.11.001 |
Keywords | Overlap; Turn-taking; Information density; Incremental processing; Spoken dialogue systems |
Public URL | https://hull-repository.worktribe.com/output/384285 |
Publisher URL | http://www.sciencedirect.com/science/article/pii/S0885230815000972 |
Additional Information | Authors' accepted manuscript of article published in: Computer speech and language, 2016, v.37. |
Article.pdf
(1.3 Mb)
PDF
Copyright Statement
© 2016, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Facilitating a smoother transition to renewable energy with AI
(2022)
Journal Article
Hierarchical Multiscale Recurrent Neural Networks for Detecting Suicide Notes
(2021)
Journal Article
About Repository@Hull
Administrator e-mail: repository@hull.ac.uk
This application uses the following open-source libraries:
Apache License Version 2.0 (http://www.apache.org/licenses/)
Apache License Version 2.0 (http://www.apache.org/licenses/)
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Advanced Search