Epistemic intonation and epistemic gesture are mutually co-expressive: empirical results from two intonation-gesture matching tasks

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Borràs Comes, Joan Manel, 1984-
• dc.contributor.author Kiagia, Evangelia
• dc.contributor.author Prieto Vives, Pilar, 1965-
• dc.date.accessioned 2020-04-21T09:29:20Z
• dc.date.available 2020-04-21T09:29:20Z
• dc.date.issued 2019
• dc.description.abstract While several studies have investigated the temporal relationship between co-speech gestures and prosodic structure, little is known about their potential interaction at the level of their encoding of pragmatic meaning. Here we report the results of two complementary intonation-gesture matching tasks which investigate the potential co-dependencies between intonation patterns related to epistemic commitment operators and their associated gestures in Catalan. In Experiment 1, participants were shown audio-muted videos in which a speaker performed gestures conveying epistemic information of certainty or uncertainty while uttering statements and questions. The subjects were then asked to produce a stipulated target word, the goal being to examine whether they would produce the word with a tune that was semantically consistent with the gestures they had seen. In Experiment 2, participants were primed by hearing intonation patterns conveying epistemic information (certainty-uncertainty) and were then asked to select one of two silent videos which seemed to best match the intonation they had heard. The results suggest converging positive effects in both matching tasks and suggest a close interrelation between the pragmatic representations of intonation and gesture that needs to be taken into account when investigating multimodal pragmatic encoding.en
• dc.description.sponsorship This research has been funded by a research grant awarded by the Spanish Ministry of Science, Innovation and Universities (PGC2018-097007-B-I00, “Multimodal Language Learning (MLL): Prosodic and Gestural Integration in Pragmatic and Phonological Development”), and by a grant awarded by the Generalitat de Catalunya (2017 SGR 971) to the Prosodic Studies Group. Also awarded by the Generalitat de Catalunya, the first author acknowledges a research group grant to “LLETRA, Linguistic and Literary Education” (2017 SGR 1728).
• dc.format.mimetype application/pdf
• dc.identifier.citation Borràs-Comes J, Kiagia E, Prieto P. Epistemic intonation and epistemic gesture are mutually co-expressive: empirical results from two intonation-gesture matching tasks. J Pragmat. 2019 Sep;150:39-52. DOI: 10.1016/j.pragma.2019.07.004
• dc.identifier.doi http://dx.doi.org/10.1016/j.pragma.2019.07.004
• dc.identifier.issn 0378-2166
• dc.identifier.uri http://hdl.handle.net/10230/44288
• dc.language.iso eng
• dc.publisher Elsevier
• dc.relation.ispartof Journal of Pragmatics. 2019 Sep;150:39-52
• dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PGC2018-097007-B-I00
• dc.rights © Elsevier http://dx.doi.org/10.1016/j.pragma.2019.07.004
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.subject.keyword Gesture-speech integrationen
• dc.subject.keyword Gesture-intonation co-dependenciesen
• dc.subject.keyword Epistemic meaningen
• dc.subject.keyword Gestureen
• dc.subject.keyword Intonationen
• dc.subject.keyword Speaker commitmenten
• dc.title Epistemic intonation and epistemic gesture are mutually co-expressive: empirical results from two intonation-gesture matching tasksen
• dc.type info:eu-repo/semantics/article
• dc.type.version info:eu-repo/semantics/acceptedVersion