Are gesture and prosodic prominences always coordinated?: evidence from perception and production

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Esteve Gibert, Núriaca
• dc.contributor.author Pons Gimeno, Ferranca
• dc.contributor.author Bosch, Lauraca
• dc.contributor.author Prieto Vives, Pilar, 1965-ca
• dc.date.accessioned 2017-09-26T16:51:09Z
• dc.date.available 2017-09-26T16:51:09Z
• dc.date.issued 2014
• dc.description Comunicació presentada a: Speech Prosody 2014, celebrada del 20 al 23 de maig de 2014 a Dublin, Irlanda.
• dc.description.abstract This study explores the temporal coordination between gesture and speech by addressing two main questions: (1) Are speakers sensitive to the misalignment between gesture prominence and prosodic prominence? (2) Is this sensitivity modulated by the semantic information conveyed by gesture and speech modalities in production? Experiment 1 tested question (1) and Experiment 2 tested question (2). Results from Experiment 1 revealed that the combinations in which prominences were misaligned were less acceptable than combinations with aligned prominences, and that the metrical pattern of the target word had an effect on the speakers’ sensitivity: unsynchronized trochees (with the gesture prominence at the post-tonic syllable) were frequently accepted, while unsynchronized iambs (with the gesture prominence at the pre-tonic syllable) were rejected. Results from Experiment 2 revealed that when the pointing gesture adds information to speech, i.e. it is supplementary to speech, the prominences are frequently misaligned (with gesture occurring after the speech), as if two different speech acts were produced. These findings suggest that the semantic content of gesture-speech combinations might influence the speakers’ sensitivity of the misalignment between prosodic and gesture prominences.
• dc.description.sponsorship This research has been funded by grants FFI2012-31995, PSI-2011-25376, 2009SGR-701, and by the RECERCAIXA 2012 grant “Els precursors del llenguatge: una guia TIC per a pares i educadors”.
• dc.format.mimetype application/pdfca
• dc.identifier.citation Esteve-Gibert N, Pons F, Bosch L, Prieto P. Are gesture and prosodic prominences always coordinated?: evidence from perception and production. In: Campbell N, Gibon D, Hirst D, editors. Speech Prosody 2014; 2014 May 20-23; Dublin, Ireland. [place unknown]: International Speech Communication Association; 2014. p.1139-43.
• dc.identifier.issn 2333-2042
• dc.identifier.uri http://hdl.handle.net/10230/32814
• dc.language.iso eng
• dc.publisher International Speech Communication Associationca
• dc.relation.ispartof Campbell N, Gibon D, Hirst D, editors. Speech Prosody 2014; 2014 May 20-23; Dublin, Ireland. [place unknown]: International Speech Communication Association; 2014. p.1139-43.
• dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2012-31995
• dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/PSI-2011-25376
• dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/2009SGR-701
• dc.rights © ISCA
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.subject.keyword Gesture-speech synchronization
• dc.subject.keyword Audiovisual prosody
• dc.subject.keyword Multimodal prominence
• dc.title Are gesture and prosodic prominences always coordinated?: evidence from perception and productionca
• dc.type info:eu-repo/semantics/conferenceObject
• dc.type.version info:eu-repo/semantics/publishedVersion