In speech entrainment research, a less investigated yet crucial aspect for modelling multimodal interactive dialogue systems is the influence of inter-action modality, i.e. whether conversational partners who are visible to each other would entrain their speech more with respect to when eye contact is inhibited, or not. In our study, we compared prosodic adaptation behaviour (convergence and synchrony) of the same speaker pairs involved in collaborative game sessions under two conditions: audiovisual vs audio-only interaction. Results provide a complex picture, with a tendency to vocal entrainment enhancement when the speech/audio channel is the only one available.

Seeing or Not Seeing Your Conversational Partner: The Influence of Interaction Modality on Prosodic Entrainment

Michelina Savino
;
Loredana Lapertosa;
2018

Abstract

In speech entrainment research, a less investigated yet crucial aspect for modelling multimodal interactive dialogue systems is the influence of inter-action modality, i.e. whether conversational partners who are visible to each other would entrain their speech more with respect to when eye contact is inhibited, or not. In our study, we compared prosodic adaptation behaviour (convergence and synchrony) of the same speaker pairs involved in collaborative game sessions under two conditions: audiovisual vs audio-only interaction. Results provide a complex picture, with a tendency to vocal entrainment enhancement when the speech/audio channel is the only one available.
File in questo prodotto:
File Dimensione Formato  
SpeCom18_Savinoetal_postprint.pdf

non disponibili

Tipologia: Documento in Post-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 271.66 kB
Formato Adobe PDF
271.66 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11586/227541
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact