Costanza Navarretta
University of Copenhagen, Copenhagen, Denmark
Magdalena Lis
University of Copenhagen, Copenhagen, Denmark
Ladda ner artikel
Ingår i: NEALT Proceedings. Northern European Association for Language and Technology; 4th Nordic Symposium on Multimodal Communication; November 15-16; Gothenburg; Sweden
Linköping Electronic Conference Proceedings 93:8, s. 55-62
NEALT Proceedings Series 21:8, p. 55-62
Publicerad: 2013-10-29
ISBN: 978-91-7519-461-5
ISSN: 1650-3686 (tryckt), 1650-3740 (online)
This paper presents a pilot comparative study
of feedback head movements and voc expressions in Danish and Polish naturallocurring video recorded conversations. The conversations involve three well-acquainted participants who talk freely in their homes while eating and drinking. The analysis of the data indicates that the participants use the same types of head and spoken feedback in the two languages. However; the Polish participants express more often feedback multimodally; that is through the two modalities; and they use more repeated multimodal feedback expressions than the Danish participants. Moreover; we found a stronger relation between repeated head movements and repeated speech tokens in the Polish data than in the Danish one. Our data also confirms that there is a correlation between familiarity and feed- back frequency and familiarity and repetitive- ness of feedback expressions as suggested in preceding studies (Boholm and Allwood 2010; Navarretta and Paggio 2012).
Allwood; J. & Lu; J. (2010). Chinese and Swedish multimodal communicative feedback. Presented at the 5th Conference on Multimodality. Sydney;1-3 December 2010; pp.19-20.
Allwood; J. & Ahlsén; E. (1998). Learning how to manage communication; with special refer- ence to the acquisition of linguistic feedback. Journal of Pragmatics; 31; 1353-1389.
Allwood; J.; Cerrato; L.; Jokinen; K.; Navarretta; C. & Paggio; P. (2007). The MUMIN Coding Scheme for the Annotation of Feedback; Turn Management and equencing. In Martin; J. C. et al. (eds) Multimodal Corpora for Modelling Human Multimodal Behaviour. Special issue of the International Journal of Language Resources and Evaluation. Springer.
Boholm; M. & Allwood; J. (2010). Repeated head movements; their function and relation to speech. In Kipp; M. et al. (eds.) Workshop on Multimodal Corpora: Advances in Capturing; Coding and Analyzing Multimodality. LREC 2010.
Campbell; N. (2007). Individual Traits of Speaking. Style and Speech Rhythm in a Spoken Discourse. In. Proceedings of the COST 2102 Workshop; pp. 107-120.
Cerrato; L. (2007). Investigating Communicative Feedback Phenomena across Languages and Modalities. PhD thesis; Stockholm; KTH; Speech and Music Communication.
McClave; E. (2000). Linguistic functions of head movements in the context of speech. Journal of Pragmatics; 32; 855-878.
MacWhinney; B. & Wagner; J. (2010). Transcribing; searching and data sharing: The CLAN software and the TalkBank data repository. In: Gespraechsforschung; Vol. 11; 2010; 154-173.
Malisz; Z. & Maciej Karpinski. M. (2010). Multimodal aspects of positive and negative responses in Polish task-oriented dialogues. Proceedings of Speech Prosody 2010. Chicago.
Maynard; S. (1987). Interactional functions of a nonverbal sign: Head movement in Japanese dyadic casual conversation. Journal of Pragmatics; 11; 589-606.
Navarretta; C.; Ahlsén; E.; Allwood; J.; Jokinen; K. & Paggio; P. (2012). Feedback in Nordic First-Encounters: a Comparative Study. In Proceedings of LREC 2012; May 2012; Istanbul; Turkey; pp. 2494-2499.
Navarretta. C. (2011). Annotating Non-verbal Behaviours in Informal Interactions. In Esposito; A; Vinciarelli; A.; Vicsi; K.; Pelachaud; C. & Nijholt; A. (eds.) Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues; LNCS 6800; Springer Verlag; pp. 317-324.
Paggio; P. & Navarretta. C. (2011a). Feedback and gestural behaviour in a conversation- al corpus of Danish. In P. Paggio et al. (eds.) Proceedings of the 3rd Nordic Symposium on Multi- modal Communication May 27-28; 2011; University of Helsinki; Finland; NEALT Proceedings Series vol. 15; 2011; pp. 33-39.
Paggio; P. & Navarretta; C. (2011b.) Learning to classify the feedback function of head movements in a Danish Corpus of first encounters . In Proceedings of ICMI 2011 Workshop Multimodal Corpora for Machine Learning: Taking Stock and Road mapping the Future ; Alicante; Spain November; 8 pages.
Navarretta; C. & & Paggio; P. (2012) Verbal and Non-Verbal Feedback in Different Types of Interac- tions. In Proceedings of LREC 2012; May 2012; Istanbul; Turkey; pp. 2338-2342.
Rehm; M.; Nakano; Y.; André; E. & Nishida. T. (2008). Culture-Specific First Meeting Encounters between Virtual Agents. In Proceedings of the 8th international conference on Intelligent Virtual Agents (IVA ’08); Prendinger (Eds.). Springer- Verlag; Berlin; Heidelberg; pp. 223–236.
Truong; K.; Poppe; R.; de Kok; I. & Heylen; D. (2011). A Multimodal Analysis of Vocal and Visual Backchannels in Spontaneous Dialogs. In Proceedings of Interspeech 2011; International Speech Communication Association; France; pp.
2973-2976.
