Published: 2013-10-29
ISBN: 978-91-7519-461-5
ISSN: 1650-3686 (print), 1650-3740 (online)
There is wide agreement about the fact that different kinds of communicative gestures like head move- ments and facial expressions are used extensively in face-to-face communication for various purposes e.g. expressing feedback; emphasis; turn management and emotions; or supporting the speaker’s own communi- cation management. Moreover; studies show that individual differences in gestural behaviour can be attributed to different personality traits like extraversion and openness. But these findings do not model the fact that the same person may feel and act differently in different situations. We compare the results of post- experiment questionnaires consisting of self-rating questions about conversation experience; influence and attitudinal emotions; to gestural behaviour in a multimodal corpus of face-to-face conversations. Our findings suggest a slight positive correlation between the way conversations are perceived and the number of head nods produced. In turn; the degree of head movement in the specific conversation is probably a function of the subject’s positive engagement in it.
attitudinal emotions; .first-acquaintance conversations; head nods; gesture; Danish
Allwood; J.; Nivre; J. & Ahlsen; E. (1992). On the semantics and pragmatics of linguistic feedback. Journal of Semantics; (9); 1–26.
Allwood; J.; Cerrato; L.; Jokinen; K.; Navarretta; C. & Paggio; P. (2007). The Mumin coding scheme for the annotation of feedback; turn management and sequencing. Multimodal Corpora for Modelling Human Multimodal Behaviour. Special Issue of the International Journal of Language Resources and Evaluation; 41(3-4); 273-287.
Argyle; M. 1975. Bodily communication. London.
Routledge.
Batrinca; L. M.; Mana; N.; Lepri; B.; Pianesi; F. & Sebe; N. (2011). Please; Tell Me About Yourself: Automatic Personality Assessment Using Short Self-Presentations; (13th International Conference on Multimodal Interaction - ICMI 2011; Alicante; Spain).
Boersma; P. & Weenink; D. (2009). Praat: doing phonetics by computer (version 5.1.05) [computer program]. Retrieved May 1; 2009; from http://www.praat.org/.
Boholm; M. & Allwood; J. (2010). Repeated Head Movements; their Function and Relation to Speech. In Kipp; M.; Martin; J.C.; Paggio; P.; & Heylen; D. (eds.) Proceedings of the Workshop on Multimodal Corpora: Advances in Capturing; Coding and Analyzing Multimodality. LREC 2010.Valletta; Malta; 18 May 2010; pages 6-10.
Brebner; J. (1985). Personality theory and movement. Individual differences in movement; 27-41.
Cerrato; L. (2007). Investigating Communicative Feed- back Phenomena across Languages and Modalities. Ph.D. thesis; Stockholm; KTH; Speech and Music Communication.
Duncan; S. (1972). Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology (23); 283–292.
Ekman; P. (1972). Emotion in the Human Face: Guide-Lines for Research and an Integration of Findings. New York. Pergamon.
Helweg-Larsen; M.; Cunningham; S.J.; Carrico; A.; & Pergram; A.M. (2004). To nod or not to nod: An observational study of nonverbal communication and status in female and male college students. Psychology of Women Quarterly (28); 358-361.
Jokinen; K.; Navarretta; C. & Paggio; P. (2008). Distinguishing the communicative functions of gestures. In Proceedings of the 5th MLMI; LNCS 5237; pp. 38–49; Utrecht; September. Springer.
Kipp; M. (2004). Gesture Generation by Imitation. From Human Behavior to Computer Character Animation. Boca Raton; Florida: Dissertation.com.
Lippa; R. (1998). The nonverbal display and judgment of extraversion; masculinity; femininity; and gender diagnosticity: A lens model analysis. Journal of Research in Personality (32); 80-107.
McClave; E. (2000). Linguistic functions of head movements in the context of speech. Journal of Pragmatics (32); 855–878.
Mehrabian; A (1996). Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology (14); 261-292.
Navarretta; C. & Paggio; P. (2010). Classi?cation of feedback expressions in multimodal data. In Proceedings of the 48th Annual Meeting of the Asso- ciation for Computational Linguistics (ACL 2010); pp. 318–324; Uppsala; Sweden; Juli 11-16.
Nezlek; J. B. (2010). Multilevel modeling and cross-cultural research. In Matsumoto; D. & van de Vijver; A. J. R. (eds.) Cross-Cultural research meth- ods in psychology. Oxford.
Paggio; P.; Allwood; J.; Ahlsén; E.; Jokinen; K & Navarretta; C. (2010). The NOMCO multimodal Nordic resource - goals and characteristics. In Proceedings of LREC 2010; Malta; 17-23 May pp. 2968-2973.
Paggio; P. & Navarretta; C. (2010). Feedback in head gesture and speech. In Kipp; M. et al.; (eds); Proceedings of LREC-2010; pages 1–4; Malta; May 17.
Paggio; P. & Navaretta; C. (2011a). Feedback and gestural behaviour in a conversational corpus of Danish. Proceedings of the 3rd Nordic Symposium on Multimodal Communication. NEALT Proceedings Series (15); 33–39.
Paggio; P. & Navarretta; C. (2011b). Learning to classify the feedback function of head movements in a Danish Corpus of first encounters. In Proceedings of ICMI 2011 Workshop Multimodal Corpora for Machine Learning: Taking Stock and Road mapping the Future ; Alicante; Spain November 2011;
8 pages.
Paggio; P. & Navarretta; C. (2011c). Head movements; facial expressions and feedback in Danish ?rst encounters interactions: a culture-speci?c analysis. In C. Stephanidis; (Ed.); Universal Access in Human-Computer Interaction. Users Diversity. Proceedings of 6th International Conference; UAHCI 2011; Held as Part of HCI International; pp. 583–590; Orlando; FL; USA; July. Springer.
Riggio; R.& Friedman; H. (1986). Impression formation: The role of expressive behavior. In Journal of Personality and Social Psychology; 50 (2); 421-427.
Yngve; V. 1970. On getting a word in edgewise. In Papers from the sixth regional meeting of the Chicago Linguistic Society; pp. 567–578.
