Published: 2013-10-29
ISBN: 978-91-7519-461-5
ISSN: 1650-3686 (print), 1650-3740 (online)
This study treats the semantic interpretation of co-speech gestures produced with nouns and verbs. One set of 30 gestures was originally produced in conversation by speakers with aphasia; whereas another set of 30 gestures was produced by speakers without aphasia. Each gesture was mimicked by the experiment leader to a panel of judges. The interpreted meaning was written down by the panel of 13 subjects; 7 with the same linguistic and cultural background as the original producers and 6 with other linguistic-cultural backgrounds. The purpose was to study the possible influence on the interpretations of (i) aphasia – no aphasia; in the originally producing group;(ii) cultural background in the panel; (iii) verb vs. noun (or action vs. object orientation) of the originally co-produced word; and (iv) the level of abstraction of a gesture-word-combination. The results showed no influence from aphasia in the producer or cultural background in the interpreting panel. Action gestures tended to be more frequent for both persons with and without aphasia than object gestures and were used also with some nouns. The level of abstractness was captured in the interpretation of about 75% of the items and in the remaining 25%; the interpretations tended to be more abstract than the originally co-produced word.
Ahlsén; E. (1991). Body communication and speech in a Wernicke’s aphasic – A longitudinal study. Journal of Communication Disorders; 24; 1–12.
Ahlsén; E. (2011). Towards an integrated view of gestures related to speech; Proceedings of the 3rd Nordic Symposium on Multimodal Communication. Editors: Patrizia Paggio; Elisabeth Ahlsén; Jens Allwood; Kristiina Jokinen; Costanza Navarretta. NEALT Proceedings Series. 15 (2111) s. 72-77.
Ahlsén; E. & Schwarz; A. (2013). Features of aphasic gesturing. Clinical Linguistics and Phonetics). (Early online doi:10.3109/02699206.2013.813077).
Allwood; J.(2003). Meaning Potential and Context. Some Consequences for the Analysis of Variation in Meaning. In Cuyckens; Hubert; Dirven; René & Taylor; John R. (eds). Cognitive Approaches to Lexical Semantics. Moulton de Gruyter; pp. 29-65.
Allwood; J. (2008). Dimensions of Embodied Communication - towards a typology of embodied communication. In: Ipke Wachsmuth; Manuela Lenzen; Günther Knoblich (eds.) Embodied Communication in Humans and Machines; Oxford University Press.
Arbib; M. (2005). From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics. Behavioral and Brain Sciences; 28; 105–124.
Beattie; G. W.; & Shovelton; H. K. (2000). Iconic hand gestures and predictability of words in context in spontaneous speech. British Journal of Psychology; 91; 473–492.
Beattie; G. W.; & Shovelton; H. K. (2002). An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology; 93; 179–192.
Beattie; G. W.; & Shovelton; H. K. (2004). Body language. In Oxford companion to the mind. Oxford: Oxford University Press.
Beattie; G. W.; & Shovelton; H. K. (2005). Why the spontaneous images created by the hands during talk can help make TV advertisements more effective. British Journal of Psychology; 96; 21–37.
Crepaldi; D.; Berlinger; M.; Paulesu; E.; & Luzzatti; C. (2011). A place for nouns and a place for verbs? A critical review of grammatical-class effects. Brain and Language; 116; 33–49.
De Ruiter; J. P. (2006). Can gesticulation help aphasic people speak; or rather; communicate? Advances in Speech-Language Pathology; 8; 124–127.
Feyereisen; P.; & Havard; I. (1999). Mental imagery and production of hand gestures while speaking in younger and older adults. Journal of Nonverbal Behavior; 23; 153–171.
Gallese; V.; & Lakoff; G. (2005). The brain’s concepts: The role of the sensory-motor system in reason and language. Cognitive Neuropsychology; 22; 455–479.
Graham; J. A.; & Argyle; M. (1975). A cross-cultural study of the communication of extra-verbal meaning by gestures. International Journal of Psychology; 10; 57–67.
Graham; J. A.; & Heywood; S. (1975). The effects of elimination of hand gestures and of verbal codability on speech performance. European Journal of Social Psychology; 5; 189–195.
Hadar; U.; & Butterworth; B. (1997. Iconic gesture; imagery and word retrieval in speech. Semiotica; 115; 147–172.
Hadar; U.; Wenkert-Olenik; D.; & Soroker; N. (1996). Gesture and the processing of speech in aphasia. Brain and Language; 55; 180–182.
Kita; S. (2000). How representational gestures help speaking. In D. McNeill (Ed.); Language and gesture: Window into thought and action (pp. 162–185). Cambridge; UK: Cambridge University Press.
Lott; P. (1999). Gesture and aphasia. Bern: Peter Lang.
McNeill; D. (1985). So you think gestures are nonverbal? Psychological Review; 92; 350–371.
McNeill; D. (1992). Hand and mind. Chicago: The University of Chicago Press.
McNeill; D. (2000). Language and gesture. Cambridge; UK: Cambridge University Press.
McNeill; D. (2007). Gesture and thought. Chicago: University of Chicago Press.
Melinger; A.; & Kita; S. (2006). Conceptual load triggers gesture production. Language and Cognitive Processes; 22; 473–500.
Özyürek; A.; Willems; R. M.; Kita; S.; & Hagoort; P. (2007). On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience; 19; 605–616.
Peirce; C. S. (1932). Collectd Papers of Charles Sanders Peirce. Harvard University Press.
Rauscher; F. H.; Krauss; R. M.; & Chen; Y. (1996). Gesture; speech and lexical access: The role of lexical movements in speech production. Psychological Science; 7; 226–231.
Rimé; B.; Schiaratura; L.; & Ghysselinckx; A. (1984). Effects of relative immobilization on the speaker’s nonverbal behavior and on the dialogue imagery level. Motivation and Emotion; 8; 311–325.
Simmons; K.; & Barsalou; L. W. (2003). The similarity-in-topography principle: Reconciling theories of conceptual deficits. Cognitive Neuropsychology; 20; 451–486.
Wu; Y. C.; & Coulson; S. (2007). How iconic gestures enhance communication: An ERP study. Brain and Language; 101; 234–245.
