Publicerad: 2015-06-03
ISBN: 978-91-7519-074-7
ISSN: 1650-3686 (tryckt), 1650-3740 (online)
Illiteracy remains a persistent problem all over the world. Especially people with cognitive impairments are affected and, at the same time, often excluded from interventions because courses and e-learning materials are not tailored to the particular needs of these people. A teaching method that is occasionally applied in special schools is a gesture-based training: Learning of letter-sound pairs is supported by associated gestures. In this paper first steps towards realizing this methodology with a virtual teacher are presented. We apply a user-centered approach and present a first prototype system which is used to set up an evaluation with learners from the target audience. In the study, participants learned with the system in consecutive learning sessions over three days. We present results with regard to the general acceptability of the system, problems the learners had as well as issues of the system they liked. The outcome of the study serves to inform future versions of the prototype system.
C. Abras, D. Maloney-Krichmar, and J. Preece. 2012. User-centered design. In Encyclopedia of Human-Computer Interaction. Sage Publications.
A.L. Baylor and S. Kim. 2009. Designing nonverbal communication for pedagogical agents: When less is more. Computers in Human Behavior, 25:450–457.
K. Bergmann and M. Macedonia. 2013. A virtual agent as vocabulary trainer: Iconic gestures help to improve learners’ memory performance. In Proceedings of the 13th International Conference on Intelligent Virtual Agents, pages 139–148, Berlin/Heidelberg. Springer.
U. Bleidick and W. Kraft. 1966. Lesen und Lesenlernen unter erschwerten Bedingungen [Reading and learning to read under difficult conditions]. Neue Deutsche Schule Verlagsgesellschaft.
M.J. Gielniak and A.L. Thomaz. 2012. Enhancing interaction through exaggerated motion synthesis. In Proceedings of the 7th annual ACM/IEEE international conference on Human-Robot Interaction, pages 375–382.
S. Heidig and G. Clarebout. 2011. Do pedagogical agents make a difference to student motivation and learning? a review of empirical research. Educational Research Review, 6(1):27–54.
F.J. Koch. 1939. Fingerlesen. Lesen als Gebärdenspiel [Finger-reading. Reading as a gesture-based game].
Schwann, Düsseldorf.
H.J Kossow. 1979. Zur Therapie der Lese-Rechtschreibschwäche [About the therapy of dyslexia].
W. Kraft. 1971. Lautgebärden im Erstleseunterricht der Lernbehinderten- und Geistigbehindertenschule [gestures for sounds in reading eductation in specilaized schools for pupils with learning difficulties and cognitive impairments]. Zeitschrift für Heilpädagogik, 22:1–19.
M. Kramer, R. Yaghoubzadeh, S. Kopp, and K. Pitsch. 2013. A conversational virtual human as autonomous assistant for elderly and cognitively impaired users? social acceptability and design considerations. In Lecture Notes in Informatics (LNI). Series of the Gesellschaft f¨ur Informatik (GI), volume P-220, pages 1105–1119, Bonn. K¨ollen Druck + Verlag GmbH.
W. Radigk. 1975. Lesenlernen: Unter besonderer Berücksichtigung der Arbeit mit lernbehinderten Schülern [Learning to read: Under particular consideration of the work with learning-disabled pupils]. Marhold, Berlin.
H. Schäfer. 2011. Zur wirkungsweise von lautgebärden im f¨orderschwerpunkt geistige entwicklung [about the effectiveness of gestures in the area of mental development]. Behindertenpädagogik, 2:200–121.
M. Schröder and J. Trouvain. 2003. The german text-to-speech synthesis system MARY: A tool for research, development and teaching. International Journal of Speech Technology, 6:365–377.
H. van Welbergen, R. Yaghoubzadeh, and S. Kopp. 2014. AsapRealizer 2.0: The next steps in fluent behavior realization for ECAs. In Proceedings of the 14th International Conference on Intelligent Virtual Agents, LNCS, Berlin, Germany. Springer.
H. Vilhjalmsson, N. Cantelmo, J. Cassell, N. Chafai, M. Kipp, S. Kopp, M. Mancini, S. Marsella, A.N. Marshall, C. Pelachaud, Z. Ruttkay, K.R. Thorisson, H. van Welbergen, and R.J. van der Werf. 2007. The Behavior Markup Language: Recent developments and challenges. In C. Pelachaud, J.-C. Martin, E. Andre, G. Chollet, K. Karpouzis, and D. Pelé, editors, Proceedings of the 7th International Conference on Intelligent Virtual Agents, pages 99–111, Berlin/Heidelberg. Springer.
R. Yaghoubzadeh, M. Kramer, K. Pitsch, and S. Kopp. 2013. Virtual agents as daily assistants for elderly or mentally handicapped persons - studies on acceptance and interaction feasibility. In Proceedings of the 13th International Conference on Intelligent Virtual Agents, pages 79–91, Berlin/Heidelberg. Springer.
