Konferensartikel

Niklas Rönnberg
Division for Media and Information Technology, Linköping University, Linköping, Sweden

Jonas Löwgren
Division for Media and Information Technology, Linköping University, Linköping, Sweden

Ladda ner artikelhttp://dx.doi.org/10.3384/ecp10305

Ingår i: Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016

Linköping Electronic Conference Proceedings 103:5, s. 31-34

Publicerad: 2016-03-01

ISBN: 978-91-7685-817-2

ISSN: 1650-3686 (tryckt), 1650-3740 (online)

This paper is an introduction to the emotional qualities of sound and music, and we suggest that the visual and the aural modalities should be combined in the design of visualizations involving emotional expressions. We therefore propose that visualization design should incorporate sonic interaction design drawing on musicology, cognitive neuroscience of music, and psychology of music, and identify what we see as key research challenges for such an approach.

1. Eerola, T. & J.K. Vuoskoski, A Review of Music and Emotion Studies: Approaches, Emotion Models, and Stimuli. Music Percept, 2013. 30(3): p. 307-340.

2. Davies, S., Musical Meaning and Expression. Vol. 46. 1994: Cornell University Press. 533.

3. Juslin, P.N. & P. Laukka, Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening. J New Music Res, 2004. 33(3): p. 217-238.

4. Peretz, I. & R.J. Zatorre, Brain Organization for Music Processing. Annu Rev Psychol, 2005. 56(1): p. 89-114.

5. Hunter, P.G., et al., Feelings and Perceptions of Happiness and Sadness Induced by Music: Similarities, Differences, and Mixed Emotions. Psychol Aesthet Creat Arts, 2010. 4(1): p. 47-56.

6. Maslow, A.H., Music Education and Peak Experience. Music Educ J, 1968. 54(6): p. 72-171.

7. Schäfer, T., et al., How music changes our lives: A qualitative study of the long-term effects of intense musical experiences. Psychol Music, 2014. 42(4): p. 525-544.

8. Croom, A.M., Music, neuroscience, and the psychology of well-being: a précis. Front Psychol, 2012. 2: p. 393.

9. Schmidt, L.A. & L.J. Trainor, Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cognition Emotion, 2001. 15(4): p. 487-500.

10. Lane, R.D., et al., Cognitive neuroscience of emotion. Series in affective science. New York: Oxford University Press, 2000.

11. Burnett, S., et al., Development during Adolescence of the Neural Processing of Social Emotion. J Cognitive Neurosci, 2009. 21(9): p. 1736-1750.

12. Seashore, C.E., Psychol Music. NY, US: Dover, 1967. 13. Levitin, D.J., This is your brain on music: The science of a human obsession. NY, US: Dutton/Penguin Books, 2006.

14. Iakovides, S.A., et al., Psychophysiology and psychoacoustics of music: Perception of complex sound in normal subjects and psychiatric patients. Ann Gen Hosp Psychiatry, 2004. 3.

15. Coutinho, E. & A. Cangelosi, Musical emotions: predicting second-by-second subjective feelings of emotion from low-level psychoacoustic features and physiological measurements. Emotion, 2011. 11(4): p. 921-37.

16. Menon, V. & D.J. Levitin, The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage, 2005. 28(1): p. 175-84.

17. Evers, S. & B. Suhr, Changes of the neurotransmitter serotonin but not of hormones during short time music perception. Eur Arch Psychiatry Clin Neurosci, 2000. 250(3): p. 144.

18. Bresin, R. & A. Friberg, Emotion rendering in music: range and characteristic values of seven musical variables. Cortex, 2011. 47(9): p. 1068-81.

19. Kreutz, G., et al., Using music to induce emotions: Influences of musical preference and absorption. Psychol Music, 2008. 36(1): p. 101-126.

20. Ashley, R. Affective and perceptual responses to very brief musical stimuli. In Proc. of International conference on music perception and cognition. 2008.

21. Mace, S.T., et al., Genre identification of very brief musical excerpts. Psychol Music, 2011. 40(1): p. 112-128.

22. Gorbman, C., Unheard melodies: narrative film music. London: Bloomington: BFI Pub.; Indiana University Press, 1987.

23. Phillips, W., A composer’s guide to game music. Cambridge, Mass.: MIT Press, 2014.

24. Pauletto, S., Film and theatre-based approaches for sonic interaction design. Digit Creat, 2014. 25(1): p. 15-26.

25. Tweedie, L., et al. Externalising abstract mathematical models. In Proc. of CHI 96. ACM (1996).

26. Koskinen, I.K., Design research through practice: from the lab, field, and showroom. Waltham, Mass.: Morgan Kaufmann, 2012.

27. Franinovic, K. & S. Serafin, Sonic interaction design. Cambridge, Mass.: MIT Press, 2013.

28. Peretz, I. & R.J. Zatorre, The cognitive neuroscience of music. Oxford: Oxford University Press, 2003.

29. Gaver, W.W., et al., Effective sounds in complex systems: the ARKola simulation. In Proc. of CHI 91. ACM (1991).

30. Burkhard, R.A., et al., Visualization Summit 2007: Ten research goals for 2010. Inf Vis, 2007. 6(3): p. 169-188.

31. Kerren, A., et al., Workshop Report: Information Visualization: Human-Centered Issues in Visual Representation, Interaction, and Evaluation. Inf Vis,
2007: p. 189.

32. Moere, A.V., et al., On the role of design in information visualization. Inf Vis, 2011. 10(4): p. 356-371.