Music information representation: emotions expressed by users
DOI:
https://doi.org/10.5433/1981-8920.2020v25n3p306Keywords:
Music, Information representation, Information retrievalAbstract
Introduction: Representative concepts of music information domain are related to many dimensions: emotional, structural, technological, etc., varying its representation forms for retrieval purposes.Objective: Focusing on the emotional dimension related to listeners' musical experiences, the goal of this paper was to reveal the aspects expressed by the users in their comments about a specific song and video clip, and to relate these aspects with music information representation field.
Methodology: We collected 304 comments from Youtube and we analyzed language, extension and expression forms, presence and nature of the expressed emotional aspects. Inductively, we verified the facets to which comments were referring to.
Results: The main forms of expression used by users were textual, emojis or emoticons. A total of 79,1% of comments expressed some emotional aspect, being 53,6% positives and 13,1% negatives. Inductive analysis resulted in 12 emotional facets, referring to sound aspects, emotions evoked by past experiences, among others.
Conclusions: The facets represent the user point of view in a way of general classification that can be used to guide recommendation systems, be a source of extraction of natural language terms, acting as supporting to enrich semantically terms and expressions for music information retrieval
References
BRÄSCHER, M.; CAFÉ, L. Organização da Informação ou Organização do Conhecimento? In: LARA, M. L. G.; SMIT, J. W. Temas de Pesquisa em Ciência da Informação no Brasil. São Paulo: Escola de Comunicação e Artes, 2010. p. 87-103.
CRUZ, F. W.; CUNHA, M. B.; FERNEDA, E.; ALONSO, L. B. N.; VASCONCELOS, A. M. N. Um modelo para mapeamento de necessidades e usos de informação musical. Perspectivas em Ciência da Informação, Belo Horizonte, v. 16, n. 2, p. 207-227, abr./jun. 2011. Disponível em: http://www.scielo.br/pdf/pci/v16n2/13.pdf. Acesso em: 24 abr. 2016.
DENORA, T. Emotion as social emergence: perspectives from musicology. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011.
FONT, F.; SERRÀ, J.; SERRA, X. Analysis of the impact of a tag recommendation system in a real-world folksonomy. ACM Transactions on Intelligent Systems and Technology, v. 7, n. 1, 2015.
FUTRELLE, J., DOWNIE, J. S. Interdisciplinary communities and research issues in music information retrieval. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 2002, Paris. Anais [...]. Paris, 2002. Disponível em: http://ismir2002.ismir.net/proceedings/02-FP07-3.pdf. Acesso em: 23 jan. 2014.
GNOLI, C. Metadata about what? Distinguishing between ontic, epistemic, and documental dimensions in knowledge organization. Knowledge Organization, v. 39, n. 4, p. 268-275, 2012.
HEVNER, K. Experimental studies of the elements of expression in music source. The American Journal of Psychology, v. 48, n. 2. p. 246-268, abr.1936. Disponível em: https://www.jstor.org/stable/1415746?seq=1#page_scan_tab_contents. Acesso em: 17 jan. 2019.
HU, X.; DOWNIE, J. S.; EHMANN, A. F. Exploiting recommended usage metadata: exploratory analyses. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 2006, Victoria. Anais [...], Victoria, 2006. Disponível em: https://static.aminer.org/pdf/PDF/000/439/595/exploiting_recommended_usage_metadata_exploratory_analyses.pdf. Acesso em: 22 out. 2020.
HU, X.; DOWNIE, J. S. Exploring mood metadata: relationships with genre, artist and usage metadata. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, Viena, 2007. Anais [...], Viena, 2007. Disponível em: http://ismir2007.ismir.net/proceedings/ISMIR2007_p067_hu.pdf. Acesso em: 08 set. 2010.
HU, X.; LI, F.; NG, J. T. D. On the relationship between music-induced emotion and physiological signals. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19, Paris, 2018. Anais […], Paris (FR), 2018. Disponível em: ismir2018.ircam.fr/doc/pdfs/115_Paper.pdf. Acesso em:23 jan. 2019.
JUSLIN, P. N.; LAUKKA, P. Expression, perception, and induction of musical emotions: a review and a questionnaire study of everyday listening. Journal of New Music Research, v. 33, n. 3, p. 217-238, 2004.
KONECNI, V. J. The influence of affect on music choice. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011. p.697-724.
LAPLANTE, A. Everyday life music information-seeking behaviour of young adults: an exploratory study. 2008, 332 f. Tese (Doctor of Philosophy) – McGill University, School of Information Studies, Faculty of Education, Montréal (Canadá), 2008. Disponível em: https://escholarship.mcgill.ca/concern/theses/2514np20z. Acesso em: 22 out. 2020.
LAPLANTE, A. Users' Relevance Criteria in Music Retrieval in Everyday Life: An Exploratory Study. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 11, Utrecht, 2010. Anais [...], Utrecht, 2010, p. 601-606. Disponível em: http://ismir2010.ismir.net/proceedings/ismir2010-103.pdf. Acesso em: 15 jun. 2014.
LAPLANTE, A. Social capital and music discovery: an examination of the ties through which late adolescents discover new music. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 12, Miami, 2011. Anais [...], Miami, 2011, p. 341-346. Disponível em: http://ismir2011.ismir.net/papers/OS5-2.pdf. Acesso em: 15 jun. 2014.
LAPLANTE, Audrey. Tagged at first listen: an examination of social tagging practices in a music recommender system. Encontros Bibli, Florianópolis, v. 20, n. 1, p. 33-54, 2015. Disponível em: https://www.redalyc.org/pdf/147/14735377004.pdf. Acesso em: 27 out. 2020.
LEE, J. H. Analysis of user needs and information features in natural language queries seeking music information. Journal of the American Society for Information Science and Technology, v. 61, n. 5, p. 1025–1045, 2010.
LEE, J. H.; CUNNINGHAM, S. J. Toward an understanding of the history and impact of user studies in music information retrieval. Journal of Intelligent Information Systems, v. 41, n. 3, p. 499-521, 2013.
LEE, J. H.; DOWNIE, J. S.; CUNNINGHAM, S. J. Challenges in crosscultural/multilingual music information seeking. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 6., 2005, London. Anais [...], London, 2005. p. 1-7. Disponível em: http://ismir2005.ismir.net/proceedings/1100.pdf. Acesso em: 22 jan. 2014
LEE, J. H.; DOWNIE, J. S. Survey of music information needs, uses, and seeking behaviours: preliminary findings. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 5., Barcelona, 2004. Anais [...]. Barcelona, 2004. Disponível em: https://www.semanticscholar.org/paper/Survey-OfMusic-Information-Needs%2C-Uses%2C-And-LeeDownie/38dd11deaadd13d2c21904ae2bdf9789f6cfbbbb. Acesso em: 22 jan. 2014.
LESAFFRE, M.; DE VOOGDT, L.; LEMAN, M.; DE BAETS, B.; DE MEYER, H.; MARTENS, J. How potencial users of music search and retrieval systems describe the semantic quality of music. Journal of the American Society for Information Science and Technology, v. 59, n. 5, p. 695- 707, 2008.
MCLANE, A. Music as information. In: CRONIN, B. ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY. 37 ed. Medford: Information Today, 1996. p. 295-340.
MERRIAM, A. P. The anthropology of music. Evanston: Northwestern University Press, 1964.
PANDA, R.; MALHEIRO, R.; PAIVA, R. P. Musical Texture and Expressivity Features for Music Emotion Recognition. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19., Paris, 2018. Anais […]. Paris, 2018. Disponível em: http://ismir2018.ircam.fr/doc/pdfs/250_Paper.pdf. Acesso em: 27 out. 2020.
PARADA-CABALEIRO, E.; SCHMITT, M.; BATLINER, A.; HANTKE, S.; COSTANTINI, G.; SCHERER, K.; SCHULLER, B. W. Identifying emotions in opera singing: implications of adverse acoustic conditions. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19., Paris, 2018. Anais […]. Paris, 2018. Disponível em: http://ismir2018.ircam.fr/doc/pdfs/22_Paper.pdf. Acesso em: 23 jan. 2019.
PEIRCE, C. S. Semiótica. 3. ed. São Paulo: Perspectiva, 1995.
RUSSELL, J. A. A circumplex model of affect. Journal of Personality and Social Psychology, v. 39, n. 6, p. 1161-1178, 1980.
SANTAELLA, L. Matrizes da linguagem e pensamento: sonora, visual, verbal: aplicações na hipermídia. 3. ed. São Paulo: Iluminuras; FAPESP, 2009.
SLOBODA, J. A. Music in everyday life: the role of emotions. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011.
SPECK, J. A.; SCHMIDT, E. M.; MORTON, B. G.; KIM, Y. E. A comparative study of collaborative vs. traditional musical mood annotation. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 12., Miami, 2011. Anais [...]. Miami, 2004. Disponível em: http://www.mirlab.org/conference_papers/International_Conference/ISMIR%202011/papers/PS4-13.pdf. Acesso em: 23 out. 2015.
TELLEGEN, A.; WATSON, D.; CLARK, L. A. On the Dimensional and Hierarchical Structure of Affect. Psychological Science, v. 10, n. 4. p. 297-303, Jul./1999.
THAYER, R. E. The biopsychology of mood and arousal. New York: Oxford University Press, 1989.
VAN DE LAAR, B. Emotion detection in music, a survey. In: TWENTH STUDENT CONFERENCE ON IT, 4., Enschede, 2006. Anais [...], Enschede, 2006. Disponível em: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.75.284&rep=rep1&type=pdf. Acesso em: 22 out. 2020.
WEISSENBERGER, L. Toward a universal, meta-theoretical framework for music information classification and retrieval. Journal of Documentation, v. 71, n. 5, p. 917-937, 2015.
WIKIPEDIA. Emoji. Disponível em: https://pt.wikipedia.org/wiki/Emoji. Acesso em: 23 jan. 2019.
ZANGERLE, E.; PICHL, M. Content-based user models: modeling the many faces of musical preference. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, Paris, 2018. Anais [...]. Paris, 2018. Disponível em: ismir2018.ircam.fr/doc/pdfs/128_Paper.pdf. Acesso em: 23 jan. 2019.
CRUZ, F. W.; CUNHA, M. B.; FERNEDA, E.; ALONSO, L. B. N.; VASCONCELOS, A. M. N. Um modelo para mapeamento de necessidades e usos de informação musical. Perspectivas em Ciência da Informação, Belo Horizonte, v. 16, n. 2, p. 207-227, abr./jun. 2011. Disponível em: http://www.scielo.br/pdf/pci/v16n2/13.pdf. Acesso em: 24 abr. 2016.
DENORA, T. Emotion as social emergence: perspectives from musicology. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011.
FONT, F.; SERRÀ, J.; SERRA, X. Analysis of the impact of a tag recommendation system in a real-world folksonomy. ACM Transactions on Intelligent Systems and Technology, v. 7, n. 1, 2015.
FUTRELLE, J., DOWNIE, J. S. Interdisciplinary communities and research issues in music information retrieval. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 2002, Paris. Anais [...]. Paris, 2002. Disponível em: http://ismir2002.ismir.net/proceedings/02-FP07-3.pdf. Acesso em: 23 jan. 2014.
GNOLI, C. Metadata about what? Distinguishing between ontic, epistemic, and documental dimensions in knowledge organization. Knowledge Organization, v. 39, n. 4, p. 268-275, 2012.
HEVNER, K. Experimental studies of the elements of expression in music source. The American Journal of Psychology, v. 48, n. 2. p. 246-268, abr.1936. Disponível em: https://www.jstor.org/stable/1415746?seq=1#page_scan_tab_contents. Acesso em: 17 jan. 2019.
HU, X.; DOWNIE, J. S.; EHMANN, A. F. Exploiting recommended usage metadata: exploratory analyses. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 2006, Victoria. Anais [...], Victoria, 2006. Disponível em: https://static.aminer.org/pdf/PDF/000/439/595/exploiting_recommended_usage_metadata_exploratory_analyses.pdf. Acesso em: 22 out. 2020.
HU, X.; DOWNIE, J. S. Exploring mood metadata: relationships with genre, artist and usage metadata. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, Viena, 2007. Anais [...], Viena, 2007. Disponível em: http://ismir2007.ismir.net/proceedings/ISMIR2007_p067_hu.pdf. Acesso em: 08 set. 2010.
HU, X.; LI, F.; NG, J. T. D. On the relationship between music-induced emotion and physiological signals. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19, Paris, 2018. Anais […], Paris (FR), 2018. Disponível em: ismir2018.ircam.fr/doc/pdfs/115_Paper.pdf. Acesso em:23 jan. 2019.
JUSLIN, P. N.; LAUKKA, P. Expression, perception, and induction of musical emotions: a review and a questionnaire study of everyday listening. Journal of New Music Research, v. 33, n. 3, p. 217-238, 2004.
KONECNI, V. J. The influence of affect on music choice. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011. p.697-724.
LAPLANTE, A. Everyday life music information-seeking behaviour of young adults: an exploratory study. 2008, 332 f. Tese (Doctor of Philosophy) – McGill University, School of Information Studies, Faculty of Education, Montréal (Canadá), 2008. Disponível em: https://escholarship.mcgill.ca/concern/theses/2514np20z. Acesso em: 22 out. 2020.
LAPLANTE, A. Users' Relevance Criteria in Music Retrieval in Everyday Life: An Exploratory Study. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 11, Utrecht, 2010. Anais [...], Utrecht, 2010, p. 601-606. Disponível em: http://ismir2010.ismir.net/proceedings/ismir2010-103.pdf. Acesso em: 15 jun. 2014.
LAPLANTE, A. Social capital and music discovery: an examination of the ties through which late adolescents discover new music. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 12, Miami, 2011. Anais [...], Miami, 2011, p. 341-346. Disponível em: http://ismir2011.ismir.net/papers/OS5-2.pdf. Acesso em: 15 jun. 2014.
LAPLANTE, Audrey. Tagged at first listen: an examination of social tagging practices in a music recommender system. Encontros Bibli, Florianópolis, v. 20, n. 1, p. 33-54, 2015. Disponível em: https://www.redalyc.org/pdf/147/14735377004.pdf. Acesso em: 27 out. 2020.
LEE, J. H. Analysis of user needs and information features in natural language queries seeking music information. Journal of the American Society for Information Science and Technology, v. 61, n. 5, p. 1025–1045, 2010.
LEE, J. H.; CUNNINGHAM, S. J. Toward an understanding of the history and impact of user studies in music information retrieval. Journal of Intelligent Information Systems, v. 41, n. 3, p. 499-521, 2013.
LEE, J. H.; DOWNIE, J. S.; CUNNINGHAM, S. J. Challenges in crosscultural/multilingual music information seeking. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 6., 2005, London. Anais [...], London, 2005. p. 1-7. Disponível em: http://ismir2005.ismir.net/proceedings/1100.pdf. Acesso em: 22 jan. 2014
LEE, J. H.; DOWNIE, J. S. Survey of music information needs, uses, and seeking behaviours: preliminary findings. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 5., Barcelona, 2004. Anais [...]. Barcelona, 2004. Disponível em: https://www.semanticscholar.org/paper/Survey-OfMusic-Information-Needs%2C-Uses%2C-And-LeeDownie/38dd11deaadd13d2c21904ae2bdf9789f6cfbbbb. Acesso em: 22 jan. 2014.
LESAFFRE, M.; DE VOOGDT, L.; LEMAN, M.; DE BAETS, B.; DE MEYER, H.; MARTENS, J. How potencial users of music search and retrieval systems describe the semantic quality of music. Journal of the American Society for Information Science and Technology, v. 59, n. 5, p. 695- 707, 2008.
MCLANE, A. Music as information. In: CRONIN, B. ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY. 37 ed. Medford: Information Today, 1996. p. 295-340.
MERRIAM, A. P. The anthropology of music. Evanston: Northwestern University Press, 1964.
PANDA, R.; MALHEIRO, R.; PAIVA, R. P. Musical Texture and Expressivity Features for Music Emotion Recognition. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19., Paris, 2018. Anais […]. Paris, 2018. Disponível em: http://ismir2018.ircam.fr/doc/pdfs/250_Paper.pdf. Acesso em: 27 out. 2020.
PARADA-CABALEIRO, E.; SCHMITT, M.; BATLINER, A.; HANTKE, S.; COSTANTINI, G.; SCHERER, K.; SCHULLER, B. W. Identifying emotions in opera singing: implications of adverse acoustic conditions. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 19., Paris, 2018. Anais […]. Paris, 2018. Disponível em: http://ismir2018.ircam.fr/doc/pdfs/22_Paper.pdf. Acesso em: 23 jan. 2019.
PEIRCE, C. S. Semiótica. 3. ed. São Paulo: Perspectiva, 1995.
RUSSELL, J. A. A circumplex model of affect. Journal of Personality and Social Psychology, v. 39, n. 6, p. 1161-1178, 1980.
SANTAELLA, L. Matrizes da linguagem e pensamento: sonora, visual, verbal: aplicações na hipermídia. 3. ed. São Paulo: Iluminuras; FAPESP, 2009.
SLOBODA, J. A. Music in everyday life: the role of emotions. In: JUSLIN, P. N.; SLOBODA, J. A. Handbook of music and emotion: theory, research, applications. Oxford: Oxford University Press, 2011.
SPECK, J. A.; SCHMIDT, E. M.; MORTON, B. G.; KIM, Y. E. A comparative study of collaborative vs. traditional musical mood annotation. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, 12., Miami, 2011. Anais [...]. Miami, 2004. Disponível em: http://www.mirlab.org/conference_papers/International_Conference/ISMIR%202011/papers/PS4-13.pdf. Acesso em: 23 out. 2015.
TELLEGEN, A.; WATSON, D.; CLARK, L. A. On the Dimensional and Hierarchical Structure of Affect. Psychological Science, v. 10, n. 4. p. 297-303, Jul./1999.
THAYER, R. E. The biopsychology of mood and arousal. New York: Oxford University Press, 1989.
VAN DE LAAR, B. Emotion detection in music, a survey. In: TWENTH STUDENT CONFERENCE ON IT, 4., Enschede, 2006. Anais [...], Enschede, 2006. Disponível em: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.75.284&rep=rep1&type=pdf. Acesso em: 22 out. 2020.
WEISSENBERGER, L. Toward a universal, meta-theoretical framework for music information classification and retrieval. Journal of Documentation, v. 71, n. 5, p. 917-937, 2015.
WIKIPEDIA. Emoji. Disponível em: https://pt.wikipedia.org/wiki/Emoji. Acesso em: 23 jan. 2019.
ZANGERLE, E.; PICHL, M. Content-based user models: modeling the many faces of musical preference. In: INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, Paris, 2018. Anais [...]. Paris, 2018. Disponível em: ismir2018.ircam.fr/doc/pdfs/128_Paper.pdf. Acesso em: 23 jan. 2019.
Downloads
Published
2020-10-31
How to Cite
Barros, C. M. de. (2020). Music information representation: emotions expressed by users. Informação & Informação, 25(3), 306–331. https://doi.org/10.5433/1981-8920.2020v25n3p306
Issue
Section
Artigos
License
A revista se reserva o direito de efetuar, nos originais, alterações de ordem normativa, ortográfica e gramatical, com vistas a manter o padrão culto da língua e a credibilidade do veículo. Respeitará, no entanto, o estilo de escrever dos autores. Alterações, correções ou sugestões de ordem conceitual serão encaminhadas aos autores, quando necessário.
O conteúdo dos textos e a citação e uso de imagens submetidas são de inteira responsabilidade dos autores.
Em todas as citações posteriores, deverá ser consignada a fonte original de publicação, no caso a Informação & Informação.
