Abstract
This paper describes the iterative design process and evaluation of mood pictures in a social music discovery service. The service enables users to consume and collaboratively create playlists based on the pictures. In total, 45 Finnish users took part in the qualitative evaluations. This paper presents the results regarding the preset mood picture design and introduces user-generated mood picture playlists. Based on the results, a set of design implications for mood pictures is introduced. In addition, the consistency of user responses from a quantitative picture–music association test shows the applicability of mood picture–music associations to a music discovery service.
Similar content being viewed by others
References
Ahmed YA, Benford S, Crabtree A (2012) Digging the crates: an ethnographic study of DJ’s work. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1805–1814
Bentley F, Metcalf C, Harboe G (2009) Personal versus commercial content: the similarities between consumer use of photos and music. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 667–676
Brown B, Geelhoed E, Sellen A (2001) The use of conventional and new music media: Implications for future technologies. In: Proceedings of Interact, pp 67–75
Brinegar J, Capra R (2011) Understanding personal digital music collections. In: Proceedings of the American Society for Information Science and Technology, 47 (1–2). doi: 10.1002/meet.14504701378
Casey M, Veltkamp R, Goto M, Leman M, Rhodes C, Slaney M (2008) Content-based music information retrieval: current directions and future challenges. Proc IEEE 96(4):668–696
Cunningham S, Reeves N, Britland M (2003) An ethnographic study of music information seeking: implications for the design of a music digital library. In: Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, pp 5–17
Cunningham SJ, Bainbridge D, McKay D (2007) Finding new music: a diary study of everyday encounters with novel songs. In: Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR, pp 23–27
Dunker P, Nowak S, Begau A. Lanz C (2008) Content-based mood classification for photos and music: A generic multimodal classification framework and evaluation approach. In: Proceedings of the Intl. Conf. on Multimedia Information Retrieval, MIR, pp 97–104
Eerola T (2012) Are the emotions expressed in music genre-specific? An audio based evaluation of datasets spanning classical, film, pop and mixed genres. J New Music Res 40(4):349–366
Goto M, Goto T (2005) Musicream: new music playback interface for streaming, sticking, sorting, and recalling musical pieces. In: Proceedings of the 6th International Conference on Music Information Retrieval, ISMIR, pp 404–411
Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105
Holm J, Holm H, Seppänen J. (2010) Associating emoticons with musical genres. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME, pp 383–386
Holm J, Holm H (2008) Associating icons with musical genres. In: Proceedings of the 12th IASTED International Conference on Internet and Multimedia Systems and Applications
Holm J, Aaltonen A, Siirtola H (2009) Associating colors with musical genres. J New Music Res 38(1):87–100. doi:10.1080/09298210902940094
Holm J, Lehtiniemi A, Eronen A (2010) Evaluating an avatar-based user interface for discovering new music. In: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, pp 201–208
Holm J, Siirtola H, Laaksonen L (2010) Associating avatars with musical genres. In: Proceedings of the 14th International Conference on Information Visualisation, pp 186–193
Hu X, Downie SJ (2010) Improving mood classification in music digital libraries by combining lyrics and audio. In: Proceedings of the 10th annual joint conference on Digital libraries, JCDL, pp 159–168
Hu X (2009) Combining text and audio for mood classification in music digital libraries. IEEE Bull Tech Comm Digital Libr, 5 (3). http://www.ieee-tcdl.org/Bulletin/v5n3/Hu/hu.html
IFPI Digital Music Report (2012), http://www.ifpi.org/content/library/dmr2012.pdf. Accessed 1 April 2015
Jones M, Marsden G (2006) Mobile interaction design. Wiley, London
Juslin PN, Sloboda JA (2001) Music and emotion: theory and research. Oxford University Press, New York
Julia CF, Jorda S (2009) Songexplorer: a tabletop application for exploring large collections of songs. International society for music information retrieval, ISMIR, New York, pp 675–680
Kim H-J, Kwon J-Y, Yoo M-J, Lee I-K (2009) Generating affective music icons in the emotion plane. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 3389–3394
Kim YE, Schmidt EM, Migneco R, Morton BG, Richardson P, Scott J, Speck JA, Turnbull D (2010) Music emotion recognition: a state of the art review. In: Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR, pp 255–266
Kim J, Belkin NJ (2002) Categories of music description and search terms and phrases used by non-music experts. In: Proceedings of the 3rd International Conference on Music Information Retrieval, ISMIR, pp 209–214
Kim YE, Schmidt E, Emelle L (2008) Moodswings: a collaborative game for music mood label collection. In: Proceedings of International conference on Music Information Retrieval, ISMIR, pp 231–236
Lehtiniemi A, Holm J (2012) Using animated mood pictures in music recommendation. In: Proceedings of the 16th International Conference on Information Visualisation, pp 143–150
Lehtiniemi A, Ojala J (2013) Evaluating MoodPic: a concept for collaborative mood music playlist creation. In: Proceedings of the 17th International Conference on Information Visualisation, pp 86–95
Lillie AS (2008) MusicBox: navigating the space of your music. Master’s thesis, Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences. http://hdl.handle.net/1721.1/46583
McKay C, Fujinaga I (2006) Musical genre classification: is it worth pursuing and how can it be improved? In: Proceedings of the 7th International Conference on Music Information Retrieval, ISMIR, pp 101–106
Miller GA (1956) The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information by originally published in The Psychological Review, 63, pp 81–97. Available at: http://cogprints.org/730/1/miller.html
Rentfrow PJ, Gosling SD (2003) The do re mi’s of everyday life: the structure and personality correlates of music preferences. J Pers Soc Psychol 84(6):1236–1256
Russell JA (1980) A circumspect model of affect, 1980. J Psychol Soc Psychol 39(6):1161
Sease R, McDonald W (2009) Musical fingerprints: collaboration around home media collections. In: Proceedings of GROUP, pp 331–340
Strauss A, Corbin J (1994) Grounded theory methodology. In: Denzin NK, Lincoln YS (eds) Handbook of qualitative research. Sage Publications, Thousand Oaks, pp 217–285
Voida A, Grinter R, Ducheneaut N, Edwards WK, Newman MW (2005) Listening in: practices surrounding iTunes music sharing. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 191–200
Vignoli F (2004) Digital music interaction concepts: a user study. In: Proceedings of the 5th International Conference on Music Information Retrieval
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lehtiniemi, A., Ojala, J. & Toukomaa, H. Design and evaluation of mood pictures in social music discovery service. Pers Ubiquit Comput 20, 97–119 (2016). https://doi.org/10.1007/s00779-016-0900-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-016-0900-5