Skip to main content
Log in

Design and evaluation of mood pictures in social music discovery service

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

This paper describes the iterative design process and evaluation of mood pictures in a social music discovery service. The service enables users to consume and collaboratively create playlists based on the pictures. In total, 45 Finnish users took part in the qualitative evaluations. This paper presents the results regarding the preset mood picture design and introduces user-generated mood picture playlists. Based on the results, a set of design implications for mood pictures is introduced. In addition, the consistency of user responses from a quantitative picture–music association test shows the applicability of mood picture–music associations to a music discovery service.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25

Similar content being viewed by others

References

  1. Ahmed YA, Benford S, Crabtree A (2012) Digging the crates: an ethnographic study of DJ’s work. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1805–1814

  2. Bentley F, Metcalf C, Harboe G (2009) Personal versus commercial content: the similarities between consumer use of photos and music. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 667–676

  3. Brown B, Geelhoed E, Sellen A (2001) The use of conventional and new music media: Implications for future technologies. In: Proceedings of Interact, pp 67–75

  4. Brinegar J, Capra R (2011) Understanding personal digital music collections. In: Proceedings of the American Society for Information Science and Technology, 47 (1–2). doi: 10.1002/meet.14504701378

  5. Casey M, Veltkamp R, Goto M, Leman M, Rhodes C, Slaney M (2008) Content-based music information retrieval: current directions and future challenges. Proc IEEE 96(4):668–696

    Article  Google Scholar 

  6. Cunningham S, Reeves N, Britland M (2003) An ethnographic study of music information seeking: implications for the design of a music digital library. In: Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, pp 5–17

  7. Cunningham SJ, Bainbridge D, McKay D (2007) Finding new music: a diary study of everyday encounters with novel songs. In: Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR, pp 23–27

  8. Dunker P, Nowak S, Begau A. Lanz C (2008) Content-based mood classification for photos and music: A generic multimodal classification framework and evaluation approach. In: Proceedings of the Intl. Conf. on Multimedia Information Retrieval, MIR, pp 97–104

  9. Eerola T (2012) Are the emotions expressed in music genre-specific? An audio based evaluation of datasets spanning classical, film, pop and mixed genres. J New Music Res 40(4):349–366

    Article  Google Scholar 

  10. Goto M, Goto T (2005) Musicream: new music playback interface for streaming, sticking, sorting, and recalling musical pieces. In: Proceedings of the 6th International Conference on Music Information Retrieval, ISMIR, pp 404–411

  11. Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105

    Google Scholar 

  12. Holm J, Holm H, Seppänen J. (2010) Associating emoticons with musical genres. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME, pp 383–386

  13. Holm J, Holm H (2008) Associating icons with musical genres. In: Proceedings of the 12th IASTED International Conference on Internet and Multimedia Systems and Applications

  14. Holm J, Aaltonen A, Siirtola H (2009) Associating colors with musical genres. J New Music Res 38(1):87–100. doi:10.1080/09298210902940094

    Article  Google Scholar 

  15. Holm J, Lehtiniemi A, Eronen A (2010) Evaluating an avatar-based user interface for discovering new music. In: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, pp 201–208

  16. Holm J, Siirtola H, Laaksonen L (2010) Associating avatars with musical genres. In: Proceedings of the 14th International Conference on Information Visualisation, pp 186–193

  17. Hu X, Downie SJ (2010) Improving mood classification in music digital libraries by combining lyrics and audio. In: Proceedings of the 10th annual joint conference on Digital libraries, JCDL, pp 159–168

  18. Hu X (2009) Combining text and audio for mood classification in music digital libraries. IEEE Bull Tech Comm Digital Libr, 5 (3). http://www.ieee-tcdl.org/Bulletin/v5n3/Hu/hu.html

  19. IFPI Digital Music Report (2012), http://www.ifpi.org/content/library/dmr2012.pdf. Accessed 1 April 2015

  20. Jones M, Marsden G (2006) Mobile interaction design. Wiley, London

    Google Scholar 

  21. Juslin PN, Sloboda JA (2001) Music and emotion: theory and research. Oxford University Press, New York

    Google Scholar 

  22. Julia CF, Jorda S (2009) Songexplorer: a tabletop application for exploring large collections of songs. International society for music information retrieval, ISMIR, New York, pp 675–680

    Google Scholar 

  23. Kim H-J, Kwon J-Y, Yoo M-J, Lee I-K (2009) Generating affective music icons in the emotion plane. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 3389–3394

  24. Kim YE, Schmidt EM, Migneco R, Morton BG, Richardson P, Scott J, Speck JA, Turnbull D (2010) Music emotion recognition: a state of the art review. In: Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR, pp 255–266

  25. Kim J, Belkin NJ (2002) Categories of music description and search terms and phrases used by non-music experts. In: Proceedings of the 3rd International Conference on Music Information Retrieval, ISMIR, pp 209–214

  26. Kim YE, Schmidt E, Emelle L (2008) Moodswings: a collaborative game for music mood label collection. In: Proceedings of International conference on Music Information Retrieval, ISMIR, pp 231–236

  27. Lehtiniemi A, Holm J (2012) Using animated mood pictures in music recommendation. In: Proceedings of the 16th International Conference on Information Visualisation, pp 143–150

  28. Lehtiniemi A, Ojala J (2013) Evaluating MoodPic: a concept for collaborative mood music playlist creation. In: Proceedings of the 17th International Conference on Information Visualisation, pp 86–95

  29. Lillie AS (2008) MusicBox: navigating the space of your music. Master’s thesis, Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences. http://hdl.handle.net/1721.1/46583

  30. McKay C, Fujinaga I (2006) Musical genre classification: is it worth pursuing and how can it be improved? In: Proceedings of the 7th International Conference on Music Information Retrieval, ISMIR, pp 101–106

  31. Miller GA (1956) The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information by originally published in The Psychological Review, 63, pp 81–97. Available at: http://cogprints.org/730/1/miller.html

  32. Rentfrow PJ, Gosling SD (2003) The do re mi’s of everyday life: the structure and personality correlates of music preferences. J Pers Soc Psychol 84(6):1236–1256

    Article  Google Scholar 

  33. Russell JA (1980) A circumspect model of affect, 1980. J Psychol Soc Psychol 39(6):1161

    Google Scholar 

  34. Sease R, McDonald W (2009) Musical fingerprints: collaboration around home media collections. In: Proceedings of GROUP, pp 331–340

  35. Strauss A, Corbin J (1994) Grounded theory methodology. In: Denzin NK, Lincoln YS (eds) Handbook of qualitative research. Sage Publications, Thousand Oaks, pp 217–285

    Google Scholar 

  36. Voida A, Grinter R, Ducheneaut N, Edwards WK, Newman MW (2005) Listening in: practices surrounding iTunes music sharing. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 191–200

  37. Vignoli F (2004) Digital music interaction concepts: a user study. In: Proceedings of the 5th International Conference on Music Information Retrieval

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arto Lehtiniemi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lehtiniemi, A., Ojala, J. & Toukomaa, H. Design and evaluation of mood pictures in social music discovery service. Pers Ubiquit Comput 20, 97–119 (2016). https://doi.org/10.1007/s00779-016-0900-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-016-0900-5

Keywords

Navigation