Abstract
Music and places can both trigger emotional responses in people. This chapter presents a technical approach that exploits the congruence of emotions raised by music and places to identify music tracks that match a place of interest (POI). Such technique can be used in location-aware music recommendation services. For instance, a mobile city guide may play music related to the place visited by a tourist, or an in-car navigation system may adapt music to places the car is passing by. We address the problem of matching music to places by employing a controlled vocabulary of emotion labels. We hypothesize that the commonality of these emotions could provide, among other approaches, the base for establishing a degree of match between a place and a music track, i.e., finding music that “feels right” for the place. Through a series of user studies we show the correctness of our hypothesis. We compare the proposed emotion-based matching approach with a personalized approach where the music track is matched to the music preferences of the user, and to a knowledge-based approach which matches music to places based on metadata (e.g., matching music that was composed during the same period that the place of interest was built in). We show that when evaluating the goodness of fit between places and music, personalization is not sufficient and that the users perceive the emotion-based music suggestions as better fitting the places. The results also suggest that emotion-based and knowledge-based techniques can be combined to complement each other.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adkins, M., Santamas, H.: Exploring the perception and identity of place through sound and image. In: Proceedings of the Invisible Places International Symposium, pp. 403–421 (2014)
Ankolekar, A., Sandholm, T.: Foxtrot: a soundtrack for where you are. In: Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications, pp. 26–31 (2011)
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: DBpedia: a nucleus for a web of open data. In: ISWC ’08: Proceedings of the 7th International Semantic Web Conference, pp. 722–735 (2008)
Bachelard, G.: The Poetics of Space. Beacon Press, Boston (1958)
Braunhofer, M., Kaminskas, M., Ricci, F.: Location-aware music recommendation. Int. J. Multimedia Inf. Retrieval 2(1), 31–44 (2013)
Cai, R., Zhang, C., Wang, C., Zhang, L., Ma, W.-Y.: Musicsense: contextual music recommendation using emotional allocation modeling. In: MULTIMEDIA ’07: Proceedings of the 15th International Conference on Multimedia, pp. 553–556. ACM, New York, NY, USA (2007)
Castello, L.: Rethinking the Meaning of Place: Conceiving Place in Architecture-Urbanism. Ashgate Publishing, Ltd., London (2010)
Cheng, Z., Shen, J.: Just-for-me: an adaptive personalization system for location-aware social music recommendation. In: Proceedings of International Conference on Multimedia Retrieval, pp. 185–192, ACM (2014)
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.G.: Emotion recognition in human-computer interaction. IEEE Signal Process. Mag. 18(1), 32–80 (2001)
Debord, G.: Introduction to a critique of urban geography. Critical Geographies A Collection of Readings (1955)
Dunker, P., Nowak, S., Begau, A., Lanz, C.: Content-based mood classification for photos and music: a generic multi-modal classification framework and evaluation approach. In: MIR’08: Proceeding of the 1st ACM International Conference on Multimedia Information Retrieval, pp. 97–104. ACM, New York, NY, USA (2008)
Dwork, C., Kumar, R., Naor, M., Sivakumar, D.: Rank aggregation methods for the web. In: Proceedings of the 10th International Conference on World Wide Web (WWW), pp. 613–622 (2001)
Ellin, N.: Good Urbanism: Six Steps to Creating Prosperous Places. Island Press, Washington (2012)
Engler, M.: Experience at view places: an inquiry into the emotional ties between people and places. In: Proceedings of the 21st Annual Conference of the Environmental Design Research Association, pp. 222–230 (1990)
Gillhofer, M., Schedl, M.: Iron maiden while jogging, debussy for dinner? In: MultiMedia Modeling, pp. 380–391, Springer (2015)
Gretzel, U.: Intelligent systems in tourism: a social science perspective. Ann. Tour. Res. 38(3), 757–779 (2011)
Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–268 (1936)
Huron, D.: Perceptual and cognitive applications in music information retrieval. In: Proceedings of the 1st Annual International Symposium on Music Information Retrieval (ISMIR) (2000)
Iosafat, D.: On sonification of place: psychosonography and urban portrait. Org. Sound 14(01), 47–55 (2009)
Kaminskas, M., Ricci, F.: Matching places of interest with music. In: Workshop on Exploring Musical Information Spaces, pp. 68–73 (2009)
Kaminskas, M., Ricci, F.: Contextual music information retrieval and recommendation: state of the art and challenges. Comput. Sci. Rev. 6, 89–119 (2012)
Kaminskas, M., Ricci, F., Schedl, M.: Location-aware music recommendation using auto-tagging and hybrid matching. In: Proceedings of the 7th ACM Conference on Recommender Systems (RecSys 2013), Hong Kong, China (2013)
Kaminskas, M., Fernández-Tobías, I., Ricci, F., Cantador, I.: Knowledge-based identification of music suited for places of interest. Inf. Technol. Tour. 14(1), 73–95 (2014)
Law, E.L.M., Von Ahn, L., Dannenberg, R.B., Crawford, M.: Tagatune: a game for music and sound annotation. In: ISMIR, vol. 3, p. 2 (2007)
Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: state of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP) 2(1), 1–19 (2006)
Li, C.-T., Shan, M.-K.: Emotion-based impressionism slideshow with automatic music accompaniment. In: MULTIMEDIA ’07: Proceedings of the 15th International Conference on Multimedia, pp. 839–842. ACM Press, New York, NY, USA, (2007)
Markines, B., Cattuto, C., Menczer, F., Benz, D., Hotho, A., Stumme, G.: Evaluating similarity measures for emergent semantics of social tagging. In: Proceedings of the 18th International Conference on World Wide Web, pp. 641–650, ACM (2009)
Noll, P., Noll, B.: List of adjectives in american english. http://www.paulnoll.com/Books/Clear-English/English-adjectives-1.html
North, A.C., Hargreaves, D.J.: Situational influences on reported musical preference. Psychomusicology Music Mind Brain 15(1–2), 30–45 (1996)
North, A.C., Hargreaves, D.J.: The Social and Applied Psychology of Music. Cambridge University Press, Cambridge (2008)
Pettijohn, T.F., Williams, G.M., Carter, T.C.: Music for the seasons: seasonal music preferences in college students. Curr. Psychol. 1–18 (2010)
Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)
Schedl, M., Vall, A., Farrahi, K.: User geospatial context for music recommendation in microblogs. In: Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 987–990, ACM (2014)
Seyerlehner, K., Schedl, M., Knees, P., Sonnleitner, R.: A refined block-level feature set for classification, similarity and tag prediction. In: 7th Annual Music Information Retrieval Evaluation eXchange (MIREX) (2011)
Shi, Y., Larson, M., Hanjalic, A.: Tags as bridges between domains: improving recommendation with tag-induced cross-domain collaborative filtering. In: User Modeling, Adaption and Personalization, pp. 305–316. Springer, Heidelberg (2011)
Stupar, A., Michel, S.: Picasso—to sing, you must close your eyes and draw. In: 34th ACM SIGIR Conference on Research and Development in Information, pp. 715–724 (2011)
Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, Oxford (1989)
Turnbull, D., Barrington, L., Lanckriet, G.: Five approaches to collecting tags for music. In: Proceedings of the 9th International Society for Music Information Retrieval Conference (ISMIR), pp. 225–230 (2008)
Urry, J.: Consuming Places. Psychology Press, Abingdon (1995)
Yang, Y.-H., Chen, H.H.: Machine recognition of music emotion: a review. ACM Trans. Intell. Syst. Technol. (TIST), 3(3), 40 (2012)
Zentner, M., Grandjean, D., Scherer, K.R.: Emotions evoked by the sound of music: Characterization, classification, and measurement. Emotion 8(4), 494–521 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Kaminskas, M., Ricci, F. (2016). Emotion-Based Matching of Music to Places. In: Tkalčič, M., De Carolis, B., de Gemmis, M., Odić, A., Košir, A. (eds) Emotions and Personality in Personalized Services. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-31413-6_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-31413-6_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31411-2
Online ISBN: 978-3-319-31413-6
eBook Packages: Computer ScienceComputer Science (R0)