The preferences of Web information purchasers are changing. Cost-effectiveness (i.e., an emphasis on performance with respect to price) is becoming less regarded than cost-satisfaction, which emphasizes the purchaser’s psychological satisfaction. A method to improve a user’s cost-satisfaction in recommending multimedia content is to use the mood-inherent in multimedia items. An example of applications using this method is SNS (Social Network Services) based on mood folksonomy. However, such applications encounter problems due to synonyms. This paper suggests a cost-satisfactory method of multimedia content recommendation to solve the problem of synonyms. It utilizes arousal and valence (AV), which express the mood of multimedia content, as its internal tag. A method that defines the relationship between the AV values of multimedia content and the AV values of mood tags is suggested by considering synonyms and the correlations between them. Furthermore, a multimedia content-recommendation method based on the relationship is suggested and tested. The analysis shows that the AV values of multimedia content with a mood tag and its synonyms reside in the area of the mood tag in the Thayer model. The performance of this method exceeds that of a keyword-based recommendation method.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
Moon, C.B., Yi, J.Y., Kim, D.-S., Kim, B.M.: Analysis of overlapping mood tags based on synonyms, Korea Computer Congress 2018 (KCC 2018), KIISE (2018), June 20–22, pp. 667–669 ICC JEJU, Korea (2018)
Russel, J.A.: A circumplex model of affect. J. Personal. Soc. Psychol. 39(6), 1161–1178 (1980)
Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–268 (1936)
Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, Oxford (1990)
Moon, C.B., Kim, H.S., Kim, B.M.: Music retrieval method using mood tag and music AV tag based on folksonomy. J. KIISE 40(9), 526–543 (2013)
Moon, C.B., Kim, H.S., Lee, H.A., Kim, B.M.: Analysis of relationships between mood and color for different musical preferences. Color Res. Appl. 39(4), 413–423 (2014)
Moon, C.B., Kim, H.S., Lee, D.W., Kim, B.M.: Mood lighting system reflecting music mood. Color Res. Appl. 40(2), 201–212 (2015)
Ness, S.R., Theocharis, A., Tzanetakis, G., Martins, L.G.: Improving automatic music tag annotation using stacked generalization of probabilistic svm outputs. Proc. of the 17th ACM International Conference on Multimedia, pp. 705–708 (2009)
Laurier, C., Sordo, M., Serra, J., Herrera, P.: Music mood representations from social tags. Proc. of the 10th International Society for Music Information Conference, pp. 381–386. Kobe, Japan (2009)
Kim, J., Lee, S., Kim, S., Yoo, W.Y.: Music mood classification model based on arousal-valence values. Proc. of 13th International Conference on Advanced Communication Technology (ICACT), 2011, pp. 292295 (2011)
Ji, A.T., et al.: Collaborative Tagging in Recommender Systems, presented at the Advances in Artificial Intelligence (2007)
Tso-Sutter, K.H.L., et al.: Tag-aware Recommender Systems by Fusion of Collaborative Filtering Algorithms, presented at the ACM Symposium on Applied Computing (2008)
Vojnovic, M., et al.: Ranking and suggesting popular items. IEEE Trans. Knowl. Data Eng. 21, 1133–1146 (2009)
Yang, S., Kim, S., Ro, Y.M.: Semantic home photo categorization. IEEE Trans. Circ. Syst. Video Technol. 17(3), 324–335 (2007)
Yang, S., Kim, S.K., Seo, K.S., Ro, Y.M., Kim, J., Seo, Y.S.: Semantic categorization of digital home photo using photographic region templates. Int. J. Inf. Process. Manag. 43(2), 503–514 (2007)
Yang, S., Ro, R.M.: Photo indexing using person-based multi-feature fusion with temporal context. Proc. International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, Nov. 2007, pp. 257–262 (2007)
Chang, E., Kingshy, G., Sychay, G., Wu, G.: CBSA: Content-based soft annotation for multimodal image retrieval using Bayes point machines. IEEE Trans. Circ. Syst. Video Technol. 13(1), 26–38 (2003)
Li, J., Wang, J.Z.: Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 985–1002 (2008)
ö rzinger, R.M., Sorschag, R., Thallinger, G., Lindstaedt, S.: Automatic image annotation using visual content and folksonomies. Multimed. Tools Appl. 42(1), 97–113 (2009)
Powers, D.: Evaluation: from precision recall and f-measure to roc informedness markedness and correlation. J. Mach. Learn. Technol. 2(1), 37–63 (2011)
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2017R1D1A1B03033733, 2018R1C1B6001042).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Communicated by Y. Zhang.
About this article
Cite this article
Moon, C.B., Lee, J.Y., Kim, DS. et al. Multimedia content recommendation in social networks using mood tags and synonyms. Multimedia Systems 26, 139–156 (2020). https://doi.org/10.1007/s00530-019-00632-w
- Multimedia content
- Multimedia content mood
- Multimedia content recommendation
- Mood tag
- Social network