Abstract
Searching the Web has become an everyday task for most people. However, the presence of too much information can cause information overload. For example, when shopping online, a user can easily be overwhelmed by too many choices. To this end, we propose a personalized clothing recommendation system, namely i-Stylist, through the analysis of personal images in social networks. To access the available personal images of a user, the i-Stylist system extracts a number of characteristics from each clothing item such as CNN feature vectors and metadata such as color, material and pattern of the fabric. Then, these clothing items are organized as a fully connected graph to later infer the personalized probability distribution of how the user will like each clothing item in a shopping website. The user is able to modify the graph structure, e.g. adding and deleting vertices by giving feedback about the retrieved clothing items. The i-Stylist system is compared against two other baselines and demonstrated to have better performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Usually a popular item is defined by the number of likes, links, etc., that an image or user can have.
- 2.
- 3.
Different from the authors of this paper.
References
Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., Gool, L.: Apparel classification with style. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 321–335. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_25
Carmel, D., Zwerdling, N., Guy, I., Ofek-Koifman, S., Har’el, N., Ronen, I., Uziel, E., Yogev, S., Chernov, S.: Personalized social search based on the user’s social network. In: ACM IKM (2009)
Chi, H.Y., Chen, C.C., Cheng, W.H., Chen, M.S.: Ubishop: commercial item recommendation using visual part based object representation. Multimed. Tools Appl. 75, 16093–16115 (2015)
Chi, H.-Y., Cheng, W.-H., Chen, M.-S., Tsui, A.W.: MOSRO: enabling mobile sensing for real-scene objects with grid based structured output learning. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds.) MMM 2014. LNCS, vol. 8325, pp. 207–218. Springer, Heidelberg (2014). doi:10.1007/978-3-319-04114-8_18
Dooms, S., De Pessemier, T., Martens, L.: A user-centric evaluation of recommender algorithms for an event recommendation system. In: RecSys (2011)
Guntuku, S.C., Qiu, L., Roy, S., Lin, W., Jakhetiya, V.: Do others perceive you as you want them to?: modeling personality based on selfies. In: ASM (2015)
Hidayati, S.C., Hua, K., Cheng, W., Sun, S.: What are the fashion trends in new york? In: ACM Multimedia Conference (2014)
Hu, Y., Yi, X., Davis, L.S.: Collaborative fashion recommendation: A functional tensor factorization approach. In: ACM Multimedia (2015)
Huang, C., Wei, C., Wang, Y.F.: Active learning based clothing image recommendation with implicit user preferences. In: ICME Workshops (2013)
Iwata, T., Watanabe, S., Sawada, H.: Fashion coordinates recommender system using photographs from fashion magazines. In: IJCAI (2011)
Kiapour, M.H., Han, X., Lazebnik, S., Berg, A.C., Berg, T.L.: Where to buy it: matching street clothing photos in online shops. In: ICCV (2015)
Knijnenburg, B.P., Willemsen, M.C.: Evaluating recommender systems with user experiments. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 309–352. Springer, Boston (2015)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012)
Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., Yan, S.: Hi, magic closet, tell me what to wear! In: Proceedings of ACM Multimedia (2012)
van der Maaten, L., Hinton, G.E.: Visualizing high-dimensional data using t-SNE. JMLR 9, 2579–2605 (2008)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013)
Nguyen, H.T., Almenningen, T., Havig, M., Schistad, H., Kofod-Petersen, A., Langseth, H., Ramampiaro, H.: Learning to rank for personalised fashion recommender systems via implicit feedback. In: Prasath, R., O’Reilly, P., Kathirvalavakumar, T. (eds.) MIKE 2014. LNCS (LNAI), vol. 8891, pp. 51–61. Springer, Heidelberg (2014). doi:10.1007/978-3-319-13817-6_6
Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers (1999)
van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Empowering visual categorization with the GPU. IEEE Trans. Multimed. 13(1), 60–70 (2011)
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: Overfeat: Integrated recognition, localization and detection using convolutional networks. In: ICLR (2014)
Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: CVPR Workshops (2014)
Simo-Serra, E., Fidler, S., Moreno-Noguer, F., Urtasun, R.: Neuroaesthetics in fashion: modeling the perception of fashionability. In: CVPR (2015)
Tsai, T.H., Cheng, W.H., You, C.W., Hu, M.C., Tsui, A.W., Chi, H.Y.: Learning and recognition of on-premise signs (opss) from weakly labeled street view images. IEEE Trans. TIP 23(3), 1047–1059 (2014)
Weijer, J.V.D., Gevers, T., Bagdanov, A.: Boosting color saliency in image feature detection. IEEE Trans. PAMI 28, 150–156 (2005)
Yamaguchi, K., Berg, T.L., Ortiz, L.E.: Chic or social: visual popularity analysis in online fashion networks. In: ACM ICM (2014)
Yamaguchi, K., Kiapour, M.H., Ortiz, L.E., Berg, T.L.: Retrieving similar styles to parse clothing. IEEE Trans. PAMI 37(5), 1028–1040 (2015)
Acknowledgement
This work is funded by ITRI Grant #105-W100-21A1, under the project “Big Data Technologies and Applications (2/4)” of the Industrial Technology Research Institute of Taiwan, R.O.C.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Sanchez-Riera, J., Lin, JM., Hua, KL., Cheng, WH., Tsui, A.W. (2017). i-Stylist: Finding the Right Dress Through Your Social Networks. In: Amsaleg, L., Guðmundsson, G., Gurrin, C., Jónsson, B., Satoh, S. (eds) MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science(), vol 10132. Springer, Cham. https://doi.org/10.1007/978-3-319-51811-4_54
Download citation
DOI: https://doi.org/10.1007/978-3-319-51811-4_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51810-7
Online ISBN: 978-3-319-51811-4
eBook Packages: Computer ScienceComputer Science (R0)