Abstract
In multi-label classification, the explosion of the label space makes the classic multi-label classification models computationally inefficient and degrades the classification performance. To alleviate the curse of dimensionality in label space, many label space dimension reduction (LSDR) algorithms have been developed in last few years. Whereas, they are all designed for single-view learning and ignore that one sample can be represented from different views. In this paper, we propose a multi-view LSDR model for multi-label classification. The weights of different views are learned and then multi-view label embedding results are combined by the learned weights. Experiments on benchmark datasets show that the proposed multi-view learning model outperforms the best single-view model and the majority voting method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Balasubramanian, K., Lebanon, G.: The landmark selection method for multiple output prediction. In: ICML (2012)
Bi, W., Kwok, J.T.Y.: Efficient multi-label classification with many labels. In: ICML, pp. 405–413 (2013)
Boutell, M., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)
Chen, Y.N., Lin, H.T.: Feature-aware label space dimension reduction for multi-label classification. In: NIPS, pp. 1529–1537 (2012)
Duygulu, P., Barnard, K., Freitas, J., Forsyth, D.A.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: ECCV, pp. 97–112 (2001)
Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification, pp. 681–687 (2001)
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes challenge 2007 (VOC2007) results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html
Fakeri-Tabrizi, A., Amini, M.R., Gallinari, P.: Multiview semi-supervised ranking for automatic image annotation. In: ACM MM, pp. 513–516 (2013)
Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. In: NIPS, vol. 22, pp. 772–780 (2009)
Li, X., Guo, Y.: Multi-label classification with feature-aware non-linear label space transformation. In: IJCAI, pp. 3635–3642 (2015)
Li, Y., Yang, M., Xu, Z., Zhang, Z.: Multi-view learning with limited and noisy tagging. In: IJCAI, pp. 957–966 (2016)
Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: ICML, pp. 325–333 (2014)
Luo, Y., Tao, D., Xu, C., Xu, C., Liu, H., Wen, Y.: Multiview vector-valued manifold regularization for multilabel image classification. TNNLS 24(5), 709–722 (2013)
Makadia, A., Pavlovic, V., Kumar, S.: A new baseline for image annotation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5304, pp. 316–329. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88690-7_24
Tai, F., Lin, H.T.: Multilabel classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)
Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 667–685. Springer, Bostan (2009). doi:10.1007/978-0-387-09823-4_34
Yeh, C.K., Wu, W.C., Ko, W.J., Wang, Y.C.F.: Learning deep latent spaces for multi-label classification. In: AAAI (2017)
Zhang, L., Wang, S., Zhang, X., Wang, Y., Li, B., Shen, D., Ji, S.: Collaborative multi-view denoising. In: KDD, pp. 2045–2054 (2016)
Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. TKDE 26(8), 1819–1837 (2014)
Zhang, M., Zhou, Z.: Ml-knn: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)
Zhang, X., Yuan, Q., Zhao, S., Fan, W., Zheng, W., Wang, Z.: Multi-label classification without the multi-label cost, pp. 778–789 (2010)
Acknowledgements
This work was supported by the National Program on Key Basic Research Project under Grant 2013CB329304, the National Natural Science Foundation of China under Grants 61502332, 61432011, 61222210.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Hu, Q., Zhu, P., Zhang, C., Hu, Q. (2017). Multi-view Label Space Dimension Reduction. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10634. Springer, Cham. https://doi.org/10.1007/978-3-319-70087-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-70087-8_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70086-1
Online ISBN: 978-3-319-70087-8
eBook Packages: Computer ScienceComputer Science (R0)