Skip to main content

Multi-view Label Space Dimension Reduction

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10634))

Included in the following conference series:

Abstract

In multi-label classification, the explosion of the label space makes the classic multi-label classification models computationally inefficient and degrades the classification performance. To alleviate the curse of dimensionality in label space, many label space dimension reduction (LSDR) algorithms have been developed in last few years. Whereas, they are all designed for single-view learning and ignore that one sample can be represented from different views. In this paper, we propose a multi-view LSDR model for multi-label classification. The weights of different views are learned and then multi-view label embedding results are combined by the learned weights. Experiments on benchmark datasets show that the proposed multi-view learning model outperforms the best single-view model and the majority voting method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Balasubramanian, K., Lebanon, G.: The landmark selection method for multiple output prediction. In: ICML (2012)

    Google Scholar 

  2. Bi, W., Kwok, J.T.Y.: Efficient multi-label classification with many labels. In: ICML, pp. 405–413 (2013)

    Google Scholar 

  3. Boutell, M., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)

    Article  Google Scholar 

  4. Chen, Y.N., Lin, H.T.: Feature-aware label space dimension reduction for multi-label classification. In: NIPS, pp. 1529–1537 (2012)

    Google Scholar 

  5. Duygulu, P., Barnard, K., Freitas, J., Forsyth, D.A.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: ECCV, pp. 97–112 (2001)

    Google Scholar 

  6. Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification, pp. 681–687 (2001)

    Google Scholar 

  7. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes challenge 2007 (VOC2007) results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html

  8. Fakeri-Tabrizi, A., Amini, M.R., Gallinari, P.: Multiview semi-supervised ranking for automatic image annotation. In: ACM MM, pp. 513–516 (2013)

    Google Scholar 

  9. Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. In: NIPS, vol. 22, pp. 772–780 (2009)

    Google Scholar 

  10. Li, X., Guo, Y.: Multi-label classification with feature-aware non-linear label space transformation. In: IJCAI, pp. 3635–3642 (2015)

    Google Scholar 

  11. Li, Y., Yang, M., Xu, Z., Zhang, Z.: Multi-view learning with limited and noisy tagging. In: IJCAI, pp. 957–966 (2016)

    Google Scholar 

  12. Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: ICML, pp. 325–333 (2014)

    Google Scholar 

  13. Luo, Y., Tao, D., Xu, C., Xu, C., Liu, H., Wen, Y.: Multiview vector-valued manifold regularization for multilabel image classification. TNNLS 24(5), 709–722 (2013)

    Google Scholar 

  14. Makadia, A., Pavlovic, V., Kumar, S.: A new baseline for image annotation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5304, pp. 316–329. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88690-7_24

    Chapter  Google Scholar 

  15. Tai, F., Lin, H.T.: Multilabel classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  16. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 667–685. Springer, Bostan (2009). doi:10.1007/978-0-387-09823-4_34

    Chapter  Google Scholar 

  17. Yeh, C.K., Wu, W.C., Ko, W.J., Wang, Y.C.F.: Learning deep latent spaces for multi-label classification. In: AAAI (2017)

    Google Scholar 

  18. Zhang, L., Wang, S., Zhang, X., Wang, Y., Li, B., Shen, D., Ji, S.: Collaborative multi-view denoising. In: KDD, pp. 2045–2054 (2016)

    Google Scholar 

  19. Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. TKDE 26(8), 1819–1837 (2014)

    Google Scholar 

  20. Zhang, M., Zhou, Z.: Ml-knn: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)

    Article  MATH  Google Scholar 

  21. Zhang, X., Yuan, Q., Zhao, S., Fan, W., Zheng, W., Wang, Z.: Multi-label classification without the multi-label cost, pp. 778–789 (2010)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Program on Key Basic Research Project under Grant 2013CB329304, the National Natural Science Foundation of China under Grants 61502332, 61432011, 61222210.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pengfei Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Hu, Q., Zhu, P., Zhang, C., Hu, Q. (2017). Multi-view Label Space Dimension Reduction. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10634. Springer, Cham. https://doi.org/10.1007/978-3-319-70087-8_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70087-8_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70086-1

  • Online ISBN: 978-3-319-70087-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics