Skip to main content
SpringerLink
Log in

Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary Relevance

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10638))

Included in the following conference series:

Abstract

Online multi-label learning is an efficient classification paradigm in machine learning. However, traditional online multi-label methods often need requesting all class labels of each incoming sample, which is often human cost and time-consuming in labeling classification problem. In order to tackle these problems, in this paper, we present online multi-label passive aggressive active (MLPAA) learning algorithm by combining binary relevance (BR) decomposition strategy with online passive aggressive active (PAA) method. The proposed MLPAA algorithm not only uses the misclassified labels to update the classifier, but also exploits correctly classified examples with low prediction confidence. We perform extensive experimental comparison for our algorithm and the other methods using nine benchmark data sets. The encouraging results of our experiments validate the effectiveness of our proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Notes

  1. 1.

    http://mulan.sourceforge.net/datasets-mlc.html.

References

  1. Hoi, S.C.H., Wang, J.L., Zhao, P.: LIBOL: a library for online learning algorithms. J. Mach. Learn. Res. 15, 495–499 (2014)

    MATH  Google Scholar 

  2. Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(1), 386–408 (1958)

    Article  Google Scholar 

  3. Crammer, K., Dekel, O., Keshet, J., et al.: Online passive-aggressive algorithms. J. Mach. Learn. Res. 7, 551–585 (2006)

    MathSciNet  MATH  Google Scholar 

  4. Crammer, K., Kulesza, A., Dredze, M.: Adaptive regularization of weight vectors. Mach. Learn. 91(2), 155–187 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  5. Crammer, K., Dredze, M., Pereira, F.: Exact convex confidence-weighted learning. In: Proceedings of the NIPS, pp. 345–352 (2008)

    Google Scholar 

  6. Liu, D., Zhang, P., Zheng, Q.: An efficient online active learning algorithm for binary classification. Pattern Recogn. Lett. 68(1), 22–26 (2015)

    Article  Google Scholar 

  7. Dasgupta, S., Kalai, A., Monteleoni, C.: Analysis of perceptron-based active learning. J. Mach. Learn. Res. 10, 281–299 (2009)

    MathSciNet  MATH  Google Scholar 

  8. Lu, J., Zhao, P., Hoi, S.C.H.: Online passive aggressive active learning and its applications. In: Proceedings of the ACML, pp. 266–282 (2014)

    Google Scholar 

  9. Zhao, P., Hoi, S.C.H., Jin, R.: Double updating online learning. J. Mach. Learn. Res. 12, 1587–1615 (2011)

    MathSciNet  MATH  Google Scholar 

  10. Crammer, K., Dredze, M., Kulesza, A.: Multi-class confidence weighted algorithms. In: Proceedings of the EMNLP, pp. 496–504 (2009)

    Google Scholar 

  11. Fink, M., Shwartz, S.S.; Singer, Y., et al.: Online multiclass learning by interclass hypothesis sharing. In: Proceedings of the ICML, pp. 313–320 (2006)

    Google Scholar 

  12. Crammer, K., Singer, Y.: A family of additive online algortihtms for category ranking. J. Mach. Learn. Res. 3, 1025–1058 (2003)

    MathSciNet  MATH  Google Scholar 

  13. Higuchi, D., Ozawa, S.: A neural network model for online multi-task multi-label pattern recognition. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E.P., Appollini, B., Kasabov, N. (eds.) ICANN 2013. LNCS, vol. 8131, pp. 162–169. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40728-4_21

    Chapter  Google Scholar 

  14. Park, S., Choi, S.: Online multi-label learning with accelerated nonsmooth stochastic gradient descent. In: ICASSP, pp. 3322–3326 (2013)

    Google Scholar 

  15. Zhang, X., Graepel, T., Herbrich, R.: Bayesian online learning for multi-label and multi-variate performance measures. In: Proceedings of the AISTATS, pp. 956–963 (2013)

    Google Scholar 

  16. Hua, X.S., et al.: Two-dimensional multi-label active learning with an efficient online adaptation model for image classification. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1880–1897 (2009)

    Article  Google Scholar 

  17. Hua, K., Sheng, X., Qi, G.: Online multi-label active learning for large-scale multimedia annotation. Technical report from Microsoft Research (2008). https://www.microsoft.com/en-us/research/wp-content/uploads/2008/06/tr-2008-103.pdf

  18. Gibaja, E., Ventura, S.: A tutorial on multi-label learning. ACM Comput. Surv. 47(3), 1–38 (2015). Article No. 51

    Article  Google Scholar 

  19. Herbrich, R., Minka, T., Graepel, T.: TrueskillTM: a Bayesian skill ranking system. In: Proceedings of the NIPS, pp. 569–576 (2006)

    Google Scholar 

  20. Cesa-Bianchi, N., Gentile, C., Zaniboni, L.: Worst-case analysis of selective sampling for linear classification. J. Mach. Learn. Res. 7, 1205–1230 (2006)

    MathSciNet  MATH  Google Scholar 

  21. Cesa-Bianchi, N., Lugosi, G.: Prediction, Learning, and Games. Cambridge University Press, Cambridge (2006)

    Book  MATH  Google Scholar 

  22. Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by the Natural Science Foundation of China (NSFC) under Grant 61273246.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Nanjing Normal University, Nanjing, 210023, Jiangsu, China

    Xizhi Guo, Yongwei Zhang & Jianhua Xu

Authors
  1. Xizhi Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongwei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jianhua Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianhua Xu .

Editor information

Editors and Affiliations

  1. Guangdong University of Technology, Guangzhou, China

    Derong Liu

  2. Guangdong University of Technology, Guangzhou, China

    Shengli Xie

  3. South China University of Technology, Guangzhou, China

    Yuanqing Li

  4. Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Dongbin Zhao

  5. King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia

    El-Sayed M. El-Alfy

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guo, X., Zhang, Y., Xu, J. (2017). Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary Relevance. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10638. Springer, Cham. https://doi.org/10.1007/978-3-319-70139-4_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70139-4_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70138-7

  • Online ISBN: 978-3-319-70139-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation