Abstract
ML-kNN is a well-known algorithm for multi-label classification, but it just assumes the independence of labels and instances. In fact, in the real world, labels or instances are more or less related via explicit or implicit relationships. In this paper, we propose an improved ML-kNN approach that takes the coupled similarity of attributes and labels into account, where coupling between attributes is used to find k nearest neighbors for instances and coupling between labels is used to predict the labels of unseen instances. Experimental results show that our proposed method outperforms the traditional ML-kNN.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)
Lewis, D., Yang, Y., Rose, T., Li, F.: RCV1: a new benchmark collection for text categorization research. Mach. Learn. Res. 5, 361–397 (2004)
Elisseeff, A., Weston, J.: A kernel method for multi-labeled classification. In: Advances in Neural Information Processing Systems, vol. 14, pp. 681–687 (2002)
Snoek, C., Worring, M., Gemert, J.V., Geusebroek, J., Smeulders, A.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: ACM International Conference on Multimedia, pp. 421–430. ACM, New York (2006)
Schapire, R.E., Singer, Y.: Boostexter: a boosting-based system for text categorization. Mach. Learn. 39(2–3), 135–168 (2000)
McCallum, A.: Multi-label text classification with a mixture model trained by EM. In: Working Notes of the AAAI 1999 Workshop on Text Learning (1999)
Zhang, M., Zhou, Z.: ML-kNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)
Liu, C., Cao, L.: A coupled k-nearest neighbor algorithm for multi-label classification. In: 19th Pacific-Asia Conference on Knowledge Discovery and Data mining, pp. 179–187 (2015)
Kaytoue, M., Kuznetsov, S.O., Napoli, A.: Revisiting numerical pattern mining with formal concept analysis. In: 22nd International Joint Conference on Artificial Intelligence, pp. 1342–1347 (2011)
Wang, C., She, Z., Cao, L.: Coupled attribute analysis on numerical data. In: 22th International Joint Conference on Artificial Intelligence, pp. 1736–1742 (2013)
Clare, A.J., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 42–53. Springer, Heidelberg (2001)
Zhang, M., Zhou, Z.: Multi-label neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18(10), 1338–1351 (2006)
Zheng, W., Wang, C., Liu, Z., Wang, J.: A multi-label classification algorithm based on random walk model. Chin. J. Comput. 33(8), 1418–1426 (2010)
Cao, L.: Coupling learning of complex interactions. Inf. Process. Manag. 51, 167–186 (2015)
Wang, C., Cao, L., Li, J., Wei, W., Ou, Y.: Coupled nominal similarity in unsupervised learning. In: The 20th ACM International Conference on Information and Knowledge Management, pp. 973–978. ACM, New York (2011)
Cao, L.: Non-IIDness learning in behavioral and social data. Comput. J. 57(9), 1358–1370 (2014)
Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I.P.: Multi-label classification of music into emotions. In: 2011 9th International Conference on Music Information Retrieval, vol. 2011, no. 1, pp. 325–330 (2008)
Wang, C., Cao, L.: Coupled attribute similarity learning on categorical data. IEEE Trans. Neural Netw. Learn. Syst. 26(4), 781–797 (2015)
Acknowledgement
This work is supported by the National Natural Science Foundation of China under Grant No. 61262069, No. 61472346, the Natural Science Foundation of Yunnan Province under Grant No. 2015FB114, No. 2015FB149, No. 2016FA026, Program for Young and Middle-aged Skeleton Teachers, Yunnan University, and Program for Innovation Research Team in Yunnan University under Grant No. XT412011.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, X., Zhou, L., Wang, L. (2016). An Improved ML-kNN Approach Based on Coupled Similarity. In: Morishima, A., et al. Web Technologies and Applications. APWeb 2016. Lecture Notes in Computer Science(), vol 9865. Springer, Cham. https://doi.org/10.1007/978-3-319-45835-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-45835-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-45834-2
Online ISBN: 978-3-319-45835-9
eBook Packages: Computer ScienceComputer Science (R0)