Abstract
One-class classification problems have been widely encountered in the fields that the negative class patterns are difficult to be collected, and the one-class support vector machine is one of the popular algorithms for solving them. However, one-class support vector machine is a vector-based learning algorithm, and it cannot work directly when the input pattern is a tensor. This paper proposes a tensor-based maximum margin classifier for one-class classification problems, and develops a One-Class Support Higher Order Tensor Machine (HO-OCSTM) which can separate most of the target patterns from the origin with the maximum margin in the higher order tensor space. HO-OCSTM directly employs the higher order tensors as the input patterns, and it is more proper for small sample study. Moreover, the direct use of tensor representation has the advantage of retaining the structural information of data, which helps improve the generalization ability of the proposed algorithm. We implement HO-OCSTM by the alternating projection method and solve a convex quadratic programming similar to the standard one-class support vector machine algorithm at each iteration. The experimental results have shown the high recognition accuracy of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Vapnik V (1995) The nature of statistical learning theory. Springer, New York
Schölkopf B, Platt JC, Taylor JS, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13(7):1443–1471
Wang Y, Wong J, Miner A (2004) Anomaly intrusion detection using one class SVM, in the 5th Annual IEEE SMC Information Assurance Workshop IEEE
Chen Y, Zhou XS, Huang TS (2001) One-class SVM for learning in image retrieval, in the IEEE International Conference on Image Processing IEEE
Manevitz LM, Yousef M (2001) One-class SVMs for document classification. J Mach Learn Res 2:139–154
Khan SS, Madden MG (2014) One-class classification: taxonomy of study and review of techniques. Knowl Eng Rev 29(3): 345–374
Utkin LV, Zhuk YA (2014) Imprecise prior knowledge incorporating into one-class classification. Knowl Inf Syst 41:53–76
Hao PY (2008) Fuzzy one-class support vector machines. Fuzzy Sets Syst 159(18):2317–2336
Choi YS (2009) Least squares one-class support vector machine. Pattern Recogn Lett 30(13):1236–1240
Zhu W, Zhong P (2014) A new one-class SVM based on hidden information. Knowl-Based Syst 60:35–43
Krawczyk B, Woźniak M, Cyganek B (2014) Clustering-based ensembles for one-class classification. Inf Sci 264:182–195
Krawczyk B, Woźniak M (2016) Dynamic classifier selection for one-class classification. Knowl-Based Syst 107:43–53
Tax DMJ, Duin RPW (2004) Support vector domain description. Mach Learn 54(1):45–66
Casale P, Pujol O, Radeva P (2014) Approximate polytope ensemble for one-class classification. Pattern Recogn 47:854–864
Kemmler M, Rodner E, Wacker E-S, Denzler J (2013) One-class classification with Gaussian processes. Pattern Recogn 46:3507–3518
Cai D, Hei X, Han J (2006) Learning with tensor representation, Department of Computer Science, University of Illinois at Urbana-Champaign UIUCDCS-R-2006-2716
Wu X, Maybank SJ, Hu W, Li X, Tao D (2005) Supervised tensor learning, IEEE International Conference on Data Mining. IEEE Comput Soc 13:450–457
Tao D, Li X, Wu X, Maybank SJ (2007) Supervised tensor learning. Knowl Inf Syst 13(1):1–42
Zhang X, Gao X, Wang Y (2009) Twin support tensor machines for MCS detection. J Electron(China) 26(3):318–325
Khemchandani R, Karpatne A, Chandra S (2013) Proximal support tensor machines. Int J Mach Learn Cybern 4:703–712
Kotsia I, Guo W, Patras I (2012) Higher rank support tensor machines for visual recognition. Pattern Recogn 45(12):4192–4203
Hao Z, He L, Chen B, Yang X (2013) A linear support higher-order tensor machine for classification. IEEE Trans Image Process 22(7):2911–2920
Signoretto M, Lathauwerb LD, Suykens JAK (2011) A kernel-based framework to tensorial data analysis. Neural Netw 24:861–874
Yang Y, Yang Q, Qi L (2014) Properties and methods for finding the best rank-one approximation to higher-order tensors. Comput Optim Appl 58(1):105–132
Chen Y, Wang K, Zhong P (2016) One-class support tensor machine. Knowl-Based Syst 96:14–28
http://prlab.tudelft.nl/users/david-tax accessed in Apr 22 2016
Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: Multilinear Principal component analysis of tensor objects. IEEE Trans Neural Netw 19(1):18–39
Airola A, Pahikkala T, Waegeman W, De Baets B, Salakoski T (2011) An experimental comparison of cross-validation techniques for estimating the area under the ROC curve. Comput Stat Data Anal 55(4):1828–1844
Acknowledgments
The work is supported by the National Natural Science Foundation of China No. 11171346, the Chinese Universities Scientific Fund No. 2016LX002, and the “New Start” Academic Research Projects of Beijing Union University No. Zk10201513.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, Y., Lu, L. & Zhong, P. One-class support higher order tensor machine classifier. Appl Intell 47, 1022–1030 (2017). https://doi.org/10.1007/s10489-017-0945-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-017-0945-9