A novel online incremental and decremental learning algorithm based on variable support vector machine
- 206 Downloads
In view of the long execution time and low execution efficiency of Support Vector Machine in large-scale training samples, the paper has proposed the online incremental and decremental learning algorithm based on variable support vector machine (VSVM). In deep understanding of the operation mechanism and correlation algorithms for VSVM, each sample has increased training datasets changes and it needs to update the classifier of learning algorithm. Firstly, they are given the online growth amount of learning algorithm taken full advantage of the incremental pre-calculated information, and doesn’t require retraining for the new incremental training datasets. Secondly, the incremental matrix inverse calculation process had greatly reduced the running time of algorithm, and it is given in order to verify out the validity of the online learning algorithm. Finally, the nine groups of datasets in the standard library have been selected in the pattern classification experiment. The experimental results are shown that the online learning algorithm given in the case to ensure the correct classification rates and effective training’s speed. With the implementation of the incremental process, training meetings, the need for large-scale data storage space, result in slow training, the online learning algorithm based on VSVM can solve the problem.
KeywordsVariable support vector machine Classification Online incremental and decremental learning algorithm Inverse matrix
This work is supported by the National Natural Science Foundation of China (Nos. 61772087, 61702052), the Science and Technology Service Platform of Hunan Province (No. 2012TP1001), the Open Research Fund of Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation (No. 2015TP1005), the Changsha Science and Technology Planning (Nos. KQ1703018, KQ1706064), the Research Foundation of Education Bureau of Hunan Province (Nos. 12C0010, 17A007), the ZOOMLION Intelligent Technology Limited Company (No. 2017zkhx130). We are grateful to anonymous referees for useful comments and suggestions.
- 3.Syed, N.A., Liu, H., Sung, K.K.: Incremental learning with support vector machines. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-99) (1999)Google Scholar
- 4.Cauwenberghs, G., Paggio, T.: Incremental and decremental support vector machine learning. In: Proceedings of Advanced Neural Information Processing, MIT Press (2001)Google Scholar
- 7.Mangasarian, O.L., Musicant, D.R.: Active support vector machines classification. In: Advances in Neural Information Processing Systems (NIPS 2000) (2000)Google Scholar
- 15.Yang, X.W., Yu, Q.Z., He, L.F.: The one-against-all partition based binary tree support vector machine algorithms for multi-class classification. Neurocomputing 77(2), 307–314 (2012)Google Scholar
- 16.He, L.F., Hao, Z.F., Yang, X.W., Xiao, F.Z., Lv, H.R.: An optimal grid-clustering based decision tree support vector machine algorithm for large-scale classification problems. Neurocomputing 77(3), 507–514 (2012)Google Scholar
- 18.Standard pattern classification library. http://ida.first.gmd.de/raetsch/data/benchmarks.htm
- 19.Machine learning database. http://www.ics.uci.edu
- 22.Judd, T., Ehinger, K., Durand, F. et al.: Learning to predict where humans look. In: Proceedings of IEEE International Conference on Computer Vision, pp. 230–242 (2009)Google Scholar
- 24.Stan Birchfield’s datasets in Stanford University. http://vision.stanford.edu/~birch/headtracker/