A New Approach for Finding an Optimal Solution and Regularization by Learning Dynamic Momentum
Regularization and finding optimal solution for the classification problems are well known issue in the machine learning, but most of researches have been separately studied or considered as a same problem about these two issues. However, it is obvious that these approaches are not always possible because the evaluation of the performance in classification problems is mostly based on the data distribution and learning methods; therefore this paper suggests a new approach to simultaneously deal with finding optimal regularization parameter and solution in classification and regression problems by introducing dynamically rescheduled momentum with modified SVM in kernel space.
KeywordsSupport Vector Machine Regularization Parameter Little Mean Square Kernel Method Kernel Space
Unable to display preview. Download preview PDF.
- 2.Hansen, P.C.: Regularization Tools, A Matlab Package for Analysis and Solution of Discrete Ill-Posed Problems. Version 3.1 for Matlab 6.0 (2001)Google Scholar
- 3.Haykin, S.: Neural Networks. In: A comprehensive Foundation, 2nd edn., Prentice-Hall, Inc., Englewood Cliffs (1999)Google Scholar
- 4.Jeong, J.C.: A New Learning Methodology for Support Vector Machine and Regularization RBF Neural Networks, Thesis for the degree of the master of engineering, Department of Computer Engineering Graduate School, Yosu National University, Republic of Korea (2002)Google Scholar
- 5.Joachims, T.: Text Categorization with Support Vector Machines: Learning with Many Relevant Features. In: Proceedings of ECML 1998, 10th European Conference on Machine Learning (1998)Google Scholar
- 6.Kim, E.M., Park, S.M., Kim, K.H., Lee, B.H.: An effective machine learning algorithm using momentum scheduling. In: Hybrid Intelligent Systems, Japan, pp. 442–443 (2004)Google Scholar
- 7.Mangasarian, O.L., Musicant, D.R.: Active Set Support Vector Machine Classificatio. In: Lee, T.K., Dietterich, T.G., Tresp, V. (eds.) Neural Information Processing Systems 2000 (NIPS 2000), pp. 577–583. MIT Press, Cambridge (2001)Google Scholar
- 8.Platt, J.C.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Advances in Kernels Methods: Support Vector Learning, MIT Press, Cambridge (1998)Google Scholar
- 9.Tikhonov, A.N.: On solving incorrectly posed problems and method of regularization. In: Doklady Akademii Nauk USSR, vol. 151, pp. 501–504 (1963)Google Scholar
- 11.Yoo, J.H., Jeong, J.C.: Sparse Representation Learning of Kernel Space Using the Kernel Relaxation Procedure. Journal of Fuzzy Logic and Intelligent Systems 11(9), 817–821 (2002)Google Scholar