Abstract
Regression analysis has a long history and switching regression models is a derived form that can output multiple clusters and regression models. Semi-supervision is also useful technique for improving accuracy of regression analysis. However, there is one problem: the results have a strong dependency on the predefined number of clusters. To avoid these drawbacks, we proposed semi-supervised sequential regression models which we call SSSeRM that are related to the algorithm of sequential extractions. In sequential extractions process, one cluster is extracted at a time using a method of noise-detection, and the number of clusters are determinate by automatically. In this paper, we extend the capability of SSSeRM for handling non-linear structures by using kernel methods. Kernel methods can handle non-linear data and we propose two kernel regression algorithms (sequential kernel regression models and semi-supervised sequential kernel regression models) which can output clusters and regression models without defining cluster number. We compare these methods with the ordinary kernel switching regression models and semi-supervised kernel switching regression models and show the effectiveness of the proposed method by using numerical examples.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Galton, F.: Typical laws of heredity. Nature 15, 492–495, 512–514, 532–533 (1877)
Yule, G.U.: On the Theory of Correlation. Journal of the Royal Statistical Society 60(4), 812–854 (1897)
Pearson, K., Yule, G.U., Blanchard, N., Lee, A.: The Law of Ancestral Heredity. Biometrika 2(2), 211–236 (1903)
Quandt, R.E.: A New Approach to Estimating Switching Regressions. Journal of the American Statistical Association 67, 306–310 (1972)
Goldfeld, S.M., Quandt, R.E.: Techniques for Estimating Switching Regressions. In: Goldfeld, S.M., Quandt, R.E. (eds.) Studies in Nonlinear Estimation, Ballinger, Cambridge, Massachusetts, pp. 3–35 (1976)
Wagstaff, K., Cardie, C., Rogers, S., Schröedl, S.: Constrained K-means Clustering with Background Knowledge. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 577–584 (2001)
Basu, S., Bilenko, M., Mooney, R.J.: A Probabilistic Framework for Semi-Supervised Clustering. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 59–68 (2004)
Chapelle, O., Schölkopf, B., Zien, A.: Semi-Supervised Learning. The MIT Press, Cambridge (2006)
Mirkin, B.: The Iterative Extraction Approach to Clustering. Lecture Notes in Computational Science and Engineering, vol. 58, pp. 153–179. Springer, New York (2007)
Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic Press, Massachusetts (2008)
Miyamoto, S., Kuroda, Y., Arai, K.: Algorithms for Sequential Extraction of Clusters by Possibilistic Method and Comparison with Mountain Clustering. Journal of Advanced Computational Intelligence and Intelligent Informatics 12(5), 448–453 (2008)
Davé, R.N., Krishnapuram, R.: Robust clustering methods: a unified view. IEEE Transactions on Fuzzy Systems 5(2), 270–293 (1997)
Davé, R.N., Sen, S.: On Generalizing the Noise Clustering Algorithms. In: Proceedings of the Seventh IFSA World Congress, vol. 3, pp. 205–210 (1997)
Tang, H., Miyamoto, S.: Sequential Regression Models with Pairwise Constraints Using Noise Clusters. Journal of Advanced Computational Intelligence and Intelligent Informatics 16(7), 814–818 (2012)
Girolami, M.: Mercer Kernel-Based Clustering in Feature Space. IEEE Transactions on Neutral Networks 13(3), 780–784 (2002)
Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press (2004)
Kernel-Machines. Org, http://kernel-machines.org
Tang, H., Miyamoto, S.: Algorithms in Sequential Fuzzy Regression Models Based on Least Absolute Deviations. In: Torra, V., Narukawa, Y., Daumas, M. (eds.) MDAI 2010. LNCS (LNAI), vol. 6408, pp. 129–139. Springer, Heidelberg (2010)
Tang, H., Miyamoto, S.: Sequential Extraction of Fuzzy Regression Models: Least Squares and Least Absolute Deviations. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 19(suppl.1), 53–63 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tang, H., Miyamoto, S. (2013). Semi-supervised Sequential Kernel Regression Models with Pairwise Constraints. In: Torra, V., Narukawa, Y., Navarro-Arribas, G., MegÃas, D. (eds) Modeling Decisions for Artificial Intelligence. MDAI 2013. Lecture Notes in Computer Science(), vol 8234. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41550-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-41550-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41549-4
Online ISBN: 978-3-642-41550-0
eBook Packages: Computer ScienceComputer Science (R0)