Abstract
Recent findings in pattern recognition show that dramatic improvement of the recognition rate can be obtained by application of fusion systems utilizing many different and diverse classifiers for the same task. Apart from a good individual performance of individual classifiers the most important factor is the useful diversity they exhibit. In this work we present an example of a novel non-parametric classifier design, which shows a substantial level of diversity with respect to other commonly used classifiers. In our approach inspiration for the new classification method has been found in the physical world. Namely we considered training data as particles in the input space and exploited the concept of a static field acting upon the samples. Specifically, every single data point used for training was a source of a central field, curving the geometry of the input space. The classification process is presented as a translocation in the input space along the local gradient of the field potential generated by the training data. The label of a training sample to which it converged during the translocation determines the eventual class label of the new data point. Based on selected simple fields found in nature, we show extensive examples and visual interpretations of the presented classification method. The practical applicability of the new model is examined and tested using well-known real and artificial datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duda R.O., Hart P.E., Stork D.G.: Pattern Classification. John Wiley & Sons, New York (2001).
Bezdek J.C.: Fuzzy Models and Algorithms for Pattern Recognition and Image Processing. Kluwer Academic, Boston (1999).
Sharkey A.J.C.: Combining Artificial Neural Nets: Ensemble and Modular Multi-net Systems. Springer-Verlag, Berlin Heidelberg New York (1999).
Sharkey A.J.C., Sharkey N.E.: Combining Diverse Neural Nets. The Knowledge Engineering Review 12(3) (1997) 231–247.
Kuncheva L.I., Whitaker C.J.: Ten Measures of Diversity in Classifier Ensembles: Limits for Two Classifiers. IEE Workshop on Intelligent Sensor Processing, Birmingham (2001) 10/1–10/6
Ruta D., Gabrys B.: Analysis of the Correlation Between Majority Voting Errors and the Diversity Measures in Multiple Classifier Systems. International Symposium on Soft Computing, Paisley (2001).
Zurek W.H.: Complexity, Entropy and the Physics of Information. Proc. of the Workshop on Complexity, Entropy, and the Physics of Information. Santa Fe (1989).
Klir G.J., Folger T.A.: Fuzzy Sets, Uncertainty, and Information. Prentice-Hall International Edition (1988).
Hochreiter S., Mozer M.C.: An Electric Approach to Independent Component Analysis. Proc. of the Second International Workshop on Independent Component Analysis and Signal Separation, Helsinki(2000) 45–50.
Principe J., Fisher III, Xu D.: Information Theoretic Learning. In S. Haykin (Ed.): Unsupervised Adaptive Filtering. New York NY (2000).
Torkkola K., Campbell W.: Mutual Information in Learning Feature Transformations. Proc. of International Conference on Machine Learning, Stanford CA (2000).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ruta, D., Gabrys, B. (2002). Static Field Approach for Pattern Classification. In: Bustard, D., Liu, W., Sterritt, R. (eds) Soft-Ware 2002: Computing in an Imperfect World. Soft-Ware 2002. Lecture Notes in Computer Science, vol 2311. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46019-5_18
Download citation
DOI: https://doi.org/10.1007/3-540-46019-5_18
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43481-8
Online ISBN: 978-3-540-46019-0
eBook Packages: Springer Book Archive