Skip to main content

Statistical Pattern Recognition: The State of the Art

  • Chapter
Image Analysis and Processing II
  • 159 Accesses

Abstract

Objects or events in the universe are perceived by biological systems as patterns. Pattern recognition is a process which assigns these sensory stimuli into perceptually meaningful categories. For the last four decades a considerable effort has been made to simulate the human pattern recognition capabilities by a machine. This quest for automation of pattern recognition processes is primarily driven by applications in computer vision for flexible manufacturing, speech recognition, text recognition, remote sensing, medicine and others. In computer vision for robots, for instance, the pattern recognition task may involve identification of object shape. In speech recognition the object categories may be words, phonemes or diphones and the sensory data on which classification is based could be vector quantised speech signal. In text recognition the objects of interest are characters and their groups forming words. Object categories in remote sensing relate to land cover and the sensory data are reflected energies in several spectral channels of the electromagnetic spectrum.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Besag, J., 1986, On the statistical analysis of dirty pictures, Journal of the Royal Statistical Society Series B, 48: 259.

    MathSciNet  MATH  Google Scholar 

  • Biswas, G., Jain, A.K. and Dubes, R., 1981, Evaluation of projection algorithms, IEEE Trans Pattern Analysis and Machine Intelligence, 3: 701

    Article  Google Scholar 

  • Boekee, D.E. and Van der Lubbe, 1979, Some aspects of error bounds in feature selection,Pattern Recognition, 11: 353

    Article  MathSciNet  MATH  Google Scholar 

  • Bunke,H.1987, Hybrid methods in pattern recognition, in “Pattern Recognition Theory and Applications”, P. Devijver and J. Kittler eds., Springer-Verlag.

    Google Scholar 

  • Chandrasekaran, B., 1986, From numbers to symbols to knowledge structures: Pattern recognition and artificial intelligence perspectives on the classification task, in “Pattern Recognition in Practice”, Vol. 2, E.S. Gelsema and L.N.Kanal, eds., North Holland.

    Google Scholar 

  • Cheng, Y. and Fu, K.S., 1984, Conceptual clustering in knowledge organization, Proc. First IEEE Conf. on Artificial Intelligence Applications, Denver, 274.

    Google Scholar 

  • Chernick, M.R., Murthy,V.K. and Nealy, C.D., 1985, Application of bootstrap and other resampling techniques: Evaluation of classifier performance, Pattern Recognition Letters, 3: 167.

    Google Scholar 

  • Chernick, M.R., Murthy,V.K. and Nealy, C.D., 1986, Application of bootstrap and other resampling techniques: Evaluation of classifier performance, Pattern Recognition Letters, 4: 133.

    Google Scholar 

  • Dattatreya, G.R. and Kanal, L.N., 1985, Decision trees in pattern recognition, Technical Report TR-1429, Machine Intelligence and Pattern Analysis Laboratory, University of Maryland

    Google Scholar 

  • Devijver, P.A., 1986, Probabilistic labelling in a second order Markov mesh, in “Pattern Recognition in Practice”, Vol. 2, E.S. Gelsema and L.N.Kanal, eds., North Holland

    Google Scholar 

  • Devijver, P.A., 1985, A multiclass, k-NN approach to Bayes risk estimation, Pattern Recog-nition Letters, 3: 1.

    Article  MATH  Google Scholar 

  • Devijver, P.A. and Kittler, J., 1980, On the edited nearest neighbour rule, Proc 5th Interna-tional Conference on Pattern Recognition, Miami Beach, Florida, 72.

    Google Scholar 

  • Devijver, P.A. and Kittler, J., 1982, “Pattern Recognition: A Statistical Approach”, Prentice Hall, Englewood Cliffs, NJ.

    Google Scholar 

  • Devroye,L. and Machell, F., 1985, Data structures in kernel density estimation, IEEE Trans.

    Google Scholar 

  • Patt. Anal. Mach. Intell., 7:360. Dubes, R. and Jain, A.K., 1980, Clustering methodology in exploratory data analysis, in “Advances in Computers” Vol.19, M Yovits, ed., Academic Press.

    Google Scholar 

  • Dubes, R. and Jain, A.K., 1979, Validity studies in clustering methodology, Pattern Recognition, 11: 235.

    Article  MATH  Google Scholar 

  • Duchene, J., 1986, A significant plane for two-class discrimination problems, IEEE Trans. Pattern Analysis and Machine Intelligence, 8: 557.

    Article  Google Scholar 

  • Duda, R.O. and Hart, P.E., 1973, “Pattern Classification and Scene Analysis”, Wiley, New York.

    MATH  Google Scholar 

  • Efron, B., 1982, The jackknife, the bootstrap, and other resampling plans, Society for Indus-trial and Applied Mathematics, Philadelphia, PA.

    Google Scholar 

  • Efron, B., 1983, Estimating the error rate of a prediction rule: Improvement on cross- validation JASA, 78: 316.

    MathSciNet  MATH  Google Scholar 

  • Fitzmaurice, G.M. and Hand, D.J., 1987, A comparison of two average conditional error rate estimators, Pattern Recognition Letters, (to appear)

    Google Scholar 

  • Foley, D.H., 1982, Consideration of sample and feature size, IEEE Trans. Inf. Theory, 18: 618.

    Google Scholar 

  • Fu, K.S., 1986, A step towards unification of syntactic and statistical pattern recognition, IEEE Trans. Patt. Anal. Mach. Intell., 8: 398.

    Google Scholar 

  • Fukunaga, K. and Flick, T.E., 1984a, Classification error for a very large number of classes, IEEE Trans. Patt. Anal. Mach. Intell., 6: 779.

    Google Scholar 

  • Fukunaga, K. and Flick, T.E., 1984b, An optimal global nearest neighbour metric, IEEE Trans. Patt. Anal. Mach. Intell., 6: 314.

    Google Scholar 

  • Fukunaga, K. and Flick, T.E., 1985, The 2-NN rule for more accurate risk estimation, IEEE Trans. Patt. Anal. Mach. Intell., 7: 107.

    Google Scholar 

  • Fukunaga, K. and Flick, T.E., 1986, A test of Gaussian-ness of a data set using clustering, IEEE Trans. Patt. Anal. Mach. Intell., 8: 240.

    Google Scholar 

  • Fukunaga, K. and Mantock, J.M., 1983, Nonparametric discriminant analysis, IEEE Trans. Patt. Anal. Mach. Intell., 5: 671.

    Google Scholar 

  • Ganesalingam, S. and McLachlan, G.J., 1980, Error rate estimation on the basis of posterior probabilities, Pattern Recognition, 12: 405.

    Article  MATH  Google Scholar 

  • Geman, S. and Geman, D., 1984, Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images, IEEE Trans. Patt. Anal. Mach. Intell., 6: 721.

    Google Scholar 

  • Gong, G., 1982, Cross-validation, the jackknife and the bootstrap: Excess error estimation in forward logistic regression, PhD Thesis, Stanford University Technical Report No. 80, Department of Statistics

    Google Scholar 

  • Hall, P., 1983, Large sample optimality of least squares cross-validation in density estimation, Annals of Statistics, 11: 1156.

    MathSciNet  MATH  Google Scholar 

  • Hancock, E.R. and Kittler, J., 1987, A list driven contextual decision rule, Proc. 5th Scandi-navian Conf. Image Analysis, Stockholm, 555.

    Google Scholar 

  • Hand, D.J., 1986a, Recent advances in error rate estimation, Pattern Recognition Letters, 4: 335.

    Article  Google Scholar 

  • Hand, D.J., 1986b, An optimal error rate estimator based on average conditional error rate: Asymptotic results, Pattern Recognition Letters, 4: 347.

    Article  Google Scholar 

  • Haslett, J., 1985, Maximum likelihood discriminant analysis on the plane using a Markovian model of spatial context, Pattern Recognition, 18: 287.

    Article  MATH  Google Scholar 

  • Jain, A.K. and Chandrasekaran, B., 1982, Dimensionality and sample size consideration in pattern recognition practice, in “Handbook of Statistics”, Vol. 2, P.R.Krishnaiah and L.N.Kanal eds., North Holland

    Google Scholar 

  • Jelinek, F., Mercer, R.L. and Bahl, L.R., 1982, Continuous speech recognition: statistical methods, in “Handbook of Statistics”, Vol. 2, P.R.Krishnaiah and L.N.Kanal eds., North Holland

    Google Scholar 

  • Kalayeh, M.M. and Landgrebe, D.A., 1983, Predicting the required number of training pat-terns, IEEE Trans. Patt. Anal. Mach. Intell., 5: 664.

    Google Scholar 

  • Kamgar-Parsi, B. and Kanal., L.N., 1985, An improved branch and bound algorithm for computing k-nearest neighbors, Pattern Recogntion Letters, 3: 7.

    Article  Google Scholar 

  • Keating, J.P. and Mason, R.L., 1985, Some practical aspects of covariance estimation, Pattern Recognition Letters, 3: 295.

    Article  Google Scholar 

  • Kim, B.S. and Park, S.B., 1986, A fast k nearest neighbor finding algorithm based on the ordered partition, IEEE Trans. Patt. Anal. Mach. Intell., 8: 761.

    Google Scholar 

  • Kittler, J., 1986, Compatibility and support functions in probabilistic relaxation, Proc 8th Intern. Conf. Pattern Recognition, Paris, 186.

    Google Scholar 

  • Kittler, J. and Devijver, P.A., 1981, An efficient estimator of pattern recognition system error probability, Pattern Recognition, 13: 245.

    Article  MathSciNet  MATH  Google Scholar 

  • Kittler, J. and Devijver, P.A., 1982, Statistical properties of error estimators in performance assessment of recognition systems, IEEE Trans. Patt. Anal. Mach. Intell., 4: 215.

    Article  MATH  Google Scholar 

  • Kittler, J. and Foglein, J., 1984, Contextual classification of multispectral pixel data, Image and Vision Computing, 2: 13.

    Article  Google Scholar 

  • Kittler, J. and Foglein, J., 1986, On compatibility and support function in probabilistic relaxation, Comput. Vision, Graphics and Image Processing, 34: 257

    Google Scholar 

  • Kittler, J. and Hancock, E.R., 1987, Contextual decision rule for region analysis, Image and Vision Computing, 5: 145.

    Article  Google Scholar 

  • Kittler, J. and Pairman, D., 1985, Contextual pattern recognition applied to cloud detection and identification, IEEE Trans. Geosci. Remote Sens., 23: 825.

    Google Scholar 

  • Kumar, V. and Kanal, L.N., 1984, Parallel branch and bound formulation for AND/OR tree search, IEEE Trans. Pattern Analysis and Machine Intelligence, 6: 768.

    Article  Google Scholar 

  • Li, X. and Dubes, R., 1986, Tree classifier design with a permutation statistic, Pattern Recognition, 19: 229.

    Article  Google Scholar 

  • Longstaff, I.D., 1987, On extensions to Fisher’s linear discriminant function, IEEE Trans. Pattern Analysis and Machine Intelligence, 9: 321.

    Article  Google Scholar 

  • Malina, W., 1981, On an extended Fisher criterion for feature selection, IEEE Trans. Pattern Analysis and Machine Intelligence, 3: 611.

    Article  Google Scholar 

  • McLachlan, G.J., 1980, The efficiency of Efron’s bootstrap approach applied to error rate estimation in discriminant analysis, J. Statist. Comp. Simul. 11: 273.

    Article  MATH  Google Scholar 

  • Miclet, L. and Dabouz, M., 1983, Approximative fast nearest-neighbour recognition, Pattern Recognition Letters, 1: 277.

    Article  Google Scholar 

  • Michalski, R.S. and Step R.E., 1983, Automated construction of classification: Conceptual clustering versus numerical taxonomy, IEEE Trans. Pattern Analysis and Machine In¬telligence, 5: 396.

    Article  Google Scholar 

  • Morgera, S.D., 1986, Linear, structured covariance estimation: An application to pattern classification for remote sensing, Pattern Recognition Letters, 4: 1.

    Article  MATH  Google Scholar 

  • Mui, J.K. and Fu, K.S., 1980, Automated classification of nucleated blood cells using binary tree classifier, IEEE Trans. Pattern Analysis and Machine Intelligence, 2: 429.

    Google Scholar 

  • Okada, T. and Tomita, S., 1985, An optimal orthonormal system for discriminant analysis, Pattern Recognition, 18: 139.

    Article  Google Scholar 

  • Peck, R. and Van Ness, J., 1982, The use of shrinkage estimators in linear discriminant analysis, IEEE Trans. Pattern Analysis and Machine Intelligence, 4: 530.

    Article  Google Scholar 

  • Postaire, J.G. and Vasseur, C., 1982, A fast algorithm for nonparametric probability density estimation, IEEE Trans. Pattern Analysis and Machine Intelligence, 4: 663.

    Article  Google Scholar 

  • Sethi, I.K. and Sarvarayudu, G.P.R., 1982, Hierarchical classifier design using mutual infor¬mation, IEEE Trans. Pattern Analysis and Machine Intelligence, 4: 441.

    Article  Google Scholar 

  • Short, R.D. and Fukunaga, K., 1980, A new nearest neighbour distance measure, Proc 5th International Conference on Pattern Recognition, Miami Beach, Florida, 81.

    Google Scholar 

  • Smith, S.P. and Jain, A.K., 1984, Testing for uniformity in multidimensional data, IEEE Trans. Pattern Analysis and Machine Intelligence, 6: 73.

    Article  Google Scholar 

  • Smith, S.P. and Jain, A.K., 1985, An experiment on using the Friedman-Rafsky test to deter¬mine the multivariate normality of a data set, Proc. IEEE CVPR Conf, San Francisco, 423.

    Google Scholar 

  • Snapinn, S.M. and Knoke, J.D., 1984, Classification error rate estimators evaluated by un¬conditional mean square error, Technometrics, 26: 371.

    Article  Google Scholar 

  • Snapinn, S.M. and Knoke, J.D., 1985, An evaluation of smoothed classification error rate estimators, Technometrics, 27: 199.

    Article  MathSciNet  Google Scholar 

  • Swain, P.H., Vardeman, S.B. and Tilton, J.C., 1981, Contextual classification of multispectral image data, Pattern Recognition, 13: 429.

    Article  Google Scholar 

  • Thomason, M.G., 1987, Advances in structural methods, in “Pattern Recognition Theory and Applications” P. Devijver and J. Kittler eds., Springer-Verlag.

    Google Scholar 

  • Toussaint, G.T., 1974, Bibliography on estimation of misclassification, IEEE Trans. Inf. Theory, 20: 472.

    Article  MathSciNet  MATH  Google Scholar 

  • Trunk, G.V., 1979, A problem of dimensionality: A simple example, IEEE Trans. Pattern Analysis and Machine Intelligence, 1: 306.

    Article  Google Scholar 

  • Van Ness, J., 1980, On the dominance of non-parametric Bayes rule discriminant algorithms in high dimensions, Pattern Recognition, 12: 355.

    Article  Google Scholar 

  • Wyse, N., Jain, A.K., and Dubes, R., 1980, A critical review of intrinsic dimensionality algorithms, in “Pattern Recognition in Practice”, E.S. Gelsema and L.N.Kanal eds., North Holland, 415.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Plenum Press, New York

About this chapter

Cite this chapter

Kittler, J. (1988). Statistical Pattern Recognition: The State of the Art. In: Cantoni, V., Di Gesù, V., Levialdi, S. (eds) Image Analysis and Processing II. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1007-5_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-1007-5_5

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4612-8289-1

  • Online ISBN: 978-1-4613-1007-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics