Skip to main content

Local Selection of Model Parameters in Probability Density Function Estimation

  • Conference paper
Artificial Neural Networks – ICANN 2006 (ICANN 2006)

Abstract

Here we present a novel probability density estimation model. The classical Parzen window approach builds a spherical Gaussian density around every input sample. Our proposal selects a Gaussian specifically tuned for each sample, with an automated estimation of the local intrinsic dimensionality of the embedded manifold and the local noise variance. This leads to outperform other proposals where local parameter selection is not allowed, like the manifold Parzen windows.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bishop, C.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)

    Google Scholar 

  2. Silverman, B.: Density Estimation for Statistics and Data Analysis. Chapman and Hall, New York (1986)

    MATH  Google Scholar 

  3. Vapnik, V.N.: Statistical Learning Theory. John Wiley & Sons, New York (1998)

    MATH  Google Scholar 

  4. Izenman, A.J.: Recent developments in nonparametric density estimation. Journal of the American Statistical Association 86(413), 205–224 (1991)

    Article  MATH  MathSciNet  Google Scholar 

  5. Lejeune, M., Sarda, P.: Smooth estimators of distribution and density functions. Computational Statistics & Data Analysis 14, 457–471 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  6. Hjort, N.L., Jones, M.C.: Locally Parametric Nonparametric Density Estimation. Annals of Statistics 24(4), 1619–1647 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  7. Hastie, T., Loader, C.: Local regression: Automatic kernel carpentry. Statistical Science 8, 120–143 (1993)

    Article  Google Scholar 

  8. McLachlan, G., Peel, D.: Finite Mixture Models. Wiley, Chichester (2000)

    Book  MATH  Google Scholar 

  9. Parzen, E.: On the Estimation of a Probability Density Function and Mode. Annals of Mathematical Statistics 33, 1065–1076 (1962)

    Article  MATH  MathSciNet  Google Scholar 

  10. Vincent, P., Bengio, Y.: Manifold Parzen Windows. Advances in Neural Information Processing Systems 15, 825–832 (2003)

    Google Scholar 

  11. López-Rubio, E., Ortiz-de-Lazcano-Lobato, J.M., Vargas-González, M.C., López-Rubio, J.M.: Dynamic Selection of Model Parameters in Principal Components Analysis Neural Networks. In: Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004), pp. 618–622 (2004)

    Google Scholar 

  12. López-Rubio, E., Ortiz-de-Lazcano-Lobato, J.M., Vargas-González, M.C.: Competitive Networks of Probabilistic Principal Components Analysis Neurons. In: 9th IASTED International Conference on Artificial Intelligence and Soft Computing (ASC 2005), pp. 141–146 (2005)

    Google Scholar 

  13. VizieR service (March 29, 2004), Online, Available at, http://vizier.cfa.harvard.edu/viz-bin/VizieR/

  14. Chen, H.-W., et al.: Early-type galaxy progenitors beyond z=1. Astrophysical Journal 560, L131 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

López-Rubio, E., Ortiz-de-Lazcano-Lobato, J.M., López-Rodríguez, D., Mérida-Casermeiro, E., del Carmen Vargas-González, M. (2006). Local Selection of Model Parameters in Probability Density Function Estimation. In: Kollias, S., Stafylopatis, A., Duch, W., Oja, E. (eds) Artificial Neural Networks – ICANN 2006. ICANN 2006. Lecture Notes in Computer Science, vol 4132. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11840930_30

Download citation

  • DOI: https://doi.org/10.1007/11840930_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-38871-5

  • Online ISBN: 978-3-540-38873-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics