On discovering functional relationships when observations are noisy: 2D Case

  • J. Ćwik
  • J. Koronacki
  • J. M. Żytkow
Communications 7B Learning and Knowledge Discovery
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1609)


A heuristic method of model selection for a nonlinear regression problem on R 2 is proposed and discussed. The method is based on combining nonparametric statistical techniques for generalized additive models with an implementation of the Equation Finder of Zembowicz and Żytkow (1992). Given the inherent instability of such approaches to model selection when data are noisy, a special procedure for stabilization of the selection is an important target of the method proposed.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Breiman, L.: Heuristics of instability and stabilization in model selection. Ann. Statist. 24 (1996a) 2350–2393MATHMathSciNetCrossRefGoogle Scholar
  2. Breiman, L.: Bagging predictors. Machine Learning 26 (1996b) 123–140Google Scholar
  3. Breiman, L. and Friedman, J.H.: Estimating optimal transformations for multiple regression and correlation. J. American Statist. Assoc. 80 (1985) 580–619.MATHMathSciNetCrossRefGoogle Scholar
  4. Ćwik, J. and Koronacki, J.: A heuristic method of model choice for nonlinear regression. In: Rough Sets and Current Trends in Computing, L. Polkowski and A Skowron (eds.), Springer, LNAI 1424 (1998) 68–74Google Scholar
  5. Diaconis, P. and Shahshahani, M.: On nonlinear functions of linear combinations, SIAM J. on Scientific and Statistical Computing 5 (1984) 175–191MATHMathSciNetCrossRefGoogle Scholar
  6. Friedman, J.H. and Stuetzle, W.: Projection pursuit regression. J. American Statist. Assoc. 76 (1981) 817–823MathSciNetCrossRefGoogle Scholar
  7. Krzanowski, W.J.: Principles of multivariate analysis: A user’s perspective. Oxford Univ. Press, 1988.Google Scholar
  8. Moulet, M.: Comparison of three inductive numerical law discovery systems. In: Machine learning and statistics, G. Nakhaeizadeh and C.C. Taylor (eds.), Wiley, 1997, 293–317Google Scholar
  9. Zembowicz, R. and Żytkow, J.M.: Discovery of equations: Experimental evaluation of convergence. In: Proceedings of the 10th National Conference on Artificial Intelligence, AAAI Press, 1992, 70–75Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • J. Ćwik
    • 1
  • J. Koronacki
    • 1
    • 2
  • J. M. Żytkow
    • 1
    • 3
  1. 1.Institute of Computer SciencePolish Academy of SciencesPoland
  2. 2.Polish-Japanese Institute of Computer TechniquesPoland
  3. 3.Computer Science Department, UNC CharlottePoland

Personalised recommendations