Robust Cross-Validation Score Function for Non-linear Function Estimation

  • Jos De Brabanter
  • Kristiaan Pelckmans
  • Johan A. K. Suykens
  • Joos Vandewalle
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2415)


In this paper a new method for tuning regularisation parameters or other hyperparameters of a learning process (non-linear function estimation) is proposed, called robust cross-validation score function \( \left( {CV_{S - {\mathbf{ }}fold}^{Robust} } \right) \) . \( CV_{S - {\mathbf{ }}fold}^{Robust} \) is effective for dealing with outliers and non-Gaussian noise distributions on the data. Illustrative simulation results are given to demonstrate that the \( CV_{S - {\mathbf{ }}fold}^{Robust} \)method outperforms other cross-validation methods.


Weighted LS-SVM Robust Cross-Validation Score function Influence functions Breakdown point M-estimators and L-estimators 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Craven P. and Wahba G. (1979). Smoothing noisy data with spline functions. Nu-mer. Math., 31, 377–390.zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Hampel F.R. (1974). The influence curve and its role in robust estimation. J.Am.Stat.Assoc. 69, 383–393.zbMATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    Huber P.J. (1964). Robust estimation of a location parameter. Ann.Math. Stat. 35, 73–103MathSciNetzbMATHCrossRefGoogle Scholar
  4. 4.
    Marazzi A. and Ruffieux C. (1996). Implementing M-estimators of the Gamma Distribution. Lecture Notes in Statistics, 109, Springer Verlag, Heidelberg.Google Scholar
  5. 5.
    Stone M. (1974). Cross-validatory choice and assessment of statistical predictions. J. Royal Statist. Soc. Ser. B 36 111–147.zbMATHGoogle Scholar
  6. 6.
    Suykens J.A.K., Vandewalle J. (1999). Least squares support vector machine classifiers. Neural Processing Letters. Vol. 9, 293–300CrossRefMathSciNetGoogle Scholar
  7. 7.
    Suykens J.A.K., De Brabanter J., Lukas L., Vandewalle J. (2002). “Weighted least squares support vector machines: robustness and sparse approximation”, Neurocom-puting, in press.Google Scholar
  8. 8.
    Vapnik V. (1995) The nature of statistical learning theory, Springer-Verlag.Google Scholar
  9. 9.
    Yang Y. and Zheng Z.(1992). “Asymptotic properties for cross-validation nearest neighbour median estimates in non-parametric regression: the L1-view”, Probability and statistics, 242–257.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Jos De Brabanter
    • 1
  • Kristiaan Pelckmans
    • 1
  • Johan A. K. Suykens
    • 1
  • Joos Vandewalle
    • 1
  1. 1.K.U.Leuven ESAT-SCD/SISTALeuvenBelgium

Personalised recommendations