Abstract
Many problems in computer vision involve a choice of the most suitable model for a set of data. Typically one wishes to choose a model which best represents the data in a way that generalises to unseen data without overfitting. We propose an algorithm in which the quality of a model match can be determined by calculating how well the distribution of model residuals matches a distribution estimated from the noise on the data. The distribution of residuals has two components - the measurement noise, and the noise caused by the uncertainty in the model parameters. If the model is too complex to be supported by the data, then there will be large uncertainty in the parameters. We demonstrate that the algorithm can be used to select appropriate model complexity in a variety of problems, including polynomial fitting, and selecting the number of modes to match a shape model to noisy data.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
N. A.J. Lacey and N.L. Seed. Feature tracking and motion classification using a switchable model kalman filter. In E. Hancock, editor, 5th British Machine Vison Conference, pages 599–608. BMVA Press, Sept. 1994.
H. Akaike. A new look at statistical model identification. IEEE Trans. on Automatic Control, 19:716–723, 1974.
T. F. Cootes, C. J. Taylor, D. Cooper, and J. Graham. Active shape models-their training and application. Computer Vision and Image Understanding, 61(1):38–59, Jan. 1995.
D. Schuurmans. A new metric-based approach to model selection. In National Conf. on Artificial Intelligence (AAAI97), 1997.
D. Schuurmans and F. Southey. Metric-based methods for adaptive model selection and regularization. Machine Learning, page To Appear, 2001.
B. Efron. The Jackknife, the Bootstrap, and other Resampling Plans. S.I.A.M, Philadelphia, 1982.
K. Kanatani. Statistical Optimization for Geometric Computation: Theory and Practise. Elsevier Science, Amsterdam, 1996.
N.A. Thacker, F. Ahearne, and P.I. Rockett. The bhattacharryya metric as an absolute similarity measure for frequency coded data. Kybernetika, 34(4):363–368, 1997.
O. Chapelle, V. Vapnik, and Y. Bengio. Model selection for small sample regression. In NIPS2000 Workshop: Cross-Validation, Bootstrap and Model Selection, 2000.
W. Press, S. Teukolsky, W. Vetterling, and B. Flannery. Numerical Recipes in C (2nd Edition). Cambridge University Press, 1992.
B. Silverman. Density Estimation for Statistics and Data Analysis. Chapman and Hall, London, 1986.
N. Thacker, D. Prendergast, and P.I. Rockett. B-fitting: An estimation technique with automatic parameter selection. In 7 th British Machine Vison Conference, pages 283–292, Edinburgh, UK, 1996.
P. Torr. Model selection for two view geometry. Technical report, http://research.microsoft.com/-philtorr, 1998.
P. H. S. Torr. Geometric motion segmentation and model selection. In J. Lasenby, A. Zisserman, R. Cipolla, and H. Longuet-Higgins, editors, Philosophical Transactions of the Royal Society A, pages 1321–1340. Roy Soc, 1998.
M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neu-roscience, 3(1):71–86, 1991.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cootes, T.F., Thacker, N., Taylor, C.J. (2002). Automatic Model Selection by Modelling the Distribution of Residuals. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2353. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47979-1_42
Download citation
DOI: https://doi.org/10.1007/3-540-47979-1_42
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43748-2
Online ISBN: 978-3-540-47979-6
eBook Packages: Springer Book Archive