Skip to main content

Model Selection for Machine Learning

  • Chapter
  • First Online:
Machine Learning in Biological Sciences

Abstract

The selection of an appropriate model is a highly critical part of implementing the machine learning algorithm. A particular problem can be addressed with more than one algorithm. However, the choice of that depends on the availability of data type, data set, complexity, use of resources, and statistical cost function. Here in this chapter, we have explored different algorithms for their suitability to solve a particular problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Further Reading

  • Akaike H (1969) Fitting autoregressive models for prediction. Ann Inst Stat Math 21(1):243–247

    Article  Google Scholar 

  • Akaike H (1974) A new look at the statistical model identification. IEEE Trans Autom Control 19(6):716–723

    Article  Google Scholar 

  • Allen DM (1974) The relationship between variable selection and data augmentation and a method for prediction. Technometrics 16:125–127

    Article  Google Scholar 

  • Andersen CM, Bro R (2010) Variable selection in regression a tutorial. J Chemometr 24(11-12):728–737

    Article  CAS  Google Scholar 

  • Arcones MA, Giné E (1992) On the bootstrap of M-estimators and other statistical functionals. In: Exploring the limits of bootstrap (East Lansing, MI, 1990), Wiley series in probability and mathematical statistics. Wiley, New York, pp 13–47

    Google Scholar 

  • Arlot S (2007) Resampling and model selection. PhD thesis, University Paris-Sud

    Google Scholar 

  • Burnham KP, Anderson DR (2003) Model selection and multimodel inference: a practical information-theoretic approach. Springer

    Google Scholar 

  • Greenland S (1989) Modeling and variable selection in epidemiologic analysis. Am J Public Health 79(3):340–349

    Article  CAS  Google Scholar 

  • Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182

    Google Scholar 

  • Ing C-K, Wei C-Z (2005) Order selection for same-realization predictions in autoregressive processes. Ann Stat 33(5):2423–2474

    Article  Google Scholar 

  • Johnson JB, Omland KS (2004) Model selection in ecology and evolution. Trends Ecol Evolut 19(2):101–108

    Article  Google Scholar 

  • Kadane JB, Lazar NA (2004) Methods and criteria for model selection. J Am Stat Assoc 99(465):279–290

    Article  Google Scholar 

  • Liu W, Yang Y (2011) Parametric or nonparametric? A parametricness index for model selection. Ann Stat 39:2074–2102

    Article  Google Scholar 

  • Parry M, Dawid AP, Lauritzen S (2012) Proper local scoring rules. Ann Stat 40:561–592

    Article  Google Scholar 

  • Shao J (1997) An asymptotic theory for linear model selection. Stat Sin 7(2):221–242

    Google Scholar 

  • Shibata R (1980) Asymptotically efficient selection of the order of the model for estimating parameters of a linear process. Ann Stat 8(1):147–164

    Article  Google Scholar 

  • Stoica P, Selen Y (2004) Model-order selection: a review of information criterion rules. IEEE Signal Process Mag 21(4):36–47

    Article  Google Scholar 

  • Vapnik V, Chervonenkis A (1971) On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications 16:264–280

    Article  Google Scholar 

  • Wallace CS, Boulton DM (1968) An information measure for classification. Comput J 11(2):185–194

    Article  Google Scholar 

  • Yang Y (2006) Comparing learning methods for classification. Stat Sin 16:635–657

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ghosh, S., Dasgupta, R. (2022). Model Selection for Machine Learning. In: Machine Learning in Biological Sciences. Springer, Singapore. https://doi.org/10.1007/978-981-16-8881-2_5

Download citation

Publish with us

Policies and ethics