Analysis of precision and accuracy in a simple model of machine learning
Abstract
Machine learning is a procedure where a model for the world is constructed from a training set of examples. It is important that the model should capture relevant features of the training set, and at the same time make correct prediction for examples not included in the training set. I consider the polynomial regression, the simplest method of learning, and analyze the accuracy and precision for different levels of the model complexity.
Keywords
Machine Learning Regression Inference MethodsPreview
Unable to display preview. Download preview PDF.
References
- [1]K. P. Murphy, Machine learning: a probabilistic perspective (MIT Press, Cambridge, MA, USA, 2012), Chap. 1, p. 1.MATHGoogle Scholar
- [2]L. Ward, R. Liu, A. Krishna, V. I. Hegde, A. Agrawal, A. Choudhary and C. Wolverton, Phys. Rev. B 96, 024104 (2017).ADSCrossRefGoogle Scholar
- [3]W. Hu, R. R. P. Singh and R. T. Scalettar, Phys. Rev. E 95, 062122 (2017).ADSCrossRefGoogle Scholar
- [4]N. F. Y. Chen, M. F. Kasim, L. Ceurvorst, N. Ratan, J. Sadler et al., Phys. Rev. E 95, 043305 (2017).ADSCrossRefGoogle Scholar
- [5]Q. Wei, R. G. Melko and J. Z. Y. Chen, Phys. Rev. E 95, 032504 (2017).ADSCrossRefGoogle Scholar
- [6]E. Magesan, Jay M. Gambetta, A. D. Córcoles and Jerry M. Chow, Phys. Rev. Lett. 114, 200501 (2015).ADSCrossRefGoogle Scholar
- [7]S-H. Lee and S-H. Kang, J. Korean Phys. Soc. 69, 1254 (2016).ADSCrossRefGoogle Scholar
- [8]H. Park, J. Korean Phys. Soc. 61, 1148 (2012).ADSCrossRefGoogle Scholar
- [9]J. Sim, S-Y. Kim and J. Lee, Proteins 59, 627 (2005).CrossRefGoogle Scholar
- [10]D. T. Jones, J. Mol. Biol. 292, 195 (1999).CrossRefGoogle Scholar
- [11]D. Ciresan, U. Meier, J. Masci and J. Schmidhuber, Neural Networks 32, 333 (2012).CrossRefGoogle Scholar
- [12]G. Hinton, L. Deng, G. E. Dahl, A. Mohamed, N. Jaitly et al., IEEE Signal Proc. Mag. 29, 82 (2012).ADSCrossRefGoogle Scholar
- [13]D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre et al., Nature 529, 484 (2016).ADSCrossRefGoogle Scholar
- [14]S. Geman, E. Bienenstock and R. Doursat, Neural Comput. 4, 1 (1992).CrossRefGoogle Scholar
- [15]G. James, D. Witten, T. Hastie and R. Tibshirani, An Introduction to Statistical Learning (Springer, New York, NY, USA, 2013), Chap. 2, p. 34.CrossRefMATHGoogle Scholar
- [16]I. Goodfellow, Y. Bengio and A. Courville, Deep Learning (MIT Press, Cambridge, MA, USA, 2016), Chap 5. p. 110.MATHGoogle Scholar
- [17]P. G. Green and B. W. Silverman, Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach (Chapman & Hall, London, UK, 2000), Chap. 1, p. 2.Google Scholar
- [18]P. J. Bickel and K. Doksum, Mathematical Statistics (Holden-Day, Oakland, CA, USA, 1977), Chap. 3, p. 99.MATHGoogle Scholar
Copyright information
© The Korean Physical Society 2017