Skip to main content

Supervised Learning: Classification and Regression

  • Chapter
  • First Online:
Online Machine Learning


This chapter provides an overview and evaluation of Online Machine Learning (OML) methods and algorithms, with a special focus on supervised learning. First, methods from the areas of classification (Sect. 2.1) and regression (Sect. 2.2) are presented. Then, ensemble methods are described in Sect. 2.3. Clustering methods are briefly mentioned in Sect. 2.4. An overview is given in Sect. 2.5.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 64.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. 1.


  • Bifet, A. (2018). Machine learning for data streams with practical examples in MOA. MIT Press.

    Google Scholar 

  • Breiman, L. (1984). Classification and regression trees. Wadsworth.

    Google Scholar 

  • Crammer, K., et al. (2006). Online passive-aggressive algorithms. Journal of Machine Learning Research, 7(19), 551–585.

    Google Scholar 

  • Domingos, P. M., & Hulten, G. (2000). Mining high-speed data streams. In R. Ramakrishnan et al. (Eds.), Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, USA, August 20–23 (pp. 71–80). ACM.

    Google Scholar 

  • Ezukwoke, K. I., & Zareian, S. J. (2021). Online learning and active learning: A comparative study of passive-aggressive algorithm with support vector machine (SVM). Journal of Higher Education Theory and Practice, 21(3), 105–110.

    Google Scholar 

  • Gentile, C. (2002). A new approximate maximal margin classification algorithm. Journal of Machine Learning Research, 2, 213–242.

    MathSciNet  Google Scholar 

  • Manapragada, C., Webb, G. I., & Salehi, M. (2018). Extremely fast decision tree. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’18, New York, NY, USA (pp. 1953–1962). Association for Computing Machinery.

    Google Scholar 

  • Oza, N. C., & Russell, S. (2001). Online bagging and boosting. In T. Jaakola & T. Richardson (Eds.), 8th International Workshop on Artificial Intelligence and Statistics (pp. 105–112).

    Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Thomas Bartz-Beielstein .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Bartz-Beielstein, T. (2024). Supervised Learning: Classification and Regression. In: Bartz, E., Bartz-Beielstein, T. (eds) Online Machine Learning. Machine Learning: Foundations, Methodologies, and Applications. Springer, Singapore.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-7006-3

  • Online ISBN: 978-981-99-7007-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics