Skip to main content
SpringerLink
Log in
Book cover

Encyclopedia of Algorithms pp 1–6Cite as

Active Learning - Modern Learning Theory

  • Living reference work entry
  • Latest version View entry history
  • First Online:

Years and Authors of Summarized Original Work

2006; Balcan, Beygelzimer, Langford

2007; Balcan, Broder, Zhang

2007; Hanneke

2013; Urner, Wulff, Ben-David

2014; Awashti, Balcan, Long

Problem Definition

Most classic machine learning methods depend on the assumption that humans can annotate all the data available for training. However, many modern machine learning applications (including image and video classification, protein sequence classification, and speech processing) have massive amounts of unannotated or unlabeled data. As a consequence, there has been tremendous interest both in machine learning and its application areas in designing algorithms that most efficiently utilize the available data while minimizing the need for human intervention. An extensively used and studied technique is active learning, where the algorithm is presented with a large pool of unlabeled examples (such as all images available on the web) and can interactively ask for the labels of examples of its own...

This is a preview of subscription content, log in via an institution.

Recommended Reading

  1. Awasthi P, Balcan M-F, Long PM (2014) The power of localization for efficiently learning linear separators with noise. In: Proceedings of the 46th annual symposium on the theory of computing (STOC), New York

    Google Scholar 

  2. Balcan MF, Beygelzimer A, Langford J (2006) Agnostic active learning. In: Proceedings of the 23rd international conference on machine learning (ICML), Pittsburgh

    Google Scholar 

  3. Balcan M-F, Broder A, Zhang T (2007) Margin based active learning. In: Proceedings of the 20th annual conference on computational learning theory (COLT), San Diego

    Google Scholar 

  4. Balcan M-F, Long PM (2013) Active and passive learning of linear separators under log-concave distributions. In: Proceedings of the 26th conference on learning theory (COLT), Princeton

    Google Scholar 

  5. Beygelzimer A, Hsu D, Langford J, Zhang T (2010) Agnostic active learning without constraints. In: Advances in neural information processing systems (NIPS), Vancouver

    Google Scholar 

  6. Cohn D, Atlas L, Ladner R (1994) Improving generalization with active learning. In: Proceedings of the 11th international conference on machine learning (ICML), New Brunswick

    Google Scholar 

  7. Dasgupta S, Hsu D (2008) Hierarchical sampling for active learning. In: Proceedings of the 25th international conference on machine learning (ICML), Helsinki

    Google Scholar 

  8. Dasgupta S, Hsu DJ, Monteleoni C (2007) A general agnostic active learning algorithm. In: Advances in neural information processing systems (NIPS), Vancouver

    Google Scholar 

  9. Hanneke S (2007) A bound on the label complexity of agnostic active learning. In: Proceedings of the 24th international conference on machine learning (ICML), Corvallis

    Google Scholar 

  10. Kearns MJ, Vazirani UV (1994) An introduction to computational learning theory. MIT, Cambridge

    Google Scholar 

  11. Koltchinskii V (2010) Rademacher complexities and bounding the excess risk in active learning. J Mach Learn 11:2457–2485

    MathSciNet  Google Scholar 

  12. Urner R, Wullf S, Ben-David S (2013) Plal: cluster-based active learning. In: Proceedings of the 26th conference on learning theory (COLT), Princeton

    Google Scholar 

  13. Vapnik VN (1998) Statistical learning theory. Wiley, New York

    MATH  Google Scholar 

  14. Zhang C, Chaudhuri K (2014) Beyond disagreement-based agnostic active learning. In: Advances in neural information processing systems (NIPS), Montreal

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Machine Learning, Carnegie Mellon University, Pittsburgh, USA

    Maria-Florina Balcan & Ruth Urner

Authors
  1. Maria-Florina Balcan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruth Urner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria-Florina Balcan .

Editor information

Editors and Affiliations

  1. Dept. Electrical Engineering & Computer Science, Northwestern University, Evanston, Illinois, USA

    Ming-Yang Kao

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this entry

Cite this entry

Balcan, MF., Urner, R. (2014). Active Learning - Modern Learning Theory. In: Kao, MY. (eds) Encyclopedia of Algorithms. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27848-8_769-2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27848-8_769-2

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Online ISBN: 978-3-642-27848-8

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Chapter history

  1. Latest

    Active Learning - Modern Learning Theory
    Published:
    30 December 2014

    DOI: https://doi.org/10.1007/978-3-642-27848-8_769-2

  2. Original

    Active Learning
    Published:
    06 November 2014

    DOI: https://doi.org/10.1007/978-3-642-27848-8_769-1

Search

Navigation