Skip to main content

Abstract

Reinforcement learning allows computational agents to act intelligently in a complex (and often dynamic) environment in order to achieve a narrowly defined goal. The sheer number of complex ideas involved in reinforcement learning makes it more challenging to grasp than the previously discussed supervised learning frameworks. That is why in this chapter, we introduce reinforcement learning by pulling apart the entire process, and by introducing each concept as needed. By focusing our attention on just one piece of the system at a time, we can gain a fuller understanding of how each component works, and why it is needed. Moreover, by doing so, we also gain some extremely important intuition about how the individual components of reinforcement learning define the strengths and limitations of the process in general.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Recall that Q is initialized randomly or at zero.

  2. 2.

    The pioneering electrical engineer Claude Shannon, who is regarded as the father of information theory, published a seminal paper in 1950 entitled Programming a Computer for Playing Chess [2] in which he points out the intractability of the approach of defining a “dictionary” for all possible positions in Chess.

  3. 3.

    Here, the input is σ k, and the output is .

References

  1. Murali A, Sen S, Kehoe B, et al. Learning by observation for surgical subtasks: multilateral cutting of 3D viscoelastic and 2D orthotropic tissue phantoms. In: Proceedings of the 2015 IEEE international conference on robotics and automation; 2015.p. 1202–9

    Google Scholar 

  2. Shannon CE. Programming a computer playing chess. Philos Mag. 1959;41(312)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Borhani, R., Borhani, S., Katsaggelos, A.K. (2022). Reinforcement Learning. In: Fundamentals of Machine Learning and Deep Learning in Medicine. Springer, Cham. https://doi.org/10.1007/978-3-031-19502-0_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-19502-0_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-19501-3

  • Online ISBN: 978-3-031-19502-0

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics