Skip to main content

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 50))

Abstract

Reinforcement learning (RL) comes from the self-learning theory. RL can autonomously get optional results with the knowledge obtained from various conditions by interacting with dynamic environment. It allows machines and software agents to automatically determine the ideal behavior within a specific context, in order to maximize its performance. Neural network reinforcement learning is most popular algorithm. Advantage of using neural network is that it regulates RL more efficient in real life applications. In this paper, we firstly survey reinforcement learning theory and model. Then we present various main RL algorithms. Then we discuss different neural network RL algorithms. Finally we introduce some application of RL and outline some future research of RL with NN.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  2. Qiang, W., Zhongli, Z.: Reinforcement learning model, algorithms and its application. In: 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (2011)

    Google Scholar 

  3. Asadi, R., Mustapha, N., Sulaiman, N.: A framework for intelligent multi agent system based neural network classification model. (IJCSIS) Int. J. Comput. Sci. Inf. Secur. (2009)

    Google Scholar 

  4. Sutton, R.S.: Learning to predict by the method of temporal differences. Mach. Learn. 3(1), 9–44 (1988)

    Google Scholar 

  5. Littman, M.L., Moor, A.W.: Reinforcement Learning: A Survey. Leslie Pack Kaelbling (1996)

    Google Scholar 

  6. Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279–292 (1992)

    Google Scholar 

  7. Celiberto, L.A., Jr., Matsuura, J.P., de Màntaras, R.L.: Using transfer learning to speed-up reinforcement learning: a cased-based approach. In: 2010 Latin American Robotics Symposium and Intelligent Robotics Meeting (2010)

    Google Scholar 

  8. Torrey, L.: Reinforcement Learning. University of Wisconsin, Madison HAMLET (2009)

    Google Scholar 

  9. Luviano Cruz, D., Yu, W.: Multi-agent path planning in unknown environment with reinforcement learning and neural network. In: 2014 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, USA, Oct 5–8 2014

    Google Scholar 

  10. Ghanbari, A., Vaghei, Y., Reza, S.M., Noorani, S.: Reinforcement learning in neural networks: a survey. Int. J. Adv. Biol. Biomed. Res. 2(5), 1398–1416 (2014)

    Google Scholar 

  11. Shiraga, N., Ozawa, S., Abe, S.: A reinforcement learning algorithm for neural networks with incremental learning ability

    Google Scholar 

  12. Han, J., Kamber, M.: Data Mining: Concepts and Techniques. Simon Fraser University, Academic Press. Information Quality Issues. International Institute for Advanced Studies in Systems Research and Cybernetic, IIAS (2001)

    Google Scholar 

  13. Yadav, A.K., Sachan, A. K.: Research and application of dynamic neural network based on reinforcement learning. In: Satapathy, S.C., et al. (eds.) Proceedings of the InConINDIA 2012, AISC, vol. 132, pp. 931–942

    Google Scholar 

  14. Haykin, S.: Neural Networks: A Comprehensive Foundation. Macmillan, New York (1994)

    MATH  Google Scholar 

  15. Rojas, R.: Neural Networks: a Systematic Introduction, pp. 336. Springer, Berlin (2013). ISBN 978–3-540-60505-8

    Google Scholar 

  16. van der Ree, M., Wiering, M.: Reinforcement learning in the game of Othello: learning against a fixed opponent and learning from self-play

    Google Scholar 

  17. Prabuchandran, K.J., Hemanth Kumar, A.N., Bhatnagar, S.: Multi-agent reinforcement learning for traffic signal control. In: 2014 IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), Qingdao, China, 8–11 Oct 2014

    Google Scholar 

  18. Dini, S., Serrano, M.: Combining Q-learning with artificial neural networks in an adaptive light seeking robot, 6 May 2012

    Google Scholar 

  19. Coulom, R.: Feedforward neural networks in reinforcement learning applied to high-dimensional motor control. In: Cesa-Bianchi, N., et al. (eds.) ALT 2002, LNAI 2533, pp. 403–413 (2002)

    Google Scholar 

  20. Anderson, C.W., Hittle, D.C., Katz, A.D., Matt Kretchmar, R.: Reinforcement learning, neural networks and PI control applied to a heating coil

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bhumika Modi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Modi, B., Jethva, H.B. (2016). Reinforcement Learning with Neural Networks: A Survey. In: Satapathy, S., Das, S. (eds) Proceedings of First International Conference on Information and Communication Technology for Intelligent Systems: Volume 1. Smart Innovation, Systems and Technologies, vol 50. Springer, Cham. https://doi.org/10.1007/978-3-319-30933-0_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-30933-0_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-30932-3

  • Online ISBN: 978-3-319-30933-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics