Skip to main content
SpringerLink
Log in

Brain-Inspired Emergence of Behaviors Based on Values and Curiosity in Mobile Robots

  • Chapter
Brain-Inspired Information Technology

Part of the book series: Studies in Computational Intelligence ((SCI,volume 266))

  • 849 Accesses

Abstract

We propose to introduce the desire for existence, specific curiosity, diversive curiosity, and novelty into reinforcement learning as intrinsic rewards for developing truly autonomous mobile robots capable of behaving without being told what to do. A pursuit-evasion game composed of predators and their prey is selected as a testbed. Simulation experiments and experiments using real mobile robots, WITHs, on a robotic field well demonstrate the effectiveness of introducing intrinsic rewards in addition to external rewards in the conventional reinforcement learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Shmidhuber, J.: Self-motivated development through rewards for predictor errors/ improvements. In: Developmental Robotics, 2005 AAAI Spring Symposium (2005)

    Google Scholar 

  2. Oudeyer, P.-Y., Kaplan, F., Hafner, V.V.: Intrinsic Motivation Systems for Autonomous Mental Development. IEEE Trans. EC 11(2), 265–286 (2007)

    Google Scholar 

  3. Stout, A., Konidaris, G.D., Barto, A.G.: Intrinsically motivated reinforcement learning: A promising framework for developmental robot learning. In: Developmental Robotics AAAI Spring Symp. (2005)

    Google Scholar 

  4. Hagiwara, T., Ishikawa, M.: Emergence of Behaviors Based on the Desire for Existence. Brain IT 2007, 41 (2007)

    Google Scholar 

  5. Yamamoto, N., Ishikawa, M.: Curiosity and boredom based on prediction error as novel internal rewards. Brain IT 2007, 43 (2007)

    Google Scholar 

  6. Kiriake, F., Ishikawa, M.: Classfication and novelty detection of omni-view images taken from a mobile robot. Brain IT 2007, 42 (2007)

    Google Scholar 

  7. Otsu, N., Kurita, T.: A new scheme for flexible and intelligent vision systems. In: IAPR Workshop on Computer Vision, Tokyo, pp. 431–435 (1988)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Brain Science and Engineering, Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology, 2-4 Hibikino, Wakamatsu, Kitakyushu, 808-0196, Japan

    Masumi Ishikawa, Masahiro Nagamatsu, Naoyuki Yamamoto, Fumiko Kiriake, Takehiko Nishida, Takeshi Yamakawa, Kazuo Ishii, Hideki Nakagawa & Hong Zhang

  2. Quebs, Iizuka, 820-0066, Japan

    Takao Hagiwara

Authors
  1. Masumi Ishikawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masahiro Nagamatsu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Takao Hagiwara
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Naoyuki Yamamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fumiko Kiriake
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Takehiko Nishida
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Takeshi Yamakawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Kazuo Ishii
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hideki Nakagawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Hong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Brain Science and Engineering, Graduate School of Life Science and System Engineering, Kyushu Institute of Technology, Hibikino 2-4,Wakamatsu, 808-0196, Kitakyushu, Fukuoka, Japan

    Akitoshi Hanazawa  & Tsutom Miki  & 

  2. Department of Brain Science and Engineering , Graduate School of Life Science and System Engineering, Kyushu Institute of Technology, Hibikino 2-4,Wakamatsu, 808-0196, Kitakyushu, Fukuoka, Japan

    Keiichi Horio

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Ishikawa, M. et al. (2010). Brain-Inspired Emergence of Behaviors Based on Values and Curiosity in Mobile Robots. In: Hanazawa, A., Miki, T., Horio, K. (eds) Brain-Inspired Information Technology. Studies in Computational Intelligence, vol 266. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04025-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04025-2_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04024-5

  • Online ISBN: 978-3-642-04025-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation