Skip to main content
SpringerLink
Log in

An adaptive behavior decision model of mobile robot based on the neuromodulation

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

How to effectively improve the behavior decision ability in unknown environment is a great challenge for mobile robots. Traditional methods suffer from the low efficiency and large computation load. Motivated by the regulation effect of serotonin and dopamine on human behavior, a novel adaptive behavior decision model for mobile robot is proposed in this work. This model integrates two kinds of adjustment factors that mimic the effects of two neuromodulators, serotonin and dopamine, to regulate the behavior decision of a mobile robot in unknown environment. Adjustment factor \(\mathbf {p}\) is designed to simulate the function of the serotonin and make the robot avoid obstacles effectively, while the adjustment factor \(\mathbf {r}\) is designed to simulate the function of the dopamine and make the robot approach the target quickly. Both of the adjustment functions can be adaptively regulated with the robot’s movement. Static and dynamic simulation results show that this neuromodulatory model has excellent collision avoidance capacity which can avoid the obstacles fluently, and the trajectory obtained tends to be optimal. Moreover, it is relatively simple, thus can effectively reduce the computation time and the load capacity, and greatly improve the running efficiency of the mobile robot in unknown environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ahmed SA, Opalov AV, Shakev NG, Popov VL (2018) Model-free detection and following of moving objects by an omnidirectional mobile robot using 2d range data. IFAC-Papers OnLine 51(22):226–231

    Article  Google Scholar 

  2. Asher DE, Craig AB, Andrew Z et al (2013) A dynamic, embodied paradigm to investigate the role of serotonin in decision-making. Front Integr Neurosci 7:1–6

    Article  Google Scholar 

  3. Aston-Jones G, Cohen J (2005) An integrative theory of locus coeruleus-norepine- phrine function: Adaptive gain and optimal performance. Annu Rev Neurosci 28:403–450

    Article  Google Scholar 

  4. Boureau Y, Dayan P (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuro-psychopharmacology 36(1):74–97

    Article  Google Scholar 

  5. Carlucho I, Paula MD, Acosta GG (2019) Double q-pid algorithm for mobile robot control. Expert Syst Appl 137:292–307

    Article  Google Scholar 

  6. Cools R, Roberts A, Robbins T (2008) erotoninergic regulation of emotional and behavioral control processes. Trends Cogn Sci 12(1):1–40

    Article  Google Scholar 

  7. Corbetta M, Patel G, Shulman G (2008) The reorienting system of the human brain: from environment to theory of mind. Neuron 58:306–324

    Article  Google Scholar 

  8. Cox BR, Krichmar JL (2009) Neuromodulation as a robot controller, a brain-inspired strategy for controlling autonomous robots. IEEE Robot Autom Mag 16(9):72–80

    Article  Google Scholar 

  9. Crockett M, Siegel J, Kurth-Nelson Z et al (2015) Dissociable effects of serotonin and dopamine on the valuation of harm in moral decision making. Curr Biol 25(14):1852–1859

    Article  Google Scholar 

  10. Crockett MJ, Apergis-Schoute A, Herrmann B, Lieberman M, Muller U, Robbins TW, Clark L (2013) Serotonin modulates striatal responses to fairness and retaliation in humans. J Neurosci 33(8):3505–3513

    Article  Google Scholar 

  11. Dasgupta S, Worgotter F, Manoonpong P (2014) Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control. Front Neural Circ 8:1–21

    Google Scholar 

  12. Ehrlich K, Cheng G (2019) A feasibility study for validating robot actions using eeg-based error-related potentials. Int J Soc Robot 11:271–283

    Article  Google Scholar 

  13. Fang L, Gao F (2018) Type design and behavior control for six legged robots. Chin J Mech Eng 31:1–12

    Article  Google Scholar 

  14. Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Netw 15:549–559

    Article  Google Scholar 

  15. Kattner F, Cochrane A, Cox CR, Gorman TE, Green CS (2017) Perceptual learning generalization from sequential perceptual training as a change in learning rate. Curr Biol 27:840–846

    Article  Google Scholar 

  16. Krichmar JL (2012) A biologically inspired action selection algorithm based on principles of neuromodulation. In: Proceedings of the WCCI 2012 IEEE World Congress on Computational Intelligence, pp 1–8

  17. Krichmar JL (2013) A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior. Front Neurorobot 7:1–17

    Google Scholar 

  18. Law CT, Gold JI (2008) Neural correlates of perceptual learning in a sensory motor, but not a sensory, cortical area. Nat Neurosci 11(4):505–513

    Article  Google Scholar 

  19. Meneses A, Perez-Garcia G (2007) 5-ht1a receptors and memory. Neurosci Biobehav Rev 31(5):705–727

    Article  Google Scholar 

  20. Merrick KE (2010) A comparative study of value systems for self-motivated exploration and learning by robots. IEEE Trans Auton Ment Dev 2:119–131

    Article  Google Scholar 

  21. Mirus F, Axenie C, Stewart TC, Conradt J (2018) Neuromorphic sensorimotor adaptation for robotic mobile manipulation: From sensing to behaviour. Cogn Syst Res 50:52–66

    Article  Google Scholar 

  22. Mohanta JC, Anupam K (2019) A knowledge based fuzzy-probabilistic roadmap method for mobile robot navigation. Appl Soft Comput 79:391–409

    Article  Google Scholar 

  23. Patle BK, Parhi DRK, Jagadeesh A, Kashyap SK (2019) Application of probability to enhance the performance of fuzzy based mobile robot navigation. Appl Soft Comput 75:265–283

    Article  Google Scholar 

  24. Popov VL, Ahmed SA, Topalov AV, Shakev NG (2018) Development of mobile robot target recognition and following behaviour using deep convolutional neural network and 2d range data. IFAC-Papers OnLine 51(30):210–215

    Article  Google Scholar 

  25. Ramos K, Stanley M (2018) Anxiety disorders in late life. Psychiatr Clin N Am 41(1):55–64

    Article  Google Scholar 

  26. Seo C, Guru A, Jin M, Ito B, Sleezer B, Ho Y, Wang E, Boada C, Krupa N, Kullakanda D, Shen C, Warden M (2019) Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode. Science 363(6426):538–542

    Article  Google Scholar 

  27. Wang D, Duan Y, Weng J (2018) Motivated optimal developmental learning for sequential tasks without using rigid time discounts. IEEE Trans Neural Netw Learn Syst 29(10):4917–4931

    Article  Google Scholar 

  28. Wang D, Hu Y, Ma T (2020) Mobile robot navigation with the combination of supervised learning in cerebellum and reward-based learning in basal ganglia. Cogn Syst Res 59:1–14

    Article  Google Scholar 

  29. Wang D, Si W, Luo Y, Wang H, Ma T (2019) Goal-directed autonomous navigation of mobile robot based on the principle of neuromodulation. Netw Comput Neural Syst 30(1–4):79–106

    Article  Google Scholar 

  30. Wen S, Chen X, Ma C (2015) The q-learning obstacle avoidance algorithm based on ekf-slam for nao autonomous walking under unknown environments. Robot Autonom Syst 72:29–36

    Article  Google Scholar 

  31. Xie X, Yu C (2018) Double training downshifts the threshold vs. noise contrast (tvc) functions with perceptual learning and transfer. Vis Res 152:3–9

    Article  Google Scholar 

  32. Xu L (2018) Fault-tolerant iterative learning control for mobile robots non-repetitive trajectory tracking with output constraints. Automatica 94:63–71

    Article  MathSciNet  Google Scholar 

  33. Zhao P, Yuan J, Wang H, Mi T (2019) Research on autonomous decision-making method of plume tracking robot based on decision tree. Comput Eng Appl 55(14):254–259

    Google Scholar 

Download references

Acknowledgements

This research is supported by the Scientific Problem Tackling of Henan Province under Grant 192102210256. The authors also want to thank the help from the National Supercomputing Center in Zhengzhou.

Author information

Authors and Affiliations

  1. School of Electrical Engineering, Zhengzhou University, Zhengzhou, 450001, People’s Republic of China

    Dongshu Wang & Kai Yang

  2. Institute of the Public Safety, Zhengzhou University, Zhengzhou, 450001, People’s Republic of China

    Dongshu Wang & Kai Yang

  3. The People’s Bank of China, Zhengzhou Central Sub-Branch, Zhengzhou, 450018, People’s Republic of China

    Lei Liu

Authors
  1. Dongshu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kai Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongshu Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, D., Yang, K. & Liu, L. An adaptive behavior decision model of mobile robot based on the neuromodulation. Artif Life Robotics 26, 66–75 (2021). https://doi.org/10.1007/s10015-020-00629-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-020-00629-z

Keywords

Search

Navigation