Skip to main content

Advertisement

SpringerLink
Log in

A deep reinforcement learning process based on robotic training to assist mental health patients

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Nowadays, robots are playing a vital role in healthcare applications to provide patients support and assistance in critical situations. The robots are trained by artificial intelligence systems which help to learn the robot according to their patient needs. However, the robots require the medical staff while diagnosing diseases with maximum accuracy, remote treatment, paralyzed patient treatment and so on. For these precise and accurate issues, an intelligent learning process is applied to train the robot to support the patient’s mental health and related task in this work. Initially, the patient health details are collected along with their simple daily routine, medical checkup information and other healthcare details. The gathered details are processed with the help of a deep reinforcement learning process used to get important information. The learning approach uses the state and action process to determine every patient’s needs and the respective assistance. Based on the information, robots are trained continuously to keep patient positive attitudes in their mental health problems. The excellence of the system is evaluated using experimental analysis in which the deep reinforcement system ensures a 0.083 error rate and 98.42% accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Schrank B, Bird V, Rudnick A, Slade M (2012) Determinants, self-management strategies and interventions for hope in people with mental disorders: systematic search and narrative review. Soc Sci Med 74(4):554–564

    Article  Google Scholar 

  2. National Research Council (2009) Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. National Academies Press, Washington, DC

    Google Scholar 

  3. Drake RE, Latimer E (2012) Lessons learned in developing community mental health care in North America. World Psychiatry 11(1):47–51

    Article  Google Scholar 

  4. Luhrs K, Ward T, Hudac CM et al (2017) Associations between familial rates of psychiatric disorders and de novo genetic mutations in autism. Autism Res Treat 2017, 9371964. https://doi.org/10.1155/2017/9371964

  5. Morgan VA, Croft ML, Valuri GM et al (2012) Intellectual disability and other neuropsychiatric outcomes in high-risk children of mothers with schizophrenia, bipolar disorder and unipolar major depression. Br J Psychiatry 200(4):282–289

    Article  Google Scholar 

  6. Curtis S, Pain R, Fuller S et al (2013) Neighbourhood risk factors for common mental disorders among young people aged 10–20 years: a structured review of quantitative research. Health Place 20:81–90

    Article  Google Scholar 

  7. Read J, Bentall RP (2012) Negative childhood experiences and mental health: theoretical, clinical and primary prevention implications. Br J Psychiatry 200(2):89–91

    Article  Google Scholar 

  8. Pransky GS, Loisel P, Anema JR (2011) Work disability prevention research: current and future prospects. J Occup Rehabil 21:287–292

    Article  Google Scholar 

  9. Whitfill T, Haggard R, Bierner SM, Pransky G, Hassett RG, Gatchel RJ (2010) Early intervention options for acute low back pain patients: a randomized clinical trial with one-year follow-up outcomes. J Occup Rehabil 20:256–263

    Article  Google Scholar 

  10. Guilmatre A, Dubourg C, Mosca A-L et al (2009) Recurrent rearrangements in synaptic and neurodevelopmental genes and shared biologic pathways in schizophrenia, autism, and mental retardation. Arch Gen Psychiatry 66(9):947–956

    Article  Google Scholar 

  11. Gelderblom GJ, Bemelmans R, Spierts N, Jonker P, de Witte L (2010) Development of PARO interventions for dementia patients in Dutch psycho-geriatric care. In: Ge SS, Li H, Cabibihan JJ, Tan YK (eds) Social robotics. ICSR 2010. Lecture Notes in Computer Science, vol 6414. Springer, Berlin

    Google Scholar 

  12. Tapus A, Tapus C, Mataric MJ (2009) The use of socially assistive robots in the design of intelligent cognitive therapies for people with dementia. In: IEEE international conference on rehabilitation robotics, ICORR 2009, pp 924–929

  13. Burton WN, Pransky G, Conti DJ, Chen CY (2004) The association of medical conditions and presenteeism. J Occup Environ Med 46(6):S38–S45. https://doi.org/10.1097/01.jom.0000126687.49652.44

    Article  Google Scholar 

  14. Libin A, Libin E (2004) Person Robot interactons from robopsychologists’ point of view: the robotic psychology and robotherapy approach. Proc IEEE 92(11):1–5

    Article  Google Scholar 

  15. Yousif J, Fekihal M (2012) Neural approach for determining mental health problems. J Comput 4:6–11

    Google Scholar 

  16. Rudovic O, Lee J, Dai M, Schuller B, Picard RW (2018) Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci Robot 3(19):6760. https://doi.org/10.1126/scirobotics.aao6760

    Article  Google Scholar 

  17. Loh E (2018) Medicine and the rise of the robots: a qualitative review of recent advances of artificial intelligence in health. BMJ Leader 2:59–63

    Article  Google Scholar 

  18. Durstewitz D, Koppe G, Meyer-Lindenberg A (2019) Deep neural networks in psychiatry. Mol Psychiatry 24(11):1583–1598

    Article  Google Scholar 

  19. Galiatsatos D, Konstantopoulou G, Anastassopoulos G, Nerantzaki M, Assimakopoulos K, Lymberopoulos D (2015) Classification of the most significant psychological symptoms in mental patients with depression using Bayesian network. In: Proceeding EANN ‘15 proceedings of the 16th international conference on engineering applications of neural networks (INNS), Article No. 15

  20. Alegria M, Jackson JS, Kessler RC, Takeuchi D (2007) Collaborative Psychiatric Epidemiology Surveys (CPES), 2001–2003 [United States]. Inter-university Consortium for Political and Social Research [distributor], 2016-03-23, Ann Arbor. https://doi.org/10.3886/ICPSR20240.v8

  21. https://www.hcp.med.harvard.edu/ncs/. Accessed 20 Dec 2019

  22. https://www.massgeneral.org/disparitiesresearch/Research/pastresearch/NLAAS-study.aspx. Accessed 20 Dec 2019

  23. https://www.icpsr.umich.edu/icpsrweb/ICPSR/studies/190. Accessed 20 Dec 2019

  24. Choi J, Dekkers OM, le Cessie S (2018) A comparison of different methods to handle missing data in the context of propensity score analysis. Eur J Epidemiol. https://doi.org/10.1007/s10654-018-0447-z

    Article  Google Scholar 

  25. Bonander C, Strömberg U Eur, Epidemiol J (2019) Methods to handle missing values and missing individuals. Eur J Epidemiol 34:5. https://doi.org/10.1007/s10654-018-0461-1

    Article  Google Scholar 

  26. Tang F, Ishwaran H (2017) Random Forest missing data algorithms. Stat Anal Data Min 10(6):363–377

    Article  MathSciNet  Google Scholar 

  27. Pantanowitz A, Marwala T (2009) Missing data imputation through the use of the random forest algorithm. In: Yu W, Sanchez EN (eds) Advances in computational intelligence. Advances in intelligent and soft computing, vol 116. Springer, Berlin

    Google Scholar 

  28. Gomathi P, Baskar S, Shakeel MP, Dhulipala SV (2019) Numerical function optimization in brain tumor regions using reconfigured multi-objective bat optimization algorithm. J Med Imaging Health Inform 9(3):482–489

    Article  Google Scholar 

  29. Chen X, Cao L, Li C, Xu Z, Lai J (2018) Ensemble network architecture for deep reinforcement learning. Math Problems Eng 2018, 2129393. https://doi.org/10.1155/2018/2129393

  30. Van Hasselt H (2011) Double Q-learning. Adv Neural Inf Process Syst 23:2613–2622

    Google Scholar 

  31. Van Hasselt H (2012) Reinforcement learning in continuous state and action spaces. In: Wiering M, van Otterlo M (eds) Reinforcement learning: state-of-the-art. Springer, Berlin, pp 207–251. ISBN 978-3-642-27645-3

    Chapter  Google Scholar 

  32. Maei H, Szepesvári C, Bhatnagar S, Sutton R (2010) Toward off-policy learning control with function approximation. In: Proceedings of the 27th international conference on machine learning, pp 719–726

  33. Faußer S, Schwenker F (2011) Ensemble methods for reinforcement learning with function approximation. In: Sansone C, Kittler J, Roli F (eds) Multiple classifier systems. Springer, Berlin, pp 56–65

    Chapter  Google Scholar 

  34. Degris T, Pilarski PM, Sutton RS (2012) Model-Free reinforcement learning with continuous action in practice. In: Proceedings of the 2012 American control conference, ACC 2012, pp 2177–2182, June 2012. View at Scopus

  35. Mozer S, Hasselmo M (2005) Reinforcement learning: an introduction. IEEE Trans Neural Netw Learn Syst 16(1):285–286

    Article  Google Scholar 

  36. Zhao Y, Wong ZS-Y, Tsui KL (2018) A framework of rebalancing imbalanced healthcare data for rare events’ classification: a case of look-alike sound-alike mix-up incident detection. J Healthc Eng 2018, 6275435. https://doi.org/10.1155/2018/6275435

  37. Vanhaezebrouck IF, Ballegeer EA, Frey S, Sieffert R (2018) Accuracy and precision of a veterinary neuronavigation system for radiation oncology positioning. J Vet Med 2018, 6431749. https://doi.org/10.1155/2018/6431749

  38. Saqlain SM, Sher M, Shah FA et al (2019) Fisher score and Matthews correlation coefficient-based feature subset selection for heart disease diagnosis using support vector machine. Knowl Inf Syst 58:139. https://doi.org/10.1007/s10115-018-1185-y

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to extend their sincere appreciation to the Deanship of Scientific Research at King Saud University for its funding this research group No. (RGP – 1436-035).

Author information

Authors and Affiliations

  1. Computer Science Department, CC, King Saud University, Riyadh, 11437, Saudi Arabia

    Torki Altameem & Mohammed Amoon

  2. Computer Science and Engineering Department, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952, Egypt

    Mohammed Amoon

  3. College of Applied Studies, King Saud University, Riyadh, Saudi Arabia

    Ayman Altameem

Authors
  1. Torki Altameem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Amoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ayman Altameem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Torki Altameem.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Altameem, T., Amoon, M. & Altameem, A. A deep reinforcement learning process based on robotic training to assist mental health patients. Neural Comput & Applic 34, 10587–10596 (2022). https://doi.org/10.1007/s00521-020-04855-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04855-1

Keywords

Search

Navigation