Advertisement

Comparative Analysis of Approaches to Building Medical Dialog Systems in Russian

  • Aleksandra VatianEmail author
  • Natalia Dobrenko
  • Nikolai Andreev
  • Aleksandr Nemerovskii
  • Anastasia Nevochhikova
  • Natalia Gusarova
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11871)

Abstract

Nowadays dialog systems have great promise in the field of medicine and healthcare. Only a few medicine dialog systems presented in the literature are accompanied by an experimental effectiveness evaluations. Moreover, they cover only English-speaken context. In this paper we set the task to conduct a comparative analysis of the effectiveness of Russian-language mixed-initiative medical dialog systems, depending on the chosen architecture and method of processing the users’ intentions. We have developed and compared three types of chat-bots; Frame-based, ML-based and Ontology-based. As the metrics used the accuracy of the intent recognition as the percentage of intents correctly defined by the system relative to the total number of processed utterances. The results show that the accuracy of the intent recognition in all three approaches is quite the same, so finally we propose the architecture of s combined dialog system which covers all the needs for Russian-language medical domain.

Keywords

Dialog systems Chatbot Medical systems 

References

  1. 1.
    McTear, M., Callejas, Z., Griol, D.: The Conversational Interface: Talking to Smart Devices. Springer, Switzerland (2016).  https://doi.org/10.1007/978-3-319-32967-3CrossRefGoogle Scholar
  2. 2.
    Farkash, Z.: Medical Chatbot — The 4 Greatest Challenges Medical Institutes Are Facing, Solved with Chatbots, 19 August 2018Google Scholar
  3. 3.
    Laranjo, L., Dunn, A.G, Tong, H.L.: Conversational agents in healthcare: a systematic review. J. Am. Med. Inform. Assoc. 25(9), 1248–1258 (2018).  https://doi.org/10.1093/jamia/ocy072CrossRefGoogle Scholar
  4. 4.
    White, R.W., Horvitz, E.: From health search to healthcare: explorations of intention and utilization via query logs and user surveys. J. Am. Med. Inform. Assoc. 21(1), 49–55 (2014)CrossRefGoogle Scholar
  5. 5.
    Senaar, K.: Chatbots for Healthcare – Comparing 5 Current Applications. https://emerj.com/ai-application-comparisons/chatbots-for-healthcare-comparison/. Accessed 10 Feb 2019
  6. 6.
    Virtualspirits. Chatbot for Healthcare. https://www.virtualspirits.com/chatbot-for-healthcare.aspx. Accessed 07 June 2019
  7. 7.
    Jurafsky, D., Martin, J.H.: Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 2nd edn. Prentice Hall, Englewood Cliffs (2008)Google Scholar
  8. 8.
    de Bayser, M.G., Cavalin, P., Souza, R., et al.: A Hybrid Architecture for MultiParty Conversational Systems (2017). https://arxiv.org/abs/1705.01214
  9. 9.
    Lambert, M.: Chatbot Decision Trees. Seriously, how hard can they be? https://chatbotsmagazine.com/chatbot-decision-trees-a42ed8b8cf32. Accessed 21 Apr 2018
  10. 10.
    Churilov, M. Conversational UI: Writing Chatbot Scripts Step by Step. https://chatbotslife.com/conversational-ui-writing-chatbot-scripts-step-by-stepa78b611a5eba. Accessed 8 Jan 2018
  11. 11.
    Paul, M.S.: How to build a Google Home App with DialogFlow. Conversation Design. https://medium.com/swlh/chapter-7-how-to-build-a-google-home-app-withdialogflow-conversation-design-63d6a1402ed0. Accessed 13 Aug 2018
  12. 12.
    Jakuben, B.: Intents, Entities, and Dialogs. https://teamtreehouse.com/library/intents-entities-and-dialogs. Accessed 3 June 2019
  13. 13.
    Liu, Z., et al.: Entity recognition from clinical texts via recurrent neural network. BMC Med. Inform. Decis. Mak. 17(Suppl 2), 67 (2017)Google Scholar
  14. 14.
    Wei, Q., Chen, T., Xu, R., He, Y., Gui, L.: Disease named entity recognition by combining conditional random fields and bidirectional recurrent neural networks. Database (Oxford) (2016).  https://doi.org/10.1093/database/baw140CrossRefGoogle Scholar
  15. 15.
    Quimbaya, A.P., Munera, A.S., Rivera, R.A.G. et al.: Named entity recognition over electronic health records through a combined dictionary-based approach. Procedia Comput. Sci. 100, 55–61 (2016)CrossRefGoogle Scholar
  16. 16.
    Siu, A.: Knowledge-driven Entity Recognition and Disambiguation in Biomedical Text. Saarland University, Saarbrücken, May 2017. https://pure.mpg.de/rest/items/item_2475275_3/component/file_2475274/content. Accessed 03 June 2019
  17. 17.
    Vatian, A., et al.: Intellectualization of knowledge acquisition of academic texts as an answer to challenges of modern information society. Commun. Comput. Inf. Sci. 947, 138–153 (2019)Google Scholar
  18. 18.
    Zhang, Ch., Du, N., Fan, W., Li, Y., Lu, C.-T., Yu, P.S.: Bringing Semantic Structures to User Intent Detection in Online Medical Queries. arXiv:1710.08015v1 [cs.CL], 22 October 2017
  19. 19.
    Amatriain, X.: NLP & Healthcare: Understanding the Language of Medicine. https://medium.com/curai-tech/nlp-healthcare-understanding-the-language-ofmedicine-e9917bbf49e7. Accessed 5 Nov 2018
  20. 20.
    Dharwadkar, R., Deshpande, N.A.: A medical ChatBot. Int. J. Comput. Trends Technol. (IJCTT) 60(1), 39–43 (2018)CrossRefGoogle Scholar
  21. 21.
    Fadhil, A.: Beyond patient monitoring: conversational agents role in telemedicine & healthcare support for home-living elderly individuals. https://arxiv.org/pdf/1803.06000
  22. 22.
    Oyebode, O.O., Orji, R.: Likita: a medical chatbot to improve healthcare delivery in Africa. www.hcixb.org/papers_2018/hcixb18-final-22.pdf
  23. 23.
    Palanica, A., Flaschner, P., Thommandram, A., Li, M., Fossat, Y.: Physicians’ perceptions of chatbots in health care: cross-sectional web-based survey. J. Med. Internet Res. 21(4), e12887 (2019).  https://doi.org/10.2196/12887CrossRefGoogle Scholar
  24. 24.
    Divya, S., Indumathi, V., Ishwarya, S., Priyasankari, M., Kalpana, D.S.: Survey on medical self-diagnosis chatbot for accurate analysis using artificial intelligence. Int. J. Trend Res. Dev. 5(2)Google Scholar
  25. 25.
    Kazi, H., Chowdhry, B.S., Memon, Z.: MedChatBot: an UMLS based chatbot for medical students. Int. J. Comput. Appl. 55(17), 1–5 (2012). (0975–8887)CrossRefGoogle Scholar
  26. 26.
    Tielman, M., van Meggelen, M., Neerincx, M.A., Brinkman, W.-P.: An ontology-based question system for a virtual coach assisting in trauma recollection. In: Brinkman, W.-P., Broekens, J., Heylen, D. (eds.) IVA 2015. LNCS (LNAI), vol. 9238, pp. 17–27. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-21996-7_2CrossRefGoogle Scholar
  27. 27.
    Griol, D., Carbo, J., Molina, J.M.: An automatic dialog simulation technique to develop and evaluate interactive conversational agents. Appl. Artif. Intell. 27(9), 759–780 (2013)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Aleksandra Vatian
    • 1
    Email author
  • Natalia Dobrenko
    • 1
  • Nikolai Andreev
    • 1
  • Aleksandr Nemerovskii
    • 1
  • Anastasia Nevochhikova
    • 1
  • Natalia Gusarova
    • 1
  1. 1.ITMO UniversitySaint PetersburgRussia

Personalised recommendations