Skip to main content
SpringerLink
Log in

An augmented reality-supported mobile application for diagnosis of heart diseases

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Nowadays, it is important to design and develop effective applications for improving solution experiences in the fields associated with studies of biomedical and health informatics. Along with rapid developments in computer and electronics technologies, that has become more important in especially twenty-first century. Moving from that, main objective of this study is to deal with the problem of heart sound analysis and disease diagnosis by using a mobile application that can perform the mentioned tasks by having also support from both virtual reality- and augmented reality-oriented components. Thanks to the using features and functions provided over the application, it is possible to analyze signals instantly and have rapid feedback over the interface supported with virtual or mixed reality objects as combining both real and virtual worlds in a common ground. The paper briefly focuses on technical background and essentials of the developed mobile system and then evaluates its performance in the context of different perspectives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Steuer J (1992) Defining virtual reality: dimensions determining telepresence. J Commun 42(4):73–93

    Google Scholar 

  2. Burdea Grigore C, Coiffet P (1994) Virtual reality technology. Wiley-Interscience, London

    Google Scholar 

  3. Rheingold H (1991) Virtual reality: exploring the brave new technologies. Simon & Schuster Adult Publishing Group, New York

    Google Scholar 

  4. Biocca F, Levy MR (eds) (2013) Communication in the age of virtual reality. Routledge, London

    Google Scholar 

  5. Lévy P, Bononno R (1998) Becoming virtual: reality in the digital age. Da Capo Press, Incorporated, Cambridge

    Google Scholar 

  6. Zyda M (2005) From visual simulation to virtual reality to games. Computer 38(9):25–32

    Google Scholar 

  7. Bates J (1992) Virtual reality, art, and entertainment. Presence Teleoperators Virtual Environ 1(1):133–138

    Google Scholar 

  8. Sherman WR, Craig AB (2002) Understanding virtual reality: interface, application, and design. Elsevier, Amsterdam

    Google Scholar 

  9. Hughes CE, Stapleton CB, Hughes DE, Smith EM (2005) Mixed reality in education, entertainment, and training. IEEE Comput Graph Appl 25(6):24–30

    Google Scholar 

  10. Ong SK, Nee AYC (2013) Virtual and augmented reality applications in manufacturing. Springer Science & Business Media, Berlin

    Google Scholar 

  11. Roussou M, Oliver M, Slater M (2006) The virtual playground: an educational virtual reality environment for evaluating interactivity and conceptual learning. Virtual Real 10(3–4):227–240

    Google Scholar 

  12. Weiss PL, Rand D, Katz N, Kizony R (2004) Video capture virtual reality as a flexible and effective rehabilitation tool. J Neuroeng Rehabil 1(1):12

    Google Scholar 

  13. Merchant Z, Goetz ET, Cifuentes L, Keeney-Kennicutt W, Davis TJ (2014) Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis. Comput Educ 70:29–40

    Google Scholar 

  14. Loeffler CE (1993) Distributed virtual reality: applications for education, entertainment and industry. Telektronikk 89:83

    Google Scholar 

  15. Guttentag DA (2010) Virtual reality: applications and implications for tourism. Tour Manag 31(5):637–651

    Google Scholar 

  16. Oliveira JM, Fernandes RCG, Pinheiro PR, Ribeiro STG, de Albuquerque VHC (2016) Novel virtual environment for alternative treatment of children with cerebral palsy. Comput Intell Neurosci 2016:1–10

    Google Scholar 

  17. Ohta Y, Tamura H (2014) Mixed reality: merging real and virtual worlds. Springer Publishing Company, Incorporated, Berlin

    Google Scholar 

  18. Van Krevelen DWF, Poelman R (2010) A survey of augmented reality technologies, applications and limitations. Int J Virtual Real 9(2):1

    Google Scholar 

  19. Cawood S, Fiala M, Steinberg DH (2007) Augmented reality: a practical guide. Pragmatic Bookshelf, Raleigh

    Google Scholar 

  20. Silva RDDC, Albuquerque SGC, Muniz ADV, Filho PPR, Ribeiro S, Pinheiro PR, Albuquerque VHC (2017) Reducing the schizophrenia stigma: a new approach based on augmented reality. Comput Intell Neurosci 2017:1–10

    Google Scholar 

  21. Billinghurst M, Clark A, Lee G (2015) A survey of augmented reality. Found Trends® Hum Comput Interact 8(2–3):73–272

    Google Scholar 

  22. Azuma R, Baillot Y, Behringer R, Feiner S, Julier S, MacIntyre B (2001) Recent advances in augmented reality. IEEE Comput Graph Appl 21(6):34–47

    Google Scholar 

  23. Höllerer T, Feiner S (2004) Mobile augmented reality. Telegeoinformatics: location-based computing and services. Taylor and Francis Books Ltd, London, p 21

    Google Scholar 

  24. Köse U (2017) An augmented-reality-based intelligent mobile application for open computer education. In: Kurubacak G, Altinpulluk H (eds) Mobile technologies and augmented reality in open education. IGI Global, Hershey, PA, pp 154–174. https://doi.org/10.4018/978-1-5225-2110-5.ch008

  25. Dunleavy M, Dede C (2014) Augmented reality teaching and learning. In: Michael Spector J, David Merrill M, Elen J, Bishop J (eds) Handbook of research on educational communications and technology. Springer, New York, pp 735–745. https://doi.org/10.1007/978-1-4614-3185-5

    Chapter  Google Scholar 

  26. Nee AY, Ong SK, Chryssolouris G, Mourtzis D (2012) Augmented reality applications in design and manufacturing. CIRP Ann Manuf Technol 61(2):657–679

    Google Scholar 

  27. Rodrigues JJPC, Segundo DBDR, Junqueira HA, Sabino MH, Prince RM, Al-Muhtadi J, De Albuquerque VHC (2018) Enabling technologies for the internet of health things. IEEE Access 6:13129–13141

    Google Scholar 

  28. Da Cruz MAA, Rodrigues JJPC, Al-Muhtadi J, Korotaev VV, De Albuquerque VHC (2018) A reference model for internet of things middleware. IEEE Internet Things J 5:871–883

    Google Scholar 

  29. Hussein AF, Kumar A, Burbano-Fernandez M, Ramirez-Gonzalez G, Abdulhay E, de Albuquerque VHC (2018) An automated remote cloud-based heart rate variability monitoring system. IEEE Access. https://doi.org/10.1109/access.2018.2831209

    Article  Google Scholar 

  30. De Albuquerque VHC, Nunes TM, Pereira DR, Luz EJDS, Menotti D, Papa JP, Tavares JMRS (2016) Robust automated cardiac arrhythmia detection in ECG beat signals. Neural Comput Appl 29:1

    Google Scholar 

  31. Luz EJS, Nunes TM, de Albuquerque VHC, Papa JP, Menotti D (2013) ECG arrhythmia classification based on optimum-path forest. Expert Syst Appl 40:3561–3573

    Google Scholar 

  32. You SH, Jang SH, Kim YH, Hallett M, Ahn SH, Kwon YH, Lee MY (2005) Virtual reality–induced cortical reorganization and associated locomotor recovery in chronic stroke: an experimenter-blind randomized study. Stroke 36(6):1166–1171

    Google Scholar 

  33. Saposnik G, Levin M, Stroke Outcome Research Canada (SORCan) Working Group (2011) Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke 42(5):1380–1386

    Google Scholar 

  34. Weidenbach M, Wick C, Pieper S, Quast KJ, Fox T, Grunst G, Redel DA (2000) Augmented reality simulator for training in two-dimensional echocardiography. Comput Biomed Res 33(1):11–22

    Google Scholar 

  35. Marescaux J, Diana M (2015) Next step in minimally invasive surgery: hybrid image-guided surgery. J Pediatr Surg 50(1):30–36

    Google Scholar 

  36. Nicolau S, Soler L, Mutter D, Marescaux J (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20(3):189–201

    Google Scholar 

  37. Bernhardt S, Nicolau SA, Agnus V, Soler L, Doignon C, Marescaux J (2016) Automatic localization of endoscope in intraoperative CT image: a simple approach to augmented reality guidance in laparoscopic surgery. Med Image Anal 30:130–143

    Google Scholar 

  38. Tang SL, Kwoh CK, Teo MY, Sing NW, Ling KV (1998) Augmented reality systems for medical applications. IEEE Eng Med Biol Mag 17(3):49–58

    Google Scholar 

  39. Birkfellner W, Figl M, Huber K, Watzinger F, Wanschitz F, Hummel J, Bergmann H (2002) A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation. IEEE Trans Med Imaging 21(8):991–997

    MATH  Google Scholar 

  40. De Buck S, Maes F, Ector J, Bogaert J, Dymarkowski S, Heidbuchel H, Suetens P (2005) An augmented reality system for patient-specific guidance of cardiac catheter ablation procedures. IEEE Trans Med Imaging 24(11):1512–1524

    Google Scholar 

  41. Luo X, Kline T, Fischer HC, Stubblefield KA, Kenyon RV, Kamper DG (2005) Integration of augmented reality and assistive devices for post-stroke hand opening rehabilitation. In: 27th Annual International Conference of the Engineering in Medicine and Biology Society, 2005. IEEE-EMBS 2005. IEEE, pp 6855–6858

  42. Khademi M, Hondori HM, Lopes CV, Dodakian L, Cramer SC (2012) Haptic augmented reality to monitor human arm’s stiffness in rehabilitation. In: 2012 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES). IEEE, pp 892–895

  43. Kamphuis C, Barsom E, Schijven M, Christoph N (2014) Augmented reality in medical education? Perspect Med Educ 3(4):300–311

    Google Scholar 

  44. Herron J (2016) Augmented reality in medical education and training. J Electron Resour Med Libr 13(2):51–55

    MathSciNet  Google Scholar 

  45. Kiourexidou M, Natsis K, Bamidis P, Antonopoulos N, Papathanasiou E, Sgantzos M, Veglis A (2015) Augmented reality for the study of human heart anatomy. Int J Electron Commun Comput Eng 6(6):658

    Google Scholar 

  46. Zhu E, Hadadgar A, Masiello I, Zary N (2014) Augmented reality in healthcare education: an integrative review. PeerJ 2:e469

    Google Scholar 

  47. Hsieh MC, Lee JJ (2018) Preliminary study of VR and AR applications in medical and healthcare education. J Nurs Health Stud 3(1):1

    Google Scholar 

  48. Smith M, Gabbard JL, Burnett G, Doutcheva N (2017) The effects of augmented reality head-up displays on drivers’ eye scan patterns, performance, and perceptions. Int J Mob Hum Comput Interact (IJMHCI) 9(2):1–17

    Google Scholar 

  49. McGrath JL, Taekman JM, Dev P, Danforth DR, Mohan D, Kman N, Bond WF (2018) Using virtual reality simulation environments to assess competence for emergency medicine learners. Acad Emerg Med 25(2):186–195

    Google Scholar 

  50. Mostafa AE, Ryu WHA, Chan S, Takashima K, Kopp G, Costa Sousa M, Sharlin E (2017) Designing NeuroSimVR: a stereoscopic virtual reality spine surgery simulator. Science 1:1–20

    Google Scholar 

  51. Wiederhold BK, Miller I, Wiederhold MD (2018) Augmenting behavioral healthcare: mobilizing services with virtual reality and augmented reality. In: Rivas H, Wac K (eds) Digital health. Springer, Cham, pp 123–137

    Google Scholar 

  52. Moro C, Štromberga Z, Raikos A, Stirling A (2017) The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat Sci Educ 10(6):549–559

    Google Scholar 

  53. Douglas DB, Wilke CA, Gibson D, Petricoin EF, Liotta L (2017) Virtual reality and augmented reality: advances in surgery. Biology 2(5):1–8

    Google Scholar 

  54. Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, Slater M (2017) Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med 47(14):2393–2400

    Google Scholar 

  55. McCloy R, Stone R (2001) Science, medicine, and the future: virtual reality in surgery. BMJ Br Med J 323(7318):912

    Google Scholar 

  56. Riva G (2002) Virtual reality for health care: the status of research. Cyberpsychol Behav 5(3):219–225

    Google Scholar 

  57. Ma M, Jain LC, Anderson P (eds) (2014) Virtual, augmented reality and serious games for healthcare 1, vol 1. Springer, Berlin

    Google Scholar 

  58. Deperlioglu O (2018) Segmentation of heart sounds by re-sampled signal energy method. BRAIN Broad Res Artif Intell Neurosci 9(1):17–28

    Google Scholar 

  59. Ahlström C (2006) Processing of the phonocardiographic signal-methods for the intelligent stethoscope, Disseration, Linköping University, Institute of Technology, Linköping, Sweden

  60. Zabihi M, Rad AB, Kiranyaz S, Gabbouj M, Katsaggelos AK (2016) Heart sound anomaly and quality detection using ensemble of neural networks without segmentation. Comput Cardiol 43:613–616

    Google Scholar 

  61. Deperlioglu O (2018) Classification of phonocardiograms with convolutional neural networks. BRAIN Broad Res Artif Intell Neurosci 9(2):22–23

    Google Scholar 

  62. Bulbul HI, Karaci A (2007) Speech command recognition in computer: pattern recognition method. Kastamonu Educ J 15(1):45–62

    Google Scholar 

  63. Qiang H, Youwei Z (1998) On prefiltering and endpoint detection of speech signal. In: 1998 Fourth International Conference on Signal Processing Proceedings ICSP’98, vol 1, pp 749–753

  64. Bentley P, Nordehn G, Coimbra M, Mannor S (2011) The PASCAL classifying heart sounds challenge 2011 (CHSC2011) results. http://www.peterjbentley.com/heartchallenge/index.html. Accessed 05 Feb 2018

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, Karunya University, Coimbatore, India

    Jude D. Hemanth

  2. Department of Computer Engineering, Suleyman Demirel University, 32260, Isparta, Turkey

    Utku Kose

  3. Department of Computer Technologies, Afyon Kocatepe University, 03200, Afyon, Turkey

    Omer Deperlioglu

  4. Graduate Program in Applied Informatics, University of Fortaleza, Fortaleza, CE, Brazil

    Victor Hugo C. de Albuquerque

Authors
  1. Jude D. Hemanth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Utku Kose
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Omer Deperlioglu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Victor Hugo C. de Albuquerque
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Victor Hugo C. de Albuquerque.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hemanth, J.D., Kose, U., Deperlioglu, O. et al. An augmented reality-supported mobile application for diagnosis of heart diseases. J Supercomput 76, 1242–1267 (2020). https://doi.org/10.1007/s11227-018-2483-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-018-2483-6

Keywords

Search

Navigation