Abstract
In this paper, we propose a method for visualizing Parkinson’s disease tremors using augmented reality to support telemedicine. The proposed method utilizes OpenPose to extract body joints and connects the coordinates of every two adjacent joints with straight lines in the video. We made the angular changes of adjacent joints representing tremors, with each angle’s latest 64 data points as a set of signals. The color and thickness of the lines are changed by using the frequency of the maximum amplitude and the strength of tremors. We created a prototype system and conducted an experiment to evaluate the proposed method. The experimental results showed significant color and thickness changes in the lines where tremors occurred. Moreover, we sent the video with the visualization results to a doctor, and the doctor found this method to be useful in visualizing the characteristics of tremors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bhat, M., Inamdar, S., Kulkarni, D., Kulkarni, G., Shriram, R.: Parkinson’s disease prediction based on hand tremor analysis. In: 2017 International Conference on Communication and Signal Processing (ICCSP), pp. 0625–0629 (2017)
Kostikis, N., Hristu-Varsakelis, D., Arnaoutoglou, M., Kotsavasiloglou, C.: A smartphone-based tool for assessing Parkinsonian hand tremor. IEEE J. Biomed. Health Inform. 19(6), 1835–1842 (2015)
LeMoyne, R., Mastroianni, T., Cozza, M., Coroian, C., Grundfest, W.: Implementation of an iPhone for characterizing Parkinson’s disease tremor through a wireless accelerometer application. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 4954–4958 (2010)
Pang, Y., et al.: Automatic detection and quantification of hand movements toward development of an objective assessment of tremor and bradykinesia in Parkinson’s disease. J. Neurosci. Methods 333, 108576 (2020)
Polat, K.: Freezing of Gait (FoG) detection using logistic regression in parkinson’s disease from acceleration signals. In: 2019 Scientific Meeting on Electrical-Electronics and Biomedical Engineering and Computer Science (EBBT), pp. 1–4 (2019)
El-Attar, A., Ashour, A.S., Dey, N., Abdelkader, H., Abd El-Naby, M.M., Sherratt, R.S.: Discrete wavelet transform-based freezing of gait detection in Parkinson’s disease. J. Exp. Theor. Artif. Intell. 33(4), 543–559 (2018)
Bigy, A. A. M., Banitsas, K., Badii, A., Cosmas, J.: Recognition of postures and freezing of gait in Parkinson’s disease patients using Microsoft Kinect sensor. In: 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER), pp. 731–734 (2015)
Fleyeh, H., Westin, J.: Extracting body landmarks from videos for Parkinson gait analysis. In: 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), 2019, pp. 379–384 (2019)
Li, M.H., Mestre, T.A., Fox, S.H., Taati, B.: Vision-based assessment of Parkinsonism and levodopa-induced dyskinesia with deep learning pose estimation. J. Neuroeng. Rehabil. 15(1), 1–13 (2017)
Cao, Z., Hidalgo, G., Simon, T., Wei, S., Sheikh, Y.: OpenPose: realtime MultiPerson 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Du, T., Komuro, T., Ogawa-Ochiai, K. (2022). Visualization of Parkinson’s Disease Tremor for a Telemedicine System. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2022 – Late Breaking Posters. HCII 2022. Communications in Computer and Information Science, vol 1654. Springer, Cham. https://doi.org/10.1007/978-3-031-19679-9_52
Download citation
DOI: https://doi.org/10.1007/978-3-031-19679-9_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-19678-2
Online ISBN: 978-3-031-19679-9
eBook Packages: Computer ScienceComputer Science (R0)