Abstract
Parkinson’s disease (PD) is characterized by motor alterations and associated with dopamine neurotransmitters degeneration, affecting 3% of the population over 65 years of age. Today, there is no definitive biomarker for an early diagnosis and progression characterization. Recently, oculomotor alterations have shown promising evidence to quantify PD patterns. Current capture and oculomotor setups however require sophisticated protocols, limiting the analysis to coarse measures that poorly exploit alterations and restrict their standard use in clinical environments. Computational based deep learning strategies today bring a robust alternative by discovering in video sequences hidden patterns associated to the disease. However, these approaches are dependent on large training data volumes to cover the variability of patterns of interest. This work introduces a novel strategy that exploits data geometry within a deep Riemannian manifold, withstanding data scarcity and discovering oculomotor PD hidden patterns. First, oculomotor information is encoded as symmetric matrices that capture second order statistics of deep features computed by a convolutional scheme. These symmetric matrices then form an embedded representation, which is decoded by a Riemannian network to discriminate Parkinsonian patients w.r.t a control population. The proposed strategy, evaluated on a fixational eye experiment, proves to be a promising approach to represent PD patterns.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton (2009)
Acharya, D., Huang, Z., Pani Paudel, D., Van Gool, L.: Covariance pooling for facial expression recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 367–374 (2018)
Bronstein, M.M., Bruna, J., LeCun, Y., Szlam, A., Vandergheynst, P.: Geometric deep learning: going beyond Euclidean data. IEEE Signal Process. Mag. 34(4), 18–42 (2017). https://doi.org/10.1109/MSP.2017.2693418
Chan, F., Armstrong, I.T., Pari, G., Riopelle, R.J., Munoz, D.P.: Deficits in saccadic eye-movement control in Parkinson’s disease. Neuropsychologia 43, 784–796 (2005)
Dorsey, E.R., Elbaz, A., Nichols, E., Abd-Allah, F., Abdelalim, A., Adsuar, J.C., et al.: Global, regional, and national burden of Parkinson’s disease, 1990–2016: a systematic analysis for the global burden of disease study 2016. Lancet Neurol. 17(11), 939–953 (2018)
Gatys, L., Ecker, A.S., Bethge, M.: Texture synthesis using convolutional neural networks. In: Advances in Neural Information Processing Systems, vol. 28 (2015)
Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2414–2423 (2016)
Gitchel, G.T., Wetzel, P.A., Baron, M.S.: Pervasive ocular tremor in patients with Parkinson disease. Arch. Neurol. 69, 1011–1017 (2012)
Guayacán, L.C., Rangel, E., Martínez, F.: Towards understanding spatio-temporal parkinsonian patterns from salient regions of a 3D convolutional network. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 3688–3691. IEEE (2020)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Huang, Z., Van Gool, L.: A Riemannian network for SPD matrix learning. In: Thirty-First AAAI Conference on Artificial Intelligence, vol. 31, no. 1 (2017)
Ionescu, C., Vantzos, O., Sminchisescu, C.: Matrix backpropagation for deep networks with structured layers. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2965–2973 (2015)
Li, P., Xie, J., Wang, Q., Zuo, W.: Is second-order information helpful for large-scale visual recognition? In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2070–2078 (2017)
Li, Y., Wang, N., Liu, J., Hou, X.: Demystifying neural style transfer. arXiv preprint arXiv:1701.01036 (2017)
Pennec, X., Fillard, P., Ayache, N.: A Riemannian framework for tensor computing. Int. J. Comput. Vis. 66(1), 41–66 (2006)
Poewe, W., Seppi, K., Tanner, C.M., Halliday, G.M., Brundin, P., Volkmann, J., et al.: Parkinson disease. Nat. Rev. Disease Primers 3(1), 1–21 (2017)
Salazar, I., Pertuz, S., Contreras, W., Martínez, F.: A convolutional oculomotor representation to model Parkinsonian fixational patterns from magnified videos. Pattern Anal. Appl. 24(2), 445–457 (2021)
Teed, Z., Deng, J.: RAFT: recurrent all-pairs field transforms for optical flow. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12347, pp. 402–419. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58536-5_24
Tolosa, E., Garrido, A., Scholz, S.W., Poewe, W.: Challenges in the diagnosis of Parkinson’s disease. Lancet Neurol. 20(5), 385–397 (2021)
Wang, Q., Xie, J., Zuo, W., Zhang, L., Li, P.: Deep CNNs meet global covariance pooling: better representation and generalization. IEEE Trans. Pattern Anal. Mach. Intell. 43, 2582–2597 (2020)
Wang, W., Lee, J., Harrou, F., Sun, Y.: Early detection of Parkinson’s disease using deep learning and machine learning. IEEE Access 8, 147635–147646 (2020)
Weil, R.S., Schrag, A.E., Warren, J.D., Crutch, S.J., Lees, A.J., Morris, H.R.: Visual dysfunction in Parkinson’s disease. Brain J. Neurol. 139(11), 2827–2843 (2016)
Acknowledgments
The recorded dataset was possible thanks to the support of the Parkinson foundation FAMPAS and the institution Asilo San Rafael. Additionally, acknowledgments to the Universidad Industrial de Santander for supporting this research registered by the project: Cuantificación de patrones locomotores para el diagnóstico y seguimiento remoto en zonas de dificil acceso, with SIVIE code 2697.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Olmos, J., Manzanera, A., Martínez, F. (2022). An Oculomotor Digital Parkinson Biomarker from a Deep Riemannian Representation. In: El Yacoubi, M., Granger, E., Yuen, P.C., Pal, U., Vincent, N. (eds) Pattern Recognition and Artificial Intelligence. ICPRAI 2022. Lecture Notes in Computer Science, vol 13363. Springer, Cham. https://doi.org/10.1007/978-3-031-09037-0_55
Download citation
DOI: https://doi.org/10.1007/978-3-031-09037-0_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-09036-3
Online ISBN: 978-3-031-09037-0
eBook Packages: Computer ScienceComputer Science (R0)