The Assessment of Visuospatial Abilities with Tangible Interfaces and Machine Learning

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11486)


Visuospatial abilities are framed in the capacity of perceiving, acting and reasoning in function of spatial coordinates, permitting to identify visual and spatial relationships among objects. They represent the set of skills conferring individuals the ability to interact with the surrounding world. Whenever spatial cognition is impaired it is important to correctly assess visuospatial abilities. Scientific literature, for this purpose, reports many diagnostic tools that have been adopted by clinicians and neuropsychologists.

In this paper we present a prototype that aims to evaluate the visuospatial abilities that are related to how individuals explore their peripersonal space. In particular, the presented tool makes use of tangible interfaces and augmented reality systems.

In the final part of this study we describe the implementation of an ecological test for the assessment of visuospatial abilities through our prototype by highlighting its advantage in terms of data collection and analysis.


Visuospatial abilities Spatial cognition Neuropsychological assessment Machine learning Unilateral Spatial Neglect 


  1. 1.
    Angelini, R., Grossi, D.: La terapia razionale dei disturbi costruttivi. TeRaDic (1993)Google Scholar
  2. 2.
    Appelros, P., Karlsson, G., Thorwalls, A., Tham, K., Nydevik, I.: Unilateral neglect: further validation of the baking tray task. J. Rehabil. Med. 36, 258–261 (2004)CrossRefGoogle Scholar
  3. 3.
    American Psychological Association: Committee on professional standards, American psychological Association, Board of Scientific Affairs, and committee on Psychological Tests and Assessment. Guidelines for computer-based tests and interpretations (1986)Google Scholar
  4. 4.
    Bailey, M.J., Riddoch, M.J., Crome, P.: Test-retest stability of three tests for unilateral visual neglect in patients with stroke: Star Cancellation, Line bisection, and the Baking Tray Task. Neuropsychol. Rehabil. 14, 403–419 (2004)CrossRefGoogle Scholar
  5. 5.
    Benton, A.L., Varney, N.R., deS Hamsher, K.: Visuospatial judgment: a clinical test. Arch. Neurol. 35, 364–367 (1978)CrossRefGoogle Scholar
  6. 6.
    Cerrato, A., Ponticorvo, M.: Enhancing neuropsychological testing with gamification and tangible interfaces: the baking tray task. In: Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Toledo Moreo, J., Adeli, H. (eds.) IWINAC 2017. LNCS, vol. 10338, pp. 147–156. Springer, Cham (2017). Scholar
  7. 7.
    Cerrato, A., Siano, G., De Marco, A.: Augmented reality: from education and training applications to assessment procedures. Qwerty-Open Interdisc. J. Technol. Culture Educ. 13, 11–27 (2018)Google Scholar
  8. 8.
    Cerrato, A., Ponticorvo, M., Bartolomeo, P., Miglino, O.: BTT-scan: An ecological and technology enhanced tool to assess visual neglect. Cogn. Process. 19, S36–S36 (2018)Google Scholar
  9. 9.
    Chung, S.J., et al.: The computerized table setting test for detecting unilateral neglect. PloS one 11(1), e0147030 (2016)CrossRefGoogle Scholar
  10. 10.
    Colom, R., Contreras, M., Shih, P.C., Santacreu, J., et al.: The assessment of spatial ability with a single computerized test. Eur. J. Psychol. Assess. 19(2), 92 (2003)CrossRefGoogle Scholar
  11. 11.
    Di Fuccio, R., Ponticorvo, M., Ferrara, F., Miglino, O.: Digital and multisensory storytelling: narration with smell, taste and touch. In: Verbert, K., Sharples, M., Klobučar, T. (eds.) EC-TEL 2016. LNCS, vol. 9891, pp. 509–512. Springer, Cham (2016). Scholar
  12. 12.
    Diller, L., et al.: Studies in cognition and rehabilitation in hemiplegia (1974)Google Scholar
  13. 13.
    Facchin, A., Beschin, N., Pisano, A., Reverberi, C.: Normative data for distal line bisection and baking tray task. Neurol. Sci. 37, 1531–1536 (2016)CrossRefGoogle Scholar
  14. 14.
    Ferrara, F., Ponticorvo, M., Di Ferdinando, A., Miglino, O.: Tangible interfaces for cognitive assessment and training in children: LogicART. In: Uskov, V.L., Howlett, R.J., Jain, L.C. (eds.) Smart Education and e-Learning 2016. SIST, vol. 59, pp. 329–338. Springer, Cham (2016). Scholar
  15. 15.
    Fordell, H., Bodin, K., Bucht, G., Malm, J.: A virtual reality test battery for assessment and screening of spatial neglect. Acta Neurologica Scandinavica 123, 167–174 (2011)CrossRefGoogle Scholar
  16. 16.
    Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F.J., Marín-Jiménez, M.J.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)CrossRefGoogle Scholar
  17. 17.
    Gigliotta, O., Bartolomeo, P., Miglino, O.: Approaching neuropsychological tasks through adaptive neurorobots. Connect. Sci. 27, 153–163 (2015)CrossRefGoogle Scholar
  18. 18.
    Gigliotta, O., Seidel Malkinson, T., Miglino, O., Bartolomeo, P.: Pseudoneglect in visual search: behavioral evidence and connectional constraints in simulated neural circuitry. eNeuro 4 (2017). eprint:
  19. 19.
    Goodale, M.A., Westwood, D.A., Milner, A.D.: Two distinct modes of control for object-directed action. Prog. Brain Res. 144, 131–144 (2004)CrossRefGoogle Scholar
  20. 20.
    Halligan, P.W., Marshall, J.C.: Left visuo-spatial neglect: a meaningless entity? Cortex 28, 525–535 (1992)CrossRefGoogle Scholar
  21. 21.
    James, M., Warrington, E.: Visual object and space perception battery (VOSP) (1991)Google Scholar
  22. 22.
    Japkowicz, N., Myers, C., Gluck, M., et al.: A novelty detection approach to classification. In: IJCAI, vol. 1, pp. 518–523 (1995)Google Scholar
  23. 23.
    Miglino, O., Ponticorvo, M.: Enhancing multi-sensory and handling-based psycho-pedagogical approaches through new technologies (2018)Google Scholar
  24. 24.
    Mishkin, M., Ungerleider, L.G., Macko, K.A.: Object vision and spatial vision: two cortical pathways. Trends Neurosci. 6, 414–417 (1983)CrossRefGoogle Scholar
  25. 25.
    Osterieth, P.A.: Filetest de copie dune figure complex, contribution B letudede la perception et de la m&moire. Archives de Psychologie 30, 205–353 (1945)Google Scholar
  26. 26.
    Pacella, D., Ponticorvo, M., Gigliotta, O., Miglino, O.: Basic emotions and adaptation. A computational and evolutionary model. PLOS ONE 12, 1–20 (2017)CrossRefGoogle Scholar
  27. 27.
    Parsons, T.D.: Advanced Computational Intelligence Paradigms in Health-Care 6. Virtual Reality in Psychotherapy, Rehabilitation, and Assessment. Studies in Computational Intelligence, vol. 337, pp. 271–289. Springer, Heidelberg (2011). Scholar
  28. 28.
    Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetzbMATHGoogle Scholar
  29. 29.
    Rapcsak, S.Z., Verfaellie, M., Fleet, S., Heilman, K.M.: Selective attention in hemispatial neglect. Arch. Neurol. 46, 178–182 (1989)CrossRefGoogle Scholar
  30. 30.
    Rey, A.: L’examen psychologique dans les cas d’encéphalopathie traumatique. (Les problems.). Archives de psychologie (1941)Google Scholar
  31. 31.
    Rizzolatti, G., Fadiga, L., Fogassi, L., Gallese, V.: The space around us. Science 277, 190–191 (1997)CrossRefGoogle Scholar
  32. 32.
    Tham, K.: The baking tray task: a test of spatial neglect. Neuropsychol. Rehabil. 6, 19–26 (1996)CrossRefGoogle Scholar
  33. 33.
    Urbanski, M., et al.: Négligence spatiale unilatérale: une conséquence dramatique mais souvent négligée des lésions de lhémisphère droit. Revue Neurologique 163, 305–322 (2007)CrossRefGoogle Scholar
  34. 34.
    Wilson, B., Cockburn, J., Halligan, P.: Development of a behavioral test of visuospatial neglect. Arch. Phys. Med. Rehabil. 68, 98–102 (1987)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Humanistic StudiesUniversity of Naples “Federico II”NaplesItaly
  2. 2.Institute of Cognitive Sciences and Technologies, National Research CouncilRomeItaly
  3. 3.Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Institut du Cerveau et de la Moelle épinière, Hôpital de la Pitié-SalpêtriéreParisFrance

Personalised recommendations