Skip to main content

Spatial Tangible User Interfaces for Cognitive Assessment and Training

  • Conference paper
Biologically Inspired Approaches to Advanced Information Technology (BioADIT 2004)

Abstract

This paper discusses Tangible User Interfaces (TUIs) and their potential impact on cognitive assessment and cognitive training. We believe that TUIs, and particularly a subset that we dub spatial TUIs, can extend human computer interaction beyond some of its current limitations. Spatial TUIs exploit human innate spatial and tactile ability in an intuitive and direct manner, affording interaction paradigms that are practically impossible using current interface technology. As proof-of-concept we examine implementations in the field of cognitive assessment and training. In this paper we use Cognitive Cubes, a novel TUI we developed, as an applied test bed for our beliefs, presenting promising experimental results for cognitive assessment of spatial ability, and possibly for training purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fjeld, M., Bichsel, M., Rauterberg, M.: BUILD-IT: A Brick-Based Tool for Direct Interaction. In: Harris, D. (ed.) Engineering Psychology and Cognitive Ergonomics (EPCE), vol. 4, pp. 205–212. Ashgate, Hampshire (1999), http://www.iha.bepr.ethz.ch/pages/leute/fjeld/publications/EPCEbuildit.pdf

    Google Scholar 

  2. Fjeld, M., Lauche, K., Bichsel, M., Voorhorst, F., Krueger, H., Rauterberg, M.: Physical and Virtual Tools: Activity Theory Applied to the Design of Groupware. In: Computer Supported Cooperative Work, pp. 153–180. Kluwer Academic Publishers, Netherlands (2002)

    Google Scholar 

  3. Groth-Marnat, G.: Handbook of Psychological Assessment, 3rd edn. John Wiley & Sons, New York (1997)

    Google Scholar 

  4. Kirsh, D., Maglio, P.: On Distinguishing Epistemic from Pragmatic Action. Cognitive Science 18, 513–549 (1994)

    Article  Google Scholar 

  5. Kitamura, Y., Itoh, Y., Kishino, F.: Real-Time 3D Interaction with ActiveCube. In: Short Talks, in Extended Abstracts, Human Factors in Computing Systems CHI 2001, Seattle, Washington, USA, March 2001, pp. 355–356 (2001)

    Google Scholar 

  6. Lezak, M.D.: Neuropsychological Assessment. Oxford UP, New York (1983)

    Google Scholar 

  7. Meichenbaum, D., Cameron, R.: Issues in Cognitive Assessment: An Overview. In: Merluzzi, T.V., Glass, C.R., Genest, M. (eds.) Cognitive Assessment, The Guilford Press, New York (1981)

    Google Scholar 

  8. Norman, D.A.: The Psychology of Everyday Things. Basic Books, New York (1988)

    Google Scholar 

  9. Rizzo, A.A., Bowerly, T., Buckwalter, J.G., Schultheis, M.T.: Virtual Environments for the Assessment of Attention and Memory Processes: Results from the Virtual Classroom and Office. In: Proceedings of the International Conference on Disability, Virtual Reality and Associated Technology, Vesaprem, Hungary (September 2002), http://dimlab.usc.edu/DocsDemos/ICDVRAT2002.pdf

  10. Rizzo, A.A., Buckwalter, J.G.: Virtual Reality and Cognitive Assessment and Rehabilitation: The State of the Art. In: Riva, G. (ed.) Virtual Reality in Neuro-Psycho-Physiology: Cognitive, Clinical and Methodological Issues in Assessment and Rehabilitation, pp. 123–146. IOS Press, Amsterdam (1997)

    Google Scholar 

  11. Rizzo, A.A., Buckwalter, J.G.: Special Issue: Virtual Reality Applications in Neuropsychology. Guest Editor’s Introduction. Presence: Teleoperators and Virtual Environments 10(4) (August 2001)

    Google Scholar 

  12. Rizzo, A.A., Buckwalter, J.G., McGee, J.S., Bowerly, T., van der Zaag, C., Neumann, U., Thiebaux, M., Kim, L., Pair, J., Chua, C.: Virtual Environments for Assessing and Rehabilitating Cognitive/Functional Performance - A Review of Projects at the USC Integrated Media Systems Center. Presence: Teleoperators and Virtual Environments 10(4), 359–374 (2001)

    Article  Google Scholar 

  13. Schultheis, M.T., Rizzo, A.A.: The Application of Virtual Reality Technology for Rehabilitation. Rehabilitation Psychology 46(3), 296–311 (2001)

    Article  Google Scholar 

  14. Sharlin, E., Itoh, Y., Watson, B.A., Kitamura, Y., Sutphen, S., Liu, L.: Cognitive Cubes: A Tangible User Interface for Cognitive Assessment. In: Human Factors in Computing Systems CHI 2002, April 2002, pp. 347–354. ACM, Minneapolis (2002)

    Google Scholar 

  15. Shepard, R.N., Metzler, J.: Mental Rotation of Three-Dimensional Objects. Science 171, 701–703 (1971)

    Article  Google Scholar 

  16. Sternberg, R.: “Intelligence and Lifelong Learning: What’s New and How Can We Use It? American Psychologist 52(10), 1134–1139 (1997)

    Article  Google Scholar 

  17. Ullmer, B., Ishii, H.: Emerging Frameworks for Tangible User Interfaces. In: Carroll, J.M. (ed.) Human Computer Interaction in the New Millennium, pp. 579–601. Addison-Wesley, Reading (2001)

    Google Scholar 

  18. Vandenberg, S.G., Kuse, A.R.: Mental Rotations: A Group Test of Three-Dimensional Spatial Visualization. Perceptual and Motor Skills 47, 599–604 (1978)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sharlin, E. et al. (2004). Spatial Tangible User Interfaces for Cognitive Assessment and Training. In: Ijspeert, A.J., Murata, M., Wakamiya, N. (eds) Biologically Inspired Approaches to Advanced Information Technology. BioADIT 2004. Lecture Notes in Computer Science, vol 3141. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27835-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-27835-1_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23339-8

  • Online ISBN: 978-3-540-27835-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics