Intelligent Decision-Support in Virtual Reality Healthcare and Rehabilitation

  • A. L. Brooks
Part of the Studies in Computational Intelligence book series (SCI, volume 326)


Intelligent Decision-Support (IDS) mechanisms to improve an ‘in-action’ facilitator intervention model and ‘on-action’ evaluation and refinement model are proposed for contemporary Virtual Reality Healthcare & Rehabilitation training. The ‘Zone of Optimized Motivation’ (ZOOM) model and the ‘Hermeneutic Action Research Recursive Reflection’ model have emerged from a body of virtual reality research called SoundScapes. The work targets all ages and all abilities through gesture-control of responsive multimedia within Virtual Interactive Space (VIS). VIS is an interactive information environment at the core of an open-ended custom system where unencumbered residual function manipulates selected audiovisual and robotic feedback that results in afferent-efferent neural feedback loop closure. Such loop closure is hypothesized as the reason why such interactive system environments are so effective in the context of rehabilitation and healthcare. The approach is adaptive across the range of dysfunction, from the most profoundly disabled to traditionally developed. This proposal considers enhancing VIS data exchange, i.e. human input information matched to responsive content, through dynamic decision-support of adjustment of difficulty encountered. To date facilitator role has included manual parameter manipulation of interface to affect an invisible active zone quality (typically, sensitivity or location) and/or content quality. Inaction human adjustment-decisions are according to interpretation of user state and engagement. Questioned is whether automated support for such decisions is feasible so that dynamic difficulty adjustment (DDA) of that which is encountered by the user is considered optimal to goal. Core issues are presented to detail and justify the concept. Findings are related to current trends with conclusions reflecting on potential impact.


Afferent-Efferent Neural Feedback Loop Closure Gesture-control Sensor-based Interactivity Virtual Reality Healthcare & Rehabilitation Virtual Interactive Space (VIS) Dynamic Difficulty Adjustment (DDA) 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alvesson, M., Sköldberg, K.: Tolkning och reflection: Vetenskapfilosofi och kvalitativ metod. Studentlitteratur, Swedish, Lund (1994)Google Scholar
  2. 2.
    Amabile, T.M.: The social psychology of creativity. Springer, New York (1983)Google Scholar
  3. 3.
    Amabile, T.M.: Creativity in context: Update to the Social Psychology of Creativity. Westview, Boulder (1996)Google Scholar
  4. 4.
    Bailey, C., Pearson, E.: The Nintendo Wii Games Console and its potential for Supporting Disabled Learners in Education. In: Bastiaens, T., Carliner, S. (eds.) Proc. of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, pp. 213–217 (2007)Google Scholar
  5. 5.
    Boud, D., Keogh, R., Walker, D.: Reflection: Turning Experience Into Learning. Routledge, London (1985)Google Scholar
  6. 6.
    Brooker, R., Macpherson, I., Aspland, T.: Enriching the outcomes of action research: Connecting the local with the global through a hermeneutic spiral. Queensland Journal of Educational Research 17(1), 16–28 (2001)Google Scholar
  7. 7.
    Brooks, A.L.: Virtual interactive space (V.I.S.) as a movement capture interface tool giving multimedia feedback for treatment and analysis. In: Proc. World Confederation for Physical therapy, p. 66 (1999)Google Scholar
  8. 8.
    Brooks, A.L., Hasselblad, S.: Creating aesthetically resonant environments for the handicapped, elderly and rehabilitation: Sweden. In: Proc. 6th International Conference on Disability, Virtual Reality and Associated Technologies, pp. 191–198 (2004)Google Scholar
  9. 9.
    Brooks, A.L., Petersson, E.: Play Therapy Utilizing the Sony EyeToy®. In: Slater, M. (ed.) Annual International Workshop on Presence (8th), Presence2005, pp. 303–314. University College London, London (2005)Google Scholar
  10. 10.
    Brooks, A.L., Sorensen, C.: Communication Method and Apparatus. USPTO Patent Full-Text and Image Database: Patent number US 6,893,407 (2005)Google Scholar
  11. 11.
    Brooks, A.L., Hasselblad, S., Camurri, A., Canagarajah, N.: Interaction with shapes and sounds as a therapy for special needs and rehabilitation. In: Proc. 4th Int. Conference on Disability, Virtual Reality, and Associated Technologies, Veszprém, Hungary, pp. 205–212 (2002)Google Scholar
  12. 12.
    Byrne, R.W.: The Thinking Ape. Evolutionary Origins of Intelligence. Oxford University Press, Oxford (1995)Google Scholar
  13. 13.
    Byrne, R.W., et al.: Learning by imitation: A hierarchical approach. Behavioral and Brain Sciences 21(5), 667–721 (1998)MathSciNetGoogle Scholar
  14. 14.
    Christensen, A.-L., Uzzell, B.P. (eds.): International Handbook of Neuropsychological Rehabilitation. Springer, New York (1999)Google Scholar
  15. 15.
    Csíkszentmihályi, M.: Creativity: Flow and the Psychology of Discovery and Invention. Harper Collins, New York (1997)Google Scholar
  16. 16.
    Csíkszentmihályi, M.: Flow: The classic work on how to achieve happiness. Random House, London (2002)Google Scholar
  17. 17.
    Csíkszentmihályi, M.: Flow: the Psychology of Optimal Experience. Harper Perennial, New York (1991)Google Scholar
  18. 18.
    Curry, A.: Action Research in Action: Involving Students and Professionals. In: World Library and Information Congress: 71th IFLA General Conference and Council (2005)Google Scholar
  19. 19.
    Dunst, C.J.: An integrated framework for practicing early childhood intervention and family support. Perspectives in Education 22(2), 1–16 (2004)Google Scholar
  20. 20.
    Dvorkin, A.Y., Shahar, M., Weiss, P.L.: Reaching within Video-Capture Virtual Reality: Using Virtual Reality as a Motor Control Paradigm. CyberPsychology and Behavior 9(2), 133–136 (2006)CrossRefGoogle Scholar
  21. 21.
    Eaglestone, B., Bamidis, P.D.: Music composition for the multi-disabled: A systems perspective. Disab. Human Develop. 7(1), 19–24 (2008)Google Scholar
  22. 22.
    Eden, C., Huxham, C.: Action research for management research. British Journal of Management 7, 75–86 (1996)CrossRefGoogle Scholar
  23. 23.
    Ellis, P.: Moving Sound. In: MacLachlan, M., Gallagher, P. (eds.) Enabling Technologies in Rehabilitation: Body Image and Body Function, Churchill Livingstone, Oxford, pp. 59–75 (2004)Google Scholar
  24. 24.
    Ellis, P., Van Leeuwen, L., Brown, K.: Visual-Music Vibrations Improving quality of life for the elderly and children with special needs. Digital Creativity 19(3), 194–202 (2008)CrossRefGoogle Scholar
  25. 25.
    Frisoli, A., Camurri, A.: Multisensory interaction in virtual environments. Virtual Reality 10(1), 2–3 (2006)CrossRefGoogle Scholar
  26. 26.
    Gadamer, H.G.: Truth and Method, 2nd edn. Continuum International, London (1989)Google Scholar
  27. 27.
    Gaver, W., Bowers, J., Boucher, A., Gellerson, H., Pennington, S., Schmidt, A., Steed, A., Villar, N., Walker, B.: The Drift Table: Designing for ludic engagement. In: Proc. CHI 2004 Design Expo. ACM Press, New York (2004)Google Scholar
  28. 28.
    Gray, C., Malins, J.: Visualizing Research: A Guide to the Research process in Art and Design. Ashgate, Aldershot (2004)Google Scholar
  29. 29.
    Halton, J.: Virtual rehabilitation with video games: A new frontier for occupational therapy. Occupational Therapy Now 10(1), 12–14 (2008), MathSciNetGoogle Scholar
  30. 30.
    Izard, C.: Human Emotions. Plenum, New York (1977)Google Scholar
  31. 31.
    Kemmis, S., McTaggart, R.: Participatory action Research. In: Denzin, N.K., Lincoln, Y.S. (eds.) The Handbook of Qualitative Research, 2nd edn., pp. 567–606. Sage, London (2000)Google Scholar
  32. 32.
    Kreppner, K.: William L. Stern, 1871–1938: A Neglected Founder of Developmental Psychology. Developmental Psychology 28(4), 539–547 (1992)CrossRefGoogle Scholar
  33. 33.
    Lampton, D.R., Bliss, J.P., Morris, C.S.: Human Performance Measurement in Virtual Environments. In: Stanney, K.M. (ed.) Handbook of Virtual Environments: Design, Implementation, and Applications, pp. 701–720. LEA, New Jersey (2002)Google Scholar
  34. 34.
    Lopes-dos-Santos, P., Teixeira, L.M., Silva, M., Azeredo, M., Barbosa, M.: Exploring interpersonal dynamics between adults and motor disabled children within aesthetic resonant environments. In: Cobb, S., Brooks, A.L., Sharkey, P.M., Merrick, J. (eds.) International Journal on Disability and Human Development, vol. 5(2), pp. 133–139 (2006)Google Scholar
  35. 35.
    Mahoney, M.J.: Human change processes. Basic Books, New York (1991)Google Scholar
  36. 36.
    McNiff, J., Whitehead, J.: Action Research: Living Theory. Sage, London (2006)Google Scholar
  37. 37.
    Patton, M.: Qualitative evaluation and research methods. Sage, Thousand Oaks (1990)Google Scholar
  38. 38.
    Patton, M.: Utilization-focused evaluation: The new century text. Sage, Thousand Oaks (1997)Google Scholar
  39. 39.
    Petersson, E.: Non-Formal Learning Through Ludic Engagement within Interactive Environments. [Doctoral Thesis] ‘Malmö Studies in Educational Sciences’, Malmö högskola, Lärarutbildningen / Lund University, Sweden (2006)Google Scholar
  40. 40.
    Pollini, A.: Experimenting with an Ubiquitous Computing Open Architecture. [Doctoral Thesis, Telematica e Società dell ‘Informazione Cicle XX. Uni. of Florence and Uni. of Siena] (2008),
  41. 41.
    Raab, M., Dunst, C.J.: Influence of child interests on variations in child behavior and functioning. Bridges 4(4), 1–22 (2006)Google Scholar
  42. 42.
    Rand, D., Kizony, R., Feintuch, U., Katz, N., Josman, N., Rizzo, A., Weiss, P.L.: Comparison of Two VR Platforms for Rehabilitation: Video Capture versus HMD. Presence: Teleoperators & Virtual Environments 14(2), 147–160 (2005)CrossRefGoogle Scholar
  43. 43.
    Rand, D., Kizony, R., Weiss, P.L.: Virtual reality rehabilitation for all: Vivid GX versus Sony PlayStation II EyeToy. In: Sharkey, P., McCrindle, R., Brown, D. (eds.) International Conference on Disability, Virtual Reality and Associated Technologies, pp. 87–94. University of Reading, Reading (2004)Google Scholar
  44. 44.
    Reason, P., Bradbury, H. (eds.): Handbook of Action Research. Sage, London (2001)Google Scholar
  45. 45.
    Renninger, K.A.: Individual interest and its implications for understanding intrinsic motivation. In: Sansone, C., Harackiewicz, J.M. (eds.) Intrinsic and Extrinsic Motivation: The Search for Optimal Motivation and Performance, pp. 373–404. Academic Press, San Diego (2000)CrossRefGoogle Scholar
  46. 46.
    Rizzo, A., Kim, G.: A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy. Presence 14(2), 119–146 (2005)CrossRefGoogle Scholar
  47. 47.
    Rizzolatti, G., Arbib, M.A.: From grasping to speech: imitation might provide a missing link: [Reply]. Trends in Neurosciences 22(4), 52 (1999)Google Scholar
  48. 48.
    Rizzolatti, G., Arbib, M.A.: Language within our grasp. Trends Neurosci. 21, 188–194 (1998)CrossRefGoogle Scholar
  49. 49.
    Rogoff, B.: Becoming a Cooperative Parent in a Parent Cooperative. In: Rogoff, B., Goodman Turkanis, C., Bartlett, L. (eds.) Learning Together, Oxford University Press, New York (2001)Google Scholar
  50. 50.
    Rogoff, B.: The cultural nature of human development. Oxford University Press, New York (2003)Google Scholar
  51. 51.
    Rosenbaum, P., King, S., Law, M., King, G., Evans, J.: Family-centered services: A conceptual framework and research review. Physical and Occupational Therapy in Pediatrics 18(1), 1–20 (1998)Google Scholar
  52. 52.
    Schleirmacher, F.: Hermeneutics: The Handwritten Manuscripts. Scholars Press, Missoula, (1977, 1996) Google Scholar
  53. 53.
    Schön, D.: The Reflective Practitioner – How professionals think in action. Basic Books, New York (1983)Google Scholar
  54. 54.
    Schön, D.: Educating the Reflective Practitioner. Josey-Bass, San Francisco (1987)Google Scholar
  55. 55.
    Steels, L.: The Autotelic Principle. In: Iida, F., Pfeifer, R., Steels, L., Kuniyoshi, Y. (eds.) Embodied Artificial Intelligence. LNCS (LNAI), vol. 3139, pp. 231–242. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  56. 56.
    Sternberg, R.J.: Handbook of Creativity, 8th edn., Cambridge, New York (2005)Google Scholar
  57. 57.
    Thorpe, W.H.: Learning and Instinct in Animals, 2nd edn. Methuen and Company, London (1963)Google Scholar
  58. 58.
    Varela, F., Thompson, E., Rosch, E.: The embodied mind. MIT, Cambridge (1991)Google Scholar
  59. 59.
    Weiss, P.L., Kedar, R., Shahar, M.: TIES that BIND: An Introduction to Domain Mapping as a Visualization Tool for Virtual Rehabilitation. CyberPsychology and Behavior 9(2), 114–122 (2006)CrossRefGoogle Scholar
  60. 60.
    Whiten, A.: Imitation of the Sequential Structure of Actions by Chimpanzees (Pan troglodytes). J. Comp. Psychol. 112, 270–281 (1998)CrossRefGoogle Scholar
  61. 61.
    Wood, D.J., Bruner, J.S., Ross, G.: The role of tutoring in problem solving. Journal of Child Psychiatry and Psychology 17(2), 89–100 (1976)CrossRefGoogle Scholar
  62. 62.
    Yan, Z., Fischer, K.: Dynamic growth modeling of human cognitive microdevelopment. In: Proc. 2nd International Conference on Development and Learning, pp. 221–227 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • A. L. Brooks
    • 1
  1. 1.Esbjerg Technical Institute, SensoramaLabAalborg UniversityEsbjergDenmark

Personalised recommendations