Autonomous Robots

, Volume 22, Issue 2, pp 183–198 | Cite as

Robotic smart house to assist people with movement disabilities

  • Kwang-Hyun Park
  • Zeungnam Bien
  • Ju-Jang Lee
  • Byung Kook Kim
  • Jong-Tae Lim
  • Jin-Oh Kim
  • Heyoung Lee
  • Dimitar H. Stefanov
  • Dae-Jin Kim
  • Jin-Woo Jung
  • Jun-Hyeong Do
  • Kap-Ho Seo
  • Chong Hui Kim
  • Won-Gyu Song
  • Woo-Jun Lee
Article

Abstract

This paper introduces a new robotic smart house, Intelligent Sweet Home, developed at KAIST in Korea, which is based on several robotic agents and aims at testing advanced concepts for independent living of the elderly and people with disabilities. The work focuses on technical solutions for human-friendly assistance in motion/mobility and advanced human-machine interfaces that provide simple control of all assistive robotic systems and home-installed appliances. The smart house concept includes an intelligent bed, intelligent wheelchair, and robotic hoist for effortless transfer of the user between bed and wheelchair. The design solutions comply with most of the users’ requirements and suggestions collected by a special questionnaire survey of people with disabilities. The smart house responds to the user's commands as well as to the recognized intentions of the user. Various interfaces, based on hand gestures, voice, body movement, and posture, have been studied and tested. The paper describes the overall system structure and explains the design and functionality of some main system components.

Keywords

Assistive system Smart house Movement assistance Human-friendly interface Intelligent bed Intelligent wheelchair Robotic hoist 

References

  1. Abdulrazak, B., Mokhtari, M., and Grandjean, B. 2001. Toward a new high level controller for Manus robot: The Commanus project. In Proceedings of the 7th International Conference on Rehabilitation Robotics. Evry, France, pp. 221–226.Google Scholar
  2. Access Unlimited. http://www.accessunlimited.com/html/home_lifts. htmlGoogle Scholar
  3. Alihanka, J., Vaahtoranta, K., and Saarikivi, I. 1981. A new method for long-term monitoring of ballistocardiogram, heart rate, and respiration. American Journal of Physiology, 240:384–392.Google Scholar
  4. Aluminum Extrusion. http://www.aec.org/assets/pdf/ShowcaseCeiling Track.pdfGoogle Scholar
  5. AryCare. http://arycare.tripod.comGoogle Scholar
  6. Berlo, A. 1998. A smart model house as research and demonstration tool for telematics development. In Proceedings of the 3rd TIDE Congress. Helsinki, Finland.Google Scholar
  7. Bien, Z., Park, K.-H., Jung, J.-W., and Do, J.-H. 2005. Intention reading is essential in human-friendly interfaces for the elderly and the handicapped. IEEE Transactions on Industrial Electronics, 52(6).Google Scholar
  8. Bien, Z., Chung, M.-J., Chang, P.-H., Kwon, D.-S., Kim, D.-J., Han, J.-S., Kim, J.-H., Kim, D.-H., Park, H.-S., Kang, S.-H., Lee, K., and Lim, S.-C. 2004. Integration of a rehabilitation robotic system (KARES II) with human-friendly man-machine interaction units. Autonomous Robots, 16:165–191.CrossRefGoogle Scholar
  9. Bonner, S. 1998. SMART technology demonstrator site. In Proceedings of the 3rd TIDE Congress. Helsinki, Finland.Google Scholar
  10. Bourhis, G., Horn, O., Habert, O., and Pruski, A. 2001. An autonomous vehicle for people with motor disabilities. IEEE Robotics and Automation Magazine, 8(1):20–28.CrossRefGoogle Scholar
  11. Casals, A., Cufí, X., Portell, E., Merchany, R., and Contijoch, J. 1999. CAPDI: A robotized kitchen for the disabled and elderly. In Assistive Technology at the Threshold of the New Millennium. IOS Press, Amsterdam, The Netherlands, pp. 346–351.Google Scholar
  12. Dario, P., Guglielmelli, E., Laschi, C., and Teti, G. 1999. MOVAID: A personal robot in everyday life of disabled and elderly people. Technology and Disability, 10:55–71.Google Scholar
  13. Denissen, G. 2001. Domotics in housing projects for older persons to prolong independence and increase the quality of life. In C. Marinček, C. Bühler, H. Knops, and R. Andrich (eds.), Assistive Technology—Added Value to the Quality of Life. IOS Press, Amsterdam, The Netherlands, pp. 293–299.Google Scholar
  14. Do, J.-H., Park, K.-H., Bien, Z., Park, K.C., Oh, Y.T., and Kang, D.H. 2001. A development of emotional interactive robot. In The 32nd International Symposium on Robotics. Seoul, Korea, pp. 544–549.Google Scholar
  15. Elger, G. and Furugren, B. 1998. SmartBO—An ICT and computer-based demonstration home for disabled. In Proceedings of the 3rd TIDE Congress. Helsinki, Finland.Google Scholar
  16. Feki, M.-A., Ghorbel, M., Hariz, M., Abdulrazak, B., Granjean, B., and Mokhtari, M. 2004. Dynamicity in smart homes concept applied to complex system: The Manus robot. In Proceedings of the 2nd International Conference on Smart Homes and Health Telematics. Singapore, pp. 253–260.Google Scholar
  17. Ghorbel, M., Segarra, M.-T., Kerdreux, J., Thepaut, A., and Mokhtari, M. 2004. Networking and communication in smart home for people with disabilities. In Proceedings of the 9th International Conference on Computers Helping People with Special Needs. Paris, France, pp. 937–944.Google Scholar
  18. Hamagami, T. and Hirata, H. 2004. Development of intelligent wheelchair acquiring autonomous, cooperative, and collaborative behavior. In IEEE International Conference on Systems, Man and Cybernetics. The Hague, The Netherlands, pp. 3525–3530.Google Scholar
  19. Hammond, J., Sharkey, P., and Foster, G. 1996. Integrating augmented reality with home systems. In Proceedings of the 1st International Conference on Disability, Virtual Reality and Associated Technologies, pp. 57–66.Google Scholar
  20. Harada, T., Sato, T., and Mori, T. 2002. Estimation of bed-ridden human's gross and slight movement based on pressure sensors distribution bed. In IEEE International Conference on Robotics and Automation, pp. 3795–3800.Google Scholar
  21. Haykin, S. 1999. Neural Networks: A Comprehensive Foundation, 2nd Edition, Prentice HallGoogle Scholar
  22. Johnson, M.J., Guglielmelli, E., Di Lauro, G.A., Laschi, C., Carrozza, M.C., and Dario, P. 2004. GIVING-A-HAND system: The development of a task-specific robot appliance. In Z.Z. Bien, and D. Stefanov (eds.) Advances in Rehabilitation Robotics: Human-friendly Technologies on Movement Assistance and Restoration for People with Disabilities. Springer, Berlin, Germany, pp. 127–141.Google Scholar
  23. Kang, D.-O., Kim, S.-H., Lee, H., and Bien, Z. 2001. Multiobjective navigation of a guide mobile robot for the visually impaired based on intention inference of obstacles. Autonomous Robots, 10:213–230.MATHCrossRefGoogle Scholar
  24. Kawarada, A., Tsukada, A., Sasaki, K., Ishijimaz, M., Tamura, T., Togawa, T., and Yamakoshi, K. 1999. Automated monitoring system for home health care. In Proceedings of the 1st Joint BMES/EMBS Conference: Serving Humanity Advancing Technology. Atlanta, GA, USA.Google Scholar
  25. Kim, C.H., Kim, S.J., Kim, H.S., and Kim, B.K. 2005. Robotic wheelchair system for transfer aid with robust localization in complex indoor environment. In Proceedings of the 6th International Workshop on Human-friendly Welfare Robotic Systems. Daejeon, Korea, pp. 237–244.Google Scholar
  26. Kim, Y., Park, K.-H., Bang, W.-C., Han, J.-S., Kim, M.-J., and Bien, Z. 2002. Development of intelligent bed robot system for the elderly and the disabled. International Journal of Human-friendly Welfare Robotic Systems, 3(2):17–22.Google Scholar
  27. Kim, Y., Park, K.-H., Seo, K.-H., Kim, C.H., Lee, W.-J., Song, W.-G., Do, J.-H., Lee, J.-J., Kim, B.K., Kim, J.-O., Lim, J.-T., and Bien, Z. 2003. A report on questionnaire for developing Intelligent Sweet Home for the disabled and the elderly in Korean living conditions. In Proceedings of the 8th International Conference on Rehabilitation Robotics. Daejeon, Korea, pp. 171–174.Google Scholar
  28. Kohler, M. 1996. Vision base remote control in intelligent home environments. In Proceedings of 3D Image Analysis and Synthesis ‘96, pp. 147–154.Google Scholar
  29. Levine, S.P., Bell, D.A., Jaros, L.A., Simpson, R.C., Korean, Y., and Borenstein, J. 1999. The NavChair assistive wheelchair navigation system. IEEE Transactions on Rehabilitation Engineering, 7(4):443–451.CrossRefGoogle Scholar
  30. Lieberman, H. and Selker, T. 2000. Out of context: Computer systems that adapt to, and learn from, context. IBM Systems Journal, 39(3&4):617–632.CrossRefGoogle Scholar
  31. Mazo, M. 2001. An integral system for assisted mobility. IEEE Robotics and Automation Magazine, 8(1):46–56.CrossRefGoogle Scholar
  32. Mokhtari, M., Feki, M.A., Abdulrazak, B., Rodriguez, R., and Granjean, B. 2004. Toward a human-friendly user interface to control an assistive robot in the context of smart homes. In Z.Z. Bien, and D. Stefanov (eds.), Advances in Rehabilitation Robotics: Human-friendly Technologies on Movement Assistance and Restoration for People with Disabilities. Springer, Berlin, Germany, pp. 47–56.Google Scholar
  33. Moon, I., Lee, M., Ryu, J., and Mun, M. 2003. Intelligent robotic wheelchair with EMG-, Gesture-, and Voice-based Interfaces. In Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3453–3458.Google Scholar
  34. Nakata, T., Sato, T., Mizoguchi, H., and Mori, T. 1996. Synthesis of robot-to-human expressive behavior for human-robot symbiosis. In Proceedings of the 1996 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1608–1613.Google Scholar
  35. NorthStar. http://www.evolution.com/products/northstar, Evolution Robotics, Inc.Google Scholar
  36. O’Rourke, J. and Badler, N.I. 1980. Model-based image analysis of human motion using constraint propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2(6):522–536.Google Scholar
  37. Orpwood, R., Adlam, T., Gibbs, C., and Hagan, S. 2001. User-centred design of support devices for people with dementia for use in a smart house. In C. Marinček, C. Bühler, H. Knops, and R. Andrich (eds.), Assistive Technology—Added Value to the Quality of Life. IOS Press, Amsterdam, The Netherlands, pp. 314–318.Google Scholar
  38. Perzanowski, D., Schultz, A.C., Adams, W., Marsh, E., and Bugajska, M. 2001. Building a multimodal human-robot interface. IEEE Intelligent Systems, 16(1):16–21.CrossRefGoogle Scholar
  39. Prassler, E., Scholz, J., and Fiorini, P. 2001. A robotics wheelchair for crowded public environment. IEEE Robotics and Automation Magazine, 8(1):38–45.CrossRefGoogle Scholar
  40. Pries, G., Araúo, R., Nunes, U., and Almeida, A.T. 1998. ROBCHAIR—A powered wheelchair using a behaviour-based navigation. In Proceedings of the 5th International Workshop on Advanced Motion Control. Coimbra, Portugal, pp. 536–541.Google Scholar
  41. Rehg, J. and Kanade, T. 1994. Visual tracking of high DOF articulated structures: An application to human hand tracking. In Proceedings of the 3rd European Conference on Computer Vision, pp. 35–46.Google Scholar
  42. Seo, K.-H., Oh, C., and Lee, J.-J. 2004. Intelligent bed robot system: Pose estimation using pressure sensing mattress. International Journal of Human-friendly Welfare Robotic Systems, 5(3):17–22.Google Scholar
  43. Simpson, R., LoPresti, E., Hayashi, S., Nourbakhsh, I., and Miller, D. 2004. The smart wheelchair component system. Journal of Rehabilitation Research & Development, 41(3B):429–442.CrossRefGoogle Scholar
  44. Smart Homes. http://www.smart-homes.nl/engels/infonet/projects.htmlGoogle Scholar
  45. Song, W.-K., Lee, H., and Bien, Z. 1999. KARES: Intelligent wheelchair-mounted robotic arm system using vision and force sensor. Robotics and Autonomous Systems, 28(1):83–94.CrossRefGoogle Scholar
  46. Stefanov, D.H., Bien, Z., and Bang, W.-C. 2004. The smart house for older persons and persons with physical disabilities: Structure, technology arrangements, and perspectives. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 12(2):228–250.CrossRefGoogle Scholar
  47. Tamura, T., Jhou, J., Mizukami, H., and Togawa, T. 1993. A system for monitoring temperature distribution in bed and its application to the assessment of body movement. Physiological Measurement, 14:33–41.CrossRefGoogle Scholar
  48. Thrun, S. Bennewitz, M., Burgard, W., Cremers, A.B., Dellaert, F., Fox, D., Hähnel, D., Rosenberg, C., Roy, N., Schulte, J., and Schulz, D. 1999. MINERVA: A second-generation museum tour-guide robot. In IEEE International Conference on Robotics and Automation, pp. 1999–2005.Google Scholar
  49. Van der Loos, H.F.M., Ullrich, N., and Kobayashi, H. 2003. Development of sensate and robotic bed technologies for vital signs monitoring and sleep quality improvement. Autonomous Robots, 15:67–79.CrossRefGoogle Scholar
  50. Vermeulen, C. and Berlo, A. 1997. A model house as platform for information exchange on housing. In J. Graafmans, V. Taipale, and N. Charness (eds.), Gerontechnology: A Sustainable Investment of the Future. IOS Press, Amsterdam, The Netherlands, pp. 337–339.Google Scholar
  51. VoiceEz. http://voiceware.co.kr/english/products/ez.htmlGoogle Scholar
  52. West, G., Newman, C., and Greenhill, S. 2005. Using a camera to implement virtual sensors in a smart house. In S. Giroux, and H. Pigot (eds.), From Smart Homes to Smart Care. IOS Press, Amsterdam, The Netherlands, pp. 83–90.Google Scholar
  53. Wren, C.R., Clarkson, B.P., and Pentland, A.P. 2000. Understanding purposeful human motion. In IEEE International Conference on Automatic Face and Gesture Recognition, pp. 378–383.Google Scholar
  54. Yanco, H.A. 1998. Wheelesley, a robotic wheelchair system: Indoor navigation and user interface. In Lecture Notes in Artificial Intelligence: Assistive Technology and Artificial Intelligence. Springer-Verlag, pp. 256–268.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2006

Authors and Affiliations

  • Kwang-Hyun Park
    • 1
  • Zeungnam Bien
    • 1
  • Ju-Jang Lee
    • 1
  • Byung Kook Kim
    • 1
  • Jong-Tae Lim
    • 1
  • Jin-Oh Kim
    • 2
  • Heyoung Lee
    • 3
  • Dimitar H. Stefanov
    • 4
    • 5
  • Dae-Jin Kim
    • 6
  • Jin-Woo Jung
    • 7
  • Jun-Hyeong Do
    • 1
  • Kap-Ho Seo
    • 1
  • Chong Hui Kim
    • 1
  • Won-Gyu Song
    • 1
  • Woo-Jun Lee
    • 2
  1. 1.Department of Electrical Engineering and Computer ScienceKorea Advanced Institute of Science and TechnologyYuseong-guRepublic of Korea
  2. 2.Department of Information and Control EngineeringKwangwoon UniversityNowon-guRepublic of Korea
  3. 3.Department of Control and Instrumentation EngineeringSeoul National University of TechnologyNowon-guRepublic of Korea
  4. 4.Cardiff & Vale NHS TrustRehabilitation Engineering UnitCardiffUK
  5. 5.Institute of MechanicsBulgarian Academy of SciencesSofiaBulgaria
  6. 6.Department of Computer Engineering and Computer ScienceUniversity of LouisvilleLouisvilleUSA
  7. 7.Department of Computer EngineeringDongguk UniversityChung-guRepublic of Korea

Personalised recommendations