From Dialogue Management to Pervasive Interaction Based Assistive Technology

  • Yong Lin
  • Fillia Makedon
Part of the Intelligent Systems Reference Library book series (ISRL, volume 26)


Dialogue management system is originated when human-computer interaction (HCI) was dominated by a single computer. With the development of sensor networks and pervasive techniques, the HCI has to adapt into pervasive environments. Pervasive interaction is a form of HCI derived under the context of pervasive computing. This chapter introduces a pervasive interaction based planning and reasoning system for individuals with cognitive impairment, for their activities of daily living. Our system is a fusion of speech prompt, speech recognition as well as events from sensor networks. The system utilizes Markov decision processes for activity planning, and partially observable Markov decision processes for action planning and executing. Multimodal and multi-observation is the characteristics of a pervasive interaction system. Experimental results demonstrate the flexible effect the reminder system works for activity planning.


Sensor Network Activity Recognition Markov Decision Process Belief State Sensor Event 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Boger, J., Poupart, P., Hoey, J., Boutilier, C., Fernie, G., Mihailidis, A.: A decision-theoretic approach to task assistance for persons with dementia. In: Proceedings of IJCAI, pp. 1293–1299 (2005)Google Scholar
  2. 2.
    Broz, F., Nourbakhsh, I.R., Simmons, R.G.: Planning for human-robot interaction using time-state aggregated POMDPs. In: Proceedings of AAAI, pp. 1339–1344 (2008)Google Scholar
  3. 3.
    Holz, T., Dragone, M., O’Hare, G.M.P.: Where robots and virtual agents meet. I. J. Social Robotics 1(1), 83–93 (2009)CrossRefGoogle Scholar
  4. 4.
    Kawanaka, D., Okatani, T., Deguchi, K.: HHMM based recognition of human activity. Transactions Institute Elec. Info. and Comm. Eng. E89-D(7), 2180–2185 (2006)Google Scholar
  5. 5.
    Kelley, R., Tavakkoli, A., King, C., Nicolescu, M., Nicolescu, M., Bebis, G.: Understanding human intentions via hidden markov models in autonomous mobile robots. In: Proc. of the 3rd ACM/IEEE International Conference on Human Robot Interaction, pp. 367–374 (2008)Google Scholar
  6. 6.
    Lee, H.-E., Kim, Y., Park, K.-H., Bien, Z.Z.: Development of a steward robot for human-friendly interaction. In: Control Applications (CCA), pp. 551–556 (2006)Google Scholar
  7. 7.
    Mühlenbrock, M., Brdiczka, O., Snowdon, D., Meunier, J.-L.: Learning to detect user activity and availability from a variety of sensor data. In: Proceedings of the Second IEEE International Conference on Pervasive Computing and Communications, p. 13 (2004)Google Scholar
  8. 8.
    Natarajan, S., Tadepalli, P., Fern, A.: A relational hierarchical model for decision-theoretic assistance. In: Blockeel, H., Ramon, J., Shavlik, J., Tadepalli, P. (eds.) ILP 2007. LNCS (LNAI), vol. 4894, pp. 175–190. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  9. 9.
    Pineau, J., Roy, N., Thrun, S.: A hierarchical approach to pomdp planning and execution. In: Workshop on Hierarchy and Memory in Reinforcement Learning, ICML (2001)Google Scholar
  10. 10.
    Pollack, M.: Intelligent technology for an aging population: The use of AI to assist elders with cognitive impairment. AI Magazine 26(2), 9–24 (2005)Google Scholar
  11. 11.
    Pollack, M.E.: Planning technology for intelligent cognitive orthotics. In: Proceedings of the Sixth International Conference on Artificial Intelligence Planning Systems (AIPS), p. 322 (2002)Google Scholar
  12. 12.
    Singh, S., Cohn, D.: How to dynamically merge markov decision processes. In: Proceedings of NIPS, Denver, Colorado, United States, pp. 1057–1063 (1998)Google Scholar
  13. 13.
    Vail, D.L., Veloso, M.M., Lafferty, J.D.: Conditional random fields for activity recognition. In: Proceedings of AAMAS, Honolulu, Hawaii, pp. 1–8 (2007)Google Scholar
  14. 14.
    Youngblood, G.M., III, E.O.H., Cook, D.J., Holder, L.B.: Automated hpomdp construction through data-mining techniques in the intelligent environment domain. In: FLAIRS Conference, pp. 194–200 (2005)Google Scholar

Copyright information

© IFIP 2012

Authors and Affiliations

  • Yong Lin
    • 1
  • Fillia Makedon
    • 1
  1. 1.Department of Computer Science and EngineeringThe University of Texas at ArlingtonArlingtonUSA

Personalised recommendations