Advertisement

Advanced User Assistance for Setting Up a Home Theater

  • Pascal Bercher
  • Felix Richter
  • Thilo Hörnle
  • Thomas Geier
  • Daniel Höller
  • Gregor Behnke
  • Florian Nielsen
  • Frank Honold
  • Felix Schüssel
  • Stephan Reuter
  • Wolfgang Minker
  • Michael Weber
  • Klaus Dietmayer
  • Susanne Biundo
Chapter
Part of the Cognitive Technologies book series (COGTECH)

Abstract

In many situations of daily life, such as in educational, work-related, or social contexts, one can observe an increasing demand for intelligent assistance systems. In this chapter, we show how such assistance can be provided in a wide range of application scenarios—based on the integration of user-centered planning with advanced dialog and interaction management capabilities. Our approach is demonstrated by a system that assists a user in the task of setting up a complex home theater. The theater consists of several hi-fi devices that need to be connected with each other using the available cables and adapters. In particular for technically inexperienced users, the task is quite challenging due to the high number of different ports of the devices and because the used cables might not be known to the user. Support is provided by presenting a detailed sequence of instructions that solves the task.

Notes

Acknowledgements

This work is done within the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” funded by the German Research Foundation (DFG). We also want to thank our former colleagues Gregor Bertrand, Peter Kurzok, Louisa Pragst, Bernd Schattenberg, and Bastian Seegebarth for their work on the demonstrated system. We also acknowledge Roland Barth and Matthias Rau for their contributions in producing the video [11] explaining the system.

References

  1. 1.
    Bercher, P., Biundo, S., Geier, T., Hörnle, T., Nothdurft, F., Richter, F., Schattenberg, B.: Plan, repair, execute, explain - how planning helps to assemble your home theater. In: Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS), pp. 386–394. AAAI Press, Palo Alto (2014)Google Scholar
  2. 2.
    Bercher, P., Richter, F., Hörnle, T., Geier, T., Höller, D., Behnke, G., Nothdurft, F., Honold, F., Minker, W., Weber, M., Biundo, S.: A planning-based assistance system for setting up a home theater. In: Proceedings of the 29th National Conference on AI (AAAI), pp. 4264–4265. AAAI Press, Palo Alto (2015)Google Scholar
  3. 3.
    Bertrand, G., Nothdurft, F., Honold, F., Schüssel, F.: CALIGRAPHI - creation of adaptive dialogues using a graphical interface. In: 35th Annual 2011 IEEE Computer Software and Applications Conference (COMPSAC), pp. 393–400. IEEE, Piscataway (2011)Google Scholar
  4. 4.
    Biundo, S., Wendemuth, A.: Companion-technology for cognitive technical systems. Künstl. Intell. 30(1), 71–75 (2016). doi:10.1007/s13218-015-0414-8CrossRefGoogle Scholar
  5. 5.
    Biundo, S., Bercher, P., Geier, T., Müller, F., Schattenberg, B.: Advanced user assistance based on AI planning. Cogn. Syst. Res. 12(3–4), 219–236 (2011). Special Issue on Complex CognitionGoogle Scholar
  6. 6.
    Biundo, S., Höller, D., Schattenberg, B., Bercher, P.: Companion-technology: an overview. Künstl. Intell. 30(1), 11–20 (2016). doi:10.1007/s13218-015-0419-3CrossRefGoogle Scholar
  7. 7.
    Geier, T., Reuter, S., Dietmayer, K., Biundo, S.: Track-person association using a first-order probabilistic model. In: Proceedings of the 24th IEEE International Conference on Tools with AI (ICTAI 2012), pp. 844–851. IEEE, Piscataway (2012)Google Scholar
  8. 8.
    Höller, D., Bercher, P., Richter, F., Schiller, M., Geier, T., Biundo, S.: Finding user-friendly linearizations of partially ordered plans. In: 28th PuK Workshop “Planen, Scheduling und Konfigurieren, Entwerfen” (2014)Google Scholar
  9. 9.
    Honold, F., Schüssel, F., Weber, M.: Adaptive probabilistic fission for multimodal systems. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, OzCHI ’12, pp. 222–231. ACM, New York (2012)Google Scholar
  10. 10.
    Honold, F., Schüssel, F., Weber, M., Nothdurft, F., Bertrand, G., Minker, W.: Context models for adaptive dialogs and multimodal interaction. In: 9th International Conference on Intelligent Environments, pp. 57–64. IEEE, Piscataway (2013)Google Scholar
  11. 11.
    Honold, F., Bercher, P., Richter, F., Nothdurft, F., Geier, T., Barth, R., Hörnle, T., Schüssel, F., Reuter, S., Rau, M., Bertrand, G., Seegebarth, B., Kurzok, P., Schattenberg, B., Minker, W., Weber, M., Biundo, S.: Companion-technology: towards user- and situation-adaptive functionality of technical systems. In: 10th International Conference on Intelligent Environments, pp. 378–381. IEEE, Piscataway (2014). http://companion.informatik.uni-ulm.de/ie2014/companion-system.mp4
  12. 12.
    Honold, F., Schüssel, F., Weber, M.: The automated interplay of multimodal fission and fusion in adaptive HCI. In: 10th International Conference on Intelligent Environments, pp. 170–177 (2014)Google Scholar
  13. 13.
    Nothdurft, F., Minker, W.: Using multimodal resources for explanation approaches in intelligent systems. In: Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC), pp. 411–415. European Language Resources Association (ELRA), Paris (2012)Google Scholar
  14. 14.
    Nothdurft, F., Bertrand, G., Heinroth, T., Minker, W.: GEEDI - guards for emotional and explanatory dialogues. In: 6th International Conference on Intelligent Environments, pp. 90–95. IEEE, Piscataway (2010)Google Scholar
  15. 15.
    Nothdurft, F., Honold, F., Kurzok, P.: Using explanations for runtime dialogue adaptation. In: Proceedings of the 14th ACM International Conference on Multimodal Interaction, pp. 63–64. ACM, New York (2012)Google Scholar
  16. 16.
    Nothdurft, F., Honold, F., Zablotskaya, K., Diab, A., Minker, W.: Application of verbal intelligence in dialog systems for multimodal interaction. In: 10th International Conference on Intelligent Environments, pp. 361–364. IEEE, Piscataway (2014)Google Scholar
  17. 17.
    Nothdurft, F., Richter, F., Minker, W.: Probabilistic human-computer trust handling. In: Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), pp. 51–59. Association for Computational Linguistics, Stroudsburg (2014)Google Scholar
  18. 18.
    Reuter, S., Dietmayer, K.: Pedestrian tracking using random finite sets. In: Proceedings of the 14th International Conference on Information Fusion, pp. 1–8. IEEE, Piscataway (2011)Google Scholar
  19. 19.
    Reuter, S., Wilking, B., Wiest, J., Munz, M., Dietmayer, K.: Real-time multi-object tracking using random finite sets. IEEE Trans. Aerosp. Electron. Syst. 49(4), 2666–2678 (2013)CrossRefGoogle Scholar
  20. 20.
    Richardson, M., Domingos, P.: Markov logic networks. Mach. Learn. 62(1–2), 107–136 (2006)CrossRefGoogle Scholar
  21. 21.
    Schüssel, F., Honold, F., Weber, M.: Influencing factors on multimodal interaction during selection tasks. J. Multimodal User Interfaces 7(4), 299–310 (2013)CrossRefGoogle Scholar
  22. 22.
    Schüssel, F., Honold, F., Weber, M.: Using the transferable belief model for multimodal input fusion in companion systems. In: Schwenker, F., Scherer, S., Morency, L.P. (eds.) Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction, vol. 7742, pp. 100–115. Springer, Berlin/Heidelberg (2013)CrossRefGoogle Scholar
  23. 23.
    Schüssel, F., Honold, F., Schmidt, M., Bubalo, N., Huckauf, A., Weber, M.: Multimodal interaction history and its use in error detection and recovery. In: Proceedings of the 16th International Conference on Multimodal Interaction, ICMI ’14, pp. 164–171. ACM, New York (2014)Google Scholar
  24. 24.
    Seegebarth, B., Müller, F., Schattenberg, B., Biundo, S.: Making hybrid plans more clear to human users – a formal approach for generating sound explanations. In: Proceedings of the 22nd International Conference on Automated Planning and Scheduling (ICAPS), pp. 225–233. AAAI Press, Palo Alto (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Pascal Bercher
    • 1
  • Felix Richter
    • 1
  • Thilo Hörnle
    • 1
  • Thomas Geier
    • 1
  • Daniel Höller
    • 1
  • Gregor Behnke
    • 1
  • Florian Nielsen
    • 1
  • Frank Honold
    • 1
  • Felix Schüssel
    • 1
  • Stephan Reuter
    • 1
  • Wolfgang Minker
    • 1
  • Michael Weber
    • 1
  • Klaus Dietmayer
    • 1
  • Susanne Biundo
    • 1
  1. 1.Faculty of Engineering, Computer Science and PsychologyUlm UniversityUlmGermany

Personalised recommendations