Skip to main content

Do It Yourself, but Not Alone: Companion-Technology for Home Improvement—Bringing a Planning-Based Interactive DIY Assistant to Life

KI - Künstliche Intelligenz volume 35, pages 367–375 (2021)Cite this article

Abstract

We report on the technology transfer project “Do it yourself, but not alone: Companion-Technology for Home Improvement” that was carried out by Ulm University in cooperation with Robert Bosch GmbH. We developed a prototypical assistance system that assists a Do It Yourself (DIY) handyman in carrying out DIY projects. The assistant, based on various AI and dialog management capabilities, generates a sequence of detailed instructions that users may just follow or adapt according to their individual preferences. It features explanation capabilities as well as pro-active support based on communication with the user as well as with the involved tools. We report on the project’s main achievements, including the findings of various empirical studies conducted in various development stages of the prototype.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. Behnke G, Bercher P, Kraus M, Schiller M, Mickeleit K, Häge T, Dorna M, Dambier M, Minker W, Glimm B, Biundo S (2020) New developments for Robert—assisting novice users even better in DIY projects. In: ICAPS. AAAI Press, pp. 343–347

  2. Behnke G, Biundo S (2018) X and more parallelism: integrating LTL-next into SAT-based planning with trajectory constraints while allowing for even more parallelism. Intell Artif 21(62):75–90

    Google Scholar 

  3. Behnke G, Höller D, Bercher P, Biundo S (2016) Change the plan—how hard can that be? In: ICAPS. AAAI Press, pp 38–46

  4. Behnke G, Höller D, Biundo S (2015) On the complexity of HTN plan verification and its implications for plan recognition. In: ICAPS. AAAI Press, pp 25–33

  5. Behnke G, Höller D, Biundo S (2019) Bringing order to chaos–a compact representation of partial order in SAT-based HTN planning. In: AAAI. AAAI Press, pp 7520–7529

  6. Behnke G, Höller D, Biundo S (2019) Finding optimal solutions in HTN planning—a SAT-based approach. pp 5500–5508. ijcai.org

  7. Behnke G, Höller D, Schmid A, Bercher P, Biundo S (2020) On succinct groundings of HTN planning problems. In: AAAI. AAAI Press, pp 9775–9784

  8. Behnke G, Höller D, Biundo S (2018) Tracking branches in trees—a propositional encoding for solving partially-ordered HTN planning problems. In: IEEE international conference on tools with AI (ICTAI). IEEE Computer Society, pp 73–80

  9. Behnke G, Schiller M, Kraus M, Bercher P, Schmautz M, Dorna M, Dambier M, Minker W, Glimm B, Biundo S (2019) Alice in DIY-wonderland or: instructing novice users on how to use tools in DIY projects. AI Commun 32(1):31–57

    MathSciNet  Article  Google Scholar 

  10. Bercher P, Alford R, Höller D (2019) A survey on hierarchical planning—one abstract idea, many concrete realizations. In: IJCAI. pp 6267–6275. ijcai.org

  11. Bercher P, Behnke G, Höller D, Biundo S (2017) An admissible HTN planning heuristic. In: IJCAI. pp 480–488. ijcai.org

  12. Bercher P, Biundo S, Geier T, Hoernle T, Nothdurft F, Richter F, Schattenberg B (2014) Plan, repair, execute, explain—how planning helps to assemble your home theater. In: ICAPS. AAAI Press, pp 386–394

  13. Bercher P, Keen S, Biundo S (2014) Hybrid planning heuristics based on task decomposition graphs. In: Annual symposium on combinatorial search (SoCS). AAAI Press, pp 35–43

  14. Bercher P, Olz C (2020) POP \(\equiv\) POCL, right? Complexity results for partial order (causal link) makespan minimization. AAAI Press, pp 9785–9793

  15. Bercher P, Richter F, Honold F, Nielsen F, Schüssel F, Geier T, Hörnle T, Reuter S, Höller D, Behnke G, Dietmayer K, Minker W, Weber M, Biundo S (2018) A Companion-system architecture for realizing individualized and situation-adaptive user assistance. Tech. rep., Ulm University

  16. Biundo S, Bercher P, Geier T, Müller F, Schattenberg B (2011) Advanced user assistance based on AI planning. Cogn Syst Res 12(3–4):219–236

    Article  Google Scholar 

  17. Biundo S, Schattenberg B (2001) From abstract crisis to concrete relief–a preliminary report on combining state abstraction and HTN planning. In: European conference on planning (ECP). AAAI Press, pp 157–168

  18. Biundo S, Wendemuth A (2016) Companion-technology for cognitive technical systems. Künstliche Intelligenz 30(1):71–75

    Article  Google Scholar 

  19. Biundo S, Wendemuth A (2017) An introduction to companion-technology. In: Biundo S, Wendemuth A (eds) Companion technology—a paradigm shift in human-technology interaction. Springer, Berlin

    Google Scholar 

  20. Erol K, Hendler JA, Nau DS (1996) Complexity results for HTN planning. Ann Math Artif Intell (AMAI) 18(1):69–93

    MathSciNet  Article  Google Scholar 

  21. Fox M, Long D (2003) PDDL2.1: an extension to PDDL for expressing temporal planning domains. J Artif Intell Res (JAIR) 20:61–124

    Article  Google Scholar 

  22. Höller D, Bercher P, Behnke G, Biundo S (2018) A generic method to guide HTN progression search with classical heuristics. In: ICAPS. AAAI Press, pp 114–122

  23. Höller D, Bercher P, Behnke G, Biundo S (2019) On guiding search in HTN planning with classical planning heuristics. In: IJCAI. pp 6171–6175. ijcai.org

  24. Höller D, Bercher P, Behnke G, Biundo S (2020) HTN planning as heuristic progression search. J Artif Intell Res (JAIR) 67:835–880

    MathSciNet  Article  Google Scholar 

  25. Höller D, Bercher P, Richter F, Schiller M, Geier T, Biundo S (2014) Finding user-friendly linearizations of partially ordered plans. In: Workshop “Planen, Scheduling und Konfigurieren, Entwerfen” (PuK)

  26. Höller D, Behnke G, Bercher P, Biundo S, Fiorino H, Pellier D, Alford R (2020) HDDL: an extension to PDDL for expressing hierarchical planning problems. In: AAAI. AAAI Press, pp 9883–9891

  27. Kraus M, Fischbach F, Jansen P, Minker W (2020) A comparison of explicit and implicit proactive dialogue strategies for conversational recommendation. In: Language Resources and Evaluation Conference (LREC). ELRA, pp 429–435

  28. Kraus M, Schiller M, Behnke G, Bercher P, Biundo S, Glimm B, Minker W (2019) A Multimodal dialogue framework for cloud-based companion systems. Springer, pp 405–410

  29. Kraus M, Schiller M, Behnke G, Bercher P, Dorna M, Dambier M, Glimm B, Biundo S, Minker W (2020) “Was that successful” On integrating proactive meta-dialogue in a DIY-assistant system using multimodal cues. In: International conference on multimodal interaction (ICMI). ACM

  30. Kraus M, Wagner N, Minker W (2020) Effects of proactive dialogue strategies on human-computer trust. In: ACM conference on user modeling, adaptation and personalization (UMAP). Association for Computing Machinery, pp 107–116

  31. Leichtmann B, Bercher P, Höller D, Behnke G, Biundo S, Nitsch V, Baumann M (2018) Towards a companion system incorporating human planning behavior—a qualitative analysis of human strategies. In: Transdisciplinary conference on support technologies (TCST). pp 89–98

  32. Mattmüller R, Rintanen J (2007) Planning for temporally extended goals as propositional satisfiability. In: IJCAI. AAAI Press, pp 1966–1971

  33. Nothdurft F, Richter F, Minker W (2014) Probabilistic human–computer trust handling. In: Annual meeting of the special interest group on discourse and dialogue (SIGDIAL). Association for Computational Linguistics, pp 51–59

  34. Olz C, Bercher P (2019) Eliminating redundant actions in partially ordered plans—a complexity analysis. In: ICAPS. AAAI Press, pp 310–319

  35. Pnueli A (1977) The temporal logic of programs. In: Annual symposium on Foundations of computer science (SFCS). IEEE, pp 46–57

  36. Schiller M, Behnke G, Bercher P, Kraus M, Dorna M, Richter F, Biundo S, Glimm B Minker W (2018) Evaluating knowledge-based assistance for DIY. In: MCI Workshop “Digital Companion”, pp 925–930

  37. Schiller M, Behnke G, Schmautz M, Bercher P, Kraus M, Dorna M, Minker W, Glimm B, Biundo S (2017) A paradigm for coupling procedural and conceptual knowledge in companion systems. In: International conference on computer technology (ICCT). IEEE

  38. Schiller M, Schiller F, Glimm B (2017) Testing the adequacy of automated explanations of el subsumptions. In: Proceedings of DL 2017, CEUR Workshop, 1879

Download references

Acknowledgements

This work was partly funded by the technology transfer project “Do it yourself, but not alone: Companion-Technology for Home Improvement” of the CRC/TRR 62 funded by the German Research Foundation (DFG). The industrial project partner is the Corporate Research Sector of the Robert Bosch GmbH.

Author information

Authors and Affiliations

  1. The Australian National University, College of Engineering and Computer Science, Canberra, Australia

    Pascal Bercher

  2. University of Freiburg, Freiburg im Breisgau, Germany

    Gregor Behnke

  3. Institute of Communications Engineering, Ulm University, Ulm, Germany

    Matthias Kraus & Wolfgang Minker

  4. Robert Bosch GmbH, Corporate Research Sector, Renningen, Stuttgart, Germany

    Marvin Schiller, Dietrich Manstetten, Michael Dambier & Michael Dorna

  5. Institute of Artificial Intelligence, Ulm University, Ulm, Germany

    Birte Glimm & Susanne Biundo

Authors
  1. Pascal Bercher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gregor Behnke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthias Kraus
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marvin Schiller
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dietrich Manstetten
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michael Dambier
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Michael Dorna
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Wolfgang Minker
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Birte Glimm
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Susanne Biundo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pascal Bercher.

Additional information

P. Bercher, G. Behnke: Most results described were achieved while still at Ulm University.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Bercher, P., Behnke, G., Kraus, M. et al. Do It Yourself, but Not Alone: Companion-Technology for Home Improvement—Bringing a Planning-Based Interactive DIY Assistant to Life. Künstl Intell 35, 367–375 (2021). https://doi.org/10.1007/s13218-021-00721-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13218-021-00721-x