Skip to main content
SpringerLink
Log in

Wizard’s Apprentice: Cognitive Suggestion Support for Wizard-of-Oz Question Answering

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10331))

Included in the following conference series:

Abstract

Recent advances in artificial intelligence and natural language processing greatly enhance the capabilities of intelligent tutoring systems. However, gathering a subject-appropriate corpus of training data remains challenging. In order to address this issue, we present a system based on a hybrid Wizard-of-Oz technique, which enables cognitive systems to work in tandem with a human operator (the “wizard”), to enhance collection of dialog variants.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Watson Conversation (2016). https://www.ibm.com/watson/developercloud/doc/conversation/index.html

  2. Watson Retrieve and Rank (2016). https://www.ibm.com/watson/developercloud/retrieve-rank.html

  3. Anderson, J.R., Boyle, C.F., Reiser, B.J.: Intelligent tutoring systems. Science(Washington) 228(4698), 456–462 (1985)

    Article  Google Scholar 

  4. Benzmüller, C., Horacek, H., Kruijff-Korbayová, I., Lesourd, H., Schiller, M., Wolska, M.: DiaWOz-II – a tool for wizard-of-Oz experiments in mathematics. In: Freksa, C., Kohlhase, M., Schill, K. (eds.) KI 2006. LNCS, vol. 4314, pp. 159–173. Springer, Heidelberg (2007). doi:10.1007/978-3-540-69912-5_13

    Chapter  Google Scholar 

  5. Fialho, P., Coheur, L.: ChatWoz: chatting through a Wizard of Oz. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers& Accessibility, ASSETS 2015. pp. 423–424. ACM, New York (2015). http://doi.acm.org/10.1145/2700648.2811334

  6. Gould, J.D., Conti, J., Hovanyecz, T.: Composing letters with a simulated listening typewriter. Commun. ACM 26(4), 295–308 (1983)

    Article  Google Scholar 

  7. Green, P., Wei-Haas, L.: The rapid development of user interfaces: experience with the wizard of oz method. In: Proceedings of the Human Factors Society Annual Meeting, vol. 29(5), pp. 470–474 (1985). http://dx.doi.org/10.1177/154193128502900515

  8. Kelley, J.F.: An empirical methodology for writing user-friendly natural language computer applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1983, pp. 193–196. ACM, New York (1983). http://doi.acm.org/10.1145/800045.801609

  9. Kerly, A., Bull, S.: The potential for chatbots in negotiated learner modelling: a Wizard-of-Oz study. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 443–452. Springer, Heidelberg (2006). doi:10.1007/11774303_44

    Chapter  Google Scholar 

  10. Okamoto, M., Yang, Y., Ishida, T.: Wizard of Oz method for learning dialog agents. In: Klusch, M., Zambonelli, F. (eds.) CIA 2001. LNCS, vol. 2182, pp. 20–25. Springer, Heidelberg (2001). doi:10.1007/3-540-44799-7_3

    Chapter  Google Scholar 

  11. Schlögl, S., Doherty, G., Karamanis, N., Luz, S.: Webwoz: a Wizard of Oz prototyping framework. In: Proceedings of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2010, pp. 109–114. ACM, New York (2010). http://doi.acm.org/10.1145/1822018.1822035

  12. Schlögl, S., Doherty, G., Luz, S.: Wizard of oz experimentation for language technology applications: challenges and tools. Interact. Comput. 27(6), 592–615 (2015)

    Article  Google Scholar 

  13. Steinfeld, A., Jenkins, O.C., Scassellati, B.: The Oz of Wizard: simulating the human for interaction research. In: Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction, HRI 2009, pp. 101–108. ACM, New York (2009). http://doi.acm.org/10.1145/1514095.1514115

Download references

Author information

Authors and Affiliations

  1. IBM T.J. Watson Research Center, 1101 Kitchawan Rd, Yorktown Heights, NY, 10598, USA

    Jae-wook Ahn, Patrick Watson, Maria Chang, Sharad Sundararajan, Tengfei Ma, Nirmal Mukhi & Srijith Prabhu

Authors
  1. Jae-wook Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Patrick Watson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maria Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sharad Sundararajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tengfei Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nirmal Mukhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Srijith Prabhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jae-wook Ahn .

Editor information

Editors and Affiliations

  1. Human-Centered Multimedia, University of Augsburg, Augsburg, Germany

    Elisabeth André

  2. University of Pennsylvania, Philadelphia, Pennsylvania, USA

    Ryan Baker

  3. Department of Psychology, University of Memphis, Memphis, Tennessee, USA

    Xiangen Hu

  4. Ateneo de Manila University, Quezon City, Philippines

    Ma. Mercedes T. Rodrigo

  5. University of Sussex, Brighton, United Kingdom

    Benedict du Boulay

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ahn, Jw. et al. (2017). Wizard’s Apprentice: Cognitive Suggestion Support for Wizard-of-Oz Question Answering. In: André, E., Baker, R., Hu, X., Rodrigo, M., du Boulay, B. (eds) Artificial Intelligence in Education. AIED 2017. Lecture Notes in Computer Science(), vol 10331. Springer, Cham. https://doi.org/10.1007/978-3-319-61425-0_79

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61425-0_79

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61424-3

  • Online ISBN: 978-3-319-61425-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation