Speech enabled business applications are characterized by complex implementations that bring together language processing technologies, applications development, and end-user psychology. Resilience is critical to maintaining business to customer relationships when implementing these self-service solutions. The Wizard-of-Oz experiment is a valuable technique for simulating and building human-machine prototypes to ensure successful deployment of the completed service. This paper proposes the simplification and diffusion of the methodology to facilitate the growth in demand for automated e-business transactions.


Wizard-of-Oz (WOZ) experiments self-service technology (SST) automatic speech recognition (ASR) 


  1. Benzmüller, C, Fiedler, A., Gabsdil, M., Horacek, H., Kruijff-Korbayová, I, Pinkal, M., Siekmann, J., Tsovaltzi, D., Vo, B. Q., and Wolska, M. “A Wizard-of-Oz Experiment for Tutorial Dialogues in Mathematics,” in V. Aleven, U. Hoppe, J. Kay, R. Mizoguchi, H. Pain, F. Verdejo, and K. Yacef (eds.), Proceedings of the AI in Education (AIED) Workshop on Advanced Technologies for Mathematics Education, Sydney, Australia, 2003, pp. 471–481.Google Scholar
  2. Biberman, J., Whitty, M, and Robins, L. “Lessons from Oz: Balance and Wholeness in Organizations.” Journal of Organizational Change (12:3), 1999, pp. 243–254.CrossRefGoogle Scholar
  3. Childers, D. G. Speech Processing and Synthesis Toolboxes, New York: John Wiley & Sons, 2000.Google Scholar
  4. Davis, J. S. “Active Help Found Beneficial in Wizard of Oz Study,” Information and Software Technology (40), 1998, pp. 93–103.CrossRefGoogle Scholar
  5. deRuyter, B., Saini, P., Markopoulos, P., and Breemen, A. v. “Assessing the Effects of Building Social Intelligence in a Robotic Interface for the Home,” Interactingwith Computers (17:5), 2005, pp. 522–541.CrossRefGoogle Scholar
  6. Fiedler, A., and Gabsdil, M. “Supporting Progressive Refinements of Wizard-of-Oz Experiments,” in C. P. Rose and V. Aleven (eds.), Proceedings of the ITS2002 — Workshop on Empirical Methods for Tutorial Dialogue Systems, San Sebastian, Spain, 2002, pp. 62–69.Google Scholar
  7. Gartner. “Gartner Highlights Key Emerging Technologies in 2005 Hype Cycle,” Group, Boston, 2005 (available online through Scholar
  8. Gould, J. D., and Lewis, C. “Designing for Usability: Key Principles and What Designers Think,” Communications of the ACM(28:3), March 1985, pp. 300–311.CrossRefGoogle Scholar
  9. Jurafsky, D., and Martin, J. H. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, Upper Saddle River, NJ: Prentice-Hall, Inc., 2000.Google Scholar
  10. Koumpis, K. “Corporate Technological Positioning in Automatic Speech Recognition and Natural Language Processing,” Master of Science Dissertation, Science and Technology Policy Research (SPRU), University of Sussex, 1998.Google Scholar
  11. Lieberman, H. “The ‘Wizard of Oz’ Agent Experiment,” unpublished paper, 2005 (available online at Scholar
  12. McInnes, F. E., Jack, M. A., Carraro, F., and Foster, J. C. “User Responses to Prompt Wording Styles in an Automated Banking Service with a Wizard of Oz Simulation of Word-Spotting,” IEE Colloquium on Advances in Interactive Response Technologies for Telecommunications Services (Digest No: 1997/147), June 12, 1997, pp. 7/1–7/6.Google Scholar
  13. Munteanu, C, and Boldea, M. “MDWOZ: A Wizard of Oz Environment for Dialog Systems Development,” in Proceedings of the Second International Conference on Language Resources and Evaluation, Athens, Greece, 2000, pp. 1579–1582.Google Scholar
  14. Nortel. “Position Paper: The Power of Speech,” 2005 (available online through Scholar
  15. Pettersson, J. S. “Prototyping Interactivity before Programming,” in Proceedings of the Workshop on End User Development, Conference on Human Factors in Computing Systems (CHI 2003), Fort Lauderdale, FL, April 6, 2003, pp. 73–75.Google Scholar
  16. Pujari, D. “Self-Service with a Smile? Self-Service Technology (SST) Encounters among Canadian Business-to-Business,” International Journal of Service Industry Management (15:2), 2004, pp. 202–209.Google Scholar
  17. Salber, D., and Coutaz, J. “Applying the Wizard of Oz Technique to the Study of Multimodal Systems,” in L. J. Bass, J. Gornostaev, and C. Unger (eds.), Human-Computer Interaction Selected Papers, Berlin: Springer-Verlag, 1993, pp. 219–230.Google Scholar
  18. Singh, M. “E-Services and Their Role in B2C E-Commerce.” Managing Service Quality (12:6), 2002, pp. 434–446.CrossRefGoogle Scholar
  19. Thorisson, K., and Cassell, J. “Why Put an Agent in a Body: The Importance of Communicative Feedback in Human-Humanoid Dialogue” (Abstract) in Proceedings of Lifeline Computer Characters’ 96, Snowbird, UT, October 5–9, 1996, pp. 44–45.Google Scholar
  20. W3C. World Wide Web Consortium (W3C): Voice Extensible Markup Language (VoiceXML) Version 2.0, 2005 (available online through Scholar
  21. Yang, Y., Okamoto, M., and Ishida, T. “Applying Wizard of Oz Method to Learning Interface Agent,” IEICE Workshop on Software Agent and its Applications (SAA2000) and Special Issue on Software Agent and its Applications Transactions of IEICE, 2000, pp. 223–230.Google Scholar
  22. Zue, V. W., and Glass, J. R. “Conversational Interfaces: Advances and Challenges,” in Proceedings of the IEEE (88:8), Special Issue on Spoken Language Processsing, 2000, pp. 1166–1180.CrossRefGoogle Scholar

Copyright information

© International Federation for Information Processing 2006

Authors and Affiliations

  • Gabriel J. Costello
    • 1
  1. 1.Galway-Mayo Institute of TechnologyGalwayIreland

Personalised recommendations