MIKI: A Speech Enabled Intelligent Kiosk

  • Lee McCauley
  • Sidney D’Mello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4133)


We introduce MIKI, a three-dimensional, directory assistance-type digital persona displayed on a prominently-positioned 50 inch plasma unit housed at the FedEx Institute of Technology at the University of Memphis. MIKI, which stands for Memphis Intelligent Kiosk Initiative, guides students, faculty and visitors through the Institute’s maze of classrooms, labs, lecture halls and offices through graphically-rich, multidimensional, interactive, touch and voice sensitive digital content. MIKI differs from other intelligent kiosk systems by its advanced natural language understanding capabilities that provide it with the ability to answer informal verbal queries without the need for rigorous phraseology. This paper describes, in general, the design, implementation, and observations of visitor reactions to the Intelligent Kiosk.


Speech Recognition Latent Semantic Analysis Virtual Agent Array Microphone Touch Panel 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Stephanidis, C., Salvendy, G., Akoumianakis, D., Bevan, N., Brewer, J., Emiliani, P.L., Galetsas, A., Haataja, S., Iakovidis, I., Jacko, J., Jenkins, P., Karshmer, A., Korn, P., Marcus, A., Murphy, H., Stary, C., Vanderheiden, G., Weber, G., Ziegler, J.: Toward an Information So-ciety for All: An International R&D Agenda. International Journal of Human-Computer Interaction 10, 107–134 (1998)CrossRefGoogle Scholar
  2. 2.
    Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D., Vaucelle, C., Vilhjálmsson, H.: MACK: Media lab Autonomous Conversational Kiosk. In: Imagina 2002, Monte Carlo (2002)Google Scholar
  3. 3.
    Steiger, P., Suter, B.A.: MINELLI - Experiences with an Interactive Information Kiosk for Casual Users. In: UBILAB 1994, Zurich (1994)Google Scholar
  4. 4.
    Stocky, T., Cassell, J.: Reality: Spatial Intelligence in Intuitive User Interfaces. In: Intelligent User Interfaces, San Francisco, CA (2002)Google Scholar
  5. 5.
    Gustafson, J., Lindberg, N., Lundeberg, M.: The August spoken dialogue system. In: Eurospeech 1999 (1999)Google Scholar
  6. 6.
    Gustafson, J., Lundeberg, M., Liljencrants, J.: Experiences from the development of August - a multimodal spoken dialogue system. In: IDS 1999(1999)Google Scholar
  7. 7.
    Dumais, S.T.: Latent semantic indexing (LSI) and TREC-2. In: Harman, D. (ed.) National Institute of Standards and Technology Text Retrieval Conference, NIST (1994)Google Scholar
  8. 8.
    Landaur, T.K., Dumais, S.T.: A solution to Plato’s problem: The Latent Semantic Analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review 104, 211–240 (1997)CrossRefGoogle Scholar
  9. 9.
    Charniak, E.: Statistical Language Analysis. Cambridge University Press, Cambridge (1993)Google Scholar
  10. 10.
    Sanker, A., Gorin, A.: Adaptive language acquisition in a multi-sensory device. IEEE Transactions on Systems, Man and Cybernetics (1993)Google Scholar
  11. 11.
    Graesser, A.C., Wiemer-Hastings, P., Wiemer-Hastings, K., Harter, D., Person, N., Group, T.R.: Using Latent Semantic Analysis to evaluate the contributions of students in AutoTutor. Interactive Learning Environments 8, 149–169 (2000)CrossRefGoogle Scholar
  12. 12.
    Wiemer-Hastings, P., Wiemer-Hastings, K., Graesser, A.C.: Improving an intelli-gent tutor’s comprehension of students with Latent Semantic Analysis. In: Proceedings of Artificial Intelligence in Education 1999, pp. 535–542. IOS Press, Amsterdam (1999)Google Scholar
  13. 13.
    Miikkulainen, R.: Subsymbolic case-role analysis of sentences with embedded clauses. Cognitive Science 20, 47–74 (1996)CrossRefGoogle Scholar
  14. 14.
    Burgess, C., Livesay, K., Lund, K.: Explorations in Context Space: Words, Sentences, Discourse. Discourse Processes 25, 211–257 (1998)CrossRefGoogle Scholar
  15. 15.
    Gotoh, Y., Renals, S.: Topic-based mixture language modeling. Natural Language Engineering 6 (2000)Google Scholar
  16. 16.
    Siivola, V.: Language modeling based on neural clustering of words. In: IDIAP-Com 2002, Martigny, Switzerland (2000)Google Scholar
  17. 17.
    McCauley, L., D’Mello, S., Daily, S.: Understanding Without Formality: aug-menting speech recognition to understand informal verbal commands. In: ACM Southeast Conference (ACMSE 2005), Kennesaw, GA (2005)Google Scholar
  18. 18.
    D’Mello, S., McCauley, L., Markham, J.: A Mechanism for Human - Robot Inter-action through Informal Voice Commands. In: IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), Nashville, TN (2005)Google Scholar
  19. 19.
    Kalman, R.E.: A New Approach to Linear Filtering and Prediction Problems. Transaction of the ASME-Journal of Basic Engineering, 35–45 (1960)Google Scholar
  20. 20.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR (2001)Google Scholar
  21. 21.
    The Intel Open Source Computer Vision Library, vol. 2006, Intel Corp. (2006)Google Scholar
  22. 22.
    Wallace, R.J.: The Elements of AIML Style. In: ALICE A. I. Foundation (2003)Google Scholar
  23. 23.
    Galaxy Communicator, The MITRE Corporation (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Lee McCauley
    • 1
  • Sidney D’Mello
    • 1
  1. 1.Department of Computer ScienceThe University of MemphisMemphisUSA

Personalised recommendations