A Context-Based Grammar Generation in Mixed Initiative Dialogue System for Visually Impaired

  • Jaromír Plhák
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6180)


In this paper, we present some principles of designing mixed-initiative dialogue systems suited to the needs of visually impaired users related with dialogue based web page generation. These principles have been implemented in the online BrowserWebGen system that allows users to generate their web pages. The primary user interface is implemented as a dialogue system with implicit confirmation. The users are able to enter one piece of semantic information at each step of a dialogue interaction. Second part of the application allows the user to activate mixed initiative dialogue interface in each dialogue state. This interface is called Dialogue Prompt Window and it provides an additional support to the users as well as control over the application in natural language.


web page creation dialogue system grammar accessibility visually impaired 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bunt, H.: Context Representation for Dialogue Management. In: Proceedings of the Second international and interdisciplinary Conference on Modeling and Using Context, London, pp. 77–90 (1999)Google Scholar
  2. 2.
    Jönsson, A.: A model for habitable and efficient dialogue management in natural language interaction. In: Natural Language Engineering, pp. 103–122 (1997)Google Scholar
  3. 3.
    Griol, D., Hurtado, L.F., Segarra, E., Sanchis, E.: A Dialog Management Methodology Based on Neural Networks and Its Application to Different Domains. In: Proceedings of the 13th Iberoamerican Congress on Pattern Recognition: Progress in Pattern Recognition, Image Analysis and Applications, Havana, Cuba, pp. 643–650 (2008)Google Scholar
  4. 4.
    Stent, A., Dowding, J., Gawron, J., Owen Bratt, E., Moore, R.: The CommandTalk spoken dialogue system. In: ACL 1999, pp. 183–190 (1999)Google Scholar
  5. 5.
    Litman, D.J., Pan, S.: Designing and evaluating an adaptive spoken dialogue system. In: User Modeling and User-Adapted Interaction (2002)Google Scholar
  6. 6.
    Chu-Carroll, J.: MIMIC: An adaptive mixed initiative spoken dialogue system for information queries. In: Proceedings of the Sixth Conference on Applied Natural Language Processing, Seattle, WA, pp. 97–104. AAAI Press, Menlo Park (2000)CrossRefGoogle Scholar
  7. 7.
    Fügen, C., Holzapfel, H., Waibel, A.: Tight coupling of speech recognition and dialog management - dialog-context grammar weighting for speech recognition. In: Proceedings of ICSLP 2004, Jeju Island, Korea (2004)Google Scholar
  8. 8.
    Xu, W., Rudnicky, A.: Language modeling for dialog systems. In: Proceedings of the ICSLP, Beijing, China (2000)Google Scholar
  9. 9.
    Visweswariah, K., Printz, H.: Language models conditioned on dialog state. In: Proceedings of the Eurospeech, Aalborg, Denmark (2001)Google Scholar
  10. 10.
    Kopeček, I., Bártek, L.: Web Pages for Blind People – Generating Web-Based Presentations by means of Dialogue. In: Computers Helping People with Special Needs: 10th International Conference, Linz, Austria, pp. 114–119 (2006)Google Scholar
  11. 11.
    Bártek, L., Plhák, J.: Visually Impaired Users Create Web Pages. In: 11th International Conference on Computers Helping People with Special Needs, Linz, Austria, pp. 466–473 (2008)Google Scholar
  12. 12.
    Bártek, L., Kopeček, I., Ošlejšek, R.: Setting Layout in Dialogue Generating Web Pages. In: Matoušek, V., Mautner, P. (eds.) TSD 2007. LNCS (LNAI), vol. 4629, pp. 613–620. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  13. 13.
    Kopeček, I.: Ontology and Knowledge Based Approach to Dialogue Systems. In: Proceedings of the 2009 International Conference on Internet Computing ICOMP, Las Vegas, pp. 291–295 (2009)Google Scholar
  14. 14.
    Web Content Accessibility Guidelines (WCAG) 2.0,
  15. 15.
    O’Connor, J.: Choosing an accessible CMS (2007),
  16. 16.
    Kopeček, I., Tiršel, F.: Supporting Visually Impaired People in Image Accessible Exploration and Creation of Personal Presentations. In: Hlaváčková, D., Horák, A., Osolsobě, K., Rychlý, P. (eds.) After a Century of Slavonic Natural Language Processing. Tribun EU 2009, pp. 135–142 (2009)Google Scholar
  17. 17.
    The Extensible HyperText Markup Language,
  18. 18.
    Kopeček, I., Ošlejšek, R.: GATE to Accessibility of Computer Graphics. In: 11th International Conference on Computers Helping People with Special Needs, Linz, Austria, pp. 295–302 (2008)Google Scholar
  19. 19.
    Kopeček, I., Ošlejšek, R.: Creating Pictures by Dialogue. In: Computers Helping People with Special Needs: 10th International Conference, Linz, Austria, pp. 61–68 (2006)Google Scholar
  20. 20.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jaromír Plhák
    • 1
  1. 1.Faculty of InformaticsMasaryk UniversityBrnoCzech Republic

Personalised recommendations