Skip to main content

Visual Conversational Interfaces to Empower Low-Literacy Users

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 8120)


Mobile phones have come a long way from being plain voice calling devices to becoming multipurpose handy tools powered by ever increasing new applications available on-the-go. For many, the mobile phone of today has become the essential device one does not leave home without. However, for a large percentage of human population mobile phone apps are not of much use as they are not literate or IT savvy enough to be able to benefit from them. Recent advances in voice-based telecom information systems enable underprivileged and low-literacy users to access and offer online services without requiring expensive devices or specialized technical knowledge. However, voice applications are limited in their capability due to their time consuming nature. In this paper, we demonstrate an interaction modality that combines the power of voice communication with graphical interfaces in smartphones to break the barrier of illiteracy.


  • Diversity
  • HCI4D
  • Information Sharing
  • ICTD
  • User-Centered Design
  • Interactive Voice Systems
  • Smartphones
  • India


  1. Agarwal, S., Kumar, A., Nanavati, A.A., Rajput, N.: Content creation and dissemination by-and-for users in rural areas. In: Proceedings of International Conference on Information and Communication Technologies and Development (ICTD), Doha, Qatar (2009)

    Google Scholar 

  2. Datta, A.: “New low-cost smartphone from Micromax”. The Hindu Business Line, (last accessed March 2013)

  3. Friscira, E., Knoche, H., Huang, J.: Getting in touch with text: designing a mobile phone application for illiterate users to harness SMS. In: Proceedings of ACM Second Annual Symposium on Computing for Development (DEV), Atlanta, Georgia (2012)

    Google Scholar 

  4. Kumar, A., Agarwal, S., Manwani, P.: The spoken web application framework: user generated content and service creation through low-end mobiles. In: Proceedings of the International Cross Disciplinary Conference on Web Accessibility (W4A), Raleigh, USA (2010)

    Google Scholar 

  5. Lau, T., Cerruti, J., Dixon, M., Nichols, J.: Towards conversational interfaces to web applications. In: Proceedings of Fifth Workshop on Human-Computer Interaction and Information Retrieval (HCIR), Mountain View, CA (October 2011)

    Google Scholar 

  6. Lau, T., Cerruti, J., Manzato, G., Bengualid, M., Bigham, J.P., Nichols, J.: A Conversational Interface to Web Automation. In: Proceedings of 23rd ACM Symposium on User Interface Software and Technology (UIST), NY, USA (2010)

    Google Scholar 

  7. Oviatt, S., Darves, C., Coulston, R.: Toward adaptive conversational interfaces: Modeling speech convergence with animated personas. ACM Transaction on Computer-Human Interaction 11(3), 300–328 (2004)

    CrossRef  Google Scholar 

  8. Raza, A.A., Haw, F., Tariq, Z., Pervaiz, M., Razaq, S., Saif, U., Rosenfeld, R.: Spread and sustainability: the geography and economics of speech-based services. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France (2013)

    Google Scholar 

  9. Remy, C., Agarwal, S., Kumar, A., Srivastava, S.: Supporting Voice Content Sharing among Underprivileged People in Urban India. To appear in Proceedings of 14th IFIP TC13 Conference on Human-Computer Interaction. Cape Town, South Africa (September 2013)

    Google Scholar 

  10. Sambasivan, N., Weber, J.S., Cutrell, E.: Designing a Phone Broadcasting System for Urban Sex Workers in India. In: Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI), Vancouver, British Columbia (2011)

    Google Scholar 

  11. Sun, Y., Leigh, J., Johnson, A.E., Chau, D.: Articulate: a Conversational Interface for Visual Analytics. In: Proceedings of the IEEE Symposium on Visual Analytics Science and Technology, Atlantic City, New Jersey (2009)

    Google Scholar 

  12. Trower, T.: Creating Conversational Interfaces for Interactive Software Agents. Tutorial Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI) (1997)

    Google Scholar 

  13. White, J., Duggirala, M., Srivastava, S., Kummamuru, K.: Designing a Voice-based Employment Exchange for Rural India. In: Proceedings of International Conference on Information and Communication Technologies and Development (ICTD), Atlanta, Georgia (2012)

    Google Scholar 

  14. Yin, M., Zhai, S.: The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: Proceedings of ACM Conference on Human Factors in Computing Systems (CHI) (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Agarwal, S.K., Grover, J., Kumar, A., Puri, M., Singh, M., Remy, C. (2013). Visual Conversational Interfaces to Empower Low-Literacy Users. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8120. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40497-9

  • Online ISBN: 978-3-642-40498-6

  • eBook Packages: Computer ScienceComputer Science (R0)