Visual Conversational Interfaces to Empower Low-Literacy Users

  • Sheetal K. Agarwal
  • Jyoti Grover
  • Arun Kumar
  • Monia Puri
  • Meghna Singh
  • Christian Remy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8120)


Mobile phones have come a long way from being plain voice calling devices to becoming multipurpose handy tools powered by ever increasing new applications available on-the-go. For many, the mobile phone of today has become the essential device one does not leave home without. However, for a large percentage of human population mobile phone apps are not of much use as they are not literate or IT savvy enough to be able to benefit from them. Recent advances in voice-based telecom information systems enable underprivileged and low-literacy users to access and offer online services without requiring expensive devices or specialized technical knowledge. However, voice applications are limited in their capability due to their time consuming nature. In this paper, we demonstrate an interaction modality that combines the power of voice communication with graphical interfaces in smartphones to break the barrier of illiteracy.


Diversity HCI4D Information Sharing ICTD User-Centered Design Interactive Voice Systems Smartphones India 


  1. 1.
    Agarwal, S., Kumar, A., Nanavati, A.A., Rajput, N.: Content creation and dissemination by-and-for users in rural areas. In: Proceedings of International Conference on Information and Communication Technologies and Development (ICTD), Doha, Qatar (2009)Google Scholar
  2. 2.
    Datta, A.: “New low-cost smartphone from Micromax”. The Hindu Business Line, (last accessed March 2013)
  3. 3.
    Friscira, E., Knoche, H., Huang, J.: Getting in touch with text: designing a mobile phone application for illiterate users to harness SMS. In: Proceedings of ACM Second Annual Symposium on Computing for Development (DEV), Atlanta, Georgia (2012)Google Scholar
  4. 4.
    Kumar, A., Agarwal, S., Manwani, P.: The spoken web application framework: user generated content and service creation through low-end mobiles. In: Proceedings of the International Cross Disciplinary Conference on Web Accessibility (W4A), Raleigh, USA (2010)Google Scholar
  5. 5.
    Lau, T., Cerruti, J., Dixon, M., Nichols, J.: Towards conversational interfaces to web applications. In: Proceedings of Fifth Workshop on Human-Computer Interaction and Information Retrieval (HCIR), Mountain View, CA (October 2011)Google Scholar
  6. 6.
    Lau, T., Cerruti, J., Manzato, G., Bengualid, M., Bigham, J.P., Nichols, J.: A Conversational Interface to Web Automation. In: Proceedings of 23rd ACM Symposium on User Interface Software and Technology (UIST), NY, USA (2010)Google Scholar
  7. 7.
    Oviatt, S., Darves, C., Coulston, R.: Toward adaptive conversational interfaces: Modeling speech convergence with animated personas. ACM Transaction on Computer-Human Interaction 11(3), 300–328 (2004)CrossRefGoogle Scholar
  8. 8.
    Raza, A.A., Haw, F., Tariq, Z., Pervaiz, M., Razaq, S., Saif, U., Rosenfeld, R.: Spread and sustainability: the geography and economics of speech-based services. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France (2013)Google Scholar
  9. 9.
    Remy, C., Agarwal, S., Kumar, A., Srivastava, S.: Supporting Voice Content Sharing among Underprivileged People in Urban India. To appear in Proceedings of 14th IFIP TC13 Conference on Human-Computer Interaction. Cape Town, South Africa (September 2013)Google Scholar
  10. 10.
    Sambasivan, N., Weber, J.S., Cutrell, E.: Designing a Phone Broadcasting System for Urban Sex Workers in India. In: Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI), Vancouver, British Columbia (2011)Google Scholar
  11. 11.
    Sun, Y., Leigh, J., Johnson, A.E., Chau, D.: Articulate: a Conversational Interface for Visual Analytics. In: Proceedings of the IEEE Symposium on Visual Analytics Science and Technology, Atlantic City, New Jersey (2009)Google Scholar
  12. 12.
    Trower, T.: Creating Conversational Interfaces for Interactive Software Agents. Tutorial Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI) (1997) Google Scholar
  13. 13.
    White, J., Duggirala, M., Srivastava, S., Kummamuru, K.: Designing a Voice-based Employment Exchange for Rural India. In: Proceedings of International Conference on Information and Communication Technologies and Development (ICTD), Atlanta, Georgia (2012)Google Scholar
  14. 14.
    Yin, M., Zhai, S.: The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: Proceedings of ACM Conference on Human Factors in Computing Systems (CHI) (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Sheetal K. Agarwal
    • 1
  • Jyoti Grover
    • 1
  • Arun Kumar
    • 1
  • Monia Puri
    • 1
  • Meghna Singh
    • 1
  • Christian Remy
    • 2
  1. 1.IBM India Research LabNew DelhiIndia
  2. 2.University of ZurichZurichSwitzerland

Personalised recommendations