Exploring Design for Multi-device, Multi-environment and Multimodal Connected Experiences

  • Himanshu BansalEmail author
  • Sai Shruthi Chivukula
  • Sanjay Ghosh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9749)


Increasing user encounters with connected devices, IoT, Smart Home and Connected Cars have been motivating designers and HCI researchers need to craft interaction solutions for such scenarios of the future. Designing solutions for scenarios, which we named M3 that involves multiple contexts (Multi-Environment) with users using connected devices (Multi-Device), using natural interactions (Multimodal) is complex. In this research, we employed visual stimuli and activity based methodology to explore such scenarios for connected home infotainment and connected car contexts. We explored the interrelationships among these M3 aspects and identified user preferences to evolve design direction for designing effective interaction, user workflows and tasks for such encounters. This helped us evolve the M3 Design framework which describes cause-effect relationships among various themes of a sample scenario of connected cars. We also present the applicability of the framework as a reference tool for brainstorming, comparative evaluation of design alternatives and solution detailing.


Multimodal interaction Connected devices Internet of things Smart home Connected car User centred design 


  1. 1.
    Connected Cars-Consumer & Commercial Telematics and Infotainment 2014–2018: Juniper Research, 1 Jun 2014.
  2. 2.
    Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J.: QuickSet: multimodal interaction for distributed applications. In: Proceedings of the 5th ACM International Conference on Multimedia, pp. 31–40 (1997)Google Scholar
  3. 3.
    Fischer, G., Giaccardi, E.: Meta-design: a framework for the future of end-user development. In: Lieberman, H., Paternò, F., Wulf, V. (eds.) End User Development, pp. 427–457. Springer, Netherlands (2006)CrossRefGoogle Scholar
  4. 4.
    Metze, F., Wechsung, I., Schaffer, S., Seebode, J., Möller, S.: Reliable evaluation of multimodal dialogue systems. In: Jacko, J.A. (ed.) HCI International 2009, Part II. LNCS, vol. 5611, pp. 75–83. Springer, Heidelberg (2009)Google Scholar
  5. 5.
    Naumann, A.B., Wechsung, I., Möller, S.: Factors influencing modality choice in multimodal applications. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol. 5078, pp. 37–43. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Negri, A.L., Trousse, B., Senach, B.: Ideation of IoT services with citizen: coupling GenIoT and AloHa! methods. In: ServDes 2012-Service Design and Innovation Conference (2012)Google Scholar
  7. 7.
    Nieminen, M.P., Mannonen, P., Turkki, L.: User-centered concept development process for emerging technologies. In: Proceedings of the Third Nordic Conference on Human-Computer Interaction, pp. 225–228. ACM, October 2004Google Scholar
  8. 8.
    Siewiorek, D., Smailagic, A., Hornyak, M.: Multimodal contextual car-driver interface. In: 2002 Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces, pp. 367–373. IEEE (2002)Google Scholar
  9. 9.
    Are you ready for the Internet of everything? World Economic Forum, By John Chambers, 15 January 2014.
  10. 10.
    Wu, C.L., Fu, L.C.: Design and realization of a framework for human–system interaction in smart homes. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 42(1), 15–31 (2012)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Himanshu Bansal
    • 1
    Email author
  • Sai Shruthi Chivukula
    • 1
  • Sanjay Ghosh
    • 1
  1. 1.Samsung R&D Institute BangaloreBangaloreIndia

Personalised recommendations