ModControl – Mobile Phones as a Versatile Interaction Device for Large Screen Applications

  • Matthias Deller
  • Achim Ebert
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6947)


Large, public displays are increasingly popular in today’s society. For the most part, however, these displays are purely used for information or multimedia presentation, without the possibility of interaction for viewers. On the other hand, personal mobile devices are becoming more and more ubiquitous. Though there are efforts to combine large screens with mobile devices, the approaches are mostly focused on mobiles as control devices, or they are fitted to specific applications. In this paper, we present the ModControl framework, a configurable, modular communication structure that enables large screen applications to connect with personal mobile devices and request a set of configurable modules, utilizing the device as a personalized mobile interface. The main application can easily make use of the highly sophisticated interaction features provided by modern mobile phones. This facilitates new, interactive appealing visualizations that can be actively controlled with an intuitive, unified interface by single or multiple users.


Interaction framework Distributed interfaces Input devices and strategies User-Centered Design 


  1. 1.
    Ballagas, R., Borchers, J., Rohs, M., Sheridan, J.G.: The Smart Phone: A Ubiquitous Input Device. In: IEEE Pervasive Computing, vol. 5(1), p. 70. IEEE Computer Society, Los Alamitos (2006)Google Scholar
  2. 2.
    Ballagas, R., Rohs, M., Sheridan, J.G.: Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1200–1203. ACM Press, New York (2005)CrossRefGoogle Scholar
  3. 3.
    Berger, S., Kjieldsen, R., Narayanaswami, C., Pinhanez, C., Podlaseck, M., Raghunath, M.: Using Symbiotic Displays to View Sensitive Information in Public. In: Proceedings of the Third IEEE International Conference on Pervasive Computing and Communications, pp. 139–148. IEEE Computer Society, Los Alamitos (2005)CrossRefGoogle Scholar
  4. 4.
    Finke, M., Kaviani, N., Wang, I., Tsao, V., Fels, S., Lea, R.: Investigating distributed user interfaces across interactive large displays and mobile devices. In: Proceedings of the International Conference on Advanced Visual Interfaces, pp. 413–413. ACM Press, New York (2010)CrossRefGoogle Scholar
  5. 5.
    Han, R., Perret, V., Naghshineh, M.: WebSplitter: A unified XML framework for multi-device collaborative Web browsing. In: CSCW 2000: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 221–230. ACM Press, New York (2000)CrossRefGoogle Scholar
  6. 6.
    Madhavapeddy, A., Scott, D., Sharp, R., Upton, E.: Using Camera-Phones to Enhance Human-Computer Interaction. In: Adjunct Proceedings of The Sixth International Conference on Ubiquitous Computing. ACM Press, New York (2004)Google Scholar
  7. 7.
    Myers, B.A., Peck, C.H., Nichols, J., Kong, D., Miller, R.: Interacting at a Distance Using Semantic Snarfing. In: Proceedings of the 3rd International Conference on Ubiquitous Computing, pp. 305–314. Springer, Heidelberg (2001)Google Scholar
  8. 8.
  9. 9.
    Raghunath, M., Ravi, N., Rosu, M.-C., Narayanaswami, C.: Inverted Browser: A Novel Approach towards Display Symbiosis. In: Proceedings of the 4th IEEE International Conference on Pervasive Computing and Communications, pp. 71–76. IEEE Computer Society, Los Alamitos (2006)Google Scholar
  10. 10.
    Sas, C., Dix, A.: Designing and evaluating mobile phone-based interaction with public displays. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 3941–3944. ACM Press, New York (2008)Google Scholar
  11. 11.
    Slay, H., Thomas, B.H.: Evaluation of a universal interaction and control device for use within multiple heterogeneous display environments. In: Proceedings of the 7th Australasian User Interface Conference, vol. 50, pp. 129–136. Australian Computer Society (2006)Google Scholar
  12. 12.
    Yee, K.-P.: Peephole displays: pen interaction on spatially aware handheld computers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1–8. ACM Press, New York (2003)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Matthias Deller
    • 1
    • 2
  • Achim Ebert
    • 1
  1. 1.University of KaiserslauternKaiserslauternGermany
  2. 2.DFKI GmbHKaiserslauternGermany

Personalised recommendations