Logical User Interface Modeling for Multimedia Embedded Systems

  • Saehwa Kim
Part of the Communications in Computer and Information Science book series (CCIS, volume 263)


Multimedia embedded systems such as smart phones, tablets, and smart TVs are ever proliferating. One of the major hurdles for reusing applications for multiple multimedia embedded systems is user interfaces (UIs) cannot be the same for the target embedded systems. While there have been many research activities regarding model-based UI development environments, they are focused on web of desk-top based systems and not suitable for embedded systems. This paper proposes logical user interface modeling for multimedia embedded systems (LUMME). LUMME incorporates the notions of reference containers and multimedia instance presentations. While conventional approaches model only visible UI components, LUMME incorporate events as a first-class modeling entity, which is essential to model UIs for embedded systems. Moreover, LUMME does not employ the task model, which is widely employed in conventional approaches, but incorporates events as navigators. We have fully implemented a modeling tool for LUMME as Eclipse rich-client platform (RCP) using Eclipse Graphical Modeling Framework (GMF). We have also performed a case study with a gallery application in Android targeted for multiple embedded systems with various resolutions from HVGA to XGA. The case study clearly shows how LUMME makes the modeling of UIs for multimedia embedded systems concise and allows reusing UIs for multiple multimedia embedded systems.


User interface modeling model-driven architecture (MDA) embedded systems pattern-based transformational UI development multimedia embedded applications 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mori, G., Paterno, F., Santoro, C.: Design and Development of Multidevice User Interfaces through Multiple Logical Descriptions. IEEE Transactions on Software Engineering 30 (2004)Google Scholar
  2. 2.
    Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouil-lon, L., Vanderdonckt, J.: A Unifying Reference Framework for Multi-Target User Interfaces. Interacting with Computers 15, 289–308 (2003)CrossRefGoogle Scholar
  3. 3.
    Vanderdonckt, J.: Model-driven engineering of user interfaces: Promises, successes, failures, and challenges. In: Proceedings of Annual Romanian Conference on Human-Computer Interaction, pp. 1–10 (2008)Google Scholar
  4. 4.
    Pinheiro da Silva, P.: User Interface Declarative Models and Development Environments: A Survey. In: Paternó, F. (ed.) DSV-IS 2000. LNCS, vol. 1946, pp. 207–226. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  5. 5.
    Pérez-Medina, J.-L., Dupuy-Chessa, S., Front, A.: A Survey of Model Driven Engineering Tools for User Interface Design. In: Winckler, M., Johnson, H. (eds.) TAMODIA 2007. LNCS, vol. 4849, pp. 84–97. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  6. 6.
    Coutaz, J.: User interface plasticity: model driven engineering to the limit! In: Proceedings of ACM SIGCHI Symposium on Engineering Interactive Computing Systems (2010)Google Scholar
  7. 7.
    Collignon, B., Vanderdonckt, J., Calvary, G.: Model-driven engineering of multi-target plastic user interfaces. In: Proceedings of International Conference on Autonomic and Autonomous Systems (2008)Google Scholar
  8. 8.
    Kim, S.: Pattern and Event Based Logical UI Modeling for Multi-Device Embedded Applications. In: Lee, G., Howard, D., Ślęzak, D. (eds.) ICHIT 2011. CCIS, vol. 206, pp. 560–567. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Unified Modeling Language (UML) 2.0. Object Management Group (2007) Google Scholar
  10. 10.
    Lu, X., Wan, J.: User Interface Design Model. In: Proceedings of the ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (2007)Google Scholar
  11. 11.
    Paternò, F., Santoro, C., Spano, L.D.: Model-Based Design of Multi-Device Interactive Applications Based on Web Services. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 892–905. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  12. 12.
    So, P.H.J.C.P.L., Shum, P., Li, X.J., Goyal, D.: Design and Implementation of User Interface for Mobile Devices. IEEE Transactions on Consumer Electronics 50 (2004)Google Scholar
  13. 13.
    Borchers, J.O.: A Pattern Approach to Interaction Design. In: Proceedings of Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (2001)Google Scholar
  14. 14.
    Aquino, N., Vanderdonckt, J., Pastor, O.: Transformation templates: adding flexibility to model-driven engineering of user interfaces. In: Proceedings of ACM Symposium on Applied Computing (2010)Google Scholar
  15. 15.
    Kim, S.: Graphical Modeling Environment for Logical User Interfaces Based on Eclipse GMF. Journal of Information Industrial Engineering 18 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Saehwa Kim
    • 1
  1. 1.Hankuk University of Foreign StudiesYongin-siKorea

Personalised recommendations