Human Communication Based on Icons in Crisis Environments

  • Siska Fitrianie
  • Dragos Datcu
  • Léon J. M. Rothkrantz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4560)


In recent years, we have developed an icon-based communication interface to represent concepts and ideas. Users can create messages to communicate with others using a spatial arrangement of visual symbols. We deployed our icon-based interface in a serious game environment of a disaster and rescue simulator, which is capable of simulating real disaster situations using information from human user observers’ reports. To support faster interaction, we designed a highly adaptive interface for optimizing the next icon look up. Inspired by the Fitaly keyboard, the system rearranges the icons menu’s layout dynamically to minimize the searching time. Users are able to find their desired icons fast since the next icon selection is most likely to be one that is (on or) around the center. Our user tests showed that the developed icon-based interface could serve as a communication mediator. The experimental results also indicated that the Fitaly-based interface allowed for much faster and easier icon finding than the hierarchical menu.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Basu, A., Sankar, S., Chakraborty, K., Bhattarcharya, S., Choudhury, M., Patel, R.: Vernacula Education and Communication Tool for the People with Multiple Disabilities. In: Development by Design Conference, Bangalore (2002)Google Scholar
  2. 2.
    Beardon, C.: CD-Icon, an Icon-based Language-Based on Conceptual Dependency. Intelligent Tutoring Media 3(4) (1992)Google Scholar
  3. 3.
    Bousquet-Vernhettes, C., Privat, R., Vigouroux, N.: Error Handling in Spoken Dialogue Systems: Toward Corrective Dialogue. In: ISCA 2003, USA (2003)Google Scholar
  4. 4.
    Chang, S.K., Polese, G., Orefice, S., Tucci, M.: A Methodology and Interactive Environment for Icon-based Language Design. Int. Journal of Human Computer Studies 41, 683–716 (1994)CrossRefGoogle Scholar
  5. 5.
    Corballis, M.C.: Did language Evolve from Manual Gestures? In: 3rd Conf. of The Evolution of Language 2000, France (2000)Google Scholar
  6. 6.
    Crawford, C.: Erasmatron. (2005),
  7. 7.
    Dymon, U.J.: An Analysis of Emergency Map Symbology. Int. Journal of Emergency Management 1(3), 227–237 (2003)CrossRefGoogle Scholar
  8. 8.
    Fellbaum, C.: WordNet: An Electronic Lexical Database. The MIT Press, Cambridge (1998)zbMATHGoogle Scholar
  9. 9.
    Fillmore, C.J.: The Case for Case, in Universals in Linguistic Theory. Emmon Bach and Robert Harms, Holt, Rinehart and Winston, New York (1968)Google Scholar
  10. 10.
    Fitrianie, S.: An Icon-Based Communication Tool on a PDA. Postgraduate Thesis, TU Eindhoven, the Netherlands (2004)Google Scholar
  11. 11.
    Fitrianie, S., Datcu, D., Rothkrantz, L.J.M.: Constructing Knowledge of the World in Crisis Situations using Visual Language. In: IEEE SMC 2006, pp. 121–126 (2006)Google Scholar
  12. 12.
    Frutiger, A.: Sign and Symbols, Their Design and Meaning. Van Nostrand Reinholt, New York (1989)Google Scholar
  13. 13.
    Homeland Security Working Group. Symbology Reference (2003),
  14. 14.
    Horton, W.: The Icon Book. John Wiley, New York (1994)Google Scholar
  15. 15.
    Housz, T.I.: The Elephant’s Memory (1994-1996),
  16. 16.
    ISO/IEC. International Standard, Information Technology – User System Interfaces and Symbols – Icon Symbols and Functions, 1st edn, ISO/IEC 11581-1:2000(E) to ISO/IEC 11581-6:2000(E) (2000)Google Scholar
  17. 17.
    Joshi, A.K., Levy, L., Takahashi, M.: Tree Adjunct Grammars. Journal of the Computer and System Sciences 10, 136–163 (1975)zbMATHCrossRefMathSciNetGoogle Scholar
  18. 18.
    Kamps, J., Marx, M.: Words with Attitude. In: Global WordNet CIIL 2002, India (2002)Google Scholar
  19. 19.
    Kipper-Schuler, K.: VerbNet: A Broad-Coverage, Comprehensive Verb Lexicon. In: PhD thesis proposal, University of Pennsylvania (2003)Google Scholar
  20. 20.
    Kjeldskov, J., Kolbe, N.: Interaction Design for Handheld Computers. In: APCHI 2002, Science Press, China (2002)Google Scholar
  21. 21.
    Langendorf, D.J.: Textware Solution’s Fitaly Keyboard V1.0 Easing the Burden of Keyboard Input. WinCELair Review (1988)Google Scholar
  22. 22.
    Leemans, N.E.M.P.: VIL, A Visual Inter Lingua. In: Doctoral Dissertation, Worcester Polytechnic Institute, USA (2001)Google Scholar
  23. 23.
    Littlejohn, S.W.: Theories of Human Communication. 5th edn. Wadsworth (1996)Google Scholar
  24. 24.
    MacKenzie, I.S., Soukoreff, R.W.: Text Entry for Mobile Computing: Models and Methods, Theory and Practice. Human-Computer Interaction 17, 147–198 (2002)CrossRefGoogle Scholar
  25. 25.
    MacKenzie, I.S., Zhang, S.X.: The Design and Evaluation of a High-Performance Soft Keyboard. In: ACM CHI, pp. 25–31. ACM, New York (1999)Google Scholar
  26. 26.
    Mealing, S., Yazdabi, M.: Communicating Through Pictures. In: Department of Computer Science, University of Exeter, England (1992)Google Scholar
  27. 27.
    Perlovsky, L.I.: Emotions, Learning and Control. In: International Symposium: Intelligent Control, Intelligent Systems and Semiotic, pp. 131–137 (1999)Google Scholar
  28. 28.
    Smith, P.: Toward a Practical Measure of Hypertext Usability. Interacting with Computers 8(4), 365–381 (1996)CrossRefGoogle Scholar
  29. 29.
    Schneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction, 2nd edn. Addison-Wesley Publishing, London (1992)Google Scholar
  30. 30.
    Tatomir, B., Rothkrantz, L.J.M.: Intelligent System for Exploring Dynamic Crisis Environments. In: Van de Walle, B., Turoff, M. (eds.) ISCRAM 2006. NJ, SA (2006)Google Scholar
  31. 31.
    Tegic Communication, T9. (1998),
  32. 32.
    W3C, OWL: Ontology Web Language,
  33. 33.
    Ward, D.A., Blackwell, A., MacKay, D.: Dasher – a Data Entry Interface Using Continuous Gesture and Language Models. In: UIST 2000, pp. 129–136 (2000)Google Scholar
  34. 34.
    Zhai, S., Hunter, M., Smith, B.A.: The Metropolis Keyboard - An Exploration of Quantitative Techniques for Virtual Keyboard Design. In: ACM UIST, pp. 119–128. ACM, New York (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Siska Fitrianie
    • 1
  • Dragos Datcu
    • 1
  • Léon J. M. Rothkrantz
    • 1
  1. 1.Man-Machine Interaction Group, Delft University of Technology, Mekelweg 4, 2628CD Delftthe Netherlands

Personalised recommendations