Investigating the Role of Mutual Cognitive Environment for End-User Programming

  • Rémi Barraquand
  • Patrick Reignier
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 339)


In this paper we present a situated end user programming approach where user co-constructs, in an iterative process, a mutual cognitive environment with the system. We argue that co-construction of a mutual cognitive environment, between both the human and the system, is a key toward social human-computer interaction. Preliminary results are illustrated with a step by step case study: a user teaches the system new perceptual and abstract concepts using hand gesture and an interactive learning table.


End-User Programming Situation Models Cognitive Environment 


  1. 1.
    Barraquand, R., Crowley, J.L.: Learning polite behavior with situation models. In: HRI 2008: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, pp. 209–216. ACM, New York (2008)CrossRefGoogle Scholar
  2. 2.
    Coutaz, J., Crowley, J.L., Dobson, S., Garlan, D.: Context is key. Commun. ACM 48(3), 49–53 (2005)CrossRefGoogle Scholar
  3. 3.
    Crowley, J.L., Reignier, P., Barraquand, R.: Situation models: A tool for observing and understanding activity. In: Workshop People Detection and Tracking, held in IEEE International Conference on Robotics and Automation, Kobe, Japan (2009)Google Scholar
  4. 4.
    Dey, A.K., Abowd, G.D., Salber, D.: A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum.-Comput. Interact. 16(2), 97–166 (2001)CrossRefGoogle Scholar
  5. 5.
    Dey, A.K., Hamid, R., Beckmann, C., Li, I., Hsu, D.: a CAPpella: programming by demonstration of context-aware applications. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Vienna, Austria, pp. 33–40. ACM, New York (2004)Google Scholar
  6. 6.
    Dourish, P.: What we talk about when we talk about context. Personal Ubiquitous Comput. 8(1), 19–30 (2004)CrossRefGoogle Scholar
  7. 7.
    Ganneau, V., Calvary, G., Demumieux, R.: Learning key contexts of use in the wild for driving plastic user interfaces engineering. In: Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams, Pisa, Italy, pp. 271–278. Springer, Heidelberg (2008)Google Scholar
  8. 8.
    Johnson-Laird, P.N.: Mental models: towards a cognitive science of language, inference, and consciousness. Harvard University Press, Cambridge (1983)Google Scholar
  9. 9.
    Korpip, P.P., Malm, E., Rantakokko, T., Kyllonen, V., Kela, J., Mantyjarvi, J., Hakkil, J., Kansala, I.: Customizing user interaction in smart phones. IEEE Pervasive Computing 5(3), 82–90 (2006)CrossRefGoogle Scholar
  10. 10.
    Reeves, B., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places, 1st edn., Cambridge (1996)Google Scholar
  11. 11.
    Salembier, P., Zouinar, M.: Intelligibilité mutuelle et contexte partagé. Inspirations théoriques et réductions technologiques. @CTIVITES 1(2) (2004)Google Scholar
  12. 12.
    Sperber, D., Wilson, D.: Relevance: Communication and Cognition. Blackwell Publishers, Malden (December 1995)Google Scholar
  13. 13.
    Zwaan, R.A., Radvansky, G.A.: Situation models in language comprehension and memory. Psychological Bulletin 123, 162–185 (1998)CrossRefGoogle Scholar

Copyright information

© IFIP 2010

Authors and Affiliations

  • Rémi Barraquand
    • 1
  • Patrick Reignier
    • 1
  1. 1.Rhônes-Alpes Research CenterINRIA GrenobleMontbonnotFrance

Personalised recommendations