Tasks = Data + Action + Context: Automated Task Assistance through Data-Oriented Analysis

  • Alan Dix
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5247)


Human activity unfolds partly through planning and learnt sequences of actions, and partly through reaction to the physical objects and digital data in the environment. This paper describes various techniques related to automatic task assistance that take this role of data as central. Although this brings additional complexity, it also offers ways to simplify or bypass problems in task inference that otherwise appear difficult or impossible. Although the focus in this paper is on automated task support, the importance of objects and data in understanding tasks is one that applies to other forms of task analysis in the design process.


task inference data detectors automated task support intelligent user interfaces task as grammar 


  1. 1.
    Dix, A.: Managing the Ecology of Interaction. In: Pribeanu, C., Vanderdonckt, J. (eds.) Proceedings of Tamodia 2002 - First International Workshop on Task Models and User Interface Design, pp. 1–9. INFOREC Publishing House, Bucharest (2002)Google Scholar
  2. 2.
    Clark, A.: Microcognition,: Philosophy, Cognitive Science and Parallel Processing. MIT Press, Cambridge (1989)Google Scholar
  3. 3.
    Clark, A.: Being There: Putting Brain, Body and the World Together Again. MIT Press, Cambridge (1998)Google Scholar
  4. 4.
    Hollan, J., Hutchins, E., Kirsh, D.: Distributed Cognition: Towards a New Foundation for Human–Computer Interaction Research. In: Carroll, J. (ed.) Human–Computer Interaction in the New Millennium, ch. 4, pp. 75–94. Addison-Wesley Professional, Boston (2002)Google Scholar
  5. 5.
    Pandit, M., Kalbag, S.: The selection recognition agent: Instant access to relevant information and operations. In: Proc. of Intelligent User Interfaces (IUI 1997), pp. 47–52. ACM Press, New York (1997)Google Scholar
  6. 6.
    Nardi, B., Miller, J., Wright, D.: Collaborative, Programmable Intelligent Agents. Communications of the ACM 41(3), 96–104 (1998)CrossRefGoogle Scholar
  7. 7.
    Wood, A., Dey, A., Abowd, G.: Cyberdesk: Automated Integration of Desktop and Network Services. In: Proc. of the Conference on Human Factors in Computing Systems (CHI 1997), pp. 552–553. ACM Press, New York (1997)CrossRefGoogle Scholar
  8. 8.
    Dix, A., Beale, R., Wood, A.: Architectures to make Simple Visualisations using Simple Systems. In: Proc. of. Advanced Visual Interfaces (AVI 2000), pp. 51–60. ACM Press, New York (2000)Google Scholar
  9. 9.
    Stylos, J., Myers, B., Faulring, A.: Citrine: providing intelligent copy-and-paste. In: Proc. of the 17th Symposium on User Interface Software and Technology (UIST 2004), pp. 185–188. ACM Press, New York (2004)CrossRefGoogle Scholar
  10. 10.
    Faaborg, A., Lieberman, H.: A Goal-Oriented Web Browser. In: Proc. of the Conference on Human Factors in Computing Systems (CHI 2006), pp. 751–760. ACM Press, New York (2006)Google Scholar
  11. 11.
    Hall, W., Davis, H., Hutchings, G.: Rethinking Hypermedia: The Microcosm Approach. Kluwer Academic Publishers, Norwell (1996)CrossRefGoogle Scholar
  12. 12.
    Dix, A., Catarci, T., Habegger, B., Ioannidis, Y., Kamaruddin, A., Katifori, A., Lepouras, G., Poggi, A., Ramduny-Ellis, D.: Intelligent context-sensitive interactions on desktop and the web. In: Proceedings of the international Workshop in Conjunction with AVI 2006 on Context in Advanced Interfaces, pp. 23–27. ACM Press, New York (2006)Google Scholar
  13. 13.
    Dix, A., Marshall, J.: At the right time: when to sort web history and bookmarks. In: Proc. of HCI International 2003, vol. 1, pp. 758–762 (2003)Google Scholar
  14. 14.
    Haslhofer, B., Hecht, R.: Joining the BRICKS Network - A Piece of Cake. In: The International EVA Conference (2005)Google Scholar
  15. 15.
    Bottoni, P., Civica, R., Levialdi, S., Orso, L., Panizzi, E., Trinchese, R.: MADCOW: a multimedia digital annotation system. In: MADCOW: a multimedia digital annotation system. In Proceedings of the Working Conference on Advanced Visual interfaces, AVI 2004, Gallipoli, Italy, May 25 - 28, 2004, pp. 55–62. ACM, New York (2004)Google Scholar
  16. 16.
    Katifori, A., Vassilakis, C., Daradimos, I., Lepouras, G., Ioannidis, Y., Dix, A., Poggi, A., Catarci, T.: Personal Ontology Creation and Visualization for a Personal Interaction Management System. In: Workshop on The Disappearing Desktop: Personal Information Management 2008. CHI 2008 (2008)Google Scholar
  17. 17.
    Sauermann, L.: The Gnowsis Semantic Desktop for Information Integration. In: The 3rd Conference on Professional Knowledge Management, pp. 39–42 (2005)Google Scholar
  18. 18.
    Katifori, A., Vassilakis, C., Dix, A.: Using Spreading Activation through Ontologies to Support Personal Information Management. In: Common Sense Knowledge and Goal-Oriented Interfaces (CSKGOI 2008) (workshop at 2008 International Conference on Intelligent User Interfaces (IUI 2008). CEUR Workshop Proceedings, vol. 323 (2008)Google Scholar
  19. 19.
    Anderson, J.: A spreading activation theory of memory. Journal of Verbal Learning and Verbal Behaviour 22, 261–295 (1983)CrossRefGoogle Scholar
  20. 20.
    Dix, A., Katifori, A., Poggi, A., Catarci, T., Ioannidis, Y., Lepouras, G., Mora, M.: From Information to Interaction: in Pursuit of Task-centred Information Management. In: DELOS Conference 2007 (2007)Google Scholar
  21. 21.
    Dix, A.: Towards a Ubiquitous Semantics of Interaction: phenomenology, scenarios and traces. In: Forbrig, P., Limbourg, Q., Urban, B., Vanderdonckt, J. (eds.) DSV-IS 2002. LNCS, vol. 2545, pp. 238–252. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  22. 22.
    Dix, A., Finlay, J., Abowd, G., Beale, R.: Human-Computer Interaction, 3rd edn. Prentice Hall, Harlow (2004)zbMATHGoogle Scholar
  23. 23.
    Dix, A., Finlay, J., Abowd, G., Beale, R.: Chaper 15 sides. Online Teaching Resources for Human-Computer Interaction (2004),
  24. 24.
    Asimakopoulos, S., Fildes, R., Dix, A.: Grammatically interpreted task analysis for supply chain forecasting. In: Proceedings of the 10th British HCI Conference, vol. 2, pp. 235–237. British Computer Society (2005)Google Scholar
  25. 25.
    Cypher., A.: Eager: Programming repetitive tasks by example. In: Proc. of the Conference on Human Factors in Computing Systems (CHI 1991), pp. 33–39. ACM Press, New York (1991)Google Scholar
  26. 26.
    Finlay, J., Beale., R.: Neural networks and pattern recognition in human-computer interaction. ACM SIGCHI Bulletin 25(2), 25–35 (1993)CrossRefGoogle Scholar
  27. 27.
    Dix, A., Finlay, J., Beale., R.: Analysis of user behaviour as time series. In: Monk, A., Diaper, D., Harrison, M. (eds.) Proceedings of HCI 1992: People and Computers VII, pp. 429–444. Cambridge University Press, Cambridge (1992)Google Scholar
  28. 28.
    Lieberman, H.: Your wish is my command: programming by example. Morgan Kaufmann, San Francisco (2001)Google Scholar
  29. 29.
    Dix, A., Beale, R., Wood, A.: Architectures to make simple visualisations using simple systems. In: Proceedings of the Working Conference on Advanced Visual interfaces, AVI 2000, pp. 51–60. ACM, New York (2000)Google Scholar
  30. 30.
    Ramduny-Ellis, D., Dix, A., Rayson, P., Onditi, V., Sommerville, I., Ransom, J.: Artefacts as designed, Artefacts as used: resources for uncovering activity dynamics. In: Jones, P., Chisalita, C., van der Veer, G. (eds.) Special Issue on Collaboration in Context: Cognitive and Organizational Artefacts, Cognition, Technology and Work, vol. 7(2), pp. 76–87 (2005)Google Scholar
  31. 31.
    Task Analysis Through Cognitive Archeology Frank Spillers. In: Diaper, D., Stanton, N. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 279–290. Lawrence Erlbaum Associates, Mahwah (2004)Google Scholar
  32. 32.
    Dix, A., Ramduny-Ellis, D., Wilkinson, J.: Trigger Analysis: Understanding Broken Tasks. In: Diaper, D., Stanton, N. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 381–400. Lawrence Erlbaum Associates, Mahwah (2004)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2008

Authors and Affiliations

  • Alan Dix
    • 1
  1. 1.Computing Department, InfoLab21Lancaster UniversityLancasterUK

Personalised recommendations