Skip to main content

Activity Modelling for Low-Intention Interaction

  • Chapter
  • First Online:
The Handbook of Formal Methods in Human-Computer Interaction

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

When modelling user interactions, we normally assume that the user is acting with intention: some very explicit such as opening a valve in a nuclear power station, others more tacit, hardly needing any thought, for example tipping a tablet to turn a page. However, there are also a range of system behaviours that make use of unintentional user actions, where the user acts, but the system decides that the action has meaning, and how to make use of that meaning. Again, these may operate on a variety of levels from ‘incidental interactions’, which operate entirely without the user realising, perhaps subtle changes in search results based on past activity, to more ‘expected interactions’ such as automatic doors that open as you approach. For intentional interaction, there is long-standing advice—making sure that the user can work out what controls do, where information is, interpret the available information, receive feedback on actions—and also long-standing modelling techniques. Low-intention interactions, where the system has more autonomy, require different design strategies and modelling techniques. This chapter presents early steps in this direction. Crucial to this is the notion of two tasks: the sensed task, which the system monitors to gain information and the supported task, which the system augments or aids. First, this chapter demonstrates and develops techniques in the retrospective modelling of a familiar low-intention interaction system, car courtesy lights. These techniques are then applied proactively in the design of a community public display, which is now deployed and in everyday use.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alexander A, Ishikawa S, Silverstein M Ingrid K, Angel S, Jacobsen M (1977) A pattern language. towns, buildings, construction. Oxford University Press. https://archive.org/details/APatternLanguage

  • BBC (2015) Google apologises for Photos app’s racist blunder. BBC News, Technology. http://www.bbc.co.uk/news/technology-33347866. Accessed 1 July 2015

  • Beigl M, Gellersen H, Schmidt A (2001) MediaCups: experience with design and use of computer-augmented everyday objects. Comput Netw 35(4):401–409

    Article  Google Scholar 

  • Benford S, Schnadelbach H, Koleva B, Gaver B, Schmidt A, Boucher A, Steed A, Anastasi R, Greenhalgh C, Rodden T, Gellersen H (2005) Expected, sensed, and desired: a framework for designing sensing-based interaction. ACM Trans Comput-Hum Interact (TOCHI) 12(1):3–30

    Article  Google Scholar 

  • Biggs J (2012) Augmented reality explorer Steve Mann assaulted at Parisian McDonald’s. TechCrunch. http://techcrunch.com/2012/07/16/augmented-reality-explorer-steve-mann-assaulted-at-parisian-mcdonalds/. Accessed 16 July 2012

  • Boer L, Donovan J (2012) Provotypes for participatory innovation. In: Proceedings of the DIS ‘12. ACM, p. 388–397. 2012. doi:10.1145/2317956.2318014

  • Bruegger P, Lisowska A, Lalanne D, Hirsbrunner B (2010) Enriching the design and prototyping loop: a set of tools to support the creation of activity-based pervasive applications. J Mobile Multim 6(4):339–360

    Google Scholar 

  • Bruegger P (2011). uMove: a wholistic framework to design and implement ubiquitous computing systems supporting user’s activity and situation. PhD thesis, University of Fribourg, Switzerland. http://doc.rero.ch/record/24442

  • Council of the European Union (2016) Position of the council on general data protection regulation. 8 April 2016. http://www.europarl.europa.eu/sed/doc/news/document/CONS_CONS(2016)05418(REV1)_EN.docx

  • Dey A (2001) Understanding and using context. Pers Ubiquit Comput J 5(1):4–7

    Article  MathSciNet  Google Scholar 

  • Dix A (1990) Information processing, context and privacy. In: Diaper G, Cockton G, Shakel B (eds) Human-computer interaction—INTERACT’90 North-Holland. pp 15–20. http://alandix.com/academic/papers/int90/

  • Dix A (1991) Formal methods for interactive systems. Academic Press, London. ISBN 0-12-218315-0. http://www.hiraeth.com/books/formal/

  • Dix A (1992) Human issues in the use of pattern recognition techniques. In: Beale R, Finlay J (eds) Neural networks and pattern recognition in human computer interaction, Ellis Horwood, pp 429–451. http://alandix.com/academic/papers/neuro92/neuro92.html

  • Dix A, Abowd G (1996) Modelling status and event behaviour of interactive systems. Softw Eng J 11(6):334–346

    Article  Google Scholar 

  • Dix A, Rodden T, Davies N, Trevor J, Friday A, Palfreyman K (2000a) Exploiting space and location as a design framework for interactive mobile systems. ACM Trans Comput-Hum Interact (TOCHI) 7(3):285–321

    Article  Google Scholar 

  • Dix A, Beale R, Wood A (2000b). Architectures to make simple visualisations using simple systems. In: Proceedings of the Working Conference on Advanced visual interfaces (AVI ‘00). ACM, New York, USA, pp 51–60. doi:http://dx.doi.org/10.1145/345513.345250

  • Dix A (2002) Beyond Intention—pushing boundaries with incidental interaction. In: Proceedings of building bridges: interdisciplinary context-sensitive computing. Glasgow University. http://alandix.com/academic/papers/beyond-intention-2002/. Accessed 9 Sept 2002

  • Dix A, Finlay J, Abowd G, Beale R (2004) Modeling rich interaction. Chapter 18 in Human–computer interaction, 3rd edn. Prentice Hall, Englewood Cliffs. http://www.hcibook.com/e3/

  • Dix A (2006) Car courtesy lights—designing incidental interaction. Case study in HC Book online! 2004/2006. http://www.hcibook.com/e3/casestudy/car-lights/

  • Dix A, Leite J, Friday A (2007). XSED—XML-based description of status-event components and systems. In: Proceedings of engineering interactive systems 2007, IFIP WG2.7/13.4 conference, Salamanca, March 22–24, 2007, LNCS, vol 4940, pp 210–226

    Google Scholar 

  • Dostal J, Dix A (2011) Tiree tech wave. Interfaces, Summer 2011, pp 16–17 http://tireetechwave.org/events/ttw-1/interfaces-article/

  • Forbrig P, Märtin C, Zaki M (2013). Special challenges for models and patterns in smart environments. In: Kurosu M (ed) Proceedings of the 15th international conference on human-computer interaction: human-centred design approaches, methods, tools, and environments - Volume Part I (HCI’13), vol Part I. Springer, Berlin, pp 340–349

    Google Scholar 

  • Gamma E, Helm R, Johnson R, Vlissides J (1995) Design patterns: elements of reusable object-oriented software. Addison-Wesley, Longman

    Google Scholar 

  • Gellersen H, Beigl M, Krull H (1999) The MediaCup: awareness technology embedded in an everyday object. In: International Symposium on Handheld and Ubiquitous Computing (HUC99) Karlsruhe, Germany

    Google Scholar 

  • Ghazali M, Dix A (2006) Natural inverse: physicality, interaction & meaning. In: Let’s get physical: tangible interaction and rapid prototyping in, for, and about design workshop at 2nd international conference on design computing & cognition 2006, TU/e Eindhoven. http://alandix.com/academic/papers/DCC-2006-LGP-natural-inverse/. Accessed 8–12 July 2006

  • Gibbs S (2015) Google says sorry over racist Google Maps White House search results. The Guardian, 20 May 2015. http://www.theguardian.com/technology/2015/may/20/google-apologises-racist-google-maps-white-house-search-results

  • Goodman B, Flaxman S (2016) EU regulations on algorithmic decision-making and a “right to explanation”. Presented at 2016 ICML workshop on human interpretability in machine learning (WHI 2016), New York, NY. http://arxiv.org/abs/1606.08813v1

  • Green T, Petre M M (1996) Usability analysis of visual programming environments: a ‘cognitive dimensions’ framework. J Visual Lang Comput 7(2):131–174. doi:10.1006/jvlc.1996.0009

    Article  Google Scholar 

  • Greenfield A (2006) Everyware: the dawning age of ubiquitous computing. Peachpit Press, Berkeley

    Google Scholar 

  • Heidegger M (1927) Sein und Zeit,. (English translation: Being and Time. Harper, 2008)

    Google Scholar 

  • Hern A (2015) Flickr faces complaints over ‘offensive’ auto-tagging for photos. The Guardian, 20 May 2015. http://www.theguardian.com/technology/2015/may/20/flickr-complaints-offensive-auto-tagging-photos

  • Hinze A, Malik P, Malik R (2006) Interaction design for a mobile context-aware system using discrete event modelling. In: Proceedings of the 29th Australasian computer science conference, vol 48 (ACSC ‘06), Vladimir Estivill-Castro and Gillian Dobbie (Eds.), Vol. 48. Australian Computer Society, Inc., Darlinghurst, Australia, Australia, p 257–266

    Google Scholar 

  • Hutchins E, Holland J, Norman D (1986) Direct manipulation interfaces. In: Norman DA, Draper SW (eds) User centered system design. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 87–124

    Google Scholar 

  • Hutchinson H, Mackay W, Westerlund B, Bederson B, Druin A, Plaisant C, Beaudouin-Lafon M. Conversy S, Evans H, Hansen H, Roussel N, Eiderbäck B (2003) Technology probes: inspiring design for and with families. In CHI’03: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 17–24

    Google Scholar 

  • Ju W, Leifer L (2008) The design of implicit interactions: making interactive systems less obnoxious. Des Issues 24(3):72–84. doi:10.1162/desi.2008.24.3.72

    Article  Google Scholar 

  • Kingma B, van Marken Lichtenbelt W (2015) Energy consumption in buildings and female thermal demand. Nat Clim Change 5:1054–1056. doi:10.1038/nclimate2741

    Article  Google Scholar 

  • Mann S, Nolan J, Wellman B (2003) Sousveillance: inventing and using wearable computing devices for data collection in surveillance environments. Surv Soc 1(3):331–355. http://www.surveillance-and-society.org/articles1(3)/sousveillance.pdf

  • Mori M (1970). The uncanny valley. Energy 7(4):33–35. (in Japanese). Translated MacDorman, K. and Kageki, N. (2012) IEEE Spectrum, 12 Jun 2012. http://spectrum.ieee.org/automaton/robotics/humanoids/the-uncanny-valley

  • Newman W, Eldridge M, Lamming M (1991). Pepys: generating autobiographies by automatic tracking. In: Proceedings of the second European conference on computer supported cooperative work—ECSCW ‘91, 25–27 Sept 1991, Kluwer Academic Publishers, Amsterdam, pp 175–188

    Google Scholar 

  • Nielsen J (1993) Usability engineering. Academic Press, San Diego

    MATH  Google Scholar 

  • Norman D (1990) The design of everyday things. Doubleday, New York

    Google Scholar 

  • Norman D (2010). Natural user interfaces are not natural. Interactions 17(3):6–10. doi:10.1145/1744161.1744163

  • Pallotta V, Bruegger P, Hirsbrunner B (2008) Kinetic user interfaces: physical embodied interaction with mobile ubiquitous computing systems. In: Kouadri-Mostéfaoui S, Maamar M, Giaglis P (eds) Advances in Ubiquitous computing: future paradigms and directions. IGI Global Publishing, pp 201–228. ISBN: 978-1-599-04840-6

    Google Scholar 

  • Paterno F (2012) Model-based design and evaluation of interactive applications. Springer

    Google Scholar 

  • Popper B (2012) New evidence emerges in alleged assault on cyborg at Paris McDonald’s. The Verge. http://www.theverge.com/2012/7/19/3169889/steve-mann-cyborg-assault-mcdonalds-eyetap-paris. Accessed 19 July 2012

  • Rehman K, Stajano F, Coulouris G (2007) An architecture for interactive context-aware applications. IEEE Perv Comput 6(1):73–80. doi:http://dx.doi.org/10.1109/MPRV.2007.5

  • Salber D, Dey A, Abowd G (1999) The context toolkit: aiding the development of context-enabled applications. In: Proceedings of the 1999 conference on human factors in computing systems (CHI ‘99), Pittsburgh, PA, 15–20 May 1999, pp 434–441

    Google Scholar 

  • Schmidt A (2013) Context-aware computing. The encyclopedia of human–computer interaction, 2nd edn. In: Soegaard M, Friis R (eds) Interaction design foundation. https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed/context-aware-computing-context-awareness-context-aware-user-interfaces-and-implicit-interaction

  • Schmidt A (2000) Implicit human computer interaction through context. Pers Technol 4(2–3):191–199. doi:10.1007/BF01324126

    Article  MathSciNet  Google Scholar 

  • Schilit B, Adams N, Want R (1994). Context-aware computing applications. In: Proceedings of the 1994 first workshop on mobile computing systems and applications (WMCSA ‘94). IEEE Computer Society, Washington, DC, USA, pp 85–90. doi:http://dx.doi.org/10.1109/WMCSA.1994.16

  • Shepherd A (1989) Analysis and training in information technology tasks. In: Diaper D (ed) Task analysis for human-computer interaction, Chapter 1. Ellis Horwood, Chichester, pp 15–55

    Google Scholar 

  • Shneiderman B (1982) The future of interactive systems and the emergence of direct manipulation. Behav Inf Technol 1(3):237–256

    Article  Google Scholar 

  • Shneiderman B (1998) Designing the user interface—Strategies for effective human-computer interaction, 3rd edn. Addison Wesley

    Google Scholar 

  • Tang L, Yu Z, Wang H, Zhou X, Duan Z (2014) Methodology and tools for pervasive application development. Int J Distrib Sens Netw 10(4). http://dx.doi.org/10.1155/2014/516432

  • Want R, Schilit B, Adams N, Gold R, Petersen K, Goldberg D, Ellis J, Weiser M (1995) An overview of the PARCTAB ubiquitous computing experiment. IEEE Pers Commun 2(6):28–43. doi:10.1109/98.475986

  • Wigdor D, Wixon D (2011) Brave NUI world: designing natural user interfaces for touch and gesture. Morgan Kaufmann

    Google Scholar 

  • Wilde A, Pascal B, Hirsbrunner B (2010) An overview of human-computer interaction patterns in pervasive systems. In: International conference on user science and engineering 2010 (i-USEr 2010), Sha-Allam, Malaysia, 13–15 Dec 2010

    Google Scholar 

  • Wurdel M (2011) An integrated formal task specification method for smart environments. University of Rostock. ISBN:978-3-8325-2948-2

    Google Scholar 

Download references

Acknowledgements

Many thanks to Rory Gianni who created the Internet-enabled open sign.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alan Dix .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Dix, A. (2017). Activity Modelling for Low-Intention Interaction. In: Weyers, B., Bowen, J., Dix, A., Palanque, P. (eds) The Handbook of Formal Methods in Human-Computer Interaction. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-51838-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-51838-1_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-51837-4

  • Online ISBN: 978-3-319-51838-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics