Personal and Ubiquitous Computing

, Volume 18, Issue 7, pp 1721–1735 | Cite as

Situated and mobile displays for reflection on shopping and nutritional choices

  • Wolfgang ReitbergerEmail author
  • Wolfgang Spreicer
  • Geraldine Fitzpatrick
Original Article


In this paper, we explore the use of peoples’ shopping data to raise awareness and to enable reflection about nutrition. In order to ground our Nutriflect approach, we conducted 125 structured interviews in grocery stores. Informed by the results of this exploratory study, we designed a system that shows a household’s collective food consumption patterns via situated displays in the home and through mobile devices in-store. The system aimed to minimize the need for manual entry of nutrition-related data by the users. To evaluate our system, we conducted a 4-week field study in eight households with 21 inhabitants and situated in-store shopping inquiries with a subset of 9 of these users, using actual shopping data from participants. In these studies, we identified issues regarding the interaction design of Internet of Things applications and explored the use of complementary distributed displays to provide tailored cues in context. The approach taken showed the potential to foster reflection about shopping and nutritional choices and for integration with people’s everyday practices.


Nutrition Shopping Behaviour change Reflection Mobile Display ecology 


  1. 1.
    Duhigg C (2012) How companies learn your secrets. The New York Times, New YorkGoogle Scholar
  2. 2.
    Kimokoti RW, Millen BE (2011) Diet, the global obesity epidemic, and prevention. J Am Diet Assoc 111:1137–1140CrossRefGoogle Scholar
  3. 3.
    World Health Organization (2004) Global strategy on diet, physical activity and health. WHO, Geneva.
  4. 4.
    Broll G, Rukzio E, Paolucci M, Wagner M, Schmidt A, Hussmann H (2009) Perci: pervasive service interaction with the internet of things. Internet Comput IEEE 13:74–81CrossRefGoogle Scholar
  5. 5.
    Ailisto H, Isomursu M, Tuikka T, Häikiö J (2009) Experiences from interaction design for NFC applications. J Ambient Intell Smart Environ 1:351–364Google Scholar
  6. 6.
  7. 7.
  8. 8.
  9. 9.
    Möller A, Diewald S, Roalter L, Kranz M (2012) MobiMed: comparing object identification techniques on smart phones. Proceedings of the 7th Nordic conference on human–computer interaction: making sense through design (NordiCHI ‘12). ACM, New York, NY, USA, pp 31–40Google Scholar
  10. 10.
    Ceipidor UB, Medaglia CM, Opromolla A, Volpi V, Moroni A, Sposato S (2012) A survey about user experience improvement in mobile proximity payment. 2012 4th International Workshop on near field communication (NFC), pp 51–56Google Scholar
  11. 11.
    Hang A, Broll G, Wiethoff A (2010) Visual design of physical user interfaces for NFC-based mobile interaction. Proceedings of the 8th ACM conference on designing interactive systems (DIS ‘10). ACM, New York, NY, pp 292–301CrossRefGoogle Scholar
  12. 12.
    Wisneski C, Ishii H, Dahley A, Gorbet MG, Brave S, Ullmer B, Yarin P (1998) Ambient displays: turning architectural space into an interface between people and digital information. Proceedings of CoBuild ‘98, pp 22–32Google Scholar
  13. 13.
    Reitberger W, Obermair C, Ploderer B, Meschtscherjakov A, Tscheligi M (2007) Enhancing the shopping experience with ambient displays: a field study in a retail store. Ambient intelligence, vol 4794/2007. Springer, Berlin, pp 314–331Google Scholar
  14. 14.
    Alt F, Muller J, Schmidt A (2012) Advertising on public display networks. Computer 45:50–56CrossRefGoogle Scholar
  15. 15.
    Kalnikaite V, Kreitmayer S, Rogers Y, Bird J, Villar N, Bachour K, Payne S, Todd PM, Schöning J, Krüger A (2011) How to nudge in situ: designing lambent devices to deliver salient information in supermarkets. UbiComp ‘11. ACM Press, New York, p 11Google Scholar
  16. 16.
    von Reischach F, Dubach E, Michahelles F, Schmidt A (2010) An evaluation of product review modalities for mobile phones. Proceedings of the 12th international conference on Human computer interaction with mobile devices and services. ACM, Lisbon, PortugalGoogle Scholar
  17. 17.
    Gaver W, Boucher A, Law A, Pennington S, Bowers J, Beaver J, Humble J, Kerridge T, Villar N, Wilkie A (2008) Threshold devices: looking out from the home. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Florence, Italy, pp 1429–1438Google Scholar
  18. 18.
    Gustafsson A, Gyllenswärd M (2005) The power-aware cord: energy awareness through ambient information display. In: CHI ‘05 extended abstracts on human factors in computing systems. ACM, New York, pp 1423–1426Google Scholar
  19. 19.
    Kjeldskov J, Skov MB, Paay J, Pathmanathan R (2012) Using mobile phones to support sustainability: a field study of residential electricity consumption. Proceedings of the 2012 ACM annual conference on human factors in computing systems, pp 2347–2356. ACM, Austin, TexasGoogle Scholar
  20. 20.
    Erickson T, Podlaseck M, Sahu S, Dai JD, Chao T, Naphade M (2012) The dubuque water portal: evaluation of the uptake, use and impact of residential water consumption feedback. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Austin, pp 675–684Google Scholar
  21. 21.
    Terrenghi L, Quigley A, Dix A (2009) A taxonomy for and analysis of multi-person-display ecosystems. Personal Ubiquitous Comput 13:583–598CrossRefGoogle Scholar
  22. 22.
    Huang EM, Mynatt ED, Trimble JP (2006) Displays in the wild: understanding the dynamics and evolution of a display ecology. Proceedings of the 4th international conference on pervasive computing. Springer, BerlinGoogle Scholar
  23. 23.
    Wigdor D (2010) Architecting next-generation user interfaces. Proceedings of the international conference on advanced visual interfaces. ACM, New York, NYGoogle Scholar
  24. 24.
    Fogg BJ (2003) Persuasive technology: using computers to change what we think and do. Morgan Kaufmann Publishers Inc., San FranciscoGoogle Scholar
  25. 25.
    Oinas-Kukkonen H (2013) A foundation for the study of behavior change support systems. Pers Ubiquitous Comput 17(6):1223–1235Google Scholar
  26. 26.
    Reitberger W, Ploderer B, Obermair C, Tscheligi M (2007) The perCues framework and its application for sustainable mobility. Persuasive, vol 4744. Springer, Palo Alto, California, pp. 92–95Google Scholar
  27. 27.
    Fogg BJ (2006) The six most powerful persuasion strategies. Persuasive, vol 3962. Springer, Eindhoven, p 6Google Scholar
  28. 28.
    Zajonc RB (1965) Social facilitation. Science 149:269–274CrossRefGoogle Scholar
  29. 29.
    Festinger L (1954) A theory of social comparison processes. Hum Relat 7(2):117–140CrossRefGoogle Scholar
  30. 30.
    Lin J, Mamykina L, Lindtner S, Delajoux G, Strub H (2006) Fish‘n’Steps: encouraging physical activity with an interactive computer game. In: Dourish P, Friday A (eds) UbiComp 2006: ubiquitous computing, vol 4206. Springer, Berlin, pp. 261-278Google Scholar
  31. 31.
    Consolvo S, McDonald DW, Toscos T, Chen MY, Froehlich J, Harrison B, Klasnja P, LaMarca A, LeGrand L, Libby R, Smith I, Landay JA (2008) Activity sensing in the wild: a field trial of ubifit garden. Proceedings of the twenty-sixth annual SIGCHI conference on human factors in computing systems. ACM, Florence, pp. 1797–1806Google Scholar
  32. 32.
    Froehlich J, Findlater L, Ostergren M, Ramanathan S, Peterson J, Wragg I, Larson E, Fu F, Bai M, Patel S, Landay JA (2012) The design and evaluation of prototype eco-feedback displays for fixture-level water usage data. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Austin, Texas, pp 2367–2376Google Scholar
  33. 33.
    Fox S, Duggan M (2013) Tracking for health report. Pew Research Center, WashingtonGoogle Scholar
  34. 34.
    Thaler RH, Sunstein CR (2008) Nudge: improving decisions about health, wealth, and happiness. Yale University Press, New HavenGoogle Scholar
  35. 35.
    Lee MK, Kiesler S, Forlizzi J (2011) Mining behavioral economics to design persuasive technology for healthy choices. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Vancouver, BC, pp 325–334Google Scholar
  36. 36.
    Siek KA, Connelly KH, Rogers Y, Rohwer P, Lambert D, Welch JL (2006) When do we eat? An evaluation of food items input into an electronic food monitoring application. In: Pervasive health conference and workshops, pp 1–10Google Scholar
  37. 37.
    Tsai CC, Lee G, Raab F, Norman GJ, Sohn T, Griswold WG, Patrick K (2007) Usability and feasibility of PmEB: a mobile phone application for monitoring real time caloric balance. Mob Netw Appl 12:173–184CrossRefGoogle Scholar
  38. 38.
    Andrew AH, Borriello G, Fogarty J (2013) Simplifying mobile phone food diaries. PervasiveHealth. Venice, Italy, pp 260–263Google Scholar
  39. 39.
    Kong F, Tan J (2012) DietCam: automatic dietary assessment with mobile camera phones. Pervasive Mobile Comput 8:147–163CrossRefGoogle Scholar
  40. 40.
    Noronha J, Hysen E, Zhang H, Gajos KZ (2011) Platemate: crowdsourcing nutritional analysis from food photographs. Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, Santa Barbara, pp 1–12Google Scholar
  41. 41.
    Pässler S, Wolff M, Fischer W-J (2011) Food intake recognition conception for wearable devices. Proceedings of the first ACM MobiHoc workshop on pervasive wireless healthcare. ACM, Paris, pp 1–4Google Scholar
  42. 42.
    Mansour A, Barve M, Bhat S, Do EY-L (2009) MunchCrunch. Proceedings of the 8th international conference on interaction design and children—IDC ‘09. ACM Press, New York, p 166Google Scholar
  43. 43.
    Grimes A, Landry BM, Grinter RE (2010) Characteristics of shared health reflections in a local community. Proceedings of the 2010 ACM conference on computer supported cooperative work—CSCW ‘10. ACM Press, New York, NY, p 435Google Scholar
  44. 44.
    Ganglbauer E, Fitzpatrick G, Molzer G (2012) Creating visibility: understanding the design space for food waste. In Proceedings of the 11th international conference on mobile and ubiquitous multimedia. ACM, New York, pp 1–10Google Scholar
  45. 45.
    Adams M, Winter R (2012) Shopper engagement study. POPAI the global association for marketing at retailGoogle Scholar
  46. 46.
    Die Ernährungspyramide im Detail—7 Stufen zur Gesundheit. Bundesministerium für Gesundheit.
  47. 47.
    Reitberger W, Spreicer W, Fitzpatrick G (2014) Nutriflect: reflecting collective shopping behavior and nutrition. Proceedings of the 2014 SIGCHI conference on human factors in computing systems, ACM, Vancouver, pp 3309–3318Google Scholar
  48. 48.
    Comber R, Hoonhout J, Halteren AV, Moynihan P, Olivier P (2013) Food practices as situated action: exploring and designing for everyday food practices with households. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Paris, pp 2457–2466Google Scholar

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  • Wolfgang Reitberger
    • 1
    Email author
  • Wolfgang Spreicer
    • 1
  • Geraldine Fitzpatrick
    • 1
  1. 1.Institute for Design and Assessment of TechnologyVienna University of TechnologyViennaAustria

Personalised recommendations