Skip to main content

The Shopping Experience of Tomorrow: Human-Centered and Resource-Adaptive

  • Chapter
  • First Online:

Part of the book series: Cognitive Technologies ((COGTECH))

Abstract

What would the shopping experience of tomorrow look like? In this chapter we propose several human-centered and resource-adaptive ideas to this question. Throughout the whole chapter we explain our ideas with the recurrent theme of a shop that consists of instrumented shelves, public displays, audio systems, and mobile devices for each user.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aaker, J. Dimensions of brand personality. Journal of Marketing Research, 34(3):342–352 (1997).

    Article  Google Scholar 

  2. André, E., Klesen, M., Gebhard, P., Steve Allen, T.R. Integrating models of personality and emotions into lifelike characters. In A. Paiva, C. Martinho (Eds.), Proceedings of the Workshop on Affect in Interactions – Towards a New Generation of Interfaces in Conjunction with the 3rd i3 Annual Conference (pp. 136–149). Italy: Siena (1999).

    Google Scholar 

  3. Arons, B. A review of the cocktail party effect. Journal of the American Voice I/O Society, 12:35–50 (1992).

    Google Scholar 

  4. Barrington, L., Lyons, M., Diegmann, D., Abe, S. Ambient display using musical effects. In IUI ’06: Proceedings of the 11th International Conference on Intelligent User Interfaces (pp. 372–374). ACM Press, New York, USA (2006).

    Google Scholar 

  5. Becker, P. Structural and relational analyses of emotion and personality traits. Zeitschrift für Differentielle und Diagnostische Psychologie, 22(3):155–172 (2001).

    Article  Google Scholar 

  6. Blattner, M., Sumikawa, D., Greenberg, R. Earcons and icons: Their structure and common design principles. Human Computer Interaction, 4:11–44 (1989).

    Article  Google Scholar 

  7. Brandherm, B. Eingebettete dynamische Bayessche Netze n-ter Ordnung. PhD thesis, Computer Science Institute, Saarland University, Germany (2006).

    Google Scholar 

  8. Brandherm, B., Schwartz, T. Geo referenced dynamic bayesian networks for user positioning on mobile systems. In Proceedings of the International Workshop on Location- and Context-Awareness (LoCA), LNCS 3479, volume 3479/2005 of Lecture Notes in Computer Science (pp. 223–234). Springer-Verlag Berlin Heidelberg, Munich, Germany (2005).

    Google Scholar 

  9. Brandherm, B., Schwartz, T. Geo referenced dynamic Bayesian networks for user positioning on mobile systems. In T. Strang, C. Linnhoff-Popien (Eds.), Proceedings of the International Workshop on Location- and Context-Awareness (LoCA), LNCS 3479, volume 3479/2005 of Lecture Notes in Computer Science (pp. 223–234). Springer-Verlag Berlin Heidelberg, Munich, Germany (2005).

    Google Scholar 

  10. Bregman, A. Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press (1990).

    Google Scholar 

  11. Brewster, S. Using non-speech sounds to provide navigation cues. ACM Transactions on Computer–Human Interaction, 5:224–259 (1998).

    Article  MathSciNet  Google Scholar 

  12. Bruner, G.C. Music, mood, and marketing. Journal of Marketing, 54:94–104 (1990).

    Article  Google Scholar 

  13. Butz, A., Jung, R. Seamless user notification in ambient soundscapes. In IUI ’05: Proceedings of the 10th International Conference on Intelligent User Interfaces (pp. 320–322). ACM Press, New York, NY, USA (2005).

    Google Scholar 

  14. Buxton, W., Gaver, W., Bly, S. Tutorial chapter 6: The use of non-speech audio at the interface. In Proceedings of Computer Human Interaction (CHI). ACM Press; Addison-Wesley, New Orleans (1991).

    Google Scholar 

  15. Camurri, A., Leman, M. Gestalt-based composition and performance in multimodal environments. In Joint International Conference on Cognitive and Systematic Musicology (pp. 495–508) (1996).

    Google Scholar 

  16. Cherry, E.C. Some experiments on the recognition of speech, with one and two ears. Journal of the Acoustic Society of America, 25:975–979 (1953).

    Article  Google Scholar 

  17. Costa, P., McCrae, R. The Neo Personality Inventory Manual. Odersa, FL: Psychological Assessment Resources (1985).

    Google Scholar 

  18. Davidson, R. On Emotion, mood, and related affective constructs. The nature of Emotion: Fundamental Questions (pp. 51–55). New York: Oxford University Press (1994).

    Google Scholar 

  19. Davies, J. The Psychology of Music. London: Hutchinson (1978).

    Google Scholar 

  20. Duggan, B., Deegan, M. Considerations in the usage of text to speech (tts) in the creation of natural sounding voice enabled web systems. In ISICT ’03: Proceedings of the 1st International Symposium on Information and Communication Technologies (pp. 433–438). Trinity College Dublin, Ireland (2003).

    Google Scholar 

  21. Eysenck, M., Keane, M. Cognitive Psychology: A Student–s Handbook. Hove: Psychology Press (2005).

    Google Scholar 

  22. Feld, M. Erzeugung von Sprecherklassifikationsmodulen für multiple Plattformen, Diploma Thesis, Soarland University (2006).

    Google Scholar 

  23. Fiske, S., Taylor, S. Social Cognition. New York: McGraw-Hill (1991).

    Google Scholar 

  24. Garofolo, J. e. A. DARPA TIMIT CD-ROM: An Acoustic Phonetic Continous Speech Database. Gaithersburg, MD, USA: National Institute of Standards and Technology (1998).

    Google Scholar 

  25. Gebhard, P. Alma – a layered model of affect. In F. Dignum, V. Dignum, S. Koenig, S. Kraus, M. P. Singh, M. Wooldridge (Eds.), Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems (pp. 29–36) (June 2005).

    Google Scholar 

  26. Gill, A.J., Oberlander, J., Austin, E. The perception of e-mail personality at zero-acquaintance. Personality and Individual Differences, 40:497–507 (2006).

    Article  Google Scholar 

  27. Heckmann, D. Ubiquitous user modeling. PhD thesis, Department of Computer Science, Saarland University, Germany, DISKI 297, ISBN 3898382974, Aka Verlag (2005).

    Google Scholar 

  28. Heckmann, D., Schwartz, T., Brandherm, B., Kröner, A. Decentralized User Modeling with UserML and GUMO (pp. 61–66). Scotland: Edinburgh (2005).

    Google Scholar 

  29. Johanson, B., Fox, A. The event heap: A coordination infrastructure for interactive workspaces. In Proceedings of the Workshop on Mobile Computing Systems and Applications (2002).

    Google Scholar 

  30. Jung, R., Butz, A. Effectiveness of user notification in ambient soundscapes. In Proceedings of the workshop on Auditory Displays for Mobile Context-Aware Systems at Pervasive 2005 (pp. 47–56). Munich, Germany (2005).

    Google Scholar 

  31. Jung, R., Heckmann, D. Ambient audio notification with personalized music. In Workshop on Ubiquitous User Modeling at ECAI 2006 (pp. 16–18). Riva del Garda, Italy (2006).

    Google Scholar 

  32. Jung, R., Schwartz, T. A location-adaptive human-centered audio email notification service for multi-user environments. In J.A. Jacko (Ed.), Human–Computer Interaction, vol. 4552 of LNCS (pp. 340–348). New York: Springer (2007).

    Google Scholar 

  33. Jung, R., Schwartz, T. Peripheral notification with customized embedded audio cues. In Proceedings of the 13th International Conference on Auditory Displays (pp. 221–228). Schulich School of Music, McGill University, Montreal, Canada (2007).

    Google Scholar 

  34. Krause, R. Affekt, Emotion, Gefühl (2nd edn., pp. 30–36). Stuttgart: Kohlhammer (2002).

    Google Scholar 

  35. Legaspi, R., Hashimoto, Y., Moriyama, K., Kurihara, S., Numao, M. Music compositional intelligence with an affective flavor. In Proceedings of Conference on Intelligent User Interfaces (IUI) (2007).

    Google Scholar 

  36. McCrae, R., John, O. An introduction to the five-factor model and its applications. Journal of Personality, 60:175–215 (1992).

    Article  Google Scholar 

  37. McRae, R., John, O. An introduction to the five-factor model and its applications. Journal of Personality, 60:175–215 (1992).

    Article  Google Scholar 

  38. Mehrabian, A. Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology: Developmental, Learning, Personality, Social, 14:261–292 (1996).

    MathSciNet  Google Scholar 

  39. Morris, W.N. Mood The Frame of Mind. New York: Springer (1989).

    Google Scholar 

  40. Müller, C. Zweistufige kontextsensitive Sprecherklassifikation am Beispiel von Alter und Geschlecht [Two-layered Context-Sensitive Speaker Classification on the Example of Age and Gender]. PhD thesis, Computer Science Institute, University of the Saarland, Germany (2005).

    Google Scholar 

  41. Müller, C., Feld, M. Towards a multilingual approach on speaker classification. In Proceedings of the 11th International Conference “Speech and Computer” SPECOM 2006 (pp. 120–124). Anatolya Publishers, St. Petersburg, Russia (2006).

    Google Scholar 

  42. Nass, C., Isbister, K., Lee, E.-J. Truth is beauty: Researching embodied conversational agents. Embodied conversational agents (pp. 374–402). Cambridge, MA: MIT Press (2000).

    Google Scholar 

  43. Nijholt, A., Rist, T., Tuijnenbreijer, K. Lost in Ambient Intelligence? Panel Session. In Proceedings of CHI’04 (pp. 1725–1726). ACM, New York (2004).

    Google Scholar 

  44. North, A., MacKenzie, L., Hargreaves, D. The effects of musical and voice “fit” on responses to advertisements. Journal of Applied Social Psychology, 34(8):1675–1708 (2004).

    Article  Google Scholar 

  45. Nowson, S. The langauge of weblogs: A study of genre and individual differences. PhD thesis, University of Edinburgh. College of Science and Engineering. School of Informatics. (2006).

    Google Scholar 

  46. O’Conaill, B., Frohlich, D. Timespace in the workplace: dealing with interruptions. In CHI ’95: Conference Companion on Human Factors in Computing Systems (pp. 262–263). ACM Press, New York, NY, USA (1995).

    Google Scholar 

  47. Ortony, A., Clore, G.L., Collins, A. The Cognitive Structure of Emotions. Cambridge, MA: Cambridge University Press (1988).

    Book  Google Scholar 

  48. Pennebaker, J., King, L. Linguistic styles: Language use as an individual difference. Journal of Personality and Social Psychology, 77:1296–1312 (1999).

    Article  Google Scholar 

  49. Pinhanez, C. The everywhere displays projector: A device to create ubiquitous graphical interfaces. Lecture Notes in Computer Science (2001).

    Google Scholar 

  50. Reeves, B., Nass, C. The Media Equation: How People Treat Computers, Television, and New Media like Real People and Places. Cambridge, MA: CSLI Publications and Cambridge university press (1996).

    Google Scholar 

  51. Reybrouck, M. Gestalt concepts and music: Limitations and possibilities. In Joint International Conference on Cognitive and Systematic Musicology (pp. 57–69) (1996).

    Google Scholar 

  52. Scherer, K., Zentner, M. Music and Emotion: Theory and Research (Chapter 16, pp. 361–392). Oxford, England: Oxford University Press (2001).

    Google Scholar 

  53. Schiel, F. Speech and speech-related resources at BAS. In Proceedings of the First International Conference on Language Resources and Evaluation (pp. 343–349). Granada, Spain (1998).

    Google Scholar 

  54. Schmitz, M., Butz, A. Safir: Low-cost spatial audio for instrumented environments. In Proceedings of the 2nd International Conference on Intelligent Environments. Athens, Greece, (2006).

    Google Scholar 

  55. Schmitz, M., Krüger, A., Schmidt, S. Modelling personality in voices of talking products through prosodic parameters. In Proceedings of the 10th International Conference on Intelligent User Interfaces (pp. 313–316) (2007).

    Google Scholar 

  56. Schneider, M. A smart shopping assistant utilising adaptive plan recognition. In Proceedings of the Workshop ‘Adaptivität und Benutzermodellierung in interaktiven Softwaresystemen’ (ABIS) at LLWA (2003).

    Google Scholar 

  57. Schröder, M., Grice, M. Expressing vocal effort in concatenative synthesis. In Proceedings of the 15th International Conference of Phonetic Sciences (pp. 2589–2592) (2003).

    Google Scholar 

  58. Schwartz, T., Brandherm, B., Heckmann, D. Calculation of the user-direction in an always best positioned mobile localization system. In Proceedings of the International Workshop on Artificial Intelligence in Mobile Systems (AIMS). Salzburg, Austria (September 2005).

    Google Scholar 

  59. Spassova, L. Fluid Beam – A Steerable Projector and Camera Unit. Student and Newbie Colloquium at ISWC/ISMAR (2004).

    Google Scholar 

  60. W3C-EMMA. EMMA: Extensible MultiModal Annotation markup language. W3C Working Draft, 9 April 2007, http://www.w3.org/TR/emma/, last accessed: 31.10.2007 (2007).

  61. Wasinger, R. (Ed.) Multimodal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations. Akademische Verlagsgesellschaft, Berlin, Germany (2006).

    Google Scholar 

  62. Wasinger, R., Krüger, A., Jacobs, O. Integrating intra and extra gestures into a mobile and multimodal shopping assistant. In Proceedings of the 3rd International Conference on Pervasive Computing (pp. 297–314) (2005).

    Google Scholar 

  63. Wasinger, R., Krüger, A., Jacobs, O. Integrating intra and extra gestures into a mobile and multimodal shopping assistant. International Conference on Pervasive Computing (2005).

    Google Scholar 

  64. Watson, D., Clark, L.A. On traits and temperament: General and specific factors of emotional experience and their relation to the five-factor model. Journal of Personality, 2(60): 441–476 (1992).

    Article  Google Scholar 

Download references

Acknowledgments

The research project BAIR was supported by the German Research Foundation (DFG) in its Collaborative Research Center on Resource-Adaptive Cognitive Processes, SFB 378, Project EM 4. We also would like to thank the Transfer Unit on Cognitive Technologies for Real-Life Applications, TFB53, Project TB2, RENA for their cooperation in the research on indoor navigation solutions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wolfgang Wahlster .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wahlster, W. et al. (2010). The Shopping Experience of Tomorrow: Human-Centered and Resource-Adaptive. In: Crocker, M., Siekmann, J. (eds) Resource-Adaptive Cognitive Processes. Cognitive Technologies. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89408-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89408-7_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89407-0

  • Online ISBN: 978-3-540-89408-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics