Skip to main content
SpringerLink
Log in

Eliciting, Measuring and Predicting Affect via Physiological Measures for Emotional Design

  • Chapter
  • First Online:
Emotional Engineering vol. 2

Abstract

Emotional design plays an important role in the development of products and services towards high value-added user satisfaction and performance enhancement. One critical challenge in emotional design is the measurement and prediction of affect. Most current measurement and prediction methods are affected by many biases and artifacts. For example, verbal reports only represent the sheer reflection of consciously experienced feelings. This study aimed to evaluate affect via physiological measures. Specifically, standardized affective stimuli in both visual and auditory forms were used to elicit different affective states (7 types of affect for the visual stimuli and 6 for the auditory ones). Each affective stimulus was presented for 6 s and a wide range of physiological signals were measured, including facial electromyography (EMG) (zygomatic and corrugator muscle activity), respiration rate, electroencephalography, and skin conductance response (SCR). Subjective ratings were also recorded immediately after stimulus presentation. The physiological measures show a relatively high differentiating ability in postulating affect via statistical tests and data mining-based prediction, with highest mean recognition rates of 91.47 and 71.13 % for the visual stimuli, and 91.36 and 80.66 % for the auditory stimuli, for valence- and affect-based predictions, respectively. This technological and methodological advancement offers a great potential for the development of emotional design.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Picard RW (1997) Affective Computing. The MIT Press, Cambridge

    Google Scholar 

  2. Helander MG, Tham MP (2003) Hedonomics-affective human factors design. Ergonomics 46(13/14):1269–1272.

    Article  Google Scholar 

  3. Helander MG, Khalid HM (2006) Affective and pleasurable design. In: Salvendy G (ed) Handbook of human factors and ergonomics, 3rd edn. Wiley, New York

    Google Scholar 

  4. Jiao J, Xu Q, Du J, Zhang Y, Helander MG, Khalid HM et al (2007) Analytical emotional design with ambient intelligence for mass customization and personalization. Int J Flex Manuf Syst 19:570–595

    Article  Google Scholar 

  5. Desmet PMA, Hekkert P (2007) Framework of product experience. Int J Des 1(1):57–66

    Google Scholar 

  6. Yerkes RM, Dodson JD (1908) The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol 18:459–482

    Article  Google Scholar 

  7. Wickens CD, Hollands JG (1999) Engineering psychology and human performance, 3rd edn. Prentice Hall, New Jersey

    Google Scholar 

  8. Csikszentmihalyi M (1990) Flow: the psychology of optimal experience. Harper and Row, New York

    Google Scholar 

  9. Ekman P (1999) Basic Emotions. In: Dalgleish T, Power M (eds) Handbook of cognition and emotion. Wiley, Sussex

    Google Scholar 

  10. Detenber BH (2001) Measuring emotional responses in human factors research: some theoretical and practical considerations. Paper presented at the international conference on affective human factors design, Singapore

    Google Scholar 

  11. Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110(1):145–172

    Article  Google Scholar 

  12. Nagamachi M (1995) Kansei engineering: a new ergonomic consumer-oriented technology for product development. Int J Ind Ergon 15(1):3–11

    Article  MathSciNet  Google Scholar 

  13. Osgood CE, Suci GJ, Tannenbaum PH (1957) The measurement of meaning. University of Illinois Press, Urbana

    Google Scholar 

  14. Grandjean D, Sander D, Scherer KR (2008) Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization. Conscious Cogn 17(2):484–495

    Article  Google Scholar 

  15. Stone AA, Shiffman S (1994) Ecological momentary assessment (EMA) in behavioral medicine. Ann Behav Med 16(3):199–202

    Google Scholar 

  16. Picard RW, Klein J (2002) Computers that recognise and respond to user emotion: theoretical and practical implications. Interact Comput 14:141–169

    Article  Google Scholar 

  17. Crabtree A, Rodden T, Hemmings T, Benford S (2003) Tools for studying behavior and technology in natural settings paper presented at the UbiComp 2003

    Google Scholar 

  18. Ekman P, Levenson RW, Friesen WV (1983) Autonomic nervous system activity distinguishes among emotions. Sci New Ser 221(4616):1208–1210

    Google Scholar 

  19. Picard RW, Vyzas E, Healey J (2001) Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175–1191

    Article  Google Scholar 

  20. Schiano DJ, Ehrlich SM, Sheridan K (2004) Categorical imperative NOT: facial affect is perceived continuously. Paper presented at the conference on human factors in computing systems, Vienna, Austria

    Google Scholar 

  21. Bailenson JN, Pontikakis ED, Mauss IB, Gross JJ, Jabon ME, Hutcherson CAC et al (2008) Real-time classification of evoked emotions using facial feature tracking and physiological responses. Int J Hum Comput Stud 66(5):303–317

    Article  Google Scholar 

  22. Mandryk R, Atkins M (2007) A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J Hum Comput Stud 65(4):329–347

    Article  Google Scholar 

  23. Fairclough SH (2009) Fundamentals of physiological computing. Interact Comput 21(1–2):133–145

    Article  Google Scholar 

  24. Scheirer J, Fernandez R, Klein J, Picard RW (2002) Frustrating the user on purpose: a step toward building an affective computer. Interact Comput 14(2):93–118

    Article  Google Scholar 

  25. Cacioppo JT, Tassinary LG (1990) Inferring psychological significance from physiological signals. Am Psychol 45(1):16–28

    Article  Google Scholar 

  26. Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology 1993(30):3

    Google Scholar 

  27. Partala T, Surakka V (2003) Pupil size as an indication of affective processing. Int J Hum Comput Stud 59(1–2):185–198

    Article  Google Scholar 

  28. Lang PJ, Bradley MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report number A-8, University of Floridao, Gainesville

    Google Scholar 

  29. Bradley MM, Lang PJ (2007) The international affective digitized sounds (2nd Edition; IADS-2): affective ratings of sounds and instruction manual. Technical report number B-3, University of Floridao, Gainesville

    Google Scholar 

  30. Bernstein AS (1969) The orienting response and direction of stimulus change. Psychon Sci 12:127–128

    Google Scholar 

  31. Shelley K, Shelley S (2001) Pulse oximeter waveform: photoelectric plethysmography. In: Lake C, Hines R, Blitt C (eds) Clinical Monitoring. Saunders Company, Philadeiphia, pp 420–428

    Google Scholar 

  32. Laparra-Hernández J, Belda-Loisa JM, Medinaa E, Camposa N, Povedaa R (2008) EMG and GSR signals for evaluating user’s perception of different types of ceramic flooring. Int J Ind Ergon 39(2):326–332

    Article  Google Scholar 

  33. Larsen JT, Norris CJ, Cacioppo JT (2003) Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40:776–785

    Article  Google Scholar 

  34. Stern RM, Ray WJ, Quigley KS (2001) Psychophysiological recording, 2nd edn. Oxford University Press, New York

    Google Scholar 

  35. Creutzfeldt OD, Watanabe S, Lux HD (1966) Relations between EEG phenomena and potentials of single cortical cells. I. Evoked responses after thalamic and epicortical stimulation. Electroencephalogr Clin Neurophysiol 20:1–18

    Article  Google Scholar 

  36. Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science, 4th edn. McGraw-Hill, New York

    Google Scholar 

  37. Niemic CP (2002) Studies of emotion: a theoretical and empirical review of psychophysiological studies of emotion. J Undergrad Res 1:15–18

    Google Scholar 

  38. Niedermeyer E, Lopes da Silva F (2004) Electroencephalography: basic principles, clinical applications, and related fields, 5th edn. Lippincott Williams & Wilkins, Philadelphia

    Google Scholar 

  39. Haykin S (1996) Adaptive filter theory, 3rd edn. Prentice-Hall, Inc., Upper Saddle River, NJ, USA

    Google Scholar 

  40. Welch PD (1967) The use of fast fourier transform for the estimation of power spectra: method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electro Acoustics AU-15:70–73

    Google Scholar 

  41. Lang PJ (1980) Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski JB, Johnson JH, Williams TA (eds) Technology in mental health care delivery systems. Ablex, Norwood, pp 119–137

    Google Scholar 

  42. Martinez AM, Kak AC (2001) PCA versus LDA. IEEE Trans Pattern Anal Mach Intell 23(2):228–233

    Article  Google Scholar 

  43. Bazan J, Szczuka M (2000) RSES and RSESlib—a collection of tools for rough set computations. Lecture notes in artificial intelligence, vol 3066. Springer, Heidelberg, pp 592-601

    Google Scholar 

  44. Gora G, Wojna A (2002) RIONA: a new classification system combining rule induction and instance-based learning. Fundamenta Informaticae 51(4):369–390

    MathSciNet  MATH  Google Scholar 

  45. Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data, 1st edn. Springer, London

    MATH  Google Scholar 

  46. Hudlicka E (2003) To feel or not to feel: the role of affect in human-computer interaction. Int J Hum Comput Stud 59:1–32

    Article  Google Scholar 

  47. Davison RJ, Scherer KR, Goldsmith HH (eds) (2003) Handbook of affective sciences. Oxford University Press, New York

    Google Scholar 

  48. Bradley MM, Lang PJ (2000) Affective reactions to acoustic stimuli. Psychophysiology 37:204–215

    Article  Google Scholar 

  49. Pandian PS, Mohanavelu K, Safeer KP, Kotresh TM, Shakunthala DT, Gopal P et al (2008) Smart vest: wearable multi-parameter remote physiological monitoring system. Med Eng Phys 30(4):466–477

    Article  Google Scholar 

  50. Cacioppo J, Bernston G, Larson J, Poehlmann K, Ito T (2000) The psychophysiology of emotion. In: Lewis M, Haviland-Jones J (eds) Handbook of emotions, 2nd edn. Guilford Press, New York, pp 173–191

    Google Scholar 

  51. Ward RD, Marsden PH (2004) Affective computing: problems, reactions and intentions. Interact Comput 16:707–713

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Georgia, 30332, USA

    Feng Zhou, Roger Jianxin Jiao & Roger Jianxin Jiao

Authors
  1. Feng Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roger Jianxin Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Roger Jianxin Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Feng Zhou .

Editor information

Editors and Affiliations

  1. Stanford University, 228 Hamilton Avenue, Stanford, 94301, California, USA

    Shuichi Fukuda

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Zhou, F., Jiao, R.J., Jiao, R.J. (2013). Eliciting, Measuring and Predicting Affect via Physiological Measures for Emotional Design. In: Fukuda, S. (eds) Emotional Engineering vol. 2. Springer, London. https://doi.org/10.1007/978-1-4471-4984-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-4984-2_4

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-4983-5

  • Online ISBN: 978-1-4471-4984-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation