Abstract
Cognition and emotion have long been thought of as independent systems. However, recent research in the cognitive and neurobiological sciences has shown that the relationship between cognition and emotion is more interdependent than separate. Based on evidence from behavioral and neuroscientific research, researchers have realized that it is necessary to propose a new conceptual framework to describe the relationship between cognition and emotion. In this article, recent research from behavioral, neuroscientific and developmental research on the interaction between cognition and emotion is summarized, and how the interaction of cognition and emotion might affect computer science and artificial intelligence is discussed. It especially focuses on the implications for affective computing.
Similar content being viewed by others
References
Ochsner K N, Phelps E. Emerging perspectives on emotion-cognition interactions. Trends Cogn Sci, 2007, 11: 317–318
Pessoa L. On the relationship between cognition and emotion. Nat Rev Neurosci, 2008, 9: 148–158
Lyons W. The philosophy of cognition and emotion. In: Dalgleish T, Power M, eds. Handbook of Cognition and Emotion. Chichester: Wiley, 1999. 21–44
Pessoa L. How do emotion and motivation direct executive control? Trends Cogn Sci, 2009, 13: 160–166
Dolan R. Emotion, cognition, and behavior. Science, 2002, 298: 1191–1194
Phelps E A. Cognition and emotion: insights from studies of the human amygdala. Annu Rev Psychol, 2006, 57: 27–53
Barrett L F, Mesquita B, Ochsner K N, et al. The experience of emotion. Annu Rev Psychol, 2007, 58: 373–403
Izard C E. Emotion Theory and research: Highlights, unanswered questions, and emerging issues. Annu Rev Psychol, 2009, 60: 1–25
Ekman P. Handbook of Cognition and Emotion. Chichester: Wiley, 1999
Mehrabian A. Framework for a comprehensive description and measurement of emotional states. Genet Soc Gen Psychol Monogr, 1995, 3: 339–361
Mehrabian A. Pleasure-Arousal-Dominace: A general framework for describing and measuring individual differences in temperament. Curr Psychol Dev Learning Personal Soc, 1996, 4: 261–292
Li X, Zhou H, Song S, et al. The reliability and validity of the Chinese version of abbreviated PAD emotion scales. In: Tao J, Tan T, Picard R W, eds. Affective Computing and Intelligent Interaction. Berlin Heidelberg: Springer-Verlag, 2005. 513–518
Martino B D, Kumaran D, Seymour B, et al. Frames, biases, and rational decision-making in the human brain. Science, 2006, 313: 684–687
Irrational Decisions Driven By Emotions, ScienceDaily. Retrieved June 29, 2009, from http://www.sciencedaily.com/releases/2006/08/060803171138.htm
Clore G L, Storbeck J. Affect as information about liking, efficacy, and importance. In: Forgas J, ed. Affect in Social Thinking and Behavior. New York and Hove: Psychology Press, 2006. 123–142
Buchanan T W. Retrieval of emotional memories. Psychol Bull, 2007, 133: 761–779
Bower G H, Forgas J P. Affect, memory, and social cognition. In: Eich E, Kihlstrom J F, Bower G H, et al., eds. Cognition and Emotion. New York: Oxford University Press, 2000. 87–168
Langeslag S J E, Franken I H A, van Strien J W. Dissociating love-related attention from task-related attention: An event-related potential oddball study. Neurosci Lett, 2008, 431: 236–240
Rowe G, Hirsh J B, Anderson A K. Positive affect increases the breadth of attentional selection. Proc Natl Acad Sci USA, 2007, 104: 383–388
Kiss M, Goolsby B, Raymond J E, et al. Efficient attentional selection predicts distractor devaluation: ERP evidence for a direct link between attention and emotion. J Cogn Neurosci, 2007, 19: 1316–1322
Stefanucci J K, Proffitt D R. The roles of altitude and fear in the perception of height. J Exp Psychol Hum Percept Perform, 2009, 35: 424–438
Stefanucci J K, Storbeck J. Don’t look down: Emotional arousal elevates height perception. J Exp Psychol Gen, 2009, 138: 131–145
Droit-Volet S, Meck W H. How emotions colour our perception of time. Trends Cogn Sci, 2007, 11: 504–513
Effron D A, Niedenthal P M, Gil S, et al. Embodied temporal perception of emotion. Emotion, 2006, 6: 1–9
Tipples J. Negative emotionality influences the effects of emotion on time perception. Emotion, 2008, 8: 127–131
Schupp H T, Stockburger J, Codispoti M, et al. Selective visual attention to emotion. J Neurosci, 2007, 27: 1082–1089
Hao F, Zhang H, Fu X. Modulation of attention by faces expressing emotion: Evidence from visual marking. In: Tao J, Tan T, Picard R W, eds. Affective Computing and Intelligent Interaction. Berlin Heidelberg: Springer-Verlag, 2005. 127–134
Lim S L, Padmala S, Pessoa L. Affective learning modulates spatial competition during low-load attentional conditions. Neuropsychologia, 2008, 46: 1267–1278
Kanske P, Kotz S A. Concreteness in emotional words: ERP evidence from a hemifield study. Brain Res, 2007, 1138: 138–148
Kanske P, Kotz S A. Executive control of attention benefits from positive emotion: ERP evidence. Intl J Psychol, 2008, 43: 279–279
Baddeley A. Working memory: Looking back and looking forward. Nat Rev Neurosci, 2003, 4: 829–839
Levens S M, Phelps E A. Emotion processing effects on interference resolution in working memory. Emotion, 2008, 8: 267–280
Baddeley A. Working Memory, Thought, and Action. Oxford: Oxford Univesity Press, 2007
Cacioppo J T, Gardner W L. Emotion. Annu Rev Psychol, 1999, 50: 191–214
Hsee C K, Hastie R. Decision and experience: Why don’t we choose what makes us happy? Trends Cogn Sci, 2006, 10: 31–37
Kahneman D. Experienced utility and objective happiness: A moment-based approach. In: Kahneman D, Tversky A, eds. Choices, Values, and Frames. Cambridge: Cambridge University Press, 2000. 673–692
Rustichini A. Emotion and reason in making decisions. Science, 2005, 310: 1624–1625
Greene J D, Sommerville R B, Nystrom L E, et al. An fMRI investigation of emotional engagement in moral judgment. Science, 2001, 293: 2105–2108
Huebner B, Dwyer S, Hauser M. The role of emotion in moral psychology. Trends Cogn Sci, 2009, 13: 1–6
Lazarus R S. Cognition and motivation in emotion. Am Psychol, 1991, 46: 352–67
Fenske M J, Raymond J E, Kunar M A. The affective consequences of visual attention in preview search. Psychon Bull Rev, 2004, 11: 1034–1040
Raymond J E, Fenske M J, Westoby N. Emotional devaluation of distracting patterns and faces: A consequences of attentional inhibition during visual search? J Exp Psychol Hum Percept Perform, 2005, 31: 1404–1415
Fenske M J, Raymond J E, Kessler K, et al. Attentional inhibition has social-emotional consequences for unfamiliar faces. Psychol Sci, 2005, 16: 753–758
Zhou H, Wan L, Fu X. Generalized “Stigma”: Evidence for devaluation-by-inhibition hypothesis from implicit learning. The Proceedings of 2nd International Conference on Affective Computing and Intelligent Interaction (ACII2007). Berlin Heidelberg: Springer-Verlag, 2007. 690–697
Storbeck J, Clore G L. With sadness comes accuracy, with happiness, false memory: Mood and the false memory effect. Psychol Sci, 2005, 16: 785–791
Righart R, de Gelder B. Recognition of facial expressions is influenced by emotional scene gist. Cogn Affect Behav Neurosci, 2008, 8: 264–272
Hansen T, Bartsch R A. Positive correlation between personal need for structure and the mere exposure effect. Soc Behav Pers, 2001, 29: 271–276
Witvliet C V O, Vrana S R. Play it again, Sam: Repeated exposure to emotionally evocative music polarizes liking and smiling responses, and influences other affective reports, facial EMG and heart rate. Cogn Emot 2007, 21: 3–25
Barrett L F, Lindquist K A, Gendron M. Language as context for the perception of emotion. Trends Cogn Sci, 2007, 11: 327–332
Ekman P. Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique. Psychol Bull, 1994, 115: 268–287
Izard C E. Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychol Bull, 1994, 115: 288–299
Barrett L F. Emotions as natural kinds? Perspect Psychol Sci, 2006, 1: 28–58
Lindquist K, Barrett L F, Bliss-Moreau E, et al. Language and the perception of emotion. Emotion, 2006, 6: 125–138
Calder A J, Young A W, Keane J, et al. Configural information in facial expression perception. J Exp Psychol Hum Percept Perform, 2000, 26: 527–551
Ganel T, Goshen-Gottstein Y. Effects of familiarity on the perceptual integrality of the identity and expression of faces: The parallel-route hypothesis revisited. J Exp Psychol Hum Percept Perform, 2004, 30: 583–597
Bruce V, Young A. Understanding face recognition. Br J Psychol, 1986, 77: 305–327
Wang Y, Fu X. Recognizing facial expression and facial identity: Parallel processing or interactive processing (in Chinese). Adv Psychol Sci, 2005, 13: 497–516
Haxby J V, Hoffman E A, Gobbini M I. The distributed human neural system for face perception. Trends Cogn Sci, 2000, 4: 223–233
Wang Y M, Fu X. Effect of discriminability on interference between facial expression and facial identity recognition. Acta Psychol Sin, 2007, 39: 191–200
Zhang H, Xuan Y, Fu X. What expression could be found more quickly? It depends on facial identities. In: Tao J, Tan T, Picard R W, eds. Affective Computing and Intelligent Interaction. Berlin Heidelberg: Springer-Verlag, 2005. 195–201
Adams R B, Kleck R E Jr. Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 2005, 5: 3–11
Graham R, LaBar K S. Garner interference reveals dependencies between emotional expression and gaze in face perception. Emotion, 2007, 7: 296–313
Shang J, Liu Y, Fu X. Dominance modulates the effects of eye gaze on the perception of threatening facial expressions. Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition, 2008
Gross J J. The emerging field of emotion regulation: An integrative review. Rev Gen Psychol, 1998, 2: 271–299
Ochsner K N, Gross J J. The cognitive control of emotion. Trends Cogn Sci, 2005, 9: 242–249
Gross J J. Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology, 2002, 39: 281–291
Hariri A R, Bookheimer S Y, Mazziotta J C. Modulating emotional responses: Effects of a neocortical network on the limbic system. Neuroreport, 2000, 11: 43–8
Tamir M, Mitchell C, Gross J J. Hedonic and instrumental motives in anger regulation. Psychol Sci, 2008, 19: 324–328
Gross J J. Emotion regulation. In: Lewis M, Haviland-Jones J M, Barrett L F, eds. Handbook of Emotions. 3rd ed. New York: Guilford Press, 2008. 497–512
Wolfe C D, Bell M A. The integration of cognition and emotion during infancy and early childhood: Regulatory processes associated with the development of working memory. Brain Cogn, 2007, 65: 3–13
Gallagher M, Holland P C. The amygdala complex: Multiple roles in associative learning and attention. Proc Natl Acad Sci USA, 1994, 91: 11771–1776
Lim S L, Pessoa L. Affective learning increases sensitivity to graded emotional faces. Emotion, 2008, 8: 96–103
Adolphs R. Perception and emotion: How we recognize facial expressions. Curr Direct Psychol Sci, 2006, 15: 222–226
Barot S K, Kyono Y, Clark E W, et al. Visualizing stimulus convergence in amygdala neurons during associative learning. Proc Natl Acad Sci USA, 2008, 105: 20959–20963
Phelps E A. Human emotion and memory: interactions of the amygdala and hippocampal complex. Curr Opin Neurobiol, 2004, 14: 198–202
Papez J W. A proposed mechanism of emotion. Arch Neurol Psychiatry, 1937, 38: 725–744
Broadbent N J, Squire L R, Clark R E. Spatial memory, recognition memory, and the hippocampus. Proc Natl Acad Sci USA, 2004, 101: 14515–14520
LaBar K S, Cabeza R. Cognitive neuroscience of emotional memory. Nat Rev: Neurosci, 2006, 7: 54–64
Richardson M P, Strange B A, Dolan R J. Encoding of emotional memories depends on amygdala and hippocampus and their interactions. Nat Neurosci, 2004, 7: 278–285
Gray J R, Braver T S, Raichle M E. Integration of cognition and emotion in the lateral prefrontal cortex. Proc Natl Acad Sci USA, 2002, 99: 4115–4120
Rushworth M F S, Behrens T E J, Rudebeck P H, et al. Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn Sci, 2007, 11: 168–176
Wallis J D. Orbitofrontal cortex and its contribution to decision-making. Annu Rev Neurosci, 2007, 30: 31–56
Schoenbaum G, Roesch M R, Stalnaker T A. Orbitofrontal cortex, decision-making and drug addiction. Trends Neurosci, 2006, 29: 116–124
Beer J S, Knight R T, D’Esposito M. Controlling the integration of cognition and emotion: The role of frontal cortex in distinguishing helpful from hurtful emotional information. Psychol Sci, 2006, 17: 448–453
Bush G, Luu P, Posner M I. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn Sci, 2000, 4: 215–222
Gotlib I H, Sivers H, Gabrieli J D, et al. Subgenual anterior cingulate activation to valenced emotional stimuli in major depression. Neuroreport, 2005, 16: 1731–1734
Davidson R J, Pizzagalli D, Nitschke J B. The representation and regulation of emotion in depression: Perspectives from affective neuroscience. In: Gotlib I, Hammen C, eds. Handbook of Depression. 2nd ed. New York: Guilford Press, 2009
Olsson A, Ochsner K N. The role of social cognition in emotion. Trends Cogn Sci, 2008, 12: 65–71
Etkin A, Egner T, Peraza D M, et al. Resolving emotional conflict: A role for the rostral anterior cingulate cortex in modulating activity in the amygdala. Neuron, 2006, 51: 871–882
Schmahmann J D, Caplan D. Cognition, emotion and the cerebellum. Brain, 2006, 129: 288–292
Turner B M, Paradiso S, Marvel C L, et al. The cerebellum and emotional experience. Neuropsychologia, 2007, 45: 1331–1341
Schutter D J, van Honk J. The cerebellum on the rise in human emotion. Cerebellum, 2005, 4: 290–294
Sacchetti M, Saltin B, Olsen D B, van Hall G. High triacylglycerol turnover rate in human skeletal muscle. J Physiol, 2004, 561: 883–891
Schutter D, van Honk J. The cerebellum in emotion regulation: A repetitive transcranial magnetic stimulation study. Cerebellum, 2009, 8: 28–34
Pauly K, Seiferth N Y, Kellermann T, et al. Cerebral dysfunctions of emotion-cognition interactions in adolescent-onset schizophrenia. J Am Acad Child Adolesc Psychiatry, 2008, 47: 1299–1310
Minsky M. The Society of Mind. New York: Simon & Schuster, 1985
Picard R W. Affective medicine: Technology with emotional intelligence. In: Bushko R G, ed. Future of Health Technology. Cambridge: OIS Press, 2001. 1–15
Picard R W. Affective Computing. London: MIT Press, 1997
Norman D A. Emotional Design: Why We Love (or Hate) Everyday Things. New York: Basic Books, 2004
Tao L, Liu Y, Fu X, et al. A computational study on PAD based emotional state model. Proceedings of the 26th Computer-Human Interaction Conference, 2008
Niedenthal P M. Embodying emotion. Science, 2007, 316: 1002–1005
Author information
Authors and Affiliations
Additional information
Supported by the National Key Basic Research and Development Program of China (Grant No. 2006CB303101), National Natural Science Foundation of China (Grant Nos. 60433030, 90820305, and 30700233), and Young Scientists Fund, Institute of Psychology of Chinese Academy of Sciences (Grant Nos. 07CX132013 and 07CX142014)
About this article
Cite this article
Liu, Y., Fu, Q. & Fu, X. The interaction between cognition and emotion. Chin. Sci. Bull. 54, 4102–4116 (2009). https://doi.org/10.1007/s11434-009-0632-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11434-009-0632-2