Advertisement

Computational Neuroscience Models: Error Monitoring, Conflict Resolution, and Decision Making

  • Joshua W. Brown
  • William H. Alexander
Chapter
Part of the Springer Series in Cognitive and Neural Systems book series (SSCNS)

Abstract

A critical part of the perception–reason–action cycle is performance monitoring, in which the outcomes of decisions and actions are monitored with respect to how well the actions are (or are not) achieving the desired goals. If the current behavior is not achieving the desired goals, then the problems must be detected as early as possible, and corrective action must be implemented as quickly as possible. The cognitive process of performance monitoring refers to the ability to detect such problems, and cognitive control (or executive control) refers to the processes of directing actions toward their intended goals and correcting failures to do so. In this chapter, the basic neural mechanisms of goal-directed behavior are re-viewed through the lens of computational neural models on the topic, and the neural mechanisms of decision-making are reviewed briefly. We then go on to discuss how top-down goal representations are chosen, instantiated, strengthened, and when necessary, changed.

Keywords

Anterior Cingulate Cortex Cognitive Control Performance Monitoring Response Conflict Proactive Control 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgments

Supported in part by AFOSR FA9550-07-1-0454, A NARSAD Young Investigator Award, the Sidney R. Baer, Jr. Foundation, R03 DA023462, and R01 DA026457.

References

  1. .
    Amiez C, Joseph JP, Procyk E (2005) Anterior cingulate error-related activity is modulated by predicted reward. Eur J Neurosci 21:3447–3452.CrossRefPubMedGoogle Scholar
  2. .
    Amiez C, Joseph JP, Procyk E (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 16:1040–1055.CrossRefPubMedGoogle Scholar
  3. .
    Anderson JR, Bothell D, Byrne MD, Douglass S, Lebiere C, Qin Y (2004) An integrated theory of the mind. Psychol Rev 111:1036–1060.CrossRefPubMedGoogle Scholar
  4. .
    Barbas H, Pandya DN (1989) Architecture of intrinsic connections of the prefrontal cortex in the Rhesus monkey. J Comp Neurol 286:353–375.CrossRefPubMedGoogle Scholar
  5. .
    Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214–1221.CrossRefPubMedGoogle Scholar
  6. .
    Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 113:700–765.CrossRefPubMedGoogle Scholar
  7. .
    Botvinick MM, Nystrom L, Fissel K, Carter CS, Cohen JD (1999) Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402:179–181.CrossRefPubMedGoogle Scholar
  8. .
    Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JC (2001) Conflict monitoring and cognitive control. Psychol Rev 108:624–652.CrossRefPubMedGoogle Scholar
  9. .
    Braver TS, Barch DM, Gray JR, Molfese DL, Snyder A (2001) Anterior cingulate cortex and response conflict: effects of frequency, inhibition, and errors. Cereb Cortex 11:825–836.CrossRefPubMedGoogle Scholar
  10. .
    Braver TS, Gray JR, Burgess GC (2007) Explaining the many varieties of working memory variation: dual mechanisms of cognitive control. In: Variation of working memory (A. Conway CJ, M. Kane, A. Miyake, & J. Towse, eds). Oxford: Oxford University Press.Google Scholar
  11. .
    Brown J, Braver TS (2007) Risk prediction and aversion by anterior cingulate cortex. Cogn Affect Behav Neurosci 7:266–277.CrossRefPubMedGoogle Scholar
  12. .
    Brown JW (2009a) Multiple cognitive control effects of error likelihood and conflict. Psychol Res 73:744–750.CrossRefPubMedGoogle Scholar
  13. .
    Brown JW (2009b) Conflict effects without conflict in anterior cingulate cortex: multiple response effects and context specific representations. Neuroimage 47:334–341.CrossRefPubMedGoogle Scholar
  14. .
    Brown JW, Braver TS (2005) Learned predictions of error likelihood in the anterior cingulate cortex. Science 307:1118–1121.CrossRefPubMedGoogle Scholar
  15. .
    Brown JW, Braver TS (2008) A computational model of risk, conflict, and individual difference effects in the anterior cingulate cortex. Brain Res 1202:99–108.CrossRefPubMedGoogle Scholar
  16. .
    Burle B, Roger C, Allain S, Vidal F, Hasbroucq T (2008) Error negativity does not reflect conflict: a reappraisal of conflict monitoring and anterior cingulate cortex activity. J Cogn Neurosci 20:1637–1655.CrossRefPubMedGoogle Scholar
  17. .
    Busemeyer JR, Townsend JT (1993) Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 100:432–459.CrossRefPubMedGoogle Scholar
  18. .
    Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA (2002) Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci U S A 99:507–512.CrossRefGoogle Scholar
  19. .
    Carter CS, Braver TS, Barch DM, Botvinick MM, Noll DC, Cohen JD (1998) Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280:747–749.CrossRefPubMedGoogle Scholar
  20. .
    Cohen JD, Dunbar K, McClelland JL (1990) On the control of automatic processes: a parallel distributed processing account of the stroop effect. Psychol Rev 97:332–361.CrossRefPubMedGoogle Scholar
  21. .
    Cutsuridis V, Smyrnis N, Evdokimidis I, Perantonis S (2007) A neural model of decision-making by the superior colicullus in an antisaccade task. Neural Netw 20:690–704.CrossRefPubMedGoogle Scholar
  22. .
    Daw ND, Kakade S, Dayan P (2002) Opponent interactions between serotonin and dopamine. Neural Netw 15:603–616.CrossRefPubMedGoogle Scholar
  23. .
    Dehaene S, Posner MI, Tucker DM (1994) Localization of a neural system for error detection and compensation. Psychol Sci 5:303–306.CrossRefGoogle Scholar
  24. .
    Eblen F, Graybiel AM (1995) Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J Neurosci 15:5999–6013.PubMedGoogle Scholar
  25. .
    Emeric EE, Brown JW, Leslie M, Pouget P, Stuphorn V, Schall JD (2008) Performance monitoring local field potentials in the medial frontal cortex of primates: anterior cingulate cortex. J Neurophysiol 99:759–772.CrossRefPubMedGoogle Scholar
  26. .
    Fishbein DH, Eldreth DL, Hyde C, Matochik JA, London ED, Contoreggi C, Kurian V, Kimes AS, Breeden A, Grant S (2005) Risky decision making and the anterior cingulate cortex in abstinent drug abusers and nonusers. Brain Res Cogn Brain Res 23:119–136.CrossRefPubMedGoogle Scholar
  27. .
    Forstmann BU, Dutilh G, Brown S, Neumann J, von Cramon DY, Ridderinkhof KR, Wagenmakers EJ (2008) Striatum and pre-SMA facilitate decision-making under time pressure. Proc Natl Acad Sci U S A 105:17538–17542.CrossRefPubMedGoogle Scholar
  28. .
    Frank MJ, D’Lauro C, Curran T (2007) Cross-task individual differences in error processing: neural, electrophysiological, and genetic components. Cogn Affect Behav Neurosci 7:297–308.CrossRefPubMedGoogle Scholar
  29. .
    Gehring WJ, Coles MGH, Meyer DE, Donchin E (1990) The error-related negativity: an event-related potential accompanying errors. Psychophysiology 27:S34.CrossRefGoogle Scholar
  30. .
    Gehring WJ, Goss B, Coles MGH, Meyer DE, Donchin E (1993) A neural system for error detection and compensation. Psychol Sci 4:385–390.CrossRefGoogle Scholar
  31. .
    Gemba H, Sasaki K, Brooks VB (1986) ‘Error’ potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neurosci Lett 70:223–227.CrossRefPubMedGoogle Scholar
  32. .
    Grant DA, Berg EA (1948) A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl type card sorting problem. J Exp Psychol 38:404–411.CrossRefPubMedGoogle Scholar
  33. .
    Hanes DP, Schall JD (1996) Neural control of voluntary movement initiation. Science 274: 427–430.CrossRefPubMedGoogle Scholar
  34. .
    Hohnsbein J, Falkenstein M, Hoorman J (1989) Error processing in visual and auditory choice reaction tasks. J Psychophysiol 3:32.Google Scholar
  35. .
    Holroyd CB, Coles MG (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109:679–709.CrossRefPubMedGoogle Scholar
  36. .
    Ito S, Stuphorn V, Brown J, Schall JD (2003) Performance monitoring by anterior cingulate cortex during saccade countermanding. Science 302:120–122.CrossRefPubMedGoogle Scholar
  37. .
    Jones AD, Cho R, Nystrom LE, Cohen JD, Braver TS (2002) A computational model of anterior cingulate function in speeded response tasks: effects of frequency, sequence, and conflict. Cogn Affect Behav Neurosci 2:300–317.CrossRefPubMedGoogle Scholar
  38. .
    Kerns JG, Cohen JD, MacDonald AW, 3rd, Cho RY, Stenger VA, Carter CS (2004) Anterior cingulate conflict monitoring and adjustments in control. Science 303:1023–1026.CrossRefPubMedGoogle Scholar
  39. .
    Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43:59–69.CrossRefGoogle Scholar
  40. .
    Laming D (1979) Choice reaction performance following an error. Acta Psychol 43:199–224.CrossRefGoogle Scholar
  41. .
    Laming DRJ (1968) Information theory of choice reaction times. London: Academic.Google Scholar
  42. .
    MacDonald AW, Cohen JD, Stenger VA, Carter CS (2000) Dissociating the role of the dorsolateral prefrontal cortex and anterior cingulate cortex in cognitive control. Science 288:1835–1838.CrossRefPubMedGoogle Scholar
  43. .
    Magno E, Foxe JJ, Molholm S, Robertson IH, Garavan H (2006) The anterior cingulate and error avoidance. J Neurosci 26:4769–4773.CrossRefPubMedGoogle Scholar
  44. .
    Matsumoto K, Suzuki W, Tanaka K (2003) Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301:229–232.CrossRefPubMedGoogle Scholar
  45. .
    Mayr U, Awh E, Laurey P (2003) Conflict adaptation effects in the absence of executive control. Nat Neurosci 6:450–452.PubMedGoogle Scholar
  46. .
    Meyer DE, Kieras DE (1994) EPIC computational models of psychological refractory-period effects in human multiple-task performance. In. Ann Arbor: University of Michigan.Google Scholar
  47. .
    Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 21:167–202.CrossRefGoogle Scholar
  48. .
    Modirrousta M, Fellows LK (2008) Dorsal medial prefrontal cortex plays a necessary role in rapid e rror prediction in humans. J Neurosci 28:14000–14005.CrossRefPubMedGoogle Scholar
  49. .
    Nakamura K, Roesch MR, Olson CR (2005) Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. J Neurophysiol 93:884–908.CrossRefPubMedGoogle Scholar
  50. .
    Newell A (1991) Unified theories of cognition. Cambridge: Cambridge University Press.Google Scholar
  51. .
    Norman D, Shallice T (1986) Attention to action: willed and automatic control of behavior. In: Consciousness and self regulation: advances in research and theory (Davidson R, Schwartz G, Shapiro D, eds). New York: Plenum.Google Scholar
  52. .
    Notebaert W, Houtman F, Opstal FV, Gevers W, Fias W, Verguts T (2009) Post-error slowing: an orienting account. Cognition 111:275–279.CrossRefPubMedGoogle Scholar
  53. .
    Oliveira FT, McDonald JJ, Goodman D (2007) Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J Cogn Neurosci 19:1994–2004CrossRefPubMedGoogle Scholar
  54. .
    Posner MI, DiGirolamo GJ (1998) Executive attention: conflict, target detection and cognitive control. In: The attentive brain (Parasuraman R, ed), pp 401–423. Cambridge: MIT.Google Scholar
  55. .
    Rabbitt P (1967) Time to detect errors as a function of factors affecting choice-response time. Acta Psychol (Amst) 27:131–142.CrossRefGoogle Scholar
  56. .
    Rabbitt PMA (1966) Errors and error correction in choice-response tasks. J Exp Psychol 71:264–272.CrossRefPubMedGoogle Scholar
  57. .
    Ratcliff R, Smith PL (2004) A comparison of sequential sampling models for two-choice reaction time. Psychol Rev 111:333–367.CrossRefPubMedGoogle Scholar
  58. .
    Reddi BA, Carpenter RH (2000) The influence of urgency on decision time. Nat Neurosci 3:827–830.CrossRefPubMedGoogle Scholar
  59. .
    Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MF (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 28:13775–13785.CrossRefPubMedGoogle Scholar
  60. .
    Saaty TL (1987) Risk – its priority and probability: the analytic hierarchy process. Risk Anal 7:159–172.CrossRefGoogle Scholar
  61. .
    Schall JD, Boucher L (2007) Executive control of gaze by the frontal lobes. Cogn Affect Behav Neurosci 7:396–412.CrossRefPubMedGoogle Scholar
  62. .
    Scheffers MK, Coles MG (2000) Performance monitoring in a confusing world: error-related brain activity, judgments of response accuracy, and types of errors. J Exp Psychol Hum Percept Perform 26:141–151.CrossRefPubMedGoogle Scholar
  63. .
    Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1–27.PubMedGoogle Scholar
  64. .
    Shidara M, Richmond BJ (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296:1709–1711.CrossRefPubMedGoogle Scholar
  65. .
    Shima K, Tanji J (1998) Role of cingulate motor area cells in voluntary movement selection based on reward. Science 282:1335–1338.CrossRefPubMedGoogle Scholar
  66. .
    Stroop JR (1935) Studies of interference in serial verbal reactions. J Exp Psychol 18:643–662.CrossRefGoogle Scholar
  67. .
    Thorndike EL (1911) Animal intelligence: experimental studies. New York: MacMillan.Google Scholar
  68. .
    Walton ME, Devlin JT, Rushworth MF (2004) Interactions between decision making and performance monitoring within prefrontal cortex. Nat Neurosci 7:1259–1265.CrossRefPubMedGoogle Scholar
  69. .
    Weber E, Blais A, Betz N (2002) A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J Behav Decis Mak 15:263–290.CrossRefGoogle Scholar
  70. .
    Williams SM, Goldman-Rakic PS (1998) Widespread origin of the primate mesofrontal dopamine system. Cereb Cortex 8:321–345.CrossRefPubMedGoogle Scholar
  71. .
    Yeung N, Cohen JD, Botvinick MM (2004) The neural basis of error detection: conflict monitoring and the error-related negativity. Psychol Rev 111:931–959.CrossRefPubMedGoogle Scholar
  72. .
    Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681–692.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.Department of Psychological and Brain SciencesIndiana UniversityBloomingtonUSA

Personalised recommendations