Abstract
In recent years, predictive coding has become an increasingly influential model of how the brain processes sensory information. Predictive coding theories state that the brain is constantly trying to predict the inputs it receives, and each region in the cortical sensory hierarchy represents both these predictions and the mismatch between predictions and input (prediction error). In this chapter, we review the extant empirical evidence for this theory, as well as discuss recent theoretical advances. We find that predictive coding provides a good explanation for many phenomena observed in perception, and generates testable hypotheses. Furthermore, we suggest possible avenues for further empirical testing and for broadening the perspective of the role predictive coding may play in cognition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rao RPN, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2(1):79–87
Mumford D (1992) On the computational architecture of the neocortex. II. The role of corticocortical loops. Biol Cybern 66(3):241–251
Friston KJ (2005) A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci 360(1456):815–836
Helmholtz H (1867) Handbuch der physiologischen optik. L. Voss, Leipzig
Weiss Y, Simoncelli EP, Adelson EH (2002) Motion illusions as optimal percepts. Nat Neurosci 5(6):598–604
Gregory RL (1997) Knowledge in perception and illusion. Phil Trans R Soc Lond B 352:1121–1128
Knill DC, Richards W (Eds) (1996) Perception as Bayesian inference. Cambridge University Press: Cambridge
Yuille A, Kersten D (2006) Vision as Bayesian inference: analysis by synthesis? Trends Cogn Sci 10(7):301–308
Lee TS, Mumford D (2003) Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis 20(7):1434–1448
Kersten D, Mamassian P, Yuille A (2004) Object perception as Bayesian inference. Annu Rev Psychol 55:271–304
Den Ouden HEM, Kok P, De Lange FP (2012) How prediction errors shape perception, attention, and motivation. Front Psychol 3:548
Spratling MW (2012) Predictive coding as a model of the V1 saliency map hypothesis. Neural Networks 26:7–28
Pearce JM, Hall G (1980) A model for Pavlovian learning: variations on the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87(6):532–552
Kok P, Jehee JFM, De Lange FP (2012) Less is more: expectation sharpens representations in the primary visual cortex. Neuron 75:265–270
Bar M (2004) Visual objects in context. Nat Rev Neurosci 5(8):617–629
Ahissar M, Hochstein S (2004) The reverse hierarchy theory of visual perceptual learning. Trends Cogn Sci 8(10):457–464
Sugase Y et al (1999) Global and fine information coded by single neurons in the temporal visual cortex. Nature 400:869–873
Spratling MW (2008) Reconciling predictive coding and biased competition models of cortical function. Front Comput Neurosci 2:4
Bastos AM et al (2012) Canonical microcircuits for predictive coding. Neuron 76:695–711
Felleman DJ, Van Essen DC (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1(1):1–47
Maunsell JHR, Van Essen DC (1983) The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J Neurosci 3(12):2563–2586
Rockland K, Pandya D (1979) Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey. Brain Res 179:3–20
Rao RPN, Sejnowski, TJ (2002) Predictive coding, cortical feedback, and spike-timing dependent plasticity. In: Rao RPN, Olshausen BA, Lewicki MS (eds) Probabilistic models of the brain: perception and neural function. MIT Press, Cambridge, pp 297–315
Grill-Spector K, Henson R, Martin A (2006) Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn Sci 10(1):14–23
Pariyadath V, Eagleman D (2007) The effect of predictability on subjective duration. PLoS ONE 2(11):e1264
Summerfield C et al (2008) Neural repetition suppression reflects fulfilled perceptual expectations. Nat Neurosci 11(9):1004–1006
Todorovic A et al (2011) Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study. J Neurosci 31(25):9118–9123
Meyer T, Olson CR (2011) Statistical learning of visual transitions in monkey inferotemporal cortex. Proc Natl Acad Sci U S A 108(48):19401–19406
Todorovic A, De Lange FP (2012) Repetition suppression and expectation suppression are dissociable in time in early auditory evoked fields. J Neurosci 32(39):13389–13395
Wacongne C et al (2011) Evidence for a hierarchy of predictions and prediction errors in human cortex. Proc Natl Acad Sci U S A 108(51):20754–20759
Wacongne C, Changeux JP, Dehaene S (2012) A neuronal model of predictive coding accounting for the mismatch negativity. J Neurosci 32(11):3665–3678
Schröger E, Wolff C (1996) Mismatch response of the human brain to changes in sound location. Neuroreport 7:3005–3008
Muckli L et al (2005) Primary visual cortex activity along the apparent-motion trace reflects illusory perception. PLoS Biol 3(8):e265
Sterzer P, Haynes JD, Rees G (2006) Primary visual cortex activation on the path of apparent motion is mediated by feedback from hMT + /V5. Neuroimage 32:1308–1316
Wibral M et al (2009) The timing of feedback to early visual cortex in the perception of long-range apparent motion. Cereb Cortex 19:1567–1582
Ahmed B et al (2008) Cortical dynamics subserving visual apparent motion. Cereb Cortex 18:2796–2810
Alink A et al (2010) Stimulus predictability reduces responses in primary visual cortex. J Neurosci 30(8):2960–2966
Chandrasekaran C et al (2009) The natural statistics of audiovisual speech. PLoS Comput Biol 5(7):e1000436
Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26(2):212–215
Van Wassenhove V, Grant KW, Poeppel D (2005) Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci U S A 102(4):1181–1186
Arnal LH et al (2009) Dual neural routing of visual facilitation in speech processing. J Neurosci 29(43):13445–13453
McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748
Arnal LH, Wyart V, Giraud A (2011) Transitions in neural oscillations reflect prediction errors generated in audiovisual speech. Nat Neurosci 14(6):797–801
Den Ouden HEM et al (2009) A dual role for prediction error in associative learning. Cereb Cortex 19:1175–1185
Den Ouden HEM et al (2010) Striatal prediction error modulates cortical coupling. J Neurosci 30(9):3210–3219
Egner T, Monti JM, Summerfield C (2010) Expectation and surprise determine neural population responses in the ventral visual stream. J Neurosci 30(49):16601–16608
Bell CC (2001) Memory-based expectations in electrosensory systems. Curr Opin Neurobiol 11:481–487
Blakemore SJ, Wolpert DM, Frith CD (1998) Central cancellation of self-produced tickle sensation. Nat Neurosci 1(7):635–640
Houde JF et al (2002) Modulation of the auditory cortex during speech: an MEG study. J Cognitive Neurosci 14(8):1125–1138
Martikainen MH, Kaneko K, Hari R (2005) Suppressed responses to self-triggered sounds in the human auditory cortex. Cereb Cortex 15:299–302
Shergill SS et al (2013) Modulation of somatosensory processing by action. Neuroimage 70:356–362
Crapse TB, Sommer MA (2008) Corollary discharge across the animal kingdom. Nat Rev Neurosci 9:587–600
Murray SO et al (2002) Shape perception reduces activity in human primary visual cortex. Proc Natl Acad Sci U S A 99(23):15164–15169
Fang F, Kersten D, Murray SO (2008) Perceptual grouping and inverse fMRI activity patterns in human visual cortex. J Vision 8(7):2–9
Wyart V, Nobre AC, Summerfield C (2012) Dissociable prior influences of signal probability and relevance on visual contrast sensitivity. Proc Natl Acad Sci U S A 109(9):3593–3598
Kok P et al (2012) Attention reverses the effect of prediction silencing sensory signals. Cereb Cortex 22(9):2197–2206
Kok P, Failing FM, De Lange FP (2014) Prior expectations evoke stimulus templates in the primary visual cortex. J Cogn Neurosci 26(7):1546–1554
Smith FW, Muckli L (2010) Nonstimulated early visual areas carry information about surrounding context. Proc Natl Acad Sci U S A 107(46):20099–20103
Lee TS, Nguyen M (2001) Dynamics of subjective contour formation in the early visual cortex. Proc Natl Acad Sci U S A 98(4):1907–1911
Kok P, De Lange FP (2014) Shape perception simultaneously up- and downregulates neural activity in the primary visual cortex. Curr Biol 24:1531–1535
Von Der Heydt R, Peterhans E, Baumgartner G (1984) Illusory contours and cortical neuron responses. Science 224(4654):1260–1262
Sakai K, Miyashita Y (1991) Neural organization for the long-term memory of paired associates. Nature 354:152–155
Erickson CA, Desimone R (1999) Responses of macaque perirhinal neurons during and after visual stimulus association learning. J Neurosci 19(23):10404–10416
Schapiro AC, Kustner LV, Turk-Browne NB (2012) Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr Biol 22(17):1622–1627
Sterzer P, Frith C, Petrovic P (2008) Believing is seeing: expectations alter visual awareness. Curr Biol 18(16):R697–R698
Denison RN, Piazza EA, Silver MA (2011) Predictive context influences perceptual selection during binocular rivarly. Front Human Neurosci 5:166
Chalk M, Seitz AR, Seriès P (2010) Rapidly learned stimulus expectations alter perception of motion. J Vision 10(8):1–18
Sotiropoulos G, Seitz AR, Seriès P (2011) Changing expectations about speeds alters perceived motion direction. Curr Biol 21(21):R883–R884
Gold JI, Shadlen MN (2007) The neural basis of decision making. Annu Rev Neurosci 30:535–74
Nienborg H, Cumming BG (2009) Decision-related activity in sensory neurons reflects more than a neuron’s causal effect. Nature 459:89–92
Serences JT, Boynton GM (2007) The representation of behavioral choice for motion in human visual cortex. J Neurosci 27(47):12893–12899
Summerfield C, Egner T (2009) Expectation (and attention) in visual cognition. Trends Cogn Sci 13(9):403–409
Miller EK, Desimone R (1994) Parallel neuronal mechanisms for short-term memory. Science 263(5146):520–522
Woloszyn L, Sheinberg DL (2012) Effects of long-term visual experience on responses of distinct classes of single units in inferior temporal cortex. Neuron 74:193–205
Hubel DH, Wiesel TN (1968) Receptive fields and functional architecture of monkey striate cortex. J Physiol 195(1):215–243
Jones HE, Wang W, Sillito AM (2002) Spatial organization and magnitude of orientation contrast interactions in primate V1. J Neurophysiol 88:2796–2808
Knierim JJ, Van Essen DC (1992) Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. J Neurophysiol 67:961–980
Sillito AM et al (1995) Visual cortical mechanisms detecting focal orientation discontinuities. Nature 378:492–496
Angelucci A, Bullier J (2003) Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons? J Physiology-Paris 97:141–154
Hupé JM et al (1998) Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature 394:784–787
Johnson RR, Burkhalter A (1996) Microcircuitry of forward and feedback connections within rat visual cortex. J Comp Neurol 368:383–398
Johnson RR, Burkhalter A (1997) A polysynaptic feedback circuit in rat visual cortex. J Neurosci 17(18):7129–7140
Spratling MW (2008) Predictive coding as a model of biased competition in visual attention. Vision Res 48:1391–1408
Thomson AM, Bannister AP (2003) Interlaminar connections in the neocortex. Cereb Cortex 13:5–14
Olsen SR et al (2012) Gain control by layer six in cortical circuits of vision. Nature 483:47–52
Koch C, Poggio T (1999) Prediction the visual world: silence is golden. Nat Neurosci 2(1):9–10
Doherty JR et al (2005) Synergistic effect of combined temporal and spatial expectations on visual attention. J Neurosci 25(36):8259–8266
Chaumon M, Drouet V, Tallon-Baudry C (2008) Unconscious associative memory affects visual processing before 100 ms. J Vis 8(3):1–10
Posner MI (1980) Orienting of attention. Q J Exp Psychol 32(1):3–25
Mangun GR, Hillyard SA (1991) Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. J Exp Psychol 17(4):1057–1074
Friston KJ (2009) The free-energy principle: a rough guide to the brain? Trends Cogn Sci 13(7):293–301
Feldman H, Friston KJ (2010) Attention, uncertainty, and free-energy. Front Human Neurosci 4:215
Rao RPN, Ballard DH (1997) Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput 9:721–763
Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosc 18:193–222
Maunsell JHR, Treue S (2006) Feature-based attention in visual cortex. Trends Neurosci 29(6):317–322
Reynolds JH, Heeger DJ (2009) The normalization model of attention. Neuron 61(2):168–185
Posner MI, Snyder CR, Davidson BJ (1980) Attention and the detection of signals. J Exp Psychol 109(2):160–174
Hohwy J (2012) Attention and conscious perception in the hypothesis testing brain. Front Psych 3:96
Rauss K, Schwartz S, Pourtois G (2011) Top-down effects on early visual processing in humans: a predictive coding framework. Neurosci Biobehav Rev 35:1237–1253
Hesselmann G et al (2010) Predictive coding or evidence accumulation? False inference and neuronal fluctuations. PLoS ONE 5:e9926
Ress D, Backus BT, Heeger DJ (2000) Activity in primary visual cortex predicts performance in a visual detection task. Nat Neurosci 3(9):940–945
Ress D, Heeger DJ (2003) Neuronal correlates of perception in early visual cortex. Nat Neurosci 6(4):414–420
Mitchell JF, Sundberg KA, Reynolds JH (2009) Spatial attention decorrelates intrinsic activity fluctuations in macaque area V4. Neuron 63:879–888
Cohen MR, Maunsell JHR (2009) Attention improves performance primarily by reducing interneuronal correlations. Nat Neurosci 12(12):1594–1601
Lakatos P et al (2008) Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320(5872):110–113
Koopmans PJ, Barth M, Norris DG (2010) Layer-Specific BOLD Activation in Human V1. Hum Brain Mapp 31:1297–1304
Takeuchi D et al (2011) Reversal of interlaminar signal between sensory and memory processing in monkey temporal cortex. Science 331:1443–1447
Harrison SA, Tong F (2009) Decoding reveals the contents of visual working memory in early visual areas. Nature 458:632–635
Lee SH, Kravitz DJ, Baker CI (2012) Disentangling visual imagery and perception of realworld objects. Neuroimage 59:4064–4073
Albers AM et al (2013) Shared representations for working memory and mental imagery in early visual cortex. Curr Biol 23:1427–1431
Horikawa T et al (2013) Neural decoding of visual imagery during sleep. Science 340:639–642
Schindel R, Rowlands J, Arnold DH (2011) The oddball effect: perceived duration and predictive coding. J Vision 11(2):17
Tse PU et al (2004) Attention and the subjective expansion of time. Percept Psychophys 66(7):1171–1189
Carrasco M, Ling S, Read S (2004) Attention alters appearance. Nat Neurosci 7(3):308–313
Corlett PR et al (2011) Glutamatergic model psychoses: prediction error, learning, and inference. Neuropsychopharmacol 36:294–315
Fletcher PC, Frith CD (2009) Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat Rev Neurosci 10(1):48–58
Eagleman DM, Pariyadath V (2009) Is subjective duration a signature of coding efficiency? Phil Trans R Soc B 364:1841–1851
Blakemore SJ et al (2000) The perception of self-produced sensory stimuli in patients with auditory hallucinations and passivity experiences: evidence for a breakdown in self-monitoring. Psychol Med 30:1131–1139
Pellicano E, Burr D (2012) When the world becomes ‘too real’: a Bayesian explanation of autistic perception. Trends Cogn Sci 16(10):504–510
Van de Cruys S et al (2013) Weak priors versus overfitting of predictions in autism: reply to Pellicano and Burr (TICS, 2012). Iperception 4:95–97
Clark A (2013) Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav Brain Sci 36:181–253
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Kok, P., de Lange, F. (2015). Predictive Coding in Sensory Cortex. In: Forstmann, B., Wagenmakers, EJ. (eds) An Introduction to Model-Based Cognitive Neuroscience. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-2236-9_11
Download citation
DOI: https://doi.org/10.1007/978-1-4939-2236-9_11
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-2235-2
Online ISBN: 978-1-4939-2236-9
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)