Cognitive Algorithms and Systems of Episodic Memory, Semantic Memory, and Their Learnings

  • Qi Zhang
Part of the Springer Series in Cognitive and Neural Systems book series (SSCNS)


Explicit (declarative) memory, the memory that can be “declared” in words or languages, is made up of two dissociated parts: episodic memory and semantic memory. This dissociation has its neuroanatomical basis–episodic memory is mostly associated with the hippocampus and semantic memory with the neocortex. The two memories, on the other hand, are closely related. Lesions in the hippocampus often result in various impairments of explicit memory, e.g., anterograde, retrograde and developmental amnesias, and semantic learning deficit. These impairments provide opportunities for us to understand how the two memories may be acquired, stored, and organized. This chapter reviews several cognitive systems that are centered to mimic explicit memory, and other systems that are neuroanatomically based and are implemented to simulate those memory impairments mentioned above. This review includes the structures of the computational systems, their learning rules, and their simulations of memory acquisition and impairments.


Episodic Memory Semantic Memory Medial Temporal Lobe Memory Consolidation Serial Recall 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Anderson, J.R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.Google Scholar
  2. Anderson, J.R., Bothell, D., Lebiere, C., and Matessa, M. (1998). An integrated theory of list memory. Journal of Memory and Language 38: 341–380.CrossRefGoogle Scholar
  3. Anderson, J.R., and Matessa, M.P. (1997). A production system theory of serial memory. Psychological Review 104: 728–748.CrossRefGoogle Scholar
  4. Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiere, C., and Qin, Y. (2004). An integrated theory of the mind. Psychological Review 111: 1036–1060.CrossRefPubMedGoogle Scholar
  5. Alvarez, P., and Squire, L. (1994). Memory consolidation and the medial temporal lobe: a simple network model. Proceedings of the National Academic Science USA 91: 7041–7045.CrossRefGoogle Scholar
  6. Aggleton, J.P., and Brown, M.W. (1999). Episodic memory, amnesia and the hippocampal–anterior thalamic axis. Behavioral Brain Science 22: 425–489Google Scholar
  7. Anon (1996). Previous cases: hippocampal amnesia. Neurocase 2: 259–298.Google Scholar
  8. Baddeley, A.D., Vargha-Khadem, F., and Mishkin, M. (2001). Preserved recognition in a case of developmental amnesia: implications for the acquisition of semantic memory. Journal of Cognitive Neuroscience 13: 357–369CrossRefPubMedGoogle Scholar
  9. Battaglia, F.P., Sutherland, G.R., and McNaughton, B.L. (2004). Hippocampal sharp wave bursts coincide with neocortical “up-state” transitions. Learning & Memory 11: 697–704.CrossRefGoogle Scholar
  10. Bloch, V., Hennevinm, E., and Leconte, P. (1979). Relationship between paradoxical sleep and memory processes. In: Brazier M.A. (ed), Brain mechanisms in memory and learning: from the single neuron to man (pp. 329–343), Raven: New York.Google Scholar
  11. Budiu, R., and Anderson, J.R. (2004). Interpretation-based processing: a unified theory of semantic sentence processing. Cognitive Science 28: 1–44.CrossRefGoogle Scholar
  12. Butters, M.A., Glisky, E.L., and Schacter, D.L. (1993). Transfer of new learning in memory-impaired patients. Journal of Clinical Experimental Neuropsychol 15: 219–230.CrossRefGoogle Scholar
  13. Drescher, G. (1991). Made-up minds. Cambridge, MA: MIT.Google Scholar
  14. Fishbein, W. (1970). Interference with conversion of memory from short-term to long-term storage by partial sleep deprivation. Communications in Behavioral Biology 5: 171–175.Google Scholar
  15. Gluck, M.A., Meeter, M., and Myers, C.E. (2003). Computational models of the hippocampal region: linking incremental learning and episodic memory. TRENDS in Cognitive Neuroscience 7: 269–276.CrossRefGoogle Scholar
  16. Greenberg, R., and Pearlman, C. (1974). Cutting the REM nerve: An approach to the adaptive role of REM sleep. Perspectives in Biology & Medicine 17: 513–521.Google Scholar
  17. Cohen, N.J., and Squire, L.R. (1980). Preserved learning and retention of pattern analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science 210: 207–209.CrossRefPubMedGoogle Scholar
  18. Collins, A.M., and Quillian, M.R. (1969). Retrieval time from semantic memory. Journal of Learning and Verbal Behavior 8: 240–247.CrossRefGoogle Scholar
  19. Eichenbaum, H. (2004). Hippocampus: cognitive processes and neural representations that underlie declarative memory. Neuron 44: 109–120.CrossRefPubMedGoogle Scholar
  20. Fosse, M.J., Fosse, R., Hobson, J.A., and Stickgold, R.J. (2003). Dreaming and episodic memory: a functional dissociation? Journal of Cognitive Neuroscience 15: 1–9.CrossRefPubMedGoogle Scholar
  21. Foulkes, D. (1985). Dreaming: a cognitive-psychological analysis. Erlbaum: Hillsdale.Google Scholar
  22. Gabrieli, J.D.E., Cohen, N.J., and Corkin, S. (1988). The impaired learning of semantic knowledge following bilateral medial temporal-lobe resection. Brain Cognitive 7: 151–177.Google Scholar
  23. Graf, P., and Schacter, D.L. (1985). Implicit and explicit memory for new associations in normal and amnesic subjects. Journal of Experimental Psychology: Learning, Memory & Cognition 11: 501–518.CrossRefGoogle Scholar
  24. Granger, R., Wiebe, S.P., Taketani, M., and Lynch, G. (1996). Distinct memory circuits composing the hippocampal region. Hippocampus 6: 567–578.CrossRefPubMedGoogle Scholar
  25. Harnad, S. (1990). The symbol grounding problem. Physica D, 42: 335–346.CrossRefGoogle Scholar
  26. Hobson, J.A., and McCarley, R.W. (1977). The brain as a dream-state generator: An activation-synthesis hypothesis of the dream process. American Journal of Psychiatry 134: 1335–1348.PubMedGoogle Scholar
  27. Kitchener, E.G., Hodges, J.R., and McCarthy, R. (1998). Acquisition of post-morbid vocabulary and semantic facts in the absence of episodic memory. Brain 121: 1313–1327.CrossRefPubMedGoogle Scholar
  28. Isaacs, E.B., Vargha-Khadem, F., Watkins, K.E., Lucas, A., Mishkin, M., and Gadian, D.G. (2003). Developmental amnesia and its relationship to degree of hippocampal atrophy. PNAS 100: 13060–13063.CrossRefPubMedGoogle Scholar
  29. Levy, W.B. (1989). A computational approach to hippocampal function. In: Hawkins R.D., Bower G.H., (eds.), Computational models of learning in simple neural systems (pp. 243–305). Orlando, FL: Academic.CrossRefGoogle Scholar
  30. Levy, W.B. (1996). A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks. Hippocampus 6: 579–590.CrossRefPubMedGoogle Scholar
  31. Louie, K., and Wilson, M.A. (2001). Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29: 145–156.CrossRefPubMedGoogle Scholar
  32. Lynch, M.A. (2004). Long-Term Potentiation and Memory. Physiol Reviews 84: 87–136.CrossRefGoogle Scholar
  33. Meyer, D. and Kieras, D. (1997). A computational theory of executive cognitive processes and human multiple-task performance: part 1, basic mechanisms. Psychological Reviews 104: 3–65.CrossRefGoogle Scholar
  34. McClelland, J.L., McNaughton, B.L., and O’Reilly, R.C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol Reviews 102: 419–457.CrossRefGoogle Scholar
  35. McCloskey, M., and Cohen, N.J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. In Bower G.H. (ed.), The psychology of learning and motivation (Vol. 24, pp. 109–165). New York: Academic.Google Scholar
  36. McNaughton, B.L., and Morris, R.G.M. (1987). Hippocampal synaptic enhancement and information storage. Trends Neuroscience 10: 408–415.CrossRefGoogle Scholar
  37. Meeter, M., and Murre, J.M.J. (2005). Tracelink: A model of consolidation and amnesia. Cognitive Neuropsychology 22: 559–587.CrossRefPubMedGoogle Scholar
  38. Minton, S. (1990). Quantitative results concerning the utility of explanation-based learning. Artificial Intelligence 42: 363–391.CrossRefGoogle Scholar
  39. Murre, J.M. (1996). TraceLink: a model of amnesia and consolidation of memory. Hippocampus 6: 675–684.CrossRefPubMedGoogle Scholar
  40. Myers, R.E., and Sperry, R.W. (1953). Interocular transfer of a visual forma discrimination habit in cats after section of the optic chaism and corpus callosum. Anatomy Record 115: 351–352.Google Scholar
  41. Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.Google Scholar
  42. O’Kane, G., Kensinger, E.A., and Corkin, S. (2004). Evidence for semantic learning in profound amnesia: an investigation with patient H.M. Hippocampus 14: 417–425.Google Scholar
  43. O’Reilly, R.C., Norman, K., and McClelland, J.L. (1998). A hippocampal model of recognition memory. In: Jordan M.I., Kearns M.J., Solla S.A., (eds.), Neural information processing systems, (Vol. 10, pp. 73–79). Cambridge, MA: MIT.Google Scholar
  44. Pavlides, C., and Winson, J. (1989). Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes. Journal of Neuroscience 9: 2907–2918.PubMedGoogle Scholar
  45. Pearlman, C. (1971). Latent learning impaired by REM sleep deprivation. Psychonomic Science 25: 135–136.Google Scholar
  46. Poe, G.R., Nitz, D.A., McNaughton, B.L., and Barnes, C.A. (2000). Experience dependent phase-reversal of hippocampal neuron firing during REM sleep. Brain Research 855: 176–180.CrossRefPubMedGoogle Scholar
  47. Postle, B.R., and Corkin, S. (1998). Impaired word-stem completion priming but intact perceptual identification priming with novel words: evidence from the amnesic patient H.M. Neuropsychologia 36: 421–440.Google Scholar
  48. Ribot, T. (1881). Les maladies de la memoire. Paris: Germer Baillare.Google Scholar
  49. Schank, R. (1995). Information is suprises. In: Brockman J. (ed.), The third culture. New York: Simon and Schuster.Google Scholar
  50. Schwartz, S. (2003). Are life episodes replayed during dreaming? Trends in Cognitive Sciences 7: 325–327.CrossRefPubMedGoogle Scholar
  51. Scoville, W.B., and Milner, B. (1957). Loss of recent memory after bilateral hippocampal lesions. Journal of Neurology, Neurosurgery and Psychiatry 20: 11–21.CrossRefGoogle Scholar
  52. Searle, J. (1980). Minds, brains, and programs. Behavioral and Brain Sciences 3: 417–424.CrossRefGoogle Scholar
  53. Smolenshy, P. (1997), Connectionist modeling, In Haugeland, J. (ed.), Mind design II. London: MIT.Google Scholar
  54. Sperry, R. (1982). Some effects of disconnecting the cerebral hemispheres. Science 217: 1223–1226.CrossRefPubMedGoogle Scholar
  55. Squire, L.R. (2004). Memory systems of the brain: A brief history and current perspective. Neurobiology of Learning and Memory 82: 171–177.CrossRefPubMedGoogle Scholar
  56. Squire, L.R., and Alvarez, P. (1995). Retrograde amnesia and memory consolidation: a neurobiological perspective. Current Opinion in Neurobiology 5: 169–177.CrossRefPubMedGoogle Scholar
  57. Squire, L.R., and Zola, S.M. (1998). Episodic memory, semantic memory, and amnesia. Hippocampus 8: 205–211.CrossRefPubMedGoogle Scholar
  58. Staba, R. J., Wilson, C. L., Fried, I., and Engel, J. J. (2002). Single neuron burst firing in the human hippocampus during sleep. Hippocampus 12: 724–734.CrossRefPubMedGoogle Scholar
  59. Sun, R. (2004). Desiderata for cognitive architectures. Philosophical Psychology 17: 343–374.CrossRefGoogle Scholar
  60. Sun, R., and Alexandre, F. (eds.) (1997). Connectionist: symbolic interpretation; from unified to hybrid approaches. Lawrence Erlbaum Associates.Google Scholar
  61. Sun, R., Merrill, E., and Peterson, T. (2001). From implicit skills to explicit knowledge: a bottom–up model of skill learning. Cognitive Science 25: 203–244.CrossRefGoogle Scholar
  62. Sun, R. (1995). Robust reasoning: integrating rule-based and similarity-based reasoning. Artificial Intelligence 75(2): 241–296.CrossRefGoogle Scholar
  63. Sun, R. (1999). Accounting for the computational basis of consciousness: a connectionist approach. Consciousness and Cognition 8: 529–565.CrossRefPubMedGoogle Scholar
  64. Tulving, E. (1983). Elements of episodic memory. Cambridge: Oxford University Press.Google Scholar
  65. Tulving, E., Hayman, C.A.G., and Macdonald, C.A. (1991). Long-lasting perceptual priming and semantic learning in amnesia: a case experiment. Journal of Experimental Psychology: Learning, Memory & Cognition 17: 595–617.CrossRefGoogle Scholar
  66. Teyler, T.J., and DiScenna, P. (1986). The hippocampal memory indexing theory, Behavioral Neuroscience 100: 147–154.CrossRefPubMedGoogle Scholar
  67. Vargha-Khadem, F., Gadian, D.G., Watkins, K.E., Connelly, A., Van Paesschenm, W., and Mishkin, M. (1997). Differential effects of early hippocampal pathology on episodic and semantic memory. Science 277: 376–380.CrossRefPubMedGoogle Scholar
  68. Wallenstein, G.V., Eichenbaum, H.B., and Hasselmo, M.E. (1998). The hippocampus as an associator of discontiguous events. Trends Neuroscience 21: 317–323.CrossRefGoogle Scholar
  69. Watkins, C. (1989). Learning with delayed rewards. Ph.D. Thesis, Cambridge University, Cambridge, UK.Google Scholar
  70. Wilson, M.A., and McNaughton, B.L. (1994). Reactivation of hippocampal ensemble memories during sleep. Science 265: 676–679.CrossRefPubMedGoogle Scholar
  71. Wolf, F.A. (1994). The dreaming Universe. New York: Simon & Schuster.Google Scholar
  72. Zachary, W., Lementec, J., and Ryder, J. (1996). Interface agents in complex systems. In Nituen, C. and Park, E. (eds.), Human interaction with complex systems: conceptual principles and design practice. Needham, MA: Kluwer.Google Scholar
  73. Zhang, Q. (2005). An artificial intelligent counter. Cognitive Systems Research 6: 320–332.CrossRefGoogle Scholar
  74. Zhang, Q. (2009a). A computational account of dreaming: learning and memory consolidation. Cognitive Systems Research 10: 91–101.CrossRefGoogle Scholar
  75. Zhang, Q. (2009b). A consequence of failed sequential learning: A computational account of sdevelopmental amnesia. Cognitive computation 1: 244–256.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.Sensor SystemMadisonUSA

Personalised recommendations