Neural Processing Letters

, Volume 47, Issue 3, pp 1027–1039 | Cite as

Words-In-Sequence Memory Formed by Eye Movement Sequences During Reading: A Network Model Based on Theta Phase Coding

  • Naoyuki Sato


Revealing the neuronal mechanisms enabling the hippocampus to maintain episodic memory (i.e., memory for personal events) is a fundamental issue for our understanding of human intelligence. A temporal compression mechanism based on theta phase coding has been shown to be essential for the encoding of episodic memory occurring on a behavioral timescale (>a few seconds) and capable of operating sequential and spatial memory. However, episodic memory models should be developed to handle more semantic-rich contents. Here, memory from the reading of a passage of literature was evaluated using a network model based on theta phase coding. Two types of input were simultaneously applied: word inputs, defined by the eye movement sequence obtained during the reading, with each fixated word encoded by a vector computed from a statistical language model with a large text corpus; and sequence inputs, defined by random activations and representing a gradually changing input pattern, independent of the eye movement. The results successfully demonstrated a memory generated by the word sequence from the 6-min reading session, and the memory network for the sequence input was shown to be essential for the retrieval. This result was characterized by a words-in-sequence structure in the network formed by theta phase coding, of which, the unidirectional connections among sequence units dominantly evoked the sequential activation, which further conveyed word unit activations through the unidirectional connections from the sequence to the word units. This suggests a general role for theta phase coding in the formation of episodic memory.


Computational neuroscience Hippopcampus Episodic memory Neural oscillation Statistical language modeling 



This work was partially supported by JSPS KAKENHI Grant No. 26540069 and MEXT KAKENHI Grant No. 16H01618 (Non-linear Neuro-oscillology).


  1. 1.
    Squire LR (1992) Declarative and nondeclarative memory: multiple brain systems supporting learning and memory. J Cogn Neurosci 4(3):232–243CrossRefGoogle Scholar
  2. 2.
    Kahana MJ, Seelig D, Madsen JR (2001) Theta returns. Curr Opin Neurobiol 11(6):739–744CrossRefGoogle Scholar
  3. 3.
    Marr D (1971) Simple memory: a theory for archicortex. Philos Trans R Soc Lond B Biol Sci 262(841):23–81CrossRefGoogle Scholar
  4. 4.
    Hasselmo ME, Wyble BP, Wallenstein GV (1996) Encoding and retrieval of episodic memories: role of cholinergic and GABAergic modulation in the hippocampus. Hippocampus 6(6):693–708CrossRefGoogle Scholar
  5. 5.
    Samsonovich A, McNaughton BL (1997) Path integration and cognitive mapping in a continuous attractor neural network model. J Neurosci 17(15):5900–5920CrossRefGoogle Scholar
  6. 6.
    Levy WB (1996) A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks. Hippocampus 6(6):579–590CrossRefGoogle Scholar
  7. 7.
    Yamaguchi Y (2003) A theory of hippocampal memory based on theta phase precession. Biol Cybern 89(1):1–9zbMATHGoogle Scholar
  8. 8.
    O’Keefe J, Recce ML (1993) Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 3(3):317–330CrossRefGoogle Scholar
  9. 9.
    Sato N, Yamaguchi Y (2003) Memory encoding by theta phase precession in the hippocampal network. Neural Comp 15:2379–2397CrossRefzbMATHGoogle Scholar
  10. 10.
    Sato N, Yamaguchi Y (2005) Online formation of a hierarchical cognitive map for object-place association by theta phase coding. Hippocampus 15(7):963–978CrossRefGoogle Scholar
  11. 11.
    Sato N, Yamaguchi Y (2009) A computational predictor of human episodic memory based on a theta phase precession network. PloS One 4:e7536CrossRefGoogle Scholar
  12. 12.
    Mitchell TM, Shinkareva SV, Carlson A, Chang KM, Malave VL, Mason RA, Just MA (2008) Predicting human brain activity associated with the meanings of nouns. Science 320(5880):1191–1195CrossRefGoogle Scholar
  13. 13.
    Sato N (2015) Neuroscience meeting planner. Society for Neuroscience, ChicagoGoogle Scholar
  14. 14.
    Sato N, Ozaki TJ, Someya Y, Anami K, Ogawa S, Mizuhara H, Yamaguchi Y (2010) Subsequent memory-dependent EEG theta correlates to parahippocampal blood oxygenation level-dependent response. Neuroreport 21(3):168–172CrossRefGoogle Scholar
  15. 15.
    Maekawa K, Yamazaki M, Ogiso T, Maruyama T, Ogura H, Kashino W, Koiso H, Yamaguchi M, Tanaka M, Den Y (2014) Balanced corpus of contemporary written Japanese. Lang Resour Eval 48:345–371CrossRefGoogle Scholar
  16. 16.
    Griffiths TL, Steyvers M (2004) Finding scientific topics. Proc Natl Acad Sci United States Am 101(Suppl 1):5228–5235CrossRefGoogle Scholar
  17. 17.
    Sato N, Yamaguchi Y (2009) Relationship between an input sequence and asymmetric connections formed by theta phase precession and STDP. In: Mario K, Nikola K, Coghill G (Eds) Advances in neuro-information processing,vol 5506. Springer Berlin Heidelberg, pp 186–193Google Scholar
  18. 18.
    Terada S (2016) Neuroscience meeting planner. Society for Neuroscience, San DiegoGoogle Scholar
  19. 19.
    Hill A (1978) First occurrence of hippocampal spatial firing in a new environment. Exp Neurol 62(2):282–297MathSciNetCrossRefGoogle Scholar
  20. 20.
    Lee AK, Wilson MA (2002) Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36(6):1183–1194CrossRefGoogle Scholar
  21. 21.
    Bi GQ, Poo MM (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18(24):10464–10472CrossRefGoogle Scholar
  22. 22.
    Mishra RK, Kim S, Guzman SJ, Jonas P (2016) Symmetric spike timing-dependent plasticity at CA3-CA3 synapses optimizes storage and recall in autoassociative networks. Nat Commun 7:11552. doi: 10.1038/ncomms11552 CrossRefGoogle Scholar
  23. 23.
    Eichenbaum H, Yonelinas AP, Ranganath C (2007) The medial temporal lobe and recognition memory. Annu Rev Neurosci 30:123–152CrossRefGoogle Scholar
  24. 24.
    Sato N, Yamaguchi Y (2009) Spatial-area selective retrieval of multiple object-place associations in a hierarchical cognitive map formed by theta phase coding. Cogn Neurodyn 3(2):131–140CrossRefGoogle Scholar
  25. 25.
    Song S, Miller KD, Abbott LF (2000) Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci 3(9):919–926CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.Future University HakodateHakodateJapan

Personalised recommendations