Skip to main content

Directed Network Analysis Using Transfer Entropy Component Analysis

  • Conference paper
  • First Online:
Structural, Syntactic, and Statistical Pattern Recognition (S+SSPR 2018)

Abstract

In this paper, we present a novel method for detecting directed network characteristics using histogram statistics based on degree distribution associated with transfer entropy. The proposed model in this paper established in information theory looks forward to learn the low dimensional representation of sample graphs, which can be obtained by transfer entropy component analysis (TECA) model. In particular, we apply transfer entropy to measure the transfer information between different time series data. For instances, for the fMRI time series data, we can use the transfer entropy to explore the connectivity between different brain functional regions effectively, which plays a significant role in diagnosing Alzheimers disease (AD) and its prodromal stage, mild cognitive impairment (MCI). With the properties of the directed graph in hand, we commence to further encode it into advanced representation of graphs based on the histogram statistics of degree distribution and multilinear principal component analysis (MPCA) technology. It not only reduces the memory space occupied by the huge transfer entropy matrix, but also enables the features to have a stronger representational capacity in the low-dimensional feature space. We conduct a classification experiment on the proposed model for the fMRI time series data. The experimental results verify that our model can significantly improve the diagnosis accuracy for MCI subjects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lo, R.Y., et al.: Longitudinal change of biomarkers in cognitive decline. Arch. Neurol. 68(10), 1257–1266 (2011)

    Article  Google Scholar 

  2. Machulda, M.M., et al.: Functional MRI changes in amnestic and non-amnestic MCI during encoding and recognition tasks (2009)

    Google Scholar 

  3. Wee, C.Y., Yang, S., Yap, P.T., Shen, D.: Sparse temporally dynamic resting-state functional connectivity networks for early MCI identification. Brain Imaging Behav. 10(2), 342–356 (2016)

    Article  Google Scholar 

  4. Kang, U., Tong, H., Sun, J.: Fast random walk graph kernel (2012)

    Google Scholar 

  5. Onias, H., et al.: Brain complex network analysis by means of resting state fMRI and graph analysis: will it be helpful in clinical epilepsy? Epilepsy Behav. 38, 71–80 (2014)

    Article  Google Scholar 

  6. Edwards, D.A.: The mathematical foundations of quantum mechanics (1955)

    Google Scholar 

  7. Passerini, F., Severini, S.: The von Neumann entropy of networks. SSRN Electron. J. (12538) (2008)

    Google Scholar 

  8. Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27(4), 379–423 (1948)

    Article  MathSciNet  Google Scholar 

  9. Pluim, J.P.W., Maintz, J.B.A., Viergever, M.A.: Image registration by maximization of combined mutual information and gradient information. IEEE Trans. Med. Imaging 19(8), 809–814 (2000)

    Article  Google Scholar 

  10. Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85(2), 461–464 (2000)

    Article  MathSciNet  Google Scholar 

  11. Haiping, L., Plataniotis, K.N., Venetsanopoulos, A.N.: MPCA: multilinear principal component analysis of tensor objects. IEEE Trans. Neural Netw. 19(1), 18 (2008)

    Article  Google Scholar 

  12. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 1–27 (2011)

    Article  Google Scholar 

  13. Shannon, C.E.: The mathematical theory of communication, 1963. MD Comput. 14(4), 306 (1997)

    Google Scholar 

  14. De Lathauwer, L., De Moor, B., Vandewalle, J.: On the best rank-1 and rank-( r 1, r 2, \(\ldots \), r n ) approximation of higher-order tensors. SIAM J. Matrix Anal. Appl. 21(4), 1324–1342 (2000)

    Google Scholar 

  15. Neymotin, S.A., Jacobs, K.M., Fenton, A.A., Lytton, W.W.: Synaptic information transfer in computer models of neocortical columns. J. Comput. Neurosci. 30(1), 69–84 (2011)

    Article  MathSciNet  Google Scholar 

  16. Gourvitch, B., Eggermont, J.J.: Evaluating information transfer between auditory cortical neurons. J. Neurophysiol. 97(3), 2533 (2008)

    Article  Google Scholar 

  17. Martin, T., Ball, B., Newman, M.E.: Structural inference for uncertain networks. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 93(1–1), 012306 (2016)

    Article  Google Scholar 

  18. Ye, C., Wilson, R.C., Hancock, E.R.: Network analysis using entropy component analysis. IMA J. Complex Netw. (2017)

    Google Scholar 

  19. Chen, X., Zhang, H., Zhang, L., Shen, C., Lee, S.W., Shen, D.: Extraction of dynamic functional connectivity from brain grey matter and white matter for MCI classification. Hum. Brain Mapp. 38(10), 5019 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhihong Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, M. et al. (2018). Directed Network Analysis Using Transfer Entropy Component Analysis. In: Bai, X., Hancock, E., Ho, T., Wilson, R., Biggio, B., Robles-Kelly, A. (eds) Structural, Syntactic, and Statistical Pattern Recognition. S+SSPR 2018. Lecture Notes in Computer Science(), vol 11004. Springer, Cham. https://doi.org/10.1007/978-3-319-97785-0_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-97785-0_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-97784-3

  • Online ISBN: 978-3-319-97785-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics