Skip to main content

Hyperdimensional Representations in Semiotic Approach to AGI

Part of the Lecture Notes in Computer Science book series (LNAI,volume 12177)

Abstract

The paper is dedicated to the use of distributed hyperdimensional vectors to represent sensory information in the sign-based cognitive architecture, in which the image component of a sign is encoded by a causal matrix. The hyperdimensional representation allows us to update the precedent dimension of the causal matrix and accumulate information in it during the interaction of the system with the environment. Due to the high dimensionality of vectors, it is possible to reduce the representation and reasoning on the entities related to them to simple operations on vectors. In this work we show how hyperdimensional representations are embedded in an existing sign formalism and provide examples of visual scene encoding.

Keywords

  • Cognitive agent
  • Sign-based world model
  • Semiotic network
  • Causal tensor
  • Distributed representation
  • Symbol grounding

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-52152-3_24
  • Chapter length: 11 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   79.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-52152-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.

References

  1. Newell, A., Simon, H.A.: Computer science as empirical inquiry: symbols and search. Commun. ACM 19(3), 113–126 (1976). https://doi.org/10.1145/360018.360022

    MathSciNet  CrossRef  Google Scholar 

  2. Rumelhart, D.E., McClelland J.L.: Learning internal representations by error propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations, pp. 318–362, MITP (1987)

    Google Scholar 

  3. Richardson, M., Domingos, P.: Markov logic networks. Mach. Learn. 62(1–2), 107–136 (2006). https://doi.org/10.1007/s10994-006-5833-1

    CrossRef  Google Scholar 

  4. Wang, J., Domingos, P.: Hybrid markov logic networks. AAAI 137(1–2), 1106–1111 (2008)

    Google Scholar 

  5. Serafini, L., Garcez, A.D.A.: Logic tensor networks: deep learning and logical reasoning from data and knowledge. In: CEUR Workshop Proceedings, p. 1768 (2016)

    Google Scholar 

  6. Kanerva, P.: Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors. Cogn. Comput. 1(2), 139–159 (2009). https://doi.org/10.1007/s12559-009-9009-8

    CrossRef  Google Scholar 

  7. Bandaragoda, T., De Silva, D., Kleyko, D., Osipov, E., Wiklund, U., Alahakoon, D.: Trajectory clustering of road traffic in urban environments using incremental machine learning in combination with hyperdimensional computing. In: IEEE Intelligent Transportation Systems Conference (ITSC), pp. 1664–1670 (2019)

    Google Scholar 

  8. Kovalev, A.K., Panov, A.I.: Mental actions and modelling of reasoning in semiotic approach to AGI. In: Hammer, P., Agrawal, P., Goertzel, B., Iklé, M. (eds) Artificial General Intelligence. AGI 2019. Lecture Notes in Computer Science, vol 11654. Springer, Cham (2019) https://doi.org/10.1007/978-3-030-27005-6_12

  9. Osipov, G.S., Panov, A.I.: Relationships and operations in a sign-based world model of the actor. Sci. Techn. Inf. Process. 45(5), 317–330 (2018)

    CrossRef  Google Scholar 

  10. Kiselev, G.A., Panov, A.I.: Sign-based approach to the task of role distribution in the coalition of cognitive agents. In: SPIIRAS Proceedings, pp. 161–187 (2018). https://doi.org/10.15622/sp.57.7

  11. Kiselev, G., Kovalev, A., Panov, A.I.: Spatial reasoning and planning in sign-based world model. In: Kuznetsov, S., Osipov, G.S., Stefanuk, V. (eds.) Artificial Intelligence. RCAI 2018. Communications in Computer and Information Science, pp. 1–10. Springer (2018). https://doi.org/10.1007/978-3-030-00617-4_1

  12. Panov, A.I.: Goal Setting and Behavior Planning for Cognitive agents. Sci. Tech. Inf. Process. 46(6), 404–415 (2019)

    CrossRef  Google Scholar 

  13. Koren, Y.: The BellKor Solution to the Netflix Grand Prize (2009)

    Google Scholar 

  14. Douglas, L.T.R., Laura, M.G., David, C.P.: An improved model of semantic similarity based on lexical co-occurrence. In: Communications of the ACM (2006)

    Google Scholar 

  15. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: 1st International Conference on Learning Representations, ICLR 2013 - Workshop Track Proceedings, pp. 1–12 (2013)

    Google Scholar 

  16. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, vol. 2, pp 3111–3119 (2013)

    Google Scholar 

  17. Pennington, J., Socher, R., Manning, C.D.: GloVe: Global Vectors for Word Representation, 31(6), 682–687 (2017). https://doi.org/10.1080/02688697.2017.1354122

  18. Mikolov, T., Yih, W., Zweig, G.: Linguistic regularities in continuous space word representations. Proc. OfNAACL-HLT 2013, 746–751 (2013)

    Google Scholar 

  19. Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. In: 4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings, pp. 1–16 (2016)

    Google Scholar 

  20. Hou, X., Shen, L., Sun, K., Qiu, G.: Deep feature consistent variational autoencoder. In: Proceedings - 2017 IEEE Winter Conference on Applications of Computer Vision, WACV 2017, pp. 1133–1141 (2017). https://doi.org/10.1109/WACV.2017.131

  21. Plate, T.A.: Holographic Reduced Representations: Distributed Representation for Cognitive Structures. Center for the Study of Language and Information (CSLI). Stanford, ‎Redwood City (2003)

    Google Scholar 

  22. Plate, T.A.: Distributed representations and nested compositional structure, University of Toronto, Ph.D. Thesis (1994)

    Google Scholar 

  23. Gallant, S.I., Okaywe, T.W.: Representing objects, relations, and sequences. Neural Comput. 25(8), 2038–2078 (2013)

    MathSciNet  CrossRef  Google Scholar 

  24. Kleyko, D., Osipov, E., Senior, A., Khan, A.I., Sekercioglu, Y.A.: Holographic graph neuron: a bio-inspired architecture for pattern processing. IEEE Trans. Neural Netw. Learn. Syst. 28(6), 1250–1262 (2017)

    MathSciNet  CrossRef  Google Scholar 

  25. Frady, E.P., Kleyko, D., Sommer, F.T.: A theory of sequence indexing and working memory in recurrent neural networks. Neural Comput. 30, 1449–1513 (2018)

    MathSciNet  CrossRef  Google Scholar 

  26. Smirnov, I., Panov, A.I., Skrynnik, A., Isakov, V., Chistova, E.: Personal cognitive assistant: concept and key principals. Inform. In: IEEE Primen, vol. 13, pp. 105–113 (2019). https://doi.org/10.14357/19922264190315

Download references

Acknowledgements

The reported study was supported by RFBR, research Projects No. 18-07-01011 and No. 19-37-90164.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aleksandr I. Panov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Kovalev, A.K., Panov, A.I., Osipov, E. (2020). Hyperdimensional Representations in Semiotic Approach to AGI. In: Goertzel, B., Panov, A., Potapov, A., Yampolskiy, R. (eds) Artificial General Intelligence. AGI 2020. Lecture Notes in Computer Science(), vol 12177. Springer, Cham. https://doi.org/10.1007/978-3-030-52152-3_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-52152-3_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-52151-6

  • Online ISBN: 978-3-030-52152-3

  • eBook Packages: Computer ScienceComputer Science (R0)