Abstract
Problems (inherent in compound hierarchical representations) of preserving information on the structure of coded data and methods of solving them by “binding” of information substructures are discussed. A type of distributed representations is considered in which data are coded by multidimensional binary sparse vectors. The constraints imposed on a binding procedure are formulated and its implementation is provided. Some examples of representation of structured data are considered.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
N. M. Amosov, Modeling of Thinking and the Mind, Spartan Books, New York (1967).
Z. L. Rabinovich, “Natural thinking mechanisms and computer intelligence,” Kibern. Sist. Anal., No. 5, 82–89 (2003).
E. M. Kussul, Associative Neural-like Structures [in Russian], Naukova Dumka, Kiev (1991).
T. Plate, Holographic Reduced Representation: Distributed Representation for Cognitive Structures, CSLI Publications, Stanford (2003).
S. Thorpe, “Localized versus distributed representations,” in: The Handbook of Brain Theory and Neural Networks, MIT Press, Cambridge, MA (2003), pp. 643–646.
D. A. Rachkovskij and E. M. Kussul, “Binding and normalization of binary sparse distributed representations by context-dependent thinning,” Neural Comput., 2, No.13, 411–452 (2001).
A. Kitayev, A. Shen', and M. Vyalyi, Classical and Quantum Computations [in Russian], MTsNMO, Moscow (1999).
D. A. Rachkovskij, “Representation and processing of structures with binary sparse distributed codes, ” IEEE Trans. on Knowledge and Data Eng., 2, No.13, 261–276 (2001).
D. Rumelhart, J. McClelland, and G. Hinton, “Distributed representations,” in: Parallel Distributed Processing, Explorations in the Microstructure of Cognition, MIT Press, Cambridge, MA (1986), pp. 77–109.
A. Browne and R. Sun, “Connectionist inference models,” Neural Networks, 10, No.14, 1331–1355 (2001).
D. O. Hebb, The Organization of Behavior: A Neuropsychological Theory, Wiley, New York (1949).
G. E. Hinton, “Mapping part-whole hierarchies into connectionist networks,” Artificial Intelligence, 46, Nos. 1–2, 47–75 (1990).
D. A. Rachkovskij and E. M. Kussul, “Building a world model with structure-sensitive distributed representations,” http://www.bbsonline.org/Preprints/Rachkovskij/Referees/Rachkovskij.pdf.
P. Kanerva, “Binary spatter-coding of ordered K-tuples,” in: Intern. Conf. on Artificial Neural Networks ICANN'96, Springer, Bochum-Berlin (1996), pp. 869–873.
P. Kanerva, “Dual role of analogy in the design of a cognitive compute,” in: Advances in Analogy Research: Integration of Theory and Data from the Cognitive, Computational, and Neural Sciences, New Bulgarian University, Sofia, Bulgaria (1998), pp. 164–170.
T. N. Baidyk, Neural Networks and Problems of Artificial Intelligence [in Russian], Naukova Dumka, Kiev (2001).
A. A. Frolov, D. A. Rachkovskij, and D. Husek, “On information characteristics of willshaw-like auto-associative memory,” Neural Network World, 2, 141–157 (2002).
M. Abeles, Corticonics: Neural Circuits of the Cerebral Cortex, Cambridge Univ. Press, Cambridge, UK (1991).
J. Feldman, “Neural representation of conceptual knowledge,” in: Neural Connections: Mental Computation, The MIT Press, London (1989), pp. 68–103.
C. Von der Malsburg, “Am I thinking assemblies?” in: Proc. Trieste Meeting on Brain Theory (October 1984), Springer, Berlin (1986), 161–176.
V. Gladun, Processes of Formation of New Knowledge [in Russian], “Pedagog 6,” Sofia (1994).
E. M. Kussul and T. N. Baidyk, “Development of the architecture of a neural-like network for recognition of the form of objects on an image,” Avtomatika 5, No.23, 56–61 (1990).
E. Kussul and T. Baidyk, “Permutative coding technique for a handwritten digit recognition system, ” in: Proc. Intern. Joint Conf. on Neural Networks, 3 (2003), pp. 2163–2168.
D. A. Rachkovskij, “Some approaches to analogical mapping with structure sensitive distributed representations,” Journ. of Experimental and Theoretical Artificial Intelligence, 16, No.3, 125–145 (2004).
Author information
Authors and Affiliations
Additional information
__________
Translated from Kibernetika i Sistemnyi Analiz, No. 3, pp. 3–18, May–June 2005.
Rights and permissions
About this article
Cite this article
Rachkovskii, D.A., Slipchenko, S.V., Kussul', E.M. et al. A Binding Procedure for Distributed Binary Data Representations. Cybern Syst Anal 41, 319–331 (2005). https://doi.org/10.1007/s10559-005-0066-z
Received:
Issue Date:
DOI: https://doi.org/10.1007/s10559-005-0066-z