We propose category theory, the mathematical theory of structure, as a vehicle for defining ontologies in an unambiguous language with analytical and constructive features. Specifically, we apply categorical logic and model theory, based upon viewing an ontology as a sub-category of a category of theories expressed in a formal logic. In addition to providing mathematical rigor, this approach has several advantages. It allows the incremental analysis of ontologies by basing them in an interconnected hierarchy of theories, with an operation on the hierarchy that expresses the formation of complex theories from simple theories that express first principles. Another operation forms abstractions expressing the shared concepts in an array of theories. The use of categorical model theory makes possible the incremental analysis of possible worlds, or instances, for the theories, and the mapping of instances of a theory to instances of its more abstract parts. We describe the theoretical approach by applying it to the semantics of neural networks.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Adamek, J., H. Herrlich and G. Strecker: 1990, Abstract and Concrete Categories: The Joy of Cats, Cambridge University Press.
Andrews, P. B.: 1986, An Introduction to Mathematical Logic and Type Theory: To Truth through Proof, Academic Press, Inc.
R. Andrews J. Diederich A. B. Tickle (1995) ArticleTitle‘Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks’ Knowledge-Based Systems 8 IssueID6 373–389 Occurrence Handle10.1016/0950-7051(96)81920-4
M. A. Arbib (1987) Brains, Machines, and Mathematics Springer Berlin
Bartfai, G.: 1994, ‘Hierarchical Clustering with ART Neural Networks’, in Proceedings of the International Conference on Neural Networks, Orlando, FL, June 28–July 2, 1994.
Bennet, M. K.: 1995, Affine and Projective Geometry, John Wiley and Sons.
G. A. Carpenter A.-H. Tan (1995) ArticleTitle‘Rule Extraction: From Neural Architecture to Symbolic Representation’ Connection Science 7 3–27
Craven, M. W. and J. W. Shavlik: 1993, ‘Learning Symbolic Rules using Artificial Neural Networks’, in Proceedings of the 10th International Machine Learning Conference, Amherst, MA, Morgan Kaufmann.
Crole, R. L.: 1993, Categories for Types, Cambridge University Press.
A Damasio (1989) ArticleTitle‘Time-Locked Multiregional Retroactivation: A Systems-Level Proposal for the Neural Substrates of Recall and Recognition’ Cognition 33 25–62 Occurrence Handle10.1016/0010-0277(89)90005-X
A. C. Ehresmann J.-P. Vanbremeersch (1997) ArticleTitle‘Information Processing and Symmetry-Breaking in Memory Evolutive Systems’ BioSystems 43 25–40 Occurrence Handle10.1016/S0303-2647(97)01690-0
Fu, L. M.: 1992, ‘A Neural Network for Learning Rule-Based Systems’, in Proceedings of the International Joint Conference on Neural Networks, Baltimore, MD.
J. A. Goguen R. M. Burstall (1992) ArticleTitle‘Institutions: Abstract Model Theory for Specification and Programming’ Journal of the Association for Computing Machinery 39 IssueID1 95–146
Gruber, T. and G. Olsen: 1994, ‘An Ontology for Engineering Mathematics’, in Proceedings of the Fourth International Conference on Principles of Knowledge Representation and Reasoning, Morgan Kauffman.
Gust, H. and K.-U. Kühnberger: 2005, ‘Learning Symbolic Inferences with Neural Networks’, in Proceedings of the XXVII Annual Conference of the Cognitive Science Society (CogSci2005), Stresa, Italy, Cognitive Science Society, ed. offices University of Indiana, Bloomington, IN.
M. J Healy (1999a) ArticleTitle‘A Topological Semantics for Rule Extraction with Neural Networks’ Connection Science 11 IssueID1 91–113 Occurrence Handle10.1080/095400999116377
M. J. Healy (1999b) ‘Colimits in Memory: Category Theory and Neural Systems’ J. S. Boswell (Eds) Proceedings of IJCNN’99: International Joint Conference on Neural Networks IEEE Press Washington, DC
M. J. Healy (2000) ‘Category Theory Applied to Neural Modeling and Graphical Representations’ M. Gori S. -I. Amari C. L. Giles V. Piuri (Eds) Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks: IJCNN2000 IEEE Computer Society Press Como, Italy
M. J. Healy T. P. Caudell (1997) ArticleTitle‘Acquiring Rule Sets as a Product of Learning in a Logical Neural Architecture’ IEEE Transactions on Neural Networks 8 IssueID3 461–474 Occurrence Handle10.1109/72.572088
Healy, M. J. and T. P. Caudell: 2001, ‘A Categorical Semantic Analysis of ART Architectures’, in IJCNN’01:International Joint Conference on Neural Networks, Washington, DC, IEEE Press.
Healy, M. J. and T. P. Caudell: 2002, ‘Aphasic Compressed Representations: A Functorial Semantic Design Principle for Coupled ART Networks’, in The 2002 International Joint Conference on Neural Networks (IJCNN’02), Honolulu, (CD-ROM Proceedings), IEEE Press.
Healy, M. J. and T. P. Caudell: 2003, ‘From Categorical Semantics to Neural Network Design’, in The Proceedings of the IJCNN 2003 International Joint Conference on Neural Networks, Portland, OR, 2003 (CD-ROM Proceedings), IEEE Press.
Healy, M. J. and T. P. Caudell: 2004, Neural Networks, Knowledge, and Cognition: A Mathematical Semantic Model Based upon Category Theory. Technical Report EECE-TR-04-020, Department of Electrical and Computer Engineering, University of New Mexico.
Healy, M. and K. Williamson: 2000, ‘Applying Category Theory to Derive Engineering Software from Encoded Knowledge’, in Proceedings of the Algebraic Methodology and Software Technology 8th International Conference, AMAST 2000, Iowa City, IA. Published in Lecture Notes in Computer Science, Springer-Verlag.
D. O. Hebb (1949) The Organization of Behavior John Wiley and Sons New York
Heileman, G. L., M. Georgiopoulos, M. J. Healy and S. J. Verzi: 1997, ‘The Generalization Capabilities of ARTMAP’, in Proceedings of the International Joint Conference on Neural Networks (ICNN97), Houston, TX.
J. Hirsch D. R. Moreno K. H. S. Kim (2001) ArticleTitle‘Interconnected Large-Scale Systems for Three Fundamental Cognitive Tasks Revealed by Functional mri’ Journal of Cognitive Neuroscience 13 IssueID3 389–405 Occurrence Handle10.1162/08989290151137421
Jullig, R. and Y. V. Srinivas: 1993, ‘Diagrams for Software Synthesis’, in Proceedings of KBSE ‘93: The Eighth Knowledge-Based Software Engineering Conference, IEEE Computer Society Press.
N. K Kasabov (1996) ArticleTitle‘Adaptable Neuro Production Systems’ Neurocomputing 13 95–117 Occurrence Handle10.1016/0925-2312(95)00098-4
W. M. Kelley C. N. Macrae C. L. Wyland S. Caglar S. Inati T. F. Heatherton (2002) ArticleTitle‘Finding the Self ? An Event-Related fmri Study’ Journal of Cognitive Neuroscience 14 IssueID5 785–794 Occurrence Handle10.1162/08989290260138672
Lawvere, F. W. and S. H. Schanuel: 1997, Conceptual Mathematics: A First Introduction to Categories, Cambridge University Press.
Mac Lane, S.: 1971, Categories for the Working Mathematician, Springer. This is the standard reference for mathematicians, written by one of the two co-discoverors of category theory (S. Eilenberg being the other).
McClelland, J. L., D. E. Rumelhart and G. E. Hinton: 1986, ‘The Appeal of Parallel Distributed Processing’, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, The MIT Press, pp. 3–44. This volume contains an exposition on bias nodes as a neural mechanism for varying the thresholds of a layer of nodes.
W. S. McCullough W. Pitts (1943) ArticleTitle‘A Logical Calculus of the Ideas Immanent in Nervous Activity’ Bulletin of Mathematical Biophysics 5 115–133
Meseguer, J.: 1989, ‘General logics’, in Logic Colloquium ’87, Science Publishers B. V. (North-Holland), pp. 275–329.
S. Mitra S. K. Pal (1995) ArticleTitle‘Fuzzy Multi-Layer Perceptron, Inferencing and Rule Generation’ IEEE Transactions on Neural Networks 6 51–63 Occurrence Handle10.1109/72.363450
I. Otto P. Grandguillaume L. Boutkhil Y. Burnod E. Guigon (1992) ArticleTitle‘Direct and Indirect Cooperation between Temporal and Parietal Networks for Invariant Visual Recognition’ Journal of Cognitive Neuroscience 4 IssueID1 35–57
C Perry (1999) ArticleTitle‘Testing a Computational Account of Category-Specific Deficits’ Journal of Cognitive Neuroscience 11 IssueID3 312–320 Occurrence Handle10.1162/089892999563418
Pierce, B. C.: 1991, Basic Category Theory for Computer Scientists, MIT Press.
G Pinkas (1995) ArticleTitle‘Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge’ Artificial Intelligence 77 203–247 Occurrence Handle10.1016/0004-3702(94)00032-V
S. C. Rao G. Ranier E. K. Miller (1997) ArticleTitle‘Integration of What and Where in the Primate Prefrontal Cortex’ Science 276 821–824
M. Riesenhuber T. Poggio (1999) ArticleTitle‘Are Cortical Models Really Bound by the Binding Problem?’ Neuron 24 87–93 Occurrence Handle10.1016/S0896-6273(00)80824-7
R Rosen (1958a) ArticleTitle‘A Relational Theory of Biological Systems’ Bulletin of Mathematical Biophysics 20 245–260
R Rosen (1958b) ArticleTitle‘The Representation of Biological Systems from the Standpoint of the Theory of Categories’ Bulletin of Mathematical Biophysics 20 317–341
J Sima (1995) ArticleTitle‘Neural Expert Systems’ Neural Networks 8 261–271
L. R. Squire S. Zola-Morgan (1991) ArticleTitle‘The Medial Temporal Lobe Memory System’ Science 253 1380–1385
Srinivas, Y. V. and R. Jullig: 1995, ‘SpecwareTM: Formal Support for Composing Software’, in Proceedings of the Conference of Mathematics of Program Construction.
Stoltenberg-Hansen, V., I. Lindstroem, and E. R. Griffor: 1994, Mathematical Theory of Domains, Cambridge University Press.
Tse, T. H.: 1991, A Unifying Framework for Structured Analysis and Design Models: An Approach using Initial Algebra Semantics and Category Theory, Cambridge University Press.
Vickers, S.: 1993, Topology via Logic, Cambridge University Press.
I Wickelgren (1997) ArticleTitle‘Getting a Grip on Working Memory’ Science 275 1580–1582
Williamson, K. and M. Healy: 1997, ‘Formally Specifying Engineering Design Rationale’, in Proceedings of the Automated Software Engineering Conference-1997.
K. Williamson M. Healy (2000) ArticleTitle‘Deriving Engineering Software from Requirements’ Journal of Intelligent Manufacturing 11 IssueID1 3–28 Occurrence Handle10.1023/A:1008959706859
K. Williamson M. Healy R. Barker (2001) ArticleTitle‘Industrial Applications of Software Synthesis via Category Theory-Case Studies using SpecwareTM’ Automated Software Engineering 8 IssueID1 7–30 Occurrence Handle10.1023/A:1008759623876
About this article
Cite this article
Healy, M.J., Caudell, T.P. Ontologies and Worlds in Category Theory: Implications for Neural Systems. Axiomathes 16, 165–214 (2006). https://doi.org/10.1007/s10516-005-5474-1
- natural transformation
- neural network