Skip to main content
  • Book
  • Open Access
  • © 2023

Vector Semantics

  • This book is open access, which means that you have free and unlimited access

  • Links the formal theory of word vectors to the cognitive theory of linguistics

  • Unifies theories originating in linguistics, logic, artificial intelligence, cognitive science, etc

  • Provides rich inline references to allow broader readership to understand the book content

Part of the book series: Cognitive Technologies (COGTECH)

Buying options

Softcover Book USD 49.99
Price excludes VAT (USA)
This title has not yet been released. You will be able to pre-order it soon.
Hardcover Book USD 59.99
Price excludes VAT (USA)
This title has not yet been released. You will be able to pre-order it soon.

About this book

This open access book introduces Vector semantics, which links the formal theory of word vectors to the cognitive theory of linguistics. 

The computational linguists and deep learning researchers who developed word vectors have relied primarily on the ever-increasing availability of large corpora and of computers with highly parallel GPU and TPU compute engines, and their focus is with endowing computers with natural language capabilities for practical applications such as machine translation or question answering. Cognitive linguists investigate natural language from the perspective of human cognition, the relation between language and thought, and questions about conceptual universals, relying primarily on in-depth investigation of language in use. 

In spite of the fact that these two schools both have ‘linguistics’ in their name, so far there has been very limited communication between them, as their historical origins, data collection methods, and conceptual apparatuses are quite different. Vector semantics bridges the gap by presenting a formal theory, cast in terms of linear polytopes, that generalizes both word vectors and conceptual structures, by treating each dictionary definition as an equation, and the entire lexicon as a set of equations mutually constraining all meanings. 

Keywords

  • Semantics
  • Natural Language Processing
  • Computational Linguistics
  • Artificial Intelligence
  • explainable AI
  • Artificial Neural Nets
  • lexical semantics
  • word vectors
  • embeddings
  • dynamic embeddings
  • algebraic semantic
  • knowledge bases
  • machine learning
  • Open Access

Authors and Affiliations

  • HLT, SZTAKI Computer Science Research Institute, Budapest, Hungary

    András Kornai

About the author

András Kornai is Senior Research Advisor at SZTAKI Institute of Computer Science and full professor at the Department of Algebra, Budapest University of Technology and Economics (BME).  He was educated at Eotvos Lorand University (mathematics) and Stanford (linguistics). He wrote the standard textbook Mathematical Linguistics (Springer 2007) and is past president of the Mathematics of Language SIG of ACL. He is author or co-author of over a hundred refereed publications, four monographs (the last one being Semantics, Springer 2019), and five edited volumes. He is senior member of the IEEE, winner of the ACM Distinguished Scientist award, and member of Academia Europaea. 

Kornai has broad experience in industrial research (Xerox, IBM, BBN) and at startups (MAD, Calera, Belmont, Northern Light, MetaCarta, MindSpeak) working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group.

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

MindSpeak), working as chief scientist at the last three. Several of these startups were purchased by industry leaders (Nuance, PPD, Microsoft) and much of the technology developed under his leadership is still in use. He held various visiting and research positions at Rice University, Boston University, and Harvard. He currently leads the SZTAKI/BME Human Language Technology group 

Buying options

Softcover Book USD 49.99
Price excludes VAT (USA)
This title has not yet been released. You will be able to pre-order it soon.
Hardcover Book USD 59.99
Price excludes VAT (USA)
This title has not yet been released. You will be able to pre-order it soon.