Capturing Meaning from Text as Word Embeddings

Abstract

This chapter provides a hands-on guide to learn word embeddings from text corpora. To this purpose we choose Swivel, whose extension is the basis for the Vecsigrafo algorithm, which will be described in Chap. 6 . As introduced in Chap. 2 , word embedding algorithms like Swivel are not contextual, i.e. they do not provide different representations for the different meanings a polysemous word may have. As we will see in the subsequent chapters of the book, this can be addressed in a variety of ways. For the purpose of this chapter, we focus on a basic way to represent words using embeddings.