Deep Generative Modeling

1. Front Matter

   Pages i-xviii

   PDF

2. Why Deep Generative Modeling?

   • Jakub M. Tomczak

   Pages 1-12

3. Autoregressive Models

   • Jakub M. Tomczak

   Pages 13-25

4. Flow-Based Models

   • Jakub M. Tomczak

   Pages 27-56

5. Latent Variable Models

   • Jakub M. Tomczak

   Pages 57-127

6. Hybrid Modeling

   • Jakub M. Tomczak

   Pages 129-141

7. Energy-Based Models

   • Jakub M. Tomczak

   Pages 143-158

8. Generative Adversarial Networks

   • Jakub M. Tomczak

   Pages 159-172

9. Deep Generative Modeling for Neural Compression

   • Jakub M. Tomczak

   Pages 173-188

10. Back Matter

    Pages 189-197

    PDF

This textbook tackles the problem of formulating AI systems by combining probabilistic modeling and deep learning. Moreover, it goes beyond typical predictive modeling and brings together supervised learning and unsupervised learning. The resulting paradigm, called deep generative modeling, utilizes the generative perspective on perceiving the surrounding world. It assumes that each phenomenon is driven by an underlying generative process that defines a joint distribution over random variables and their stochastic interactions, i.e., how events occur and in what order. The adjective "deep" comes from the fact that the distribution is parameterized using deep neural networks. There are two distinct traits of deep generative modeling. First, the application of deep neural networks allows rich and flexible parameterization of distributions. Second, the principled manner of modeling stochastic dependencies using probability theory ensures rigorous formulation and prevents potential flaws in reasoning. Moreover, probability theory provides a unified framework where the likelihood function plays a crucial role in quantifying uncertainty and defining objective functions.

Deep Generative Modeling is designed to appeal to curious students, engineers, and researchers with a modest mathematical background in undergraduate calculus, linear algebra, probability theory, and the basics in machine learning, deep learning, and programming in Python and PyTorch (or other deep learning libraries). It will appeal to students and researchers from a variety of backgrounds, including computer science, engineering, data science, physics, and bioinformatics, who wish to become familiar with deep generative modeling. To engage the reader, the book introduces fundamental concepts with specific examples and code snippets. The full code accompanying the book is available on github.

The ultimate aim of the book is to outline the most important techniques in deep generative modeling and, eventually, enable readers to formulate new models and implement them.

• Artificial Intelligence
• Deep Learning
• Autoregressive models
• Generative Adversarial Networks
• Probabilistic modeling
• Latent Variable Models

• Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

  Jakub M. Tomczak

Jakub Tomczak is an assistant professor of Artificial Intelligence in the Computational Intelligence group at Vrije Universiteit Amsterdam since November 2019. Before, from October 2018 to October 2019, he was a deep learning researcher (Staff Engineer) in Qualcomm AI Research in Amsterdam. From October 2016 to September 2018, he was a Marie Sklodowska-Curie Individual Fellow in Prof. Max Welling’s group at the University of Amsterdam. He obtained his Ph.D. in machine learning from the Wroclaw University of Technology. His research interests include probabilistic modeling, deep learning, approximate Bayesian modeling, and deep generative modeling (with special focus on Variational Auto-Encoders and Flow-based model).