Advanced CNNs and Transfer Learning

Abstract

In this chapter, we look at more advanced techniques typically used when developing CNNs. In particular, we will look at a very successful new convolutional network called the inception network that is based on the idea of several convolutional operations done in parallel instead of sequentially. We will then look at how to use the multiple cost function, in a similar fashion as what is done in multi-task learning. The next sections will show you how to use the pre-trained network that Keras makes available, and how to use transfer learning to tune those pre-trained networks for your specific problem. At the end of the chapter, we will look at a technique to implement transfer learning that is very efficient when dealing with big datasets.