With the tremendous success of deep learning in recent years, the field of data science has undergone unprecedented changes that can be considered a “revolution”. Despite the great successes of deep learning in various areas, there is a tremendous lack of rigorous mathematical foundations which enable us to understand why deep learning methods perform well.