Advertisement

Data Dependent Adaptive Prediction and Classification of Video Sequences

  • Amrutha MachireddyEmail author
  • Shayan Srinivasa Garani
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10841)

Abstract

Convolutional neural networks (CNN) are popularly used for applications in natural language processing, video analysis and image recognition. However, the max-pooling layer used in CNNs discards most of the data, which is a drawback in applications, such as, prediction of video frames. With this in mind, we propose an adaptive prediction and classification network (APCN) based on a data-dependent pooling architecture. We formulate a combined cost function for minimizing prediction and classification errors. During testing, we identify a new class in an unsupervised fashion. Simulation results over a synthetic data set show that the APCN algorithm is able to learn the spatio-temporal information to predict and classify the video frames, as well as, identify a new class during testing.

Keywords

Data-dependent pooling Adaptive network Prediction and classification network 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

S. S. Garani acknowledges IISc-start up funds for this project.

References

  1. 1.
    Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L.: Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1725–1732 (2014)Google Scholar
  2. 2.
    Ji, S., Xu, W., Yang, M., Yu, K.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)CrossRefGoogle Scholar
  3. 3.
    Ke, Y., Sukthankar, R., Hebert, M.: Efficient visual event detection using volumetric features. In: 10th IEEE International Conference on Computer Vision, pp. 166–173 (2005)Google Scholar
  4. 4.
    Niebles, J.C., Wang, H., Fei-Fei, L.: Unsupervised learning of human action categories using spatial-temporal words. Int. J. Comput. Vision. 79(3), 299–318 (2008)CrossRefGoogle Scholar
  5. 5.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  6. 6.
    Farabet, C., Couprie, C., Najman, L., LeCun, Y.: Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1915–1929 (2013)CrossRefGoogle Scholar
  7. 7.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  8. 8.
    Ranzato, M., Szlam, A., Bruna, J., Mathieu, M., Collobert, R., Chopra, S.: Video (language) modeling: a baseline for generative models of natural videos. arXiv preprint arXiv:1412.6604 (2014)
  9. 9.
    Xingjian, S., Chen, Z., Wang, H., Yeung, D., Wong, W., Woo, W.: Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In: Advances in Neural Information Processing Systems, pp. 802–810 (2015)Google Scholar
  10. 10.
    Lotter, W., Kreiman, G., Cox, D.: Deep predictive coding networks for video prediction and unsupervised learning. arXiv preprint arXiv:1605.08104 (2016)
  11. 11.
  12. 12.

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Electronic Systems EngineeringIndian Institute of ScienceBengaluruIndia

Personalised recommendations

Cite paper

Buy options