Advertisement

Double Channel 3D Convolutional Neural Network for Exam Scene Classification of Invigilation Videos

  • Wu SongEmail author
  • Xinguo Yu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11854)

Abstract

This paper presents a double channel 3D convolution neural network to classify the exam scenes of invigilation videos. The first channel is based on the C3D convolution neural network, which is the status-of-arts method of the video scene classification. The structure of this channel is redesigned for classifying the exam-room scenes of invigilation videos. Another channel is based on the two-stream convolution neural network using the optical flow graph sequence as its input. This channel uses the data from the optical flow of video to improve the performance of the video scene classification. The formed double channel 3D convolution neural network has appropriate size of convolution kernel and pooling kernel design. Experiments show that the proposed neural network can classify the exam-room scenes of invigilation videos faster and more accurately than the existing methods.

Keywords

Exam invigilation video Video scene classification Convolutional neural network 

References

  1. 1.
    Adil, M., Simon, R., Khatri, S.K.: Automated invigilation system for detection of suspicious activities during examination. In: IEEE Amity International Conference on Artificial Intelligence (AICAI) (2019)Google Scholar
  2. 2.
    Cote, M., Jean, F., Albu, A.B., Capson, D.W.: Video summarization for remote invigilation of online exams. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–9 (2016)Google Scholar
  3. 3.
    Andrej, K., George, T., Sanketh, S., et al.: Large-scale video classification with convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1725–1732 (2014)Google Scholar
  4. 4.
    Park, E., Han, X., Berg, T.L., et al.: Combining multiple sources of knowledge in deep CNNS for action recognition. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–8 (2016)Google Scholar
  5. 5.
    Wang, L., Qiao, Y., Tang, X.: Action recognition with trajectory-pooled deep-convolutional descriptors. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4305–4314 (2015)Google Scholar
  6. 6.
    Wang, H., Kläser, A., Schmid, C., et al.: Action recognition by dense trajectories. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3169–3176 (2011)Google Scholar
  7. 7.
    Shao, J., Chen, C.L., Kang, K., et al.: Slicing convolutional neural network for crowd video understanding. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5620–5628 (2016)Google Scholar
  8. 8.
    Shao, J, Loy C.C., Wang, X.: Scene-independent group profiling in crowd. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2227–2234 (2014)Google Scholar
  9. 9.
    Zhang, J., Zheng, Y., Qi, D.: Deep spatio-temporal residual networks for citywide crowd flows prediction. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 1655–1661 (2016)Google Scholar
  10. 10.
    Simonyan, K., Zisserman, A.: Two-stream convolutional networks for action recognition in videos. In: Advances in Neural Information Processing Systems, Montreal, Canada, pp. 568–576 (2014)Google Scholar
  11. 11.
    Feichtenhofer, C., Pinz, A., Zisserman, A.: Convolutional two-stream network fusion for video action recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1933–1941 (2016)Google Scholar
  12. 12.
    Zhu, Y., Lan, Z., Newsam, S., et al.: Hidden two-stream convolutional networks for action recognition. arXiv preprint arXiv:1704.00389 (2017)
  13. 13.
    Wang, H, Wang, L.: Modeling temporal dynamics and spatial configurations of actions using two-stream recurrent neural networks. In: CVPR, pp. 499–508 (2017)Google Scholar
  14. 14.
    Ji, S., Xu, W., Yang, M., et al.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)CrossRefGoogle Scholar
  15. 15.
    Tran, D., Bourdev, L., Fergus, R., et al.: Learning spatiotemporal features with 3D convolutional networks. In: IEEE International Conference on Computer Vision, pp. 4489–4497 (2015)Google Scholar
  16. 16.
    Qiu, Z., Yao, T., Mei, T.: Learning spatio-temporal representation with pseudo-3D residual networks. In: IEEE International Conference on Computer Vision (ICCV), pp. 5534–5542 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.National Engineering Research Center for E-Learning, Central China Normal UniversityWuhanChina

Personalised recommendations