A Panoramic Video Face Detection System Design and Implement
- 111 Downloads
A panorama is a wide-angle view picture with high-resolution, usually composed of multiple images, and has a wide range of applications in surveillance and entertainment. This paper presents a end-to-end real-time panoramic face detection video system, which generates panorama video efficiently and effectively with the ability of face detection. We fix the relative position of the camera and use the speeded up robust features (SURF) matching algorithm to calibrate the cameras in the offline stage. In the online stage, we improve the parallel execution speed of image stitching using the latest compute unified device architecture (CUDA) technology. The proposed design fulfils high-quality automatic image stitching algorithm to provide a seamless panoramic image with 6k resolution at 25 fps. We also design a convolutional neural network to build a face detection model suitable for panorama input. The model performs very well especially in small faces and multi-faces, and can maintain the detection speed of 25 fps at high resolution.
KeywordsPanorama Face detection SURF CUDA
The authors thank the editors and the anonymous reviewers for their invaluable comments to help to improve the quality of this paper. This work was supported in part by the National Natural Science Foundation of China under Grant Nos. 61762053, 61831018, 61571329, Guangdong Province Key Research and Development Program Major Science and Technology Projects under Grant 2018B010115002, Key Laboratory of Embedded System and Service Computing (Tongji University), Ministry of Education, Shanghai (ESSCKF 2018-06).
- 2.Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, p. 511 (2001)Google Scholar
- 3.Papageorgiou, C.P., Oren, M., Poggio, T.: A general framework for object detection. In: Sixth International Conference on Computer Vision, pp. 555–562 (1998)Google Scholar
- 5.Shete, P.P., Sarode, D.M., Bose, S.K.: Real-time panorama composition for video surveillance using GPU. In: International Conference on Advances in Computing. IEEE (2016)Google Scholar
- 6.Lee, J., Kim, B., Kim, Y., et al.: Rich360: optimized spherical representation from structured panoramic camera arrays. ACM Trans. Graph. 35–63, 1–11 (2016)Google Scholar
- 7.Silva, R.M.A., Monteiro, D., Monteiro, D., et al.: Real time 360 video stitching and streaming. In: ACM SIGGRAPH, p. 70. ACM (2016)Google Scholar
- 9.Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: International Conference on Neural Information Processing Systems, pp. 1097–1105. Curran Associates Inc. (2012)Google Scholar
- 10.He, K., Zhang, X., Ren, S., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
- 11.Redmon, J., Divvala, S., Girshick, R., et al.: You only look once: unified, real-time object detection. In: Computer Vision and Pattern Recognition, pp. 779–788. IEEE (2016)Google Scholar
- 15.Xiong, X., De La Torre, F.: Supervised descent method and its applications to face alignment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 532–539 (2013)Google Scholar