Target Recognition in Infrared Imagery Using Convolutional Neural Network
In this paper, deep learning based approach is advocated for automatic recognition of civilian targets in thermal infrared images. High variability of target signature and low contrast ratio of targets to background makes the task of target recognition in infrared images challenging, demanding robust adaptable methods capable of capturing these variations. As opposed to the traditional shallow learning approaches which rely on hand engineered feature extraction, deep learning based approaches use environmental knowledge to learn and extract the features automatically. We present convolutional neural network (CNN) based deep learning framework for automatic recognition of civilian targets in infrared images. The performance evaluation is carried on infrared target clips obtained from ‘CSIR-CSIO moving object thermal infrared imagery dataset’. The task involves four categories classification one category representing the background and three categories of targets -ambassador, auto and pedestrians. The proposed CNN framework provides classification accuracy of 88.15 % with all four categories and 98.24 % with only three target categories.
KeywordsThermal infrared imaging Deep learning Target recognition Convolutional neural network
The work is supported in part by funds of Council of Scientific and Industrial Research (CSIR), India under the project OMEGA PSC0202-2.3.1.
- 1.J. G. Verly, R. L. Delanoy, and D. E. Dudgeon, “Machine Intelligence Technology for Automatic Target Recognition,” The Lincoln Laboratory Journal, vol. 2, no. 2, pp. 277–310, 1989.Google Scholar
- 2.A. Arora, P. Dutta, S. Bapat, V. Kulathumani, H. Zhang, V. Naik, V. Mittal, H. Cao, M. Demirbas, M. Gouda, Y. Choi, T. Herman, S. Kulkarni, U. Arumugam, M. Nesterenko, A. Vora, and M. Miyashita, “A line in the sand: a wireless sensor network for target detection, classification, and tracking,” Computer Networks, vol. 46, no. 5, pp. 605–634, 2004.Google Scholar
- 4.S. G. Narasimhan and S. K. Nayar, “Shedding light on the weather,” 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003 Proceedings, vol. 1, 2003.Google Scholar
- 6.J. M. Lloyd, Thermal imaging systems. Springer Science & Business Media, 2013.Google Scholar
- 8.Y. Fang, K. Yamada, Y. Ninomiya, B. Horn, and I. Masaki, “Comparison between infrared-image-based and visible-image-based approaches for pedestrian detection,” IEEE IV2003 Intelligent Vehicles Symposium Proceedings (Cat No03TH8683), pp. 505–510, 2003.Google Scholar
- 11.B. Li, W. Hu, W. Xiong, O. Wu, and W. Li, “Horror Image Recognition Based on Emotional Attention,” in Asian Conference on Computer Vision (ACCV), 2011, pp. 594–605.Google Scholar
- 12.S. Z. Li, L. Zhang, S. Liao, X. X. Zhu, R. Chu, M. Ao, and H. Ran, “A Near-infrared Image Based Face Recognition System,” 7th International Conference on Automatic Face and Gesture Recognition (FGR06), pp. 455–460, 2006.Google Scholar
- 13.V. Elangovan and A. Shirkhodaie, “Recognition of human activity characteristics based on state transitions modeling technique,” p. 83920 V–83920 V–10, May 2012.Google Scholar
- 14.B. Li, R. Chellappa, R. Chellappa, Q. Zheng, Q. Zheng, S. Der, S. Der, N. Nasrabadi, N. Nasrabadi, L. Chan, L. Chan, L. Wang, and L. Wang, “Experimental evaluation of FLIR ATR approaches—A comparative study,” Computer Vision and Image Understanding, vol. 84, pp. 5–24, 2001.CrossRefzbMATHGoogle Scholar
- 19.D. Ciresan, “Multi-column Deep Neural Networks for Image Classification,” in Computer Vision and Pattern Recognition, IEEE, 2012, pp. 3642–3649.Google Scholar
- 20.A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” Advances In Neural Information Processing Systems, pp. 1–9, 2012.Google Scholar
- 21.P. Sermanet, S. Chintala, and Y. LeCun, “Convolutional neural networks applied to house numbers digit classification,” Proceedings of International Conference on Pattern Recognition ICPR12, pp. 10–13, 2012.Google Scholar
- 22.Y. LeCun, F. J. Huang, and L. Bottou, “Learning methods for generic object recognition with invariance to pose and lighting,” in Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., 2004, vol. 2, pp. 97–104.Google Scholar
- 24.J. L. Chu and A. Krzy, “Analysis of Feature Maps Selection in Supervised Learning Using Convolutional Neural Networks,” in Advances in Artificial Intelligence, Springer International Publishing, 2014, pp. 59–70.Google Scholar
- 25.S. Karsoliya, “Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture,” International Journal of Engineering Trends and Technology, vol. 3, no. 6, pp. 714–717, 2012.Google Scholar
- 27.S. Ioffe and C. Szegedy, “Batch Normalization : Accelerating Deep Network Training by Reducing Internal Covariate Shift,” arXiv preprint arXiv:150203167v3, 2015.
- 28.H. Yu and B. M. Wilamowski, “Levenberg-Marquardt training,” Industrial Electronics Handbook, vol 5—Intelligent Systems, pp. 12–1 to 12–18, 2011.Google Scholar