Optical Review

, Volume 24, Issue 3, pp 383–397 | Cite as

Fast aircraft detection using cascaded discriminative model in photoelectric sensing system

  • Jiandan Zhong
  • Tao Lei
  • Guangle Yao
  • Zili Tang
  • Yinhui Liu
Regular Paper
  • 89 Downloads

Abstract

Aircraft detection is a fundamental problem in computer vision. As a vision-based system, the photoelectric sensing system (in airport) needs to capture the aircrafts quickly and accurately by the optical camera. Although many existing detection models reach to favorable accuracy, they are time consuming in training and testing, which is not suitable for this system. In practice, as a core part of vision-based system, detection module always occupies a lot of time in image processing and target matching. To reduce the (detection) time cost without losing detection accuracy, we designed a cascade discriminative model which includes two stages: coarse pre-detection stage and fine detection stage. In the traditional object detection models, generally, an object feature template was employed to search for all positions and levels in image pyramid with sliding window fashion. However, in our detection model, only a small number of candidate regions were pre-detected to reduce the searching space at the first stage. At the second stage, an assembled method (which includes partitioned bag-of-words method and random forest) was adopted for accelerating the feature quantization and formation. Then, the possible regions including object were decided by a non-linear SVM classifier. We evaluated our model on two benchmark databases (Caltech 101 and PASCAL 2007) and our own database (images were obtained from the optical camera), and it yields high performance. Compared with other state-of-the-art methods, our model outperforms them not only in detection speed, but also in detection accuracy.

Keywords

Aircraft detection Objectness Bag-of-words Random forest 

Notes

Acknowledgements

This work was supported by Youth Innovation Promotion Association, CAS (Grant No. 2016336). The authors would appreciate the anonymous reviewers for their valuable comments and suggestions for improving this paper.

References

  1. 1.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 886–893. San Diego (2005)Google Scholar
  2. 2.
    Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)CrossRefGoogle Scholar
  3. 3.
    Ren, X., Ramanan, D.: Histograms of sparse codes for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3246–3253 (2013)Google Scholar
  4. 4.
    Malisiewicz, T., Gupta, A., Efros, A.A.: Ensemble of exemplar-SVMs for object detection and beyond. In: Proceedings of the International Conference on Computer Vision, pp. 89–96 (2011)Google Scholar
  5. 5.
    Chum, O., Zisserman, A.: An exemplar model for learning object classes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar
  6. 6.
    Enzweiler, M., Gavrila, D.: Monocular pedestrian detection: survey and experiments. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 2179–2195 (2009)CrossRefGoogle Scholar
  7. 7.
    Torralba, A., Murphy, K.P., Freeman, W.T.: Sharing visual features for multiclass and multiview object detection. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 854–869 (2007)CrossRefGoogle Scholar
  8. 8.
    Wu, Q., Sun, H., Sun, X., Zhang, D., Fu, K., Wang, H.: Aircraft recognition in high-resolution optical satellite remote sensing images. IEEE Geosci. Remote Sens. Lett. 12(1), 112–116 (2015)ADSCrossRefGoogle Scholar
  9. 9.
    Gu, Q., Yang, J., Zhai, Y., Kong, L.: Vision-based multi-scaled vehicle detection and distance relevant mix tracking for driver assistance system. Opt. Rev. 22(2), 197–209 (2015)CrossRefGoogle Scholar
  10. 10.
    Pan, H., Song, G., Xie, L., Zhao, Y.: Detection method for small and dim targets from a time series of images observed by a space-based optical detection system. Opt. Rev. 21(3), 292–297 (2014)CrossRefGoogle Scholar
  11. 11.
    Zhao, Y., Pan, H., Du, C., Zheng, Y.: Principal direction-based Hough transform for line detection. Opt. Rev. 22(2), 224–2317 (2015)CrossRefGoogle Scholar
  12. 12.
    Gu, Q., Yang, J., Kong, L., Cui, G.: Multi-scaled license plate detection based on the label-moveable maximal MSER clique. Opt. Rev. 22(4), 669–678 (2015)CrossRefGoogle Scholar
  13. 13.
    Cheng, M., Zhang, Z., Lin, W., Torr, P.: BING: binarized normed gradients for objectness estimation at 300 fps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3286–3293 (2014)Google Scholar
  14. 14.
    Alexe, B., Deselaers, T., Ferrari, V.: Measuring the objectness of image windows. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2189–2202 (2012)CrossRefGoogle Scholar
  15. 15.
    Alexe, B., Deselaers, T., Ferrari, V.: What is an object? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 73–80 (2010)Google Scholar
  16. 16.
    Endres, I., Hoiem, D.: Category independent object proposals. In: Proceedings of the European Conference on Computer Vision, pp. 575–588 (2010)Google Scholar
  17. 17.
    Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Proceedings of the European Conference on Computer Vision, pp. 1–22 (2004)Google Scholar
  18. 18.
    Sivic, J., Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1470–1477 (2003)Google Scholar
  19. 19.
    Wolfe, J.M., Horowitz, T.S.: What attributes guide the deployment of visual attention and how do they do it? Nat. Rev. Neurosci. 5(6), 495–501 (2004)CrossRefGoogle Scholar
  20. 20.
    Desimone, R., Duncan, J.: Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18(18), 193–222 (1995)CrossRefGoogle Scholar
  21. 21.
    Uijlings, J., Van de Sande, K., Gevers, T., Smeulders, A.: Selective search for object recognition. Int. J. Comput. Vis. 104(2), 154–171 (2013)CrossRefGoogle Scholar
  22. 22.
    Siva, P., Russell, C., Xiang, T.: In defence of negative mining for annotating weakly labelled data. Microelectron. J. 7574(1), 594–608 (2012)Google Scholar
  23. 23.
    Siva, P., Xiang, T.: Weakly supervised object detector learning with model drift detection. In: Proceedings of the International Conference on Computer Vision, pp. 343–350 (2011)Google Scholar
  24. 24.
    Wang, C., Ren, W., Huang, K., Tan, T.: Weakly supervised object localization with latent category learning. In: Proceedings of the 13th European Conference on Computer Vision, pp. 431–445 (2014)Google Scholar
  25. 25.
    Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)Google Scholar
  26. 26.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(60), 91–110 (2004)CrossRefGoogle Scholar
  27. 27.
    Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATHGoogle Scholar
  28. 28.
    Li, F., Perona, P.: A Bayesian hierarchical model for learning natural scene categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 524–531 (2005)Google Scholar
  29. 29.
    Jurie, F., Triggs, B.: Creating efficient codebooks for visual recognition. In: Proceedings of the 10th IEEE International Conference on Computer Vision, pp. 604–610 (2005)Google Scholar
  30. 30.
    Grabner, M., Grabner, H., Bischof, H.: Fast approximated SIFT. In: Proceedings of the 7th Asian Conference on Computer Vision, pp. 918–927 (2006)Google Scholar
  31. 31.
    Zhang, J., Marszałek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vis. 73(2), 213–238 (2007)CrossRefGoogle Scholar
  32. 32.
    Van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: A comparison of color features for visual concept classification. In: Proceedings of the ACM International Conference on Image and Video Retrieval, pp. 141–150 (2008)Google Scholar
  33. 33.
    Shotton, J., Johnson, M., Cipolla, R.: Semantic texton forests for image categorization and segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 211–227 (2008)Google Scholar
  34. 34.
    Moosmann, F., Triggs, B., Jurie, F.: Fast discriminative visual codebooks using randomized clustering forests. In: Proceedings of the 20th Annual Conference on Neural Information Processing Systems, pp. 985–992 (2006)Google Scholar
  35. 35.
    Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2161–2168 (2006)Google Scholar
  36. 36.
    Maji, S., Berg, A., Malik, J.: Classification using intersection kernel support vector machines is efficient. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)Google Scholar
  37. 37.
    Li, X., Chen, X., Yan, Y., Wei, W., Wang, Z.: Classification of EEG signals using a multiple kernel learning support vector machine. Sensors 14(7), 12784–12802 (2014)CrossRefGoogle Scholar
  38. 38.
    Keerthi, S., Lin, C.: Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Comput. 15(7), 1667–1689 (2003)CrossRefMATHGoogle Scholar
  39. 39.
    Zhang, Z., Warrell, J., Torr, P.H.: Proposal generation for object detection using cascaded ranking SVMS. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1497–1504 (2011)Google Scholar
  40. 40.
    Zhu, Q., Liu, C., Cai, C.: A novel robot visual homing method based on sift features. Sensors 15(10), 26063–26084 (2015)CrossRefGoogle Scholar
  41. 41.
    Rituerto, A., Andreasson, H., Murillo, A.C., Lilienthal, A., Guerrero, J.J.: Building an enhanced vocabulary of the robot environment with a ceiling pointing camera. Sensors 16(4), 493–511 (2016)CrossRefGoogle Scholar
  42. 42.
    Weinberger, K., Saul, L.: Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10(1), 207–244 (2006)MATHGoogle Scholar
  43. 43.
    Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Mach. Learn. 63(1), 3–42 (2006)CrossRefMATHGoogle Scholar
  44. 44.
    Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27(4), 379–423 (1948)MathSciNetCrossRefMATHGoogle Scholar
  45. 45.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2169–2178 (2006)Google Scholar
  46. 46.
    Chang, C., Lin, C.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 389–396 (2011)CrossRefGoogle Scholar
  47. 47.
    Li, F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 178–189 (2004)Google Scholar
  48. 48.
    The PASCAL Visual Object Classes Challenge 2007 (VOC2007). http://host.robots.ox.ac.uk/pascal/VOC/index.html (2007). Accessed 18 May 2016
  49. 49.
    Everingham, M., Gool, L.V., Williams, C., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 88(2), 303–338 (2010)CrossRefGoogle Scholar

Copyright information

© The Optical Society of Japan 2017

Authors and Affiliations

  • Jiandan Zhong
    • 1
    • 2
    • 3
  • Tao Lei
    • 1
  • Guangle Yao
    • 1
    • 2
    • 3
  • Zili Tang
    • 4
  • Yinhui Liu
    • 1
    • 2
    • 3
  1. 1.Institute of Optics and ElectronicsChinese Academy of SciencesChengduChina
  2. 2.University of Electronic Science and Technology of ChinaChengduChina
  3. 3.University of Chinese Academy of SciencesBeijingChina
  4. 4.China Huayin Ordnance Test CenterHuayinChina

Personalised recommendations