Application of Ghost Images for Object Detection and Quality Assessment

  • Nan Hu
  • Huimin MaEmail author
  • Xuehui Shao
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 875)


Ghost imaging uses the high-order correlation of the light field and has the physical properties of entanglement, coherence, and nonlocality. With high performance of anti-interference and stability, ghost imaging has important value in theoretical research and practical application. This paper presents the application of ghost data for object detection and quality assessment. Due to the complexity of the real imaging environment, we generated a large number of synthetic images as original materials through a ghost imaging simulation systems. And then we proposed a detection network for ghost data based on convolutional neural network with several fusion strategies. At the same time, a novel non-reference image quality assessment criteria based on detection performance is designed. Experiments on ghost dataset demonstrated that the early fusion network performed better, and the quality evaluation criteria based on this network is simple, reliable, and has usability.


Ghost imaging Object detection Quality assessment 



This work was supported by National Key R&D Plan (No. 2016YFB0100901) and National Natural Science Foundation of China (No. 61171113 and No. 61773231).


  1. 1.
    Abouraddy, A.F., Saleh, B.E.A., Sergienko, A.V., Teich, M.C.: Role of entanglement in two-photon imaging. Phys. Rev. Lett. 87(12), 123602 (2001)CrossRefGoogle Scholar
  2. 2.
    Alejandra, V., Giuliano, S., Milena, D., Yanhua, S.: Two-photon imaging with thermal light. Phys. Rev. Lett. 94(6), 063601 (2005)CrossRefGoogle Scholar
  3. 3.
    Bennink, R.S., Bentley, S.J., Boyd, R.W.: “Two-photon” coincidence imaging with a classical source. Phys. Rev. Lett. 89(11), 113601 (2002)CrossRefGoogle Scholar
  4. 4.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, pp. 886–893 (2005)Google Scholar
  5. 5.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Li, F.F.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 248–255 (2009)Google Scholar
  6. 6.
    Eitel, A., Springenberg, J.T., Spinello, L., Riedmiller, M., Burgard, W.: Multimodal deep learning for robust RGB-D object recognition, pp. 681–687 (2015)Google Scholar
  7. 7.
    Girshick, R.: Fast R-CNN. In: Computer Science (2015)Google Scholar
  8. 8.
    Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation, pp. 580–587 (2013)Google Scholar
  9. 9.
    Gupta, S., Girshick, R., Arbeláez, P., Malik, J.: Learning rich features from RGB-D images for object detection and segmentation. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 345–360. Springer, Cham (2014). Scholar
  10. 10.
    He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, pp. 1026–1034 (2015)Google Scholar
  11. 11.
    Hoffman, J., Gupta, S., Jian, L., Guadarrama, S., Darrell, T.: Cross-modal adaptation for RGB-D detection. In: IEEE International Conference on Robotics and Automation, pp. 5032–5039 (2016)Google Scholar
  12. 12.
    Hou, W., Gao, X., Tao, D., Li, X.: Blind image quality assessment via deep learning. IEEE Trans. Neural Networks Learn. Syst. 26(6), 1275–1286 (2017)MathSciNetGoogle Scholar
  13. 13.
    Jia, Y., et al.: Caffe: Convolutional architecture for fast feature embedding, pp. 675–678 (2014)Google Scholar
  14. 14.
    Kang, L., Ye, P., Li, Y., Doermann, D.: Convolutional neural networks for no-reference image quality assessment. In: Computer Vision and Pattern Recognition, pp. 1733–1740 (2014)Google Scholar
  15. 15.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)Google Scholar
  16. 16.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  17. 17.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)CrossRefGoogle Scholar
  18. 18.
    Shapiro, J.H., Boyd, R.W.: The physics of ghost imaging. Quantum Inf. Process. 11(4), 949–993 (2012)CrossRefGoogle Scholar
  19. 19.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Computer Science (2014)Google Scholar
  20. 20.
    Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: Computer Vision and Pattern Recognition, pp. 1701–1708 (2014)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of Electronic EngineeringTsinghua UniversityBeijingChina
  2. 2.National Key Laboratory of Science and Technology on Aerospace Intelligent ControlBeijingChina

Personalised recommendations