Dangerous Objects Detection of X-Ray Images Using Convolution Neural Network

  • Lekang ZouEmail author
  • Tanaka Yusuke
  • Iba Hitoshi
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 895)


Object detection is a popular research direction in the field of traditional visual research. It has a wide range of applications in our real life. Because the deep learning model training for object detection requires a large amount of training data, the research on object detection until now is mostly based on natural images datasets. While natural image object recognition techniques are already very mature, the research on X-ray images is still in its infancy. This paper applies X-ray image dataset for object detection experiments and in particular aims to build an X-ray security system which can be widely used in airports, subway stations and high security conference venues. Our experiments mainly focus on three kinds of dangerous objects: scissor, knife and bottle. The results show that we achieve mean average precision of 86.41% and recall rate of 87.70%.


Dangerous object detection X-ray image Security system 



We thank Yokoshima Shin and Nikaido Yoji in T & S Co., Ltd., for providing us with portable X-ray device information and data collection environments.


  1. 1.
    Akcay, S., Kundegorski, M., Willcocks, C., Breckon, T.: Using deep convolutional neural network architectures for object classification and detection within X-ray baggage security imagery. IEEE Trans. Inf. Forensics Secur. 13, 2203–2215 (2018)CrossRefGoogle Scholar
  2. 2.
    Turcsany, D, Mouton, A., Breckon, T.P.: Improving feature-based object recognition for X-ray baggage security screening using primed visualwords. In: 2013 IEEE International Conference on Industrial Technology (ICIT), pp. 1140–1145. IEEE (2013)Google Scholar
  3. 3.
    Singh, S., Singh, M.: Explosives detection systems (EDS) for aviation security. Signal Process. 83, 31–55 (2003)CrossRefGoogle Scholar
  4. 4.
    Chen, Z., Zheng, Y., Abidi, B.R., Page, D.L., Abidi, M.A.: A combinational approach to the fusion, de-noising and enhancement of dual-energy X-ray luggage images. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, 2005. CVPR Workshops, p. 2. IEEE (2005)Google Scholar
  5. 5.
    He, X.P., Han, P., Lu, X.G., Wu, R.B.: A new enhancement technique of x-ray carry-on luggage images based on dwt and fuzzy theory. In: International Conference on Computer Science and Information Technology, 2008, ICCSIT 2008, pp. 855–858. IEEE (2008)Google Scholar
  6. 6.
    Baştan M., Yousefi M.R., Breuel T.M.: Visual words on baggage X-ray images. In: Real, P., Diaz-Pernil, D., Molina-Abril, H., Berciano, A., Kropatsch, W. (eds.) Computer Analysis of Images and Patterns. CAIP. Lecture Notes in Computer Science, vol 6854. Springer, Berlin (2011)Google Scholar
  7. 7.
    Jaccard, N., Rogers, T.W., Griffin, L.D.: Automated detection of cars in transmission X-ray images of freight containers. In: 2014 International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 387—392. IEEE (2014)Google Scholar
  8. 8.
    Rogers, T.W., Jaccard, N., Protonotarios, E.D., Ollier, J., Morton, E.J., Griffin, L.D.: Threat image projection (TIP) into X-ray images of cargo containers for training humans and machines. In: 2016 IEEE International Carnahan Conference on Security Technology (ICCST), pp. 1–7. IEEE (2016)Google Scholar
  9. 9.
    Baştan, M.: Multi-view object detection in dual-energy X-ray images. Mach. Vis. Appl. 26, 1045–1060 (2015)CrossRefGoogle Scholar
  10. 10.
    Kundegorski, M.E., Akçay, S., Devereux, M., Mouton, A., Breckon, T.P.: On using feature descriptors as visual words for object detection within X-ray baggage security screening (2016)Google Scholar
  11. 11.
    Akçay, S., Kundegorski, M.E., Devereux, M., Breckon, T.P.: Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery. IEEE (2016)Google Scholar
  12. 12.
    Riffo, V., Mery, D.: Automated detection of threat objects using adapted implicit shape model. IEEE Trans. Syst. Man Cybern. Syst. 46, 472–482 (2016)CrossRefGoogle Scholar
  13. 13.
    Van de Sande, K.E., Uijlings, J.R., Gevers, T., Smeulders, A.W.: Segmentation as selective search for object recognition. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1879–1886. IEEE (2011)Google Scholar
  14. 14.
    Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)Google Scholar
  15. 15.
    He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37, 1904–1916 (2015)CrossRefGoogle Scholar
  16. 16.
    Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)Google Scholar
  17. 17.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137–1149 (2017)CrossRefGoogle Scholar
  18. 18.
    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)Google Scholar
  19. 19.
    Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. arXiv preprint (2017)Google Scholar
  20. 20.
    Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., Berg, A.C.: SSD: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer, Cham (2016)Google Scholar
  21. 21.
    Fu, C.Y., Liu, W., Ranga, A., Tyagi, A., Berg, A.C.: DSSD: deconvolutional single shot detector. arXiv preprint arXiv:1701.06659 (2017)
  22. 22.
    Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)
  23. 23.
    Jaccard, N., Rogers, T.W., Morton, E.J., Griffin, L.D.: Tackling the X-ray cargo inspection challenge using machine learning. In: Anomaly Detection and Imaging with X-Rays (ADIX), vol. 9847, p. 98470N. International Society for Optics and Photonics (2016)Google Scholar
  24. 24.
    Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks?. In: Advances in Neural Information Processing Systems, pp. 3320–3328 (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Information & Communication EngineeringThe University of TokyoTokyoJapan

Personalised recommendations