Automated Deep Learning for Threat Detection in Luggage from X-Ray Images

  • Alessio Petrozziello
  • Ivan JordanovEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11544)


Luggage screening is a very important part of the airport security risk assessment and clearance process. Automating the threat objects detection from x-ray scans of passengers’ luggage can speed-up and increase the efficiency of the whole security procedure. In this paper we investigate and compare several algorithms for detection of firearm parts in x-ray images of travellers’ baggage. In particular, we focus on identifying steel barrel bores as threat objects, being the main part of the weapon needed for deflagration. For this purpose, we use a dataset of 22k double view x-ray scans, containing a mixture of benign and threat objects. In the pre-processing stage we apply standard filtering techniques to remove noisy and ambiguous images (i.e., smoothing, black and white thresholding, edge detection, etc.) and subsequently employ deep learning techniques (Convolutional Neural Networks and Stacked Autoencoders) for the classification task. For comparison purposes we also train and simulate shallow Neural Networks and Random Forests algorithms for the objects detection. Furthermore, we validate our findings on a second dataset of double view x-ray scans of courier parcels. We report and critically discuss the results of the comparison on both datasets, showing the advantages of our approach.


Baggage screening Deep learning Convolutional neural networks Image filtering Object detection algorithms X-ray images 


  1. 1.
    Michel, S., Koller, S.M., de Ruiter, J.C., Moerland, R., Hogervorst, M., Schwaninger, A.: Computer-based training increases efficiency in X-ray image interpretation by aviation security screeners. In: 41st Annual IEEE International Carnahan Conference on Security Technology (2007)Google Scholar
  2. 2.
    Riffo, V., Mery, D.: Active X-ray testing of complex objects. Insight-Non-Destructive Test. Condition Monit. 54(1), 28–35 (2012)CrossRefGoogle Scholar
  3. 3.
    Mery, D., et al.: The database of X-ray images for nondestructive testing. J. Nondestr. Eval. 34(4), 1–12 (2015)CrossRefGoogle Scholar
  4. 4.
    Mery, D., Riffo, V., Zuccar, I., Pieringer, C.: Automated X-ray object recognition using an efficient search algorithm in multiple views. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013)Google Scholar
  5. 5.
    Flitton, G., Mouton, A., Breckon, T.: Object classification in 3D baggage security computed tomography imagery using visual codebooks. Pattern Recogn. 48(8), 2489–2499 (2015)CrossRefGoogle Scholar
  6. 6.
    Jaccard, N., Rogers, T.W., Morton, E.J., Griffin, L.D.: Tackling the X-ray cargo inspection challenge using machine learning. In: Anomaly Detection and Imaging with X-Rays (ADIX) (2016)Google Scholar
  7. 7.
    Rogers, T.W., Jaccard, N., Griffin, L.D.: A deep learning framework for the automated inspection of complex dual-energy x-ray cargo imagery. In: Anomaly Detection and Imaging with X-Rays (ADIX) II (2017)Google Scholar
  8. 8.
    Li, G., Yu, Y.: Contrast-oriented deep neural networks for salient object detection. IEEE Trans. Neural Networks Learn. Syst. 29(1), 6038–6051 (2018)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Shen, Y., Ji, R., Wang, C., Li, X., Li, X.: Weakly supervised object detection via object-specific pixel gradient. IEEE Trans. Neural Networks Learn. Syst. 29(1), 5960–5970 (2018)CrossRefGoogle Scholar
  10. 10.
    Bastan, M., Byeon, W., Breuel, T.M.: Object recognition in multi-view dual energy x-ray images. In: BMVC (2013)Google Scholar
  11. 11.
    Zhang, C., Tan, K.C., Li, H., Hong, G.S.: A cost-sensitive deep belief network for imbalanced classification. IEEE Trans. Neural Networks Learn. Syst. 30(1), 109–122 (2019)CrossRefGoogle Scholar
  12. 12.
    Zhao, Z.-Q., Zheng, P., Xu, S.-T., Wu, X.: Object detection with deep learning: a review. IEEE Trans. Neural Networks Learn. Syst. 1–21 (2019) Google Scholar
  13. 13.
    Kang, Y., Chen, S., Wang, X., Cao, Y.: Deep convolutional identifier for dynamic modeling and adaptive control of unmanned helicopter. IEEE Trans. Neural Networks Learn. Syst. 30(2), 524–538 (2019)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Newell, A.J., Griffin, L.D.: Natural image character recognition using oriented basic image features. In: International Conference on Digital Image Computing Techniques and Applications (2011)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of PortsmouthPortsmouthUK

Personalised recommendations