Abstract
The recent developments in the field of unmanned aerial vehicles (UAV or drones) technology has generated a lot of interdisciplinary applications, ranging from remote surveillance of energy infrastructure, to agriculture. However, in the context of national security, low-cost drone equipment has also been viewed as an easy means to cause destructive effects against national critical infrastructures and civilian population. Addressing the challenge of real-time detection and continuous tracking, this paper proposed presents a holistic architecture consisting of both software and hardware design. The software-based video analytics component leverages upon the advancement of Region based Fully Convolutional Network model for drone detection. The hardware component includes a low-cost sensing equipment powered by Raspberry Pi for controlling the camera platform for continuously tracking the orientation of the drone by streaming the video footage captured from the long-range surveillance camera. The novelty of the proposed framework is twofold namely the detection of the drone in real-time and continuous tracking of the detected drone through controlling the camera platform. The framework relies on the capability of the long-range camera to lock into the drone and subsequently track the drone through space. The analytics processing component utilises the NVIDIA\(\circledR \) GeForce\(\circledR \) GTX 1080 with 8 GB GDDR5X GPU. The experimental results of the proposed framework have been validated against real-world threat scenarios simulated for the protection of the national critical infrastructure.
X. Zhang—The author is pursuing doctoral dissertation at Multimedia and Vision Research Group, School of Electronic Engineering and Computer Science, Queen Mary Univeristy of London.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cehovin, L., Leonardis, A., Kristan, M.: Visual object tracking performance measures revisited. CoRR abs/1502.05803 (2015). http://arxiv.org/abs/1502.05803
Coluccia, A., et al.: Drone-vs-bird detection challenge at IEEE AVSS2017. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, August 2017. https://doi.org/10.1109/AVSS.2017.8078464
Dai, J., Li, Y., He, K., Sun, J.: R-FCN: object detection via region-based fully convolutional networks. CoRR abs/1605.06409 (2016). http://arxiv.org/abs/1605.06409
Girshick, R.: Fast R-CNN. In: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 11–18 December 2015, pp. 1440–1448 (2015). https://doi.org/10.1109/ICCV.2015.169. IEEE International Conference on Computer Vision, Amazon; Microsoft; Sansatime; Baidu; Intel; Facebook; Adobe; Panasonic; 360; Google; Omron; Blippar; iRobot; Hiscene; nVidia; Mvrec; Viscovery; AiCure
He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 346–361. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10578-9_23
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CoRR abs/1512.03385 (2015). http://arxiv.org/abs/1512.03385
Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. CoRR abs/1404.7584 (2014). http://arxiv.org/abs/1404.7584
Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. CoRR abs/1704.04861 (2017). http://arxiv.org/abs/1704.04861
Liu, W., et al.: SSD: single shot multibox detector. CoRR abs/1512.02325 (2015). http://arxiv.org/abs/1512.02325
Mejias, L., McNamara, S., Lai, J., Ford, J.: Vision-based detection and tracking of aerial targets for UAV collision avoidance. In: IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems (IROS 2010), Taipei, Taiwan, 18–22 October 2010, pp. 87–92 (2010). https://doi.org/10.1109/IROS.2010.5651028
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, 27–30 June 2016, pp. 779–788. IEEE Computer Society; Computer Vision Foundation (2016). https://doi.org/10.1109/CVPR.2016.91
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031
Rozantsev, A., Lepetit, V., Fua, P.: Detecting flying objects using a single moving camera. IEEE Trans. Pattern Anal. Mach. Intell. 39(5), 879–892 (2017). https://doi.org/10.1109/TPAMI.2016.2564408
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015). http://arxiv.org/abs/1512.00567
Wu, Y., Lim, J., Yang, M.: Online object tracking: a benchmark. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013). https://doi.org/10.1109/CVPR.2013.312
Acknowledgement
This work is partially funded by the European Union Horizon 2020 research and innovation program under grant agreement No. 740898 (DEFENDER IP project) and grant agreement No. 787123 (PERSONA RIA project).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, X., Chandramouli, K. (2019). Critical Infrastructure Security Against Drone Attacks Using Visual Analytics. In: Tzovaras, D., Giakoumis, D., Vincze, M., Argyros, A. (eds) Computer Vision Systems. ICVS 2019. Lecture Notes in Computer Science(), vol 11754. Springer, Cham. https://doi.org/10.1007/978-3-030-34995-0_65
Download citation
DOI: https://doi.org/10.1007/978-3-030-34995-0_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34994-3
Online ISBN: 978-3-030-34995-0
eBook Packages: Computer ScienceComputer Science (R0)