Skip to main content
SpringerLink
Log in
Book cover

International Conference on Aerospace System Science and Engineering

ICASSE 2018: Proceedings of International Conference on Aerospace System Science and Engineering 2018 pp 53–68Cite as

A Survey on Object Tracking in Aerial Surveillance

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 549))

Abstract

Nowadays the Unmanned Aerial Vehicle (UAV) has been widely used due to its low-cost and unique flexibility. Specifically, the high-altitude operational capability makes it the ideal tool in military and civilian surveillance system, in which object tracking based on computer vision is the core ingredient. In this paper, we presented a survey on object tracking methods in aerial surveillance. After briefly reviewing the development history and current research institutions, we summarized frequently used sensors in aerial platform. Then we focused on UAV-based tracking methods by providing detailed descriptions of its common framework (ego motion compensation, object detection, object tracking) and representative tracking algorithms. Through discussing the requirement of a good tracking system and deficiency of current technologies, future directions for aerial surveillance were proposed.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Chikwanha, A., Motepe, S., & Stopforth, R. (2012, November). Survey and requirements for search and rescue ground and air vehicles for mining applications. In Proceeding of the 19th Conference on Mechatronics and Machine Vision in Practice (pp. 105–109).

    Google Scholar 

  2. Bian, J., Hui, X., Yu, Y., Zhao, X., & Tan, M. (2017, December). A robust vanishing point detection method for UAV autonomous power line inspection. In Proceeding of the Conference on Robotics and Biomimetics on IEEE (pp. 646–651).

    Google Scholar 

  3. Ke, R., Li, Z., Tang, J., Pan, Z., & Wang, Y. (2018). Real-time traffic flow parameter estimation from UAV video based on ensemble classifier and optical flow. In IEEE Transaction on Intelligent Transportation Systems.

    Google Scholar 

  4. Carroll, E. A., & Rathbone, D. B. (2002, January). Using an unmanned airborne data acquisition system (ADAS) for traffic surveillance, monitoring and management. In Proceedings of the Conference on ASME 2002 International Mechanical Engineering Congress and Exposition (pp. 145–157).

    Google Scholar 

  5. Clapper, J. R., Young, J. J., Cartwright, J. E., & Grimes, J. G. (2009). Office of the secretary of defense unmanned systems roadmap (2009–2034). United States Department of Defense, Tech. Rep.

    Google Scholar 

  6. Mercado, D., Colunga, G. R. F., Castillo, P., Escareño, J. A., & Lozano, R. (2013, May). Gps/ins/optic flow data fusion for position and velocity estimation. In Proceeding of the Conference of Unmanned Aircraft Systems on IEEE (pp. 486–491).

    Google Scholar 

  7. Yang, S., Scherer, S. A., Schauwecker, K., & Zell, A. (2013, May). Onboard monocular vision for landing of an MAV on a landing site specified by a single reference image. In Proceeding of the Conference on Unmanned Aircraft Systems on IEEE (pp. 318–325).

    Google Scholar 

  8. Wu, Y., Lim, J., & Yang, M. H. (2013). Online object tracking: A benchmark. In Proceeding of the Conference on CVPR (pp. 2411–2418).

    Google Scholar 

  9. Taylor, J. W. R., & Munson, K. (1977). Jane’s pocket book of remotely piloted vehicles: Robot aircraft today. Collier Books.

    Google Scholar 

  10. Huang, M., Zhang, B., & Ding, Y. L. (2018). Development of airborne photoelectric platform at abroad. Aeronautical Manufacturing Technology, 9, 70–71.

    Google Scholar 

  11. http://www.borderlandnews.com/stories/borderland/20040319–95173.shtml.

  12. http://iris.usc.edu/people/medioni/current_research.html.

  13. Reilly, V., Idrees, H., & Shah, M. (2010, September). Detection and tracking of large number of targets in wide area surveillance. In Proceeding of the Conference on ECCV (pp. 186–199).

    Google Scholar 

  14. Prokaj, J., Zhao, X., & Medioni, G. (2012, June). Tracking many vehicles in wide area aerial surveillance. In Proceeding of the Conference on CVPR Workshops (pp. 37–43).

    Google Scholar 

  15. Prokaj, J., & Medioni, G. (2011, June). Using 3d scene structure to improve tracking. In Proceeding of the Conference on CVPR (pp. 1337–1344).

    Google Scholar 

  16. Prokaj, J., Duchaineau, M., & Medioni, G. (2011, June). Inferring tracklets for multi-object tracking. In Proceeding of the Conference on Computer Vision and Pattern Recognition Workshops (pp. 37–44).

    Google Scholar 

  17. http://theairlab.org/.

  18. https://uavvision.com/about/.

  19. https://www.youtube.com/watch?v=pgYDoU8BiiE.

  20. https://www.dji.com/cn.

  21. http://thedronegirl.com/2017/02/26/dji-yuneec-autel-mota/.

  22. http://www.automatedvehiclessymposium.org/avs2018/proceedings.

  23. http://www.uasconferences.com/.

  24. Yuan, C., Medioni, G., Kang, J., & Coehn, I. (2011, December). Detection and tracking of moving objects from a moving platform in presence of strong parallax. U.S. Patent 8,073,196.

    Google Scholar 

  25. Barnea, D. I., & Silverman, H. F. (1972). A class of algorithms for fast digital image registration. IEEE Transaction on Computers, 100(2), 179–186.

    Article  Google Scholar 

  26. Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    Article  Google Scholar 

  27. Fan, X., Rhody, H., & Saber, E. (2005, December). Automatic registration of multisensor airborne imagery. In Proceedings of the 34th Conference on Applied Imagery and Pattern Recognition Workshop (p. 6).

    Google Scholar 

  28. Bouchahma, M., Barhoumi, W., Yan, W., & Al Wardi, H. (2017, October). Optical-flow-based approach for the detection of shoreline changes using remote sensing data. In Proceeding of the 14th Conference on Computer Systems and Applications (pp. 184–189).

    Google Scholar 

  29. Srivastav, N., Agrwal, S. L., Gupta, S. K., Srivastava, S. R., Chacko, B., & Sharma, H. (2017, January). Hybrid object detection using improved three frame differencing and background subtraction. In Proceedings of the 7th Conference on Cloud Computing, Data Science and Engineering-Confluence (pp. 613–617).

    Google Scholar 

  30. Ahmed, A. H., Kpalma, K., & Guedi, A. O. (2017, December). Human detection using HOG-SVM, mixture of Gaussian and background contours subtraction. In Proceedings of 13th the Conference on Signal-Image Technology and Internet-Based Systems (pp. 334–338).

    Google Scholar 

  31. Chao, H., Gu, Y., & Napolitano, M. (2013, May). A survey of optical flow techniques for uav navigation applications. In Proceeding of the Conference on Unmanned Aircraft Systems (pp. 710–716).

    Google Scholar 

  32. Cohen, I., & Medioni, G. (1998, November). Detecting and tracking moving objects in video from an airborne observer. In Proceeding of the Conference on IEEE Image Understanding Workshop (Vol. 1, pp. 217–222).

    Google Scholar 

  33. Cheng, Y. (1995). Mean shift, mode seeking and clustering. IEEE Transaction on Pattern Analysis and Machine Intelligence, 17(8), 790–799.

    Google Scholar 

  34. Kalal, Z., Matas, J., & Mikolajczyk, K. (2010, June). PN learning: Bootstrapping binary classifiers by structural constraints. In Proceeding of the Conference on CVPR (pp. 49–56).

    Google Scholar 

  35. Yilmaz, A., Javed, O., & Shah, M. (2006). Object tracking: A survey. ACM Computing Surveys (CSUR), 38(4), 13.

    Article  Google Scholar 

  36. Keck, M., Galup, L., Stauffer, C. (2013, January). Real-time tracking of low-resolution vehicles for wide-area persistent surveillance. In Proceeding of the Conference on Applications of Computer Vision (pp. 441–448).

    Google Scholar 

  37. Gong, S., & Xiang, T. (2003, October). Recognition of group activities using dynamic probabilistic networks. In Proceeding of the Conference on Computer Vision (pp. 742–749).

    Google Scholar 

  38. Pavlovic, V., Frey, B. J., & Huang, T. S. (1999). Time-series classification using mixed-state dynamic Bayesian networks. In Proceeding of the Conference on CVPR (Vol. 2, pp. 609–615).

    Google Scholar 

  39. Medioni, G., & Nevatia, R. (1997). Surveillance and monitoring using video images from a UAV. In Proceeding of the Conference on IUW.

    Google Scholar 

  40. Cohen, I., & Medioni, G. (1998). Detection and tracking of objects in airborne video imagery. In Proceeding of the Conference on CVPR Workshop on Interpretation of Visual Motion.

    Google Scholar 

  41. Chen, B. J., & Medioni, G. (2017, March). Exploring local context for multi-target tracking in wide area aerial surveillance. In Proceeding of the Conference on Applications of Computer Vision (pp. 787–796).

    Google Scholar 

  42. Ali, S., & Shah, M. (2006, May). COCOA: Tracking in aerial imagery. In Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III (Vol. 6209, p. 62090D).

    Google Scholar 

  43. Ali, S., Reilly, V., & Shah. (2007, June). Motion and appearance contexts for tracking and re-acquiring targets in aerial videos. In Proceeding of the Conference on CVPR (pp. 1–6).

    Google Scholar 

  44. Perera, A. A., Srinivas, C., Hoogs, A., Brooksby, G., & Hu, W. (2006, June). Multi-object tracking through simultaneous long occlusions and split-merge conditions. In Proceeding of the Conference on CVPR (Vol. 1, pp. 666–673).

    Google Scholar 

  45. Xiao, J., Cheng, H., Sawhney, H., & Han, F. (2010). Vehicle detection and tracking in wide field-of-view aerial video. In Proceeding of the Conference on CVPR (pp. 679–684).

    Google Scholar 

  46. Yu, Q., & Medioni, G. (2009, June). Motion pattern interpretation and detection for tracking moving vehicles in airborne video. In Proceeding of the Conference on CVPR (pp. 2671–2678).

    Google Scholar 

  47. Fang, P., Lu, J., Tian, Y., & Miao, Z. (2011). An improved object tracking method in UAV videos. Procedia Engineering, 15, 634–638.

    Article  Google Scholar 

  48. Collins, R., Zhou, X., & Teh, S. K. (2005). An open source tracking testbed and evaluation web site. IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, 2, 35.

    Google Scholar 

  49. Mueller, M., Smith, N., & Ghanem, B. (2016, October). A benchmark and simulator for uav tracking. In Proceeding of the Conference on ECCV (pp. 445–461).

    Google Scholar 

  50. https://www.sdms.afrl.af.mil.

  51. Jha, M. N., Levy, J., & Gao, Y. (2008). Advances in remote sensing for oil spill disaster management: state-of-the-art sensors technology for oil spill surveillance. Sensors, 8(1), 236–255.

    Article  Google Scholar 

  52. http://i21www.ira.uka.de/image_sequences/.

  53. https://www.sdms.afrl.af.mil/index.php?collection=clif2006.

  54. http://crcv.ucf.edu/data/UCF_Aerial_Action.php.

  55. Shu, T., Xie, D., Rothrock, B., Todorovic, S., & Chun Zhu, S. (2015). Joint inference of groups, events and human roles in aerial videos. In Proceedings of the Conference on CVPR (pp. 4576–4584).

    Google Scholar 

  56. Wang, F. Y., Zhang, J. J., Zheng, X., Wang, X., Yuan, Y., Dai, X., … Yang, L. (2016). Where does AlphaGo go: From church-turing thesis to AlphaGo thesis and beyond. IEEE/CAA Journal of Automatica Sinica, 3(2), 113–120.

    Google Scholar 

Download references

Acknowledgements

This paper is sponsored by National Program on Key Basic Research Project (2014CB744903), National Natural Science Foundation of China (61673270), Shanghai Pujiang Program (16PJD028), Shanghai Industrial Strengthening Project (GYQJ-2017-5-08), Shanghai Science and Technology Committee Research Project (17DZ1204304) and Shanghai Engineering Research Center of Civil Aircraft Flight Testing.

Author information

Authors and Affiliations

  1. School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai, China

    Junhao Zhao, Gang Xiao, Xingchen Zhang & Durga Prasad Bavirisetti

Authors
  1. Junhao Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gang Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xingchen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Durga Prasad Bavirisetti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gang Xiao .

Editor information

Editors and Affiliations

  1. School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai, China

    Zhongliang Jing

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, J., Xiao, G., Zhang, X., Bavirisetti, D.P. (2019). A Survey on Object Tracking in Aerial Surveillance. In: Jing, Z. (eds) Proceedings of International Conference on Aerospace System Science and Engineering 2018. ICASSE 2018. Lecture Notes in Electrical Engineering, vol 549. Springer, Singapore. https://doi.org/10.1007/978-981-13-6061-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-6061-9_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-6060-2

  • Online ISBN: 978-981-13-6061-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation