Advertisement

Machine Vision and Applications

, Volume 26, Issue 7–8, pp 885–904 | Cite as

Resource aware and incremental mosaics of wide areas from small-scale UAVs

  • Daniel Wischounig-Strucl
  • Bernhard Rinner
Original Paper

Abstract

Small-scale unmanned aerial vehicles (UAVs) are an emerging research area and have been recently demonstrated in many applications including disaster response management, construction site monitoring and wide area surveillance where multiple UAVs impose various benefits. In this work we present a system composed of multiple networked UAVs for autonomously monitoring a wide area scenario. Each UAV is able to follow waypoints and capture high-resolution images. In order to overcome the strong resource limitations we implement an incremental approach for generating an orthographic mosaic from the individual images. Captured images are pre-processed on-board, annotated with other sensor data and transferred by a prioritized transmission scheme. The ultimate goal of our approach is to generate an overview mosaic as fast as possible and to improve its quality over time. The mosaicking exploits position and orientation data of the UAV to compute rough image projections which are incrementally refined by scene structure analysis when more image data is available. We evaluate our incremental mosaicking in the strongly resource limited UAV network composed of up to three concurrently flying UAVs. Our results are compared to state-of-the-art mosaicking methods and show a unique performance in our dedicated application scenarios.

Keywords

Resource-aware Mosaics Orthophoto UAV Drone Network Scheduling 3D reconstruction Bundle adjustment Structure-from-motion  Unmanned aerial vehicle 

Notes

Acknowledgments

This work was performed in the project Collaborative Microdrones (cDrones) of the research cluster Lakeside Labs and was partly funded by the European Regional Development Fund, the Carinthian Economic Promotion Fund (KWF), and the state of Austria under grant KWF-20214/17095/24772.

References

  1. 1.
    Ahmad, A., Samad, A.: Aerial mapping using high resolution digital camera and unmanned aerial vehicle for Geographical Information System. In: Proceedings of the 6th International Colloquium on Signal Processing and Its Applications (CSPA), pp. 1–6 (2010)Google Scholar
  2. 2.
    Akyildiz, I.F., Melodia, T., Chowdhury, K.R.: A survey on wireless multimedia sensor networks. J. Comput. Netw. 51(4), 921–960 (2007)CrossRefGoogle Scholar
  3. 3.
    Anderson, E., Bai, Z., Bischof, C., Blackford, S., Demmel, J., Dongarra, J., Du Croz, J., Greenbaum, A., Hammarling, S., McKenney, A., Sorensen, D.: LAPACK Users’ Guide, 3rd edn. In: Society for Industrial and Applied Mathematics. Philadelphia (1999)Google Scholar
  4. 4.
    Arya, S., Mount, D.M.: Approximate nearest neighbor queries in fixed dimensions. In: Proceedings of the fourth annual ACM-SIAM Symposium on Discrete algorithms, pp. 271–280. Society for Industrial and Applied Mathematics (1993)Google Scholar
  5. 5.
    Blackford, L.S., Petitet, A., Pozo, R., Remington, K., Whaley, R.C., Demmel, J., Dongarra, J., Duff, I., Hammarling, S., Henry, G.: An updated set of basic linear algebra subprograms (BLAS). ACM Trans. Math. Softw. 28(2), 135–151 (2002)CrossRefGoogle Scholar
  6. 6.
    Bradley, A.P., Stentiford, F.W.: JPEG 2000 and region of interest coding. In: Proceedings of Digital Image Computing Techniques and Applications (DICTA2002), pp. 1–6. Melbourne (2002)Google Scholar
  7. 7.
    Burt, P.J., Adelson, E.H.: A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2(4), 217–236 (1983)CrossRefGoogle Scholar
  8. 8.
    Caballero, F., Merino, L., Ferruz, J., Ollero, A.: Unmanned aerial vehicle localization based on monocular vision and online mosaicking. J. Intell. Robotic Syst. 55(4), 323–343 (2009)zbMATHCrossRefGoogle Scholar
  9. 9.
    Cheng, Y., Xue, D., Li, Y.: A fast mosaic approach for remote sensing images. In: Proceedings of the International Conference on Mechatronics and Automation (ICMA), pp. 2009–2013 (2007)Google Scholar
  10. 10.
    Colomina, I., Molina, P.: Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 92, 79–97 (2014)Google Scholar
  11. 11.
    Coopmans, C., Han, Y.: AggieAir: an integrated and effective small multi-UAV command, control and data collection architecture. In: Proceedings of the 5th ASME/IEEE International Conference on Mechatronic and Embedded Systems and Applications (MESA09), pp. 1–7 (2009)Google Scholar
  12. 12.
    Daniel, K., Dusza, B., Lewandowski, A., Wietfeld, C.: AirShield: a system-of-systems MUAV remote sensing architecture for disaster response. In: Proceedings of the 3rd Annual IEEE Systems Conference, pp. 196–200 (2009)Google Scholar
  13. 13.
    Elibol, A., Kim, J., Gracias, N., Garcia, R.: Efficient image mosaicing for multi-robot visual underwater mapping. Pattern Recognit. Lett. 46, 20–26 (2014)CrossRefGoogle Scholar
  14. 14.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Frescura, F., Giorni, M., Feci, C., Cacopardi, S.: JPEG2000 and MJPEG2000 transmission in 802.11 wireless local area networks. IEEE Trans. Consum. Electron. 49(4), 861–871 (2003)CrossRefGoogle Scholar
  16. 16.
    Friedman, J.H., Bentley, J.L., Finkel, R.A.: An algorithm for finding best matches in logarithmic expected time. ACM Trans. Math. Softw. 3(3), 209–226 (1977)zbMATHCrossRefGoogle Scholar
  17. 17.
    Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2010)CrossRefGoogle Scholar
  18. 18.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004). ISBN:0521540518Google Scholar
  19. 19.
    Hui, J.W., Culler, D.E.: IP is dead, long live IP for wireless sensor networks. In: SenSys’08: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems. ACM Request Permissions (2008)Google Scholar
  20. 20.
    Mersheeva, V., Friedrich, G.: Routing for continuous monitoring by multiple micro UAVs in disaster scenarios. In: Proceedings of the European Conference on Artificial Intelligence, pp. 588–593 (2012)Google Scholar
  21. 21.
    Pratt, K.S., Murphy, R., Stover, S., Griffin, C.: CONOPS and autonomy recommendations for VTOL small unmanned aerial system based on Hurricane Katrina operations. J. Field Robotics 26(8), 636–650 (2009)CrossRefGoogle Scholar
  22. 22.
    Quaritsch, M., Kruggl, K., Wischounig-Strucl, D., Bhattacharya, S., Shah, M., Rinner, B.: Networked UAVs as aerial sensor network for disaster management applications. e & i Elektrotechnik und Informationstechnik 127(3), 56–63 (2010)CrossRefGoogle Scholar
  23. 23.
    Roßmann, J., Rast, M.: High-detail local aerial imaging using autonomous drones. In: Proceedings of 12th AGILE International Conference on Geographic Information Science: Advances in GIScience, pp. 1–8. Hannover (2009)Google Scholar
  24. 24.
    Sturm, P.: Multi-view geometry for general camera models. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 (CVPR’05), pp. 206–212 (2005)Google Scholar
  25. 25.
    Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Computer Vision—ECCV’96 1065(Chapter 61), 709–720 (1996)Google Scholar
  26. 26.
    Thite, S.: Smallest enclosing circle of a set of points in the plane. Website. http://www.win.tue.nl/-sthite/mincircle/ (2000) last visited on July 3rd 2013
  27. 27.
    Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment–a modern synthesis. Vis. Algorithms Theory Pract. 1883, 298–372 (2000)CrossRefGoogle Scholar
  28. 28.
    Turkbeyler, E., Harris, C., Evans, R.: Building aerial mosaics for visual MTI. In: Proceedings of the 5th EMRS DTC Technical Conference. Roke Manor Research, Romsey, Hampshire SO51 0ZN, Edinburgh (2008)Google Scholar
  29. 29.
    Wischounig-Strucl, D., Quartisch, M., Rinner, B.: Prioritized data transmission in airborne camera networks for wide area surveillance and image mosaicking. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 17–24 (2011)Google Scholar
  30. 30.
    Yahyanejad, S., Wischounig-Strucl, D., Quaritsch, M., Rinner, B.: Incremental mosaicking of images from autonomous, small-scale UAVs. In: Proceedings of the 7th IEEE International Conference on Advanced Video and Signal-Based Surveillance (2010)Google Scholar
  31. 31.
    Yanmaz, E., Kuschnig, R., Bettstetter, C.: Channel measurements over 802.11a-based UAV-to-ground links. In: Proceedings of the IEEE GLOBECOM Workshops, pp. 1280–1284 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  1. 1.Institute of Networked and Embedded SystemsAlpen-Adria-Universität KlagenfurtKlagenfurtAustria

Personalised recommendations