Robust Underwater Image Stitching Based on Graph Matching

  • Xu Yang
  • Zhi-Yong LiuEmail author
  • Chuan Li
  • Jing-Jing Wang
  • Hong Qiao
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10559)


Image stitching is important in intelligent perception and manipulation of underwater robots. In spite of a well developed technique, it is still challenging for underwater images because of their inevitable appearance ambiguity. For the feature based underwater image stitching, robust feature correspondence is the key because most other algorithmic parts are less directly associated with the characteristics of underwater images. Structural information between feature points may be helpful for robust feature correspondence, and based on this idea the paper proposes a robust underwater image stitching method by incorporating structural cues as additional information, whose effectiveness is validated on real underwater images. Specifically, the appearance information and structural cues are integrated by a labeled weighted graph, and the underwater image correspondence is formulated by graph matching. After geometric transformation estimation, the underwater images are finally blended into a wider viewing image.


Underwater image Image stitching Feature correspondence Graph matching Structural information 



This work is supported partly by the National Natural Science Foundation (NSFC) of China (grants 61503383, 61633009, U1613213, 61375005, 61210009, and 61773047), partly by the National Key Research and Development Plan of China (grant 2016YFC0300801), partly by the Beijing Municipal Science and Technology (grants D16110400140000 and D161100001416001), and Guangdong Science and Technology Department (grant 2016B090910001).


  1. 1.
    Huang, H., Tang, Q., Li, Y., Wan, L., Pang, Y.: Dynamic control and disturbance estimation of 3D path following for the observation class underwater remotely operated vehicle. Adv. Mech. Eng. 5, 604393 (2013)CrossRefGoogle Scholar
  2. 2.
    Huang, H., Tang, Q., Li, H., Liang, L., Li, W., Pang, Y.: Vehicle-manipulator system dynamic modeling and control for underwater autonomous manipulation. Multibody Syst. Dyn. (2017). doi: 10.1007/s11044-0169538-3
  3. 3.
    Tang, Y., Li, S., Zhang, A.: Research on optimization design of a new type of underwater vehicle for arctic expedition. In: Proceedings of the International Symposium Underwater Technology, pp. 96–100 (2009)Google Scholar
  4. 4.
    Lowe, D.: Object recognition from local scale-invariant features. In: Proceedings of IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)Google Scholar
  5. 5.
    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Proceedigs of the European Conference on Computer vision, pp. 404–417 (2006)Google Scholar
  6. 6.
    Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)CrossRefGoogle Scholar
  7. 7.
    Yang, X., Liu, Z., Qiao, H., Song, Y., Ren, S., Zheng, S.: Underwater image matching by incorporating structural constraints. Int. J. Adv. Robot. Syst. Under RevisionGoogle Scholar
  8. 8.
    Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010 Part IV. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-15561-1_56 CrossRefGoogle Scholar
  9. 9.
    Belongie, S., Malik, J.: Matching with shape contexts. In: Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries, pp. 20–26 (2000)Google Scholar
  10. 10.
    Leone, A., Distante, C., Mastrolia, A., Indiveri, G.: A fully automated approach for underwater mosaicking. In: OCEANS, pp. 1–6 (2006)Google Scholar
  11. 11.
    Elibol, A., Garcia, R., Gracias, N.: A new global alignment approach for underwater optical mapping. Ocean Eng. 38(10), 1207–1219 (2011)CrossRefGoogle Scholar
  12. 12.
    Ferreira, F., Veruggio, G., Caccia, M., Zereik, E., Bruzzone, G.: A real-time mosaicking algorithm using binary features for rovs. In: Proceedings of the Mediterranean Conference on Control and Automation, pp. 1267–1273 (2013)Google Scholar
  13. 13.
    Garcia-Fidalgo, E., Ortiz, A., Bonnin-Pascual, F., Company, J.: Fast image mosaicing using incremental bags of binary words. In: Proceedings of the IEEE International Conference Robotics and Automation, pp. 1174–1180 (2016)Google Scholar
  14. 14.
    Liu, Z., Qiao, H.: GNCCP graduated nonconvexity and concavity procedure. IEEE Trans. Pattern Anal. Mach. Intell. 36(6), 1258–1267 (2014)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Frank, M., Wolfe, P.: An algorithm for quadratic programming. Nav. Res. Logist. Q. 3(1–2), 95–110 (1956)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Jaggi, M.: Revisiting Frank-Wolfe: projection-free sparse convex optimization. In: Proceedings of the International Conference on Machine Learning, pp. 427–435 (2013)Google Scholar
  17. 17.
    Torr, P., Zisserman, A.: MLESAC: a new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78, 138–156 (2000)CrossRefGoogle Scholar
  18. 18.
    Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Li, C., Liu, Z., Yang, X., Qiao, H., Su, J.: Stitching contaminated images. Neurocomputing 214, 829–836 (2016)CrossRefGoogle Scholar
  20. 20.
    Loera, J., Rambau, J., Santos, F.: Triangulations: Structures for Algorithms and Applications. Springer, Heidelberg (2010)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Xu Yang
    • 1
  • Zhi-Yong Liu
    • 1
    • 2
    • 3
    Email author
  • Chuan Li
    • 1
    • 4
  • Jing-Jing Wang
    • 1
  • Hong Qiao
    • 1
    • 2
    • 3
  1. 1.State Key Laboratory of Management and Control for Complex SystemsInstitute of Automation, Chinese Academy of SciencesBeijingPeople’s Republic of China
  2. 2.Center for Excellence in Brain Science and Intelligence TechnologyChinese Academy of SciencesShanghaiPeople’s Republic of China
  3. 3.University of Chinese Academy of SciencesBeijingChina
  4. 4.Research Institute of ChengduBeijing Jingdong Century Trade Co., Ltd.ChengduChina

Personalised recommendations