Skip to main content
SpringerLink
Log in

Dynamic mosaicking: region-based method using edge detection for an optimal seamline

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image mosaicking is a process of assembling multiple images to create an image with a larger field of view. It is used in different studies, but some errors, like ghosting or parallax effects, could occur when the images contain dynamic elements. To avoid the failure of the mosaic and to solve these errors, a new method that searches an optimal seamline for dynamic mosaicking is presented. By finding regions that are similar between the images, and regions that are not alike, the seamline was computed by going through the similar regions and by avoiding the not common regions. To achieve this, a combination of Canny edge detector, and the outliers and inliers from the RANSAC method were used to identify these regions. Then, the regions were incorporated in an intensity difference to create a map that reveals them. Thus, the optimal seamline was computed by going through the similar regions and by avoiding the unalike regions. The experimental results show that the proposed approach is capable of generating robust mosaics against ghosting and parallax effects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Azzari P, Di Stefano L, Tombari F, Mattoccia S (2008) Markerless augmented reality using image mosaics. Image and Signal Processing 5099:413–420

    Article  Google Scholar 

  2. Baataoui A, Laraqui A, Saaidi A, Satori K, Jarrar A, Masrar M (2015) Image Mosaicing using a self-calibration camera. 3D Research (Springer) 6(2):19–34

    Article  Google Scholar 

  3. Bartoli A, Dalal N, Horaud R (2004) Motion Panoramas. In Jour. of Computer Animation and Virtual Worlds, pp.501–517

  4. Bhat KS, Saptharishi M, Khosla PK (2000) Motion detection and segmentation using image mosaics. IEEE Inter. Conf. on Multimedia and Expo, pp.1577–1580

  5. Brown M, Lowe D (2007) Automatic panoramic image stitching using invariant features. Inter Journal of Computer Vision 74(1):59–73

    Article  Google Scholar 

  6. Burt PJ, Adelson EH (1983) A multiresolution spline with application to image mosaics. ACM Trans Graph 2(4):217–236

    Article  Google Scholar 

  7. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Analysis and Machine Intelligence 8(6):679–698

    Article  Google Scholar 

  8. Chen S, QuickTime VR (1995) Image-based approach to virtual environment navigation. In SIGGRAPH'95, Vol. 29, pp 29–38

  9. Comaniciu D, Meer P, Shift M (2002) A robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  Google Scholar 

  10. Davis J (1998) Mosaics of scenes with moving objects. Computer Vision and Pattern Recognition, IEEE Computer Society Conf. pp.354–360

  11. Burtsev S V, Kuzmin Ye P (1993) An efficient flood-filling algorithm. Comput Graph 17(5):549–561

  12. Duplaquet M (1998) Building large image mosaics with invisible seam lines. Proc. SPIE 3387, Visual Information Processing VII, 369

  13. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Comm Of the ACM 24:381–395

    Article  MathSciNet  Google Scholar 

  14. Gu X, Song P, Rao Y, Soo YG, Yeong CF, Tan JTC et al (2016) Dynamic Image Stitching for Moving Object. Proc. of the 2016 IEEE Inter. Confer. on Robotics and Biomimetics Qingdao, China

  15. Irani M, Hsu S, Anandan P (1995) Video compression using mosaic representations. Signal Process Image Commun 7:529–552

    Article  Google Scholar 

  16. Juan L, Gwun O (2009) A comparison of SIFT, PCA-SIFT and SURF. International Journal of Image Processing (IJIP) 3(4):143–152

    Google Scholar 

  17. Kerschner M (2001) Seamline detection in colour orthoimage mosaicking by use of twin snakes. Jour of Photogrammetry & Remote Sensing 56(1):53–64

    Article  Google Scholar 

  18. Laaroussi S, Baataoui A, Halli A, Khalid S (2018) A dynamic mosaicking method based on histogram equalization for an improved seamline. Proc. of the first inter. conf. on intel. comp. in data sciances ICDS2017 Issue 127, pp.344–352

  19. Laraqui A, Baataoui A, Saaidi A, Jarrar A, Masrar M, Satori K (2017) Image Mosaicing Using Voronoi Diagram. Multimedia Tools and Applications (Springer) 76:8803–8829

    Article  Google Scholar 

  20. Li L, Yao J, Li H, Xia M, Zhang W (2017) Optimal seamline detection in dynamic scenes via graph cuts for image mosaicking. Mach Vis Appl 28:819–837

    Article  Google Scholar 

  21. Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  22. Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 27(10):1615–1630

    Article  Google Scholar 

  23. Mills A, Dudek G (2009) Image stitching with dynamic elements. Image Vis Comput 27(10):1593–1602

    Article  Google Scholar 

  24. Pan J, Zhou Q, Wang M (2014) Seamline determination based on segmentation for urban image mosaicking. IEEE Geosci Remote Sens Lett 11(8):1335–1339

    Article  Google Scholar 

  25. Pont-Tuset J, Perazzi F, Caelles S, Arbeláez P, Sorkine-Hornung A, Van Gool L (2017) The 2017 DAVIS Challenge on Video Object Segmentation. arXiv:1704.00675

  26. Qi Z, Cooperstock JR (2008) Depth-based image mosaicing for both static and dynamic scenes. In ICPR'08: Proc. of the 19th Inter. Conf. on Pattern Recognition

  27. Qureshi HS, Khan MM, Hafiz R, Cho Y, Cha J (2012) Quantitative quality assessment of stitched panoramic images. IET Image Process 6(9):1348–1358

    Article  MathSciNet  Google Scholar 

  28. Ramachandran M, Chellappa R (2006) Stabilization and Mosaicing of Airborne Videos. IEEE Inter. Conf. on Image Processing, pp.345–348

  29. Rebière N, Auclair-Fortier M, deschênes F (2008) Image mosaicing using optical flow registration. Pattern Recognition, pp.1051–4651

  30. Reinhard E, Adhikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34–41

    Article  Google Scholar 

  31. Sawhney HS, Ayer S (1996) Compact representations of videos through dominant and multiple motion estimation. Transactions on Pattern Analysis and Machine Intelligence (PAMI) 18:814–830

    Article  Google Scholar 

  32. Szeliski R, Shum HY (1997) Creating full view panoramic image mosaics and environment maps. In SIGGRAPH'97: Proc. of the 24th annual conf. on Computer graphics and interactive techniques, pp.251–258

  33. Tang Y, Jiang H (2009) Highly efficient image stitching based on energy map. Image and Signal Processing, CISP '09, 2nd International Congress

  34. Tang Y, Shin J, Liao H (2012) De-ghosting Method for Image Stitching. International Journal of Digital Content Technology and its Applications (JDCTA)

  35. Uyttendaele M, Eden A, Skeliski R (2001) Eliminating ghosting and exposure artifacts in image mosaics. Computer Vision and Pattern Recognition, pp.1063–6919

  36. Wald L (2002) Data fusion: definitions and architectures – fusion of images of different spatial resolutions, ISBN 2–911762-38-X (ENSMP)

  37. Wang Z, Bovik AC, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  38. Xu W, Mulligan J (2010) Performance evaluation of color correction approaches for automatic multi-view image and video stitching. In: 2010 IEEE Conference on computer vision and pattern recognition(CVPR), pp 263–270

  39. Yan C, Zhang Y, Xu J, Dai F, Zhang J, Dai Q, Wu F (2014) Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors. IEEE Transactions on Circuits and Systems for Video Technology, Vol.24 (12)

  40. Yan C, Xie H, Yang D, Yin J, Zhang Y, Dai Q (2017) Supervised hash coding with deep neural network for environment perception of intelligent vehicles. IEEE Trans Intell Transp Syst 19(1)

  41. Yao R, Sun J, Zhoul Y, Chen D (2016) Video stitching based on iterative hashing and dynamic seam-line with local context. Multimed Tools Appl 76(11):13615–13631

    Article  Google Scholar 

  42. Yu L, Holden EJ, Dentith MC, Zhang H (2011) Towards the automatic selection of optimal seam line locations when merging optical remote-sensing images. Inter Jour of Remote Sensing 33(4):1000–1014

    Article  Google Scholar 

  43. Yun-Hee C, Yeong Kyeong S, Tae-Sun C (2002) Image mosaicing with automatic scene segmentation for video indexing. Inter. Conf. on Consumer Electronics, pp.74–75

  44. Zeng L, Zhang S, Zhang J, Zhang Y (2014) Dynamic image mosaic via SIFT and dynamic programming. Machine Vision and Applications archive 25(5):1271–1282

    Article  Google Scholar 

  45. Zhang W, Hu S, Liu K (2017) Patch-based correlation for Deghosting in exposure fusion. Inf Sci 415–416:19–27

    Article  Google Scholar 

  46. Zhanga W, Hua S, Liua K, Yaoc J (2016) Motion-free exposure fusion based on inter-consistency and intra-consistency. Inf Sci 376:190–201

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the national center of scientific and technology research (CNRST, Centre National pour la Recherche Scientifique et Technique).

Author information

Authors and Affiliations

  1. LIIAN, Laboratory, Sidi Mohammed Ben Abdellah University, 1796, 30003, Atlas-Fes, Morocco

    Saadeddine Laaroussi, Aziz Baataoui & Khalid Satori

  2. Department of computer science, Faculty of Science & Tecchniques, Moulay Ismail University, 509 Boutalamine, 52000, Errachidia, BP, Morocco

    Aziz Baataoui

  3. OMEGA, LERES Laboratory, Moualy Ismail University, Marjane 2, 298, 50050, Meknes, Morocco

    Akram Halli

Authors
  1. Saadeddine Laaroussi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aziz Baataoui
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Akram Halli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Khalid Satori
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saadeddine Laaroussi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Laaroussi, S., Baataoui, A., Halli, A. et al. Dynamic mosaicking: region-based method using edge detection for an optimal seamline. Multimed Tools Appl 78, 23225–23253 (2019). https://doi.org/10.1007/s11042-019-7603-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7603-7

Keywords

Search

Navigation