Skip to main content
SpringerLink
Log in

Estimating deformation factors of planar patterns in spherical panoramic images

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

The transformation between a planar image and a planar pattern is commonly described by a homography. However, a homography cannot express the exact relation between a spherical panoramic image and a planar pattern. In this paper, we propose a new method of parameter estimation for locating planar patterns in spherical panoramic images. First, we estimate transformation parameters which express how much the target object is scaled, translated and rotated in the spherical panoramic image. Then, we project the planar pattern onto the center of the spherical panoramic image. The center-aligned pattern is used to estimate the transformation parameters. The parameters express the geometric relation between pixels in the spherical panoramic image and pixels in the planar pattern. Our proposed estimation process decreases the error of pattern matching caused by the heavy spherical distortion. Experimental results show that the failure rate of matching is significantly reduced.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  1. Fangi, G., Nardinocchi, C.: Photogrammetric processing of spherical panoramas. Photogramm. Rec. 28(143), 293–311 (2013)

    Article  Google Scholar 

  2. Lourenco, M., Barreto, J., Vasconcelos, F.: sRD-SIFT: keypoint detection and matching in images with radial distortion. IEEE Trans. Robot. 28(3), 752–760 (2012)

    Article  Google Scholar 

  3. Lourenco, M., Barreto, J., Malti, A.: Feature detection and matching in images with radial distortion. In: IEEE International Conference on Robotics and Automation, pp. 1028–1034 (2010)

  4. Wang, Q.H., Miao, F., Liu, B., Li, C.P.: Panorama image distortion correction method based on straight baseline. In: International Conference on Apperceiving Computing and Intelligence Analysis, pp. 203–207 (2008)

  5. Swaminathan, R., Nayar, S.K.: Nonmetric calibration of wide-angle lenses and polycameras. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1172–1178 (2000)

    Article  Google Scholar 

  6. Snyder, J.P.: Flattening the Earth: Two Thousand Years of Map Projections. University Of Chicago Press, Chicago (1993)

    Google Scholar 

  7. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, p. 50 (1988)

  8. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  9. Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)

    Article  Google Scholar 

  10. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded up robust features. In: 9th European Conference on Computer Vision, pp. 404–417 (2006)

  11. De Carufel, J., Laganiere, R.: Matching cylindrical panorama sequences using planar reprojections. In: International Conference on Computer Vision Workshops, pp. 320–327 (2011)

  12. Tong, G., Gu, J.: Locating objects in spherical panoramic images. In: IEEE International Conference on Robotics and Biomimetics, pp. 818–823 (2011)

  13. Tong, G., Liu, R., Tan, J.: 3D information retrieval in mobile robot vision based on spherical compound eye. In: IEEE International Conference on Robotics and Biomimetics, pp. 1895–1900 (2011)

  14. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004). (ISBN: 0521540518)

    Book  MATH  Google Scholar 

  15. Carmichael, G.: Matching spherical panoramas and planar photographs. Ph.D. thesis, Carleton University Ottawa (2009)

  16. Zhou, Z., Niu, B., Ke, C., Wu, W.: Static object tracking in road panoramic videos. In: IEEE International Symposium on Multimedia, pp. 57–64 (2010)

  17. Kroepfl, M., Wexler, Y., Ofek, E.: Efficiently locating photographs in many panoramas. In: 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 119–128 (2010)

  18. Geyer, C., Daniilidis, K.: Catadioptric projective geometry. Int. J. Comput. Vis. 45(3), 223–243 (2001)

    Article  MATH  Google Scholar 

  19. Geodeme, T., Tuytelaars, T., Vanacker, G., Nuttin, M., Van Gool, L.: Omnidirectional sparse visual path following with occlusion-robust feature tracking. In: Proceedings 6th workshop on omnidirectional vision, camera networks and non-classical cameras (2005)

  20. Hansen, P., Corke, P., Boles, W., Daniilidis, K.: Scale invariant feature matching with wide angle images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1689–1694 (2007)

  21. Hansen, P., Corke, P., Boles, W., Daniilidis, K.: Scale-invariant features on the sphere. In: IEEE 11th International Conference on Computer Vision, pp. 1–8 (2007)

  22. Murillo, A., Sagüés, C., Guerrero, J.J., Goedemé, T., Tuytelaars, T., Van Gool, L.: From omnidirectional images to hierarchical localization. Robot. Auton. Syst. 55(5), 372–382 (2007)

    Article  Google Scholar 

  23. Murillo, A., Campos, P., Kosecka, J., Guerrero, J.: Gist vocabularies in omnidirectional images for appearance based mapping and localization. IEEE Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (2010)

  24. Murillo, A.C., Kosecka, J.: Experiments in place recognition using gist panoramas. In: IEEE 12th International Conference on Computer Vision Workshops, pp. 2196–2203 (2009)

  25. Murillo, A.C., Singh, G., Kosecka, J., Guerrero, J.J.: Localization in urban environments using a panoramic gist descriptor. IEEE Trans. Robot. 29(1), 146–160 (2013)

    Article  Google Scholar 

  26. Sato, T., Pajdla, T., Yokoya, N.: Epipolar geometry estimation for wide-baseline omnidirectional street view images. In: The Second IEEE International Workshop on Mobile Vision, pp. 56–63 (2011)

  27. Swaminathan, R., Nischt, M., Kuhnel, C.: Localization based object recognition for smart home environments. In: IEEE International Conference on Multimedia and Expo, pp. 921–924 (2008)

  28. Arican, Z., Frossard, P.: Sampling-aware polar descriptors on the sphere. In: 17th IEEE International Conference on Image Processing, pp. 3509–3512 (2010)

  29. Arican, Z., Frossard, P.: Scale-invariant features and polar descriptors in omnidirectional imaging. IEEE Trans. Image Process. 21(5), 2412–2423 (2012)

    Article  MathSciNet  Google Scholar 

  30. Arican, Z., Frossard, P.: OmniSIFT: Scale invariant features in omnidirectional images. In: 17th IEEE International Conference on Image Processing, pp. 3505–3508 (2010)

  31. Ly, D.S., Demonceaux, C., Seulin, R., Fougerolle, Y., et al.: Scale invariant line matching on the sphere. In: IEEE International Conference on Image Processing (2013)

  32. Alter, T., Jacobs, D.: Uncertainty propagation in model-based recognition. Int. J. Comput. Vis. 27(2), 127–159 (1998)

    Article  Google Scholar 

  33. Dementhon, D.F., Davis, L.S.: Model-based object pose in 25 lines of code. Int. J. Comput. Vis. 15(1–2), 123–141 (1995)

    Article  Google Scholar 

  34. Oberkampf, D., DeMenthon, D.F., Davis, L.S.: Iterative pose estimation using coplanar points. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 626–627 (1993)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Incheon National University, Incheon, South Korea

    Bo-Sung Kim & Jong-Seung Park

Authors
  1. Bo-Sung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jong-Seung Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jong-Seung Park.

Additional information

Communicated by S. Kopf.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, BS., Park, JS. Estimating deformation factors of planar patterns in spherical panoramic images. Multimedia Systems 23, 607–625 (2017). https://doi.org/10.1007/s00530-016-0513-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-016-0513-x

Keywords

Search

Navigation