Multimedia Tools and Applications

, Volume 76, Issue 15, pp 16189–16223 | Cite as

Projection matrix by orthogonal vanishing points

Article

Abstract

Calculation of camera projection matrix, also called camera calibration, is an essential task in many computer vision and 3D data processing applications. Calculation of projection matrix using vanishing points and vanishing lines is well suited in the literature; where the intersection of parallel lines (in 3D Euclidean space) when projected on the camera image plane (by a perspective transformation) is called vanishing point and the intersection of two vanishing points (in the image plane) is called vanishing line. The aim of this paper is to propose a new formulation for easily computing the projection matrix based on three orthogonal vanishing points. It can also be used to calculate the intrinsic and extrinsic camera parameters. The proposed method reaches to a closed-form solution by considering only two feasible constraints of zero-skewness in the internal camera matrix and having two corresponding points between the world and the image. A nonlinear optimization procedure is proposed to enhance the computed camera parameters, especially when the measurement error of input parameters or the skew factor are not negligible. The proposed method has been run on real and synthetic data for more precise evaluations. The provided experimental results demonstrate the superiority of the proposed method.

Keywords

Projection matrix Perspective transformation Camera calibration Vanishing points 

References

  1. 1.
    Antunes M, Barreto JP (2013) A global approach for the detection of vanishing points and mutually orthogonal vanishing directions. In: IEEE conference on computer vision and pattern recognition (CVPR), 2013. IEEE, pp 1336–1343Google Scholar
  2. 2.
    Babaee-Kashany V, Pourreza HR (2010) Camera pan and tilt estimation in soccer scenes based on vanishing points. In: 4th UKSim European symposium on computer modeling and simulation (EMS), 2010. IEEE, pp 152–157Google Scholar
  3. 3.
    Babaee-Kashany V, Pourreza HR (2010) Camera pose estimation in soccer scenes based on vanishing points. In: IEEE international symposium on haptic audio-visual environments and games (HAVE), 2010. IEEE, pp 1–6Google Scholar
  4. 4.
    Beardsley P, Murray D (1992) Camera calibration using vanishing points. In: BMVC92. Springer, pp 416–425Google Scholar
  5. 5.
    Beardsley P, Murray D, Zisserman A (1992) Camera calibration using multiple images. In: Computer vision ECCV’92. Springer, pp 312–320Google Scholar
  6. 6.
    Caprile B, Torre V (1990) Using vanishing points for camera calibration. Int J Comput Vis 4(2):127–139CrossRefGoogle Scholar
  7. 7.
    Cipolla R, Drummond T, Robertson DP (1999) Camera calibration from vanishing points in image of architectural scenes. In: BMVC, vol 99. Citeseer, pp 382–391Google Scholar
  8. 8.
    Daniilidis K, Ernst J (1996) Active intrinsic calibration using vanishing points. In: Proceedings of 1996 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1996 (CVPR’96). IEEE, pp 708–713Google Scholar
  9. 9.
    Dong S-P (2003) Determination of 3-d position of particles in perspective picture with vanishing-point theorem. In: Optical technology and image processing fo rfluids and solids diagnostics 2002. International Society for Optics and Photonics, pp 104–112Google Scholar
  10. 10.
    Duda RO, Hart PE (1972) Use of the hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15. Available: doi:10.1145/361237.361242 CrossRefMATHGoogle Scholar
  11. 11.
    Farin D, Krabbe S, Effelsberg W (2003) Robust camera calibration for sport videos using court models. In: Electronic imaging 2004. International Society for Optics and Photonics, pp 80– 91Google Scholar
  12. 12.
    Grammatikopoulos L, Karras G, Petsa E (2004) Camera calibration combining images with two vanishing points. Int Arch Photogramm Remote Sens Spat Inf Sci 35 (5):99–104Google Scholar
  13. 13.
    Grammatikopoulos L, Karras G, Petsa E (2007) An automatic approach for camera calibration from vanishing points. ISPRS J Photogramm Remote Sens 62 (1):64–76CrossRefGoogle Scholar
  14. 14.
    Grammatikopoulos L, Karras G, Petsa E, Kalisperakis I (2006) A unified approach for automatic camera calibration from vanishing points. Int Arch Photogramm Remote Sens Spat Inf Sci 5Google Scholar
  15. 15.
    Guillemaut J-Y, Aguado AS, Illingworth J (2005) Using points at infinity for parameter decoupling in camera calibration. IEEE Trans Pattern Anal Mach Intell 27 (2):265–270CrossRefGoogle Scholar
  16. 16.
    Guillou E, Meneveaux D, Maisel E, Bouatouch K (2000) Using vanishing points for camera calibration and coarse 3d reconstruction from a single image. Vis Comput 16(7):396–410CrossRefMATHGoogle Scholar
  17. 17.
    Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University PressGoogle Scholar
  18. 18.
    He B, Li Y (2007) A novel method for camera calibration using vanishing points. In: 14th international conference on mechatronics and machine vision in practice, 2007. M2VIP 2007. IEEE , pp 44–47Google Scholar
  19. 19.
    He B, Li YF (2008) Camera calibration from vanishing points in a vision system. Opt Laser Technol 40(3):555–561MathSciNetCrossRefGoogle Scholar
  20. 20.
    IPL Soccer Dataset IPL Azadi Soccer Dataset. http://ipl.ce.sharif.edu/links.html 2016-01-01
  21. 21.
    Ito M (1990) Robot vision modelling-camera modelling and camera calibration. Adv Robot 5(3):321–335MathSciNetCrossRefGoogle Scholar
  22. 22.
    Kanatani K (1992) Statistical analysis of focal-length calibration using vanishing points. IEEE Trans Robot Autom 8(6):767–775CrossRefGoogle Scholar
  23. 23.
    Kong H, Sarma SE, Tang F (2013) Generalizing laplacian of gaussian filters for vanishing-point detection. IEEE Trans Intell Transp Syst 14(1):408–418CrossRefGoogle Scholar
  24. 24.
    Lenz RK, Tsai RY (1988) Techniques for calibration of the scale factor and image center for high accuracy 3-d machine vision metrology. IEEE Trans Pattern Anal Mach Intell 10(5):713–720CrossRefGoogle Scholar
  25. 25.
    Li B, Peng K, Ying X, Zha H (2010) Simultaneous vanishing point detection and camera calibration from single images. In: Advances in visual computing. Springer, pp 151–160Google Scholar
  26. 26.
    Liang D, Huang Q, Liu Y, Zhu G, Gao W (2007) Video2cartoon: a system for converting broadcast soccer video into 3d cartoon animation. IEEE Trans Consum Electron 53(3):1138–1146CrossRefGoogle Scholar
  27. 27.
    Moghadam P, Starzyk JA, Wijesoma WS (2012) Fast vanishing-point detection in unstructured environments. IEEE Trans Image Process 21(1):425–430MathSciNetCrossRefGoogle Scholar
  28. 28.
    Orghidan R, Salvi J, Gordan M, Orza B (2012) Camera calibration using two or three vanishing points. IEEEGoogle Scholar
  29. 29.
    Pan S, Dong S, Wang H (2008) The calibration of perspective picture based on vanishing point. In: Congress on image and signal processing, 2008. CISP’08, vol 2. IEEE, pp 417–421Google Scholar
  30. 30.
    Salvi J (1998) An approach to coded structured light to obtain three dimensional information. Ph.D Thesis, Universitat de GironaGoogle Scholar
  31. 31.
    Salvi J, Armangué X., Batlle J (2002) A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recogn 35(7):1617–1635CrossRefMATHGoogle Scholar
  32. 32.
    Seetharaman G, Bao H, Shivaram G (1994) Calibration of camera parameters using vanishing points. J Frankl Inst 331(5):555–585CrossRefMATHGoogle Scholar
  33. 33.
    Stevenson DE, Fleck MM (1995) Robot aerobics: four easy steps to a more flexible calibration. In: Proceedings of 5th international conference on computer vision, 1995. IEEE, pp 34–39Google Scholar
  34. 34.
    Sun J, Gu H, Qin X, Zheng J (2008) A new camera calibration based on vanishing point. In: 7th world congress on intelligent control and automation, 2008. WCICA 2008. IEEE, pp 2371–2376Google Scholar
  35. 35.
    Sun H, Lu J, Chang Z (2016) An efficient camera calibration and optimisation method based on orthogonal vanishing points. Imag Sci J 64(4):232–239. Available. doi:10.1080/13682199.2016.1168143 CrossRefGoogle Scholar
  36. 36.
    Triggs B, McLauchlan PF, Hartley RI, Fitzgibbon AW (2000) Bundle adjustment-a modern synthesis. In: Vision algorithms: theory and practice. Springer, pp 298–372Google Scholar
  37. 37.
    Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J Robot Autom 3 (4):323–344CrossRefGoogle Scholar
  38. 38.
    Wang L-L, Tsai W-H (1990) Computing camera parameters using vanishing-line information from a rectangular parallelepiped. Mach Vis Appl 3(3):129–141CrossRefGoogle Scholar
  39. 39.
    Wang L-L, Tsai W-H (1991) Camera calibration by vanishing lines for 3-d computer vision. IEEE Trans Pattern Anal Mach Intell 4:370–376CrossRefGoogle Scholar
  40. 40.
    Weng J, Cohen P, Herniou M (1992) Camera calibration with distortion models and accuracy evaluation. IEEE Trans Pattern Anal Mach Intell 10:965–980CrossRefGoogle Scholar
  41. 41.
    Wikipedia. Football pitch. [Online]. Available: https://en.wikipedia.org/wiki/Football_pitch
  42. 42.
    Wu Y, Hu Z (2006) A robust method to recognize critical configuration for camera calibration. Image Vis Comput 24(12):1313–1318CrossRefGoogle Scholar
  43. 43.
    Xu X, Xia J, Xiong J, Xie X-F (2012) Robust camera calibration with vanishing points. In: 5th international congress on image and signal processing (CISP), 2012. IEEE, pp 931–935Google Scholar
  44. 44.
    Xu Y, Oh S, Hoogs A (2013) A minimum error vanishing point detection approach for uncalibrated monocular images of man-made environments. In: IEEE conference on computer vision and pattern recognition (CVPR), 2013. IEEE, pp 1376–1383Google Scholar
  45. 45.
    You X, Zheng Y (2016) An accurate and practical calibration method for roadside camera using two vanishing points. Neurocomputing 204:222–230. Big Learning in Social Media AnalyticsContaining a selection of papers from the 2014 International Conference on Security, Pattern Analysis, and Cybernetics (ICSPAC2014)CrossRefGoogle Scholar
  46. 46.
    Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRefGoogle Scholar
  47. 47.
    Zhu H, Yang J, Liu Z (2009) Fisheye camera calibration with two pairs of vanishing points. In: International conference on information technology and computer science, 2009. ITCS 2009, vol 1. IEEE, pp 321–324Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Department of Computer EngineeringSharif University of TechnologyTehranIran

Personalised recommendations