Trinocular vision system based on cameras with tilt–shift lens

  • Mingwei ShaoEmail author
  • Junyu Dong
Research Article


In multi-camera vision system, two major deficiencies are the limited field of view and the difficulty of feature matching. In this paper, a camera with tilt–shift lens is designed and a trinocular vision system based on the camera is detailed. The tilt–shift lens, which meets the Scheimpflug condition, can enlarge the overlapping area of the trinocular vision system. The trifocal tensor which can provide a strong constraint is determined, and the trifocal tensor is used for feature matching and 3D reconstruction in this paper.


Machine vision Calibration Multi-sensor methods Three-dimensional sensing 



This work was supported by Postdoctoral Sustentation Fund of Qingdao (861805033068), the National Natural Science Fundations of China (U1706218 and 41576011).


  1. 1.
    C.L. Zitnick, T. Kanade, A volumetric iterative approach to stereo matching and occlusion detection. CMU Technical Report CMU-RI-98-30, 1998Google Scholar
  2. 2.
    T. Scheimpflug, Improved method and apparatus for the systematic alteration or distortion of plane pictures and images by means of lenses and mirrors for photography and for other purposes. GB Patent No. 1196. Filed 16 January 1904, and issued 12 May 1904Google Scholar
  3. 3.
    Y.V. Chavan, D.K. Mishra, Lens modeling for computer vision system. J. Opt. 38(1), 38–47 (2009)CrossRefGoogle Scholar
  4. 4.
    Z.Y. Zhang, A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  5. 5.
    J. Bouguet, Camera calibration toolbox for Matlab, Accessed 12 Jan 2012
  6. 6.
    R. Hartley, An investigation of the essential matrix [R/OL] (1992), Research report, pp. 1–40,
  7. 7.
    R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision, 2nd edn. (Cambridge University, Cambridge, 2003)zbMATHGoogle Scholar
  8. 8.
    Lu Rui, M.W. Shao, Sphere-based calibration method for trinocular vision sensor. Opt. Lasers Eng. 90(2017), 119–127 (2017)Google Scholar
  9. 9.
    M.Okutomi Knade, A stereo matching algorithm with an adaptive window: theory and experiment. IEEE Trans. Pattern Anal. Mach. Intell. 16(9), 920–932 (1994)CrossRefGoogle Scholar
  10. 10.
    C. Steger, Unbiased extraction of curvilinear structures from 2D and 3D image, Ph.D. Dissertation, Technische Universitaet Muenchen, 1998Google Scholar

Copyright information

© The Optical Society of India 2019

Authors and Affiliations

  1. 1.College of Information Science and EngineeringOcean University of ChinaQingdaoChina

Personalised recommendations