Multi-insight Monocular Vision System Using a Refractive Projection Model

  • J. Mohamed Asharudeen
  • Senthil Kumar ThangavelEmail author
Conference paper
Part of the Lecture Notes in Computational Vision and Biomechanics book series (LNCVB, volume 30)


The depth information of a scene, imaged from the inside of a patient’s body, is a difficult task using a monocular vision system. A multi-perception vision system idea has been proposed as a solution in this work. The vision system of the camera has been altered with the refractive projection model. The developed lens model recognises the scene with multiple perceptions. The motion parallax is observed under the different lenses for the single shot, captured through the monocular vision system. The presence of multiple lenses refracts the light in the scene at the different angles. Eventually, the appearance of the object dimension is augmented with more spatial cues that help in capturing 3D information in a single shot. The affine transformations between the lenses have been estimated to calibrate the multi-insight monocular vision system. The geometrical model of the refractive projection is proposed. The multi-insight lens plays a significant role in spatial user interaction.


Camera model Monocular vision Camera calibration Perspective projection Projective geometry 


  1. 1.
    Michels J, Saxena A, Ng AY (2007) 3D depth reconstruction from a single still image. Int J Comput VisGoogle Scholar
  2. 2.
    Cui X, Zhao Y, Lim K, Wu T (2015) Perspective projection model for prism based stereo vision. Opt Soc Am 23(21)CrossRefGoogle Scholar
  3. 3.
    Beardsley P, Murray D (1992) Camera calibration using vanishing points. University of Oxford, OxfordCrossRefGoogle Scholar
  4. 4.
    Zhang Z (1998) A flexible new technique for camera calibration. Microsoft research-technical report-98-71Google Scholar
  5. 5.
    Teixeira L, Gattass M, Fernandez M (2006) Zhang’s camera calibration: step by stepGoogle Scholar
  6. 6.
    Burger W (2016) Zhang’s camera calibration algorithm: in-depth tutorial and implementation. Technical report-HGB16-05Google Scholar
  7. 7.
    Cipolla R, Drummond T, Robertson D (1999) Camera calibration from vanishing points in images of architectural scenes. University of Cambridge, BMVC99Google Scholar
  8. 8.
    Tsai RY (1987) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off the shelf TV cameras and lenses. IEEE J Robot Autom RA-3(4)CrossRefGoogle Scholar
  9. 9.
    Jurjevic L, Gasparovic M (2017) 3D data acquisition based on OpenCV for close range photogrammetry applications. Int Arch Photogram Remote Sens Spat Inf Sci XLII-1/W1Google Scholar
  10. 10.
    Heikkila J, Silven O (1997) A four step camera calibration procedure with implicit image correction. University of OuluGoogle Scholar
  11. 11.
    Barath D, Toth T, Hajder L (2017) A minimal solution for two view focal length estimation using two affine correspondences. Machine Perception Research LaboratoryGoogle Scholar
  12. 12.
    Meng X, Hu Z (2003) A new easy camera calibration technique based on circular points. J Pattern Recogn Soc: 115–1164Google Scholar
  13. 13.
    Feng H, Li Q, Feng M (2017) A novel multi camera calibration method using transparent glass calibration board. In: Proceedings of 2nd international conference on advances in materials machinery, Electronics I. American Institute of PhysicsGoogle Scholar
  14. 14.
    Drennan M (2010) An implementation of camera calibration algorithms. Clemson UniversityGoogle Scholar
  15. 15.
    Orghidan R, Salvi J, Gordan M, Orza B (2012) Camera calibration using two or three vanishing points. In: IEEE proceedings of the federated conference on computer science and information systems, pp 123–130Google Scholar
  16. 16.
    Wang L-L, Tsai W-H (1990) Computing camera parameters using vanishing line information from a rectangular parallelepiped. Mach Vis Appl 129–141CrossRefGoogle Scholar
  17. 17.
    Guillou E, Meneveaux D, Maisel E, Bouatouch K (2000) Using vanishing points for camera calibration and coarse 3D reconstruction from a single image. Vis Comput 396–410CrossRefGoogle Scholar
  18. 18.
    Caprile B, Torre V (1990) Using vanishing points for camera calibration. Int J Comput Vis 4:127–140CrossRefGoogle Scholar
  19. 19.
    Hartley R, Zisserman A (2005) Multiple view geometry in computer vision. Cambridge University Press, Cambridge Google Scholar
  20. 20.
    Beardsley P, Murray D, Zisserman (1992) A Camera calibration using multiple images. University of Oxford, OxfordCrossRefGoogle Scholar
  21. 21.
    Feng M, Jia X, Wang J, Feng S, Zheng T (2017) Global calibration of multi camera based on refractive projection and ray tracing. Sensors 17:2494CrossRefGoogle Scholar
  22. 22.
    Hartley RI, Kaucic R (2002) Sensitivity of calibration to principal point position. In: European conference on computer vision. Springer, BerlinCrossRefGoogle Scholar
  23. 23.
    Rothwell CA, Zisserman A, Marinos CI, Forsyth DA, Mundy JL (1992) Relative motion and pose from arbitrary plane curves. University of Oxford, Oxford CrossRefGoogle Scholar
  24. 24.
    Hansen P, Alismail H, Rander P, Browning B (2012) Online continuous stereo extrinsic parameter estimation. CVPRGoogle Scholar
  25. 25.
    Sreelakshmi S, Vijai A, Senthil Kumar T (2016) Detection and segmentation of cluttered objects from texture cluttered scene. In: Proceedings of the international conference on soft computing systemsGoogle Scholar
  26. 26.
    Senthil Kumar T, Vijai A (2014) 3D reconstruction of face: a comparison of marching cube and improved marching cube algorithm. Int J Adv Image Process Tech 1:6–9Google Scholar
  27. 27.
    Nirmala R, Thangavel SK (2017) Develop, implement and evaluate a multimodal system for government organisation. In: Proceedings of 4th international conference on advanced computing and communication systems, ICACCS 2017, pp 111–117Google Scholar
  28. 28.
    Kavin D, Thangavel SK (2017) Improving capabilities for visually challenged person in library environment. In: Proceedings of 4th international conference on advanced computing and communication systems, ICACCS 2017, pp 1–10Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • J. Mohamed Asharudeen
    • 1
  • Senthil Kumar Thangavel
    • 1
    Email author
  1. 1.Department of Computer Science and EngineeringAmrita School of Engineering, Amrita Vishwa VidyapeethamCoimbatoreIndia

Personalised recommendations