Cluster Computing

, Volume 21, Issue 1, pp 29–38 | Cite as

Object recognition and 3D reconstruction of occluded objects using binocular stereo

  • L. PriyaEmail author
  • Sheila Anand


Object recognition is one of the key areas in computer vision which comprises of object detection, recognition and reconstruction. The image of the object to be recognized is captured using camera and matched with pre-stored templates of the model object. Recognizing 3D view of the object is difficult in the presence of object occlusion and view-point invariants. This paper focuses on the problem of occlusion and provides a solution for handling self and inter-object occlusion. Self-occlusion has been addressed by the suitable calibration of the cameras and a novel algorithm has been proposed to address inter-object occlusion. A modified geometric mapping technique has been proposed for the 3D reconstruction of the recognized object. Real-time setup has been used to test the proposed solutions to identify objects of multiple shapes and sizes. The results show that the performance of the algorithm was superior and enabled recognition of objects with 80% occlusion or less.


Computer vision Occlusion 3D object recognition 3D object reconstruction 


  1. 1.
    Allen, P.K.: Robotic Object Recognition Using Vision and Touch. Kluwer Academic Publishers, Boston (1987)CrossRefGoogle Scholar
  2. 2.
    Yang, T., Zhang, Y., Yu, R., Zhang, X., Chen, T., Ran, L., Song, Z., Ma, W.: Simultaneous active camera array focus plane estimation and occluded moving object imaging. Image Vis. Comput. 32, 510–521 (2014)CrossRefGoogle Scholar
  3. 3.
    Zeeshan Zia, M., Stark, M., Schindler, K.: Explicit occlusion modeling for 3D object representations. In: IEEE Conference on Computer Vision and Pattern Recognition (2013)Google Scholar
  4. 4.
    Priya, L., Anand, S., Uma, K.: Detection of occluded objects under backlighting. IJCSE, ISBN: 9788192958022 (2016)Google Scholar
  5. 5.
    Toshev, A., Taskar, B., Daniilidis, K.: Object detection via boundary structure segmentation. In: CVPR (2010)Google Scholar
  6. 6.
    Wu, B.-F., et al.: A relative-discriminative-histogram-of-oriented-gradients-based particle filter approach to vehicle occlusion handling and tracking. IEEE Trans. Ind. Electron. 61(8), 4228–4237 (2014)CrossRefGoogle Scholar
  7. 7.
    Leibe, B., Leonardis, A., Schiele, B.: Robust object detection with interleaved categorization and segmentation. IJCV 77(1–3), 259–289 (2008)CrossRefGoogle Scholar
  8. 8.
    Shah, SAA.: A novel local surface description for automatic 3D object recognition in low resolution cluttered scenes. In: ICCV 2013, IEEE Xplore (2013)Google Scholar
  9. 9.
    Gao, T., Packer, B., Koller, D.: A segmentation-aware object detection model with occlusion handling. In: CVPR (2011)Google Scholar
  10. 10.
    Joglekar, J., Gedam, S.S.: Area/based stereo matching technique using Hausdorff distance and texture analysis, PIA11. International Archives of PhotogrammetryGoogle Scholar
  11. 11.
  12. 12.
    Suzuki, M.T., Yaginuma, Y., Shimizu, Y.: A partial shape matching technique for 3D model retrieval systems. In: SIGGRAPH 2005, The 32nd International Conference on Computer Graphics and Interactive Techniques ISBN:1-59593-100-7, ACM-ON:428052, 2005Google Scholar
  13. 13.
    Zhang, S., Qu, X., Ma, S., Yang, Z., Kong, L.: A dense stereo matching algorithm based on triangulation. J. Comput. Inf. Syst. 8(1), 283–292 (2012)Google Scholar
  14. 14.
    Niknejad, H.T., Kawano, T., Oishi, Y., Mita, S.: Occlusion handling using discriminative model of trained part templates and conditional random field. In: IEEE Intelligent Vehicles Symposium (IV) June 23–26, 2013. Gold Coast, Australia (2013)Google Scholar
  15. 15.
    Sabourin, C., Moreno, R., Madani, K.: A machine learning based intelligent vision system for autonomous object detection and recognition. Appl. Intell. 40(2), 358–375 (2014)CrossRefGoogle Scholar
  16. 16.
    Torralba, A., Murphy, K.P., Freeman, W.T.: Sharing features: efficient boosting procedures for multiclass object detection. In: CVPR (2004)Google Scholar
  17. 17.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. In: IJCV (2004)Google Scholar
  18. 18.
    Hinterstoisser, S., Lepetit, V., Ilic, S., Fua, P., Navab, N.: Dominant orientation templates for real-time detection of texture-less objects. In: CVPR (2010)Google Scholar
  19. 19.
    Borgefors, G.: Hierarchical chamfer matching: a parametric edge matching algorithm. PAMI 10(6), 849–865 (1988)CrossRefGoogle Scholar
  20. 20.
    Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1), 7–42 (2002)CrossRefzbMATHGoogle Scholar
  21. 21.
    Okada, R.: Discriminative generalized hough transform for object detection. In: ICCV (2009)Google Scholar
  22. 22.
    Chandel, H., Bahra University Waknaghat, Shimla, Vatta, S.: Occlusion detection and handling: a review. Int. J. Comput. Appl. 120(10), 0975–8887 (2015)Google Scholar
  23. 23.
    Amit, Y., Geman, D., Fan, X.: A coarse-to-fine strategy for multiclass shape detection. TPAMI 26(12), 1606–1621 (2004)CrossRefGoogle Scholar
  24. 24.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (2001)Google Scholar
  25. 25.
    Priya, L., Anand, S.: Shape based object detection for partially occluded objects under front lighting techniques. In: 2015 IEEE European Modeling Symposium, 978-1-5090-0206-1/15. IEEE, doi: 10.1109/EMS.2015.27 (2015)
  26. 26.
    Loncaric, S.: A survey of shape analysis techniques. Pattern Recognit. 31(8), 983–1001 (1998)Google Scholar
  27. 27.
    Gandhi, C., Viradiya, J.: A survey on occlusion detection and handling. Int. J. Adv. Eng. Res. Dev. 3(2), 203–209 (2016)Google Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.Department of Information TechnologyRajalakshmi Engineering CollegeThandalamIndia
  2. 2.Computer StudiesRajalakshmi Engineering CollegeThandalamIndia

Personalised recommendations