Skip to main content

Depth Estimation Based on Stereo Image Using Passive Sensor

  • Conference paper
  • First Online:
Advances in Electronics Engineering

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 619))

Abstract

This article presents an algorithm for depth estimation using a pair of passive sensors which involves two cameras. These cameras did not produce any energy to collect the depth information. However, the depth information obtained from a camera can be produced by a matching process between two images at the same viewpoints. These images are captured from two cameras, which are also known as stereo cameras. The matching process consists of several stages, which will produce depth map. The most challenging problem for the matching process is to get an accurate corresponding point between two images. Hence, this article proposes an algorithm for stereo matching using Weighted Sum of Absolute Differences (WSAD), Median Filter (MF), and Bilateral Filter (BF) to surge up the accuracy. The WSAD will be implemented at the first stage to get the preliminary corresponding result, then the BF works as an edge-preserving filter to remove the noise from the first stage. The MF is used at the last stage to improve final depth map. A standard benchmarking dataset from the Middlebury has been used for the experimental analysis and validation. The proposed work in this article achieves good accuracy. The comparison is also conducted with some established methods where the proposed framework performs much better.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Vedamurthy I, Knill DC, Huang SJ, Yung A, Ding J, Kwon OS, Bavelier D, Levi DM (2016) Recovering stereo vision by squashing virtual bugs in a virtual reality environment. Phil Trans R Soc B 371(1697):20150264

    Article  Google Scholar 

  2. Hamzah RA, Ibrahim H, Hassan AH (2016) Stereo matching algorithm for 3D surface reconstruction based on triangulation principle. In: International conference on information technology, information systems and electrical engineering (ICITISEE), pp 119–124

    Google Scholar 

  3. Menze M, Geiger A (2015) Object scene flow for autonomous vehicles. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3061–3070

    Google Scholar 

  4. Aziz KA, Shokri AS (2012) A pixel to pixel correspondence and region of interest in stereo vision application. In: 2012 IEEE Symposium on Computers & Informatics (ISCI), pp 193–197

    Google Scholar 

  5. Hasan AH, Hamzah RA, Johar MH (2009) Range estimation in disparity mapping for navigation of stereo vision autonomous vehicle using curve fitting tool. IJVIPNS, pp 5–9 (2009)

    Google Scholar 

  6. Hamid MS, Rosly HN, Hashim NM (2011) A distance and pixel intensity relation for disparity mapping in region of interest. In: 2011 IEEE 3rd international conference on communication software and networks, pp 15–19

    Google Scholar 

  7. Xi HX, Cui W (2013) Wide baseline matching using support vector regression. Telecommun Comput Electron Control 597–602

    Google Scholar 

  8. Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 7–42

    Google Scholar 

  9. Yang Q (2012) A non-local cost aggregation method for stereo matching. In IEEE conference on computer vision and pattern recognition (CVPR), pp 1402–14092012)

    Google Scholar 

  10. Hosni A, Rhemann C, Bleyer M, Rother C, Gelautz M (2013) Fast cost-volume filtering for visual correspondence and beyond. IEEE Trans Pattern Anal Mach Intell 504–511

    Article  Google Scholar 

  11. Kadmin AF, Hamid MS, Ghani SF, Ibrahim H (2018) Improvement of stereo matching algorithm for 3D surface reconstruction. Signal Process: Image Commun, 65:165–172

    Google Scholar 

  12. Richardt C, Kim H, Valgaerts L, Theobalt C (2016) Dense wide-baseline scene flow from two handheld video cameras. In: Fourth International Conference on 3D Vision (3DV), pp 276–285

    Google Scholar 

  13. Liang Q, Yang Y, Liu B (2014) Stereo matching algorithm based on ground control points using graph cut. Int Congr Image Signal Process (CISP) 503–508

    Google Scholar 

  14. Yang Q, Ji P, Li D, Yao S, Zhang M (2014) Fast stereo matching using adaptive guided filtering. Image Vis Comput 202–211

    Article  Google Scholar 

  15. Kowalczuk J, Psota ET, Perez LC (2013) Real-time stereo matching on CUDA using an iterative refinement method for adaptive support-weight correspondences. IEEE Trans Circuits Syst Video Technol 94–104

    Article  Google Scholar 

  16. Zbontar J, LeCun Y (2015) Computing the stereo matching cost with a convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1592–1599

    Google Scholar 

  17. Hirschmüller H, Innocent PR, Garibaldi J (2002) Real-time correlation-based stereo vision with reduced border errors. Int J Comput Vis 229–246

    Google Scholar 

  18. Bricola JC, Bilodeau M, Beucher S (2016) Morphological processing of stereoscopic image superimpositions for disparity map estimation. Hal-01330139, pp 1–17

    Google Scholar 

  19. Ma N, Men Y, Men C, Li X (2016) Accurate dense stereo matching based on image segmentation using an adaptive multi-cost approach. Symmetry 159

    Google Scholar 

  20. Kitagawa M, Shimizu I, Sara R (2017) High accuracy local stereo matching using DoG scale map. In: IAPR international conference on machine vision applications (MVA), pp 258–261

    Google Scholar 

  21. Kadmin AF, Ghani SF, Hamid MS, Salam S (2017) Disparity refinement process based on RANSAC plane fitting for machine vision applications. J Fundam Appl Sci 9(4S):226–237

    Google Scholar 

  22. Wu SS, Tsai CH, Chen LG (2016) Efficient hardware architecture for large disparity range stereo matching based on belief propagation. In: IEEE international workshop on signal processing systems (SiPS), pp 236–241

    Google Scholar 

  23. Hasan AH, Hamzah RA, Johar MH (2009) Disparity mapping for navigation of stereo vision autonomous guided vehicle. In: International conference of soft computing and pattern recognition, pp 575–579

    Google Scholar 

  24. Hamzah RA, Rahim RA (2010) Depth evaluation in selected region of disparity mapping for navigation of stereo vision mobile robot. In: IEEE Symposium on Industrial Electronics & Applications (ISIEA), pp. 551–555

    Google Scholar 

  25. Ghani SF, Din A, Aziz KA (2012) Visualization of image distortion on camera calibration for stereo vision application. In: International Conference on Control System, Computing and Engineering (ICCSCE), pp. 28–33

    Google Scholar 

  26. Daniel S, Richard S (2018) Middlebury stereo evaluation—version 3. Accessed date: Nov 2018, http://vision.middlebury.edu/stereo/eval/references (2018)

  27. Einecke N, Eggert J (2013) Anisotropic median filtering for stereo disparity map refinement. In: VISAPP, pp 189–198 (2013)

    Google Scholar 

  28. Geiger A, Roser M, Urtasun R (2010) Efficient large-scale stereo matching. In: Asian conference on computer vision, pp 25–38

    Chapter  Google Scholar 

  29. Zhang K, Li J, Li Y, Hu W., Sun L, Yang S (2012) Binary stereo matching. In: International conference on pattern recognition (ICPR), pp 356–359

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Universiti Teknikal Malaysia Melaka with the grant Number (PJP/2018/FTK(13C)/S01632).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rostam Affendi Hamzah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hamzah, R.A., Wei, M.G.Y., Anwar, N.S.N., Abd Gani, S.F., Kadmin, A.F., Aziz, K.A.A. (2020). Depth Estimation Based on Stereo Image Using Passive Sensor. In: Zakaria, Z., Ahmad, R. (eds) Advances in Electronics Engineering. Lecture Notes in Electrical Engineering, vol 619. Springer, Singapore. https://doi.org/10.1007/978-981-15-1289-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-1289-6_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-1288-9

  • Online ISBN: 978-981-15-1289-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics