Skip to main content
SpringerLink
Log in

An accurate and cost-effective stereo matching algorithm and processor for real-time embedded multimedia systems

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Stereo matching is a vision technique for finding three-dimensional (3D) distance information in various multimedia applications by calculating pixel disparities between the matching points of a stereo image pair captured from a stereo camera. The most important considerations in stereo matching are highly accurate results and real-time performance. Thus, this paper proposes an accurate stereo matching algorithm that uses both a census transform algorithm and the sum of absolute differences algorithm in a complementary manner and its real-time hardware architecture. In addition, the proposed algorithm uses a vertical census transform with cost aggregation (VCTCA) to reduce hardware costs while maintaining high matching accuracy. We model the proposed algorithm using C language and verify it in several environments. Using a hardware description language, we implement the proposed hardware architecture and verify it on a field-programmable gate array-based platform to confirm the cost and performance of the hardware. The experimental results show that the proposed algorithm using the VCTCA produces accurate 3D distance information in real environments and reduces the hardware complexity. Thus, the algorithm and its hardware architecture are suitable for real-time embedded multimedia systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Banks J, Bennamoun M, Corke P (1997) Non-parametric techniques for fast and robust stereo matching. Proceedings of IEEE TENCON’97 I.E. Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications, Brisbane, Qld., Australia 2:365–8

  2. Banz C, Hesselbarth S, Flatt H, Blume H, Pirsch P (2005) Real-time stereo vision system using semi-global matching disparity estimation: architecture and FPGA-implementation. Comput Vis Pattern Recognit 2:807–14

    Google Scholar 

  3. Chang NYC, Tsai TH, Hsu BH, Chen YC, Chang TS (2010) Algorithm and architecture of disparity estimation with mini-census adaptive support weight. IEEE Trans Circuits Syst Video Technol 20(6):792–805

    Article  Google Scholar 

  4. Fife WS, Archibald JK (2013) Improved census transforms for resource-optimized stereo vision. IEEE Trans Circuits Syst Video Technol 23(1):60–73

    Article  Google Scholar 

  5. Humenberger M, Engelke T, Kubinger W (2010) A census-based stereo vision algorithm using modified semi-global matching and plane fitting to improve matching quality. Proceedings of the 2010 I.E. Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW’10), San Francisco, CA, USA, p 77–84

  6. Jin S, Cho J, Pham XD, Lee KM, Park SK, Kim M, Jeon W (2010) FPGA design and implementation of a real-time stereo vision system. IEEE Trans Circuits Syst Video Technol 20(1):15–26

    Article  Google Scholar 

  7. Jin M, Maruyama T (2012) A fast and high quality stereo matching algorithm on FPGA. proceedings of field programmable logic and applications (FPL), 2012 22nd International Conference on, Oslo, Norway, p 507–10

  8. Kalomiros JA, Lygouras J (2011) Design and hardware implementation of a stereo-matching system based on dynamic programming. Microprocess Microsyst 35(5):496–509

    Article  Google Scholar 

  9. Liang CK, Cheng CC, Lai YC, Chen LG (2011) Hardware-efficient belief propagation. IEEE Trans Circuits Syst Video Technol 21(5):525–37

    Article  Google Scholar 

  10. Ma L, Li J, Zhang H (2013) A modified census transform based on the neighborhood information for stereo matching algorithm. Proceedings of Seventh International Conference on Image and Graphics (ICIG), Qingdao, China, p 26–8

  11. McDonnell MJ (1981) Box-filtering techniques. Comput Graphics Image Process 17(1):65–70

    Article  Google Scholar 

  12. Muhlmann K, Maier D, Hesser J, Männer R (2002) Calculating dense disparity maps from color stereo images, an efficient implementation. Int J Comput Vis 47(1):79–88

    Article  MATH  Google Scholar 

  13. Nalpantidis L, Amanatiadis A, Sirakoulis GC, Gasteratos A (2011) Efficient hierarchical matching algorithm for processing uncalibrated stereo vision images and its hardware architecture. IET Image Process 5(5):481–92

    Article  Google Scholar 

  14. Perri S, Colonna D, Zicari P, Corsonello P (2006) SAD-based stereo matching circuit for FPGAs. Proceedings of Electronics, Circuits and Systems, 2006. ICECS ‘06. 13th IEEE International Conference on Nice, France, p 10–3

  15. Tan P, Monasse P (2014) Stereo disparity through cost aggregation with guided filter. Image Process On Line 4:252–75

    Article  Google Scholar 

  16. Ttofis C, Theocharides T (2012) Towards Accurate hardware stereo correspondence: a real-time FPGA Implementation of a segmentation-based adaptive support weight algorithm. Proceedings of the Conference on Design, Automation and Test in Europe, Dresden, Germany, p 703–8

  17. van der Mark W, Gavrila DM (2006) Real-time dense stereo for intelligent vehicles. IEEE Trans Intell Transp Syst 7(1):38–50

    Article  Google Scholar 

  18. Yang R, Pollefeys M, Sifang L (2004) Improved real-time stereo on commodity graphics hardware. Proceedings of the 2004 I.E. Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW’04), Washington, DC, USA, p 36–43

  19. Zabih R, Woodfill J (1994) Non-parametric local transforms for computing visual correspondence. Proceedings of Third European Conference on Computer Vision (ECCV), Stockholm, Sweden, 2, p 151–58

  20. Zhang K, Lu J, Lafruit G (2009) Cross-based local stereo matching using orthogonal integral images. IEEE Trans Circuits Syst Video Technol 19(7):533–8

    Article  Google Scholar 

  21. Zhou L, Sun T, Zhan Y, Wang J (2014) Software and hardware implementations of stereo matching. Int J Sig Proc Image Proc Pattern Recogn 7(4):37–56

    Google Scholar 

Download references

Acknowledgments

This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the C-ITRC (Convergence Information Technology Research Center) (IITP-2015-H8601-15-1002) supervised by the IITP (Institute for Information & communications Technology Promotion).

Author information

Authors and Affiliations

  1. School of Electronics Engineering, Kyungpook National University, Buk-gu, Daegu, 41566, Korea

    Kyeong-ryeol Bae & Byungin Moon

Authors
  1. Kyeong-ryeol Bae
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Byungin Moon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Byungin Moon.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bae, Kr., Moon, B. An accurate and cost-effective stereo matching algorithm and processor for real-time embedded multimedia systems. Multimed Tools Appl 76, 17907–17922 (2017). https://doi.org/10.1007/s11042-016-3248-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3248-y

Keywords

Search

Navigation