Skip to main content
SpringerLink
Log in

A simplified rectification method and its hardware architecture for embedded multimedia systems

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Stereo vision, a future disruptive technology for obtaining three-dimensional distance information, can be applied to various embedded multimedia systems. Reducing the computational overhead of stereo vision necessitates the pre-processing procedure of rectification. For the implementation of rectification, several studies have proposed a look-up table- and computational logic-based approaches. However, the former exhibits excessive growth of memory with an increasing resolution of the image, and the latter requires numerous hardware resources for implementing the necessary computational logic. Thus, this paper proposes a simplified rectification calculation method and its optimized hardware architecture. By replacing matrix multiplications of the conventional method with simple accumulations and removing division operations, the proposed method reduces addition, multiplication, and division operations by 50, 100, and 100 %, respectively, compared with the conventional method. Although the experimental results show negligible differences between rectification by the conventional method and that by the proposed method, the latter consumes fewer hardware resources. Therefore, the proposed method and its architecture are more practical for real-time embedded multimedia systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Akin A, Baz I, Gaemperle LM, Schmid A, Leblebici Y (2013) Compressed look-up-table based real-time rectification hardware. Proceedings of 2013 IFIP/IEEE 21st International Conference on Very Large Scale Integration (VLSI-SoC 2013), Istanbul, Turkey Oct. 2013;272–277

  2. Bajd T, Mihelj M, Munih M (2013) Introduction to robotics, 1st edn. Springer, The Netherlands

  3. Bensrhair A, Bertozzi M, Broggi A, Fascioli A, Mousset S, Toulminet G (2002) Stereo vision-based feature extraction for vehicle detection. Proceedings of IEEE Intelligent Vehicle Symposium (IV 2002), Versailles, France Jun. 2002;2:465–470

  4. boofCV, Stereo camera example, http://boofcv.org

  5. Caltech, Stereo camera example, http://www.vision.caltech.edu/bouguetj/calib_doc

  6. Chilian A, Hirschmuller H (2009) Stereo camera based navigation of mobile robots on rough terrain. Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009), Saint Louis, MO, USA Oct. 2009; 4571–4576

  7. Franke U, Kutzbach I (1996) Fast stereo based object detection for stop&go traffic. Proceedings of the 1996 I.E. Intelligent Vehicles Symposium, Tokyo, Japan Sep. 1996;339–344

  8. Fusiello A, Trucco E, Verri A (1997) Rectification with unconstrained stereo geometry. Proceedings of the British Machine Vision Conference 1997 (BMVC 1997), Colchester, Essex, UK Sept. 1997;400–409

  9. Fusiello A, Trucco E, Verri A (2000) A compact algorithm for rectification of stereo pairs. Mach Vis Appl 12(1):16–22

    Article  Google Scholar 

  10. Gluckman J, Nayar SK (2002) Rectified catadioptric stereo sensors. IEEE Trans Pattern Anal Mach Intell 24(2):224–236

    Article  Google Scholar 

  11. Gong M, Yang R, Wang L, Gong M (2007) A performance study on different cost aggregation approaches used in real-time stereo matching. Int J Comput Vis 75(2):283–296

    Article  Google Scholar 

  12. Gonzalez RC, Woods RE (2007) Digital image processing, 3rd edn. Prentice Hall, Upper Saddle River, New Jersey

  13. Han SK, Woo SH, Jeong MH, You BJ (2009) Improved-quality real-time stereo vision processor. Proceedings of the 22nd International Conference on VLSI Design, New Delhi, India Jan. 2009;287–292

  14. Hirschmuller H (2008) Stereo processing by semiglobal matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30(2):328–341

    Article  Google Scholar 

  15. Huh K, Park J, Hwang J, Hong D (2008) A stereo vision-based obstacle detection system in vehicles. Opt Laser Eng 46(2):168–178

    Article  Google Scholar 

  16. Hyun J, Moon B (2015) A simplified rectification method for efficient hardware implementation. Proceedings of the International Workshop on Advanced Computing and Multimedia Technology (ACMT 2015), Guam, USA Oct. 2015;20–28

  17. Jawed K, Morris J, Khan T, Gimel’farb G (2009) Real time rectification for stereo correspondence, Proceedings of 12th IEEE International Conference on Computational Science and Engineering (CSE 2009), Vancouver, Canada Aug. 2009;2:277–284

  18. Jin S, Cho J, Pham XD, Lee KM, Park SK, Kim M, Jeon JW (2010) FPGA design and implementation of a real-time stereo vision system. IEEE Trans Circuits Syst Video Technol 20(1):15–26

    Article  Google Scholar 

  19. Kaempchen N, Franke U, Ott R (2002) Stereo vision based pose estimation of parking lots using 3D vehicle models. Proceedings of IEEE Intelligent Vehicle Symposium (IV 2002), Versailles, France Jun. 2002;2:459–464

  20. Loop C, Zhang Z (1999) Computing rectifying homographies for stereo vision. Proceedings of 1999 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA Jun. 1999;1:125–131

  21. Sabe K, Fukuchi M, Gutmann JS, Ohashi T, Kawamoto K, Yoshigahara T (2004) Obstacle avoidance and path planning for humanoid robots using stereo vision. Proceedings of the 2004 I.E. International Conference on Robotics and Automation (ICRA 2004), New Orleans, LA, USA Apr. 2004;1:592–597

  22. Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47(1–3):7–42

    Article  MATH  Google Scholar 

  23. Vancea C, Nedevschi S (2007) LUT-based image rectification module implemented in FPGA. Proceedings of IEEE 3rd International Conference on Intelligent Computer Communication and Processing (ICCP 2007), Cluj-Napoca, Romania Sept. 2007;147–154

  24. Zhang Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece Sept. 1999;1:666–673

  25. Zicari P (2013) Efficient and high performance FPGA-based rectification architecture for stereo vision. Microprocess Microsyst 37(8):1144–1154

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) (IITP-2016-H8601-16-1002) supervised by the IITP (Institute for Information & communications Technology Promotion).

Author information

Authors and Affiliations

  1. School of Electronics Engineering, Kyungpook National University, Daegu, South Korea

    Jongkil Hyun & Byungin Moon

Authors
  1. Jongkil Hyun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Byungin Moon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Byungin Moon.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hyun, J., Moon, B. A simplified rectification method and its hardware architecture for embedded multimedia systems. Multimed Tools Appl 76, 19761–19779 (2017). https://doi.org/10.1007/s11042-016-3517-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3517-9

Keywords

Search

Navigation