Abstract
In this paper we present different approaches of 3D stereo matching for bio-inspired image sensors. In contrast to conventional digital cameras, this image sensor, called Silicon Retina, delivers asynchronous events instead of synchronous intensity or color images. The events represent either an increase (on-event) or a decrease (off-event) of a pixel’s intensity. The sensor can provide events with a time resolution of up to 1ms and it operates in a dynamic range of up to 120dB. In this work we use two silicon retina cameras as a stereo sensor setup for 3D reconstruction of the observed scene, as already known from conventional cameras. The polarity, the timestamp, and a history of the events are used for stereo matching. Due to the different information content and data type of the events, in comparison to conventional pixels, standard stereo matching approaches cannot directly be used. Thus, we developed an area-based, an event-image-based, and a time-based approach and evaluated the results achieving promising results for stereo matching based on events.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Belbachir, A.: Smart Cameras. Springer, Heidelberg (2010)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 7–42 (2002)
Brown, M.Z., Burschka, D., Hager, G.D.: Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 993–1008 (2003)
Banks, J., Bennamoun, M., Corke, P.: Non-parametric techniques for fast and robust stereo matching. In: Proceedings of the IEEE Region 10th Annual Conference on Speech and Image Technologies for Computing and Telecommunications, Brisbane/Australia, pp. 365–368 (1997)
Shi, J., Tomasi, C.: Good features to track. In: Proceedings of the IEEE Computer Vision and Pattern Recognition Conference, Seattle/USA, pp. 593–600 (1994)
Tang, B., AitBoudaoud, D., Matuszewski, B., Shark, L.: An efficient feature based matching algorithm for stereo images. In: Proceedings of the IEEE Geometric Modeling and Imaging Conference, London/UK, pp. 195–202 (2006)
Schraml, S., Schön, P., Milosevic, N.: Smartcam for real-time stereo vision - address-event based embedded system. In: Ranchordas, A., Araújo, H., Vitrià, J. (eds.) VISAPP 2007 - Proceedings of the Second International Conference on Computer Vision Theory and Applications, Barcelona/Spain, vol. 2, pp. 466–471 (2007)
Kogler, J., Sulzbachner, C., Humenberger, M., Eibensteiner, F.: Address-event based stereo vision with bio-inspired silicon retina imagers. In: Bhatti, A. (ed.) Advances in Theory and Applications of Stereo Vision, InTech Open Books (2011)
Mead, C., Mahowald, M.: A silicon model of early visual processing. Neural Networks Journal 1, 91–97 (1988)
Mahowald, M., Mead, C.: Silicon retina. Analog VLSI and Neural Systems, 257–278 (1989)
Sivilotti, M.: Wiring consideration in analog vlsi systems with application to field programmable networks. Phd-thesis, California Institute of Technology (1991)
Mahowald, M.: VLSI analogs of neuronal visual processing: a synthesis of form and function. Phd-thesis, California Institute of Technology (1992)
Lichtsteiner, P., Posch, C., Delbruck, T.: A 128x128 120db 30mw asynchronous vision sensor that responds to relative intensity change. In: Proceedings of the IEEE International Solid-State Circuits Conference, SanFrancisco/USA (2006)
Lichtsteiner, P., Posch, C., Delbruck, T.: A 128x128 120 db 15 μs latency asynchronous temporal constrast vision sensor. IEEE journal of solid-state circuits 43 (2008)
Posch, C., Matolin, D., Wohlgenannt, R.: A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS. IEEE Journal of Solid-State Circuits 46, 259–275 (2011)
Zhang, Z.: A flexible new technique for camera calibration. Technical Report MSRTR9-71, Microsoft Research (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kogler, J., Humenberger, M., Sulzbachner, C. (2011). Event-Based Stereo Matching Approaches for Frameless Address Event Stereo Data. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2011. Lecture Notes in Computer Science, vol 6938. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24028-7_62
Download citation
DOI: https://doi.org/10.1007/978-3-642-24028-7_62
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24027-0
Online ISBN: 978-3-642-24028-7
eBook Packages: Computer ScienceComputer Science (R0)