Abstract
Free-space detection is a primary task for car navigation. Unfortunately, classical approaches have difficulties in adverse weather conditions, in particular in daytime fog. In this paper, a solution is proposed thanks to a contrast restoration approach on images grabbed by an in-vehicle camera. The proposed method improves the state-of-the-art in several ways. First, the segmentation of the fog region of interest is better segmented thanks to the computation of the shortest routes maps. Second, the fog density as well as the position of the horizon line is jointly computed. Then, the method restores the contrast of the road by only assuming that the road is flat and, at the same time, detects the vertical objects. Finally, a segmentation of the connected component in front of the vehicle gives the free-space area. An experimental validation was carried out to foresee the effectiveness of the method. Different results are shown on sample images extracted from video sequences acquired from an in-vehicle camera. The proposed method is complementary to existing free-space area detection methods relying on color segmentation and stereovision.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Crisman, J., Thorpe, C.: Unscarf: A color vision system for the detection of unstructured roads. In: IEEE International Conference on Robotics and Automation, Sacramento, USA, pp. 2496–2501 (1991)
Zhang, J., Nagel, H.: Texture-based segmentation of road images. In: IEEE Intelligent Vehicles Symposium, pp. 260–265 (1994)
Broggi, A., Caraffi, C., Fedriga, R., Grisleri P.: Obstacle detection with stereo vision for off-road vehicle navigation. In: IEEE Workshop on Machine Vision for Intelligent Vehicles, San Diego, USA, pp. 65–73 (2005)
Soquet, N., Aubert, D., Hautière, N.: Road segmentation supervised by an extended v-disparity algorithm for autonomous navigation. In: IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, pp. 160–165 (2007)
Oakley, J.P., Satherley, B.L.: Improving image quality in poor visibility conditions using a physical model for contrast degradation. In: IEEE Transactions on Image Processing, vol. 7, pp. 167–179 (1998)
Yitzhaky Y., Dror I., Kopeika N.: Restoration of altmospherically blurred images according to weather-predicted atmospheric modulation transfer function. Optic. Eng. 36, 3064–3072 (1997)
Narasimhan S.G., Nayar S.K.: Contrast restoration of weather degraded images. IEEE Trans. Pattern Anal. Mach. Intell. 25(6), 713–724 (2003)
Schechner Y., Narasimhan S., Nayar S.: Polarization-based vision through haze. Appl. Optic. Special issue 42(3), 511–525 (2003)
Narashiman, S.G., Nayar, S.K.: Interactive deweathering of an image using physical model. In: IEEE Workshop on Color and Photometric Methods in Computer Vision (2003)
Hautière, N., Tarel, J.-P., Aubert, D.: Towards fog-free in-vehicle vision systems through contrast restoration. In: IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, Minnesota, USA, pp. 1–8 (2007)
Tan, R.T.: Visibility in bad weather from a single image. In: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, pp. 1–8 (2008)
Fattal R.: Single image dehazing. ACM Trans. Graph. 27(3), 1–9 (2008)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, Florida, USA, pp. 1956–1963 (2009)
Tarel, J.-P., Hautière, N.: Fast visibility restoration from a single color or gray level image. In: IEEE International Conference on Computer Vision, Kyoto, Japan, pp. 2201–2208 (2009)
Hautière N., Tarel J.-P., Aubert D.: Mitigation of visibility loss for advanced camera based driver assistances. IEEE Trans. Intell. Transport. Syst. 11(2), 474–484 (2010)
Tarel, J.-P., Hautière, N., Cord, A., Gruyer, D., Halmaoui, H.: Improved visibility of road scene images under heterogeneous fog. In: IEEE Intelligent Vehicles Symposium, San Diego, Californie, USA, pp. 478–485 (2010)
Middleton W.: Vision through the atmosphere. University of Toronto Press, Toronto (1952)
Commission Internationale de l’Éclairage.: International lighting vocabulary, no. 17.4 (1987)
Hautière N., Tarel J.-P., Lavenant J., Aubert D.: Automatic fog detection and estimation of visibility distance through use of an onboard camera. Mach. Vis. Appl. J. 17(1), 8–20 (2006)
Lavenant, J., Tarel, J., Aubert, D.: Procédé de détermination de la distance de visibilité et procédé de détermination de la présence d’un brouillard, French Pattent 0201822, LCPC/INRETS (2002)
Hiramatsu T., Ogawa T., Haseyama M.: A kalman filter-based method for restoration of images obtained by an in-vehicle camera in foggy conditions. IEICE Trans. Fundamentals Electron. Commun. Comput. Sci. E92.A(2), 577–584 (2009)
Tarel, J.-P., Aubert, D., Guichard, F.: Tracking occluded lane-markings for lateral vehicle guidance. In: Recent Advances in Signal Processing and Communications, World Scientific and Engineering Society Press, Japan, pp. 154–159 (1999)
Kong, H., Audibert, J.-Y., Ponce, J.: Vanishing point detection for road detection. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, Florida, USA, pp. 96–103 (2009)
Dijkstra E.W.: A note on two problems in connection with graphs. Numerische Math. 1, 269–271 (1959)
Hart P.E., Nilsson N.J., Raphael B.: A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybernet 4(2), 100–107 (1968)
Ikonen L., Toivanen P.: Shortest routes between sets on gray-level surfaces. Pattern Recogn. Imag. Anal. 15(1), 195–198 (2005)
Crisiminisi, A., Sharp, T., Blake, A.: GeOS: Geodesic image segmentation. In: European Conference on Computer Vision, Marseille, France (2008)
Brémond R., Jeulin D., Gateau P., Jarrin J., Serpe G.: Estimation of the transport properties of polymer composites by geodesic propagation. J. Microsc. 176(2), 167–177 (1994)
Hautière, N., Aubert, D.: Contrast restoration of foggy images through use of an onboard camera. In: IEEE Conference on Intelligent Transportation Systems, Vienna, Austria, pp. 1090–1095 (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hautière, N., Tarel, JP., Halmaoui, H. et al. Enhanced fog detection and free-space segmentation for car navigation. Machine Vision and Applications 25, 667–679 (2014). https://doi.org/10.1007/s00138-011-0383-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-011-0383-3