Abstract
This work aims to contribute to the reliability and integrity of perceptual systems of unmanned ground vehicles (UGV). A method is proposed to evaluate the quality of sensor data prior to its use in a perception system by utilising a quality metric applied to heterogeneous sensor data such as visual and infrared camera images. The concept is illustrated specifically with sensor data that is evaluated prior to the use of the data in a standard SIFT feature extraction and matching technique. The method is then evaluated using various experimental data sets that were collected from a UGV in challenging environmental conditions, represented by the presence of airborne dust and smoke. In the first series of experiments, a motionless vehicle is observing a ‘reference’ scene, then the method is extended to the case of a moving vehicle by compensating for its motion. This paper shows that it is possible to anticipate degradation of a perception algorithm by evaluating the input data prior to any actual execution of the algorithm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. In: International Journal of Computer Vision (1994)
Brunner, C.J., Peynot, T.: Visual metrics for the evaluation of sensor data quality in outdoor perception. In: Performance Metrics for Intelligent Systems (PerMIS) Workshop (2010)
Brunner, C.J., Peynot, T., Underwood, J.: Towards discrimination of challenging conditions for UGVs with visual and infrared sensors. In: Australasian Conference on Robotics and Automation, ACRA (2009)
International Telecommunication Union (ITU-T). Subjective video quality assessment methods for multimedia applications (1999)
Kelly, et al.: Toward reliable off road autonomous vehicles operating in challenging environments. The International Journal of Robotics Research 25, 449–483 (2006)
Leonard, et al.: A perception driven autonomous urban vehicle. Journal of Field Robotics 25(10), 727–774 (2008)
Lowe, D.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision (2004)
Mackay, D.: Information Theory, Inference & Learning Algorithms. Cambridge University Press (2007)
Narasimhan, S.G., Nayar, S.K.: Shedding light on the weather. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 665–672 (2003)
Nayar, S.K., Narasimhan, S.G.: Vision in bad weather. In: Proceedings of the Seventh International Conference on Computer Vision, vol. 2, pp. 820–827 (1999)
Peynot, T., Scheding, S., Terho, S.: The Marulan Data Sets: Multi-Sensor Perception in Natural Environment with Challenging Conditions. International Journal of Robotics Research 29(13), 1602–1607 (2010)
Peynot, T., Underwood, J., Scheding, S.: Towards reliable perception for unmanned ground vehicles in challenging conditions. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (2009)
Scaramuzza, D., Fraundorfer, F., Siegwart, R.: Real-Time Monocular Visual Odometry for On-Road Vehicles with 1-Point RANSAC. In: IEEE International Conference on Robotics and Automation (2009)
Tan, R.T.: Visibility in bad weather from a single image. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Urmson, et al.: Autonomous driving in urban environments: Boss and the urban challenge. Journal of Field Robotics 25(8), 425–466 (2008)
Vedaldi, A., Fulkerson, B.: VLFeat: An Open and Portable Library of Computer Vision Algorithms (2008), http://www.vlfeat.org/
Wang, Z., Bovik, A.C.: Modern Image Quality Assessment. Morgan & Claypool (2006)
Winkler, S.: Digital Video Quality: Vision Models and Metrics. John Wiley & Sons Ltd, New Dehli (2005)
Wyawahare, M.V., Patil, P.M., Abhyankar, H.K.: Image registration techniques: An overview. International Journal of Signal Processing, Image Processing and Pattern Recognition (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag GmbH Berlin Heidelberg
About this chapter
Cite this chapter
Brunner, C., Peynot, T. (2014). Perception Quality Evaluation with Visual and Infrared Cameras in Challenging Environmental Conditions. In: Khatib, O., Kumar, V., Sukhatme, G. (eds) Experimental Robotics. Springer Tracts in Advanced Robotics, vol 79. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28572-1_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-28572-1_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28571-4
Online ISBN: 978-3-642-28572-1
eBook Packages: EngineeringEngineering (R0)