Skip to main content

Image Features Extraction, Selection and Fusion for Computer Vision

  • Chapter
  • First Online:
Image Feature Detectors and Descriptors

Part of the book series: Studies in Computational Intelligence ((SCI,volume 630))

Abstract

This chapter addresses many problems: different types of sensors, systems and methods from the literature are briefly revised, in order to give a recipe for designing intelligent vehicle systems based on computer vision. Many computer vision or related problems are addressed, like segmentation, features extraction and selection, fusion and classification. Existing solutions are investigated and three different data-bases are presented to perform typical experiments. Features extraction is aimed for finding pertinent features to encode information about possible obstacles from the road. Feature selection schemes are further used to compact the feature vector in order to decrease the computational time. Finally, several approaches to fuse visible and infrared images are used to increase the accuracy of the monomodal systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Who is NAO? https://www.aldebaran.com/en/humanoid-robot/nao-robot. Accessed 30 Aug 2015

  2. Asimo of Honda, http://asimo.honda.com/. Accessed 30 Aug 2015

  3. Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. J. Comput. Netw., Elsevier 54(15), 2787–2805 (2010)

    Article  MATH  Google Scholar 

  4. daCosta, F.: Rethinking the Internet of Things. Apress, A Scalable Approach to Connecting Everything (2014). ISBN 13: 978-1-4302-5740-0, 192 Pages

    Google Scholar 

  5. Evans, P.C., Annunziata, M.: Industrial internet: pushing the boundaries of minds and machines, General Electric. http://www.ge.com/docs/chapters/IndustrialInternet.pdf (2012). Accessed 30 Aug 2015

  6. General Electric and Accenture, Industrial Internet insights report (2014). Accessed 30 Aug 2015

    Google Scholar 

  7. Bertozzi, M., Broggi, A., Cellario, M., Fascioli, A., Lombardi, P., Porta, M.: Artificial Vision in Road Vehicles, vol. 90, pp. 1258–1271. IEEE Proc. (2002)

    Google Scholar 

  8. Li, L., Song, J., Wang, F.Y., Niehsen, W., Zheng, N.N.: New developments and research trends for intelligent vehicles. IEEE Intell. Syst. 4, 10–14 (2005)

    Article  Google Scholar 

  9. Bu, F., Chan, C.Y.: Pedestrian detection in transit bus application-sensing technologies and safety solutions. IEEE Intell. Veh. Symp. 100–105 (2005)

    Google Scholar 

  10. Chan, C.Y., Bu, F.: Literature review of pedestrian detection technologies and sensor survey. Tech. rept. California PATH Institute of Transportation Studies, Berkeley, CA. Midterm report (2005)

    Google Scholar 

  11. Cutler, R., Davis, L.S.: Robust Real-Time Periodic Motion Detection, Analysis, and Applications, vol. 22, pp. 781–796, PAMI (2000)

    Google Scholar 

  12. Enzweiler, M., Gavrila, D.M.: Monocular Pedestrian Detection: Survey and Experiments, vol. 31, p. 2179–2195. IEEE TPAMI (2009)

    Google Scholar 

  13. Gandhi, T., Trivedi, M.M.: Pedestrian collision avoidance systems: a survey of computer vision based recent studies. In: IEEE Conference on Intelligent Transportation Systems, pp. 976–981 (2006)

    Google Scholar 

  14. Scheunert, U., Cramer, H., Fardi, B., Wanielik, G.: Multi sensor based tracking of pedestrians: a survey of suitable movement models. In: IEEE International Symposium on Intelligent Vehicles, pp. 774–778 (2004)

    Google Scholar 

  15. Sun, Z., Bebis, G., Miller, R.: On-road Vehicle Detection: A Review, vol. 28, pp. 694–711. IEEE TPAMI (2006)

    Google Scholar 

  16. McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Trans. Intell. Transp. Syst. 7(1), 20–37 (2006)

    Article  Google Scholar 

  17. Bishop, R.: A survey of intelligent vehicle applications worldwide. In: Intelligent Vehicles Symposium (2000)

    Google Scholar 

  18. Baldwin, K.C., Duncan, D.D., West, S.K.: Johns Hopkins APL technical digest. 25th ed. Johns Hopkins University Applied Physics Laboratory. The driver monitor system: a means of assessing driver performance, pp. 1–10 (2004)

    Google Scholar 

  19. Dong, Y., Zhencheng, H., Uchimura, K., Murayama, N.: Driver inattention monitoring system for intelligent vehicles: a review. IEEE Trans. Intell. Transp. Syst. 12(2), 596–614 (2011)

    Article  Google Scholar 

  20. DARPA Grand Challenge, Urban Challenge. http://archive.darpa.mil/grandchallenge/index.asp (2007)

  21. Broggi, A., Medici, P., Zani, P., Coati, A., Panciroli, M.: Autonomous vehicles control in the VisLab intercontinental autonomous challenge. Annu. Rev. Control 36, 161–171 (2012)

    Article  Google Scholar 

  22. A VisLab prototype, www.braive.vislab.it/

  23. Guizzo, E.: How google self-driving car works, IEEE spectrum online. http://spectrum.ieee.org/automaton/robotics/artificial-intelligence/how-google-self-driving-car-works (2011)

  24. Honda. http://world.honda.com/HDTV/IntelligentNightVision/200408/

  25. FLIR Application Story, BMW incorporates thermal imaging cameras in its cars. www.flir.com/uploadedFiles/ApplicationStory_BMW.pdf (2009)

  26. Discant, A., Rogozan, A., Rusu, C., Bensrhair, A.: Sensors for obstacledetection—a survey. In: 30th International Spring Seminar on Electronics Technology. Cluj-Napoca, Romania (2007)

    Google Scholar 

  27. Apatean, A., Rogozan, A., Bensrhair, A.: Visible-infrared fusion schemes for road obstacle classification. J. Transp. Res. Part C: Emerg. Technol. 35, 180–192 (2013)

    Article  Google Scholar 

  28. Toulminet, G., et al.: Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis. IEEE Trans. Image Process. 15(8), 2364–2375 (2006)

    Article  Google Scholar 

  29. Miron, A., Besbes, B., Rogozan, A., Ainouz, S., Bensrhair, A.: Intensity self similarity features for pedestrian detection in far-infrared images. In: IEEE Intelligent Vehicles Symposium (IV), pp. 1120–1125 (2012)

    Google Scholar 

  30. Emerich, S., Lupu, E., Rusu, C.: A new set of features for a bimodal system based on on-line signature and speech. Digit. Signal Process. Arch. 23(3), 928–940 (2013)

    Article  MathSciNet  Google Scholar 

  31. Zhang, W.L., Liu, L.B., Yin, S.Y., Zhou, R.Y., Cai, S.S., Wei, S.J.: An efficient VLSI architecture of speeded-up robust feature extraction for high resolution and high frame rate video. Sci. China Inf. Sci. 56(7), 1–14 (2013)

    MathSciNet  Google Scholar 

  32. Enzweiler, M., Kanter, P., Gavrila, D.M.: Monocular pedestrian recognition using motion parallax. In: IEEE Intelligent Vehicles Symposium, pp. 792–797 (2008)

    Google Scholar 

  33. Poppe, R.: Vision-based human motion analysis: an overview. Comput. Vis. Image Underst. 108, 4–18 (2007)

    Article  Google Scholar 

  34. Keller, C., Enzweiler, M., Gavrila, D.M.: A new benchmark for stereo-based pedestrian detection. In: IEEE Intelligent Vehicles Symposium (2011)

    Google Scholar 

  35. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  36. Dalal, N., Triggs, B., Schmid, C.: Human detection using oriented histograms of flow and appearance. In: European Conference Computer Vision, pp. 428–441 (2006)

    Google Scholar 

  37. Gavrila, D.M.: A Bayesian, exemplar-based approach to hierarchical shape matching. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1408–1421 (2007)

    Article  Google Scholar 

  38. Broggi, A., Cerri, P., Antonello, P.C.: Multi-resolution vehicle detection using artificial vision. In: IEEE Intelligent Vehicles Symposium, pp. 310–314 (2004)

    Google Scholar 

  39. Mikolajczyk, K., Schmid, C., Zisserman, A.: Human detection based on a probabilistic assembly of robust part detectors. In: European Conference on Computer Vision, pp. 69–81 (2004)

    Google Scholar 

  40. Wu, B., Nevatia, R.: Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors. Int. J. Comput. Vis. 75(2), 247–266 (2007)

    Article  Google Scholar 

  41. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 1–110 (2004)

    Article  Google Scholar 

  42. Besbes, B., Rogozan, A., Bensrhair, A.: Pedestrian recognition based on hierarchical codebook of SURF features in visible and infrared images. In: IEEE Intelligent Vehicles Symposium, pp. 156–161 (2010)

    Google Scholar 

  43. Viola, P., Jones, M., Snow, D.: Detecting pedestrians using patterns of motion and appearance. Int. J. Comput. Vis. 63(2), 153–161 (2005)

    Article  Google Scholar 

  44. Gavrila, D.M., Munder, S.: Multi-cue pedestrian detection and tracking from a moving vehicle. Int. J. Comput. Vis. 73(1), 41–59 (2007)

    Article  Google Scholar 

  45. Wojek, C., Schiele, B.: A performance evaluation of single and multi-feature people detection. In: Proceedings of the 30th DAGM Symposium on Pattern Recognition, pp. 82–91. Springer,Berlin (2008)

    Google Scholar 

  46. Geronimo, D., Lopez, A.M., Sappa, A.D., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans. Pattern Anal. Mach. Intell. 32(7), 1239–1258 (2010)

    Article  Google Scholar 

  47. Dollar, P., Wojek, C., Schiele, B., Perona, P.: Pedestrian detection: an evaluation of the state of the art. IEEE TPAMI 34(4), 743–761 (2012)

    Article  Google Scholar 

  48. Miron, A., Rogozan, A., Ainouz, S., Bensrhair, A., Broggi, A.: An evaluation of the pedestrian classification in a multi-domain multi-modality setup. Sensors 15(6), 13851–13873 (2015)

    Article  Google Scholar 

  49. Krotosky, S.J., Trivedi, M.M.: On color-, infrared-, and multimodal stereo approaches to pedestrian detection. IEEE Trans. Intell. Transp. Syst. 8(4), 619–629 (2007)

    Article  Google Scholar 

  50. Bertozzi, M., et al.: Lowlevel pedestrian detection by means of visible and far infra-red tetravision. In: IEEE Intelligent Vehicles Symposium, pp. 231–236 (2006)

    Google Scholar 

  51. Bertozzi, M., et al.: Multi stereo-based pedestrian detection by daylight and far-infrared camera. In: Hammoud, R., Augmented Vision Perception in Infrared: Algorithms and Applied Systems. Springer Inc., pp. 371–401 (Ch16) (2009)

    Google Scholar 

  52. Apatean, A., Emerich, S., Lupu, E., Rogozan, A., Bensrhair, A.: Ruttier obstacle classification by use of fractional B-spline wavelets and moments. In: IEEE Region 8 Conference Computer as a Tool (2007)

    Google Scholar 

  53. Sun, Z., Bebis, G., Miller, R.: Monocular precrash vehicle detection: features and classifiers. IEEE Trans. Image Process. 15, 2019–2034 (2006)

    Google Scholar 

  54. Florea, F.: Annotation automatique dmages mdicales en utilisant leur contenu visuel et les rgions textuelles associates. Application dans le contexte dn catalogue de sant en ligne. Ph.D. thesis, Institut National Des Sciences Appliques, INSA de Rouen, France and Technical University of Bucharest, Romania (2007)

    Google Scholar 

  55. Apatean, A., Rogozan, A., Bensrhair, A.: Objects recognition in visible and infrared images from the road scene. In: IEEE International Conference on Automation, Quality and Testing, Robotics, vol. 3, pp. 327–332 (2008)

    Google Scholar 

  56. Apatean, A., Emerich, S.: Obstacle recognition by the use of different wavelet families in visible and infrared images. Carpathian J. Electron. Comput. Eng. 1(1) (2008)

    Google Scholar 

  57. Apatean, A., Rogozan, A., Emerich, S., Bensrhair, A.: Wavelets as features for objects recognition. Acta Tehnica Napocensis -Electronics and Telecommunications, vol. 49, pp. 23–26 (2008)

    Google Scholar 

  58. Apatean, A., Emerich, S., Lupu, E., Rogozan, A., Bensrhair, A.: Wavelets and moments for obstacle classification. In: International Symposium on Communications, Control and Signal Processing, Malta, pp. 882–887 (2008)

    Google Scholar 

  59. http://www.csie.ntu.edu.tw/cjlin/libsvm/

  60. http://www.cs.waikato.ac.nz/ml/weka/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anca Apatean .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Apatean, A., Rogozan, A., Bensrhair, A. (2016). Image Features Extraction, Selection and Fusion for Computer Vision. In: Awad, A., Hassaballah, M. (eds) Image Feature Detectors and Descriptors . Studies in Computational Intelligence, vol 630. Springer, Cham. https://doi.org/10.1007/978-3-319-28854-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28854-3_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28852-9

  • Online ISBN: 978-3-319-28854-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics