Skip to main content

Multiple-Sensor Based Multiple-Object Tracking

  • Chapter
Autonomous Intelligent Vehicles

Part of the book series: Advances in Computer Vision and Pattern Recognition ((ACVPR))

  • 3444 Accesses

Abstract

Radar/Lidar and vision sensors have complementary properties. In this chapter, we consider multi-sensor multi-object detection and tracking systems to improve overall system performance. We formulate the probability framework of tracking and system model based on EKF using a single sensor. For multi-sensor data, data association is the first of all steps after receiving new data, aiming at judging the corresponding relation between the current observation and the previous track. We classify the data association into observation-to-observation and observation-to-track. Then we use Global Nearest Neighbor (GNN) algorithm to associate the observation with another observation or a track. For multi-sensor fusion, we map the lidar coordinates and radar coordinates into the vehicle coordinates to solve the position alignment and synchronize time between them by using the prediction equation of EKF. In comparison with other similar systems, our framework is more concise and efficient.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alefs, B., Schreiber, D., Clabian, M.: Hypothesis based vehicle detection for increased simplicity in multi-sensor ACC. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 261–266 (2005)

    Google Scholar 

  2. Baehring, D., Simon, S., Niehsen, W., Stiller, C.: Detection of close cut-in and overtaking vehicles for driver assistance based on planar parallax. In: Proc. of the IEEE Intelligent Vehicles Symposium (2005)

    Google Scholar 

  3. Bar-Shalom, Y., Li, X., Kirubarajan, T., Wiley, J.: Estimation with Applications to Tracking and Navigation. Wiley, New York (2001)

    Book  Google Scholar 

  4. Cheng, H., Zheng, N., Sun, C., van de Wetering, H.: Vanishing point and Gabor feature based multi-resolution on-road vehicle detection. In: International Symposium on Neural Networks, pp. 46–51 (2006)

    Google Scholar 

  5. Escamilla-Ambrosio, P., Lieven, N.: A multiple-sensor multiple-target tracking approach for the autotaxi system. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 601–606 (2004)

    Google Scholar 

  6. Fang, Y., Masaki, I., Horn, B.: Depth-Based Target Segmentation for Intelligent Vehicles: Fusion of Radar and Binocular Stereo (2002)

    Google Scholar 

  7. Gern, A., Franke, U., Levi, P.: Advanced lane recognition-fusing vision and radar. In: Proc. of the IEEE Intelligent Vehicles Symposium (2000)

    Google Scholar 

  8. Hofmann, U., Rieder, A., Dickmanns, E.: EMS-vision: application to hybrid adaptive cruise control. In: Proc. of the IEEE Intelligent Vehicles Symposium (2000)

    Google Scholar 

  9. Kaempchen, N., Buehler, M., Dietmayer, K.: Feature-level fusion for free-form object tracking using laserscanner and video. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 453–458 (2005)

    Google Scholar 

  10. Kawasaki, N., Kiencke, U.: Standard platform for sensor fusion on advanced driver assistance system using Bayesian network. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 250–255 (2004)

    Google Scholar 

  11. Kolodko, J., Vlacic, L.: Fusion of range and vision for real-time motion estimation. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 256–261 (2004)

    Google Scholar 

  12. Li, Q., Zheng, N., Cheng, H.: Springrobot: A prototype autonomous vehicle and its algorithms for lane detection. IEEE Trans. Intell. Transp. Syst. 5(4), 300–308 (2004)

    Article  Google Scholar 

  13. Mendes, A., Bento, L., Nunes, U.: Multi-target detection and tracking with a laser scanner. In: IEEE International Intelligent Vehicle Symposium, pp. 796–801 (2004)

    Google Scholar 

  14. Mobus, R., Kolbe, U.: Multi-target multi-object tracking, sensor fusion of radar and infrared. In: Proc. of the IEEE Intelligent Vehicles Symposium, pp. 732–737 (2004)

    Google Scholar 

  15. Qin, J.: Study on obstacle detection and tracking based on multi-sensor fusion. Relax Master Thesis, Xi’an Jiaotong University, Xi’an, China (2005)

    Google Scholar 

  16. Ruder, M., Enkelmann, W., Garnitz, R.: Highway lane change assistant. In: IEEE Intelligent Vehicle Symposium (2002)

    Google Scholar 

  17. Shimomura, N., Fujimoto, K., Oki, T., Muro, H.: An algorithm for distinguishing the types of objects on the road using laser radar and vision. IEEE Trans. Intell. Transp. Syst. 3(3), 189–195 (2002)

    Article  Google Scholar 

  18. Srinivasa, N., Chen, Y., Daniell, C.: A fusion system for real-time forward collision warning in automobiles. Proc. IEEE Intell. Trans. Syst. Conf. 1, 457–462 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hong Cheng .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Cheng, H. (2011). Multiple-Sensor Based Multiple-Object Tracking. In: Autonomous Intelligent Vehicles. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-2280-7_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2280-7_6

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2279-1

  • Online ISBN: 978-1-4471-2280-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics