Computer Analysis of Images and Patterns

Volume 9256 of the series Lecture Notes in Computer Science pp 14-26


What Is in Front? Multiple-Object Detection and Tracking with Dynamic Occlusion Handling

  • Junli TaoAffiliated withDepartment of Computer Science, The University of Auckland Email author 
  • , Markus EnzweilerAffiliated withImage Understanding, Daimler AG
  • , Uwe FrankeAffiliated withImage Understanding, Daimler AG
  • , David PfeifferAffiliated withImage Understanding, Daimler AG
  • , Reinhard KletteAffiliated withAuckland University of Technology

* Final gross prices may vary according to local VAT.

Get Access


This paper proposes a multiple-object detection and tracking method that explicitly handles dynamic occlusions. A context-based multiple-cue detector is proposed to detect occluded vehicles (occludees). First, we detect and track fully-visible vehicles (occluders). Occludee detection adopts those occluders as priors. Two classifiers for partially-visible vehicles are trained to use appearance cues. Disparity is adopted to further constrain the occludee locations. A detected occludee is then tracked by a Kalman-based tracking-by-detection method. As dynamic occlusions lead to role changes for occluder or occludee, an integrative module is introduced for possibly switching occludee and occluder trackers. The proposed system was tested on overtaking scenarios. It improved an occluder-only tracking system by over 10% regarding the frame-based detection rate, and by over 20% regarding the trajectory detection rate. The occludees are detected and tracked in the proposed method up to 7 seconds before they are picked up by occluder-only method.