Abstract
Trajectory computation for forklifts and pedestrians is of relevance for warehousing applications such as pedestrian safety and process optimization. We recorded a novel dataset with a varying range of forklift models and pedestrians, busy with loading or unloading in warehouses. We have videos with frequently occluded trucks in aisles and besides racks, some with busy pedestrian activity, such as in docking areas. Robust target localisation is very essential for seamless tracking results. For localising forklift trucks/pedestrians, we trained a deep-learning based, faster region-based convolution neural network (faster RCNN) on our own recorded data. We used detection from the model output to configure a Kalman filter to estimate the trajectories in the image plane. We also improved the forklift trajectory based on computing pixel saliency maps for the region of interest detected by faster RCNN. Our analysis shows that with robust target detection (fewer false positives and false negatives) from our trained network and Kalman-filter-based state correction, tracking results are close to ground truth.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andriluka, M., Roth, S., Schiele, B.: People tracking by detection and people detection by tracking. In: Proceedings of Computer Vision Pattern Recognition, pp. 1–8 (2008)
Milan, A., Leal-Taix, L., Reid, I., Roth, S., Schindler, K.: MOT16: a benchmark for multi-object tracking. arXiv:1603.00831 (2016)
Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT metrics. J. Image Video Process. 2008, 1 (2008)
Cane, T., Ferryman, J.: Saliency-based detection for maritime object tracking. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition Workshops, pp. 18–25 (2016)
Schulter, S., Vernaza, P., Choi, W., Chandraker, M.: Deep network flow for multi-object tracking. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 2730–2739 (2017)
Han, Z., Ye, Q., Jiao, J.: Online feature evaluation for object tracking using Kalman filter. In: Proceedings of IEEE International Conference on Pattern Recognition, pp. 1–4 (2008)
Luo, W., et al.: Multiple object tracking: a literature review. arXiv:1409.7618 (2014)
Yousefhussien, M.A., Browning, N.A., Kanan, C.: Online tracking using saliency. In: Proceedings of IEEE Applications Computer Vision, pp. 1–10 (2016)
Kuhn, H.W.: The Hungarian method for the assignment problem. Nav. Res. Logist. Q. 2(1–2), 83–97 (1955)
Multi-object tracking benchmark. motchallenge.net
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of Advances Neural Information Processing Systems, pp. 91–99 (2015)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 580–587 (2014)
Zitnick, C.L., Dollar, P.: Edge boxes: locating object proposals from edges. In: Proceedings of European Conference on Computer Vision, pp. 391–405 (2014)
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Advances Neural Information Processing, pp. 545–552 (2007)
Papageorgiou, C., Oren, M., Poggio T.: A general framework for object detection. In: IEEE International Conference on Computer Vision, pp. 555–562 (1998)
Broida, T.J., Chellappa, R.: Estimation of object motion parameters from noisy images. IEEE Trans. Pattern Anal. Mach. Intell. 1(1), 90–99 (1986)
Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)
Girshick, R.: Fast R-CNN. In: Proceedings of International Conference on Computer Vision, pp. 1440–1448 (2015)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Classification with deep convolutional neural networks. In: Proceedings of Advances Neural Information Processing Systems, pp. 1097–1105 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Fouzia, S., Bell, M., Klette, R. (2019). Tracking of Load Handling Forklift Trucks and of Pedestrians in Warehouses. In: Chang, CY., Lin, CC., Lin, HH. (eds) New Trends in Computer Technologies and Applications. ICS 2018. Communications in Computer and Information Science, vol 1013. Springer, Singapore. https://doi.org/10.1007/978-981-13-9190-3_76
Download citation
DOI: https://doi.org/10.1007/978-981-13-9190-3_76
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9189-7
Online ISBN: 978-981-13-9190-3
eBook Packages: Computer ScienceComputer Science (R0)