Skip to main content
SpringerLink
Log in

A Consistent Union-for-Fusion Approach to Multi-Robot Simultaneous Localization and Target Tracking

  • Short Paper
  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

This paper provides a fully decentralized approach for multi-robot simultaneous localization and target tracking based on extended Kalman filter and covariance union (CU), referred to as (EDMR-SLTT). In the proposed approach, each robot maintains the latest estimate of itself and targets, and information exchange only takes place between two robots when they obtain relative measurements of each other. Moreover, we have proved that when CU is used to fuse the target state estimate with the target state estimated by teammate robots, the positive definiteness of the robot and target joint covariance matrix is guaranteed without any calculation of the robot-to-target correlation terms. Finally, simulation and experimental results have shown that the EDMR-SLTT approach is superior to alternative state-of-the-art approaches with comparable processing and communication costs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability

All data and custom code support this study are available from the corresponding author, Shudong Sun, upon reasonable request.

References

  1. Alonso-Mora, J., Baker, S., Rus, D.: Multi-robot formation control and object transport in dynamic environments via constrained optimization. Int. J. Robot. Res. 36(9), 1000–1021 (2017)

    Article  Google Scholar 

  2. Capitan, J., Merino, L., Ollero, A.: Cooperative decision-making under uncertainties for multi-target surveillance with multiples uavs. J. Intell. Robot. Syst. 84(1), 371–386 (2016)

    Article  Google Scholar 

  3. Liu, Y., Nejat, G.: Robotic urban search and rescue: a survey from the control perspective. J. Intell. Robot. Syst. 72(2), 147–165 (2013)

    Article  Google Scholar 

  4. Abbasi, A., MahmoudZadeh, S., Yazdani, A.: A cooperative dynamic task assignment framework for cotsbot auvs. IEEE Transactions on Automation Science and Engineering (2020)

  5. Wang, X., Sun, S., Li, T., Liu, Y.: Fault tolerant multi-robot cooperative localization based on covariance union. IEEE Robot. Autom. Lett. 6(4), 7799–7806 (2021)

    Article  Google Scholar 

  6. Pires, A.G., Rezeck, P.A., Chaves, R.A., Macharet, D.G., Chaimowicz, L.: Cooperative localization and mapping with robotic swarms. J. Intell. Robot. Syst. 102(2), 1–23 (2021)

    Article  Google Scholar 

  7. Huang, G., Kaess, M., Leonard, J.J.: Consistent unscented incremental smoothing for multi-robot cooperative target tracking. Rob Auton Syst 69, 52–67 (2015)

    Article  Google Scholar 

  8. Chang, C.-H., Wang, S.-C., Wang, C.-C.: Exploiting moving objects: multi-robot simultaneous localization and tracking. IEEE Trans. Autom. Sci. Eng. 13(2), 810–827 (2015)

    Article  Google Scholar 

  9. Mirzaei, F.M., Mourikis, A.I., Roumeliotis, S.I.: On the performance of multi-robot target tracking. In: Proceedings 2007 IEEE International Conference on Robotics and Automation, pp 3482–3489. IEEE (2007)

  10. Ahmad, A., Tipaldi, G.D., Lima, P., Burgard, W.: Cooperative robot localization and target tracking based on least squares minimization. In: 2013 IEEE International Conference on Robotics and Automation, pp 5696–5701. IEEE (2013)

  11. Ahmad, A., Lawless, G., Lima, P.: An online scalable approach to unified multirobot cooperative localization and object tracking. IEEE Trans. Robot. 33(5), 1184–1199 (2017)

    Article  Google Scholar 

  12. Hausman, K., Müller, J., Hariharan, A., Ayanian, N., Sukhatme, G.S.: Cooperative multi-robot control for target tracking with onboard sensing. The International Journal of Robotics Research 34 (13), 1660–1677 (2015)

    Article  Google Scholar 

  13. Julier, S., Uhlmann, J.K.: General decentralized data fusion with covariance intersection. Handbook of multisensor data fusion:, theory and practice, pp. 319–344 (2009)

  14. Lyu, Y., Pan, Q., Lv, J.: Unscented transformation-based multi-robot collaborative self-localization and distributed target tracking. Appl. Sci. 9(5), 903 (2019)

    Article  Google Scholar 

  15. Zhu, P., Ren, W.: Fully distributed joint localization and target tracking with mobile robot networks. IEEE Transactions on Control Systems Technology (2020)

  16. Zhu, P., Ren, W.: Multi-robot joint localization and target tracking with local sensing and communication. In: 2019 American Control Conference (ACC), pp 3261–3266. IEEE (2019)

  17. Chen, L., Arambel, P.O., Mehra, R.K.: Estimation under unknown correlation: Covariance intersection revisited. IEEE Trans. Autom. Control 47(11), 1879–1882 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  18. Li, T., Corchado, J.M., Sun, S.: On generalized covariance intersection for distributed phd filtering and a simple but better alternative. In: 2017 20th International Conference on Information Fusion (Fusion), pp 1–8. IEEE (2017)

  19. Luft, L., Schubert, T., Roumeliotis, S.I., Burgard, W.: Recursive decentralized localization for multi-robot systems with asynchronous pairwise communication. Int. J. Robot. Res. 37(10), 1152–1167 (2018)

    Article  Google Scholar 

  20. Julier, S.J., Uhlmann, J.K.: Using covariance intersection for slam. Robot. Auton. Syst. 55 (1), 3–20 (2007)

    Article  Google Scholar 

  21. Zhu, J., Kia, S.S.: Cooperative localization under limited connectivity. IEEE Trans. Robot. 35(6), 1523–1530 (2019)

    Article  Google Scholar 

  22. Howard, A., Matark, M.J., Sukhatme, G.S.: Localization for mobile robot teams using maximum likelihood estimation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, pp 434–439. IEEE (2002)

  23. Huang, G.P., Trawny, N., Mourikis, A.I., Roumeliotis, S.I.: Observability-based consistent ekf estimators for multi-robot cooperative localization. Auton. Robot. 30(1), 99–122 (2011)

    Article  Google Scholar 

  24. Roumeliotis, S.I., Bekey, G.A.: Distributed multirobot localization. IEEE Int. Conf. Robot. Autom. 18(5), 781–795 (2002)

    Article  Google Scholar 

  25. Kia, S.S., Rounds, S., Martinez, S.: Cooperative localization for mobile agents: A recursive decentralized algorithm based on kalman-filter decoupling. IEEE Control. Syst. Mag. 36(2), 86–101 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  26. Carrillo-Arce, L.C., Nerurkar, E.D., Gordillo, J.L., Roumeliotis, S.I.: Decentralized multi-robot cooperative localization using covariance intersection. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 1412–1417. IEEE (2013)

  27. Klingner, J., Ahmed, N., Correll, N.: Fault-tolerant covariance intersection for localizing robot swarms. Robot. Auton. Syst. 122, 103306 (2019)

    Article  Google Scholar 

  28. Li, H., Nashashibi, F., Yang, M.: Split covariance intersection filter: Theory and its application to vehicle localization. IEEE Trans. Intell. Transp. Syst. 14(4), 1860–1871 (2013)

    Article  Google Scholar 

  29. Li, L., Yang, M.: Joint localization based on split covariance intersection on the lie group. IEEE Trans. Robot. 37(5), 1508–1524 (2021)

    Article  Google Scholar 

  30. Gohring, D., Burkhard, H.-D.: Multi robot object tracking and self localization using visual percept relations. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 31–36. IEEE (2006)

  31. Ahmad, A., Lima, P.: Multi-robot cooperative spherical-object tracking in 3d space based on particle filters. Robot. Auton. Syst. 61(10), 1084–1093 (2013)

    Article  Google Scholar 

  32. Schmitt, T., Hanek, R., Beetz, M., Buck, S., Radig, B.: Cooperative probabilistic state estimation for vision-based autonomous mobile robots. IEEE Int. Conf. Robot. Autom. 18(5), 670–684 (2002)

    Article  MATH  Google Scholar 

  33. Chang, C.-K., Chang, C.-H., Wang, C.-C.: Communication adaptive multi-robot simultaneous localization and tracking via hybrid measurement and belief sharing. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp 5016–5023. IEEE (2014)

  34. Li, T., Xin, Y., Song, Y., Song, E., Fan, H.: Some statistic and information-theoretic results on arithmetic average density fusion. arXiv:2110.01440 (2021)

  35. Julier, S.J., Uhlmann, J.K.: Fusion of time delayed measurements with uncertain time delays. In: Proceedings of the 2005, American Control Conference, 2005, pp 4028–4033. IEEE (2005)

  36. Horn, R.A., Horn, R.A., Johnson, C.R.: Topics in matrix analysis. Cambridge University Press (1994)

  37. Bakr, M.A., Lee, S.: Distributed multisensor data fusion under unknown correlation and data inconsistency. Sensors 17(11), 2472 (2017)

    Article  Google Scholar 

  38. Peng, Z., Wen, G., Rahmani, A., Yu, Y.: Leader–follower formation control of nonholonomic mobile robots based on a bioinspired neurodynamic based approach. Robotics and Autonomous Systems 61 (9), 988–996 (2013)

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China [grants no. 62071389 and 51975482] and Shaanxi Provincial Key R&D Program of China [grant no. 2019ZDLGY14-10].

Author information

Authors and Affiliations

  1. School of Mechanical Engninering, Northwestern Polytechnical University, 127 West Youyi Road, Beilin District, Xi’an, 710072, Shannxi, China

    Xuedong Wang, Shudong Sun & Yaqiong Liu

  2. Key Laboratory of Industrial Engineering and Intelligent Manufacturing, Ministry of Industry and Information Technology, Northwestern Polytechnical University, 127 West Youyi Road, Beilin District, Xi’an, 710072, Shannxi, China

    Xuedong Wang, Shudong Sun & Yaqiong Liu

  3. The 20th Research Institute of China Electronics Technology Corporation, 1 Baisha Road, Yanta District, Xi’an, 710068, Shannxi, China

    Xuedong Wang

  4. School of Automation, Northwestern Polytechnical University, 1 Dongxiang Road, Chang’an District, Xi’an, 710129, Shannxi, China

    Tiancheng Li

Authors
  1. Xuedong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shudong Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tiancheng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yaqiong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Xuedong Wang, Shudong Sun and Tiancheng Li. The first draft of the manuscript was written by Xuedong Wang and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Shudong Sun.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Sun, S., Li, T. et al. A Consistent Union-for-Fusion Approach to Multi-Robot Simultaneous Localization and Target Tracking. J Intell Robot Syst 106, 70 (2022). https://doi.org/10.1007/s10846-022-01770-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10846-022-01770-6

Keywords

Search

Navigation