Skip to main content
Log in

Improving performances of GNSS positioning correction using multiview deep reinforcement learning with sparse representation

  • Original Article
  • Published:
GPS Solutions Aims and scope Submit manuscript

Abstract

High-accuracy GNSS positioning in urban environments is important for applications like safe autonomous driving, however, dynamic errors in complex urban environments limit positioning performances. Recently, deep learning-based (DL) approaches can obtain better GNSS positioning solutions in complex urban environments than model-based ones. However, DL-based approaches simply concentrate one-view GNSS observations as inputs, which are insufficient to model vehicle states accurately, and temporally continuous observations are highly correlated, leading to inaccurate positioning correction results. To solve the challenge, we propose a Sparse Representation-based Multiview Deep Reinforcement Learning model for positioning correction, which employs attention-based multiview fusion to process multiview observations, and uses sparse representation to alleviate disturbances from highly correlated observations. To represent the vehicle state sufficiently, we build a multiview positioning correction environment, and develop an attention-weighted multiview fusion module to fuse temporal features as belief states based on adaptively learned attention weights. To effectively process redundant and correlated multiview features, we impose the ℓ1 norm regularizer to learn sparse hidden representations and improve the precision of value estimation. Finally, we construct a sparse representation-driven multiview actor-critic positioning correction model to achieve high-accuracy GNSS positioning in complex urban environments. We validate performances in both Google Smartphone Decimeter Challenge (GSDC) datasets and our collected GNSS datasets in the Guangzhou area (GZGNSS). Experimental results show that our algorithm can improve localization performances with 27% improvements from WLS+KF in GSDC trajectories, 16% from RTK, and 6% from DL-based methods in GZGNSS trajectories.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Notes

  1. https://gssc.esa.int/navipedia/index.php/Carrier-smoothing_of_code_pseudoranges.

References

  • Cai H, Hu Z, Huang G, Zhu D, Su X (2018) Integration of GPS, monocular vision, and high definition (HD) map for accurate vehicle localization. Sensors 18(10):3270

    Article  Google Scholar 

  • Fu GM, Khider M, van Diggelen F (2020) Android raw GNSS measurement datasets for precise positioning. In: Proceedings of ION GNSS 2020, Institute of Navigation, September 21–25, 1925–1937.

  • Groves PD, Adjrad M (2017) Likelihood-based GNSS positioning using LOS/NLOS predictions from 3d mapping and pseudoranges. GPS Solutions 21(4):1805–1816

    Article  Google Scholar 

  • Hausknecht M, Stone P (2015) Deep recurrent Q-learning for partially observable MDPs. In: Proceedings of the 2015 AAAI fall symposium series, pp 29–37

  • Kanhere AV, Gupta S, Shetty A, Gao G (2022). Improving GNSS positioning using neural-network-based corrections. Navig J Inst Navig 69(4)

  • Li Z, Xu G, Guo J, Zhao Q (2022) A sequential ambiguity selection strategy for partial ambiguity resolution during RTK positioning in urban areas. GPS Solutions 26(3):92

    Article  CAS  Google Scholar 

  • Le L, Kumaraswamy R, White M (2017) Learning sparse representations in reinforcement learning with sparse coding. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp 2067–2073

  • Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2016) Continuous control with deep reinforcement learning. In: Proceedings of the International Conference on Learning Representations, May 2–4

  • Liu X, Wen W, Hsu LT (2022) 3D LiDAR aided GNSS real-time kinematic positioning via coarse-to-fine batch optimization for high accuracy mapping in dense urban canyons. In: Proceedngs Of ION GNSS 2022, Institute of Navigation, September 19–23, 1954–1965

  • Medina D, Li H, Vila-Valls J, Closas P (2019) On robust statistics for GNSS single point positioning. In: Proceedings of 2019 IEEE Intelligent Transportation Systems Conference (ITSC). IEEE, October, 281–3287

  • Mohanty A, Gao G (2022) Learning GNSS positioning corrections for smartphones using graph convolution neural networks. In: Proceedings of ION GNSS 2022, Institute of Navigation, September 19–23, 2215–2225

  • Quddus MA, Ochieng WY, Noland RB (2007) Current map-matching algorithms for transport applications: State-of-the art and future research directions. Transp Res Part C Emerging Technol 15(5):312–328

    Article  Google Scholar 

  • Schulman J, Moritz P, Levine S, Jordan, M, Abbeel, P (2015) High-dimensional continuous control using generalized advantage estimation. In: Proceedings of International Conference on Learning Representations, May 2–4

  • Schulman J, Wolski F, Dhariwal P, Radford, A, Klimov, O (2017) Proximal policy optimization algorithms. arXiv preprint arXiv:170706347

  • Shu B, Liu H, Zhang J, Pan G, Jiang J (2017) Performance assessment of partial ambiguity resolution based on BDS/GPS combined positioning. Geomatics Inf Sci Wuhan Univ 42(7):989–994

    Google Scholar 

  • Siemuri A, Selvan K, Kuusniemi H, et al (2021) Improving precision GNSS positioning and navigation accuracy on smartphones using machine learning. In: Proceedings of ION GNSS 2022, Institute of Navigation, September 20–24, pp 3081–3093

  • Singh G, Peri S, Kim J, Kim, H, Ahn, S (2021) Structured world belief for reinforcement learning in pomdp. In: Proceedings of International Conference on Machine Learning, PMLR, pp 9744–9755

  • Skog I, Handel P (2009) In-car positioning and navigation technologies—a survey. IEEE Trans Intell Transp Syst 10(1):4–21

    Article  Google Scholar 

  • Teunissen P, Khodabandeh A (2015) Review and principles of PPP-RTK methods. J Geodesy 89(3):217–240

    Article  Google Scholar 

  • Verhagen S, Teunissen PJ (2017) Least-squares estimation and Kalman filtering. In: Springer handbook of global navigation satellite systems, pp 639–660

  • Wang S, Bao Z, Culpepper JS, Cong G (2021) A survey on trajectory data management, analytics, and learning. ACM Computing Surveys (CSUR) 54(2):1–36

    Google Scholar 

  • Wen W, Zhou Y, Zhang G, Fahandezh-Saadi S, Bai XW, Zhan W, Tomizuka M, Hsu LT (2020) UrbanLoco: a full sensor suite dataset for mapping and localization in urban scenes. In: Proceedins of 2020 IEEE International Conference on Robotics and Automation (ICRA), IEEE, pp 2310–2316

  • Xin S, Geng J, Zhang G, Ng HF, Guo J, Hsu LT (2022) 3d-mapping-aided PPP-RTK aiming at deep urban canyons. J Geodesy 96(10):1–19

    Article  Google Scholar 

  • Zhang E, Masoud N (2020) Increasing GPS localization accuracy with reinforcement learning. IEEE Trans Intell Transp Syst 22(5):2615–2626

    Article  Google Scholar 

  • Zhao H, Li Z, Chen W, Zheng Z, Xie S (2022) Accelerated partially shared dictionary learning with differentiable scale-invariant sparsity for multi-view clustering. IEEE Trans Neural Netw Learn Syst 34(11):8825–8839

    Article  Google Scholar 

  • Zhao H, Li Z, Chen C, Wang L, Xie K, Xie S (2023) Fusing vehicle trajectories and GNSS measurements to improve GNSS positioning correction based on actor-critic learning. In: Proceedings of ION ITM 2023, Institute of Navigation, January 24–26, pp 82–94

  • Zhu N, Marais J, Bétaille D, Berbineau M (2018) GNSS position integrity in urban environments: a review of literature. IEEE Trans Intell Transp Syst 19(9):2762–2778

    Article  Google Scholar 

Download references

Acknowledgements

This research is supported in part by National Natural Science Foundation of China under Grants 62203122, 62273106, 62320106008, 62373114, in part by Guang Dong Basic and Applied Basic Research Foundation 2023A1515011159, 2023A1515011480, in part by China Postdoctoral Science Foundation funded project 2022M720840, and in part by National Key Research and Development Plan-Strategic Scientific and Technological Innovation Cooperation Key Project under Grant 2023YFE0209400.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: Haoli Zhao, Zhenni Li; Methodology: Haoli Zhao, Zhenni Li; Formal analysis and Investigation: Haoli Zhao; Software: Haoli Zhao, Qianming Wang; Data Curation: Haoli Zhao, Qianming Wang; Writing original draft preparation: Haoli Zhao; Writing review and editing: Haoli Zhao, Zhenni Li, Kan Xie, Ci Chen; Funding acquisition: Haoli Zhao, Zhenni Li, Shengli Xie, Ming Liu; Supervision: Zhenni Li, Shengli Xie, Ming Liu.

Corresponding author

Correspondence to Zhenni Li.

Ethics declarations

Competing interests

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, H., Li, Z., Wang, Q. et al. Improving performances of GNSS positioning correction using multiview deep reinforcement learning with sparse representation. GPS Solut 28, 98 (2024). https://doi.org/10.1007/s10291-024-01626-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10291-024-01626-6

Keywords

Navigation