Registration of GPS and Stereo Vision for Point Cloud Localization in Intelligent Vehicles Using Particle Swarm Optimization

  • Vijay JohnEmail author
  • Yuquan Xu
  • Seiichi Mita
  • Qian Long
  • Zheng Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10385)


In this paper, we propose an algorithm for the registration of the GPS sensor and the stereo camera for vehicle localization within 3D dense point clouds. We adopt the particle swarm optimization algorithm to perform the sensor registration and the vehicle localization. The registration of the GPS sensor and the stereo camera is performed to increase the robustness of the vehicle localization algorithm. In the standard GPS-based vehicle localization, the algorithm is affected by noisy GPS signals in certain environmental conditions. We can address this problem through the sensor fusion or registration of the GPS and stereo camera. The sensors are registered by estimating the coordinate transformation matrix. Given the registration of the two sensors, we perform the point cloud-based vehicle localization. The vision-based localization is formulated as an optimization problem, where the “optimal” transformation matrix and corresponding virtual point cloud depth image is estimated. The transformation matrix, which is optimized, corresponds to the coordinate transformation between the stereo and point cloud coordinate systems. We validate the proposed algorithm with acquired datasets, and show that the algorithm robustly localizes the vehicle.


  1. 1.
    Aisan Technology Co. Ltd. (2013).
  2. 2.
    Colombo, O.: Ephemeris errors of GPS satellites. Bull. Godsique 60(1), 64–84 (1986)CrossRefGoogle Scholar
  3. 3.
    Dailey, M., Parnichkun, M.: Simultaneous localization and mapping with stereo vision. In: International Conference on Control, Automation, Robotics and Vision (2006)Google Scholar
  4. 4.
    Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. In: CVPR (2000)Google Scholar
  5. 5.
    Farrell, J., Barth, M.: The Global Positioning System and Inertial Navigation. McGraw-Hill, New York (1999)Google Scholar
  6. 6.
    Franconi, L., Jennison, C.: Comparison of a genetic algorithm and simulated annealing in an application to statistical image reconstruction. Stat. Comput. 7(3), 193–207 (1997)CrossRefGoogle Scholar
  7. 7.
    Labayrade, R., Aubert, D., Tarel, J.P.: Real time obstacle detection in stereovision on non flat road geometry through “v-disparity” representation. In: Intelligent Vehicle Symposium (2002)Google Scholar
  8. 8.
    Kneip, L., Chli, M., Siegwart, R.: Robust real-time visual odometry with a single camera and an IMU. In: British Machine Vision Conference (2011)Google Scholar
  9. 9.
    Long, Q., Xie, Q., Mita, S., Tehrani, H., Ishimaru, K., Guo, C.: Real-time dense disparity estimation based on multi-path viterbi for intelligent vehicle applications. In: British Machine Vision Conference (2014)Google Scholar
  10. 10.
    Mattern, N., Schubert, R., Wanielik, G.: High accurate vehicle localization using digital maps and coherency images. In: IVS (2010)Google Scholar
  11. 11.
    Noda, M., Takahashi, T., Deguchi, D., Ide, I., Murase, H., Kojima, Y., Naito, T.: Vehicle ego-localization by matching in-vehicle camera images to an aerial image. In: Koch, R., Huang, F. (eds.) ACCV 2010. LNCS, vol. 6469, pp. 163–173. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-22819-3_17 CrossRefGoogle Scholar
  12. 12.
    Shi, Y., Eberhart, R.: A modified particle swarm optimizer. In: International Conference on Evolutionary Computation, pp. 69–73 (1998)Google Scholar
  13. 13.
    Yoneda, K., Tehrani, H., Ogawa, T., Hukuyama, N., Mita, S.: Lidar scan feature for localization with highly precise 3-D map. In: Intelligent Vehicles Symposium (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Vijay John
    • 1
    Email author
  • Yuquan Xu
    • 1
  • Seiichi Mita
    • 1
  • Qian Long
    • 2
  • Zheng Liu
    • 3
  1. 1.Research Center of Smart VehiclesToyota Technological InstituteNagoyaJapan
  2. 2.Chinese Academy of SciencesBeijingChina
  3. 3.University of British Columbia (Okanagan)KelownaCanada

Personalised recommendations