Using 2D and 3D Landmarks to Solve the Correspondence Problem in Cognitive Robot Mapping

  • Margaret E. Jefferies
  • Michael Cree
  • Michael Mayo
  • Jesse T. Baker
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3343)

Abstract

We present an approach which uses 2D and 3D landmarks for solving the correspondence problem in Simultaneous Localisation and Mapping (SLAM) in cognitive robot mapping. The nodes in the topological map are a representation for each local space the robot visits. The 2D approach is feature based – a neural network algorithm is used to learn a landmark signature from a set of features extracted from each local space representation. Newly encountered local spaces are classified by the neural network as to how well they match the signatures of the nodes in the topological network. The 3D landmarks are computed from camera views of the local space. Using multiple 2D views, identified landmarks are projected, with their correct location and orientation into 3D world space by scene reconstruction. As the robot moves around the local space, extracted landmarks are integrated into the ASR’s scene representation which comprises the 3D landmarks. The landmarks for an ASR scene are compared against the landmark scenes for previously constructed ASRs to determine when the robot is revisiting a place it has been to before.

Keywords

Scale Invariant Feature Transform Camera View Local Space Correspondence Problem Scale Invariant Feature Transform Feature 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Yeap, W.K., Jefferies, M.E.: Computing a representation of the local environment. Artificial Intelligence 107, 265–301 (1999)MATHCrossRefGoogle Scholar
  2. 2.
    Yeap, W.K.: Towards a Computational Theory of Cognitive Maps. Artificial Intelligence 34, 297–360 (1988)CrossRefGoogle Scholar
  3. 3.
    Cheng, K.: A purely geometric module in the rat’s spatial representation. Cognition 23, 149–178 (1986)CrossRefGoogle Scholar
  4. 4.
    Gallistel, C.R., Cramer, A.E.: Computations on metric maps in mammals: getting oriented and choosing a multi-destination route. The Journal of Experimental Biology 199, 211–217 (1996)Google Scholar
  5. 5.
    Huttenlocher, J., Newcombe, N., Sandberg, E.H.: The coding of spatial location in young children. Cognitive Psychology 27, 115–147 (1994)CrossRefGoogle Scholar
  6. 6.
    Wang, R.F., Spelke, E.S.: Updating egocentric representations in human navigation. Cognition 77, 215–250 (2000)CrossRefGoogle Scholar
  7. 7.
    Hähnel, D., Burgard, W., Fox, D., Thrun, S.: An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements. In: Proceedings Intelligent Robots and Systems (2003)Google Scholar
  8. 8.
    Thrun, S., Hahnel, D., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Baker, C., Omohundro, Z., Thayer, S., Whittaker, W.: A system for volumetric robotic mapping of abandoned mines. In: Proceedings International Conference on Robotics and Automation (2003)Google Scholar
  9. 9.
    Hähnel, D., Thrun, S., Wegbreit, B., Burgard, W.: Towards lazy data association in SLAM. In: Proceedings 10th International Symposium of Robotics Research (2003)Google Scholar
  10. 10.
    Gutmann, J.-S., Konolige, K.: Incremental mapping of large cyclic environments. In: Proceedings International Symposium on Computational Intelligence in Robotics and Automation (1999)Google Scholar
  11. 11.
    Kuipers, B.: The spatial semantic hierarchy. Artificial Intelligence 119, 191–233 (2000)MATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Tomatis, N., Nourbakhsh, I., Siegwart, R.: Hybrid simultaneous localization and map building: Closing the loop with multi-hypotheses tracking. In: Proceedings International Conference on Robotics and Automation (2002)Google Scholar
  13. 13.
    Bosse, M., Newman, P., Leonard, J., Soika, M., Feiten, W., Teller, S.: An Atlas framework for scalable mapping. In: Proceedings International Conference on Robotics and Automation (2003)Google Scholar
  14. 14.
    Thrun, S.: Learning metric-topological maps for indoor mobile robot navigation. Artificial Intelligence 99(1), 21–71 (1998)MATHCrossRefGoogle Scholar
  15. 15.
    Chown, E., Kaplan, S., Kortenkamp, D.: Prototypes, Location, and Associative Networks (PLAN): Towards a Unified Theory of Cognitive Mapping. Cognitive Science 19, 1–51 (1995)CrossRefGoogle Scholar
  16. 16.
    Kuipers, B.J., Byun, Y.-T.: A Robust, Qualitative method for Robot Spatial learning. In: Proceedings of the National Conference on Artificial Intelligence, AAAI 1988 (1988)Google Scholar
  17. 17.
    Kuipers, B., Beeson, P.: Bootstrap learning for place recognition. In: Proceedings 18th International Conference on Artificial Intelligence (2002)Google Scholar
  18. 18.
    Kuipers, B., Modayil, J., Beeson, P., MacMahon, M.: Local metrical and global topological maps in the hybrid Spatial Semantic Hierarchy. In: Proceedings IEEE International Conference on Robotics and Automation, ICRA 2004 (2004)Google Scholar
  19. 19.
    Jefferies, M.E., Baker, J., Weng, W.: Robot cognitive mapping: A role for a global metric map in a cognitive mapping process. In: Proceedings Workshop on Robot and Cognitive Approaches to Spatial Mapping (2003)Google Scholar
  20. 20.
    Jefferies, M.E., Weng, W., Baker, J.T., Mayo, M.: Using context to solve the correspondence problem in simultaneous localisation and mapping. In: Proceedings 2004 Pacific Rim Conference on Artificial Intelligence (2004)Google Scholar
  21. 21.
    Modazil, J., Beeson, P., Kuipers, B.: Using the topological skeleton for global metric map-building. In: Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2004 (2004)Google Scholar
  22. 22.
    Jefferies, M.E., Cosgrove, M.C., Baker, J.T., Yeap, W.K.: The correspondence problem in topological metric mapping - Using absolute metric maps to close cycles. In: Proceedings 2004 International Conference on Knowledge-Based Intelligent Information and Engineering Systems (2004)Google Scholar
  23. 23.
    Huttenlocher, J., Presson, C.C.: The Coding and Transformation of Spatial Information. Cognitive Psychology 11, 375–394 (1979)CrossRefGoogle Scholar
  24. 24.
    Jefferies, M.E., Weng, W., Baker, J.T., Cosgrove, M.C., Mayo, M.: A hybrid approach to finding cycles in hybrid maps. In: Proceedings Australian Conference on Robotics and Automation (2003)Google Scholar
  25. 25.
    Rofer, T.: Using histogram correlation to create consistent laser scan maps. In: Proceedings IEEE International Conference on Intelligent Robotics Systems (2002)Google Scholar
  26. 26.
    Siegel, A.W., White, S.H.: The Development of Spatial Representations of Large-Scale Environments. Advances in Child Development & Behavior by H.W. Reese 10 (1975)Google Scholar
  27. 27.
    Moar, I., Carleton, L.R.: Memory for routes. Quarterly Journal of Experimental Psychology 34A, 381–394 (1982)Google Scholar
  28. 28.
    Montello, D.R.: A new framework for understanding the acquisition of spatial knowledge in large-scale environments. In: Egenhofer, M.J., Golledge, R.G. (eds.) Spatial and Temporal Reasoning in Geographic Information Systems, pp. 143–154. Oxford University Press, New York (1998)Google Scholar
  29. 29.
    Pollefeys, M.: 3D modeling from inages. In: Proceedings Tutorial Notes 2000 European Conference on Computer Vision (2000)Google Scholar
  30. 30.
    Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings 4th ALVETY Vision Conference (1998)Google Scholar
  31. 31.
    Noble, J.: Descriptions of Image Surfaces. PhD thesis Robotics Research Group, Department of Engineering Science, Oxford University (1989)Google Scholar
  32. 32.
    Klette, R., Schlüns, K., Koschan, A.: Computer Vision: Three-Dimensional Data from Images. Springer, Singapore (1998)MATHGoogle Scholar
  33. 33.
    Gupta, G.S., Win, T.A., Messom, C., Demidenko, S., Mukhopadhyay, S.: Defect analysis of grit-blasted or spray-painted surface using vision sensing techniques. In: Proceedings Image and Vision Computing New Zealand (2003)Google Scholar
  34. 34.
    Kouzoubov, K., Austin, D.: Hybrid Topological/Metric Approach to SLAM. In: Proceedings 2004 IEEE international Conference on Robotics and Automation (2004)Google Scholar
  35. 35.
    Montemerlo, M., Thrun, S., Koller, D., Wegbreit, B.: Fastslam: A factored solution to the simultaneous localization and mapping problem. In: Proceedings AAAI 2002 (2002)Google Scholar
  36. 36.
    Taylor, C.J., Kriegman, D.: Vision-based motion planning and exploration algorithms for mobile robots. IEEE Transactions on Robotics and Automation 14(3), 417–427 (1998)CrossRefGoogle Scholar
  37. 37.
    Thrun, S.: Robot mapping: A survey, in Exploring Artificial Intelligence in the New millennium. In: Lakemeyer, G., Nebel, B. (eds.), Morgan Kaufmann, San Francisco (2002)Google Scholar
  38. 38.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  39. 39.
    Lamon, P., Tapus, A., Glauser, E., Tomatis, N., Siegwart, R.: Environmental Modeling with Fingerprint sequences for topological global localization. In: Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (2003)Google Scholar
  40. 40.
    Kosecka, J., Li, F.: Vision based topological markov localization. In: Proceedings 2004 International Conference on Robotics and Automation (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Margaret E. Jefferies
    • 1
  • Michael Cree
    • 1
    • 2
  • Michael Mayo
    • 1
  • Jesse T. Baker
    • 1
  1. 1.Department of Computer ScienceUniversity of WaikatoNew Zealand
  2. 2.Department of Physics and Electrical EngineeringUniversity of WaikatoNew Zealand

Personalised recommendations