Markerless Augmented Reality Using Image Mosaics

  • Pietro Azzari
  • Luigi Di Stefano
  • Federico Tombari
  • Stefano Mattoccia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5099)


Augmented reality is a powerful tool for delivering spatially coherent information to a user moving in a known environment. Accurate and reliable pose estimation is the key to success. Many approaches track reference objects into the scene but as the environment grows larger more objects need to be tracked leading to computationally intensive methods. Instead, we propose a practical approach that is suitable for environment where big planar structures are present. All the objects laying on the structure are composed into a large reference object using image mosaicing techniques, so that the problem is reduced to that of finding the pose from a single plane. Experimental results show the effectiveness of this approach on two interesting case studies such as aeronautical servicing and cultural heritage.


Mosaicing Augmented reality Pose estimation Markerless 


  1. 1.
    Schweighofer, G., Pinz, A.: Robust pose estimation from a planar target. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2024–2030 (2006)CrossRefGoogle Scholar
  2. 2.
    Moreno-Noguer, F., Lepetit, V., Fua, P.: Accurate non-iterative o(n) solution to the pnp problem. In: IEEE Intl. Conf. on Computer Vision, Rio de Janeiro, Brazil (October 2007)Google Scholar
  3. 3.
    Simon, G., Berger, M.-O.: Real time registration of known or recovered multi-planar structures: application to ar. In: Proc. of BMVC (2002)Google Scholar
  4. 4.
    Uematsu, Y., Saito, H.: Vision-based registration for augmented reality with integration of arbitrary multiple planes. In: Proc. of ICIAP, pp. 155–162 (2005)Google Scholar
  5. 5.
    Simon, G., Fitzgibbon, A.W., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Proc. of ISAR, Munich, Germany, May–June 2000, pp. 120–128 (2000)Google Scholar
  6. 6.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. Intl. J. of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  7. 7.
    Dehais, C., Douze, M., Morin, G., Charvillat, V.: Augmented reality through real-time tracking of video sequences using a panoramic view. In: Proc. of ICPR, pp. 995–998 (2004)Google Scholar
  8. 8.
    Liu, P., Sun, X., Georganas, N.D., Dubois, E.: Augmented reality: A novel approach for navigating in panorama-based virtual. In: Proc. of HAVE (2003) (unknown)Google Scholar
  9. 9.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Pietro Azzari
    • 1
  • Luigi Di Stefano
    • 1
  • Federico Tombari
    • 1
  • Stefano Mattoccia
    • 1
  1. 1.ARCES - DEISUniversity of BolognaBolognaItaly

Personalised recommendations