Dual Camera Magic Lens for Handheld AR Sketching

  • Klen Čopič PuciharEmail author
  • Jens Grubert
  • Matjaž Kljun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9299)


One challenge of supporting in-situ sketching tasks with Magic Lenses on handheld Augmented Reality systems is to provide accurate and robust pose tracking without disrupting the sketching experience. Typical tracking approaches rely on the back-facing camera both for tracking and providing the view of the physical scene. This typically requires a fiducial to be in the scene which can disrupt the sketching experience on a blank sheet of paper. We address this challenge by proposing a Dual Camera Magic Lens approach. Specifically, we use the front facing camera for tracking while the back camera concurrently provides the view of the scene. Preliminary evaluation on a virtual tracing task with an off-the-shelf handheld device suggests that the Dual Camera Magic Lens approach has the potential to be both faster and lead to a higher perceived satisfaction compared to Magic Lens and Static Peephole interfaces.


Magic-lens Dual-camera Sketching Trace-drawing Virtual-tracing 


  1. 1.
    Hagbi, N., Bergig, O., El-Sana, J., Billinghurst, M.: Shape recognition and pose estimation for mobile augmented reality. In: IEEE TVCG, pp. 65–71, October 2009Google Scholar
  2. 2.
    Hagbi, N., Grasset, R., Bergig, O., Billinghurst, M., El-Sana, J.: In-place sketching for content authoring in augmented reality games. In: CIE, vol. 12, issue 3, p. 3 (2015)Google Scholar
  3. 3.
    Čopič Pucihar, K., Coulton, P., Alexander, J.: The use of surrounding visual context in handheld AR: device vs. user perspective rendering. In: CHI, pp. 197–206 (2014)Google Scholar
  4. 4.
    Seichter, H.: Sketchand+. In: CAADRIA 2003, pp. 209–219 (2003)Google Scholar
  5. 5.
    Sutherland, I.E.: Sketchpad: a man-machine graphical communication system. Technical report No. 296, Lincoln Laboratory, Massachusetts Institute of Technology (1963)Google Scholar
  6. 6.
    Xin, M., Sharlin, E., Sousa, M.C.: Napkin sketch: handheld mixed reality 3D sketching. In: Proceedings VRST 2008, pp. 223–226. ACM (2008)Google Scholar
  7. 7.
    Yee, B., Ning, Y., Lipson, H.: augmented reality in-situ 3D sketching of physical objects. In: Proceeding of IUI 2009 (2009)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  • Klen Čopič Pucihar
    • 1
    Email author
  • Jens Grubert
    • 2
  • Matjaž Kljun
    • 1
  1. 1.Computer Science DepartmentUniversity of PrimoraskaKoperSlovenia
  2. 2.Embedded Interactive Systems Laboratory (EISLab)University of PassauPassauGermany

Personalised recommendations