Skip to main content

MagicPad: the projection based 3D user interface


In this paper we describe a novel design and implementation of a tangible user interface framework, namely the MagicPad. The MagicPad is inspired by the concept of Spatially Augmented Reality. By using a wireless pen with any flat surface, such as a piece of paper that receives projected images from a projector, a user is able to perform a variety of interactive visualization and manipulation in the 3D space. The result of the user test is then presented and finally we suggest the possibilities of improving the MagicPad by using a pico projector to replace the wireless pen.

This is a preview of subscription content, access via your institution.


  1. 1

    Shaer, O., Hornecker, E.: Tangible user interfaces: past, present, and future directions. Found. Trends Hum. Comput. Interact. 3(1–2), 1–137 (2009).

  2. 2

    Ullmer B., Ishii H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(3–4), 915–931 (2000)

    Article  Google Scholar 

  3. 3

    Ni, T., Schmidt, G.S., Staadt, O.G., Livingston, M.A., Ball, R., May, R.: A survey of large high-resolution display technologies, techniques, and applications. Paper presented at the IEEE conference on virtual reality (2006)

  4. 4

    DeFanti, T.A., Dawe, G., Sandin, D.J., Schulze, J.P., Otto, P., Girado, J., Kuester, F., Smarr, L., Rao, R.: The StarCAVE, a third-generation CAVE and virtual reality OptIPortal. Futur. Gener. Comput. Syst. 25(2), 169–178 (2009).

  5. 5

    Bimber, O., Raskar, R.: Modern approaches to augmented reality. Paper presented at the ACM SIGGRAPH 2005 courses, Los Angeles, California (2005)

  6. 6

    Kim, J.-S., Grac̆canin, D., Singh, H.L., Matkovic, K., Juric, J.: A tangible user interface system for CAVE applicat. Paper presented at the IEEE conference on virtual reality (2006)

  7. 7

    Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. Paper presented at the 2nd IEEE and ACM international workshop on augmented reality (1999)

  8. 8

    Raskar, R., Brown, M.S., Yang, R., Chen, W.-C., Welch, G., Towles, H., Seales, B., Fuchs, H.: Multi-projector displays using camera-based registration. Paper presented at the Visualization ’99: celebrating ten years, San Francisco, California, United States (1999)

  9. 9

    Raskar, R., Low, K.-L.: Interacting with spatially augmented reality. Paper presented at the 1st international conference on computer graphics, virtual reality and visualisation, Camps Bay, Cape Town, South Africa (2001)

  10. 10

    Bandyopadhyay, D., Raskar, R., State, A., Fuchs, H.: Dynamic Spatially Augmented 3D Painting. In: Technical Report, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA (2001)

  11. 11

    Spindler, M., Stellmach, S., Dachselt, R.: PaperLens: advanced magic lens interaction above the tabletop. Paper presented at the ACM international conference on interactive tabletops and surfaces (ITS 2009), Banff, Canada, 23–25 November 2009

  12. 12

    Chan, L.K.Y., Lau, H.Y.K.: Poster: A tangible user interface using spatial augmented reality. In: IEEE Symposium on 3D User Interfaces, Waltham, MA, USA 2010, pp. 137–138. IEEE Computer Society (2010)

  13. 13

    Piazza, T., Fjeld, M.: Ortholumen: Using Light for Direct Tabletop Input. In: Proceedings of Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07), pp. 193–196 (2007)

  14. 14

    Hofer, R.L., Kunz, A.: Digisketch: Taming anoto technology on LCDs, engineering interactive computing systems 2010, pp. 103–108. Berlin, Germany, ISBN 978-1-4503-0083-4 (2010)

  15. 15

    Taylor, R.M., Hudson, T.C., Seeger, A., Weber, H., Juliano, J., Helser, A.T.: VRPN: a device-independent, network-transparent VR peripheral system. Paper presented at the ACM symposium on virtual reality software and technology, Banff, Alberta, Canada (2001)

  16. 16

    Bier, E.A., Stone, M.C., Pier, K., Buxton, W., DeRose, T.D.: Toolglass and magic lenses: the see-through interface. Paper presented at the 20th annual conference on computer graphics and interactive techniques, Anaheim, CA (1993)

  17. 17

    Brown, LD, Hua, H.: Magic lenses for augmented virtual environments. IEEE Comput. Graph. Appl. 26(4), 64–73 (2006).

  18. 18

    Looser, J., Billinghurst, M., Cockburn, A.: Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces. Paper presented at the the 2nd international conference on computer graphics and interactive techniques in Australasia and South East Asia, Singapore (2004)

  19. 19

    Lantz, E.: The future of virtual reality: head mounted displays versus spatially immersive displays (panel). Paper presented at the 23rd annual conference on computer graphics and interactive techniques (1996)

Download references

Author information



Corresponding author

Correspondence to Leith K. Y. Chan.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Chan, L.K.Y., Lau, H.Y.K. MagicPad: the projection based 3D user interface. Int J Interact Des Manuf 6, 75–81 (2012).

Download citation


  • 3D user interface
  • Virtual reality
  • Augmented reality
  • Projector