Abstract
In this paper we describe our efforts to create tangible imaging systems that provide rich virtual representations of real-world surfaces. Tangible imaging systems have three main properties: 1) the images produced must be visually realistic; 2) the images must be responsive to user interaction; and 3) the images must be situated, appearing to be integrated with their environments. Our current system, based on a computer, LCD display, light and position sensors, and graphics rendering tools meets all these requirements; supporting the accurate simulation of the appearances of surfaces with complex textures and material properties, and allowing users to interact with and experience these virtual surfaces as if they were real ones. We first describe the components of our current system and its implementation. We then illustrate the system’s capabilities for simulating the appearances and behaviors of real-world surfaces. Finally we describe some potential applications of tangible imaging systems and discuss limitations and future work.
Chapter PDF
References
Darling, B.A., Ferwerda, J.A.: The tangiBook: a tangible display system for direct interaction with virtual surfaces. In: Proc. IS&T 17th Color Imaging Conference, pp. 260–266 (2009)
Darling, B.A., Ferwerda, J.A.: Tangible display systems: direct interfaces for computer-based studies of surface appearance. In: Proc. SPIE Human Vision and Electronic Imaging, vol. 7257, pp. 1–12 (2010)
Blatner, A.M., Ferwerda, J.A., Darling, B.A., Bailey, R.J.: TangiPaint: a tangible digital painting system. In: Proc. IS&T 19th Color Imaging Conference, pp. 120–107 (2011)
Sutherland, I.E.: A head-mounted three-dimensional display. Proc. AIFPS 33, 757–764 (1968)
Vickers, D.L.: Sorcerer’s apprentice: head-mounted display and wand. Ph.D. dissertation, Univ. of Utah (1974)
Callahan, M.A.: A 3-D display head-set for personalized computing. M.S. thesis, MIT (1983)
Fisher, S.S., McGreevy, M., Humphries, J., Robinett, W.: Virtual environment display system. In: Proc. Workshop on Interactive 3D Graphics, pp. 71–87 (1986)
State, A., Keller, K., Fuchs, H.: Simulation-based design and rapid prototyping of a parallax-free, orthoscopic video see-through head-mounted display. In: Proc. IEEE Computer Society of Washington, DC, pp. 28–31 (2005)
VPL Research, See also, http://www.vrealities.com/glove.html
SensAble Technologies, http://www.sensable.com
Ascension Technology Corp, http://www.ascension-tech.com
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proc. ACM SIGGRAPH 1993, pp. 135–142 (1993)
Raskar, R., Welch, G., Low, K., Bandyopadhyay, D.: Shader lamps: animating real objects with image-based illumination. In: Proc. 12th Eurographics Workshop on Rendering Techniques, pp. 89–102 (2001)
Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., Forlines, C.: iLamps: geometrically aware and self-configuring projectors. In: Proc. ACM SIGGRAPH 2003, pp. 809–818 (2003)
Bandyopadhyay, D., Raskar, R., Fuchs, H.: Dynamic shader lamps: painting on real objects. In: Proc. International Symposium on Augmented Reality (ISAR 2001), pp. 207–216 (2001)
Bimber, O., Raskar, R.: Spatial augmented reality. A K Peters Ltd., Wellesley (2005)
Fitzmaurice, G.W.: Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36(7), 39–49 (1993)
Tsang, M., Fitzmaurice, G.W., Kurtenbach, G., Khan, A., Buxton, W.A.S.: Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. Proc. ACM UIST in CHI Letters 4(2), 111–120 (2002)
Francois, A.R.J., Kang, E.Y.: A handheld mirror simulation. In: Proc. International Conference on Multimedia and Expo., pp. 6–9 (2003)
Lazzari, M., Mclaughlin, M.L., Jaskowiak, J., Wong, W., Akbarian, M.: A haptic exhibition of daguerreotype cases for USC’s Fisher Gallery. In: McLaughlin, M.L., Hespanha, J., Sukhatme, G. (eds.) Touch in Virtual Environments: Haptics and the Design of Interactive System, pp. 260–269. Prentice-Hall, Upper Saddle River (2002)
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proc. ACM Conference on Human Factors in Computing Systems (CHI 1997), pp. 234–241 (1997)
Buxton, W.: Surface and tangible computing, and the small matter of people and design. In: IEEE International Solid-State Circuits Conference Digest of Technical Papers, vol. 51, pp. 24–29 (2008)
Darling, B.A., Ferwerda, J.A.: Real-time multispectral rendering with complex illumination. In: Proc. IS&T 19th Color Imaging Conference, pp. 345–351 (2011)
Ward, G.J.: Measuring and modeling anistropic reflection. Proc. ACM SIGGRAPH 1992, Computer Graphics 26(2), 265–272 (1992)
Gardner, A., Tchou, C., Hawkins, T., Debevec, P.: Linear light source reflectometry. Proc. SIGGRAPH 2003, ACM Transactions on Graphics 22(3), 749–758 (2003)
Darling, B.A., Ferwerda, J.: Seeing virtual objects: simulating reflective surfaces on emissive displays. In: Proc. IS&T 20th Color Imaging Conference, pp. 1–7 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ferwerda, J.A., Darling, B.A. (2013). Tangible Images: Bridging the Real and Virtual Worlds. In: Tominaga, S., Schettini, R., Trémeau, A. (eds) Computational Color Imaging. CCIW 2013. Lecture Notes in Computer Science, vol 7786. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36700-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-36700-7_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36699-4
Online ISBN: 978-3-642-36700-7
eBook Packages: Computer ScienceComputer Science (R0)