Skip to main content
SpringerLink
Log in

Tangible user interface of digital products in multi-displays

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Early attempts at supporting interaction with digital products for the design review were based on CAD and virtual reality (VR) systems. However, it is not easy to build a virtual environment of fine quality and to acquire tangible and natural interactions with VR-based systems, which are expensive and inflexible to be adaptable to typical offices or collaboration rooms. We present a new method for supporting tangible interactions with digital products in immersive and non-immersive multi-display environments with inexpensive and convenient optical tracking. The provided environment is more intuitive and natural to help participants to review digital products through their functional behavior modeling and evaluation. Although vision-based image processing has been widely used for interaction tracking, it cannot be effectively used under a low illumination condition since most of the collaborations and meetings take place in such conditions. To overcome this problem, the proposed approach utilizes Wiimote™ for infrared (IR)-based optical tracking and for capturing user's interactions and intents. Thus, users can easily manipulate and evaluate digital products with inexpensive tools called IR tangibles in more natural and user-friendly environments such as large displays, tabletops, and situational displays in typical offices and workspaces. Furthermore, the multi-view manager is suggested to effectively support multi-views of digital products among participants by providing public and private views. We will show the effectiveness and usefulness of the proposed approach by demonstrating several implementation results and by evaluating user study of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Lee JY, Rhee GW, Park H (2009) AR/RP-based tangible interactions for collaborative design evaluation of digital products. Int J Adv Manuf Tech 45:649–665

    Article  Google Scholar 

  2. Buxton W, Fitzmaurice G, Balakrishnan R, Kurtenbach G (2000) Large displays in automotive design. IEEE Comput Graph Appl 20:68–75

    Article  Google Scholar 

  3. Robertson G, Czerwinski M, Baudisch P, Meyers B, Robbins D, Smith G, Tan D (2005) The large-display user experience. IEEE Comput Graph Appl 25:44–51

    Article  Google Scholar 

  4. Ni T, Schmidt GS, Staadt OG, Livingston MA, Ball R, May R (2006) A survey of large high-resolution display technologies, techniques, and applications. Proc IEEE Conf Virtual Reality: 223–236

  5. Bowman DA, Kruijff E, LaViola JJ, Poupyrev I (2004) 3D user interface: theory and practice. Addison-Wesley Professional

  6. Kato J, Sakamoto D, Inami M, Igarashi T (2009) Multi-touch interface for controlling multiple mobile robots. Proc CHI 2009:3443–3448

    Google Scholar 

  7. Davis J, Chen X (2002) Lumipoint: multi-user laser-based interaction on large tiled displays. Displays 23:205–211

    Article  Google Scholar 

  8. Hardy R, Rukzio, E (2008) Touch & interact: touch-based interaction of mobile phones with displays. Proc Mobile HCI: 245–254

  9. Pears N, Jackson DG (2009) Smart phone interaction with registered displays. IEEE Pervasive Computing 8:14–21

    Article  Google Scholar 

  10. Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. Proc UIST 2005:33–42

    Article  Google Scholar 

  11. Malik S, Ranjan A, Balakrishnan R (2005) Interacting with large displays from a distance with vision-tracked multi-finger gestural input. Proc UIST 2005:43–52

    Google Scholar 

  12. Murgia A, Wolff R, Sharkey PM, Clark B (2008) Lost-cost optical tracking for immersive collaboration in the CAVE using the Wii remote. Proc ICDVRAT 2008:103–109

    Google Scholar 

  13. Chow Y-W (2008) The Wii remote as an input device for 3D interaction in immersive head-mounted display virtual reality. Proc IADIS Int Conference Gaming 2008:85–92

    Google Scholar 

  14. Wiimote project, http://johnnylee.net/projects/wii/

  15. Park H, Moon H-C, Lee JY (2009) Tangible augmented prototyping of digital handheld products. Comput Ind 60:1873–1882

    Article  Google Scholar 

  16. Lee JY, Rhee GW (2008) Context aware adaptable ubiquitous car services using augmented reality. Int J Adv Manuf Technol 37:431–442

    Article  Google Scholar 

  17. Christian J, Krieger H, Holzinger A, Behringer R (2007) Virtual and mixed reality interfaces for e-learning: examples of applications in light aircraft maintenance. Lect Notes Comput Sci 4556:520–529

    Article  Google Scholar 

  18. Regenbrecht HT, Wagner MT, Baratoff G (2002) MagicMeeting: a collaborative tangible augmented reality system. Virt Reality 6:151–166

    Article  Google Scholar 

  19. Cao X, Balakrishnan R (2003) VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. Proc UIST 2003:173–182

    Google Scholar 

  20. Davidson DL, Han JY (2006) Synthesis and control on large scale multi-touch sensing displays. Proc. of the 2006 International Conf. on New Interfaces for Musical Expression: 216–219

  21. Izadi S, Brignull H, Rodden T, Rogers Y, Underwood M (2003) Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media. Proc UIST 2003:159–168

    Google Scholar 

  22. Harel D (1987) Statecharts: a visual formalism for complex systems. Sci Comput Program 8:231–274

    Article  MathSciNet  MATH  Google Scholar 

  23. Antonya C, Talana D (2007) Design evaluation and modification of mechanical systems in virtual environment. Virt Reality 11:275–285

    Article  Google Scholar 

  24. Regenbrecht H, Haller M, Hauber J, Billinghurst M (2006) Carpeno: interfacing remote collaborative virtual environments with table-top interaction. Virt Reality 10:95–107

    Article  Google Scholar 

  25. Matlab, http://www.mathworks.com/products/matlab/

  26. OpenSceneGraph, http://www.openscenegraph.org/

  27. Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV library. O'REILLY

  28. Chronbach's alpha, http://en.wikipedia.org/wiki/Cronbach's_alpha

Download references

Author information

Authors and Affiliations

  1. Chonnam National University, 300 Yongbong-dong, Buk-gu, Gwangju, 500-757, South Korea

    Jae Yeol Lee & Min Seok Kim

  2. KISTI, Daejeon, South Korea

    Jae Sung Kim & Sang Min Lee

Authors
  1. Jae Yeol Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Seok Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jae Sung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sang Min Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jae Yeol Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, J.Y., Kim, M.S., Kim, J.S. et al. Tangible user interface of digital products in multi-displays. Int J Adv Manuf Technol 59, 1245–1259 (2012). https://doi.org/10.1007/s00170-011-3575-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-011-3575-0

Keywords

Search

Navigation