Skip to main content
SpringerLink
Log in

Cost-effective haptic-based networked virtual environments with high-resolution tiled display

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a haptic-based NVE (networked virtual environment) supporting high-resolution tiled display is proposed with a resource management scheme for future home applications such as a haptic-based networked game. Although NVEs with haptic interaction and immersive display have been developed in previous studies, they usually require expensive system configurations. In order to implement a cost-effective system, our proposed design includes a tiled display supporting high-resolution with several low-cost LCDs. The display nodes of the tiled display also have low processing and storage resource requirements because they only need to handle display-ready pixels received from the application node. The proposed resource management scheme, called as an object-based display scheme, reduces the resource requirements of the application node that would otherwise require significant resources to manage all the display nodes and to provide a user with haptic feedback. The proposed scheme segments graphic scenes into several pixelated virtual objects and assigns different frame rates to each object according to the interest of user. Experimental results confirm that the proposed scheme reduces the required network bandwidth and appropriately assigns the limited processing resources to graphic and haptic renderings for a high-level visual and haptic quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. This means the tip point of the haptic device.

References

  1. Allard J, Gouranton V, Lecointre L, Melin E, Raffin B (2002) Net juggler: running vr juggler with multiple displays on a commodity component cluster. In: Proc. IEEE virtual reality’02, pp 273–274

  2. Andrews S, Mora J, Lang J, Lee W (2006) Hapticast: a physically-based 3D game with haptic feedback. In: Futureplay’06

  3. Bailenson J, Yee N (2008) Virtual interpersonal touch: haptic interaction and copresence in collaborative virtual environments. Multimedia Tools and Applications 37(1):5–14

    Article  Google Scholar 

  4. Buck I, Humphreys G, Hanrahan P (2000) Tracking graphics state for networked rendering. In: Proc. ACM SIGGRAPH/EUROGRAPHICS workshop on graphics hardware’00, pp 87–95

  5. Carson M, Santay D (2003) NIST Net: a linux-based network emulation tool. SIGCOMM Comput Commun Rev 33(3):111–126

    Article  Google Scholar 

  6. Cha J, Kim SY, Ho YS, Ryu J (2006) 3d video player system with haptic interaction based on depth image-based representation. IEEE Trans Consum Electron 52:477–484

    Article  Google Scholar 

  7. Chen H, Chen Y, Finkelstein A, Funkhouser T, Li K, Liu Z, Samanta R, Wallace G (2001) Data distribution strategies for high-resolution displays. Comput Graph 25:811–818

    Article  Google Scholar 

  8. Choi S, Tan HZ (2007) Perceived instability of virtual haptic texture: III. Effect of update rate. Presence: Teleoperators & Virtual Environments 16:263–278

    Article  Google Scholar 

  9. Colgate JE, Schenkel G (1994) Passivity of a class of sampled-data systems: application to haptic interfaces. In: Proc. American control conference’94, vol 3, pp 3236–3240

  10. Conti F, Barbagli F, Morris D, Sewell C (2005) CHAI: an open-source library for the rapid development of haptic scenes. Demo paper presented at IEEE world haptics. http://www.chai3d.org

  11. de Haan G, Klompenhouwer MA (2001) An overview of flaws in emerging television displays and remedial video processing. IEEE Trans Consum Electron 47:326–334

    Article  Google Scholar 

  12. Grant B, Helser A, Taylor RM II (1998) Adding force display to a stereoscopic head-tracked projection display. In: Proc. IEEE virtual reality’98, pp 81–88

  13. Hashimoto N, Jeong S, Takeyama Y, Sato M (2004) Immersive multi-projector display on hybrid screens with human-scale haptic and locomotion interfaces. In: Proc. IEEE cyberworlds’04, pp 361–368

  14. Iwata H, Noma H (1993) Volume haptization. In: Proc. IEEE virtual reality’93, pp 16–23

  15. Kahol K, Panchanathan S (2008) Neuro-cognitively inspired haptic user interfaces. Multimedia Tools and Applications 37(1):15–38

    Article  Google Scholar 

  16. Kim JY, Kim J (2005) Decomposable decoding and display structure for scalable media visualization over advanced collaborative environments. In: Proc. SPIE ITCOM’05: multimedia systems and applications VIII

  17. Kim JP, Ryu J (2009) Robustly stable haptic interaction control using an energy-bounding algorithm. Int J Rob Res. doi:10.1177/0278364909338770

    Google Scholar 

  18. Lee S, Kim J (2007) Haptic event prioritization and network adaptation scheme for collaborative virtual environments. In: Proc. IEEE GLOBECOM’07, pp 1–5

  19. Lee S, Kim J (2009) Priority-based haptic event filtering for transmission and error control in networked virtual environments. Multimedia Syst 15(6):355–367

    Article  Google Scholar 

  20. Lee S, Kim J (2009) Transparency analysis and delay compensation scheme for haptic-based networked virtual environments. Comput Commun 32(5):992–999. doi:10.1016/j.comcom.2008.12.028

    Article  Google Scholar 

  21. Lee Y, Woo W (2007) Interactive edutainment system with enhanced personalized user interface framework. IEEE Trans Consum Electron 53:424–432

    Article  Google Scholar 

  22. Lee S, Ishibashi Y, Kim J (2009) Transparency analysis and haptic synchronization for transparency of force-reflecting teleoperation. In: Proc. ACM NetGames’09

  23. Lu X, Song A (2008) Stable haptic rendering with detailed energy-compensating control. Comput Graph 32:561–567

    Article  Google Scholar 

  24. Nam S, Deshpande S, Vishwanath V, Jeong B, Renambot L, Leigh J (2010) Multiapplication intertile synchronization on ultra-high-resolution display walls. In: Proc. ACM multimedia systems’10

  25. Navrátil PA, Westing B, Johnson GP, Athalye A, Carreno J, Rojas F (2009) A practical guide to large tiled displays. In: Proc. the 5th international symposium on advances in visual computing, pp 970–981

  26. Ni T, Schmidt GS, Staadt OG, Livingston MA, Ball R, May R (2006) A survey of large high-resolution display technologies, techniques, and applications. In: Proc. IEEE conference on virtual reality’06

  27. Niederauer C, Houston M, Agrawala M, Humphreys G (2003) Non-invasive interactive visualization of dynamic architectural environments. ACM Trans Graph 22(3):700–700

    Article  Google Scholar 

  28. Orozco M, Graydon M, Shirmohammadi S, El Saddik A (2008) Experiments in haptic-based authentication of humans. Multimedia Tools and Applications 37(1):73–92

    Article  Google Scholar 

  29. Ouhyoung M, Tsai WN, Tsai MC, Wu JR, Huang CH, Yang TJ (1995) A low-cost force feedback joystick and its use in pc video games. IEEE Trans Consum Electron 41:787–794

    Article  Google Scholar 

  30. Ramanathan S, Rangan PV, Vin HM (1992) Integrating virtual reality, tele-conferencing, and entertainment into multimedia home computers. IEEE Trans Consum Electron 38:70–76

    Article  Google Scholar 

  31. Renambot L, Jeong B, Hur H, Johnson A, Leigh J (2000) Enabling high resolution collaborative visualization in display rich virtual organizations. Future Gener Comput Syst 25:161–168

    Article  Google Scholar 

  32. Renambot L, Rao A, Singh R, Jeong B, Krishnaprasad N, Vishwanath V, Chandrasekhar V, Schwarz N, Spale A, Zhang C (2004) Sage: the scalable adaptive graphics environment. In: Proc. workshop on advanced collaborative environments (WACE)’04

  33. Singhal S, Zyda M (1999) Networked virtual environments: design and implementation. ACM Press/Addison-Wesley, Reading, MA

    Google Scholar 

  34. Wen K, Necsulescu D, Sasiadek J (2008) Haptic force control based on impedance/admittance control aided by visual feedback. Multimedia Tools and Applications 37(1):39–52

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the MKE (The Ministry of Knowledge Economy), Korea, under the ITRC (Information Technology Research Center) support program supervised by the NIPA (National IT Industry Promotion Agency) NIPA-2010-(C1090-1011-0004)).

Author information

Authors and Affiliations

  1. Networked Media Laboratory, Department of Information and Communications, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea

    Seokhee Lee & JongWon Kim

  2. Multiagent Systems Laboratory, Department of Information and Communications, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea

    Seokho Son

Authors
  1. Seokhee Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seokho Son
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. JongWon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to JongWon Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, S., Son, S. & Kim, J. Cost-effective haptic-based networked virtual environments with high-resolution tiled display. Multimed Tools Appl 54, 365–384 (2011). https://doi.org/10.1007/s11042-010-0535-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0535-x

Keywords

Search

Navigation