Skip to main content
SpringerLink
Log in

Point & click mediated interactions for large home entertainment displays

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This work introduces and discusses the implementation details of a novel concept for a home entertainment system together with an affordable controlling interface that uses point & click interactions in order to create, mix and manipulate media screens within the same projection-based display. Scenarios for single and multiple viewers are discussed with users being able to create, reposition, resize, and control their own-defined media screens. The standard and familiar WIMP interaction techniques are transferred from PCs to home entertainment using a motion-sensing remote controller. An optional system feature is described for the automatic configuration of such media screens by analyzing the home environment using computer vision techniques. Observations from initial user studies are reported with regards to the perceived usefulness and acceptability of the proposed system. The main benefit introduced by this work is that of a large entertainment display that becomes shared and personalized while it is being adapted and fit into the home environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://wii.com/

  2. http://procrastineering.blogspot.com/

  3. http://www.wiimoteproject.com/

References

  1. Ahlborn BA, Thompson D, Kreylos O, Hamann B, Staadt OG (2005) A practical system for laser pointer interaction on large displays. In: Proceedings of the ACM symposium on Virtual reality software and technology, VRST 2005 (Monterey, CA, USA), 106–109. ACM, New York, USA. doi:10.1145/1101616.1101637

  2. Bernhaupt R, Obrist M, Weiss A, Beck E, Tscheligi M (2007) Trends in the Living Room and Beyond. In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 146–155, Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_16

  3. Bernhaupt R, Obrist M, Weiss A, Beck E, Tscheligi M (2008) Trends in the living room and beyond: results from ethnographic studies using creative and playful probing, Computers in Entertainment 6(1): 1–23. ACM, New York, USA. doi:10.1145/1350843.1350848

  4. Bi X, Shi Y, Chen X, Xiang P (2005) uPen: laser-based, personalized, multi-user interaction on large displays. In: Proceedings of the 13th annual ACM international conference on Multimedia, MULTIMEDIA 2005 (Hilton, Singapore), 1049–1050. ACM, New York, USA. doi:10.1145/1101149.1101370

  5. Bolt RA (1980) Put-that-there: Voice and gesture at the graphics interface. In: Proceedings of the 7th annual conference on Computer graphics and interactive techniques, SIGGRAPH 1980 (Seattle, Washington, United States), 262–270. ACM, New York, USA. doi:10.1145/800250.807503

  6. Cao X, Balakrishnan R (2004) VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. In: Proceedings of the 16th annual ACM symposium on User interface software and technology, UIST 2004 (Vancouver, Canada), 173–182. ACM, New York, USA. doi:10.1145/964696.964716

  7. Cotting D, Gross M (2006) Interactive environment-aware display bubbles. In: Proceedings of the 19th annual ACM symposium on User interface software and technology, UIST 2006 (Montreux, Switzerland), 245–254. ACM, New York, USA. doi:10.1145/1166253.1166291

  8. Crow FC (1984) Summed-area tables for texture mapping. In: Proceedings of the 11th annual conference on Computer graphics and interactive techniques, SIGGRAPH ‘84, 207–212, ACM, New York, USA. doi:10.1145/800031.808600

  9. Cui Y, Chipchase J, Jung Y (2007) Personal TV: a qualitative study of mobile TV users. In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 195–204, Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_21

  10. Eronen L (2003) User Centered Research for Interactive Television. In: Proceedings of the 1st Conference on Interactive Television, EuroITV 2003 (April 2–4, Brighton, UK), 5–12

  11. Forlines C, Balakrishnan R, Beardsley P, van Baar J, Raskar R (2005) Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23–26, 2005). UIST ‘05. ACM, New York, NY, 73–82. doi:10.1145/1095034.1095046

  12. Freeman WT, Weissman CD (1995) Television control by hand gestures. In: IEEE International Workkshop on Automatic Face and Gesture Recognition

  13. Khan A, Fitzmaurice G, Almeida D, Burtnyk N, Kurtenbach G (2004) A remote control interface for large displays. In: Proceedings of the 17th annual ACM symposium on User interface software and technology, UIST 2004, 127–136. ACM, New York, USA. doi:10.1145/1029632.1029655

  14. Lee JC (2008) Hacking the Nintendo Wii remote. IEEE Pervasive Computing 7(3):39–45

    Article  Google Scholar 

  15. Lee JC, Hudson SE, Summet JW, Dietz PH (2005) Moveable interactive projected displays using projector based tracking. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23–26, 2005). UIST ‘05. ACM, New York, NY, 63–72. doi:10.1145/1095034.1095045

  16. Levin A, Fergus R, Durand F, Freeman WT (2007) Image and depth from a conventional camera with a coded aperture. ACM Trans Graph 26(3):70. doi:10.1145/1276377.1276464

    Article  Google Scholar 

  17. Malik S, Ranjan A, Balakrishnan R (2005) Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST 2005 (Seattle, WA, USA), 43–52. ACM, New York, USA. doi:10.1145/1095034.1095042

  18. McArthur V, Castellucci SJ, MacKenzie IS (2009) An empirical comparison of “wiimote” gun attachments for pointing tasks. In: Proceedings of the 1st ACM SIGCHI Symposium on Engineering interactive Computing Systems (Pittsburgh, PA, USA, July 15–17, 2009). EICS ‘09. ACM, New York, NY, 203–208. doi:10.1145/1570433.1570471

  19. Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, CHI 2002 (Minneapolis, Minnesota, USA), 33–40. ACM, New York, USA. doi:10.1145/503376.503383

  20. Natapov D, Castellucci SJ, MacKenzie IS (2009) ISO 9241–9 evaluation of video game controllers. In: Proceedings of Graphics interface 2009 (Kelowna, British Columbia, Canada, May 25–27, 2009). ACM International Conference Proceeding Series, vol. 324. Canadian Information Processing Society, Toronto, Ont., Canada, 223–230

  21. Oksman V, Noppari E, Tammela A, Makinen M, Ollikainen V (2007) Mobile TV in everyday life contexts: Individual Entertainment or Shared Experiences? In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 215–225. Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_23

  22. Pinhanez C (2001) Using a steerable projector and a camera to transform surfaces into interactive displays. In: CHI ‘01 extended abstracts on Human factors in computing systems (Seattle, Washington), 369–370. ACMPress, New York, USA. doi:10.1145/634067.634285

  23. Pratt WK (2001) Digital image processing, 3rd edn. Wiley, New York

    Book  Google Scholar 

  24. Rehm M, Bee N, Andre E (2008) Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions. In: Proceedings of the 22nd British HCI Group Annual Conference on HCI 2008 (Liverpool, United Kingdom), 13–22. British Computer Society

  25. Schlomer T, Poppinga B, Henze N, Boll S (2008) Gesture recognition with a Wii controller. In: Proceedings of the 2nd international conference on Tangible and embedded interaction, TEI 2008, 11-14. ACM Press, New York, USA. doi:10.1145/1347390.1347395

  26. Shoemaker G, Tang A, Booth KS (2007) Shadow reaching: a new perspective on interaction for large displays. In: Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07–10, 2007). UIST ‘07. ACM, New York, NY, 53–56. doi:10.1145/1294211.1294221

  27. Vatavu RD, Pentiuc SG (2008) Interactive coffee tables: Interfacing TV within an Intuitive, Fun and Shared Experience. In: Proceedings of the 6th European Interactive TV Conference, EuroITV 2008 (Salzburg, Austria, July 2008), LNCS 5066, pp. 183–187. Springer Berlin/Heidelberg. doi:10.1007/978-3-540-69478-6_24

  28. Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST 2005 (Seattle, WA, USA), 33–42. ACM Press, New York, USA. doi:10.1145/1095034.1095041

  29. Wilson A, Shafer S (2003) XWand: UI for intelligent spaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05–10, 2003). CHI ‘03. ACM, New York, NY, 545–552. doi:10.1145/642611.642706

  30. Yang R, Gotz D, Hensley J, Towles H, Brown MS (2001) PixelFlex: a reconfigurable multi-projector display system. In: Proceedings of the conference on Visualization, VIS 2001 (San Diego, California), 167–174. IEEE Computer Society

Download references

Acknowledgments

This paper was supported by the project Progress and development through post-doctoral research and innovation in engineering and applied sciences– PRiDE - Contract no. POSDRU/89/1.5/S/57083, project co-funded from European Social Fund through Sectorial Operational Program Human Resources 2007-2013.

Author information

Authors and Affiliations

  1. University “Stefan cel Mare” of Suceava, 13 Universitatii, 720229, Suceava, Romania

    Radu-Daniel Vatavu

Authors
  1. Radu-Daniel Vatavu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radu-Daniel Vatavu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vatavu, RD. Point & click mediated interactions for large home entertainment displays. Multimed Tools Appl 59, 113–128 (2012). https://doi.org/10.1007/s11042-010-0698-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0698-5

Keywords

Search

Navigation