Snap2Play: A Mixed-Reality Game Based on Scene Identification

  • Tat-Jun Chin
  • Yilun You
  • Celine Coutrix
  • Joo-Hwee Lim
  • Jean-Pierre Chevallet
  • Laurence Nigay
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4903)

Abstract

The ubiquity of camera phones provides a convenient platform to develop immersive mixed-reality games. In this paper we introduce such a game which is loosely based on the popular card game “Memory”, where players are asked to match a pair of identical cards among a set of overturned cards by revealing only two cards at a time. In our game, the players are asked to match a “physical card”, which is an image of a scene in the real world, to a “digital card”, which corresponds to a scene in a virtual world. The objective is to convey a mixed-reality sensation. Cards are matched with a scene identification engine which consists of multiple classifiers trained on previously collected images. We present our comprehensive overall game design, as well as implementation details and results. Additionally, we also describe how we constructed our scene identification engine and its performance.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Strachan, S., Williamson, J., Murray-Smith, R.: Show me the way to monte carlo: density-based trajectory navigation. In: Proceedings of ACM SIG CHI (2007)Google Scholar
  2. 2.
    Ballagas, R.A., Kratz, S.G., Borchers, J., Yu, E., Walz, S.P., Fuhr, C.O., Hovestadt, L., Tann, M.: REXplorer: a mobile, pervasive spell-casting game for tourists. In: CHI 2007. Extended Abstracts on Human Factors in Computing Systems (2007)Google Scholar
  3. 3.
    Fergus, R., Perona, P., Zisserman, A.: Object class recognition by unsupervised scale-invariant learning. In: Computer Vision and Pattern Recognition (2003)Google Scholar
  4. 4.
    Li, F.F., Perona, P.: A Bayesian hierarchical model for learning natural scene categories. In: Computer Vision and Pattern Recognition (2005)Google Scholar
  5. 5.
    Opelt, A., Pinz, A., Fussenegger, M., Auer, P.: Generic object recognition with boosting. Pattern Analysis and Machine Intelligence 28(3), 416–431 (2006)CrossRefGoogle Scholar
  6. 6.
    Lim, J.H., Chevallet, J.P., Gao, S.: Scene identification using discriminative patterns. In: International Conference on Pattern Recognition (2006)Google Scholar
  7. 7.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  8. 8.
    Bouchet, J., Nigay, L.: ICARE: A component-based approach for the design and development of multimodal interfaces. In: Extended Abstracts of CHI 2004 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Tat-Jun Chin
    • 1
  • Yilun You
    • 1
  • Celine Coutrix
    • 2
  • Joo-Hwee Lim
    • 1
  • Jean-Pierre Chevallet
    • 1
  • Laurence Nigay
    • 2
  1. 1.Image Perception, Access and Language Lab, Institute for Infocomm ResearchSingapore
  2. 2.Laboratoire d’Informatique de Grenoble, Université Joseph Fourier, B.P. 53, 38041 Grenoble cedex 9France

Personalised recommendations