Multimedia Tools and Applications

, Volume 49, Issue 1, pp 145–166

GameSense: game-like in-image advertising



Considering the continuously increasing availability and accessibility of multimedia contents via social networking sites, our research addresses how to monetize the social multimedia contents with an efficient advertising approach. This paper presents a novel game-like advertising system called GameSense, which is driven by the compelling contents of online images. The contextually relevant ads (i.e., product logos) are embedded at appropriate positions within the online games, which are created on the basis of online images. The ads are selected based on multimodal relevance, i.e. text relevance, user relevance and visual content similarity. The game is able to provide viewers rich experience and thus promotes the embedded ads to provide more effective advertising. GameSense represents one of the first attempts toward effective online mashup applications which connect a photo-sharing site with an advertising agency. The effectiveness of GameSense is evaluated over a large-scale real world image set.


Semantic multimedia Multimedia mashup Online advertising Game 


  1. 1.
    Baeza-Yates R, Ribeiro-Neto B (1999) Modern information retrieval. Addison Wesley, ReadingGoogle Scholar
  2. 2.
    Broder A, Fontoura M, Josifovski V, Riedel L (2007) A semantic approach to contextual advertising. In: Proceedings of SIGIRGoogle Scholar
  3. 3.
    Chen X, Zhang H-J (2001) Text area detection from video frames. In: Proceedings of the IEEE pacific rim conference on multimedia, pp 222–228Google Scholar
  4. 4.
    Dai H, Zhao L, Nie Z, Wen J-R, Wang L, Li Y (2006) Detecting online commercial intention. In: Proceedings of WWWGoogle Scholar
  5. 5.
    Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):1–60CrossRefGoogle Scholar
  6. 6.
    He X, Cai D, Wen J-R, Ma W-Y, Zhang H-J (2007) Clustering and searching WWW images using link and page layout analysis. ACM Trans Multimedia Comput Commun Appl 3(2)Google Scholar
  7. 7.
    Hu J, Zeng H-J, Li H, Niu C, Chen Z (2007) Demographic prediction based on user’s browsing behavior. In: Proceedings of WWWGoogle Scholar
  8. 8.
    Hua X-S, Mei T, Li S (2008) When multimedia advertising meets the new internet era. In: Workshop on multimedia signal processingGoogle Scholar
  9. 9.
    Joshi A, Motwani R (2006) Keyword generation for search engine advertising. In: Proceedings of the workshops of IEEE international conference on data miningGoogle Scholar
  10. 10.
    Kastidou G, Cohen R (2006) An approach for delivering personalized ads in interactive TV customized to both users and advertisers. In: Proceedings of European conference on interactive televisionGoogle Scholar
  11. 11.
    Kennedy LS, Chang SF, Kozintsev IV (2006) To search or to label? Precdicting the performance of search-based automatic image classifiers. In: Proceedings of the 8th ACM international workshop on multimedia information retrievalGoogle Scholar
  12. 12.
    Lacerda A, Cristo M, Goncalves MA, et al (2006) Learning to advertise. In: Proceedings of SIGIRGoogle Scholar
  13. 13.
    Li SZ, Zhu L, Zhang Z, Blake A, Zhang H-J, Shum H (2002) Statistical learning of multi-view face detection. In: Proceedings of European conference on computer vision, pp 67–81Google Scholar
  14. 14.
    Li H, Zhang D, Hu J, Zeng H-J, Chen Z (2007) Finding keyword from online broadcasting content for targeted advertising. In: International workshop on data mining and audience intelligence for advertisingGoogle Scholar
  15. 15.
    Li Z, Zhang L, Ma W-Y (2008) Delivering online advertisements inside images. In: Proceedings of ACM multimedia, pp 1051–1060Google Scholar
  16. 16.
    Liao W-S, Chen K-T, Hsu WH (2008) Adimage: video advertising by image matching and ad scheduling optimization. In: Proceedings of SIGIR, pp 767–768Google Scholar
  17. 17.
    Lim J, Kim M, Lee B, Kim M, Lee H, Lee H-K (2008) A target advertisement system based on TV viewer’s profile reasoning. Multimed Tools Appl 36Google Scholar
  18. 18.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  19. 19.
    Ma Y-F, Zhang H-J (2003) Contrast-based image attention analysis by using fuzzy growing. In: Proceedings of ACM multimedia, pp 374–381Google Scholar
  20. 20.
    Mccoy S, Everard A, Polak P, Galletta DF (2007) The effects of online advertising. Commun ACM 50(3):84–88CrossRefGoogle Scholar
  21. 21.
    Mehta A, Saberi A, Vazirani U, Vazirani V (2007) Adwords and generalized on-line matching. J ACM 54:5CrossRefMathSciNetGoogle Scholar
  22. 22.
    Mei T, Hua X-S, Lai W, Yang L, et al (2007) MSRA-USTC-SJTU at TRECVID 2007: high-level feature extraction and search. In: TREC video retrieval evaluation online proceedingsGoogle Scholar
  23. 23.
    Mei T, Hua X-S, Yang L, Li S (2007) VideoSense: towards effective online video advertising. In: Proceedings of ACM multimedia, Augsburg, Germany, pp 1075–1084Google Scholar
  24. 24.
    Mei T, Hua X-S, Li S (2008) Contextual in-image advertising. In: Proceedings of ACM multimedia, pp 439–448Google Scholar
  25. 25.
    Murdock V, Ciaramita M, Plachouras V (2007) A noisy channel approach to contextual advertising. In: International workshop on data mining and audience intelligence for advertisingGoogle Scholar
  26. 26.
    Patrali C, Donna H, Thomas N (2003) Modeling the clickstream: implications for web-based advertising efforts. Mark Sci 22(4):520–541CrossRefGoogle Scholar
  27. 27.
    Ribeiro-Neto B, Cristo M, Golgher PB, Moura ES (2005) Impedance coupling in content-targeted advertising. In: Proceedings of SIGIRGoogle Scholar
  28. 28.
    Richardson M, Dominowska E, Ragno R (2007) Predicting clicks: estimating clickthrough rate for new ads. In: Proceedings of WWWGoogle Scholar
  29. 29.
    Srinivasan SH, Sawant N, Wadhwa S (2007) vADeo: video advertising system. In: Proceedings of ACM multimedia, pp 455–456Google Scholar
  30. 30.
    Tuchinda R, Szekely P, Knoblock CA (2008) Building mashups by example. In: Proceedings of the 13th international conference on intelligent userGoogle Scholar
  31. 31.
    Yang Y, Liu X (1999) A re-examination of text categorization methods. In: Proceedings of SIGIRGoogle Scholar
  32. 32.
    Yih W-T, Goodman J, Carvalho VR (2006) Finding advertising keywords on web pages. In: Proceedings of WWWGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.State Key Laboratory of Software Development EnvironmentBeihang UniversityBeijingPeople’s Republic of China
  2. 2.Microsoft Research AsiaBeijingPeople’s Republic of China

Personalised recommendations