Modeling Color Dynamics for the Semantics of Commercials

  • Alberto Del Bimbo
  • Pietro Pala
  • Enrico Vicario
Part of the The Springer International Series in Video Computing book series (VICO, volume 4)


Retrieval of video based on content semantics requires that models are developed to map low level perceptual features into high level semantic concepts. Commercials are a video category where the link between low level perceptual features and high level semantics is stressed, since the way colors are chosen and modified throughout a commercial creates a large part of its message. In this chapter, we propose a model for the representation and comparison of video content based on dynamics of color regions in the video. A model is presented to define an intermediate level representation of color dynamics in terms of spatial arrangement of color flows. The model for representation and comparison of spatial relationships between extended sets of pixels in a 3D space is introduced by developing on the concept of weighted walkthroughs. Results of preliminary experiments are reported for a library of video commercials.


Video retrieval by semantic content representation of color dynamics spatio-temporal modeling color flows video commercials 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Ahuja, R.K., Magnanti, T.L., and Orlin, J.B. Network Flows, Prentice Hall, 1993.Google Scholar
  2. [2]
    Arndt, T. and Chang, S.K. Image sequence compression by iconic indexing. In IEEE VL '89 Workshop on Visual Languages, Roma, Italy, September 1989, pp. 177–182.Google Scholar
  3. [3]
    ASSAVID: Automatic Segmentation and Semantic Annotation of Sports Videos. European Project IST-1999-13082.Google Scholar
  4. [4]
    Berretti, S., Del Bimbo, A., and Vicario, E. Weighting spatial arrangement of colors in content based image retrieval. In IEEE Int. Conf. Multimedia Computing and Systems, Firenze, June 99.Google Scholar
  5. [5]
    Bertelli, B. La pubblicitazione: la citazione delle avanguardie storiche nelle pubblicità video e stampa. Ph.D. Thesis, Dept. of Visual Arts, University of Siena, Italy, 1997.Google Scholar
  6. [6]
    Chang, S.K., Shi, Q.Y., and Yan, C.W. Iconic indexing by 2-D strings. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 9, No. 3, pp. 413–427, July 1987.CrossRefGoogle Scholar
  7. [7]
    Colombo, C., Del Bimbo, A., and Pala, P. Semantics in visual information retrieval. IEEE Multimedia, Vol. 6, No. 3, pp. 38–53, 1999.CrossRefGoogle Scholar
  8. [8]
    Colombo, C., Del Bimbo, A., and Pala, P. Retrieval by semantic content of commercials: The semiotic perspective. Multimedia Tools and Applications, Vol. 13, pp. 93–118, 2001.zbMATHCrossRefGoogle Scholar
  9. [9]
    Del Bimbo, A. Visual Information Retrieval, Academic Press, London, 1999.Google Scholar
  10. [10]
    Del Bimbo, A., Pala, P., and Tanganelli, L. Retrieval of commercials based on dynamics of color flows. Journal of Visual Languages and Computing, Vol. 11, No. 3, June 2000, pp. 273–285.CrossRefGoogle Scholar
  11. [11]
    Del Bimbo, A. and Vicario, E. Weighted walkthroughs between extended entities for retrieval by spatial arrangement. To appear, IEEE Trans, on Multimedia.Google Scholar
  12. [12]
    Del Bimbo, A., Vicario, E., and Zingoni, D. Symbolic description of image sequences with spatio-temporal logic. IEEE Trans, on Knowledge and Data Engineering, Vol. 7, No. 4, pp. 609–621, August 1995.CrossRefGoogle Scholar
  13. [13]
    Floch, J.-M. Sémiotique, marketing et communication. Sous les signes, les stratégies. Presses Universitaires de France, Paris, France, 1990.Google Scholar
  14. [14]
    Gudivada, V.N. and Raghavan, V.V. Design and evaluation of algorithms for image retrieval by spatial similarity. ACM Trans, on Information Systems, Vol. 13, No. 2, April 1995.Google Scholar
  15. [15]
    Gupta, A., Jain, R., and Santini, S. Querying multiple perspective video. In Proc. of SPIE Vol. 3656, Storage and Retrieval for Image and Video Databases VII, San Jose, USA, January 1999.Google Scholar
  16. [16]
    Jain, A.K. and Dubes, R.C. Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs (NJ), 1991.Google Scholar
  17. [17]
    Lee, S.Y. and Hsu, F. Spatial reasoning and similarity retrieval of images using 2D C-strings knowledge representation. Pattern Recognition, Vol. 25, No. 3, pp. 305–318, 1992.MathSciNetCrossRefGoogle Scholar
  18. [18]
    Pike, J.M. and Harris, C.G. A combined corner and edge detector. In Proc. Fourth Alvey Vision Conference, pp. 147–151, 1988.Google Scholar
  19. [19]
    Ponceleon, D., Srinivasan, S., Amir, A., Petkovic, D., and Diklic, D. Key to effective video retrieval: Effective cataloging and browsing. In Proc. of the sixth ACM international conference on Multimedia, 1998, pp. 99–107.CrossRefGoogle Scholar
  20. [20]
    Uchiyama, T. and Arbib, M.A. Color image segmentation using competitive learning. IEEE Trans. Pattern Analysis and Machine Intelligence, (16)12, pp. 1197–1206, December 1994.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2002

Authors and Affiliations

  • Alberto Del Bimbo
    • 1
  • Pietro Pala
    • 1
  • Enrico Vicario
    • 1
  1. 1.Department of Systems and InformaticsUniversity of FlorenceFlorenceItaly

Personalised recommendations