Advertisement

Multimedia Tools and Applications

, Volume 34, Issue 1, pp 1–23 | Cite as

Content-based retrieval of Flash™ movies: research issues, generic framework, and future directions

  • Jun Yang
  • Qing LiEmail author
  • Liu Wenyin
  • Yueting Zhuang
Article

Abstract

As a prevailing web media format, nowadays Flash™ movies are created, delivered, and viewed by over millions of users in their daily experiences with the Internet. However, issues regarding the indexing and retrieval of Flash movies are unfortunately overlooked by the research community, which severely restrict the utilization of the extremely valuable Flash resource. A close examination reveals that the intrinsic complexity of a Flash movie, including its heterogeneous media components, its dynamic nature, and user interactivity, makes content-based Flash retrieval a host of research issues not thoroughly addressed by the existing techniques. As the first endeavor in this area, we propose a generic framework termed as FLAME (FLash Access and Management Environment) embodying a 3-layer structure that addresses the representation, indexing, and retrieval of Flash movies by mining and understanding of the movie content. An experimental prototype for Flash retrieval is implemented to verify the feasibility and effectiveness of FLAME, and future research directions on Flash management and retrieval are discussed in details.

Keywords

Flash animation Content-based retrieval Multimedia information retrieval 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adali S, Sapino ML, Subrahmanian VS (2000) An algebra for creating and querying multimedia presentations. ACM Multimedia Syst 8(3):212–230CrossRefGoogle Scholar
  2. 2.
    Al-Khatib W, Ghafoor A (1999) An approach for video meta-data modeling and query processing. In Proc. of ACM Multimedia, pp 215–224Google Scholar
  3. 3.
    Chan SSM, Li Q (1999) Developing an object-oriented video database system with spatio-temporal reasoning capabilities. In Proc. 18th Int. Conf. on Conceptual Modeling, LNCS 1728, pp 47–61Google Scholar
  4. 4.
    Chang SK, Shi QY, Yan CY (1987) Iconic indexing by 2-D strings. IEEE Tran Pattern Anal Machine Intell 9(3):413–428CrossRefGoogle Scholar
  5. 5.
    Chang SF, Chen W, Meng HJ, Sundaram H, Zhong D (1997) VideoQ: an automated content based video search system using visual cues. In Proc. ACM Int. Multimedia Conf., pp 313–324Google Scholar
  6. 6.
    Elmasri R, Navathe B (1994) Fundamentals of database systems (2 Edition). Benjamin/Cummings, Redwood City, CAzbMATHGoogle Scholar
  7. 7.
  8. 8.
    Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the QBIC system. IEEE Comput 28(9):23–32Google Scholar
  9. 9.
    Foote J (1999) An overview of audio information retrieval. ACM Multimedia Syst 7:2–10CrossRefGoogle Scholar
  10. 10.
    Furht B (1998) Handbook of multimedia computing. CRC, Sep.Google Scholar
  11. 11.
    Gudivada VN, Raghavan (1995) Design and evaluation of algorithms for image retrieval by spatial similarity. ACM Trans Inf Sys 13(2):115–144CrossRefGoogle Scholar
  12. 12.
    Hauptmann A, Ng TD, Baron R, Lin W, Chen, MY, Derthick M, Christel M, Jin R, Yan R (2002) Video classification and retrieval with the informedia digital video library system. Text Retrieval Conference, Gaithersburg, Maryland, NovemberGoogle Scholar
  13. 13.
    Hjelsvold R, Midtstraum R (1994) Modeling and querying video data. In Proc. 20th Int. Conf. Very Large Database, pp 686–694Google Scholar
  14. 14.
  15. 15.
    Lee T, Sheng L, Bozkaya T, Ozsoyoglu G, Ozsoyoglu M (1999) Querying multimedia presentations based on content. IEEE Trans Knowl Data Eng 11(3):361–387CrossRefGoogle Scholar
  16. 16.
    Liu WY, Chen Z, Lin F, Yang R, Li MJ, Zhang HJ (2001) Ubiquitous media agents for managing personal multimedia files. In Proc. ACM Multimedia Conf., pp 519–521Google Scholar
  17. 17.
    Macromedia, Inc. http://www.macromedia.com
  18. 18.
    Macromedia Flash Player adoption statistics. http://www.macromedia.com/software/player_census/flashplayer
  19. 19.
  20. 20.
    Niblack W, SlideFinder W (1999) A tool for browsing presentation graphics using content-based retrieval. In IEEE Workshop on Content-Based Access of Image and Video Libraries, June 22–22, Fort Collins, ColoradoGoogle Scholar
  21. 21.
    Ozsoyoglu G, Snodgrass R (1995) Temporal and real-time databases: a survey. IEEE Trans Knowl Data Eng 7(4):513–532CrossRefGoogle Scholar
  22. 22.
    Rui Y, Huang TS, Mehrotra S (1997) Content-based image retrieval with relevance feedback in MARS. In Proc. IEEE Int. Conf. on Image Processing, pp 815–818Google Scholar
  23. 23.
    Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool in interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8(5):644–655CrossRefGoogle Scholar
  24. 24.
    Salton G, McGill MJ (1983) Introduction to modern information retrieval. McGraw-HillGoogle Scholar
  25. 25.
    Samet H (1984) The quadtree and related hierarchical data structures. ACM Comput Surv 16(2):187–260CrossRefMathSciNetGoogle Scholar
  26. 26.
    Smeulders A et al (2000) Content-based image retrieval at then end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380CrossRefGoogle Scholar
  27. 27.
    Smith JR, Chang SF (1996) VisualSEEk: a fully automated content-based image query system. In Proc. of ACM Multimedia Conf., Boston, MA, pp 87–98Google Scholar
  28. 28.
    Synchronized Multimedia Integration Language (SMIL). http://www.w3.org/AudioVideo/
  29. 29.
    Text Retrieval Conference (TREC) Data. http://trec.nist.gov/data.html
  30. 30.
    Woods S, Yang Q (1995) Program understanding as constraint satisfaction. In Proc. 2nd Working Conf. Reverse Engineering, pp 314–323, CanadaGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2006

Authors and Affiliations

  • Jun Yang
    • 1
    • 2
  • Qing Li
    • 1
    Email author
  • Liu Wenyin
    • 3
  • Yueting Zhuang
    • 4
  1. 1.Department of Computer Engineering and Information TechnologyCity University of Hong KongKowloonPeople’s Republic of China
  2. 2.School of Computer ScienceCarnegie Mellon UniversityPittsburghUSA
  3. 3.Department of Computer ScienceCity University of Hong KongKowloonPeople’s Republic of China
  4. 4.Department of Computer ScienceZhejiang UniversityHangzhouPeople’s Republic of China

Personalised recommendations