Solving Conflicts in Video Semantic Annotation Using Consensus-Based Social Networking in a Smart TV Environment

  • Trong Hai Duong
  • Tran Hoang Chau Dao
  • Jason J. Jung
  • Ngoc Thanh Nguyen
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 282)


Smart TV media content can be embedded with available information from the Internet and shared via the Social Web. An increasing number of social videos are now available as well as traditional digital videos such as TV programs and video on demand (VOD). However, it is difficult to find relevant content due to a lack of semantic content. Therefore, there is a great need for multimedia content analysis techniques. In this work, we propose a framework of collaborative semantic video annotation using consensus-based social network. The collaborative video annotation process is organized via social networking. The media content is shared with friends of friend who collaboratively annotate it. We use ontologies to semantically describe the media content and share the media content amongst the users. A consensus choice is applied to conciliate conflicts on annotation information among the participants. According to our experiments, a consensus method is an effective approach that can be used to solve conflicts in a collaborative annotation.


Video Annotation Social Network Ontology Consensus Collaboration 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Duong, T.H., Jo, G.S., Jung, J.J., Nguyen, N.T.: Complexity Analysis of Ontology Integration Methodologies: A Comparative Study. Journal of Universal Computer Science 15(4), 877–897 (2009)MATHMathSciNetGoogle Scholar
  2. 2.
    Duong, T.H., Jo, G.S.: Collaborative Ontology Building by Reaching Consensus among Participants. Information-An International Interdisciplinary Journal 13(5), 1557–1569 (2010)Google Scholar
  3. 3.
    Duong, T.H., Nguyen, N.T., Jo, G.S.: A Hybrid Method for Integrating Multiple Ontologies. Cybernetics and Systems 40(2), 123–145 (2009)MATHCrossRefGoogle Scholar
  4. 4.
    Duong, T.H., Nguyen, N.T., Jo, G.S.: Constructing and Mining: A Semantic-Based Academic Social Network. Journal of Intelligent and Fuzzy Systems 21(3), 197–207 (2010)MATHGoogle Scholar
  5. 5.
    Kim, M.K., Park, J.H.:Demand forecasting and strategies for the successfully development of the smart TV in Korea? In: Proceeding of International Conference on Advanced Communication Technology, pp. 1475–1478 (2011)Google Scholar
  6. 6.
    Lo, T.: Overview of smart TV market platforms, business models and solutions, DIGITIMES Research, Taipei (Monday June 20, 2011)Google Scholar
  7. 7.
    Naphade, M., Smith, J.R., Tesic, J., Chang, S.F., Hsu, W., Kennedy, L., Hauptmann, A., Curtis, J.: Large-scale concept ontology for multimedia. IEEE Multimedia 13(3), 86–91 (2006)CrossRefGoogle Scholar
  8. 8.
    Sikora, T.: The MPEG-7 Visual standard for content description - an overview. IEEE Trans. on Circuits and Systems for Video Technology, special issue on MPEG-7 11(6), 696–702 (2001)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Pham, H.: Loglog fault-detection rate and testing coverage software reliability models subject to random environments. Vietnam Journal of Computer Science 1(1), 39–45 (2014)CrossRefGoogle Scholar
  10. 10.
    ISO/IEC 15938-5 FDIS Information Technology: MPEG-7 Multimedia Content Description Interface - Part 5: Multimedia Description Schemes (2001)Google Scholar
  11. 11.
    Jeong, J.W., Hong, H.K., Lee, D.H.: Ontology-based Automatic Video Annotation Technique in Smart TV Environment. IEEE Transactions on Consumer Electronics 57(4), 1830–1836 (2011)CrossRefGoogle Scholar
  12. 12.
    Francois, A.R.J., Nevatia, R., Hobbs, J., Bolles, R.C., Smith, J.R.: VERL: an ontology framework for representing and annotating video events. IEEE Multimedia 12(4), 76–86 (2005)CrossRefGoogle Scholar
  13. 13.
    Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.G.: DBpedia: A nucleus for a Web of open data. In: Aberer, K., et al. (eds.) ISWC/ASWC 2007. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007)Google Scholar
  14. 14.
    Bizer, C., Heath, T., Kingsley, I., Berners-Lee, T.: Linked data on the Web. In: Proc. WWW 2008 Workshop: LDOW (2008)Google Scholar
  15. 15.
    Hearst, M., English, J., Sinha, R., Swearingen, K., Yee, P.: Finding the Flow in Web Site Search. Communications of the ACM 45(9), 42–49 (2002)CrossRefGoogle Scholar
  16. 16.
    Kemeny, J.G.: Mathematics without Numbers. Daedalus 88(4), 577–591 (1959)Google Scholar
  17. 17.
    Nguyen, N.T.: Using Distance Functions to Solve Representation Choice Problems. Fundamenta Informaticae 48(4), 295–314 (2001)MathSciNetGoogle Scholar
  18. 18.
    Nguyen, N.T.: Consensus system for solving conflicts in distributed systems. Journal of Information Sciences 147(4), 91–122 (2002)MATHCrossRefGoogle Scholar
  19. 19.
    Nguyen, N.T.: Advanced Methods for Inconsistent Knowledge Management. Springer, London (2008)MATHCrossRefGoogle Scholar
  20. 20.
    Palau, J., Montaner, M., López, B., de la Rosa, J.L.: Collaboration analysis in recommender systems using social networks. In: Klusch, M., Ossowski, S., Kashyap, V., Unland, R. (eds.) CIA 2004. LNCS (LNAI), vol. 3191, pp. 137–151. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  21. 21.
    Park, K.W., Lee, J.H., Moon, Y.S., Park, S.H., Lee, D.H.: OLYVIA: Ontology-based Automatic Video Annotation and Summarization System Using Semantic Inference Rules. In: Proceedings of the Third International Conference on Semantics, Knowledge and Grid (SKG 2007), pp. 170–175. IEEE Computer Society (2007)Google Scholar
  22. 22.
    Renzel, D., Cao, Y., Lottko, M., Klamma, R.: Collaborative Video Annotation for Multimedia Sharing between Experts and Amateurs. In: Proceedings of the 11th International Workshop of the Multimedia Metadata Community, Barcelona, Spain, pp. 7–14 (2010)Google Scholar
  23. 23.
    Wei, S., Zhao, Y., Zhu, Z., Liu, N.: Multimodal fusion for video search reranking. IEEE Transactions on Knowledge and Data Engineering 22(8), 1191–1199 (2010)CrossRefGoogle Scholar
  24. 24.
    Hakeem, A., Lee, M.W., Javed, O., Haering, N.: Semantic video search using natural language queries. In: MM 2009: Proceedings of the Seventeen ACM International Conference on Multimedia, pp. 605–608. ACM, New York (2009)Google Scholar
  25. 25.
    Sebastine, S.C., Thuraisingham, B.M., Prabhakaran, B.: Semantic web for content based video retrieval. In: Proceedings of the 3rd IEEE International Conference on Semantic Computing (ICSC 2009), pp. 103–108. IEEE Computer Society, Berkeley (2009)CrossRefGoogle Scholar
  26. 26.
    Le, N.T., Nguyen, N.P., Seta, K., Pinkwart, N.: Automatic question generation for supporting argumentation. Vietnam Journal of Computer Science 1(1) (2014)Google Scholar
  27. 27.
    Kraaij, W., Over, P.: TRECVID-2005 high-level feature task: Overview. In: Proc. TRECVID, Gaithersburg, MD (2005)Google Scholar
  28. 28.
    Naphade, M.R., Smith, J.R.: On the detection of semantic concepts at TRECVID. In: Proc. ACM Multimedia, New York, pp. 660–667 (2004)Google Scholar
  29. 29.
    Snoek, C.G., Worring, M., Smeulders, A.W.: Early versus late fusion in semantic video analysis. In: Proc. ACM Multimedia, Singapore, pp. 399–402 (2005)Google Scholar
  30. 30.
    Volkmer, T., Smith, J.R., Natsev, A.: A web-based system for collaborative annotation of large image and video collections: an evaluation and user study. In: Proceedings of the 13th ACM International Conference on Multimedia, Singapore, pp. 892–901 (2005)Google Scholar
  31. 31.
    Yamamoto, D., Masuda, T., Ohira, S., Nagao, K.: Collaborative Video Scene Annotation Based on Tag Cloud. In: Huang, Y.-M.R., Xu, C., Cheng, K.-S., Yang, J.-F.K., Swamy, M.N.S., Li, S., Ding, J.-W. (eds.) PCM 2008. LNCS, vol. 5353, pp. 397–406. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  32. 32.
    Yamamoto, D., Masuda, T., Ohira, S., Nagao, K.: Video Scene Annotation Based on Web Social Activities. IEEE MultiMedia 15(3), 22–32 (2008)CrossRefGoogle Scholar
  33. 33.
    Dengler, F., Lamparter, S., Hefke, M., Abecker, A.: Collaborative Process Development using Semantic MediaWiki. In: Proceedings of the 5th Conference of Professional Knowledge Management, Solothurn, Switzerland, pp. 97–107 (2009)Google Scholar
  34. 34.
    Gruber, T.R.: Toward principles for the design of ontologies used for knowledge sharing. International Journal of Human Computer Studies 43(5), 907–928 (1995)CrossRefGoogle Scholar
  35. 35.
    Barnes, J.: Social Networks. Addison-Wesley, Reading (1972)Google Scholar
  36. 36.
    Scott, J.: Social network analysis. Sage, London (1991)Google Scholar
  37. 37.
    Wasserman, S., Galaskiewicz, J.: Advances in Social Network Analysis. Sage Publications (October 1994)Google Scholar
  38. 38.
    Gallagher, M., Hares, T., Spencer, J., Bradshaw, C., Webb, I.: The nominal group technique: a research tool for general practice? Family Practice 10(1), 76–81 (1993)CrossRefGoogle Scholar
  39. 39.
    Pill, J.: The Delphi method: substance, context, a critique and an annotated bibliography. Socioecon. Plann. Sci. 5, 57–71 (1971)CrossRefGoogle Scholar
  40. 40.
    Borgatti, S.P., Everett, M.G., Freeman, L.C.: Ucinet for windows: Software for social network analysis. Analytic Technologies, Harvard (2002)Google Scholar
  41. 41.
    Shin, C., Woo, W.: Socially aware tv program recommender for multiple viewers. IEEE Trans. Consumer Electron. 55(2), 927–932 (2009)CrossRefGoogle Scholar
  42. 42.
    Matsubara, F.M., Kawamori, M.: Lightweight interactive multimedia environment for TV. IEEE Trans. Consumer Electron. 57(1), 283–287 (2011)CrossRefGoogle Scholar
  43. 43.
    Lee, M.H.: The design of a heuristic algorithm for IPTV web page navigation by using remote controller. IEEE Trans. Consumer Electron. 56(3), 1775–1781 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Trong Hai Duong
    • 1
  • Tran Hoang Chau Dao
    • 1
  • Jason J. Jung
    • 2
  • Ngoc Thanh Nguyen
    • 3
  1. 1.International University- Vietnam National UniversityHo Chi MinhVietnam
  2. 2.Yeungnam UniversityDae-DongKorea
  3. 3.Institute of InformaticsWroclaw University of TechnologyWrocławPoland

Personalised recommendations