Abstract
The continuous evolution of smart devices has led to serious limitations in multimedia applications. The multimedia graphic design and animation and the increased use of rich and complex multimedia content on the web or other media have all created a need to diversify the accessibility of the content. Therefore several techniques are used today to design a universally accessible content. The main techniques that are still used to maintain accessibility is to create two parallel streams of design and development of the same content. Thus, the continuous evolution will certainly lead to create other streams. For this, the automatic reasoning on multimedia to allow a computer to modify the design according to different variables, devices capabilities, user status and context to provide personalized adapted content. In this paper, we propose an abstract document model called XMS short for XML Multimedia Specification; it describes the composition of an original multimedia document and can be extended to any document type. We present how we may use spatial information present in this document to adapt and modify the original document. We mainly focus on the spatial aspect of a web document, a combination of RCC8, qualitative distances, and directions are used to describe the layout of a set of objects. The level of granularity of the definition of the objects defines the level of details that will be processed by our PROLOG based inference system, simplified versions of algorithms from the inference system and how it works on the spatial dimension of the document are shown. In the end samples of how spatial relations manipulation algorithms work are illustrated.
Similar content being viewed by others
References
Adel A, Laborie S, Roose P (2014) Semantic context-aware adaptation platform architecture. Procedia Comput Sci 32:959–964
Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832–843
Archana P, Kulkarni SS (2015) Meta-heuristic approach for resource optimization in mobile real time video traffic. Int J Comput Appl 110:14
Bulterman DC, Rutledge LW (2008) SMIL 3.0: flexible multimedia for web mobile devices and daisy talking books. Springer Publishing Company Incorporated
Burnett I, Van de Walle R, Hill K, Bormans J, Pereira F (2003) Mpeg-21: goals and achievements. IEEE MultiMed 10(4):60–70
Burnett IS, Pereira F, Van de Walle R, Koenen R (2006) The MPEG-21 book. Wiley
Cavallaro A (2005) Universal multimedia access. In: Encyclopedia of multimedia technology and networking. IGI Global, pp 1001–1007
Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJ (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Medical Imag Graph 30(1):9–15
De Bra P, Smits D, Stash N (2006) The design of aha! In: Proceedings of the seventeenth conference on hypertext and hypermedia. ACM, pp 133–134
Dromzée C, Laborie S, Roose P (2013) A semantic generic profile for multimedia documents adaptation. In: Intelligent Multimedia technologies for networking applications: techniques and tools, pp 225–246
Ellis TJ (2001) Multimedia enhanced educational products as a tool to promote critical thinking in adult students. J Educ Multimed Hypermed 10(2):107–124
Euzenat J, Layaïda N, Dias V (2003) A semantic framework for multimedia document adaptation. In: Proceedings of the 18th international joint conference on artificial intelligence IJCAI’2003. https://hal.inria.fr/inria-00423411. Morgan Kauffman, Acapulco, pp 31–36
Frank AU (1992) Qualitative spatial reasoning about distances and directions in geographic space. J Vis Lang Comput 3(4):343–371
Frank AU (1996) Qualitative spatial reasoning: cardinal directions as an example. Int J Geogr Inf Sci 10(3):269–290
Freire J, Kumar B, Lieuwen D (2001) Webviews: accessing personalized web content and services. In: Proceedings of the 10th international conference on World Wide Web. ACM, pp 576–586
Gerevini A, Nebel B (2002) Qualitative spatio-temporal reasoning with rcc-8 and allen’s interval calculus: computational complexity. In: Proceedings of the 15th European conference on artificial intelligence. IOS Press, pp 312–316
Gerevini A, Renz J (2002) Combining topological and size information for spatial reasoning. Artif Intell 137(1–2):1–42
Geurts J, van Ossenbruggen JR, Hardman HL (2001) Application-specific constraints for multimedia presentation generation. Centrum voor Wiskunde en Informatica
Hardman L, Bulterman DC, Van Rossum G (1994) The amsterdam hypermedia model: adding time and context to the Dexter model. Commun ACM 37(2):50–62
He J, Gao T, Hao W, l Yen I, Bastani F (2007) A flexible content adaptation system using a rule-based approach. IEEE Trans Knowl Data Eng 19 (1):127–140. https://doi.org/10.1109/TKDE.2007.250590
Held A, Buchholz S, Schill A (2002) Modeling of context information for pervasive computing applications. In: Proceedings of SCI, pp 167–180
Jones CB, Purves R, Ruas A, Sanderson M, Sester M, Van Kreveld M, Weibel R (2002) Spatial information retrieval and geographical ontologies an overview of the spirit project. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 387–388
Katai Z, Toth L (2010) Technologically and artistically enhanced multi-sensory computer-programming education. Teach Teacher Educ 26(2):244–251
Kiss C (2007) Composite capability/preference profiles (cc/pp): structure and vocabularies 2.0. W3C Working Draft, p 30
Lan X, Ma AJ, Yuen PC (2014) Multi-cue visual tracking using robust feature-level fusion based on joint sparse representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1194–1201
Lan X, Zhang S, Yuen PC (2016) Robust joint discriminative feature learning for visual tracking. In: IJCAI, pp 3403–3410
Lan X, Zhang S, Yuen PC, Chellappa R (2018) Learning common and feature-specific patterns: a novel multiple-sparse-representation-based tracker. IEEE Trans Image Process 27(4):2022–2037
Lasch P, Naumann D (1998) Ft-ir microspectroscopic imaging of human carcinoma thin sections based on pattern recognition techniques. Cellular Molec Biol (Noisy-le-Grand France) 44(1):189–202
Lei Z, Georganas ND (2001) Context-based media adaptation in pervasive computin. In: Canadian Conference on electrical and computer engineering, 2001, vol 2. IEEE, pp 913–918
Li Q, Yang J, Zhuang Y (2008) Multimedia information retrieval at a crossroad. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 242–249
Louafi H, Coulombe S, Chandra U (2015) Robust qoe-aware prediction-based dynamic content adaptation framework applied to slides documents in mobile web conferencing. Multimed Tools Appl 74(18):7883–7920
Mohan R, Smith JR, Li CS (1999) Adapting multimedia internet content for universal access. IEEE Trans Multimed 1(1):104–114
Osbakk P, Ryan NS (2002) Context, cc/pp, and p3p. UbiComp 2002 adjunct proceedings, pp 9–10
Renz J (2002) Qualitative spatial reasoning with topological information. Springer-Verlag
Reynolds F (1999) Composite capability/preference profiles (cc/pp): a user side framework for content negotiation. W3C note
Saravanaselvam N, Rajangam K, Dhanam L, Balasubramanian A (2015) Mobile web browsing based on content preserving with reduced cost. Int J Adv Network Appl 6(4):2398
Scherp A, Boll S (2008) Mm4u: A framework for creating personalized multimedia content. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 325–363
Sharma J, Flewelling DM (1995) Inferences from combined knowledge about topology and directions. In: International Symposium on spatial databases. Springer, pp 279–291
Van Essen DC, Anderson CH, Felleman DJ (1992) Information processing in the primate visual system: an integrated systems perspective. Science 255(5043):419–423
Vetro A (2004) Mpeg-21 digital item adaptation: enabling universal multimedia access. IEEE Multimed 11(1):84–87
Wang Y, Kim JG, Chang SF, Kim HM (2007) Utility-based video adaptation for universal multimedia access (uma) and content-based utility function prediction for real-time video transcoding. IEEE Trans Multimed 9(2):213–220
Yuan Z, Ghinea G, Muntean GM (2015) Beyond multimedia adaptation: quality of experience-aware multi-sensorial media delivery. IEEE Trans Multimed 17 (1):104–117
Zhang D, Jangam A, Zhou L, Yakut I (2015) Context-aware multimedia content adaptation for mobile web. Int J Netw Distrib Comput 3(1):1–10
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Belhadad, Y., Refoufi, A. & Roose, P. Spatial reasoning about multimedia document for a profile based adaptation. Multimed Tools Appl 77, 30437–30474 (2018). https://doi.org/10.1007/s11042-018-6080-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6080-8