Skip to main content
Log in

Spatial reasoning about multimedia document for a profile based adaptation

Combining distances, directions and topologies

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The continuous evolution of smart devices has led to serious limitations in multimedia applications. The multimedia graphic design and animation and the increased use of rich and complex multimedia content on the web or other media have all created a need to diversify the accessibility of the content. Therefore several techniques are used today to design a universally accessible content. The main techniques that are still used to maintain accessibility is to create two parallel streams of design and development of the same content. Thus, the continuous evolution will certainly lead to create other streams. For this, the automatic reasoning on multimedia to allow a computer to modify the design according to different variables, devices capabilities, user status and context to provide personalized adapted content. In this paper, we propose an abstract document model called XMS short for XML Multimedia Specification; it describes the composition of an original multimedia document and can be extended to any document type. We present how we may use spatial information present in this document to adapt and modify the original document. We mainly focus on the spatial aspect of a web document, a combination of RCC8, qualitative distances, and directions are used to describe the layout of a set of objects. The level of granularity of the definition of the objects defines the level of details that will be processed by our PROLOG based inference system, simplified versions of algorithms from the inference system and how it works on the spatial dimension of the document are shown. In the end samples of how spatial relations manipulation algorithms work are illustrated.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29

Similar content being viewed by others

References

  1. Adel A, Laborie S, Roose P (2014) Semantic context-aware adaptation platform architecture. Procedia Comput Sci 32:959–964

    Article  Google Scholar 

  2. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832–843

    Article  Google Scholar 

  3. Archana P, Kulkarni SS (2015) Meta-heuristic approach for resource optimization in mobile real time video traffic. Int J Comput Appl 110:14

    Google Scholar 

  4. Bulterman DC, Rutledge LW (2008) SMIL 3.0: flexible multimedia for web mobile devices and daisy talking books. Springer Publishing Company Incorporated

  5. Burnett I, Van de Walle R, Hill K, Bormans J, Pereira F (2003) Mpeg-21: goals and achievements. IEEE MultiMed 10(4):60–70

    Article  Google Scholar 

  6. Burnett IS, Pereira F, Van de Walle R, Koenen R (2006) The MPEG-21 book. Wiley

  7. Cavallaro A (2005) Universal multimedia access. In: Encyclopedia of multimedia technology and networking. IGI Global, pp 1001–1007

  8. Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJ (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Medical Imag Graph 30(1):9–15

    Article  Google Scholar 

  9. De Bra P, Smits D, Stash N (2006) The design of aha! In: Proceedings of the seventeenth conference on hypertext and hypermedia. ACM, pp 133–134

  10. Dromzée C, Laborie S, Roose P (2013) A semantic generic profile for multimedia documents adaptation. In: Intelligent Multimedia technologies for networking applications: techniques and tools, pp 225–246

  11. Ellis TJ (2001) Multimedia enhanced educational products as a tool to promote critical thinking in adult students. J Educ Multimed Hypermed 10(2):107–124

    MathSciNet  Google Scholar 

  12. Euzenat J, Layaïda N, Dias V (2003) A semantic framework for multimedia document adaptation. In: Proceedings of the 18th international joint conference on artificial intelligence IJCAI’2003. https://hal.inria.fr/inria-00423411. Morgan Kauffman, Acapulco, pp 31–36

  13. Frank AU (1992) Qualitative spatial reasoning about distances and directions in geographic space. J Vis Lang Comput 3(4):343–371

    Article  Google Scholar 

  14. Frank AU (1996) Qualitative spatial reasoning: cardinal directions as an example. Int J Geogr Inf Sci 10(3):269–290

    Article  Google Scholar 

  15. Freire J, Kumar B, Lieuwen D (2001) Webviews: accessing personalized web content and services. In: Proceedings of the 10th international conference on World Wide Web. ACM, pp 576–586

  16. Gerevini A, Nebel B (2002) Qualitative spatio-temporal reasoning with rcc-8 and allen’s interval calculus: computational complexity. In: Proceedings of the 15th European conference on artificial intelligence. IOS Press, pp 312–316

  17. Gerevini A, Renz J (2002) Combining topological and size information for spatial reasoning. Artif Intell 137(1–2):1–42

    Article  MathSciNet  Google Scholar 

  18. Geurts J, van Ossenbruggen JR, Hardman HL (2001) Application-specific constraints for multimedia presentation generation. Centrum voor Wiskunde en Informatica

  19. Hardman L, Bulterman DC, Van Rossum G (1994) The amsterdam hypermedia model: adding time and context to the Dexter model. Commun ACM 37(2):50–62

    Article  Google Scholar 

  20. He J, Gao T, Hao W, l Yen I, Bastani F (2007) A flexible content adaptation system using a rule-based approach. IEEE Trans Knowl Data Eng 19 (1):127–140. https://doi.org/10.1109/TKDE.2007.250590

    Article  Google Scholar 

  21. Held A, Buchholz S, Schill A (2002) Modeling of context information for pervasive computing applications. In: Proceedings of SCI, pp 167–180

  22. Jones CB, Purves R, Ruas A, Sanderson M, Sester M, Van Kreveld M, Weibel R (2002) Spatial information retrieval and geographical ontologies an overview of the spirit project. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 387–388

  23. Katai Z, Toth L (2010) Technologically and artistically enhanced multi-sensory computer-programming education. Teach Teacher Educ 26(2):244–251

    Article  Google Scholar 

  24. Kiss C (2007) Composite capability/preference profiles (cc/pp): structure and vocabularies 2.0. W3C Working Draft, p 30

  25. Lan X, Ma AJ, Yuen PC (2014) Multi-cue visual tracking using robust feature-level fusion based on joint sparse representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1194–1201

  26. Lan X, Zhang S, Yuen PC (2016) Robust joint discriminative feature learning for visual tracking. In: IJCAI, pp 3403–3410

  27. Lan X, Zhang S, Yuen PC, Chellappa R (2018) Learning common and feature-specific patterns: a novel multiple-sparse-representation-based tracker. IEEE Trans Image Process 27(4):2022–2037

    Article  MathSciNet  Google Scholar 

  28. Lasch P, Naumann D (1998) Ft-ir microspectroscopic imaging of human carcinoma thin sections based on pattern recognition techniques. Cellular Molec Biol (Noisy-le-Grand France) 44(1):189–202

    Google Scholar 

  29. Lei Z, Georganas ND (2001) Context-based media adaptation in pervasive computin. In: Canadian Conference on electrical and computer engineering, 2001, vol 2. IEEE, pp 913–918

  30. Li Q, Yang J, Zhuang Y (2008) Multimedia information retrieval at a crossroad. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 242–249

  31. Louafi H, Coulombe S, Chandra U (2015) Robust qoe-aware prediction-based dynamic content adaptation framework applied to slides documents in mobile web conferencing. Multimed Tools Appl 74(18):7883–7920

    Article  Google Scholar 

  32. Mohan R, Smith JR, Li CS (1999) Adapting multimedia internet content for universal access. IEEE Trans Multimed 1(1):104–114

    Article  Google Scholar 

  33. Osbakk P, Ryan NS (2002) Context, cc/pp, and p3p. UbiComp 2002 adjunct proceedings, pp 9–10

  34. Renz J (2002) Qualitative spatial reasoning with topological information. Springer-Verlag

  35. Reynolds F (1999) Composite capability/preference profiles (cc/pp): a user side framework for content negotiation. W3C note

  36. Saravanaselvam N, Rajangam K, Dhanam L, Balasubramanian A (2015) Mobile web browsing based on content preserving with reduced cost. Int J Adv Network Appl 6(4):2398

    Google Scholar 

  37. Scherp A, Boll S (2008) Mm4u: A framework for creating personalized multimedia content. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 325–363

  38. Sharma J, Flewelling DM (1995) Inferences from combined knowledge about topology and directions. In: International Symposium on spatial databases. Springer, pp 279–291

  39. Van Essen DC, Anderson CH, Felleman DJ (1992) Information processing in the primate visual system: an integrated systems perspective. Science 255(5043):419–423

    Article  Google Scholar 

  40. Vetro A (2004) Mpeg-21 digital item adaptation: enabling universal multimedia access. IEEE Multimed 11(1):84–87

    Article  Google Scholar 

  41. Wang Y, Kim JG, Chang SF, Kim HM (2007) Utility-based video adaptation for universal multimedia access (uma) and content-based utility function prediction for real-time video transcoding. IEEE Trans Multimed 9(2):213–220

    Article  Google Scholar 

  42. Yuan Z, Ghinea G, Muntean GM (2015) Beyond multimedia adaptation: quality of experience-aware multi-sensorial media delivery. IEEE Trans Multimed 17 (1):104–117

    Article  Google Scholar 

  43. Zhang D, Jangam A, Zhou L, Yakut I (2015) Context-aware multimedia content adaptation for mobile web. Int J Netw Distrib Comput 3(1):1–10

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yehya Belhadad.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Belhadad, Y., Refoufi, A. & Roose, P. Spatial reasoning about multimedia document for a profile based adaptation. Multimed Tools Appl 77, 30437–30474 (2018). https://doi.org/10.1007/s11042-018-6080-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6080-8

Keywords

Navigation