Skip to main content
SpringerLink
Log in

A design-oriented method to build correct hypermedia documents

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Over the years, different approaches to identify temporal and spatial conflicts in hypermedia applications has been proposed. Most of them are based on formal verification techniques and impose to the designers to follow a formal model or language to ensure application’s functional correctness. Furthermore, the error diagnose is hard to be interpreted by a non-specialist in this domain. In this paper, we present an approach which supports formal verification for documents written in markup languages. We proposed a method and built a verification toolchain that helps designers to verify time and spatial constraints in hypermedia applications. The input language is the designer language. Its translation towards the input of toolchain is automatic and transparent for the application designer. The errors scenarios provided by the verification tool are presented in a timeline way, easily understandable by the designer. The method and toolchain support different markup languages translated in the same intermediary language in order to facilitate the use of different verification tools in the same environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. In this work, we use the expression “markup language” to reference any markup language designed for hypermedia authoring.

  2. http://www.w3.org/TR/2008/REC-SMIL3-20081201/

  3. https://www.itu.int/rec/T-REC-H.761

  4. https://www.w3.org/standards/history/html51

  5. https://marketplace.eclipse.org/content/ncl-eclipse

  6. https://www.eclipse.org/acceleo/

  7. https://www.polarsys.org/topcased

  8. http://clube.ncl.org.br/node/213

  9. First John (“Primeiro João” in Portuguese) is an award-winning animation inspired by chronicles of the life of the Brazilian soccer player Garrincha. It is an interactive application developed by the Telemedia Laboratory of Pontifical Catholic University of Rio de Janeiro (PUC-Rio, Brazil) in order to teach the NCL language and exemplify its use. It contains several examples that are gradually being refined based on the previous example. It can be downloaded at http://clube.ncl.org.br/node/46

  10. Live Longer (“Viva Mais” in Portuguese) is one of the first Brazilian television programs produced focusing on the user interactivity. The program discusses various health and wellness issues and offers some opportunities for active viewer participation. The “Healthy Eating” interactivity asks the viewer to choose between 4 different food dishes according to his/her preferences. After choosing the dish, the viewer is informed about the quality of his/her choice, whether there are any nutrients missing or even in excess. In this application, colored buttons are used by the viewer to choose his/her preferred feeding option. It can be downloaded at http://clube.ncl.org.br/node/29

References

  1. Abid N, Dal Zilio S, Le Botlan D (2012) Real-Time Specification Patterns and Tools. Springer, Berlin, pp 1–15

    Google Scholar 

  2. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26:832–843

    Article  MATH  Google Scholar 

  3. Azevedo RGA, Araújo EC, Lima B, Soares LFG, Moreno MF (2014) Composer: meeting non-functional aspects of hypermedia authoring environment. Multimed Tools Appl 70(2):1199–1228

    Article  Google Scholar 

  4. Beckert B, Hahnle R (2014) Reasoning and verification: State of the art and current trends. IEEE Intell Syst 29(1):20–29

    Article  Google Scholar 

  5. Berthomieu B, Bodeveix J-P, Chaudet C, Dal Zilio S, Filali M, Vernadat F (2009) Formal Verification of AADL Specifications in the Topcased Environment. Springer, Berlin

    Book  Google Scholar 

  6. Berthomieu B, Bodeveix J-P, Farail P, Filali M, Garavel H, Gaufillet P, Lang F, Vernadat F (2008) Fiacre: an intermediate language for model verification in the TOPCASED environment. In: Proceedings of the 4th European Congress Embedded Real Time Software (ERTS 2008), Toulouse France

  7. Berthomieu B, Ribet P-O, Vernadat F (2004) The tool TINA - construction of abstract state spaces for Petri nets e Time Petri nets. Int J Prod Res 14(42):2741–2756

    Article  MATH  Google Scholar 

  8. Bolton ML, Bass EJ, Siminiceanu RI (2013) Using formal verification to evaluate human-automation interaction: A review. IEEE Trans Syst Man Cybern Syst 43(3):488–503

    Article  Google Scholar 

  9. Bouyakoub S, Belkhir A (2011) SMIL builder: an incremental authoring tool for SMIL documents. ACM Trans Multimedia Comput Commun Appl 30(2):1–2

    Article  Google Scholar 

  10. Bridge JP, Holden SB, Paulson LC (2014) Machine learning for first-order theorem proving. J Autom Reason 53(2):141–172

    Article  MATH  Google Scholar 

  11. Burton JK, Moore DM, Holmes GA (1995) Hypermedia concepts and research: An overview. Computers in Human Behavior

  12. Clarke EM Jr, Grumberg O, Peled DA (1999) Model checking. MIT Press, Cambridge

    Google Scholar 

  13. Combéfis S, Giannakopoulou D, Pecheur C, Feary M (2011) A formal framework for design and analysis of human-machine interaction. In: 2011 IEEE international conference on systems man, and cybernetics, pp 1801–1808

  14. Farail P, Gaufillet P, Canals A, Le Camus C, Sciamma D, Michel P, Cregut X, Pantel M, Vernadat F (2006) The TOPCASED project: Toolkit in OPen-source for Critical Aplications e SystEms Development. In: 3th European Congress on Embedded Real Time Software - ERTS

  15. Felix MF, Haeusler EH, Soares LFG (2001) Validating hypermedia documents: a timed automata approach. Technical report, Rio de Janeiro, Brasil

    Google Scholar 

  16. Gaggi O, Bossi A (2011) Analysis and verification of SMIL documents. Multimedia Syst 17(6):487–506

    Article  Google Scholar 

  17. Jouault F, Kurtev I (2006) Transforming models with ATL. In: Proceedings of the 2005 International Conference on Satellite Events at the MoDELS, MoDELS’05, pages 128–138, Berlin, Heidelberg. Springer

  18. Li L, Li C, Ye L, Yongpo J, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In: Proceedings of the 13th Conference on Artificial Intelligence (AAAI), Phoenix, USA

  19. Mekahlia FZ, Ghomari A, Yazid S, Djenouri D (2016) Temporal and spatial coherence verification in SMIL documents with hoare logic and disjunctive constraints: a hybrid formal method. J Integr Des Process Sci 20(3):39–70

    Article  Google Scholar 

  20. Na J-C, Furuta R (2001) Dynamic documents: Authoring, browsing, and analysis using a high-level Petri net-based hypermedia system. In: Proceedings of the 2001 ACM Symposium on Document Engineering, DocEng ’01, pages 38–47, New York, NY, USA. ACM

  21. Oliveira MCF, Turine MAS, Masieiro PC (2001) A statechart-based model for modeling hypermedia applications. ACM Trans Inf Syst 19(1):28–52

    Article  Google Scholar 

  22. Palmeira AF, Sousa MF, Tavares TA, Segundo RMC, Souza Filho GL (2009) VestibaTV: An interactive program for vestibular training. In: Proceedings of the 7th European Conference on Interactive TV and Video (EuroITV ’09), pages 114–115, New York, NY, USA. ACM

  23. Pandey M (2016) Machine learning and systems for the next frontier in formal verification. In: Proceedings of The 2016 formal methods in computer-aided design (FMCAD), pp 4–4

  24. Picinin D Jr, Farines J-M, Koliver C (2012) An approach to verify live NCL applications. In: Proceedings of the 18th Brazilian symposium on Multimedia and the web, WebMedia, pages 223–232, New York, NY, USA. ACM

  25. Resende RMC, Moreno MF, Rodrigues RF, Soares LFG (2006) Live editing of hypermedia documents. In: Proceedings of the 2006 ACM Symp. on Document Engineering, DocEng ’06, pages 165–172, New York, NY, USA. ACM

  26. Sampaio PNM, Courtiat J-P (2004) An approach for the automatic generation of RT-LOTOS specifications from SMIL 2.0 documents. J Braz Comp Soc 9(3):39–51

    Article  Google Scholar 

  27. Santos CAS, Soares LFG, Souza GL, Courtiat J-P (1998) Design methodology and formal validation of hypermedia documents. In: Proceedings of the 6th ACM International Conference on MM, MM ’98, pages 39–48, New York, NY, USA. ACM

  28. Santos JAF, Braga C, Muchaluat-Saade DC (2015) A rewriting logic semantics for NCL. Sci Comput Program 107–108:64–92

    Article  Google Scholar 

  29. Santos JAF, Braga C, Muchaluat-Saade DC, Roisin C, Laya N (2015) Spatio-temporal validation of multimedia documents. In: Proceedings of the 2015 ACM Symposium on Document Engineering, DocEng ’15, pages 133–142, New York, NY, USA. ACM

  30. Santos JAF, Muchaluat-Saade DC (2012) Xtemplate 3.0: spatio-temporal semantics and structure reuse for hypermedia compositions. Multimed Tools Appl 61 (3):645–673

    Article  Google Scholar 

  31. Schmidt DC (2006) Model-driven engineering. IEEE Comput 39(2):25–31

    Article  Google Scholar 

  32. Yovine S, Olivero A, Monteverde D, Cordoba L, Reiter R (2010) An approach for the verification of the temporal consistency of NCL applications. In: Simpósio Brasileiro de Sistemas Multimídia e Web (WebMedia), Belo Horizonte, Brasil, Outubro

  33. Yu H, He X, Gao S, Deng Y (2002) Modeling and analyzing SMIL documents in SAM. In: ISMSE, pp 132–139

Download references

Author information

Authors and Affiliations

  1. Federal Institute of Santa Catarina, Garopaba/SC, 88495-000, Brazil

    Delcino Picinin Jr

  2. Federal University of Santa Catarina, Florianópolis/SC, 88040-900, Brazil

    Jean-Marie Farines & Cristian Koliver

  3. Federal University of Espirito Santo, Vitória/ES, 29075-910, Brazil

    Celso A. S. Santos

Authors
  1. Delcino Picinin Jr
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jean-Marie Farines
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Celso A. S. Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cristian Koliver
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Delcino Picinin Jr.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Picinin, D., Farines, JM., Santos, C.A.S. et al. A design-oriented method to build correct hypermedia documents. Multimed Tools Appl 77, 21003–21032 (2018). https://doi.org/10.1007/s11042-017-5325-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5325-2

Keywords

Search

Navigation