When History Matters - Assessing Reliability for the Reuse of Scientific Workflows

  • José Manuel Gómez-Pérez
  • Esteban García-Cuesta
  • Aleix Garrido
  • José Enrique Ruiz
  • Jun Zhao
  • Graham Klyne
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8219)


Scientific workflows play an important role in computational research as essential artifacts for communicating the methods used to produce research findings. We are witnessing a growing number of efforts that treat workflows as first-class artifacts for sharing and exchanging scientific knowledge, either as part of scholarly articles or as stand-alone objects. However, workflows are not born to be reliable, which can seriously damage their reusability and trustworthiness as knowledge exchange instruments. Scientific workflows are commonly subject to decay, which consequently undermines their reliability over their lifetime. The reliability of workflows can be notably improved by advocating scientists to preserve a minimal set of information that is essential to assist the interpretations of these workflows and hence improve their potential for reproducibility and reusability. In this paper we show how, by measuring and monitoring the completeness and stability of scientific workflows over time we are able to provide scientists with a measure of their reliability, supporting the reuse of trustworthy scientific knowledge.


Research Object Reliability Score Scholarly Article Virtual Observatory Stability Score 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bechhofer, S., Buchan, I., De Roure, D., Missier, P., Ainsworth, J., Bhagat, J., Couch, P., Cruickshank, D., Delderfield, M., Dunlop, I., Gamble, M., Michaelides, D., Owen, S., Newman, D., Sufi, S., Goble, C.: Why linked data is not enough for scientists. Future Generation Computer Systems (2011)Google Scholar
  2. 2.
    Belhajjame, K., Corcho, O., Garijo, D., Zhao, J., Missier, P., Newman, D., Palma, R., Bechhofer, S., García-Cuesta, E., Gómez-Pérez, J.M., Klyne, G., Page, K., Roos, M., Ruiz, J.E., Soiland-Reyes, S., Verdes-Montenegro, L., De Roure, D., Goble, C.A.: Workflow-centric research objects: First class citizens in scholarly discourse. In: Proceeding of SePublica 2012, pp. 1–12 (2012)Google Scholar
  3. 3.
    Bizer, C.: Quality-Driven Information Filtering in the Context of Web-Based Information Systems. VDM Verlag (2007)Google Scholar
  4. 4.
    Ciccarese, P., Ocana, M., Garcia Castro, L.J., Das, S., Clark, T.: An open annotation ontology for science on web 3.0. J. Biomed. Semantics 2(suppl. 2), S4 (2011)Google Scholar
  5. 5.
    De Roure, D., Goble, C., Stevens, R.: The design and realisation of the myexperiment virtual research environment for social sharing of workflows. Future Generation Computer Systems 25, 561–567 (2009)CrossRefGoogle Scholar
  6. 6.
    Newman, D., Bechhofer, S., De Roure, D.: Myexperiment: An ontology for e-research. In: Workshop on Semantic Web Applications in Scientific Discourse in Conjunction with the International Semantic Web Conference (2009)Google Scholar
  7. 7.
    Giunchiglia, F., ChenuAbente, R.: Scientific knowledge objects v. 1. Technical Report DISI-09-006, University of Trento (2009)Google Scholar
  8. 8.
    Goble, C., De Roure, D., Bechhofer, S.: Accelerating scientists’ knowledge turns. In: Fred, A., Dietz, J.L.G., Liu, K., Filipe, J. (eds.) IC3K 2011. CCIS, vol. 348, pp. 3–25. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  9. 9.
    Gómez-Pérez, J.M., Corcho, O.: Problem-Solving Methods for Understanding Process executions. Computing in Science and Engineering (CiSE) 10(3), 47–52 (2008)CrossRefGoogle Scholar
  10. 10.
    Groth, P., Gibson, A., Velterop, J.: The anatomy of a nanopublication. Information Services and Use 30(1), 51–56 (2010)Google Scholar
  11. 11.
    Hunter, J.: Scientific publication packages – A selective approach to the communication and archival of scientific output. International Journal of Digital Curation 1(1), 33–52 (2008)CrossRefGoogle Scholar
  12. 12.
    Lord, P., Cockell, S., Stevens, R.: Three Steps to Heaven: Semantic Publishing in a Real World Workflow. Proceeding of SePublica 2012, 23–34 (2012)Google Scholar
  13. 13.
    Mates, P., Santos, E., Freire, J., Silva, C.T.: Crowdlabs: Social analysis and visualization for the sciences. In: Bayard Cushing, J., French, J., Bowers, S. (eds.) SSDBM 2011. LNCS, vol. 6809, pp. 555–564. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  14. 14.
    Missier, P.: Modelling and computing the quality of information in e-science. Ph.D. thesis, School of Computer Science, University of Manchester (2008)Google Scholar
  15. 15.
    Mos, A., Pedrinaci, C., Rey, G.A., Gomez, J.M., Liu, D., Vaudaux-Ruth, G., Quaireau, S.: Multi-level monitoring and analysis of web-scale service based applications. In: Dan, A., Gittler, F., Toumani, F. (eds.) ICSOC/ServiceWave 2009. LNCS, vol. 6275, pp. 269–282. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
    Newell, A.: The Knowledge Level. Artificial Intelligence 18(1), 87–127 (1982)CrossRefGoogle Scholar
  17. 17.
    Newman, D., Bechhofer, S., De Roure, D.: Myexperiment: An ontology for e-research. In: Workshop on Semantic Web Applications in Scientific Discourse in Conjunction with the International Semantic Web Conference (2009)Google Scholar
  18. 18.
    Open archives initiative object reuse and exchange (2008)Google Scholar
  19. 19.
    The Research Object model specification,
  20. 20.
    Page, K., Palma, R., Houbowicz, P., et al.: From workflows to Research Objects: an architecture for preserving the semantics of science. In: Proceedings of the 2nd International Workshop on Linked Science (2012)Google Scholar
  21. 21.
    Zhao, J., Gómez-Pérez, J.M., Belhajjame, K., Klyne, G., García-Cuesta, E., Garrido, A., Hettne, K., Roos, M., De Roure, D., Goble, C.A.: Why Workflows Break - Understanding and Combating Decay in Taverna Workflows. In: The Proceedings of the IEEE eScience Conference (eScience 2012). IEEE CS, Chicago (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • José Manuel Gómez-Pérez
    • 1
  • Esteban García-Cuesta
    • 1
  • Aleix Garrido
    • 1
  • José Enrique Ruiz
    • 2
  • Jun Zhao
    • 3
  • Graham Klyne
    • 3
  1. 1.Intelligent Software Components (iSOCO)Spain
  2. 2.Instituto de Astrofísica de AndalucíaSpain
  3. 3.University of OxfordUK

Personalised recommendations