Skip to main content
SpringerLink
Log in

Semantics and Planning Based Workflow Composition for Video Processing

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

This work proposes a novel workflow composition approach that hinges upon ontologies and planning as its core technologies within an integrated framework. Video processing problems provide a fitting domain for investigating the effectiveness of this integrated method as tackling such problems have not been fully explored by the workflow, planning and ontological communities despite their combined beneficial traits to confront this known hard problem. In addition, the pervasiveness of video data has proliferated the need for more automated assistance for image processing-naive users, but no adequate support has been provided as of yet. The integrated approach was evaluated on a video set originating from open sea environment of varying quality. Experiments to evaluate the efficiency, adaptability to user’s changing needs and user learnability of this approach were conducted on users who did not possess image processing expertise. The findings indicate that using this integrated workflow composition and execution method: (1) provides a speed up of over 90 % in execution time for video classification tasks using full automatic processing compared to manual methods without loss of accuracy; (2) is more flexible and adaptable in response to changes in user requests than modifying existing image processing programs when the domain descriptions are altered; and (3) assists the user in selecting optimal solutions by providing recommended descriptions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Andrews, T., Curbera, F., Dholakia, H., Goland, Y., Klein, J., Leymann, F., Liu, K., Roller, D., Smith, D., Thatte, S., Trickovic, I., Weerawarana, S.: Business Process Execution Language for Web Services Version 1.1 (BPEL). IBM, BEA Systems, Microsoft, SAP AG, Siebel Systems (2003). http://download.boulder.ibm.com/ibmdl/pub/software/dw/specs/ws-bpel/ws-bpel.pdf. Last accessed 22 April 2013

  2. Blythe, J., Deelman, E., Gil, Y.: Automatically composed workflows for Grid environments. IEEE Intell. Syst. 19(4):16–23 (2004)

    Article  Google Scholar 

  3. Callahan, S.P., Freire, J., Santos, E., Scheidegger, C.E., Silva, C.T., Vo, H.T.: Managing the evolution of dataflows with vistrails. In: IEEE Workshop on Workflow and Data Flow for Scientific Applications (Sciflow’06), pp. 71–75 (2006)

  4. Chen-Burger, Y.H., Lin, F.P.: A semantic-based workflow choreography for integrated sensing and processing. In: The 9th IEEE International Workshop on Cellular Neural Networks and Their Applications (CNNA’05) (2005)

  5. Currie, K., Tate, A.: O-Plan: The open planning architecture. Artif. Intell. 52, 49–86 (1991)

    Article  Google Scholar 

  6. Deelman, E., Gannon, D., Shields, M., Taylor, I.: Workflows and e-Science: An overview of workflow system features and capabilities. Future Gener. Comput. Syst. 25(5), 528–540 (2009)

    Article  Google Scholar 

  7. Deelman, E., Singh, G., Su, M.H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Vahi, K., Berriman, B., Good, J., Laity, A., Jacob, J.C., Katz, D.S.: Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. J. 13(3), 219–237 (2005)

    Google Scholar 

  8. Ecogrid: National Center for High Performance Computing, Hsin-Chu, Taiwan (2006). http://ecogrid.nchc.org.tw. Last accessed 21 April 2012

  9. Foster, I., Kesselman, C. (eds.): The Grid 2: Blueprint for a New Computing Infrastructure, 2nd edn. Morgan Kaufmann (2003)

  10. Foster, I., Voeckler, J., Wilde, M., Zhao, Y.: Chimera: A virtual data system for representing, querying, and automating data derivation. In: 14th Conference on Scientific and Statistical Database Management, pp. 37–46 (2002)

  11. Ghallab, M., Nau, D., Traverso, P.: Automated Planning: Theory & Practice. Morgan Kaufmann (2004)

  12. Gil, Y., Ratnakar, V., Deelman, E., Mehta, G., Kim, J.: Wings for Pegasus: creating large-scale scientific applications using semantic representations of computational workflows. In: Proceedings of the 19th National Conference on Innovative Applications of Artificial Intelligence (IAAI’07), pp. 1767–1774. AAAI Press (2007)

  13. Gómez-Pérez, A., Fernández-López, M., Corcho, O.: Ontological Engineering. Springer (2004)

  14. Howell, D.C.: Statistical Methods for Psychology, 6th edn. Belmont, CA (2007)

  15. Intel: Open Source Computer Vision (OpenCV) Library (2006). http://sourceforge.net/projects/opencvlibrary. Last accessed 22 April 2013

  16. Kim, J., Spraragen, M., Gil, Y.: An intelligent assistant for interactive workflow composition. In: Proceedings of the International Conference on Intelligent User Interfaces (IUI’04), pp. 125–131. ACM Press (2004)

  17. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler system. Concurr. Comput. Pract. Exper. 18(10), 1039–1065 (2005)

    Article  Google Scholar 

  18. McCluskey, T.L., Liu, D., Simpson, R.M.: GIPO II: HTN planning in a tool-supported knowledge engineering environment. In: ICAPS’03, pp. 92–101 (2003)

  19. Nadarajan, G., Chen-Burger, Y.H.: Goal, video descriptions and capability ontologies for Fish4Knowledge domain. In: Special Session on Intelligent Workflow, Cloud Computing and Systems (KES-AMSTA’12) (2012)

  20. Nadarajan, G., Chen-Burger, Y.H., Fisher, R.B.: A knowledge-based planner for processing unconstrained underwater videos. In: IJCAI’09 Workshop on Learning Structural Knowledge from Observations (STRUCK’09) (2009)

  21. Nadarajan, G., Chen-Burger, Y.H., Fisher, R.B.: SWAV: Semantics-based workflows for automatic video analysis. In: Special Session on Intelligent Workflow, Cloud Computing and Systems (KES-AMSTA’11) (2011)

  22. Nadarajan, G., Renouf, A.: A modular approach for automating video processing. In: 12th International Conference on Computer Analysis of Images and Patterns (CAIP’07) (2007)

  23. Nadarajan, G., Spampinato, C., Chen-Burger, Y.H., Fisher, R.B.: A flexible system for automated composition of intelligent video analysis. In: 7th International Symposium on Image and Signal Processing and Analysis (ISPA’11) (2011)

  24. Nau, D., Au, T.C., Ilghami, O., Kuter, U., W.Murdock, Wu, D., Yaman, F.: SHOP2: An HTN planning system. J. Artif. Intell. Res. 20, 379–404 (2003)

    Google Scholar 

  25. Nau, D.S., Cao, Y., Lotem, A., Muñoz Avila, H.: SHOP: Simple hierarchical ordered planner. In: International Joint Conference on Artificial Intelligence (IJCAI’99), pp. 968–973 (1999)

  26. Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M.R., Wipat, A., Li, P.: Taverna: A tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045–3054 (2004)

    Article  Google Scholar 

  27. Oinn, T., Greenwood, M., Addis, M., Alpdemir, N., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D., Li, P., Lord, P., Pocock, M., Senger, M., Stevens, R., Wipat, A., Wroe, C.: Taverna: Lessons in creating a workflow environment for the life sciences. Concurr. Comput. Pract. Exper. 18(10), 1067–1100 (2006)

    Article  Google Scholar 

  28. Renouf, A., Clouard, R.: Hermes—A human-machine interface for the formulation of image processing applications (2007). https://clouard.users.greyc.fr/Hermes/index.html. Last accessed 22 April 2013

  29. Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor—A distributed job scheduler. In: Sterling, T. (ed.) Beowulf Cluster Computing with Linux. MIT Press (2001)

  30. Tate, A.: Intelligible AI planning—generating plans represented as a set of constraints. In: Proceedings of the Twentieth British Computer Society Special Group on Expert Systems International Conference on Knowledge Based Systems and Applied Artificial Intelligence (ES’00), pp. 3–16. Springer (2000)

  31. Taylor, I., Deelman, E., Gannon, D., Shields, M.: Workflows for e-Science. Springer, New York (2007)

    Book  Google Scholar 

  32. Taylor, I., Shields, M., Wang, I., Rana, O.: Triana applications within Grid computing and peer to peer environments. J. Grid Computing 1(2), 199–217 (2003)

    Article  Google Scholar 

  33. Taylor, I., Shields, M., Wang, I., Harrison, A.: The Triana workflow environment: architecture and applications. In: Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.) Workflows for e-Science, pp. 320–339. Springer, New York (2007)

    Chapter  Google Scholar 

  34. van Splunter, S., Brazier, F.M.T., Padget, J.A., Rana, O.F.: Dynamic service reconfiguration and enactment using an open matching architecture. In: International Conference on Agents and Artificial Intelligence (ICAART’09), pp. 533–539 (2009)

  35. von Laszewski, G., Hategan, M.: Java CoG Kit Karajan/Gridant workflow guide. Technical report, Argonne National Laboratory, Argonne, IL, USA (2005)

Download references

Author information

Authors and Affiliations

  1. Centre for Intelligent Systems and their Applications, School of Informatics, University of Edinburgh, 10 Crichton St., Edinburgh, EH8 9AB, UK

    Gayathri Nadarajan & Yun-Heh Chen-Burger

  2. Institute for Perception, Action and Behaviour, School of Informatics, University of Edinburgh, 10 Crichton St., Edinburgh, EH8 9AB, UK

    Robert B. Fisher

Authors
  1. Gayathri Nadarajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun-Heh Chen-Burger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robert B. Fisher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gayathri Nadarajan.

Additional information

This research was funded by European Commission FP7 grant 257024, in the Fish4Knowledge project (www.fish4knowledge.eu).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nadarajan, G., Chen-Burger, YH. & Fisher, R.B. Semantics and Planning Based Workflow Composition for Video Processing. J Grid Computing 11, 523–551 (2013). https://doi.org/10.1007/s10723-013-9263-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-013-9263-6

Keywords

Search

Navigation