Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

IFIP International Conference on Distributed Applications and Interoperable Systems

DAIS 2012: Distributed Applications and Interoperable Systems pp 162–176Cite as

  1. Home
  2. Distributed Applications and Interoperable Systems
  3. Conference paper
Stroll: A Universal Filesystem-Based Interface for Seamless Task Deployment in Grid Computing

Stroll: A Universal Filesystem-Based Interface for Seamless Task Deployment in Grid Computing

  • Abdulrahman Azab18 &
  • Hein Meling18 
  • Conference paper
  • 673 Accesses

  • 4 Citations

Part of the Lecture Notes in Computer Science book series (LNCCN,volume 7272)

Abstract

Developing applications for solving compute intensive problems is not trivial. Despite availability of a range of Grid computing platforms, domain specialists and scientists only rarely take advantage of these computing facilities. One reason for this is the complexity of Grid computing, and the need to learn a new programming environment to interact with the Grid. Typically, only a few programming languages are supported, and often scientists use special-purpose languages that are not supported by most Grid platforms. Moreover, users cannot easily deploy their compute tasks to multiple Grid platforms without rewriting their program to use different task submission interfaces.

In this paper we present Stroll, a universal filesystem-based interface for seamless task submission to one or more Grid facilities. Users interact with the Grid through simple read and write filesystem commands. Stroll allows all categories of users to submit and manage compute tasks both manually, and from within their programs, which may be written in any language. Stroll has been implemented on Windows and Linux, and we demonstrate that we can submit the same compute tasks to both Condor and Unicore clusters. Our evaluation shows the overhead of Stroll to negligible. Comparing the code complexity of a Stroll compute task with command-line clients and Grid APIs show that Stroll can eliminated up to 95% of the complexity.

Keywords

  • Code Complexity
  • Cyclomatic Complexity
  • Virtual Storage
  • Grid Task
  • Grid Access

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Download conference paper PDF

References

  1. Domingues, P., Marques, P., Silva, L.: Resource usage of windows computer laboratories. In: ICPP Workshops 2005, pp. 469–476 (2005)

    Google Scholar 

  2. Anderson, D.P.: Public Computing: Reconnecting People to Science. In: Shared Knowledge and the Web, Madrid, Spain (November 2003)

    Google Scholar 

  3. McConnell, B.: Beyond Contact: A Guide to SETI and Communicating with Alien Civilizations. O’Reilly (2001)

    Google Scholar 

  4. Bijsterbosch, M., et al.: DRIVER, Digital Repository Infrastructure Vision for European Research II. Technology Watch Report (December 2008)

    Google Scholar 

  5. Filesystem in userspace, http://fuse.sourceforge.net/

  6. Callback File System (2011), http://www.eldos.com/cbfs/

  7. Litzkow, M., Livny, M., Mutka, M.: Condor - a hunter of idle workstations. In: ICDCS (June 1988)

    Google Scholar 

  8. Erwin, D.W., Snelling, D.F.: Unicore: A grid computing environment. In: ECPP, pp. 825–834 (2001)

    Google Scholar 

  9. McCabe, T.J.: A complexity measure. IEEE Trans. Softw. Eng. (1976)

    Google Scholar 

  10. Halstead, M.H.: Elements of Software Science (Operating and programming systems series). Elsevier Science Inc., NY (1977)

    Google Scholar 

  11. Card, D.N., Agresti, W.W.: Measuring software design complexity. The Journal of Systems And Software 3(8) (June 1988)

    Google Scholar 

  12. Pike, R., et al.: The use of name spaces in Plan 9. SIGOPS Oper. Syst. Rev. 27(2), 72–76 (1993)

    CrossRef  Google Scholar 

  13. Wang, X.D., Yang, X., Allan, R.: Top ten questions to design a successful grid portal. In: SKG, pp. 18–24 (2006)

    Google Scholar 

  14. Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. Society for Industrial and Applied Mathematics, Philadelphia (2003)

    CrossRef  MATH  Google Scholar 

  15. Abramson, D., Giddy, J., Kotler, L.: High performance parametric modeling with nimrod/g: Killer application for the global grid? (2000)

    Google Scholar 

  16. Goodale, T., et al.: Saga: A simple api for grid applications. high-level application programming on the grid. In: Comput. Methods in Science and Tech. (2006)

    Google Scholar 

  17. Herrera, J., Huedo, E., Montero, R.S., Llorente, I.M.: Developing grid-aware applications with drmaa on globus-based grids (2004)

    Google Scholar 

  18. Hagemeier, B., Menday, R., Schuller, B., Streit, A.: A universal api for grids. In: Cracow Grid Workshop (July 2007)

    Google Scholar 

  19. Chapman, C., et al.: Condor birdbath: Web service interfaces to condor. In: UK e-Science All Hands Meeting, Nottingham, UK (2005)

    Google Scholar 

  20. Grid ASCII Helper Protocol, http://www.cs.wisc.edu/condor/gahp/

  21. Wegener, D., et al.: GridR: An R-based tool for scientific data analysis in grid environments. Future Gener. Comput. Syst. 25, 481–488 (2009)

    CrossRef  Google Scholar 

  22. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria (2011)

    Google Scholar 

  23. Urbanek, S.: rJava: Low-Level R to Java Interface (2009), http://cran.r-project.org/package=rJava

  24. Wilde, M., et al.: Swift: A language for distributed parallel scripting. Parallel Computing 37(9), 633–652 (2011)

    CrossRef  Google Scholar 

  25. Murray, D.G., Hand, S.: Scripting the cloud with skywriting (2010)

    Google Scholar 

  26. Morgan, M.M., Grimshaw, A.S.: Genesis ii - standards based grid computing. In: CCGRID, pp. 611–618 (2007)

    Google Scholar 

  27. Anjomshoaa, A., et al.: Job Submission Description Language Specification (2005)

    Google Scholar 

  28. van Hensbergen, E., Evans, N.P., Stanley-Marbell, P.: A unified execution model for cloud computing. In: LADIS (October 2009)

    Google Scholar 

  29. Thain, D., Livny, M.: Parrot: Transparent user-level middleware for data-intensive computing. Scalable Computing: Practice and Experience 6(3), 9–18 (2005)

    Google Scholar 

  30. Azab, A., Meling, H.: A Virtual File System Interface for Computational Grids. In: Aagesen, F.A., Knapskog, S.J. (eds.) EUNICE 2010. LNCS, vol. 6164, pp. 87–96. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  31. Condor submit description file, http://www.cs.wisc.edu/condor/manual/v7.6/condor_submit.html

  32. Batch processing, http://www.hpcx.ac.uk/support/documentation/#userguide/hpcxuser/batch_processing.html (retrieved 6, 2011)

  33. Microsoft.Net (2011), http://www.microsoft.com/net/

  34. Tierney, L., Rossini, A.J., Li, N., Sevcikova, H.: Snow: Simple Network of Workstations (November 2011)

    Google Scholar 

  35. Boyer, C.B.: A History of Mathematics, 2nd edn., p. 431. Wiley (1968)

    Google Scholar 

  36. Condor Java API, http://staff.aist.go.jp/hide-nakada/condor_java_api/

  37. Bowbrick, S., Borg, A.: ECG complete. Churchill Livingstone (2006)

    Google Scholar 

  38. Safar, P.: History of cardiopulmonary-cerebral resuscitation. In: Cardiopulmonary Resuscitation, New York, pp. 1–53 (1989)

    Google Scholar 

  39. Klim, S., et al.: Population stochastic modelling (psm)-an r package for mixed-effects models based on stochastic differential equations. Comput. Methods Prog. Biomed. 94, 279–289 (2009)

    CrossRef  Google Scholar 

  40. Schuller, B., Demuth, B., Mix, H., Rasch, K., Romberg, M., Sild, S., Maran, U., Bała, P., del Grosso, E., Casalegno, M., Piclin, N., Pintore, M., Sudholt, W., Baldridge, K.K.: Chemomentum - UNICORE 6 Based Infrastructure for Complex Applications in Science and Technology. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par Workshops 2007. LNCS, vol. 4854, pp. 82–93. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Electrical Engineering and Computer Science, University of Stavanger, Norway

    Abdulrahman Azab & Hein Meling

Authors
  1. Abdulrahman Azab
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hein Meling
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Information Systems, Vienna University of Technology, Argentinierstrasse 8/184-1, 1040, Vienna, Austria

    Karl Michael Göschka

  2. Swedish Institute of Computer Science, Isafjordsgatan 22, 164 29, Kista, Sweden

    Seif Haridi

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 IFIP International Federation for Information Processing

About this paper

Cite this paper

Azab, A., Meling, H. (2012). Stroll: A Universal Filesystem-Based Interface for Seamless Task Deployment in Grid Computing. In: Göschka, K.M., Haridi, S. (eds) Distributed Applications and Interoperable Systems. DAIS 2012. Lecture Notes in Computer Science, vol 7272. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30823-9_14

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-30823-9_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30822-2

  • Online ISBN: 978-3-642-30823-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature