Skip to main content

Towards DSL for DL Lifecycle Data Management

  • Conference paper
  • First Online:
Book cover Databases and Information Systems (DB&IS 2020)

Abstract

A new method based on Domain Specific Language (DSL) approach to Deep Learning (DL) lifecycle data management tool support is presented: a very simple DL lifecycle data management tool, which however is usable in practice (it will be called Core tool) and a very advanced extension mechanism which in fact converts the Core tool into domain specific tool (DSL tool) building framework for DL lifecycle data management tasks. The extension mechanism will be based on the metamodel specialization approach to DSL modeling tools introduced by authors. The main idea of metamodel specialization is that we, at first, define the Universal Metamodel (UMM) for a domain and then for each use case define a Specialized Metamodel. But for use in our new domain the specialization concept will be extended: we add a functional specialization where invoking an additional custom program at appropriate points of Core tool is supported.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barzdins, J., Cerans, K., Grasmanis, M., Kalnins A., et al.: Domain specific languages for business process management: A case study. In: Proceedings of 9th OOPSLA Workshop on Domain-Specific Modeling, pp. 34–40 (2009)

    Google Scholar 

  2. Sprogis, A., Barzdins, J.: Specification, configuration and implementation of DSL tools. Front. Artif. Intell. Appl. 249, 330–343 (2012). https://doi.org/10.3233/978-1-61499-161-8-330

    Article  Google Scholar 

  3. Kalnins, A., Barzdins, J.: Metamodel specialization for graphical modeling language support. In: Proceedings of 19th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2016, pp. 103–112 (2016). https://doi.org/10.1145/2976767.2976779

  4. Kalnins, A., Barzdins, J.: Metamodel specialization for graphical language support. Softw. Syst. Model. J. 18(3), 1699–1735 (2019). https://doi.org/10.1007/s10270-018-0668-3

  5. Bisong, E.: Kubeflow and kubeflow pipelines. In: Building Machine Learning and Deep Learning Models on Google Cloud Platform, pp. 671–685. Apress (2019). https://doi.org/10.1007/978-1-4842-4470-8_46

  6. Flyte: Cloud Native Machine Learning and Data Processing Platform. https://flyte.org

  7. Dagster: System for building modern data applications. https://github.com/dagster-io/dagster

  8. Metaflow: Framework for real-life data science. https://metaflow.org

  9. DVC: Open-source Version Control System for Machine Learning Projects. https://dvc.org

  10. Haifeng, J., Qingquan. S., Xia, H.: Auto-Keras: An efficient neural architecture search system. In: Proceedings of 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1946–1956 (2019). https://doi.org/10.1145/3292500.3330648

  11. Observatory: Solution for tracking machine learning models. https://github.com/wmeints/observatory

  12. lab: MLearning Lab. https://github.com/beringresearch/lab

  13. Weights&Biases. https://www.wandb.com

  14. comet. https://www.comet.ml

  15. mlflow: An open source platform for the machine learning lifecycle. https://mlflow.org

  16. FGLab: ML Dashboard. https://kaixhin.github.io/FGLab

  17. Sacred. https://github.com/IDSIA/sacred

  18. guild.ai: The ML Engineering Platform. https://guild.ai

  19. Sacredboard: Web dashboard for the Sacred machine learning experiment management tool. https://github.com/chovanecm/sacredboard

Download references

Acknowledgements

The research was supported by ERDF project 1.1.1.1/18/A/045 at Institute of Mathematics and Computer Science, University of Latvia.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Edgars Celms .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Celms, E. et al. (2020). Towards DSL for DL Lifecycle Data Management. In: Robal, T., Haav, HM., Penjam, J., Matulevičius, R. (eds) Databases and Information Systems. DB&IS 2020. Communications in Computer and Information Science, vol 1243. Springer, Cham. https://doi.org/10.1007/978-3-030-57672-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-57672-1_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-57671-4

  • Online ISBN: 978-3-030-57672-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics