Skip to main content
SpringerLink
Log in

Towards a Provenance Management System for Astronomical Observatories

  • Conference paper
  • First Online:
Provenance and Annotation of Data and Processes (IPAW 2020, IPAW 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12839))

Abstract

We present here a provenance management system adapted to astronomical projects needs. We collected use cases from various astronomy projects and defined a data model in the ecosystem developed by the IVOA (International Virtual Observatory Alliance). From those use cases, we observed that some projects already have data collections generated and archived, from which the provenance has to be extracted (provenance “on top”), and some projects are building complex pipelines that automatically capture provenance information during the data processing (capture “inside”). Different tools and prototypes have been developed and tested to capture, store, access and visualize the provenance information, which participate to the shaping of a full provenance management system able to handle detailed provenance information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.go-fair.org/fair-principles.

  2. 2.

    https://www.ivoa.net.

  3. 3.

    https://github.com/sanguillon/voprov.

  4. 4.

    https://github.com/mservillat/logprov.

  5. 5.

    https://voparis-uws-test.obspm.fr/provsap?ID=a9b7e2.

  6. 6.

    https://cta-observatory.github.io/ctapipe.

  7. 7.

    https://gitlab.cta-observatory.org/cta-computing/dpps/CTADIRAC.

  8. 8.

    http://ascl.net.

  9. 9.

    https://wiki.escape2020.de/index.php/WP3_-_OSSR.

References

  1. Bonnarel, F., Louys, M., Mantelet, G., Nullmeier, M., Servillat, M., Riebe, K., Sanguillon, M.: ProvTAP: a TAP service for providing IVOA provenance metadata. In: Teuben, P.J., Pound, M.W., Thomas, B.A., Warner, E.M. (eds.) ADASS XXVII. ASP Conference Series, vol. 523, p. 313 (2019)

    Google Scholar 

  2. Di Cosmo, R., Zacchiroli, S.: Software heritage: why and how to preserve software source code. In: iPRES 2017: 14th International Conference on Digital Preservation. Kyoto, Japan (2017). https://hal.archives-ouvertes.fr/hal-01590958

  3. Lefaucheur, J., Deil, C., Donath, A., Jouvin, L., Khélifi, B., King, J.: Gammapy - an Open-source Python Package for \(\gamma \)-Ray Astronomy. In: Ballester, P., Ibsen, J., Solar, M., Shortridge, K. (eds.) ADASS XXVII. ASP Conference Series, vol. 522, p. 525 (2020)

    Google Scholar 

  4. Moreau, L., et al.: PROV-DM: The prov data model. W3C Recommendation (2013). http://www.w3.org/TR/prov-dm

  5. Sanguillon, M., Bonnarel, F., Louys, M., Nullmeier, M., Riebe, K., Servillat, M.: Provenance tools for astronomy. In: Ballester, P., Ibsen, J., Solar, M., Shortridge, K. (eds.) ADASS XXVII. ASP Conference Series, vol. 522, p. 545 (2020). https://arxiv.org/abs/1812.00878

  6. Sanguillon, M., Arrabito, L., Boisson, C., Bregeon, J., Kosack, K., Servillat, M.: Storing Provenance information in a data processing workflow: one CTA use case. In: Ruiz, J.E., Pierfederici, F. (eds.) ADASS XXX. ASP Conference Series, vol. TBD, p. TBD (2021)

    Google Scholar 

  7. Servillat, M., Aicardi, S., Cecconi, B., Mancini, M.: OPUS: an interoperable job control system based on VO standards. In: Ruiz, J.E., Pierfederici, F. (eds.) ADASS XXX. ASP Conference Series, vol. TBD, p. TBD (2021). https://arxiv.org/abs/2101.08683

  8. Servillat, M., Bonnarel, F., Louys, M., Sanguillon, M.: Practical provenance in astronomy. In: Ruiz, J.E., Pierfederici, F. (eds.) ADASS XXX. ASP Conference Series, vol. TBD, p. TBD (2021). https://arxiv.org/abs/2101.08691

  9. Servillat, M., et al.: IVOA Provenance Data Model Version 1.0. IVOA Recommendation, April 2020. https://www.ivoa.net/documents/ProvenanceDM

  10. Wells, D.C., Greisen, E.W., Harten, R.H.: FITS - a flexible image transport system. A&AS 44, 363 (1981)

    Google Scholar 

Download references

Acknowledgements

We acknowledge support from the ESCAPE project funded by the EU Horizon 2020 research and innovation program (Grant Agreement n824064). Additional funding was provided by the INSU (Action Spécifique Observatoire Virtuel, ASOV), the Action Fédératrice CTA at the Observatoire de Paris and the Paris Astronomical Data Centre (PADC).

Author information

Authors and Affiliations

  1. Laboratoire Univers et Théories, Observatoire de Paris, Université PSL, CNRS, Université de Paris, 92190, Meudon, France

    Mathieu Servillat & Catherine Boisson

  2. Centre de Données astronomiques de Strasbourg, Observatoire Astronomique de Strasbourg, Université de Strasbourg, CNRS-UMR 7550, Strasbourg, France

    François Bonnarel & Mireille Louys

  3. ICube Laboratory, Université de Strasbourg, CNRS-UMR 7357, Strasbourg, France

    Mireille Louys

  4. Instituto de Astrofísica de Andalucía, Granada, Spain

    Jose Enrique Ruiz

  5. Laboratoire Univers et Particules de Montpellier, Université de Montpellier, CNRS/IN2P3, Montpellier, France

    Michèle Sanguillon

Authors
  1. Mathieu Servillat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. François Bonnarel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Catherine Boisson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mireille Louys
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jose Enrique Ruiz
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michèle Sanguillon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mathieu Servillat .

Editor information

Editors and Affiliations

  1. Illinois Institute of Technology, Chicago, IL, USA

    Boris Glavic

  2. Fluminense Federal University, Niterói, Brazil

    Vanessa Braganholo

  3. Northern Illinois University, DeKalb, IL, USA

    David Koop

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Servillat, M., Bonnarel, F., Boisson, C., Louys, M., Ruiz, J.E., Sanguillon, M. (2021). Towards a Provenance Management System for Astronomical Observatories. In: Glavic, B., Braganholo, V., Koop, D. (eds) Provenance and Annotation of Data and Processes. IPAW IPAW 2020 2021. Lecture Notes in Computer Science(), vol 12839. Springer, Cham. https://doi.org/10.1007/978-3-030-80960-7_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80960-7_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80959-1

  • Online ISBN: 978-3-030-80960-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation