Advertisement

Earth Science Informatics

, Volume 10, Issue 2, pp 219–234 | Cite as

A stakeholder consultation into hydro-meteorological e-science environments

  • Quillon HarphamEmail author
  • Olalla Gimeno
  • Antonio Parodi
  • Daniele D’Agostino
Research Article

Abstract

The purpose of this paper is to report on and analyse an international consultation into hydro-meteorological e-Science environments with the objective of identifying key functions and features together with exploring show-stopping issues and organisational structure. Transatlantic experiences were compared and contrasted. Including strong participation from both Europe and the USA with high quality responses from experienced practitioners, the consultation was undertaken as part of a joint initiative and took the form of an online questionnaire supported by a set of stakeholder interviews and other discussions. Topics included were functions and features such as provision of numerical models and data, usability, and ease of access; show-stopping issues such as flexibility, reliability and longevity; centralised and distributed structures, and funding models. The results demonstrated a broadly similar set of experiences and implied a future as an evolution of that which exists today. The consultation exercise ran alongside the development of the DRIHM e-Infrastructure which had, in itself, already benefitted from the prior DRIHMS consultation. Results were fed in to the development process at appropriate intervals allowing the consultation to shape the resultant services.

Keywords

Hydro-meteorology E-science ICT infrastructure Standards Stakeholder consultation 

Abbreviations

BSD

Berkeley Software Distribution

CESM

Community Earth System Model project

CF

Climate and Forecasting

CSDMS

Community Surface Dynamics Modeling System

CUAHSI

Consortium of Universities for the Advancement of Hydrological Science Incorporated

CUAHSI-HIS

CUAHSI Hydrologic Information System

DRIHM

Distributed Research Infrastructure for Hydro-Meteorology

DRIHMS

Distributed Research Infrastructure for Hydro-Meteorology Study

DRIHM2US

Distributed Research Infrastructure for Hydro-Meteorology to the USA

ESMF

Earth System Modelling Framework

ECOOP

European Coastal Operational Oceanography Project

EPA

Environmental Protection Agency

FEWS

Flood Early Warning System

FRAMES

Framework for Risk Analysis of Multi-Media Environmental Systems

GUI

Graphical User Interface

gUSE

Grid and cloud User Support Environment

HMR

Hydro-Meteorological Research

ICT

Information and Communication Technology

LGPL

Lesser General Public License

MoU

Memorandum of Understanding

NetCDF

Network Common Data Form

NWP

Numerical Weather Prediction

OGC

Open Geospatial Consortium

OpenMI

Open Modelling Interface

SHIWA

SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs

SLA

Service Level Agreement

SDK

Software Development Kit

WaterML

Water Markup Language

WMO

World Meteorological Organization

Notes

Acknowledgements

The project team would like to acknowledge the time taken by all respondents in providing their feedback to the consultation process and the permission given for summary results and supporting comments to be included in project outputs.

This research was co-funded by the European Commission (EC) 7th Framework Programme DRIHM2US Project, Grant Number 313122. The author would like to acknowledge the contributions of the European Commission and the project team, in particular, the group at Ludwig-Maximilians-Universitaet, Muenchen for their production of the report “Report on an Assessment of Options for Organizational Setup” and the team at Deltares for leading the work package including this consultation.

The DRIHM2US project is paired with the SCIHM project in the USA, funded by the NSF. As such, the authors would like to acknowledge the contributions of our partner organisations from this project.

References

  1. Abbott MB (1991) Hydroinformatics: information technology and the aquatic environment. Avebury Technical, AldershotGoogle Scholar
  2. Abbott MB, Vojinovic Z (2009) Applications of numerical modelling in hydroinformatics. J Hydroinf 11:308–319CrossRefGoogle Scholar
  3. Abbott MB, Tumwesigye BE, Vojinovic Z (2006) The fifth generation of modelling in hydroinformatics. In: Gourbesville P, Cunge J, Guinot V, Liong S-Y (eds) Proceedings of the 7th international conference on hydroinformatics. Research publishing, Singapore, pp 2091–2098Google Scholar
  4. Ames DP, Horsburgh JS, Cao Y, Kadlec J, Whiteaker T, Valentine D (2012) HydroDesktop: web services-based software for hydrologic data discovery, download, visualization, and analysis. Environ Model Softw 37:146–156. doi: 10.1016/j.envsoft.2012.03.013 CrossRefGoogle Scholar
  5. Balasko A, Farkas Z (2011) gUSE grid and cloud science gateway http://sourceforge.net/projects/guse. Accessed 26 Mar 2013
  6. Bastin L, Cornford D et al (2013) Managing uncertainty in integrated environmental modelling: the UncertWeb framework. Environ Model Softw 39:116–134. doi: 10.1016/j.envsoft.2012.02.008 CrossRefGoogle Scholar
  7. Blind M, Gregersen JB (2005) Towards an open modelling Interface (OpenMI) the HarmonIT project. Adv Geosci 4:69–74CrossRefGoogle Scholar
  8. Bourban S, Durand N, Turnbull M, Wilson S, Cheesman S (2012) Coastal shelf model of northern European waters to inform tidal power industry decisions. In: Bourban S, Durand N, Hervouet J-M (eds) Proceedings of XIXth TELEMAC-MASCARET user conference, 18–19 October 2012. Oxford. HR Wallingford, Wallingford, pp 143–150Google Scholar
  9. Camarinha-Matos L, Afsarmanesh H, Ollus M (2005) Virtual organizations: systems and practices. Springer, New YorkCrossRefGoogle Scholar
  10. Carusi A, Reimer T (2010) Virtual research environment collaborative landscape study. JISC, Bristol 106Google Scholar
  11. Castronova AM, Goodall JL (2013) Simulating watersheds using loosely integrated model components: evaluation of computational scaling using OpenMI. Environ Model Softw 39:304–313. doi: 10.1016/j.envsoft.2012.01.020 CrossRefGoogle Scholar
  12. CF Standard Names (2003) CF Metadata NetCDF CF Metadata Conventions Accessed 29 Apr 2014Available at: http://cf-convention.github.io/index.html
  13. Collins N, Theurich G, DeLuca C, Suarez M, Trayanov A, Balaji V, Li P, Yang W, Hill C, da Silva A (2005) Design and implementation of components in the earth system modeling Famework. International Journal of High Performance Computing Applications 19(3):341–350CrossRefGoogle Scholar
  14. D’Agostino D, Clematis A, Galizia A, Quarati A, Danovaro E, Roverelli L, Zereik G, Kranzlmuller D, Schiffers M, Gentschen Felde N, Straube C, Parodi A, Fiori E, Delogu F, Caumont O, Richard E, Garrote L, Harpham Q, Jagers B, Dimitrijević V, Dekic L (2014) The DRIHM project: a flexible approach to integrate hpc, grid and cloud resources for hydro-meteorological research. In: Proceedings of the international conference for high performance computing, networking, storage and analysis (SC '14). IEEE Press, Piscataway, pp 536–546. doi: 10.1109/SC.2014.49 CrossRefGoogle Scholar
  15. D'Agostino D, Danovaro E, Clematis A, Roverelli L, Zereik G, Parodi A, Galizia A (2016) Lessons learned implementing a science gateway for hydro-meteorological research. Practice and Experience, Concurrency and Computation. doi: 10.1002/cpe.3700 Google Scholar
  16. Danovaro E, Roverelli L, Zereik G, Galizia A, D’Agostino D, Quarati A, Clematis A, Delogu F, Fiori E, Parodi A, Straube C, Felde N, Harpham Q, Jagers B, Garrote L, Dekic L, Ivkovic M, Richard E, Caumont O (2014) Setup an hydro-meteo experiment in minutes: the DRIHM e-infrastructure for hydro-meteorology research. In: Proceedings of the 10th IEEE international conference on e-science (e-science 2014). IEEE Press, Piscataway, pp 47–54. doi: 10.1109/eScience.2014.40 Google Scholar
  17. Foster, I., Kesselman, C. & Tuecke, S. 2001. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications 15 (Nr. 3), S. 200–222.Google Scholar
  18. Gemmell AL, Barciela RM, Blower JD, Haines K, Harpham Q, Millard K, Price MR, Saulter A (2011) An ECOOP web portal for visualising and comparing distributed coastal oceanography model and in situ data. Ocean Sci 7(4):445–454CrossRefGoogle Scholar
  19. German DM, Hassan AE (2009) License integration patterns: Addressing license mismatches in component-based development. In: Software Engineering, 2009. ICSE 2009. IEEE 31st international conference on. IEEE, pp 188–198Google Scholar
  20. Gijsbers PJA, Moore RV, Tindall CI (2002) HarmonIT: towards OMI, an open modelling Interface and environment to harmonise European developments in water related simulation software. In: Falconer RA, Lin B, Harris EL, Wilson C, Cluckie ID, Han D, Davis JP, Heslop S (eds) Hydroinformatics 2002, Proceedings of the 5th International Conference on Hydroinformatics, Cardiff. UK. IWA Publishing, London, pp 1628–1275Google Scholar
  21. Gregersen JB, Gijsbers PJA, Westen SJP (2007) OpenMI: Open modelling interface. J Hydroinform 9(3):175–191CrossRefGoogle Scholar
  22. Gupta T, Jones R, Bastin L, Cornford D (2012) Integrating OpenMI and UncertWeb: managing uncertainty in OpenMI models. In: Seppelt R, Voinov AA, Lange S, Bankampa D (eds) Managing resources of a limited planet: pathways and visions under uncertainty, IEMSS Sixth International Congress on Environmental Modelling and Software, 1–5 July 2012, Leipzig. Germany. International Environmental Modelling and Software Society, Manno, pp 1151–1158Google Scholar
  23. Harpham, Q. K., Cleverley, P. & Kelly, D. 2014. The Fluid Earth 2 implementation of OpenMI 2.0. J. Hydroinform. 16(4), 890–906.Google Scholar
  24. Harpham QK, Cleverley P, Danovaro E, D’Agostino D, Galizia A, Delogu F, Fiori E (2015) Using a model MAP to prepare hydro-meteorological models for generic use. Environ Model Softw 73(C):260–271. doi: 10.1016/j.envsoft.2015.08.007 CrossRefGoogle Scholar
  25. Hill C, DeLuca C, Balaji V, Suarez M, da Silva A (2004) The architecture of the earth system modeling framework. Comput Sci Eng 6:18–28CrossRefGoogle Scholar
  26. ISO19115 (2003) ISO 19115:2003 Geographic information – metadata Accessed 2 May 2014Available at: http://www.iso.org/iso/catalogue_detail.htm?csnumber=26020
  27. Johnston JM, McGarvey DJ, Barber MC, Laniak G, Babendreier J, Parmar R, Wolfe K, Kraemer SR, Cyterski M, Knightes C, Rashleigh B, Suarez L, Ambrose R (2011) An integrated modeling framework for performing environmental assessments: application to ecosystem services in the Albemarle-Pamlico basins (NC and VA, USA). Ecol Model 222:2471–2484CrossRefGoogle Scholar
  28. Kacsuk P (2010) Sharing Interoperable Workflows for large-scale scientific simulations on available DCIs http://www.shiwa-workflow.eu/project. Accessed 26 Mar 2013
  29. NESC Website (2016) http://www.nesc.ac.uk/nesc/define.html. Accessed 23 Feb 2016
  30. OGC NetCDF (2011) OGC Network Common Data Form (NetCDF) Core Encoding Standard version 1.0. Open Geospatial Consortium. Available at: http://www.opengeospatial.org/standards/netcdf. Accessed 2 May 2014
  31. OGC OpenMI 2.0 (2014) OGC open modelling Interface (OpenMI) Interface standard. Open geospatial consortium Interface standard. Available at: http://www.opengeospatial.org/standards/openmi. Accessed 28 Aug 2014
  32. OGC WaterML 2.0 (2012) OGC WaterML 2.0 Part 1 – Timeseries. Open Geospatial Consortium Implementation Standard. Available at: http://www.opengeospatial.org/standards/waterml. Accessed 2 May 2014
  33. OGC Web Coverage Service (2012) OGC WCS 2.0 Interface Standard - Core, version 2.0.1. Available at: http://www.opengeospatial.org/standards/wcs. Accessed 30 Jan 2015
  34. OGC Web Feature Service (2014) OGC Web Feature Service 2.0 Interface Standard version 2.0.2. Available at: http://www.opengeospatial.org/standards/wfs. Accessed 30 Jan 2015
  35. Parodi A, Morando M, Rebora N, Trasforini E, Siccardi F, Craig GC, Tafferner A, Kranzlmuller D, Schiffers M, Clematis A, D’Agostino D, Galizia A, Quarati A (2011) DRIHMS: the white paper ISBN 978–88–906068-0-9. http://cordis.europa.eu/docs/projects/cnect/3/246703/080/deliverables/001-WhitePapersDrihms.pdf
  36. Peckham S, Goodall J (2013) Driving plug-and-play models with data from web services: a demonstration of interoperability between CSDMS and CUAHSI-HIS. Comput Geosci 53:154–161. doi: 10.1016/j.cageo.2012.04.019 CrossRefGoogle Scholar
  37. Peckham S, Hutton E, Norris D (2013) A component-based approach to integrated modeling in the geosciences: the design of CSDMS. Comput Geosci 53:3–12. doi: 10.1016/j.cageo.2012.04.002 CrossRefGoogle Scholar
  38. Procter R, Voss A, Asgari-Targhi M (2013) Fostering the human infrastructure of e-research. Information, Communication & Society 16(10):1668–1691CrossRefGoogle Scholar
  39. Schiffers M, Kranzlmueller D, Clematis A, D'Agostino D, Galizia A, Quarati A, Parodi A, Rebora N, Morando M, Rebora N, Trasforini E, Molini L, Siccardi F, Craig GC, Tafferner A (2011) Towards a grid infrastructure for hydro-meteorological research computer science, 12, 45-62. ISSN:1508–2806Google Scholar
  40. Sutherland J, Townend IH, Harpham QK, Pearce GR (2014) From integration to fusion: the challenges ahead. In: Riddick AT, Kessler H, Giles JRA (eds) Integrated environmental modelling to solve real world problems: methods, visions and challenges, special publications 408. Geological Society, London. doi: 10.1144/SP408.6 Google Scholar
  41. Tarboton DG, Horsburgh JS, Maidment DR, Whiteaker T, Zaslavsky I, Piasecki M, Goodall J, Valentine D, Whitenack T (2009) Development of a community hydrologic information system. 18th World IMACS / MODSIM Congress, Cairns, Australia 13–17 (July 2009) http://mssanz.org.au/modsim09
  42. Weerts AH, Schellekens J, Weiland FS (2010) Real-time geospatial data handling and forecasting: examples from delft-FEWS forecasting platform/system. IEEE J Sel Top Appl 3(3):386–394Google Scholar
  43. Whiteaker T, Cao Y, Castronova AM (2012) Using HydroDesktop to share hydrologic data and analyses. Proceedings of the AWRA Spring Specialty Conference on GIS and Water Resources, New Orleans, LA, March, In, pp 26–28 http://his.cuahsi.org/documents/TimWhiteaker_26686f68_7981.pdf Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.HR WallingfordOxfordshireUK
  2. 2.CIMA Research FoundationGenoaItaly
  3. 3.CNR – Institute of Applied Mathematics and Information TechnologiesGenoaItaly

Personalised recommendations