Skip to main content
SpringerLink
Log in

User Driven Data Access Mechanisms

  • Chapter
  • First Online:
Earth System Modelling - Volume 6

Part of the book series: SpringerBriefs in Earth System Sciences ((BRIEFSEARTHSYST))

  • 577 Accesses

Abstract

Most climate and climate impact studies include data analyses and therefore rely on scientific data. Generally, only a small part out of the whole available data of an experiment or model run is used. Hosting these data and making it easily accessible meets two challenges: First, the community of data users virtual organization (VO) grows and becomes more diverse, e.g. the Geographical Information System (GIS) users have started to use scientific climate data. The community investigates natural scientific as well as political, economical and social scientific questions (e.g. climate impact). And as heterogeneous as their questions are their data requirements. The second challenge lies in the continuous intensive growth of the amount of data, which is spread over different specialized data archives worldwide. Researchers create greater amounts of data in a shorter amount of time on the quickly evolving high-performance computing systems, whereas the storage amounts and network capacities develop less rapidly.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.wdc-climate.de

  2. 2.

    https://esgcet.llnl.gov:8443

  3. 3.

    http://www.earthsystemgrid.org

  4. 4.

    http://ndg.badc.rl.ac.uk

  5. 5.

    http://www.c3grid.de

  6. 6.

    http://cmip-pcmdi.llnl.gov/cmip5

  7. 7.

    http://www.geongrid.org

  8. 8.

    http://www.eu-egee.org

  9. 9.

    http://www.teragrid.org

  10. 10.

    http://www.earthsystemgrid.org

  11. 11.

    http://www.unidata.ucar.edu/software

  12. 12.

    http://www.opendap.org

  13. 13.

    http://www.w3c.org

  14. 14.

    http://www.ogf.org

  15. 15.

    http://www.globus.org

  16. 16.

    http://www.oasis-open.org

  17. 17.

    http://www.unidata.ucar.edu/projects/THREDDS

  18. 18.

    http://www.hdfgroup.org

  19. 19.

    http://www.wmo.int/pages/prog/www/DPS/FM92-GRIB2-11-2003.pdf

  20. 20.

    http://ferret.pmel.noaa.gov/LAS

  21. 21.

    http://www.unidata.ucar.edu/software/netcdf/ncml

  22. 22.

    http://www.resc.rdg.ac.uk/trac/ncWMS

  23. 23.

    http://openlayers.org

  24. 24.

    http://ndgbeta.badc.rl.ac.uk

  25. 25.

    http://www.ogcnetwork.net/galeon

  26. 26.

    http://www.globus.org/security/overview.html

  27. 27.

    integrating federated authorization infrastructure (Shibboleth) with Grid technology (the Globus Toolkit) to provide attribute-based authorization for distributed scientific communities, http://gridshib.globus.org.

  28. 28.

    http://shibboleth.internet2.edu

  29. 29.

    http://openid.net

  30. 30.

    http://www2-pcmdi.llnl.gov/cdat

  31. 31.

    http://nco.sourceforge.net

  32. 32.

    http://www.mpimet.mpg.de/cdo

  33. 33.

    http://datacite.org

References

  • Blower J, Haines K, Santokhee A, Liu C (2009) GODIVA2: interactive visualization of environmental data on the Web. Pjil Trans R Soc A 367:1035–1039. doi:10.1098/rsta.2008.0180

    Article  Google Scholar 

  • Dunlap R, Mark L, Rugaber S, Balaji V, Chastang J, Cinquini L, DeLuca C, Middleton D, Murphy S (2008) Earth system curator: metadata infrastructure for climate modelling. Earth Sci Inform 1:131–149. doi:10.1007/s12145-008-0016-1

    Article  Google Scholar 

  • Fielding RT, Taylor RN (2002) Principled design of the modern Web architecture. ACM Trans Internet Technol 2(2):115–150. doi:10.1145/514183. 514185

    Article  Google Scholar 

  • Frich P, Alexander L, Della-Marta P, Gleason B, Haylock M, Tank AK, Peterson T (2002) Observed coherent changes in climatic extremes during the second half of the twentieth century. Clim Res 19:193–212. http://www.vsamp.com/resume/publications/Frich_et_al.pdf

    Google Scholar 

  • GODIVA2 (2009) User guide of the GODIVA2 web client, http://www.resc.rdg.ac.uk/trac/ncWMS/wiki/GodivaTwoUserGuide

  • Groeper R, Grimm C, Makedanz S, Pfeiffenberger H, Ziegler W, Gietz P, Schiffers M (2009) A concept for attribute-based authorization on D-Grid resources. Future Gener Comput Syst 25(3):275–280. doi:10.1016/j.future.2008.05.008

    Article  Google Scholar 

  • Gudgin M, Hadley M, Mendelsohn N, Moreau JJ, Nielsen HF, Karmarkar A, Lafon Y (eds) (2007) SOAP version 1.2 Part 1: messaging framework (2nd edn). Project website, World Wide Web Consortium (W3C). http://www.w3.org/TR/soap12

  • Guilyardi E, Balaji V, Callaghan S, DeLuca C, Devine G, Denvil S, Ford R, Pascoe C, Lautenschlager M, Lawrence B, Steenman-Clark L, Valcke S (2011) The CMIP5 model and simulation documentation: a new standard for climate modelling metadata. CLIVAR Exch 16(56):42–46

    Google Scholar 

  • Haas H (2005) Reconciling Web services and REST services. In: proceedings of the 3rd IEEE European conference on Web services (ECOWS) 2005, Växjö, Sweden, 14–16 Nov 2005. http://www.w3.org/2005/Talks/1115-hh-k-ecows

  • Hankin S, Blower JD, Carval T, Casey KS, Donlon C, Lauret O, Loubrieu T, de la Villeon LP, Srinivasan A, Trinanes J, Godøy Ø, Mendelssohn R, Signell R, de La Beaujardiere J, Cornillon P, Blanc F, Rew R, Harlan J (2009) NetCDF-CF-OPeNDAP: standards for ocean data interoperability and object lessons for community data standards processes (Draft). In: Proceedings of OceanObs’09, 21–25 Sept 2009

    Google Scholar 

  • INSPIRE (2009) Draft technical guidance for INSPIRE download services—Version 2.0, 25 Sept 2009. http://is.gd/894qi

  • INSPIRE drafting team “Network Services” (2008b) INSPIRE network services architecture—version 3.0 19 July 2008. http://is.gd/8949v

  • Kindermann S, Stockhause M, Ronneberger K (2007) Intelligent data networking for the earth system science community. In: Proceedings from the German e-Science conference 2007, Max Planck Digital Library, Baden-Baden, Germany, ID: 316512.0. http://edoc.mpg.de/316512

  • Latham S, Cramer R, Grant M, Kershaw P, Lawrence B, Lowry R, Lowe D, O’Neill K, Miller P, Pascoe S, Pritchard M, Snaith H, Woolf A (2009) The NERC DataGrid services. Philos Trans Royal Soc A Math Phys Eng Sci 367(1890):1015–1019. doi:10.1098/rsta.2008.0238

    Article  Google Scholar 

  • Lautenschlager M (2008) IPCC TGICA and IPCC DDC for AR5 Data. In: Proceedings of the GO-ESSP meeting, Seattle, 17–19 Sep 2008. http://go-essp.gfdl.noaa.gov/2008/files/lautenschlager_GO-ESSP-TGICA+AR5-Seattle-17-19090.ppt

  • Lawrence BN, Kerschaw P, Blower J (2007) Practical access control using NDG security. In: Proceedings of the UK e-science all hands meeting 2007, 10–13 Sept 2007. http://www.allhands.org.uk/2007/proceedings/papers/788.pdf

  • Lawrence B, Lowry R, Miller P, Snaith H, Woolf A (2009) Information in environmental data grids. Philos Trans Royal Soc A Math Phys Eng Sci 367(1890):1003–1014. doi:10.1098/rsta.2008.0238

    Article  Google Scholar 

  • Lowe D, Woolf A, Lawrence B, Pascoe S (2009) Integrating Integrating the climate science modelling language with geospatial software and services. Int J Digit Earth 2(1):29–39. doi:10.1080/ 17538940902866161

    Article  Google Scholar 

  • Nativi S, Caron J, Domenico B (2004) NcML-GML: encoding NetCDF datasets using GML. In: Proceedings of the 15th international workshop on database and expert systems applications, 30 Aug–3 Sept 2004, pp 804–808

    Google Scholar 

  • Nativi S, Domenico B, Caron J, Davis E, Bigagli L (2006) Extending THREDDS middleware to serve OGC community. Adv Geosci 8:57–62. http://www.adv-geosci.net/8/57/2006

    Google Scholar 

  • Plantikow S, Peter K, Högqvist M, Grimme C, Papaspyrou A (2009) Generalizing the data management of three community grids. Future Gener Comput Syst 25(3):281–289. doi:10.1016/j.future.2008.05.001

    Article  Google Scholar 

  • Pouchard L, Woolf A, Bernholdt DE (2005) Data grid discovery and semantic web technologies for the earth sciences. Int J on Digit Libr 5(2):72–83

    Article  Google Scholar 

  • Pouchard L, Cinquini L, Drach B, Middleton D, Bernholdt D, Chanchio K, Foster I, Nefedova V, Brown D, Fox P, Garcia J, Strand G, Williams D, Chervenak A, Kesselman C, Shoshani A, Sim A (2003) An ontology for scientific information in a grid environment: the Earth System Grid. In: Proceedings of the 3rd IEEE/ACM international symposium on cluster computing and the grid (CCGRID’03). http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01199424

  • Proctor R, Roberts K, Bohm P, Cameron S, Hope J, Jones C, Mancini S, Pepper K, Tattersall K, Ward B, Williams G, Mak P, Goessmann F (2009) Information infrastructure for the Australian integrated marine observing system. In: Proceedings of OceanObs’09, 21–25 Sept 2009

    Google Scholar 

  • Siebenlist F, Ananthakrishnan R, Bernholdt D, Cinquini L, Foster I, Middleton D, Miller N, Williams D (2009) Earth system grid authentication infrastructure: integrating local authentication, openID and PKI. In: Proceedings of the TeraGrid 09, Virginia, 22–25 June 2009. http://www.teragrid.org/tg09/files/tg09_submission_79.pdf

  • Stephens A, James P, Alderson D, Pascoe S, Abele S, Iwi A, Chiu P (2012) The challenges of developing an open source, standards-based technology stack to deliver the latest UK climate projections. Int J Digit Earth 5(1):43–62. doi:10(1080/17538947), 2011, 571724

    Article  Google Scholar 

  • Taylor K (2009) CMOR dimensions. Technical report. http://cmip-pcmdi.llnl.gov/cmip5/output_req.html

  • Taylor KE, Balaji V, Hankin S, Juckes M, Lawrence B (2009) CMIP5 and AR5 data reference syntax (DRS). Technical report. http://is.gd/895GZ

  • Taylor K, Doutriaux C (2011) CMIP5 model output requirements: file contents and format, data structure and metadata. Technical report. http://pcmdi-cmip.llnl.gov/cmip5/docs/CMIP5_output_metadata_requirements.pdf

  • Taylor K, Stouffer R, Meehl G (2011) An overview of CMIP5 and the experiment design.Submitted to Bulletin of the American Meteorological Society. doi:10.1175/BAMS-D-11-00094.1

  • The European Parliament and Council (2007) Directive 2007/2/EC of the European Parliament and of the council of 14 March 2007 establishing an Infrastructure for Spatial Information in the European Community (INSPIRE). Off J Eur Union 50:1–14. http://eur-lex.europa.eu/JOHtml.do?uri=OJ:L:2007:108:SOM:EN:HTML

  • WGCM (2007) IPCC standard output from coupled ccean-atmosphere GCMs. Technical report. http://www-pcmdi.llnl.gov/ipcc/standard_output.html

  • Whiteside A, Evans JD (2008) Web coverage service (WCS)—implementation standard. Project website, open geospatial consortium (OGC). http://www.opengeospatial.org/standards/wcs

  • Williams D, Ananthakrishnan R, Bernholdt D, Bharathi S, Brown D, Chen M, Chervenak A, Cinquini L, Drach R, Foster I, Fox P, Fraser D, Garcia J, Hankin S, Jones P, Middleton D, Schwidder J, Schweitzer R, Schuler R, Shoshani A, Siebenlist F, Sim A, Strand W, Su M, Wilhelmi N (2009) The Earth System Grid: enabling access to multimodel climate simulation data. Bull Amer Meteor Soc 90:195–205. doi:10.1175/2008BAMS2459. 1

    Article  Google Scholar 

  • Williams D, Ananthakrishnan R, Bernholdt D, Bharathi S, Brown D, Chen M, Chervenak A, Cinquini L, Drach R, Foster I, Fox P, Hankin S, Henson V, PJones, Middleton D, Schwidder J, Schweitzer R, Schuler R, Shoshani A, Siebenlist F, Sim A, Strand W, Wilhelmi N, Su M (2008a) Data management and analysis for the Earth Sytem Grid. J Phys 125. doi:10.1088/1742-6596

  • Williams D, Middleton D, Anitescu M, Balaji V, Bethel W, Cotter S, Strand G, Schuchardt K, Shoshani A (2008b) Extreme scale data management, analysis, visualization, and productivity in climate change science, panel report. In: Extreme scale computing workshop, Dec 2008. http://is.gd/8950r

  • Williams D, Taylor K, Cinquini L, Evans B, Kawamiya M, Lautenschlager M, Lawrence B, Middleton D, ESGF contributors (2011) The Earth System Grid Federation: software supporting CMIP5 data analysis and dissemination. CLIVAR Exch 16(56):40–42

    Google Scholar 

  • WMO, Ogc (2009) Memorandum of understanding between the World Meteorological Organization and the Open Geospatial Consortium, Inc. In: Proceedings of the 2nd workshop on the use of GIS/OGC standards in meteorology, Toulouse, 23–25 Nov 2009. URL http://is.gd/896Ab

Download references

Author information

Authors and Affiliations

  1. Deutsches Klimarechenzentrum, Hamburg, Germany

    Martina Stockhause

Authors
  1. Martina Stockhause
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martina Stockhause .

Rights and permissions

Reprints and permissions

Copyright information

© 2013 The Author(s)

About this chapter

Cite this chapter

Stockhause, M. (2013). User Driven Data Access Mechanisms. In: Earth System Modelling - Volume 6. SpringerBriefs in Earth System Sciences. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37244-5_5

Download citation

Publish with us

Policies and ethics

Search

Navigation