Skip to main content

Abstract

The principles of model evaluation in terms of quality assurance, model validation, and software evaluation were elaborated and discussed with the intention to develop a suitable evaluation protocol for chemical risk assessment models. Since scientific theories and the mathematical models embedded therein cannot be proved as true, a pragmatic meaning of validation is required, of which the primary purpose is to increase the level of confidence that is placed in the model. The accuracy of the model outcome is a necessary, but insufficient criterion for the quality assurance of models. A wider approach is required which examines the scientific inference that can be made about models relative to their intended purpose. By reviewing the literature on the validation problem, it was found that all the facets of validation can be assigned to generic (internal) and task-specific (external) properties of a model. Appropriate and detailed quality criteria for fate and exposure assessment software have been recently developed. They are based on common standards for software supplemented by specific requirements for this field of application. Altogether, quality assurance of a model includes internal and external validation and addresses evaluation of the respective software. It should focus not only on the predictive capability of a model, but also on the strength of the theoretical underpinnings, the evidence supporting the model conceptualization, the database, and the software.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Beck MB, Chen J (2000) Assuring the quality of models designed for predictive tasks. In: Saltelli A, Chan K, Scott M (eds) Mathematical and statistical methods for sensitivity analysis. Wiley, New York

    Google Scholar 

  • Beck MB, Ravetz JR, Mulkey LA, Barnwell TO (1997) On the problem of model validation for predictive exposure assessments. Stoch Hydrol Hydraul 11: 229–254

    Article  Google Scholar 

  • Berding V (2000) Validation of a regional distribution model for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück

    Google Scholar 

  • Berding V, Schwartz S, Trapp S, Matthies M (2000) Validierung von Umweltexpositions-modellen und in Modellen verwendeten Parametern. Umweltbundesamt Berichte Nr. 9/00, E. Schmidt, Berlin

    Google Scholar 

  • Bredehoeft JD, Konikow LF (1993) Ground-water models: validate or invalidate. Ground Water 31:178–179

    Article  Google Scholar 

  • Caswell H (1976) The validation problem. In: Patten (ed) Systems analysis and simulation in ecology. Academic Press, New York, vol IV, pp 313 - 325

    Google Scholar 

  • EC (1996) Technical guidance document in support of the Commission Directive 93/67/EEC on risk assessment for new notified substances and the Commission Regulation (EC) 1488/94 on risk assessment for existing substances, parts I-IV. Office for Official Publications of the European Communities, Luxembourg

    Google Scholar 

  • Gayler S (1999) Bewertung computergestützter Umwelt-Simulationsmodelle. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück

    Google Scholar 

  • Jager T (1995) Feasibility of validating the uniform system for the evaluation of substances (USES). RIVM Rep No 679102 026 Bilthoven

    Google Scholar 

  • Knöll HD, Slotos T, Suk W (1996) Entwicklung und Qualitätssicherung von Anwendungs-software. Spektrum, Heidelberg

    Google Scholar 

  • Knorr G (1997) Zertifizierung von Softwareprodukten nach DIN ISO/IEC 12119. Comput Recht 3: 180–182

    Google Scholar 

  • Konikow LF, Bredehoeft JD (1992) Ground-water models cannot be validated. Adv Water Resour 15: 75–83

    Article  Google Scholar 

  • Leeuwen CJ, Hermens van JL (1995) Risk assessment of chemicals: an introduction. Kluwer Academic Publ, Dordrecht

    Book  Google Scholar 

  • Oreskes N, Shrader-Frechette K, Belitz K (1994) Verification, validation, and confirmation of numerical models in the earth sciences. Science 263: 641–646

    Article  CAS  Google Scholar 

  • Popper KR (1959) The logic of scientific discovery. Harper, New York

    Google Scholar 

  • Popper KR (1963) Conjectures and refutations: the growth of scientific knowledge. Harper, New York

    Google Scholar 

  • Ragas AMJ, Etienne RS, Willsemsen FH, Meent van de D (1999) Assessing model uncertainty for environmental decision making: a case study of the coherence of independently derived environmental quality objectives for air and water. Environ Toxicol Chem 18: 1856–1867

    Article  CAS  Google Scholar 

  • Robinson S (1999) Simulation, verification, validation, and confidence: a tutorial. Transactions 16: 63–69

    Google Scholar 

  • Rykiel EJ Jr (1995) Testing ecological models: the meaning of validation. Ecol Model 90: 229–244

    Article  Google Scholar 

  • Sargent RG (1993) Validation of simulation models: general approach. In: Young (ed) Concise encyclopaedia of environmental systems. Pergamon Press, New York

    Google Scholar 

  • Schwartz S (2000) Quality assurance of exposure models for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück

    Google Scholar 

  • Schwartz S, Berding V, Trapp S, Matthies M (1998) Quality criteria for environmental risk assessment software - using the example of EUSES. Environ Sci Pollut Res 5: 217–222

    Article  CAS  Google Scholar 

  • Trapp S, Matthies M (1998) Chemodynamics and environmental modeling - an introduction. Springer, Berlin Heidelberg

    Book  Google Scholar 

  • Veerkamp W, Wolff C (1996) Fate and exposure models in relation to risk assessment - developments and validation criteria. Environ Sci Pollut Res 3: 91 -95

    Article  CAS  Google Scholar 

  • Wagner J, Matthies M (1996) Guidelines for selection and application of fate and exposure models. Environ Sci Pollut Res 3: 47–51

    Article  CAS  Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Schwartz, S., Berding, V., Matthies, M. (2001). Evaluation Methodology for Fate and Exposure Models. In: Matthies, M., Malchow, H., Kriz, J. (eds) Integrative Systems Approaches to Natural and Social Dynamics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-56585-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-56585-4_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-62526-8

  • Online ISBN: 978-3-642-56585-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics