Abstract
Since the 1990s, numerous agri-environmental indicators and indicator-based methods have been developed to assess the adverse effects of cropping and farming systems such as water pollution by nitrates and pesticides, and gaseous emissions due to nitrogen inputs. This wealth of environmental indicators and assessment methods based on indicators raises issues on the quality of the methods and of the indicators, and on the relevancy of results. Evaluation and comparative studies are therefore needed to answer such issues. Here, we present four recent comparative studies selected for their illustrative value, first, to analyse the methodologies used for comparison of methods, and second, to highlight the main results of the four comparisons. The first study involves 23 indicators to address nitrate leaching. The second study involves 43 indicators to address pesticide risk. The third and fourth studies compare environmental assessment methods based on a set of indicators used in French and Upper Rhine plains (France, Germany and Switzerland). Both studies also compare the outputs of the methods and highlight the low degree of convergence between them. The approach proposed in the last study is the most elaborate among the four case studies. It could be used to develop a generic evaluation and comparison methodology. The review of those four case studies shows the need to formalise the methodology underlying any comparison work of indicators or evaluation methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aubry C., Galan M.B., Mazé A. (2005) Garanties de qualité dans les exploitations agricoles: exemples de l’élaboration du référentiel Quali’Terre®; en Picardie, Cah. Agric. 14, 313–321.
Aurousseau P. (2004) Agrégation des paramètres et bases mathématiques de combinatoire de facteurs de risque, in: Barriuso E. (Ed.), Estimation des risques environnementaux des pesticides, INRA Editions, Paris, pp. 58–74.
Bockstaller C., Girardin P. (2003) How to validate environmental indicators, Agr. Syst. 76, 639–653.
Bockstaller C., Girardin P., Van der Werf H.G.M. (1997) Use of agro-ecological indicators for the evaluation of farming systems, Eur. J. Agron. 7, 261–270.
Bockstaller C., Gaillard G., Baumgartner D., Freiermuth Knuchel R., Reinsch M., Brauner R., Unterseher E. (2006) Méthodes d’évaluation agri-environnementale des exploitations agricoles : Comparaison des méthodes INDIGO, KUL/USL, REPRO et SALCA, ITADA, Colmar, p. 112.
Bockstaller C., Guichard L., Makowski D., Aveline A., Girardin P., Plantureux S. (2008) Agri-environmental indicators to assess cropping and farming systems. A review, Agron. Sustain. Dev. 28, 139–149.
Cariolle M. (2002) DEAC – Nitrogen: means to diagnose nitrogen leaching on a mixedfarm scale, in: Proceedings of the 65th Institut International de Recherches Betteravières Congress, Brussels, Belgium, 13–14 February 2002, pp. 67–74.
Cloquell-Ballester V.A., Monterde-Diaz R., Santamarina-Siurana M.C. (2006) Indicators validation for the improvement of environmental and social impact quantitative assessment, Environ. Impact Assess. Rev. 26, 79–105.
CORPEN (2006) Des indicateurs AZOTE pour gérer des actions de maîtrise des pollutions à l’échelle de la parcelle, de l’exploitation et du territoire, Ministère de l’Écologie et du Développement Durable, http://www.ecologie.gouv.fr/IMG/pdf/maquette_azote29_09.pdf, Paris, p. 113.
Devillers J., Farret R., Girardin P., Rivière J.-L., Soulas G. (2005) Indicateurs pour évaluer les risques liés à l’utilisation des pesticides, Lavoisier, Londres, Paris, New York.
Eckert H., Breitschuh G., Sauerbeck D. (2000) Criteria and standards for sustainable agriculture, J. Plant Nutr. Soil Sci. 163, 337–351.
EEA (2005) Agriculture and environment in EU-15; the IRENA indicator report, European Environmental Agency (EEA), Copenhagen (Danemark), p. 128.
FRCA Centre (2002) DIAGE, manuel d’utilisation et logiciel.
Galan M.B., Peschard D., Boizard H. (2007) ISO 14 001 at the farm level: analysis of five methods for evaluating the environmental impact of agricultural practices, J. Environ. Manage. 82, 341–352.
Gebauer J., Bäuerle A.S. (2000) Betriebliche Umweltinformationstechniken für die Landwirschaft, Ber. Landwirtsch. 78, 354–392.
Girardin P., Devillers J., Thybaud E., Soulas G. (2007) Programme “Indicateurs et pesticides” Phase II : Validation et proposition d’amélioration d’indicateurs “pesticides”, Ministère de l’Écologie et du Développement Durable, p. 71.
Goodlass G., Halberg N., Verschuur G. (2003) Input output accounting systems in the European community – an appraisal of their usefulness in raising awareness of environmental problems, Eur. J. Agron. 20, 17–24.
Halberg N., van der Werf H.M.G., Basset-Mens C., Dalgaard R., de Boer I.J.M. (2005) Environmental assessment tools for the evaluation and improvement of European livestock production systems, Livest. Prod. Sci. 96, 33–50.
Hart A., Brown C.D., Lewis K.A., Tzilivakis J. (2003) p-EMA (II): evaluating ecological risks of pesticides for a farm-level risk assessment system, Agronomie 23, 75–84.
Hertwich E.G., Pease W.S., Koshland C.P. (1997) Evaluating the environmental impact of products and production processes: a comparison of six methods, Sci. Total Environ. 196, 13–29.
Hülsbergen K.J. (2003) Entwicklung und Anwendung eines Bilanzierungsmodells zur Bewertung der Nachhaltigkeit landwirtschaftlicher Systeme, Shaker (Halle, Univ., Habil.-Schr., 2002), Aachen.
Kägi T., Bockstaller C., Gaillard G., Hayer F., Mamy L., Strassemeyer J. (2008) Multicriteria evaluation of RA and LCA assessment methods considering pesticide application, European Network for Durable Exploitation of crop protection strategies (ENDURE), Internal report, p. 43, http://www.endure-network.eu/.
Kirchmann H., Thorvaldsson G. (2000) Challenging targets for future agriculture, Eur. J. Agron. 20. 12, 145–161.
Kovach J., Petzoldt C., Degni J., Tette J. (1992) A method to measure the environmental impact of pesticides, New York’s Food and Life Sciences Bulletin, 8 p.
Laurent F., Vertès F., Farrugia A., Kerveillant P. (2000) Effets de la conduite de la prairie pâturée sur la lixiviation du nitrate. Proposition pour une maîtrise du risque à la parcelle, Fourrages 164, 397–420.
López-Ridaura S., van Keulen H., van Ittersum M.K., Leffelaar P.A. (2005) Multi-scale methodological framework to derive criteria and indicators for sustainability evaluation of peasant natural resource management systems, Environ. Dev. Sustain. 7, 51–69.
Lord E.I., Anthony S.G., Goodlass G. (2002) Agricultural nitrogen balance and water quality in the UK, Soil Use Manage. 18, 363–369.
Maud J., EdwardsJones G., Quin F. (2001) Comparative evaluation of pesticide risk indices for policy development and assessment in the United Kingdom, Agr. Ecosyst. Environ. 86, 59–73.
Meyer-Aurich A. (2005) Economic and environmental analysis of sustainable farming practices – a Bavarian case study, Agr. Syst. 86, 190–206.
Meynard J.M., Cerf M., Guichard L., Jeuffroy M.H., Makowski D. (2002) Which decision support tools for the environmental management of nitrogen? Agronomie 22, 817–829.
Mitchell G., May A., Mc Donald A. (1995) PICABUE: a methodological framework for the development of indicators of sustainable development, Int. J. Sust. Dev. World 2, 104–123.
Nardo M., Saisana M., Saltelli A., Tarantola S. (2005) Tools for composite indicators building. Joint Research Center, European Commission, Ispra (Italy), p. 134.
Nemecek Th., Huguenin-Elie O., Dubois D., Gaillard G. (2005) Ökobilanzierung von Anbausystemen im schweizerischen Acker- und Futterbau, Schriftenreihe der FAL 58, Agroscope FAL Reckenholz, 155 p., Zurich.
Oenema O., van Liere L., Schoumans O. (2005) Effects of lowering nitrogen and phosphorus surpluses in agriculture on the quality of groundwater and surface water in the Netherlands, J. Hydrol. 304, 289–301.
Payraudeau S., van der Werf H.M.G. (2005) Environmental impact assessment for a farming region: a review of methods, Agr. Ecosyst. Environ. 107, 1–19.
Reus J., Leendertse P.C. (2000) The environmental yardstick for pesticides: a practical indicator used in the Netherlands, Crop Prot. 19, 637–641.
Reus J., Leenderste P., Bockstaller C., Fomsgaard I., Gutsche V., Lewis K., Nilsson C., Pussemier L., Trevisan M., van der Werf H., Alfarroba F., Blümel S., Isart J., McGrath D., Seppälä T. (1999) Comparing environmental risk indicators for pesticides. Results of the European CAPER project. Centre for Agriculture and Environment, Utrecht, p. 183.
Reus J., Leenderste P., Bockstaller C., Fomsgaard I., Gutsche V., Lewis K., Nilsson C., Pussemier L., Trevisan M., van der Werf H., Alfarroba F., Blümel S., Isart J., McGrath D., Seppälä T. (2002) Comparing and evaluating eight pesticide environmental risk indicators developed in Europe and recommandations for future use, Agr. Ecosyst. Environ. 90, 177–187.
Riley J. (2001a) The indicator explosion: local needs and international challenges, Agr. Ecosyst. Environ. 87, 119–120.
Riley J. (2001b) Indicator quality for assessment of impact of multidisciplinary systems, Agr. Ecosyst. Environ. 87, 121–128.
Romstad E. (1999) Theorical considerations in the development of environmental indicators, in: Brouwer F.M., Crabtree J.R. (Eds.), Environmental indicators and agricultural policy, CAB International, Wallingford, pp. 13–23.
Rosnoblet J., Girardin P., Weinzaepflen E., Bockstaller C. (2006) Analysis of 15 years of agriculture sustainability evaluation methods, in: Fotyma M., Kaminska B. (Eds.), 9th ESA Congress, Warsaw, Poland, pp. 707–708.
Rossier D., Gaillard G. (2004) Ökobilanzierung des Landwirtschaftsbetriebs: Méthode und Anwendung in 50 Landwirtschaftsbetrieben, 53, p. 142.
Schärlig A. (1985) Décider sur plusieurs critères. Panorama de l’aide à la décision multicritère, Presses polytechniques et universitaires romandes, Lausanne.
Solagro (2000) DIALECTE, Diagnostic Liant Environnement et Contrat Territorial d’Exploitation ; manuel d’utilisation et logiciel.
Solagro (2001) DIALOGUE, Diagnostic Agri-environnemental Global d’exploitation agricole ; manuel et logiciel.
ten Berge H.F.M., Burgers S.L.G.E., Van der Meer H.G., Schröder J.J., Van der Schoot J.R., Van Dijk J.R. (2007) Residual inorganic soil nitrogen in grass and maize on sandy soil, Environ. Pollut. 145, 22–30.
Thomassen M.A., de Boer I.J.M. (2005) Evaluation of indicators to assess the environmental impact of dairy production systems, Agr. Ecosyst. Environ. 111, 185–199.
Thompson M.A. (1990) Determining Impact significance in EIA: a review of 24 methodologies, J. Environ. Manage. 30, 235–250.
Vaillant M., Jouany J., Devillers J. (1995) A multicriteria estimation of the environmental risk of chemicals with the SIRIS method, Toxicol. Model. 1, 57–72.
van der Werf H.G.M., Petit J. (2002) Evaluation of environmental impact of agroculture at the farm level: a comparison and analysis of 12 indicator-based methods, Agr. Ecosyst. Environ. 93, 131–145.
van der Werf H.M.G., Zimmer C. (1998) An indicator of persticide environmental impact based on a fuzzy expert system, Chemosphere 36, 2225–2249.
Vercruysse F., Steurbaut W. (2002) POCER, the pesticide occupational and environmental risk indicator, Crop Prot. 21, 307–315.
Vilain L., Boisset K., Girardin P., Guillaumin A., Mouchet C., Viaux P., Zahm F. (2008) La méthode IDEA: indicateur de durabilité des exploitations agricoles: guide d’utilisation, 3rd edition, Educagri, Dijon.
Acknowledgement
The comparison of 43 pesticide indicators was sponsored by the French Ministry for Ecology and Sustainable Development. The comparison work in Picardie received financial support from the Picardie administrative region (“Conseil Régional de Picardie”) and the French government’s ADEME agency (“Agence pour l’Environnement et la Maîtrise de l’Énergie”). The research within the COMETE project was partly funded by the ITADA (Institut transfrontalier d’application et de développement agronomique) which is sponsored by the EU (Programme INTERREG 3) as well as the Swiss Confederation and the cantons of Basel-Stadt, Basel-Land and Aargau.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science+Business Media B.V
About this chapter
Cite this chapter
Bockstaller, C., Guichard, L., Keichinger, O., Girardin, P., Galan, MB., Gaillard, G. (2009). Comparison of Methods to Assess the Sustainability of Agricultural Systems: A Review. In: Lichtfouse, E., Navarrete, M., Debaeke, P., Véronique, S., Alberola, C. (eds) Sustainable Agriculture. Springer, Dordrecht. https://doi.org/10.1007/978-90-481-2666-8_47
Download citation
DOI: https://doi.org/10.1007/978-90-481-2666-8_47
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-2665-1
Online ISBN: 978-90-481-2666-8
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)