Skip to main content
Log in

Indicator development in sustainability impact assessment: balancing theory and practice

  • Original Paper
  • Published:
European Journal of Forest Research Aims and scope Submit manuscript

Abstract

In this article, the development and operationalisation of forestry-wood chain indicators within the frame of sustainability impact assessment are discussed. The analytical framework follows a distinction between indicator definition and selection in a first phase, and a second operational phase of indicator application in terms of interconnecting material flows, calculation of chain performance and utilisation within evaluation components. A clear boundary drawing effort in terms of the development of indicator definitions, related subclasses, and measurement units as well as the creation of conversion factors between indicator values and individual chain stages supports this. Economic, social and environmental indicators have to respond to data collection needs on individual process levels (that correspond to sub-divisions of the forestry-wood chain). For the usage of indicators within evaluation tools, a functional hierarchy has to be provided that supports clear preference elicitation as well as information on related externalities. In total, this paper aims at demonstrating an enhanced spectrum in the use of sustainability indicators, and the challenges that arise from a developing and applying multi-functional indicators in sustainability impact assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. The EFORWOOD project team did not include environmental interest groups as it was not possible to integrate them during the development of the research proposal; their input was instead incorporated through a stakeholder workshop conducted in October 2006 (see Fig. 1).

Abbreviations

CBA:

Cost-benefit analysis

DCP:

Data collection protocols

EFORWOOD:

Sustainability impact assessment for the forestry-wood chain

FWC:

Forestry-wood chain

MCA:

Multi-criteria analysis

MCPFE:

Ministerial conference on the protection of forests in Europe

OECD:

Organisation for economic co-operation and development

SIA:

Sustainability impact assessment

ToSIA:

Tool for the sustainability impact assessment

References

  • Bryden JM, Copus A, MacLeod M (2002) Rural Development Indicators, in the Report of the PAIS project, Phase 1. Report for Eurostat with LANDSIS, Luxembourg, Feb

  • Cigies R, Ramanauskiene J, Startiene G (2009) Theoretical reasoning of the use of indicators and indices for sustainable development assessment. Inzinerine Ekonomika-Eng Econ (3):33–40. ISSN 1392–2785

  • Cimorelli AJ, Stahl CH (2005) Tackling the dilemma of the science-policy interface in environmental policy analysis. Bull Sci Technol Soc 25:276–284. doi:10.1177/0270467605277412

    Article  Google Scholar 

  • Commission for Sustainable Development (2006) Indicators of Sustainable Development. http://www.un.org/esa/sustdev/natlinfo/indicators/isdms2001/table_4.htm)

  • Dilly O, Hüttl RF (2009) Top-down and Europe-wide versus bottom-up and intra-regional identification of key issues for sustainability impact assessment. Environ Sci Policy 12:1168–1176

    Article  Google Scholar 

  • Donnelly A, Jones M, O’Mahony T, Byrne G (2007) Selecting environmental indicator for use in strategic environmental assessment. Environ Impact Assess Rev 27:161–175. doi:10.1016/j.eiar.2006.10.006

    Google Scholar 

  • European Commission (2005a) Communication from Mr. Almunia to the Members of the Commission on Sustainable Development Indicators to monitor the implementation of the EU Sustainable Development Strategy. SEC (2005) 161 final

  • European Commission (2005b) Sustainable development indicators for the European Union. Eurostat, Luxemburg

    Google Scholar 

  • Failing L, Gregory R (2003) Ten common mistakes in designing biodiversity indicators for forest policy. J Environ Manage 68:121–132. doi:10.1016/S0301-4797(03)00014-8

    Article  PubMed  Google Scholar 

  • Gamborg C (2006) Minutes of 1st EFORWOOD stakeholder meeting: indicators for sustainability impact assessment of the forestry-wood-chain. Unpublished

  • George C, Kirkpatrick C (2003) Sustainability Impact Assessment of World Trade Negotiations: current practice and lessons for further development. Institute for Development Policy and Management, University of Manchester, UK. Conference paper, new directions in impact assessment for development, University of Manchester, Nov 2003, p. 30

  • Gough AD, Innes JL, Allen SD (2008) Development of common indicators of sustainable forest management. Ecol Indic 8:425–430. doi:10.1016/j.ecolind.2007.03.001

    Article  Google Scholar 

  • Hertin J, Turnpenny J, Jordan A, Nilsson M, Russel D, Nykvist B (2009) Rationalising the policy mess? Ex ante policy assessment and the utilisation of knowledge in the policy process. Environ Plan A 41:1185–1200

    Article  Google Scholar 

  • Holeman N (2009) Incorporating local sustainability indicators into structures of local governance: a review of the literature. Local Environ 14(4):365–375. doi:10.1080/13549830902783043

    Article  Google Scholar 

  • Kates RW, Parris T, Leiserowitz A (2005) What is sustainable development? Goals, indicators, values and practice. Environment 47:8–21

    Article  Google Scholar 

  • Kelly JR, Harwell MA (1988) Indicators of ecosystem response and recovery. In: Levin SA, Harwell MA, Kelly JR, Kimball KD (eds) Ecotoxicology: problems and approaches. Springer, New York, pp 9–35

    Google Scholar 

  • Kirkpatrick C, Lee N (2002): Further development of the methodology for a sustainability impact assessment of proposed WTO negotiations. Final Report to the European Commission. Manchester7 IDPM, University of Manchester

  • Lindner M (2011) Conducting sustainability impact assessments of forestry-wood chains: examples of ToSIA applications. Eur J For Res. doi:10.1007/s10342-011-0483-7

  • Lindner M, Suominen T, Palosuo T, Garcia-Gonzalo J, Verweij P, Zudin S, Päivinen R (2010) ToSIA-A tool for sustainability impact assessment of forest-wood-chains. Ecol Modell 221:2197–2205

    Article  Google Scholar 

  • Lootsma FA (1999) Multi-criteria decision analysis via ratio and difference judgment. Kluwer Academic Publishers, Applied Optimization Series, vol. 29, Dordrecht, The Netherlands

  • Mcalpine P, Birnie A (2005) Is there a Correct way of establishing sustainability indicators? The case of sustainability indicator development on the Island of Guernsey. Local Environ 10(3):243–257. doi:10.1080/13549830500075537

    Google Scholar 

  • McCool SF, Stankey GH (2004) Indicators of sustainability: challenges and opportunities at the interface of science and policy. Environ Manage 33:294–305

    Article  PubMed  Google Scholar 

  • Ministerial Conference on the Protection of Forests in Europe (2002) Improved Pan-European indicators for sustainable forest management. MCPFE Expert Level Meeting 7–8 Oct 2002, Vienna, Austria

  • Ness B, Urbel-Piirsalu E, Anderberg S, Olsson L (2007) Categorising tools for sustainability assessment. Ecol Econ 60:498–508

    Article  Google Scholar 

  • Niemeijer D (2002) Developing indicators for environmental policy: data-driven and theory-driven approaches examined by example. Environ Sci Policy 5:91–103. doi:10.1016/S1462-9011(02)00026-6

    Article  Google Scholar 

  • Niemeijer D, de Groot RS (2008) Framing environmental indicators from casual chains to casual networks. Environ Dev Sustain 10:89–106. doi:10.1007/s10668-006-9040-9

    Article  Google Scholar 

  • Nilsson M, Jordan A, Turnpenny J, Hertin J, Nykvist B, Russel D (2008) The use and non-use of policy appraisal tools in public policy making: an analysis of three European countries and the European Union. Policy Sci 41:335–355

    Article  Google Scholar 

  • OECD (2001) OECD environmental indicators: towards sustainable development. Organisation for Economic Co-operation and Development, Paris

    Google Scholar 

  • Olsson JA, Bockstaller C, Stapleton LM, Ewert F, Knapen R, Therond O, Geniaux G, Bello S, Pinto Correira T, Turpin N, Bezlepkina I (2009) A goal oriented indicator framework to support integrated assessment of new policies for agri-environmental systems. Environ Sci Policy 12:562–572. doi:10.1016/j.envsci.2009.01.012

    Google Scholar 

  • Paracchini ML, Pacini C, Jones MJM, Pérez-Soba M (2011) An aggregation framework to link indicators associated with multifunctional land use to the stakeholder evaluation of policy options. Ecol Indic 11:71–80

    Article  Google Scholar 

  • Pope J, Annandale D, Morrison-Saunders A (2004) Conceptualising sustainability assessment. Environ Impact Assess Rev 24:595–616

    Article  Google Scholar 

  • Prokofieva I, Lucas B. Thorsen BJ, Carlsen K (2009) Monetary values of environmental and social externalities for the purpose of cost-benefit analysis in the EFORWOOD project. EFORWOOD Project Deliverable 1.5.6, CTFC, Spain

  • Pülzl H, Rametsteiner E (2009) Indicator development as “boundary spanning” between scientists and policy-makers. J Sci Public Policy 36(10):743–752. doi:10.3152/030234209X481987

    Article  Google Scholar 

  • Rametsteiner E, Pülzl H, Puustjärvi E (2006) Draft FWC indicator set: detailed review of existing sustainability indicator concepts and sustainability indicator sets of relevance for the FWC, review of potential indicators for selection and their assessment. EFORWOOD Project, Deliverable D1.1.1. http://www.eforwoord.org

  • Rametsteiner E, Berg S, Laurijssen J, Le-Net E, Lindner M, Peuhkuri L, Schweinle J, Vötter D (2008) Revised FWC-sustainability indicators set document. EFORWOOD Deliverable 1.1.6., BOKU University, Austria

  • Rametsteiner E, Pülzl H, Alkan-Olsson J, Frederiksen P (2011) Sustainability indicator development—science or political negotiation? Ecol Indic 11:61–70. doi:10.1016/j.ecolind.2009.06.009

    Article  Google Scholar 

  • Reynolds KM, Johnson KN, Gordon SN (2003) The science/policy interface in logic-based evaluation of forest ecosystem sustainability. Forest Policy Econ 5(4):433–446. doi:10.1016/S1389-9341(03)00041-8

    Article  Google Scholar 

  • Sheil D, Nasi R, B Johnson (2004) Ecological criteria and indicators for tropical forest landscapes: challenges in the search for progress. Ecol Soc 9(1):art. 7 online at: http://www.ecologyandsociety.org/vol9/iss1/art7

  • Singh RK, Murty HR, Gupta SK, Dikshit AK (2009) An overview of sustainability assessment methodologies. Ecol Indic 9:189–212. doi:10.1016/j.ecolind.2008.05.011

    Article  Google Scholar 

  • Turnhout E (2009) The effectiveness of boundary objects: the case of ecological indicators. Sci Public Policy 36(5):403–412

    Article  Google Scholar 

  • Turnhout E, Hisschemöller M, Eijsackers H (2007) Ecological Indicators: between the two fires of science and policy. Ecol Indic (7):215–228. doi: 10.1016/j.ecolind.2005.12.003

  • von Geibler J, Kristof K, Bienge, K (2010) Sustainability assessment of entire forest value chains: integrating stakeholder perspectives and indicators in decision support tools. Ecol Modell 221:2206–2214. doi:10.1016/j.ecolmodel.2010.03.022

    Google Scholar 

  • Weaver PM, Jordan A (2008) What roles are there for sustainability assessment in the policy process? Int J Innov Sustain Dev 3:9–32

    Article  Google Scholar 

  • Wilson J, Tyedmers P, Pelot R (2007) Contrasting and comparing sustainable development indicator metrics. Ecol Indic 7(2):299–314

    Article  Google Scholar 

  • Wolfslehner B, Seidl R (2010) Harnessing ecosystem models and multi-criteria decision analysis for the support of forest management. Environ Manage 46(6):850–861. doi:10.1007/s00267-009-9414-5

    Article  PubMed  Google Scholar 

  • Wolfslehner B, Vacik H (2011) Mapping indicator models: from intuitive problem structuring to quantitative decision-making in sustainable forest management. Ecol Indic 11(2):274–283. doi:10.1016j.ecolind/20010.05.004

    Article  Google Scholar 

  • Wolfslehner B, Brüchert F, Fischbach J, Rammer W, Becker G, Lindner M, Lexer MJ (2011) Exploratory multi-criteria analysis in sustainability impact assessment of forest-wood chains: the example of a regional case study in Baden–Württemberg. Eur J For Res. doi:10.1007/s10342-011-0499-z

Download references

Acknowledgments

This work was funded by the European Community’s Sixth Framework Programme within the Integrated Project “EFORWOOD,” contract no. 518128. We thank Gerhard Weiss for his constructive comments on earlier drafts, and three anonymous reviewers for helping to improve the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Helga Pülzl.

Additional information

Communicated by K. Rosén.

Major parts of this text have been written during the research stay of Helga Pülzl at Rutgers University (USA) that was financially supported through an Erwin Schrödinger Fellowship of the FWF Austrian Science Fund (J 3015-G16).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Pülzl, H., Prokofieva, I., Berg, S. et al. Indicator development in sustainability impact assessment: balancing theory and practice. Eur J Forest Res 131, 35–46 (2012). https://doi.org/10.1007/s10342-011-0547-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10342-011-0547-8

Keywords

Navigation