Skip to main content
Log in

Assessing the impact of errors in sorting and identifying macroinvertebrate samples

  • Published:
Hydrobiologia Aims and scope Submit manuscript

Abstract

This study assesses the impact of errors in sorting and identifying macroinvertebrate samples collected and analysed using different protocols (e.g. STAR-AQEM, RIVPACS). The study is based on the auditing scheme implemented in the EU-funded project STAR and presents the first attempt at analysing the audit data. Data from 10 participating countries are analysed with regard to the impact of sorting and identification errors. These differences are measured in the form of gains and losses at each level of audit for 120 samples. Based on gains and losses to the primary results, qualitative binary taxa lists were deducted for each level of audit for a subset of 72 data sets. Between these taxa lists the taxonomic similarity and the impact of differences on selected metrics common to stream assessment were analysed. The results of our study indicate that in all methods used, a considerable amount of sorting and identification error could be detected. This total impact is reflected in most functional metrics. In some metrics indicative of taxonomic richness, the total impact of differences is not directly reflected in differences in metric scores. The results stress the importance of implementing quality control mechanisms in macroinvertebrate assessment schemes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • AQEM consortium, 2004. AQEMdip: AQEM data input program. Downloadable from http://www.eu-star.at

  • P. D. Armitage D. Moss J. F. Wright M. T. Furse (1983) ArticleTitleThe performance of a new biological water quality score system based on macroinvertebrates over a wide range of unpolluted running-water sites Water Research 17 333–347 Occurrence Handle1:CAS:528:DyaL3sXhtFegtLY%3D Occurrence Handle10.1016/0043-1354(83)90188-4

    Article  CAS  Google Scholar 

  • Biss, R., P. Kübler, I. Pinter & U. Braukmann, 2002. Leitbildbezogenes biozönotisches Bewertungsverfahren für Fließgewässer (aquatischer Bereich) in der Bundesrepublik Deutschland. Ein erster Beitrag zur integrierten ökologischen Fließgewässerbewertung – Final report on CD-ROM. UBA Texts 62/02, Berlin

  • J. Böhmer C. Rawer-Jost A. Zenker C. Meier C. Feld R. Biss D. Hering (2004) ArticleTitleDevelopment of a multimetric invertebrate based assessment system for German rivers Limnologica 34 416–432

    Google Scholar 

  • A. J. Boulton P. S. Lake (1992) ArticleTitleThe ecology of two streams in Victoria, Australia. III. Temporal changes in species composition Freshwater Biology 27 123–138 Occurrence Handle10.1111/j.1365-2427.1992.tb00528.x

    Article  Google Scholar 

  • Y. Cao C. P. Hawkins M. R. Vinson (2003) ArticleTitleMeasuring and controlling data quality in biological assemblage surveys with special reference to stream benthic macroinvertebrates Freshwater Biology 48 1898–1911 Occurrence Handle10.1046/j.1365-2427.2003.01123.x

    Article  Google Scholar 

  • J. L. Carter V. H. Resh (2001) ArticleTitleAfter site selection and before data analysis: sampling, sorting, and laboratory procedures used in stream benthic macroinvertebrate monitoring programs by USA state agencies Journal of the North American Benthological Society 20 658–682 Occurrence Handle10.2307/1468095

    Article  Google Scholar 

  • R. T. Clarke (2000) Uncertainty in estimates of river quality based on RIVPACS J. F., Wright D. W. Sutcliffe M. T. Furse (Eds) Assessing the Biological Quality of Freshwaters: RIVPACS and Similar Techniques Freshwater Biological Association Ambleside 39–54

    Google Scholar 

  • R. T. Clarke M. T. Furse R. J. M. Gunn J. M. Winder J. F. Wright (2002) ArticleTitleSampling variation in macroinvertebrate data and implications for river quality indices Freshwater Biology 47 1735–1751 Occurrence Handle10.1046/j.1365-2427.2002.00885.x

    Article  Google Scholar 

  • R. T. Clarke J. Davy-Bowker L. Sandin N. Friberg R. K. Johnson B Bis (2006a) ArticleTitleEstimates and comparisons of the effects of sampling variation using ‘national’ macroinvertebrate sampling protocols on the precision of metrics used to assess ecological status Hydrobiologia 566 477–503

    Google Scholar 

  • R. T. Clarke A. Lorenz L. Sandin A. Schmidt-Kloiber J. Strackbein N. T. Kneebone P. Haase (2006b) ArticleTitleEffects of sampling and sub-sampling variation using the STAR-AQEM sampling protocol on the precision of macroinvertebrate metrics Hydrobiologia 566 441–459

    Google Scholar 

  • C. Doberstein J. Karr L. Conquest (2000) ArticleTitleThe effect of fixed-count subsampling on macroinvertebrate biomonitoring in small streams Freshwater Biology 44 355–371 Occurrence Handle10.1046/j.1365-2427.2000.00575.x

    Article  Google Scholar 

  • European Union, 2000. Directive 2000/60/EC. Establishing a framework for community action in the field of water policy. European Commission PE-CONS 3639/1/100 Rev 1, Luxemburg

  • M. Furse D. Hering O. Moog P. Verdonschot R. K. Johnson K. Brabec K. Gritzalis A. Buffagni P. Pinto N. Friberg J. Murray-Bligh J. Kokes R. Alber P. Usseglio-Polatera P. Haase R. Sweeting B. Bis K. Szoszkiewicz H. Soszka G. Springe F. Sporka I. Krno (2006) ArticleTitleThe STAR project: context, objectives and approaches Hydrobiologia 566 3–29

    Google Scholar 

  • V. Ganasan R. M. Hughes (1998) ArticleTitleApplication of an index of biological integrity (IBI) to fish assemblages of the rivers Khan and Kshipra (Madhya Pradesh), India Freshwater Biology 40 367–383 Occurrence Handle10.1046/j.1365-2427.1998.00347.x

    Article  Google Scholar 

  • P. Haase S. Lohse S. Pauls K. Schindehütte A. Sundermann P. Rolauffs D. Hering (2004a) ArticleTitleAssessing streams in Germany with benthic invertebrates: development of a practical standardised protocol for macroinvertebrate sampling and sorting Limnologica 34 349–365

    Google Scholar 

  • P. Haase S. Pauls A. Sundermann A. Zenker (2004b) ArticleTitleTesting different sorting techniques in macroinvertebrate samples from running waters Limnologica 34 366–378

    Google Scholar 

  • D. Hering C. Meier C. Rawer-Jost R. Biss C. Feld A. Zenker A. Sundermann S. Lohse J. Böhmer (2004a) ArticleTitleAssessing streams in Germany with benthic invertebrates: selection of candidate metrics Limnologica 34 398–415

    Google Scholar 

  • D. Hering O. Moog L. Sandin P. F. M. Verdonschot (2004b) ArticleTitleOverview and application of the AQEM assessment system Hydrobiologia 516 1–20 Occurrence Handle10.1023/B:HYDR.0000025255.70009.a5

    Article  Google Scholar 

  • P. Jaccard (1901) ArticleTitleÉtude comparative de la distribution florale dans une portion des Alpes et des Jura Bulletin de la Société Vaudoise des Sciences Naturelles 37 547–579

    Google Scholar 

  • A. Lorenz L. Kirchner D. Hering (2004) ArticleTitle‘Electronic subsampling’ of macrobenthic samples: how many individuals are needed for a valid assessment result? Hydrobiologia 516 299–312 Occurrence Handle10.1023/B:HYDR.0000025272.05793.00

    Article  Google Scholar 

  • H. B. Mann D. R. Whitney (1947) ArticleTitleOn a test of whether one of two random variables is stochastically larger than the other Annals of Mathematical Statistics 18 50–60

    Google Scholar 

  • B. McCune M. J. Mefford (1999) PC-ORD. Multivariate Analysis of Ecological Data. Version 4.25 MjM Software Gleneden Beach, Oregon, USA

    Google Scholar 

  • E. P. McElravy G. A. Lamberti V. H. Resh (1989) ArticleTitleYear-to-year variation in the aquatic macroinvertebrate fauna of a northern Californian Stream Journal of the North American Benthological Society 8 51–63 Occurrence Handle10.2307/1467401

    Article  Google Scholar 

  • Murray-Bligh, J. A. D., M. T. Furse, F. H. Jones, R. J. M. Gunn, R. A. Dines & J. F. Wright, 1997. Procedure for collecting and analysing macroinvertebrate samples for RIVPACS. Joint publication by the Institute of Freshwater Ecology and the Environment Agency, 162 pp

  • Murray-Bligh, J., J. van der Molen & P. Verdonschot, 2006. STAR deliverable No. 7: Audit of Performance incorporating Results of the La Bresse sampling and analysis workshop. Unpublished report. www.eu-star.at

  • InstitutionalAuthorNameNational Water Council (1981) River Quality: The 1980 Survey and Future Outlook National Water Council UK

    Google Scholar 

  • T. Ofenböck O. Moog J. Gerritsen M. Barbour (2004) ArticleTitleA stressor specific multimetric approach for monitoring running waters in Austria using benthic macro-invertebrates Hydrobiologia 516 251–268 Occurrence Handle10.1023/B:HYDR.0000025269.74061.f9

    Article  Google Scholar 

  • J. D. Ostermiller C. P. Hawkins (2004) ArticleTitleEffects of sampling error on bioassessments of stream ecosystems: application to RIVPACS-type models Journal of the North American Benthological Society 23 363–382 Occurrence Handle10.1899/0887-3593(2004)023<0363:EOSEOB>2.0.CO;2

    Article  Google Scholar 

  • C. E. Shannon W. Weaver (1949) Mathematical Theory of Communication The University of Illinois Press Urbana, IL

    Google Scholar 

  • H. Schweder (1992) ArticleTitleNeue Indices für die Bewertung des ökologischen Zustandes von Fließgewässern, abgeleitet aus der Makroinvertebraten-Ernährungstypologie Limnologie Aktuell 3 353–377

    Google Scholar 

  • F. Šporka H. E. Vlek E. Bulánková I. Krno (2006) ArticleTitleInfluence of seasonal variation on bioassessment of streams using macroinvertebrates Hydrobiologia 566 543–555

    Google Scholar 

  • StatSoft, Inc., 2002. STATISTICA for Windows (Software-System for Data Analysis) Version 6.1. www.statsoft.com

  • N. S. Weatherby S. J. Ormerod (1990) ArticleTitleThe constancy of univoltine assemblages in soft water streams: implications for the publication and detection of environmental change Journal of Applied Ecology 27 952–964 Occurrence Handle10.2307/2404389

    Article  Google Scholar 

  • P. Wiberg-Larsen K. P. Brodersen S. Birkholm P. N. Grøn J. Skriver (2000) ArticleTitleSpecies richness and assemblage structure of Trichoptera in Danish streams Freshwater Biology 43 633–647 Occurrence Handle10.1046/j.1365-2427.2000.00546.x

    Article  Google Scholar 

  • F. Wilcoxon (1945) ArticleTitleIndividual Comparisons by Ranking Methods Biometrics 1 80–83 Occurrence Handle10.2307/3001968

    Article  Google Scholar 

  • H. E. Vlek F. Šporka I. Krno (2006) ArticleTitleInfluence of macroinvertebrate sample size on bioassessment of streams Hydrobiologia 566 523–542

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Haase.

Additional information

Peter Haase, Andrea Sundermann: These authors contributed equally to this work.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Haase, P., Murray-Bligh, J., Lohse, S. et al. Assessing the impact of errors in sorting and identifying macroinvertebrate samples. Hydrobiologia 566, 505–521 (2006). https://doi.org/10.1007/s10750-006-0075-6

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10750-006-0075-6

Keywords

Navigation