Abstract
Policy decisions should be guided by the relative degree of risk of error and bias and strength of evidence of the efficacy of alternative management interventions. This study describes the benefits and limitations of applying a sequential evidence hierarchy to evaluate alternative fisheries bycatch management strategies. Fisheries bycatch is an obstacle to global food and livelihood security and is a main anthropogenic threat to several threatened species. Independent synthesis of all accumulated information is a fundamental principle for developing transparent, evidence-informed regional conservation policy. Meta-analytic syntheses produce the most robust and generalizable findings that are optimal for guiding regional bycatch management. Otherwise, given too few studies to support robust meta-syntheses, decisions should rely on qualitative syntheses of accumulated studies. Bycatch mitigation methods with findings only available from studies with relatively weak forms of evidence, or lacking any evidence, should only be considered as a precautionary approach when more certain alternatives are unavailable. Strictly applying a hierarchical approach on study evidence to make policy decisions, however, risks ignoring potentially important findings derived from studies using methods low on an evidence hierarchy. Instead, in making bycatch management policies, authorities should account for all accumulated evidence and the implications of different approaches for testing different hypotheses. Fisheries bycatch policy guided, but not bounded, by a sequential evidence hierarchy promises to achieve ecological and socioeconomic objectives.
Similar content being viewed by others
References
Aspinall W (2010) A route to more tractable expert advice. Nature 463:294–295. https://doi.org/10.1038/463294a
Backmann M (2017) What’s in a gold standard? In defence of randomised controlled trials. Med Health Care Philos 20:513–523. https://doi.org/10.1007/s11019-017-9773-2
Bayliss H, Beyer F (2015) Information retrieval for ecological syntheses. Res Synth Methods 6:36–148. https://doi.org/10.1002/jrsm.1120
Belton B, Thilsted S (2014) Fisheries in transition: Food and nutrition security implications for the global South. Glob Food Sec 3:59–66. https://doi.org/10.1016/j.gfs.2013.10.001
Béné C, Barange M, Subasinghe R et al (2015) Feeding 9 billion by 2050—putting fish back on the menu. Food Sec 7:261–274. https://doi.org/10.1007/s12571-015-0427-z
Bluhm R (2005) From hierarchy to network: a richer view of evidence for evidence-based medicine. Perspect Biol Med 48:535–547. https://doi.org/10.1353/pbm.2005.0082
Boesche T (2020) Reassessing quasi-experiments: policy evaluation, induction, and SUTVA. Br J Philos Sci. https://doi.org/10.1093/BJPS/AXZ006
Borenstein M, Hedges L, Higgins J, Rothstein H (2009) Introduction to meta-analysis. Wiley Press, West Sussex
Brick J (2011) The future of survey sampling. Public Opin Q 75:872–888. https://doi.org/10.1093/poq/nfr045
Burgman M, McBride M, Ashton R et al (2011) Expert status and performance. PLoS ONE 6:229–1222. https://doi.org/10.21371/journal.pone.0022998
Caldwell D, Ades A, Higgins J (2005) Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 331:897–900. https://doi.org/10.1136/bmj.331.7521.897
Capello M, Bach P, Romanov E (2013) Fine-scale catch data reveal clusters of large predators in the pelagic realm. Can J Fish Aquat Sci 70:1785–1791. https://doi.org/10.1139/cjfas-2013-0149
CEBM (2009) Oxford centre for evidence-based medicine: levels of evidence (March 2009). University of Oxford, Oxford
CEE (2013) Guidelines for systematic review and evidence synthesis in environmental management Version 4.2. Collaboration for Environmental Evidence, Bangor University, Bangor
Chalmers I (2007) The lethal consequences of failing to make use of all relevant evidence about the effects of medical treatments: the need for systematic reviews. In: Rothwell P (ed) Treating individuals: from randomized trials to personalised medicine. Elsevier, London, pp 37–58
Chalmers I, Bracken M, Djulbegovic B et al (2014) How to increase value and reduce waste when research priorities are set. The Lancet 383:156–165. https://doi.org/10.1016/S0140-6736(13)62229-1
Chaloupka M (2002) Stochastic simulation modelling of southern Great Barrier Reef green turtle population dynamics. Ecol Modell 148:79–109. https://doi.org/10.1016/S0304-3800(01)00433-1
Chaloupka M, Gilman E, Swimmer Y, Kingma E (2022) A meta-synthesis of marine turtle post-release mortality to support evidence-informed bycatch mitigation policy. Pacific Islands Fisheries Science Center, National Marine Fisheries Service, Honolulu
Choi B, Pak A (2005) A catalog of biases in questionnaires. Prev Chronic Dis 2:A13
Chu R, Walter S, Guyatt G et al (2012) Assessment and implication of prognostic imbalance in randomized controlled trials with a binary outcome—a simulation study. PLoS ONE 7:e36677. https://doi.org/10.1371/journal.pone.0036677
Cooke R (1991) Experts in uncertainty: opinion and subjective probability in science. Oxford University Press, New York
Cox T, Lewison R, Zydelis R, Crowder L, Safina C, Read A (2007) Comparing effectiveness of experimental and implemented bycatch reduction measures: the ideal and the real. Conser Biol 21:1155–1164. https://doi.org/10.1111/j.1523-1739.2007.00772.x
Deaton A, Cartwright N (2018) Understanding and misunderstanding randomized controlled trials. Soc Sci Med 210:2–21. https://doi.org/10.1016/j.socscimed.2017.12.005
Dias S, Caldwell D (2019) Network meta-analysis explained. Arch Dis Child Fetal Neonate Ed 104:F8–F12. https://doi.org/10.1136/archdischild-2018-315224
Dias M, Martin R, Pearmain E et al (2019) Threats to seabirds: a global assessment. Biol Conserv 237:525–537. https://doi.org/10.1016/j.biocon.2019.06.033
Dicks L, Hodge I, Randall N, Scharlemann J et al (2014) A transparent process for “evidence-informed” policy making. Conserv Lett 7:119–125. https://doi.org/10.1111/conl.12046
Downes M, Carlin J (2020) Multilevel regression and poststratification versus survey sample weighting for estimating population quantities in large population health studies. Am J Epidemiol 189:717–725. https://doi.org/10.1002/bimj.201900023
Dulvy N, Pacoureau N, Rigby C et al (2021) Overfishing drives over one third of all sharks and rays toward a global extinction crisis. Curr Biol 31:P4773-4787.e8. https://doi.org/10.1016/j.cub.2021.08.062
Estes J, Terborgh J, Brashares J et al (2011) Trophic downgrading of planet earth. Science 333:301–306. https://doi.org/10.1126/science.1205106
FAO (2011) International guidelines on bycatch management and reduction of discards. Food and Agriculture Organization of the United Nations, Rome
FAO (2020) The state of world fisheries and aquaculture. Sustainability in action. Food and Agriculture Organization of the United Nations, Rome
Finckh A, Tramèr M (2008) Primer: Strengths and weaknesses of meta-analysis. Nat Clin Pract Rheumatol 4:146–152. https://doi.org/10.1038/ncprheum0732
Gilman E, Boggs C, Brothers N (2003) Performance assessment of an underwater setting chute to mitigate seabird bycatch in the Hawaii pelagic longline tuna fishery. Ocean Coast Manag 46:985–1010. https://doi.org/10.1016/j.ocecoaman.2003.12.001
Gilman E, Brothers N, Kobayashi D (2005) Principles and approaches to abate seabird bycatch in longline fisheries. Fish Fish 6:35–49. https://doi.org/10.1111/j.1467-2679.2005.00175.x
Gilman E, Chaloupka M, Musyl M (2018) Effects of pelagic longline hook size on species- and size-selectivity and survival. Rev Fish Biol Fish 28:417–433. https://doi.org/10.1007/s11160-017-9509-7
Gilman E, Chaloupka M, Bach P et al (2020) Effect of pelagic longline bait type on species selectivity: a global synthesis of evidence. Rev Fish Biol Fish. https://doi.org/10.1007/s11160-020-09612-0
Gilman E, Hall M, Booth H et al (2022) A decision support tool for integrated fisheries bycatch management. Rev Fish Biol Fish 32:441–472. https://doi.org/10.1007/s11160-021-09693-5
Gurevitch J, Koricheva J, Nakagawa S, Stewart G (2018) Meta-analysis and the science of research synthesis. Nature 555:175–182. https://doi.org/10.1038/nature25753
Haddaway N, Macura B, Whaley P, Pullin A (2018) ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps. Environ Evid. https://doi.org/10.1186/s13750-018-0121-7
Hanea A, McBride M, Burgman M et al (2016) Investigate Discuss Estimate Aggregate for structured expert judgement. Int J Forecast 33:267–269. https://doi.org/10.1016/j.ijforecast.2016.02.008
Hayes K, Hosack G, Lawrence E et al (2019) Designing monitoring programs for marine protected areas within an evidence-based decision-making paradigm. Front Mar Sci 6:746. https://doi.org/10.3389/fmars.2019.00746
Heino M, Pauli B, Dieckmann U (2015) Fisheries-induced evolution. Annu Rev Ecol Evol Syst 46:461–480. https://doi.org/10.1146/annurev-ecolsys-112414-054339
Hemming V, Burgman M, Hanea A, McBride M, Wintle B (2017) A practical guide to structured expert elicitation using the IDEA protocol. Methods Ecol Evol 9:169–180. https://doi.org/10.1111/2041-210X.12857
Hilborn R, Agostini V, Chaloupka M et al (2021) Area-based management of blue water fisheries: current knowledge and research needs. Fish Fish 23:492–518. https://doi.org/10.1111/faf.12629
Hooten M, Johnson D, Brost B (2021) Making recursive Bayesian inference accessible. Am Stat 75:185–194. https://doi.org/10.1080/00031305.2019.1665584
Jones A, Steel D (2018) Evaluating the quality of medical evidence in real-world contexts. J Eval Clin Pract 24:950–956. https://doi.org/10.1111/jep.12983
Kahneman D (2011) Thinking, fast and slow. Farrar, Straus and Giroux, New York
Khorsan R, Crawford C (2014) External validity and model validity: a conceptual approach for systematic review methodology. Evid-Based Complement Altern Med 2014:1–12. https://doi.org/10.1155/2014/694804
Luján J, Todt O (2021) Evidence based methodology: a naturalistic analysis of epistemic policies in regulatory science. Eur J Philos Sci 11:26. https://doi.org/10.1007/s13194-020-00340-7
Lyman G, Kuderer N (2005) The strengths and limitations of meta-analyses based on aggregate data. BMC Med Res Methodol 5:14. https://doi.org/10.1186/1471-2288-5-14
Mangi S, Smith S, Catchpole T (2016) Assessing the capability and willingness of skippers towards fishing industry-led data collection. Ocean Coast Manag 134:11–19. https://doi.org/10.1016/j.ocecoaman.2016.09.027
Marchionni C, Reijula S (2019) What is mechanistic evidence, and why do we need it for evidence-based policy? Stud Hist Philos Sci 73:54–63. https://doi.org/10.1016/j.shpsa.2018.08.003
Martin T, Burgman M, Fidler F et al (2012) Eliciting expert knowledge in conservation science. Conserv Biol 26:29–38. https://doi.org/10.1111/j.1523-1739.2011.01806.x
Mumby P, Chaloupka M, Bozec Y-M, Steneck R, Montero-Serra I (2021) Revisiting the evidentiary basis for ecological cascades with conservation impacts. Conserv Lett 15:e12847. https://doi.org/10.1111/conl.12847
Musick J (ed) (1999) Life in the slow lane: Ecology and conservation of long-lived marine animals. Symposium 23. American Fisheries Society, Bethesda, USA.
Musyl M, Gilman E (2019) Meta-analysis of post-release fishing mortality in apex predatory pelagic sharks and white marlin. Fish FIsh 20:466–500. https://doi.org/10.1111/faf.12358
Nakagawa S, Poulin R, Mengersen K et al (2015) Meta-analysis of variation: ecological and evolutionary applications and beyond. Methods Ecol Evol 6:143–152. https://doi.org/10.1111/2041-210X.12309
Nelms S, Alfaro-Shigueto J, Arnould J et al (2021) Marine mammal conservation: over the horizon. Endanger Species Res 44:291–325. https://doi.org/10.3354/esr01115
Nichols J, Kendall W, Boomer G (2019) Accumulating evidence in ecology: once is not enough. Ecol Evol 9:13991–14004. https://doi.org/10.1002/ece3.5836
Pacoureau N, Rigby C, Kyne P et al (2021) Half a century of global decline in oceanic sharks and rays. Nature 589:567–574. https://doi.org/10.1038/s41586-020-03173-9
Page M, McKenzie J, Bossuyt P et al (2021a) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. https://doi.org/10.1136/bmj.n.71
Page M, Moher D, Bossuyt P et al (2021b) PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ. https://doi.org/10.1136/bmj.n.160
Pfaller J, Chaloupka M, Bolten A, Bjorndal K (2018) Phylogeny, biogeography and methodology: a meta-analytic perspective on heterogeneity in adult marine turtle survival rates. Sci Rep 8:5852. https://doi.org/10.1038/s41598-018-24262-w
Potts S, Rose K (2018) Evaluation of GLM and GAM for estimating population indices from fishery independent surveys. Fish Res 208:167–178. https://doi.org/10.1016/j.fishres.2018.07.016
Pullin A, Frampton G, Livoreil B, Petrokofsky G (2020) Section 5. Conducting a search. Key CEE standards for conduct and reporting. In: Guidelines and standards for evidence synthesis in environmental management. Version 5.0. Collaboration for Environmental Evidence
Pullin A, Frampton G, Livoreil B, Petrokofsky G (2021) Section 3. Planning a CEE evidence synthesis. In: Guidelines and Standards for Evidence Synthesis in Environmental Management. Version 5.0. Collaboration for Environmental Evidence
Pynegar E, Gibbons J, Asquith N, Jones J (2021) What role should randomized control trials play in providing the evidence base for conservation? Oryx 55:235–244. https://doi.org/10.1017/S0030605319000188
Sackett D, Rosenberg W (1995) The need for evidence-based medicine. J R Soc Med 88:620–624. https://doi.org/10.1177/014107689508801105
Saint-Mont U (2015) Randomization does not help much, comparability does. PLoS ONE 10:e0132102. https://doi.org/10.1371/journal.pone.0132102
Sarstedt M, Bengart P, Shaltoni A, Lehmann S (2018) The use of sampling methods in advertising research: a gap between theory and practice. Int J Advert 37:650–663. https://doi.org/10.1080/02650487.2017.1348329
Satterfield J, Spring B, Brownson R et al (2009) Toward a transdisciplinary model of evidence-based practice. Milkbank Q 87:368–390. https://doi.org/10.1111/j.1468-0009.2009.00561.x
Scottish Intercollegiate Guidelines Network Grading Review Group (2001) A new system for grading recommendations in evidence based guidelines. BMJ 323:334–336. https://doi.org/10.1136/bmj.323.7308.334
Shadish W, Cook T, Campbell D (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin, Boston
Stegenga J (2011) Is meta-analysis the platinum standard of evidence? Stud Hist Philos Biol Biomed Sci 42:497–507. https://doi.org/10.1016/j.shpsc.2011.07.003
Stegenga J (2014) Down with the hierarchies. Topoi 33:313–322. https://doi.org/10.1007/s11245-013-9189-4
Stevens J, Bonfil R, Dulvy N, Walker P (2000) The effects of fishing on sharks, rays and chimaeras (chondrichthyans) and implications for marine ecosystems. ICES J Mar Sci 57:476–494. https://doi.org/10.1006/jmsc.2000.0724
Sutton A (2009) Publication bias. In: Cooper H, Hedges L, Valentine J (eds) Handbook of research synthesis and meta-analysis, 2nd edn. Russell Sage Foundation, New York, pp 435–452
Sutton A, Abrams K, Jones D, Sheldon T, Song F (2000) Methods for meta-analysis in medical research. Wiley, New York
Tourangeau R (2000) Remembering what happened: memory errors and survey reports. In: Stone A, Turkkan J, Bachrach C, Jobe J, Kurtzman H, Cain V (eds) The science of self-report. Lawrence Erlbaum Associates, Mahwah, pp 29–47
Venables W, Dichmont C (2004) GLMs, GAMs and GLMMs: an overview of theory for applications in fisheries research. Fish Res 70:319–337. https://doi.org/10.1016/j.fishres.2004.08.011
Wallace B, Kor C, Dimatteo A, Lee T, Crowder L, Lewison R (2013) Impacts of fisheries bycatch on marine turtle populations worldwide: toward conservation and research priorities. Ecosphere 4:1–49. https://doi.org/10.1890/ES12-00388.1
Walsh W, Kleiber P, McCracken M (2002) Comparison of logbook reports of incidental blue shark catch rates by Hawaii-based longline vessels to fishery observer data by application of a generalized additive model. Fish Res 58:79–94. https://doi.org/10.1016/S0165-7836(01)00361-7
Wang J, Boles L, Higgins B, Lohmann K (2007) Behavioral responses of sea turtles to lightsticks used in longline fisheries. Anim Conserv 10:176–182. https://doi.org/10.1111/j.1469-1795.2006.00085.x
Washington Sea Grant (2016) Protocol in Focus: What is “Haphazard Sampling”? University of Washington, Washington Sea Grant, Seattle
Young H, McCauley D, Galetti M, Dirzo R (2016) Patterns, causes and consequences of Anthropocene defaunation. Annu Rev Ecol Evol Syst 47:333–358. https://doi.org/10.1146/annurev-ecolsys-112414-054142
Acknowledgements
EG acknowledges support from the Pew Fellows Program in Marine Conservation at The Pew Charitable Trusts. The authors have no conflicts of interest to declare.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gilman, E., Chaloupka, M. Applying a sequential evidence hierarchy, with caveats, to support prudent fisheries bycatch policy. Rev Fish Biol Fisheries 33, 137–146 (2023). https://doi.org/10.1007/s11160-022-09745-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11160-022-09745-4