Abstract
Comparative analyses require researchers to not only ensure data quality, but to also make prudent and justifiable assumptions about data comparability. A failure to do so can lead to unreliable conclusions. As a case in point, we comment on a study that estimated the vulnerability of the world’s fish species to climate change using comparisons between life stages (Dahlke et al. 2020, Science 369: 65–70). We highlight concerns with the data quality and argue that the metrics used to investigate ontogenetic differences in thermal tolerance were incomparable and confounded. Therefore, we recommend caution when interpreting their results in light of climate vulnerability. We suggest potential remedies and recommend thermal tolerance metrics that may be comparable across life stages. We also encourage the creation of guidelines to design, report, and assess comparative analyses to increase their reliability and reproducibility.
This is a preview of subscription content, access via your institution.

References
Auer SK, Agreda E, Chen AH et al (2021) Late-stage pregnancy reduces upper thermal tolerance in a live-bearing fish. J Therm Biol 99:103022. https://doi.org/10.1016/j.jtherbio.2021.103022
Cowles RB (Raymond B, Bogert CM (Charles M (1944) A preliminary study of the thermal requirements of desert reptiles. Bulletin of the American Museum of Natural History; 83, article 5.
Dahlke FT, Wohlrab S, Butzin M, Pörtner H-O (2020) Thermal bottlenecks in the life cycle define climate vulnerability of fish. Science 369:65–70. https://doi.org/10.1126/science.aaz3658
DeBiasse MB, Ryan JF (2019) Phylotocol: promoting transparency and overcoming bias in phylogenetics. Syst Biol 68:672–678. https://doi.org/10.1093/sysbio/syy090
Del Rio AM, Davis BE, Fangue NA, Todgham AE (2020) Combined effects of warming and hypoxia on early life stage Chinook salmon physiology and development. Conservat Physiol. https://doi.org/10.1093/conphys/coy078
Fry FEJ (1947) Effects of the environment on animal activity. The University of Toronto Press, Toronto, p 62
Jørgensen LB, Malte H, Overgaard J (2019) How to assess Drosophila heat tolerance: unifying static and dynamic tolerance assays to predict heat distribution limits. Funct Ecol 33:629–642. https://doi.org/10.1111/1365-2435.13279
Jørgensen LB, Malte H, Ørsted M et al (2021) A unifying model to estimate thermal tolerance limits in ectotherms across static, dynamic and fluctuating exposures to thermal stress. Sci Rep 11:12840. https://doi.org/10.1038/s41598-021-92004-6
Mito S (1961a) Pelagic fish eggs from Japanese waters-I. Clupeina, Chanina, Stomiatina, Myctophida, Anguillida, Belonida and Syngnathida. Sci Bull Faculty Agric Kyushu Univ 18:285–310
Mito S (1961b) Pelagic fish eggs from Japanese waters-II. Lamprida, Zeida, Mugilina, Scombrina, Carangina and Stromateina. Sci Bull Faculty Agric Kyushu Univ 18:451–466
Mito S (1962a) Pelagic fish eggs from Japanese waters-V. Calliomina and Ophidiina. Sci Bull Faculty Agric Kyushu Univ 19:377–380
Mito S (1962b) Pelagic fish eggs from Japanese waters-VII. Chaetodontina, Balistina and Ostraciontina. Sci Bull Faculty Agric Kyushu Univ 19:503–506
Mito S (1962c) Pelagic fish eggs from Japanese waters—VI. Labrina. Sci Bull Faculty Agric Kyushu Univ 19:493–502
Mito S (1963) Pelagic fish eggs from Japanese waters-III Percina. Japanese J Ichthyol. 11:39–64. https://doi.org/10.11369/jji1950.11.39
Mito S (1963) Pelagic fish eggs from Japanese waters-IX. Echenieida and Pleuronectida. Japanese J Ichthyol. 11:81–102. https://doi.org/10.11369/jji1950.11.81
Mito S (1963c) Pelagic fish eggs from Japanese waters—IV. Trachinina and Uranoscopina. Sci Bull Faculty Agric Kyushu Univ 19:369–376
Mito S (1963d) Pelagic fish eggs from Japanese waters-VIII. Cottina Japanese J Ichthyol 11:65–79
Nakagawa S, Noble DWA, Senior AM, Lagisz M (2017) Meta-evaluation of meta-analysis: ten appraisal questions for biologists. BMC Biol 15:18. https://doi.org/10.1186/s12915-017-0357-7
O’Dea RE, Lagisz M, Jennions MD et al (2021) Preferred reporting items for systematic reviews and meta-analyses in ecology and evolutionary biology: a PRISMA extension. Biol Rev. https://doi.org/10.1111/brv.12721
Rezende EL, Castañeda LE, Santos M (2014) Tolerance landscapes in thermal ecology. Funct Ecol 28:799–809. https://doi.org/10.1111/1365-2435.12268
Senior AM, Grueber CE, Kamiya T et al (2016) Heterogeneity in ecological and evolutionary meta-analyses: its magnitude and implications. Ecology 97:3293–3299. https://doi.org/10.1002/ecy.1591
Zebral YD, Lansini LR, Costa PG et al (2018) A glyphosate-based herbicide reduces fertility, embryonic upper thermal tolerance and alters embryonic diapause of the threatened annual fish Austrolebias nigrofasciatus. Chemosphere 196:260–269. https://doi.org/10.1016/j.chemosphere.2017.12.196
Acknowledgements
We thank Matthew Symonds for encouraging the submission of this manuscript.
Funding
Financial support was provided by a UNSW Scientia Doctoral Scholarship to PP and SB. SN was supported by the Australian Research Council (ARC) Discovery Project (DP200100367). SMD was supported by the ARC Discovery Early Career Award (DE180100202) and the OPUS from Polish National Science Centre (UMO-2020/39/B/NZ8/01274).
Author information
Authors and Affiliations
Contributions
PP conceived and coordinated the study. All authors participated in the conceptualization and critically revised the manuscript.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare no conflicts of interest or competing interests.
Consent to participate
All authors gave consent to participate in this work.
Consent for publication
All authors gave consent for publication.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Pottier, P., Burke, S., Drobniak, S.M. et al. Methodological inconsistencies define thermal bottlenecks in fish life cycle: a comment on Dahlke et al. 2020. Evol Ecol 36, 287–292 (2022). https://doi.org/10.1007/s10682-022-10157-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10682-022-10157-w
Keywords
- Climate vulnerability
- Thermal tolerance
- Comparability
- Comparative physiology
- Climate change