The conservation of Caribou (Rangifer tarandus), one of the most iconic species in Canada, is now urgent and carries large economic, ecological, cultural and social implications. The species is now classified nation-wide as threatened or endangered, owing to severe population declines. Some of the steepest declines have occurred in ecotypes of the western Cordillera. Here, Environment Canada recognizes four “designatable units” of caribou (COSEWIC 2011): (1) the Boreal ecotype (woodland caribou), which is non-migratory; (2) the Northern Mountain ecotype, in northern British Columbia (BC) and the Yukon and a small portion of adjacent Alaska; (3) the Central Mountain ecotype, along the Rocky Mountain crest; and (4) the Southern Mountain ecotype, which occurs in eastern BC, and until 2017, extended southward into the United States (Wiles 2017). The Boreal, Northern, and Central Mountain ecotypes forage in winter predominantly on ground-dwelling lichens, accessible because of relatively shallow snow depths. The Southern Mountain ecotype, by contrast, lives in an ecosystem where winter snows are often 3–4 m deep, and has evolved an obligate dependence on arboreal lichens. This key winter forage only grows in suitable abundance in old forests and is accessible from atop the snowpack (Edwards et al. 1960). This ecological and evolutionary context, and its two annual elevational migrations (Edwards and Ritcey 1959), has led most authors to regard the Southern Mountain ecotype as distinctive, and prompted some to refer to it descriptively as the Deep-Snow Mountain caribou (Seip and McLellan 2008; Serrouya et al. 2012; Serrouya 2013). We adopt that naming convention here.
Deep-Snow Mountain caribou have experienced some of the steepest population declines of any caribou ecotype in the world. Declines began at the southern edge of the range, which once extended into Montana’s Bitterroot Mountains (Manley 1986). Nearly all U.S. populations had disappeared by 1980, except for one in the Selkirk Mountains of Idaho and Washington. In 1984, the Deep-Snow Mountain ecotype was listed as Endangered under the U.S. Endangered Species Act (as ‘Mountain Caribou’). A decline in BC began around the same time (Spalding 2000). Despite warnings that industrial resource extraction, primarily forestry, was detrimental to maintaining viable caribou populations, habitat modification, fragmentation and associated road-building increased over subsequent decades. By the early 2000s, population declines had accelerated across the Canadian mountain caribou ecotypes, with Deep-Snow Mountain caribou registering a reduction of 45% in 27 years (COSEWIC 2014). In 2014, Deep-Snow Mountain and Central Mountain caribou were classified as Endangered by the Committee on the Status of Endangered Wildlife in Canada, while the other ecotypes remained listed as Threatened (COSEWIC 2014).
Since the 1970s, biologists and governments identified clearcut logging as the likely primary cause for the decline of Deep-Snow Mountain caribou (BC Ministry of Environment 1979; Stevenson et al. 2001). Low recruitment was, however, widely attributed to predation, which is thought to be facilitated by two intertwined processes: first, the increase of other ungulates in early seral habitats that result from logging, which leads to increased predator densities (“apparent competition”: Seip 1992; Wittmer et al. 2007, 2010); and second, the greater accessibility for predators to caribou via clearcuts, roads, snow compacted by snowmobiles, and the loss of forested refuges (Environment Canada 2014). The recognition of the disturbance-mediated effects of predators has led to a shift in the types of “adaptive management” measures recommended to governments and land management stakeholders. For example, wolf culling by poison baits and shooting from helicopters was reinstated in the 1980s to slow caribou declines in Northern Mountain and Central Mountain ecotypes (Bergerud and Elliot 1986) and later in the Deep Snow Mountain ecotype (Seip 1992). Additionally, pregnant caribou cows have been held in two experimental “maternity pens” to allow calving without risk of predation. Even so, biologists have expressed skepticism at the efficacy of these measures, especially for Deep-Snow Mountain caribou (Serrouya et al. 2017).
Against this background, Serrouya et al. (2019) analyzed the efficacy of four variants of “adaptive management” in slowing population declines of threatened and endangered caribou in BC and Alberta, Canada: wolf removal (n = 6 subpopulations), moose removal (n = 4), wolf removal + penning (n = 1), and translocation (n = 1), compared to controls (i.e., no intervention; n = 6). Using this approach, Serrouya et al. (2019) tested hypotheses regarding the potential efficacy of various treatments (factors) with reference to control conditions, while accounting for habitat alteration (using an index) as a covariate. The 18 populations were drawn from three mountain ecotypes (17) and one Boreal subpopulation. As a response metric, Serrouya et al. evaluated changes in the finite population growth rate, lambda (\(\lambda )\) between periods of various lengths before and after treatments. They combined a frequentist approach and information theoretic model selection to assess whether adaptive management or habitat alteration could account for changes in lambda. The authors found wolf removal and wolf removal + penning were associated with more positive values of lambda compared to controls. They noted, prominently and in the abstract, no effect of the habitat alteration covariate. In national media, the authors referred to their results as a “black and white” case for wolf culling and maternal penning (e.g. Weber 2019). BC government policy soon thereafter ruled out new habitat protections for Deep Snow Mountain caribou (Fletcher 2019) and BC government officials cited the research as justification for at least one new wolf culling program (Shore 2019).
Given the policy implications and ultimate costs of error related to this applied research, the work of Serrouya et al. (2019) warrants close examination. Drawing on principles of strong inference (Platt 1964), we evaluated their analytical approach and re-examined the authors’ own data to “stress-test” their conclusions. We identified several shortcomings, which we detail below under five broad headings.
The authors did not report the results of a null model, which performs equally as well as treatments
Serrouya et al. employed model selection based on net change relative to a top-performing model, as expressed as differences in their respective corrected Akaike Information Criteria \((\Delta\) AICc)—an information theoretical approach that confronts a limited set of a priori models with data. This strategy can help scientists make inferences about biological processes, but the outcome of model selection relies on the candidate set of models considered (Burnham and Anderson 2002). Serrouya et al. reported only a subset of possible models (treatment + habitat, treatment, and habitat: their Tables S2, S3, Table 1) and omitted the important intercept-only model. The latter is crucial because it serves as a null scenario in which the response varies randomly, irrespective of any considered predictor. When including this null model, we found \(\Delta\) AICc to differ little (\(\Delta\) AICc < 2; Table 1A) among the intercept-only, habitat alteration and treatment models (Table 1A). This finding alone indicates that the wolf culling and maternal penning treatments from Serrouya et al. (2019) explain population dynamics of caribou no better than either habitat alteration or random chance alone.
Table 1 Model comparison based on AICc for (A) predictors except ecotype and (B) predictors as in (A) plus ecotype Owing to differences in behaviour and habitat use among ecotypes, we hypothesized that the change in lambda might be either ecotype-specific or that it depends on the interaction between ecotype and other predictors considered by Serrouya et al. Accordingly, we considered a broader candidate model set, which additionally included ecotype and its interactions with habitat alteration and treatments. We found that a model with ecotype as predictor outperformed all others (\(\Delta\) AICc ≥ 4.1, Table 1B), with significant differences between (i) Northern Mountain and Central Mountain and (ii) Deep-Snow Mountain and Central Mountain ecotypes, respectively (Fig. 1). The question why ecotype accounts for so much variation in the response variable is discussed below.
The study design was not balanced
Although Serrouya et al. (2019) referred to their work as a “replicated management experiment”, the study in fact drew from a patchwork of older and more recent studies across the four ecotypes. For example, the authors selected controls based on “matching ecological conditions as closely as possible to the treatment populations”, but wolf reduction treatments were drawn from the Central Mountain ecotype (n = 5) and Boreal population (n = 1), whereas the six controls were drawn from Deep-Snow Mountain (n = 3), Northern Mountain (n = 2) and Central Mountain (n = 1) ecotypes. This unbalanced design challenges the ability to account for any potential effects of ecotype (Fig. 1). Another variable that could not be accounted for (neither in the original nor in this work) was wolf density associated with different ecotypes and populations, which for most areas is unknown in the absence of wolf census data. Collectively, these design considerations carry broad implications for the inference of cause and the assumption of transferability of results among ecotypes, which we discuss in more detail below.
More than half of the populations in the study area were omitted and not discussed
Serrouya et al. (2019) used only 18 of 42 mountain caribou populations in the study area (COSEWIC 2014; ECCC 2018). The 24 excluded populations (Supplementary Table 1) include: (a) two large Deep-Snow Mountain populations subjected to an 8-year wolf sterilization experiment; and (b) nine other populations—three Central Mountain, one Northern Mountain and five Deep-Snow Mountain—that became functionally extinct during the study (COSEWIC 2014; ECCC 2018). Population data were available for all 24 of these populations to calculate lambda over appropriate periods, both for those with treatments and those without (Supplementary Table 1). Several of the trajectories of the excluded populations appear to contradict the inference Serrouya et al. (2019) made. In the Quesnel Lake area, for example, lambda declined during or after a wolf cull while in Wells Gray Park, in the same years but with no such treatment, lambda increased (both of these are parts of the Wells Gray subpopulation; Wittmer et al. 2005b). In the North Cariboo Mountains, lambda decreased during or after wolf sterilization and moose reduction. In South Narraway, lambda declined markedly during or after a wolf cull. Finally, the Charlotte Alplands subpopulation became extirpated altogether despite translocation of 52 caribou from the nearby Itcha-Ilgatchuz subpopulation (Supplementary Table 1). Including these and the other cases in the analysis might have allowed more comprehensive evaluation of the adaptive management approaches advocated by Serrouya et al (2019). At minimum, explicitly acknowledging the exclusion of these populations seems important.
Additional adaptive management measures were neither included in analyses nor discussed
Snowmobile and heliskiing harassment are pervasive across the range of Deep-Snow Mountain caribou (ECCC 2018) and impose potential harm during winter and spring calving (Environment Canada 2014; COSEWIC 2014). To mitigate potential effects, the BC government imposed closures of various spatial extents and periods across the study area, a source of variation not evaluated or discussed by Serrouya et al (2019). Another management intervention neither evaluated nor discussed is the habitat protections included in the 2008 provincial recovery plan (Mountain Caribou Recovery Implementation Plan 2008), which may have ameliorated downward trajectories of some populations. These additional management measures constitute additional potentially confounding variables not addressed in the original study.
Habitat alteration analysis cannot be replicated
Serrouya et al. (2019) found that changes in lambda were not associated with estimates of habitat alteration, defined as net forest loss from Global Forest Change (GFC) data derived from Landsat imagery (Hansen et al. 2013). GFC estimates forest loss annually from 2001 to 2019 and cumulative forest gain from 2001 to 2012. Serrouya et al. interpreted the forest loss as “early seral forest” and used estimates across each subpopulation’s range as the habitat alteration covariate. Following the methods described and using publicly available caribou population ranges for BC and Alberta with the same GFC data, we were unable to replicate the authors’ habitat alteration results. This suggests that further steps were taken in the geospatial analysis that are not specified in their methods.
Even if had we been able to replicate their habitat alteration estimates, GFC data carry limitations that restrict their usefulness for inferring habitat alteration. First, forest loss data do not match the temporal range of the before-treatment period for nine of the 18 populations. While the GFC will capture some pre-2000 disturbance, existing forest change products specifically developed for Canada (e.g., Hermosilla et al. 2015; Guindon et al. 2018) provide cumulative forest disturbance beginning in the 1980’s and thus would have been more suitable for characterizing forest loss in the before-treatment period. Second, forest change detection using Earth observation satellite data relies on inter-annual spectral change (Hermosilla et al. 2015) and does not fully account for roads and infrastructure that pre-date the reference year. Habitat fragmentation resulting from such features, which can influence lambda (Wittmer et al. 2007; Van Oort et al. 2011), would require the integration of other geospatial data sources.
Finally, the spatial context of any forest loss is also important. Critical low and high elevation caribou habitat has in fact been mapped throughout the study area (Environment Canada 2014). Using the more broadly circumscribed subpopulation range, as Serrouya et al. did, likely further influenced estimates of forest loss by increasing the denominator (Jelinski and Wu 1996).