Introduction

Tree regeneration layer composition is driven by numerous interrelated and covarying biotic and abiotic variables (Grubb 1977; Arii and Lechowicz 2002; McEwan et al. 2011). These variables can be grouped into logical driver sets, such as climate, overstory composition, understory environment, and understory biota, which due to their interrelationships have varying degrees of overlapping influence on tree regeneration.

For example, climate directly impacts germination, growth, and survival and indirectly affects tree regeneration through its relationships with the other explanatory variables (Barnes et al. 1998). The composition of the overstory, which is itself partially the result of responses to climate, directly influences propagule availability and strongly affects understory processes and properties including nutrient availability, seedbed conditions, and amount and timing of shading (Frelich et al. 1993; Finzi et al. 1998). The understory environment, including seedbed type, soil texture and pH, and light availability, drives not only tree regeneration but also the composition of competing vegetation layers (Canham et al. 1996; Walters and Reich 1996), while the range of environmental conditions, such as soil texture, over which a forest type occurs, is itself partially determined by climate (Henne et al. 2007). Understory biota, including competing vegetation layers and selective herbivores, act as filters that determine which tree species are able to successfully compete and survive in the regeneration layer (Côté et al. 2004; Royo and Carson 2006) and are themselves simultaneously responding to the same conditions as the regeneration layer.

Each driver set can thus be characterized as having both unique influences on tree regeneration that cannot be attributed to other factors and shared explanatory power due to confounded relationships. Too much emphasis can be placed on single factors when in reality other covarying factors may at least be partially driving trends (Legendre and Legendre 1998). Factors influencing regeneration, due to their filtering effects at early stages of development, can have long-term impacts on forest composition and understanding the unique and shared explanatory power of these variables is critical to estimating compositional shifts within forest types forecast to be sensitive to climate change (Prentice et al. 1991; Frelich and Reich 2010).

The upper Great Lakes region in North America contains a broad forest transition zone where temperate and boreal tree species reach their northern and southern limits, respectively (Pastor and Mladenoff 1992; Goldblum and Rigg 2010). Because mixed temperate–boreal forests within this zone include species at or near their temperature and moisture driven range limits, small changes in climate are forecast to have major effects on composition, with tree species shifting their range limits north and east (Iverson and Prasad 1998; Scheller and Mladenoff 2005; Frelich and Reich 2010). Recent field studies have confirmed this climate sensitivity and indicate that temperate species are expanding across local ecotonal boundaries into boreal forest (Fisichelli 2012) and that temperate and boreal saplings exhibit rank reversals in growth rates across their overlapping range limits (Fisichelli et al. 2012). However, due to the complex role of climate within ecosystems, determining the total and relative influences of climate on tree regeneration across the region has been difficult to ascertain. Furthermore, much research on forest dynamics and underlying drivers has focused on ‘pure’ or ‘homogeneous’ temperate or boreal stands (Forcier 1975; Frelich and Reich 1995; Kneeshaw and Bergeron 1996), while fewer studies have specifically targeted mixed stands (Buell and Martin 1961; Diochon et al. 2003; Kneeshaw and Prevost 2007). Quantifying the interrelated roles of explanatory variables across mixed stands is needed in order to better understand which factors are determining composition, especially in light of global change concerns (Millar et al. 2007; Frelich and Reich 2009).

The objective of this study was to examine and quantify the explanatory relationships among tree regeneration variables within mixed temperate–boreal forests across the landscape. By simultaneously studying four driver sets: climate, understory environment, overstory composition, and understory biota, we can quantify the unique, shared, and total variation in understory composition explained by each set. We specifically sampled sites across the northern, southern, and western limits of mixed stands in the Great Lakes region of North America to test the hypothesis that tree regeneration composition is sensitive to temperature and precipitation, to assess the degree of overlap in explanatory power among driver sets, to examine the individual variables that are covarying, and finally to quantify the spatial scales at which we were able to explain tree regeneration compositional variation in mixed temperate–boreal stands.

Methods

Study sites and field sampling

Mixed temperate–boreal forest stands were sampled at 124 sites over a three year period (2008–2010) across a 170,000 km2 area in northern Minnesota, WI, and the Upper Peninsula of Michigan, USA (Fig. 1a). The dominant natural disturbance in these dry-mesic to wet-mesic forests is wind, with heavy blowdown events occurring every 300+ years, while intense fires are less frequent with a return interval of 1,000+ years (MN DNR 2003; Schulte and Mladenoff 2005). Selection criteria for study sites included mature, upland forest with an overstory composition of both temperate and boreal tree species. Stands across this region are typically of second-growth origin, having been harvested 70–100 years ago, and are at the understory reinitiation stage (Oliver 1980).

Fig. 1
figure 1

Locations of study sites, upper Great Lakes region USA, and spatial patterns of selected understory regeneration drivers. a Study sites. Climate variables include b mean annual precipitation, c mean summer precipitation (JJA), d mean annual temperature, e mean summer temperature (JJA), and f mean January minimum temperature. Understory environment variables are g soil pH and h soil sand fraction. Overstory variables include the basal area of i Acer saccharum and j Populus tremuloides. Understory biota include the percent cover of k graminoids and l forbs

Study plots were 314 m2 and each site had an average of 3–4 plots, depending on stand size (456 total plots). Tree stems were sampled by size class within nested plots. Overstory trees, ≥10 cm dbh (diameter at breast height, measured at 1.3 m above the ground surface), were measured within a 10 m radius plot. This plot size was found to capture the local overstory neighborhood area of influence in a similar forest type (Frelich et al. 1993). Understory stems were tallied in two size classes, <2 m height and <10 cm dbh within a 5 m radius subplot centered inside the overstory plot.

Understory tree regeneration variables were a priori divided into four explanatory data sets, climate, understory environment, overstory composition, and understory biota, based on previous knowledge regarding similarities in the scale and role of individual variables (Table S1). As weather stations are not available near most study sites, climate data were extracted from PRISM interpolated climate surfaces (Daly et al. 2008). Five climate variables (1978–2007 averages) considered a priori as likely biologically influential were included as potential explanatory variables: mean annual precipitation, mean summer precipitation (June–August), mean annual temperature, mean summer temperature (June–August), and mean minimum January temperature. Because the climate data are available as monthly means, other potential climate variables were highly correlated with this set (e.g., growing degree days and summer temperature, r = 0.95). In general, the climate grades from dry and continental to wet and temperate from west to east across the region, however these patterns vary by season (Fig. 1b–f).

The understory environment set of eight variables described conditions in the understory and included seedbed characteristics, soil texture and pH, and available light (Table S1). Earthworm disturbance severity was included in the understory environment set because nonnative earthworms strongly affect the seedbed environment, specifically the presence and depth of the organic and upper mineral soil horizons (Frelich et al. 2006; Eisenhauer et al. 2007), and thus provide an integrated measure of environmental conditions at the forest floor. The severity of earthworm disturbance was measured for each plot using a 4 point scale based on the presence and characteristics of the litter and organic layers, exposure of mineral soil, formation of a thick soil A horizon, density of earthworm middens, and presence of worms found during soil collection. Soil pH and sand and clay particle fractions were determined from samples of the upper 20 cm of mineral soil. Regional variation in soil pH and percent sand are shown in Fig. 1g, h. Leaf litter thickness and the percent cover of leaf litter and moss were measured in each understory subplot. Canopy openness at 1 m above ground level was determined at plot center using a spherical concave densiometer.

Overstory composition was calculated based on species basal area. The potential pool of overstory tree species included the most abundant species, here defined as present at more than 50 % of sites. This resulted in six species from three functional groups: boreal broadleaf Betula papyrifera Marsh. and Populus tremuloides Michx., boreal conifer Abies balsamea (L.) Mill. and Picea glauca (Moench) Voss, and temperate broadleaf Acer rubrum L. and Acer saccharum Marsh. (Table S1). Each of these overstory species was present at more than 70 % of sites and the set accounted for, on average, 80 % of site basal area. The spatial patterns of A. saccharum and P. tremuloides basal area are depicted in Fig. 1i, j.

The understory biota set included six herbaceous and woody functional vegetation groups and browse pressure, which reflect competitive and trophic interactions (Table S1). Graminoid (grasses and sedges) (Fig. 1k), forb (broadleaved herbaceous species) (Fig. 1l), fern, and low shrub (e.g., Vaccinium spp. L., Diervilla lonicera Mill., and Rubus spp. L.) percent cover were estimated within each understory subplot. Tall shrub (e.g., Corylus cornuta Marsh. and Acer spicatum Lam.) stem density was measured in two size classes, <1 m and ≥1 m in height, within each understory subplot. Site browse pressure, primarily from white-tailed deer (Odocoileus virginianus), was assessed on a four point scale as the proportion of branches with browse damage on individual maple (Acer spp.) stems within the browse layer (0.25–2.0 m in height).

Statistical analyses

To explore relationships among explanatory variables and the response matrix, we used a multivariate method of variation partitioning with partial and simple redundancy analysis (RDA) (Borcard et al. 1992; Økland and Eilertsen 1994). RDA is a constrained multivariate ordination technique that is essentially the multivariate extension of multiple regression (Legendre and Legendre 1998). Plot data were averaged to the site level in order to assess trends across the region and to protect against pseudoreplication. The response variables, tree species understory stem densities were standardized using the Hellinger transformation to optimize model performance (Legendre and Gallagher 2001). Six boreal and 13 temperate species were present in >10 % of sites in the understory and were included as the response variables (Table S2).

Variation partitioning determines the unique, shared, and total explained variation contributed by each set of explanatory variables. The unique explained variation is that portion explained by a variable or a set of variables after controlling for all other measured variables. The shared variation is the confounded portion or explained variation that is common to more than one set of variables. The total variation explained by a set of variables is the sum of its unique and shared portions. Partitioning and the calculation of adjusted R 2 values are accomplished by running multiple RDAs with differing sets of explanatory variables (Borcard et al. 1992; Peres-Neto et al. 2006).

The four explanatory data sets each initially contained five to eight variables. In order to identify the individual variables within each set that were significantly associated with regeneration, we ran a stepwise selection process using two stopping criteria, model adjusted R 2 and variable retention at a permutation P value of 0.05 (Blanchet et al. 2008). Additionally all retained variables within each set had to have a variance inflation factor (VIF) of <5. Explanatory relationships among individual variables from all sets were explored through a correlation biplot of the full RDA model used in variation partitioning.

Since we were interested in shifts in tree regeneration composition across the region, we assessed the spatial patterns within the data and how well we captured these spatial trends. We used the principal coordinates of neighbor matrices (PCNM) method to model spatial structure in tree regeneration trends detectable in the study design (Borcard and Legendre 2002). Through principal coordinate analysis of the geographic distance matrix among sites, 76 positive eigenfunctions were created. Stepwise selection, again using model adjusted R 2 and variable retention at a permutation P value of 0.05, was run to determine the significant eigenvectors that captured the spatial pattern of tree regeneration composition. We then ran a variation partitioning model using two variable sets, the combined sets of regeneration explanatory variables and the set of PCNM eigenfunctions, to examine the ability of explanatory variables to explain both spatially and non-spatially structured variation in tree regeneration. The significance of all RDA models, RDA axes, and variation partitioning components were tested via permutation procedures (P value = 0.05). PCNM, variation partitioning, RDA models, and stepwise selection were run using the ‘vegan’ package (v. 1.17-6) (Oksanen et al. 2011) in R (v. 2.12) (R Development Core Team 2008).

Results

Explanatory variables

Initial stepwise selection procedures within each of the four driver sets chose a total of 19 variables associated with understory tree regeneration patterns (Table 1). Within the climate set, the final selected variables were mean summer temperature and mean annual precipitation. Additionally, six of eight environmental variables, five of six overstory species, and six of seven understory biota variables were selected. Explanatory power (adjusted R 2) of each individual variable based on RDA analyses is also shown in Table 1. Acer saccharum basal area, soil pH, summer temperature, Populus tremuloides basal area, and annual precipitation were the five strongest individual explanatory variables.

Table 1 Explanatory variables selected during stepwise selection procedures for variation partitioning models

Variation partitioning

The results of variation partitioning indicate that all explanatory variable sets had both significant explanatory roles and strong interrelationships (Fig. 2, see also Fig. S1 for complete partitioning among all driver sets). The overall model including all four driver sets had an adj. R 2 of 0.42 and each set of variables had significant total and unique explanatory contributions (all P values <0.005). Climate, environment, and biota each individually explained about 10–14 % of regeneration variation, while overstory composition explained 26 %. The unique portions, which represent explained variation that can only be attributed to individual explanatory variable sets, accounted for 22–61 % of each set’s explanatory power, with understory biota and overstory composition having the smallest and largest unique proportions, respectively. Conversely and as expected, there was a large amount of shared explanatory power, 39–78 % of the explained variation attributed to each set.

Fig. 2
figure 2

Unique, shared, and total variation of the tree regeneration layer explained by a climate, b understory environment, c overstory composition, and d understory biota. Values were determined through variation partitioning among all driver sets. The full variation partitioning model with all 4 driver sets explained 42 % of variation in the regeneration layer (based on adj. R 2). Shaded areas within and among circles are proportional to variation explained. See text for specific variables within each driver set. *P < 0.005, cannot be tested

The extent of shared explanatory relationships among all pairs of driver sets is shown in Fig. 3. Climate shared 21–45 % of its explanatory power with each of the other sets. The understory environment and understory biota sets had similar levels of shared explained variation as climate (ranging from 27 to 40 % for the former and from 31 to 49 % for the latter). Overstory composition, which explained the greatest variation, showed the lowest rates of confounding, 8–25 %. Overall, these levels of confounding indicate complex relationships among all sets of explanatory variables.

Fig. 3
figure 3

Variation partitioning results for all pairs of drivers. Venn diagrams show explanatory relationships among all pairs of tree regeneration driver sets (a–f). Variation explained (%) is based on adj. R 2. All unique portions (non-overlapping outer section of each circle) explained a significant portion of regeneration layer variation (P < 0.005). The overlapping middle sections represent the ‘shared’ portion or variation explained by both drivers. Climate is represented by solid black circles, understory environment by dark gray, overstory by light gray, and understory biota by dashed black circles. The size of each circle section is proportional to the variation accounted for by that element. See text for specific variables within each driver set

Explanatory relationships among individual variables are depicted in a correlation biplot of the RDA model (Fig. 4). The biplot reveals the suites of associated variables that are driving tree regeneration trends within the first two RDA axes. Axes 1 and 2 explained 19.7 and 10.9 % of total variation, respectively, and together accounted for 73 % (30.6/42) of the explained variation. Axis 1 mainly represented variation in overstory composition and related variables. Overstory composition shifted from dominance by Populus tremuloides, Betula papyrifera, and Abies balsamea at the negative end of the axis to Acer saccharum at the positive end. Overstory P. tremuloides, B. papyrifera, and A. balsamea were positively associated with understory light levels, low shrub cover, tall shrub density, moss cover, and forb cover. Conversely, A. saccharum overstory basal area was negatively related to these variables and positively correlated with leaf litter cover and annual precipitation.

Fig. 4
figure 4

Redundancy analysis (RDA) correlation biplot for the 19 significant explanatory variables in four driver sets (climate, understory environment, overstory composition, and understory biota) identified during variation partitioning. The response data are the Hellinger transformed stem densities of tree species in the regeneration layer. Explanatory variables are shown as vectors and sites as points. See Table 1 for explanations of acronyms

Axis 2 mainly reflected nutrient and climate gradients, with soil pH and summer temperature positively associated and annual precipitation and soil percent sand negatively associated with the axis. Also, Acer rubrum basal area was associated with cool, wet, acidic, and sandy conditions along the negative end of axis 2. Additional variables with positive loadings on axis 2 were graminoids, browse pressure, and earthworm invasion severity..

Accounting for spatial patterns

As expected, the PCNM analysis found significant spatial structure in regeneration layer composition. Stepwise selection identified 15 significant PCNM eigenvectors (1–7, 9, 10, 12–14, 24, 54, 60) (adj. R 2 = 0.24) that mainly represented broad-scale variation across the region. The sets of explanatory variables and the PCNM eigenvectors together explained 44.5 % of the variation in the tree regeneration layer (Fig. 5). The explanatory variable sets explained the majority, 86.1 % (21.0/24.4), of the total spatially structured tree regeneration variation. Roughly half (21.0/41.1) of the explained variation in regeneration composition was spatially structured and the large majority of variation unexplained by the explanatory variable sets, 94 % (55.5/58.9) did not have a detectable spatial pattern.

Fig. 5
figure 5

Venn diagram depicting the partitioning of variation in the tree regeneration layer among explanatory variables (climate, understory environment, overstory composition, and understory biota) (left circle) and spatial variables (right circle). The explanatory drivers include 13 variables and the spatial set includes 15 principal coordinates of neighbor matrices (PCNM) eigenfunctions selected during stepwise selection procedures. Explained variation percentages are based on adj. R 2 values

Discussion

Although it is difficult to cleanly assign causative effects from an observational study, our field-based research clearly shows the multitude of factors that must be taken into account when attempting to understand and model vegetation–environment dynamics near range boundaries. The tree regeneration layer reflects a complex suite of associated variables, including climate, understory environment, overstory composition, and understory biota. Even though there were numerous interrelationships among sets of explanatory variables, each was significantly associated with a unique portion of regeneration compositional variation, underscoring the large number of factors influencing the performance of tree species in the regeneration layer. An initial goal of this study was to test whether the tree regeneration layer was responding to climate and our results reveal that even given the strengths of other explanatory variables, tree regeneration in mixed temperate–boreal stands is sensitive to temperature and precipitation gradients. The overall influence of climate may have been underestimated as only means were included in analyses. Other climatic shifts such as changes in extreme events (heat, drought, and late-spring frosts), may increase the explanatory role of climate across the region. In any case, other variable sets, such as overstory composition, had greater explanatory roles than climate and indicate that the rate and direction of climate-mediated changes in forest composition will depend on the strengths of these factors (Clark et al. 2011). Furthermore, the relative importance of these other variables is likely to vary in the future due to direct and indirect relationships with a rapidly changing climate.

Spatially patterned and unexplained variation

Overall our model successfully accounted for most of the spatially patterned variation in regeneration across the landscape and the majority of unexplained variation was not spatially structured. The unexplained spatial patterning (3 %) may be associated with an unmeasured but spatially structured explanatory variable or indicate nonlinear relationships that were not accounted for by monomial predictors. Nearest neighbor distance among study sites was 10 km and the minimum distance was 1 km, thus spatial patterning in regeneration is likely induced by spatially structured explanatory variables and not due to spatial autocorrelation (Legendre and Legendre 1998). The large majority of unexplained variation (55.5 %) did not have a spatial structure and was likely due to unmeasured locally varying factors and stochastic events. Unknown but potentially important local factors include disturbance (Turner et al. 2001) and land-use history (Foster et al. 2003), which can both have long-lasting effects on community composition. Since only one-quarter of the variation in tree regeneration had a detectable spatial structure (right-hand ‘Space’ circle in Fig. 5), local variables and events likely dominate tree regeneration trends across the study region. Additionally, this study was based on a single sampling period and thus variability in seed production, germination, recruitment, and mortality may have also contributed to unexplained variation (Beckage et al. 2005).

Overstory, environmental, and biotic variables and interrelationships with climate

Although much current research emphasis is placed on climate, our research shows that the relative strengths of other interrelated variables must be taken into account when attempting to project climate-mediated changes in forest composition. Three variables in particular, current overstory composition, soil pH, and understory biota, appear most likely to interact with a changing climate and influence future forest composition.

The central role of the current overstory has strong implications on the rate of forest change. The high unique explanatory power of overstory composition was likely mainly due to direct influence on propagule availability. The ability of current advance regeneration to fill future gaps in the canopy will depend on the type and severity of future disturbances, which in the case of natural agents are themselves partly driven by climate. If the understory is left intact, for example after a wind storm that topples a few canopy trees, then advance regeneration is likely to fill these gaps and thus the current overstory will have great influence on future forest composition. This dynamic has two main implications. First, at the local scale temperate species already present in the overstory may be able to make substantial expansions through gap dynamics. Secondly and at a larger spatial scale, compositional shifts in the direction predicted by climate change may be slowed by the legacy effect of the current overstory. In boreal dominated areas, more severe disturbances such as intense fires which remove large portions of both the understory and overstory may be required to facilitate the rapid establishment of new species not present in the previous overstory neighborhood and that may be better adapted to the changed climate.

Given the current overstory composition and thus propagule availability, soil pH and related factors are likely to play a major role in determining which tree species (and where) are actually able to respond to a changing climate. For example, nutrient demanding temperate species will likely perform better under warmer temperatures at less acidic sites. It is important to note here that this response will be constrained by the covarying relationship between soil pH and annual precipitation. Precipitation increases and soil pH decreases from west to east across the region (Fig. 1b, g), thus species otherwise inhibited by strongly acidic conditions may be best able to respond to future warming at the western end of the temperate–boreal transition zone, assuming adequate precipitation levels.

While soil pH was a strong understory environment explanatory variable, soil sand fraction showed low explanatory power and clay was surprisingly not a significant factor. Sand was negatively related to annual precipitation, i.e., temperate–boreal forests were more confined to finer textured soils at drier sites—itself an interesting finding—but were found on a wider variety of textures at wetter sites, analogous to the results of Henne et al. (2007). Relatively wet conditions over the past three decades (Karl et al. 2009) may have limited the significance of soil texture as a regeneration driver. If the future climate becomes more droughty, mesic mixed stands currently on coarse textured soils may shift composition more dramatically towards drought tolerant species than stands on finer textured soils with higher moisture holding capacity.

Understory biota are likely to play a dynamic role in influencing tree regeneration patterns under a global change scenario. The strengths of relationships between tree regeneration and understory biota will vary depending on how understory biota respond to a changing climate. For example, both forb cover and shrub abundance showed a negative relationship with precipitation while graminoid cover increased with temperature across the region. Thus tree species attempting to track climate change and shift their ranges will have to compete with these also climate-sensitive vegetation groups (Royo and Carson 2006). The strong relationship between climate and understory biota also implies that overall understory community composition may be shifting with climate. Because species richness in these forests is greatest in the understory, these shifts will affect overall biodiversity and ecosystem functioning (Gilliam 2007).

Conclusion

The tree regeneration layer in mixed stands responds to multiple interrelated variables. Continued shifts in climate and especially warming and drying during the summer months are likely to accelerate changes in tree regeneration composition, although this will largely depend on propagule availability, soil nutrient status, and interactions with other understory biota. Moreover, since these other variables also have interrelationships with climate, the direction and rate of forest change may hinge on how the importance of these factors shifts with climate and, for the biotic variables, on the rate and magnitude of their own responses to climate change.