Introduction

The use of fire as a land management tool is widely recognized for its ecological benefits, and as a historic disturbance that has driven succession across many ecosystems (Agee 1996, Hardy and Arno 1996, Rothman 2005). While fire science and policy has advanced in the last 50 years to better allow for the use of fire in managing wildlands (van Wagtendonk 2007), increasingly stringent air quality regulations (US EPA 1990, Hardy et al. 2001, US EPA 2015,) and an increased awareness of the health impacts from smoke (Liu et al. 2015) can make the use of fire as a management tool difficult. In a recent United States survey, prescribed fire practitioners expressed that smoke and air quality issues are the third greatest impediment to prescribed burning, following low work capacity and unfavorable weather conditions (Melvin 2012). To continue using fire as a management tool, land managers must plan to meet management objectives, while also limiting the impact of smoke on public health and keeping smoke levels within regulatory thresholds (NWCG 2014). Such planning may often require the use of models to determine the quantity of emissions generated by fire; these models require many pieces of information, including expected fire size, fuel loading characteristics, and fuel consumption. Of these, fuel loading has been identified as the most critical step in obtaining accurate smoke predictions (Drury et al. 2014). Unfortunately, in many areas there may be little or no measured data on fuel loading; this creates a major difficulty in estimating fuel consumed and emissions produced.

To address the lack of fuel loading information in planning, geospatial Fire Effects Fuel Model (FEFM) layers developed by the Landscape Fire and Resource Management Planning Tools (LANDFIRE) program are often used. LANDFIRE data layers were developed for the contiguous United States, Alaska, and Hawaii to provide consistent geospatial data describing the vegetation type, structure, fuel loading, and disturbances, regardless of land ownership boundaries (Rollins 2009). LANDFIRE is principally intended to inform management and planning decisions made by land management agencies in the United States. It is also the only resource available that provides the geospatial information outlined above across as wide an area as the continental US. To populate models for smoke production, LANDFIRE FEFMs describe fuel loading for duff, litter, woody fuels from timelag size classes ranging from one hour (≤0.6 cm) to 1000 hours (≥7.62 cm), and live herb and shrub loading. Currently, there are two FEFM choices available through LANDFIRE: one represents fuel loading based on the Fuel Loading Model (FLM) categories developed by Lutes et al. (2009), and the other based on Fuels Characteristics Classification System (FCCS) categories developed by Ottmar et al. (2007). Both methods are derived from extensive measured datasets; however, FCCS is stratified to represent fuel loading by vegetation type (Ottmar et al. 2007), while FLM is stratified to represent fuel loadings by their potential fire effects (Lutes et al. 2009). The two LANDFIRE FEFMs are different not only in how they stratify fuels, but also in their reported fuel loadings.

There have been few studies that detail the differences between these two LANDFIRE FEFMs. One study evaluated their mapping performance across the western United States (Keane et al. 2013), and another compared their loadings and resulting emissions as part of a broader comparison of factors affecting smoke predictions in Washington, USA (Drury et al. 2014). When Keane et al. (2013) compared fuel loading and mapping accuracy of FCCS and FLM LANDFIRE layers throughout the western United States to data from the Forest Inventory and Analysis (FIA) program, they found poor correlations between FIA and LANDFIRE represented loadings, mainly due to the high variability in fuel loadings. Drury et al. (2014) compared FLM and FCCS FEFM data with other local datasets and found the landscape fuel loadings to range from 2.7 million Mg to 8.8 million Mg for their research area in Washington, USA, depending on which fuel loading dataset they used.

Studies such as these are extremely valuable for documenting the complexity and variation within fuel loading data, and identifying the importance and challenges of applying FEFM fuels data to model emissions. Our study builds on the few evaluations of LANDFIRE FEFMs to date by comparing FEFM surface fuel loading with measured fuel loadings, and using these loadings in two popular consumption and emissions models—the First Order Fire Effects Model (FOFEM) and Consume—to compare the resulting differences in fuel consumption and emissions production, while holding the site and environmental conditions constant. This provides insight into the degree of fuel loading differences possible at smaller scales relative to the national or sub-regional scales that LANDFIRE was developed to represent. Yet this 20 000 ha area is large enough to fall within the range of fire management units that land managers are tasked to manage (USDI NPS 2005, USDA FS 2008). We compared duff, litter, herb, shrub, and woody fuel loadings measured in forest inventory plots to those shown on both LANDFIRE Fuel Loading Models (LANDFIRE-FLM) and LANDFIRE Fuels Characterization Classification System (LANDFIRE-FCCS) maps. Subsequent differences in modeled consumption and emissions using FOFEM and Consume are reported.

Methods

Study Area

To evaluate potential differences in predicted fuel loadings and fire effects, we selected a 20 000 ha study area centered on Moscow Mountain in Latah County, Idaho, USA (Figure 1). The mountain lies in the Palouse Range of northern Idaho, with elevations ranging from 770 m to 1516 m. Moscow Mountain is dominated by mixed conifer forest tree species including ponderosa pine (Pinus ponderosa C. Lawson var. scopulorum Engelm.), Douglas-fir (Pseudotsuga menziesii [Mirb.] Franco var. glauca [Beissn.] Franco), grand fir (Abies grandis [Douglas ex D. Don] Lindl.), western red cedar (Thuja plicata Donn ex D. Don), western hemlock (Tsuga heterophylla [Raf.] Sarg.), and western larch (Larix occidentalis Nutt.). Ponderosa pine and Douglas-fir habitat types occur on the xeric southern and western aspects, grand fir and cedar-hemlock habitat types occur on the mesic northern and eastern aspects (Cooper et al. 1991). The majority of the land is owned by private timber companies, private non-commercial landowners, and public land holdings. Recent disturbances recorded between 2003 and 2009 were predominantly the result of forest management practices including thinning, timber harvesting, and prescribed burning (Hudak et al. 2012). These activities have resulted in a forest with varying stand ages and structures that occur over a variety of biophysical settings (Falkowski et al. 2009, Martinuzzi et al. 2009, Hudak et al. 2012).

Figure 1
figure 1

2009 orthoimagery of the Moscow Mountain, Idaho, USA, study area (outlined) from the United States Geological Survey. The white dot in the inset is the study area. Plot locations are indicated with black dots.

Plot Fuel Loadings

Plot data used in this study were collected in 2009, with information on plot placement and methodologies described in detail in Hudak et al. (2012). Following a stratified random sampling design of the study area, 0.04 ha fixed-radius field plots were placed randomly within strata based on elevation, slope, aspect, and percent forest cover. Plots that randomly fell within agricultural areas were subsequently excluded, leaving 87 forested plots for this analysis. Within each plot, duff; litter; coarse woody debris (CWD) in the ≥1000 hour (≥7.62 cm) size class; and fine woody debris in one hour (<0.635 cm), ten hour (0.635 cm to 2.54 cm), and 100 hour (2.54 cm to 7.62 cm) size classes were measured and loading was determined as described by Hudak et al. (2009), briefly summarized as follows: fuel loading was determined using two parallel 15 m Brown’s transects (Brown 1974) centered 2.5 m upslope and downslope from plot center. On each transect, one hour and ten hour fuels were tallied over a 1.8 m segment, 100 h fuels over a 4.6 m segment, and 1000 h fuels over the entire length of both transects. Shrub and herbaceous cover were estimated ocularly and translated to loadings using equations from Brown (1981) and Smith and Brand (1983). Duff and litter depths were measured once at a set distance along each transect (Brown 1981), and loading was derived from relationships presented in Brown et al. (1982) with bulk densities from Woodall and Monleon (2008).

LANDFIRE Fire Effects Fuel Model Loadings

LANDFIRE FEFM map layers are available for both FCCS and FLM fuel classification systems. The FCCS system is composed of fuel loading data organized by vegetation type; each vegetation type is represented by loadings derived from field data collected from that vegetation type (Ottmar et al. 2007). FLM fuel loadings are the result of several field-collected datasets, which are grouped into statistically distinct groups based on fuel loading and modeled fire effects (i.e., emissions and soil heating; Lutes et al. 2009). In-depth comparisons of these approaches have been addressed by Keane (2013).

For this study, we compared LANDFIRE Refresh 2008 FEFMs to measured fuel loadings. LANDFIRE-FCCS and LANDFIRE-FLM layers were generated using different methodologies. LANDFIRE-FCCS layers were derived by matching FCCS fuelbeds to LANDFIRE vegetation communities (Comer et al. 2003) and vegetation type (McKenzie et al. 2012, LANDFIRE Team 2014a). LANDFIRE-FLMs were derived by a series of database queries that matched LANDFIRE data to the appropriate FLMs (Hann et al. 2012). More specifically, Forest Inventory and Analysis (FIA) data (Woudenberg et al. 2010) were keyed to FLMs (Lutes et al. 2009) and these FLMs were systematically matched to LANDFIRE vegetation types and cover. We should note that the scope of our study focuses on the surface fuel loadings represented in LANDFIRE map layers, not the FCCS and FLM fuel classification systems that the layers are intended to represent.

Generating Emissions within FOFEM and Consume

Consumption and emissions were generated using two common fire effects models: Consume version 4.2 (FERA Team 2014) and the Fire Order Fire Effects Model (FOFEM) version 6.0 (Lutes 2012). Consume calculates consumption and emissions based on empirical algorithms from many studies (Prichard et al. 2005). The FOFEM model generates consumption based on equations from the BURN-UP model (Albini and Reinhardt 1997) and emission factors from Ward et al. (1993). Evaluating results in both models is important as FOFEM and Consume are both commonly used in fire management and are integrated into planning tools such as the Interagency Fuels Treatment Decision Support System (IFTDSS 2015). Consume is also integrated into the BlueSky Framework that is used for emissions calculations (AirFire 2015). For this study, we included the major compounds emitted by wildland fire that could be of concern for reasons of human health effects, regulatory impacts, or greenhouse gas emissions: carbon dioxide (CO2), carbon monoxide (CO), methane (CH4), and particulate matter 2.5 µm and 10 µm (PM25 and PM10). Nitrogen oxides (NOx) and sulfur dioxide (SO2) were also modeled using only FOFEM, and non-methane hydrocarbons (NMHC) were modeled using only Consume as these options are specific to each model. To parameterize these models we used the values in Table 1 to simulate summer fire conditions under which past fires in the region have ignited (McDonough 2003).

Table 1 Environmental parameters used to populate FOFEM and Consume under default ‘Low’ moisture conditions to simulate an early summer fire.

Statistical Comparison of Fuel Loadings

All analyses were conducted using R Statistical Software (R-Project 2013). We initially tested fuel loading differences using Bartlett’s test for equal variance (Bartlett 1937). This indicated that the data did not meet the assumption of homoscedasticity required for parametric regression analysis. Therefore, we used non-parametric statistical methods. Analysis of variance was chosen and performed using the Anova test from the “car” package (Fox et al. 2014) as this version implemented the test using heteroscedasticity-corrected coefficient covariance matrices. If a significant difference was detected, further analysis was conducted with the Dunnett-Tukey-Kramer pairwise multiple comparison test adjusted for unequal variances and unequal sample sizes (Dunnet 1980) using the DTK package (Lau 2013) at the alpha = 0.05 significance level. This method was used to compare fuel loadings, consumption, and emissions. To examine the influence of different fuels on the total emissions produced, we used Hoffman and Gardner’s Importance Index, a ratio of variances between total emissions generated and each individual fuel component (Hoffman and Gardner 1983, Hamby 1994). Values close to one indicate higher significance than values closer to zero.

Results

Fuel Loadings

In comparing LANDFIRE fuel loadings with measured fuel loadings, all fuel components differed at the alpha = 0.05 significance level with the exception of shrubs (Table 2, Figure 2). LANDFIRE-FCCS loadings over-represented duff and herbs; under-represented litter, 10 h, and 100 h fuels; and did not differ for 1 h fuels or CWD. LANDFIRE-FLM under-represented duff, litter, fine (1 h, 10 h, and 100 h), and CWD fuel loadings; over-represented herb loadings; but duff loading did not differ. Duff and CWD fuel components showed the most pronounced difference in loadings, with LANDFIRE-FCCS duff loadings 200% higher than measured loadings, and 300% higher than LANDFIRE-FLM loadings. LANDFIRE-FLM CWD loading was 9 times lower than measured or LANDFIRE-FCCS loadings. When comparing LANDFIRE FEFMs to each other, only duff, CWD, and 1 h fuel loadings differed, with LANDFIRE-FCCS having the greater loadings.

Figure 2
figure 2

Differences in fuel loading for measured plots, LANDFIRE-FLM, and LANDFIRE-FCCS products. Bold horizontal lines indicate median values, asterisks represent significant differences relative to measured loadings. Circles indicate outliers, and whiskers indicate the region between the first and third quartiles.

Table 2 Mean fuel loads (Mg ha−1 and SD in parentheses) on measured plots and as modeled by LANDFIRE-FCCS and LANDFIRE-FLM. Asterisks indicate statistically significant difference relative to measured loading data at the P < 0.05 significance level.

Modeled Consumption and Emissions in FOFEM

The statistical relationships for fuel consumption mirrored those for fuel loading (Figures 2 and 3, Tables 2 and 3). Relative to measured consumption, the mean total surface consumption from LANDFIRE-FCCS was 23% higher, and LANDFIRE-FLM was 51% lower. It is apparent that the high LANDFIRE-FCCS duff loading led to the higher overall consumption, and that the low CWD loading in the LANDFIRE-FLM contributed to less consumption. This in turn had a direct effect on the emissions modeled. All modeled emissions, with the exception of NOx, were significantly higher when modeled using LANDFIRE-FCCS loadings, and lower when using LANDFIRE-FLM loadings, while emissions derived from measured fuel loadings fell in between (Table 4, Figure 4).

Figure 3
figure 3

Differences in modeled consumption for measured, LANDFIRE-FLM, and LANDFIRE-FCCS fuel loadings. Bold horizontal lines indicate median values, asterisks represent significant differences relative to results derived from measured loadings.

Figure 4
figure 4

Differences in modeled emissions for measured, LANDFIRE-FLM, and LANDFIRE-FCCS fuel loadings. Bold horizontal lines indicate median values, asterisks represent significant differences relative to results derived from measured loadings.

Table 3 Mean fuel consumption (Mg ha−1 with SD in parentheses) under fixed environmental conditions or measured plots, and as modeled by LANDFIRE-FCCS and LANDFIRE-FLM, using FOFEM and Consume. Asterisks indicate statistically significant difference relative to estimates based on measured loading at the P < 0.05 significance level.
Table 4 Mean modeled emissions (Mg ha−1 with SD in parentheses) calculated using FOFEM and Consume for measured plots, LANDFIRE-FCCS, and LANDFIRE-FLM. Asterisks indicate statistically significant difference relative to estimates based on measured loading at the P < 0.05 significance level.

The relative importance of CWD and duff to total emissions was reaffirmed and quantified using the importance index (Table 5). Duff and CWD stood out as the primary contributors to total emissions in all cases, with the exception of LANDFIRE-FLM data, in which duff and shrub loadings were the primary contributors. Although shrub loadings did not statistically different in our study, shrub loadings tended to be higher in LANDFIRE-FLMs compared to other sources.

Table 5 Hoffman and Gardner Importance Index for each FEFM and each fuel type shows that the fuel of relative importance to the total emissions produced varied depending by FEFM. Emissions from measured data and FCCS fuelbeds were most influenced by CWD and duff, and FLM by duff and shrubs, respectively. Highest values are indicated in bold.

Modeled Consumption and Emissions in Consume

With the exception of duff, the relationships between fuel loading and modeled consumption when using Consume remained the same as with FOFEM; modeled duff consumption was much lower when using Consume (Table 3). Duff consumption using LANDFIRE-FCCS loadings did not significantly differ from consumption generated from measured loadings. Because of this, the overall modeled fuel consumption from LANDFIRE-FCCS did not significantly differ from the fuel consumption generated by measured loadings. However, the modeled consumption from LANDFIRE-FLM was significantly lower than consumption from measured loadings, with mean total surface fuel consumption 59% less than that derived from measured fuel loadings.

The importance index for the consumption and total emissions in Consume was similar to the FOFEM emissions importance index (Table 5). Duff consumption was still an important component with regard to emissions production, even though it did not statistically differ between measured and modeled fuel datasets when modeled with Consume. When emissions were evaluated, the LANDFIRE-FLM generated emissions were significantly lower than those generated using measured fuel loadings. Emissions generated using LANDFIRE-FCCS and measured fuel loadings did not differ from each other (Table 4).

Discussion

Measured Versus Modeled Fuel Loading

Duff and CWD led to the most significant differences in modeled consumption and emissions. LANDFIRE-FLMs contained higher shrub loadings, although this number did not result in a statistically significant difference, nor was it great enough to influence the total surface fuel loading when consumption and emissions were modeled. While the cause for these LANDFIRE-FLM shrub values to be so much higher is not known, the FLM system itself was developed with very little available shrub data (Lutes et al. 2009). This likely influenced which FLMs were available to assign to LANDFIRE maps when the LANDFIRE-FLM was created. Because the scope of this study focused on a mixed conifer ecosystem, our shrub data were somewhat limited and probably provided little insight in shrub-dominated ecosystems where shrubs are a large fuel component. Further investigation of these LANDFIRE layers in shrub-dominated systems and further fuel loading data from shrub ecosystems would be beneficial to further refining FLMs and the resulting LANDFIRE-FLM data for shrub ecosystems.

When comparing each fuel component for measured and LANDFIRE-represented loadings with those of other mixed conifer systems, all three of our fuel loading sets fell within the ranges observed by other researchers (Table 6). Focusing on duff and coarse woody debris, we found LANDFIRE-FCCS mean duff loading exceeded our measured values, but more closely resembled the ranges found in other mixed conifer forests. Thus, it is possible that our study area may have had less duff loading than other mixed conifer forests. When evaluating mean CWD loadings, we found the wide range noted in other studies, from 0.5 Mg ha−1 to 37 Mg ha−1; LANDFIRE-FLM mean CWD loadings were at the low end of this range averaging 0.53 Mg ha−1, while our measured data and LANDFIRE-FCCS were 10.6 Mg ha−1 and 8.6 Mg ha 1, respectively.

Table 6 Fuel loading for other mixed conifer forests in the western United States compared with mean fuel loading from this study (in Mg ha−1). Standard deviations, when present, are indicated in parentheses. Values from this study are indicated in bold in the last three rows.

Our results support a broader evaluation of the importance of various steps in the emissions modeling process in which Drury et al. (2014) compared LANDFIRE-represented loadings to a custom loading map based on measured data. Like our results, their duff loading was higher for LANDFIRE-FCCS relative to loadings represented using measured data, while in our study the LANDFIRE-FCCS total loadings were greater. Drury et al. found a wide range in possible fuel loadings depending upon the method chosen, as did we, and concluded that custom fuel loading layers derived from measured data produced the most reliable emissions estimates. Of the two LANDFIRE fuel layers, Drury et al. found the LANDFIRE-FCCS layer produced results closer to the custom loading layers. We found this to be true in our study when modeling emissions with Consume, but still found LANDFIRE-FCCS to produce higher emissions values when modeled using FOFEM.

In another study that compared classification, mapping accuracy, and fuel loadings of LANDFIRE-FCCS and LANDFIRE-FLM to Forest Inventory and Analysis (FIA) plot data across the western US, Keane et al. (2013) found poor performance in both LANDFIRE-represented FEFMs. LANDFIRE-FLM tended to under-predict loadings while LANDFIRE-FCCS tended toward over prediction. However, LANDFIRE-FLM loadings had lower root mean squared errors (Keane et al. 2013). Our findings here support the work of Keane et al. (2013) and Drury et al. (2014) in describing the tendency of LANDFIRE-FCCS to have higher loadings relative to LANDFIRE-FLMs.

Modeled Consumption and Emissions Using FOFEM

Relative differences in consumption values when modeled with FOFEM mirrored those of the loading values. High LANDFIRE-FCCS duff and low LANDFIRE-FLM CWD loading and consumption contributed to the total modeled emissions being highest when using LANDFIRE-FCCS inputs, and lowest when using LANDFIRE-FLM inputs. In examining the fuel loading data (Table 2), there is high variance in all fuel loading categories. This supports the work by Keane et al. (2013), who noted the high variance inherent in all categories of fuel loading, and the difficulties caused by spatial variation when trying to represent fuel loadings across large landscapes. Consumption followed the pattern of the total fuel loading values for the landscape, with LANDFIRE-FCCS being the highest, FLM being the lowest, and measured values in the middle. This in turn produced higher emissions from LANDFIRE-FCCS and lower emissions from LANDFIRE-FLM, highlighting the differences in emissions outcomes depending upon the choices made to represent fuel loadings.

Modeled Consumption and Emissions Using Consume

In comparing consumption and emissions from Consume, the choice of model has an effect on emissions generated. In this study, there were similar trends in modeled consumption with both fire effects models, but the lower duff consumption in Consume, relative to FOFEM, led to emissions outputs in which LANDFIRE-FCCS derived emissions did not differ from those derived from measured loadings. This difference in duff consumption is due to the fact that Consume and FOFEM calculate the consumption of duff using different equations, derived from different data sets (Reinhardt 2003, Prichard et al. 2005).

Research Implications

In modeling emissions, fuel loadings have been identified as the most crucial variables (Drury et al. 2014), yet they represent one of the greatest uncertainties in modeling emissions (French et al. 2011). In a detailed discussion on the topic, Keane et al. (2013) identified several factors creating difficulties in quantifying fuel loadings. These include lack of data to develop thorough loading maps; the use of classification systems that were developed from discrete plot locations but then applied to large, national-scale areas; and the inherent difficulty of classifying fuels into categories such as hourly size classes and duff, when each of these size classes may have different degrees of variation at different spatial scales (Keane et al. 2012, 2013). If existing fuel loading classification maps are to be improved, more data are necessary. The results of our study indicate that data on CWD and duff should be priorities, due to the relative importance of these fuels to overall emissions in mixed conifer forests (Table 5). While consumption didn’t statistically differ for the specific case of shrubs, shrub loading accounted for a great deal of variability in emissions from LANDFIRE-FLMs (Table 5), a classification that was developed with little available shrub data (Lutes et al. 2009). For the case of LANDFIRE-FLMs, having additional data on shrub loadings would be beneficial.

Despite being represented at a 30 m resolution, LANDFIRE data layers are intended to be used at larger, sub-regional to national scales (LANDFIRE Team 2014b). Data from fuel loading maps may work for finer scales; however, there will likely be greater need to supplement that data with local knowledge. Based on our findings in a 20 000 ha area, using measured data, especially for duff and CWD loadings, is preferable relative to unaltered LANDFIRE layers. However, we understand that measured data are often unavailable, may be incomplete, or limited in availability.

Management Implications

If monitoring resources are available, emission estimates will be improved by having more information on duff loading, as differences in duff loading lead to the greatest differences in emissions, followed by CWD. For coarse woody debris, the planar intercept sampling methods have been most commonly used in forests such as in this study, although the Photoload (Keane and Dickinson 2007) method has also performed well (Sikkink and Keane 2008). Duff sampling is often performed via sampling points along a planar intercept to gather both loading and depth (Brown 1974). The fuel photoseries guides available for many ecosystems provide estimates of duff loading (Ottmar et al. 2003), but there are few studies comparing their performance relative to the traditional method. If measured data are not available, one could model with both the LANDFIRE-FLM and LANDFIRE-FCCS derived fuel loadings, and then average the two sets of results.

The use of systems such as the Wildland Fire Decision Support System (WFDSS) and the Interagency Fuels Treatment Decision Support System (IFTDSS) also hold potential for obtaining measured fuel loading information (IFTDSS 2015, WFDSS 2015). These systems provide online access to several models to represent fire behavior and effects (including emissions), but they also provide an easy platform from which data can be shared from user to user. In the future, it would be ideal to see a searchable database of user-provided fuel loadings within these decision support systems, similar to the searchable data available through the Fire Research and Management Exchange System (FRAMES) Resource Catalog (FRAMES 2015).

This study has characterized the potential differences in LANDFIRE-represented fuel loadings in a mixed conifer case study area, and their impact on the emissions modeling. While using measured data provides the most reliable outcome, either by itself or to help supplement the LANDFIRE data, this is not always possible. Web-based systems can aid in finding and sharing data; however, a search for the keywords “duff” and “coarse woody debris” in FRAMES returned 34 and 3 results, respectively. While online systems can be powerful sources of information, there is clearly a need for additional data with which tools such as the LANDFIRE map layers could be strengthened. In the interim, information on the relative differences in fuel loadings from LANDFIRE-represented data may be useful to managers who are tasked with quantifying emissions for fire management planning. Using all of these resources will aid in generating more accurate emissions estimates in a climate where regulatory pressure and the need to accurately represent potential emissions from fire are increasing.