Plant species that negatively affect their environment by encroachment require constant management and monitoring through field surveys. Drones have been suggested to support field surveyors allowing more accurate mapping with just-in-time aerial imagery. Furthermore, object-based image analysis tools could increase the accuracy of species maps. However, only few studies compare species distribution maps resulting from traditional field surveys and object-based image analysis using drone imagery. We acquired drone imagery for a saltmarsh area (18 ha) on the Hallig Nordstrandischmoor (Germany) with patches of Elymus athericus, a tall grass which encroaches higher parts of saltmarshes. A field survey was conducted afterwards using the drone orthoimagery as a baseline. We used object-based image analysis (OBIA) to segment CIR imagery into polygons which were classified into eight land cover classes. Finally, we compared polygons of the field-based and OBIA-based maps visually and for location, area, and overlap before and after post-processing. OBIA-based classification yielded good results (kappa = 0.937) and agreed in general with the field-based maps (field = 6.29 ha, drone = 6.22 ha with E. athericus dominance). Post-processing revealed 0.31 ha of misclassified polygons, which were often related to water runnels or shadows, leaving 5.91 ha of E. athericus cover. Overlap of both polygon maps was only 70% resulting from many small patches identified where E. athericus was absent. In sum, drones can greatly support field surveys in monitoring of plant species by allowing for accurate species maps and just-in-time captured very-high-resolution imagery.
Drones, or UAS (unmanned aerial systems), are becoming a valuable tool for mapping problematic or endangered plant species (Alvarez-Taboada et al. 2017; Rominger and Meyer 2019). UAS are cost friendly and allow flexible application in space and time, and very-high-resolution (VHR) image data can be acquired within 1 h by a single person, e.g., before or during a field survey. Precise capture of relatively large areas, e.g., up to 400 ha, can be done in one single flight (Samiappan et al. 2017a). Besides regular RGB cameras, multispectral cameras can be mounted, which are now affordable, and allow additional information on vegetation vigor (Oldeland et al. 2017). Constraints like strong winds, rainfall, or snow pose a problem for UAS missions, but this is also true for airplane campaigns. Further limitations are often high geometric errors and high data volumes as the low flying UAS can provide VHR imagery with ground sampling distances of a few centimeters. Still, just-in-time VHR image data can support conservation and natural resource management, e.g., by mapping plant individuals at the scale of a field survey.
The very high spatial resolution and the advantages in terms of flexibility make UAS highly suitable for mapping plant species on a local spatial scale. In particular, invasive plants or plants that tend to encroach within wetlands have been in focus of several recent UAS-based studies. Wan et al. (2014) compared UAS images from 2009 to 2011 to map the encroachment of the C4 grass Spartina alterniflora in the Beihai wetland in China. They measured an increase of almost 20% within these 2 years on a scale of 300 ha. Phragmites australis is another well-known example for a strongly expanding tall grass species. Others compared different image texture measures (Samiappan et al. 2017a) and multispectral indices (Samiappan et al. 2017b) to map Phragmites australis patches in different wetlands of Louisiana, USA. A combination of texture and vegetation indices worked best to capture the extent of Phragmites invasion. Hill et al. (2017) demonstrated the utility of UAS for mapping Iris pseudacorus at two different lakes in British Columbia, Canada. They compared three different approaches to map the species, i.e., field survey, manual image interpretation, and pixel-based classification. The manual image interpretation yielded the highest accuracies. These studies confirm the applicability of UAS to map plant species in different wetlands using image analysis or manual image interpretation.
Elymus athericus (Sea Couch Grass) is a native grass species that occurs in saltmarshes in central Europe. It is a typical species of the high saltmarsh. Its establishment is facilitated by natural sedimentation processes (Nolte et al. 2019). It was observed that E. athericus is able to partially invade the low marsh overgrowing smaller species (Bakker et al. 2009). When grazing is abandoned or reduced, the species becomes dominant (Nolte et al. 2019, Bakker et al. 2020) and then negatively affects species diversity of plants (Wanner et al. 2014) or halophilic spiders (Pétillon et al. 2005) and reduces the habitat suitability for certain breeding birds (Mandema et al. 2015). Nevertheless, long-term abandoned saltmarshes with high dominance of E. athericus make an important contribution to diversity if all trophic levels are considered (Rickert et al. 2012, Van Klink et al. 2016) and provide more fish feeding opportunities in winter (Friese et al. 2018). Thus, this type of saltmarsh forms an integral part of saltmarsh conservation (Van Klink et al. 2016). Furthermore, E. athericus can trap carbon and positively affects C sequestration, thus supporting the climate change mitigation function of saltmarshes (Valéry et al. 2004). Besides these ecological implications, encroachment of E. athericus can have negative economic impacts as it reduces the yield of meadows and sheep or cattle do not eat the fully grown plants. Consequently, the encroached area is lost for livestock farming. Hence, monitoring of E. athericus expansion in response to different land uses is an important contribution for decision-making concerning environmental management.
On the Halligen, a type of seasonally inundated islands, in the North Frisian Wadden Sea, Germany, farmers receive funding for appropriate management practices through a conservation covenant scheme called “Hallig Programm.” A scientific monitoring program evaluates the effects of the management on vegetation development in general and in particular on the stands of E. athericus. On Hallig Nordstrandischmoor, surveys are carried out in intervals of 2 years (Revermann and Luther-Mosebach, 2019). During a field survey, the distribution and cover of E. athericus is recorded in the field, sketched on aerial photographs, and then later digitized as polygons to support nature conservation offices. The accuracy of the maps depends on aerial imagery which is often not from the same year as the survey but often several years older. Without recent aerial imagery, current E. athericus patches are difficult to accurately delineate in the field. UAS imagery acquired shortly before or during a field survey could help in precise mapping of these tall grass patches. However, no study evaluated the performance of UAS-based image classification for the case of E. athericus in saltmarshes in central Europe. In particular, object-based image analysis (OBIA), which, similar to a field surveyor, delivers polygon patches as an output, are highly suitable to analyze VHR imagery (Kucharczyk et al. 2020). However, a comparison of field survey–based maps and OBIA-based maps derived from VHR-UAS-imagery has not been evaluated for the case of E. athericus. Hence, it is not clear whether conducting UAS missions can improve current approaches for managing E. athericus in saltmarsh pastures or whether it only adds to the costs and complexity.
The aim of this study is to verify the applicability of UAS images for mapping the distribution of E. athericus in saltmarshes of the Wadden Sea National Park and adjecent areas, Germany. We apply object-based image analysis and provide a workflow to optimize settings of the image segmentation algorithm and simultaneously compare three different classification algorithms: random forest, elastic net, and artificial neural networks. Finally, we compare the maps resulting from traditional field survey work with OBIA-based maps and discuss the advantages and disadvantages of UAS for supporting vegetation surveys.
This study took place on the western tip of the Hallig Nordstrandischmoor in the Wadden Sea National Park (Fig. 1a). Hallig is a type of seasonally inundated island at the North Sea coast of Germany. It is typically made of fine-textured marsh sediments from the North Sea and is a remnants of a former coherent marshland. The area is dissected by tidal channels and is surrounded by a low dyke to prevent frequent flooding in summer (Fig. 1b). Vegetation belongs to the phytosociological order Glauco-Puccinellietalia maritimae and consists of typical species of the lower and higher saltmarsh like Elymus athericus, Festuca rubra, Puccinellia maritima, and Limonium vulgare. Vegetation is patchy with locally dense stands of E. athericus surrounded by short grazed saltmarsh consisting mainly of Festuca rubra and Puccinellia maritima (Fig. 1c).
A field survey was conducted in October 2019 after the UAS image acquisition (see below). Vegetation types were mapped according to the TMAP protocol (Petersen et al. 2014), adapted for the federal state of Schleswig-Holstein. In the protocol, the E. athericus type requires a coverage of that species > 30%. In total, eight different vegetation types were mapped on a scale 1:500 by drawing polygons on printed UAS RGB imagery (Fig. 1b). Next to the mapping of vegetation types the coverage of E. athericus was estimated in the entire study area and assigned to classes of 10% ranging from 0 to 100%.
For comparison with the results of the UAS-based approach, two measures were calculated: first, for comparison with the vegetation classes generated by the classification of UAS imagery, we used the vegetation types of the survey, e.g., the type “Elymus athericus lawn.” Second, the total area covered by E. athericus was calculated by multiplying the area of the polygon with homogenous vegetation cover with the cover class estimated for that polygon. Thus, we can obtain one figure for the E. athericus cover of the study area.
UAS image acquisition
Image data was acquired in August 2019 using a WingtraOne (Wingtra AG, Zurich) platform. This hybrid tail-sitter drone enables image data collection of areas up to 400 ha in a single flight. To generate a broad range of aerial data, both a full-frame Sony RX1RII 42-megapixel RGB and a Micasense RedEdge-MX camera with five narrow bands were used. Accordingly, the survey area (Fig. 1b) was mapped in two single flights: one for RGB and one for multispectral imagery. The forward and sideward image overlap was set to 80% for RGB and 70% for multispectral imagery, respectively. Both flights were carried out at a pre-set altitude of 100 m above ground level, resulting in a ground sample distance (GSD) of approximately 1.4 cm for RGB and 6.8 cm for multispectral imagery (Fig. 1c). For multispectral data post-calibration, a calibrated white reference panel was recorded shortly before and after flight. In addition, an on-board installed downwelling light sensor (DLS) was used to enable improved reflectance calibrations in situations where light conditions are changing in mid-flight, for example, due to temporary clouds. Weather conditions were slightly windy with scattered cloud cover. Both flights were carried out around solar noon to avoid strong cast shadow effects.
Image data processing
The collected image data allowed us to provide mapping products such as orthomosaics, dense point clouds, and digital surface models. We used the software Pix4Dmapper (Pix4D SA, Lausanne, Switzerland) for the photogrammetric imagery processing and point cloud generation. In case of the multispectral image data, we used a standardized radiometric calibration to correct the image reflectance values according to the calibration target and the DLS. It thus takes into consideration the illumination conditions at the date, time, and location of the image capture as well as the sensor’s characteristics. The calibration panel allows calculating absolute reflectance values which make it possible to compare data coming from different flights. In addition, a Canopy Height Model (CHM) was derived in QGIS (QGIS Development Team 2019) by subtracting the digital (ground) elevation model (DEM) from the elevation of the top of the digital surface model (DSM). Due to the higher optical sensor resolution and thus higher accuracies, we used only the RGB imagery for CHM generation.
The UAS also captured multispectral images via the Micasense RedEdge-MX in the wavelengths of the visual, red edge (717 nm center, 10 nm bandwidth) and near-infrared (840 nm center, 40 nm bandwidth). This allowed us to calculate a set of spectral indices. We chose the Normalized Difference Vegetation Index (NDVI) which is a standard vegetation index for characterizing density of green biomass (Tucker 1979). Given the moist character of the ecosystem, its spatial variability, and the various water channels, we further calculated the Normalized Difference Water Index (NDWI) after McFeeters (1996). The NDVI relies on the NIR and red channel, while the NDWI requires green and NIR channels. Both spectral indices were calculated using the command line function “otbcli_RadiometricIndices.bat” of the Orfeo Toolbox Software (McInerney and Kempeneers 2015).
Structural Feature Set texture
In the drone imagery, E. athericus patches show strong textural patterns when compared to other grass patches (Fig. 1c). To exploit the textural information, we calculated Structural Feature Set (SFS) texture measures (Huang et al. 2007) based on the RGB imagery. SFS rely on the histograms of the pixels in multiple directions from a central pixel. We computed six parameters based on the histograms: SFS-length, SFS-width, SFS-PSI, SFS-weighted-mean, SFS-ratio, and SFS-SD (standard deviation). The SFS indices are computed from the neighborhood of each pixel. It is possible to change the length of the line (spatial threshold), as well as the maximum difference between a pixel of the line and the pixel at the center of the neighborhood (spectral threshold). Calculations were done using the default values for the command line function “otbcli_SFSTextureExtraction.bat” of the Orfeo Toolbox Software (McInerney and Kempeneers 2015).
Large-scale mean shift segmentation
To perform object-based image analysis, the raster information has to be separated into polygons of similar spatial and spectral characteristics by image segmentation. The image segmentation was performed on a resampled 12-cm color-infrared (CIR) image, as performance was highly improved when compared to the 1.4-cm resolution and image noise due to the texture of E. athericus was reduced using coarser images. We used the large-scale mean shift segmentation (LSMS) application provided by the Orfeo Toolbox (McInerney and Kempeneers 2015), command line function “otbcli_LargeScaleMeanShift.bat.” It chains together the four modules for (1) stabilized mean shift smoothing, (2) connected-components segmentation, (3) small region merging, and (4) vectorization. The output is a polygon vector file in which the polygons resemble objects in the image. The LSMS algorithm is explained in more detail in Michel et al. (2015).
The application requires the setting of three parameters, the spatial radius (sp = distance in pixel), the spectral range (sr, distance in Euclidean spectral space), and the minimum size of an object in pixels. As the optimal setting was not known, different combinations of parameter settings were calculated and their respective performance was evaluated. The minimum size parameter was constantly kept at 20 pixels as this was the estimated minimum area of an Elymus patch. The spatial radius was calculated for the values 10, 20, and 30, while the spectral range was calculated for 20, 30, and 40. The calculation of the spatial radius = 30 data took extremely long for spectral ranges larger than 20; hence, for sp = 30, only this sr value was calculated. This step yielded nine different segmentation models. After image segmentation, polygons were used to calculate zonal statistics (mean, standard deviation, Gini coefficient) for the prepared image parameters using SAGA-GIS (Conrad et al. 2015). These parameters per polygon were used as model input for the classification.
The final step in mapping Elymus patches required the classification of the polygon segments into a set of thematic classes which can be found in the study area. The following eight classes were identified: Elymus athericus, mixed saltmarsh (mainly Festuca rubra and Puccinellia maritima), Limonium vulgare patches, barren ground, dyke, path, water, and mudflat. For each class, approximately 60–80 in situ locations were identified in the image and digitized as point vectors, except for classes with small spatial extent and homogenous spectral properties, e.g., mudflat or dyke. In these cases, we took between 20 and 30 in situ points. Then, for each of the nine different segmentation model outputs (Fig. 2), polygons were extracted based on the in situ points and were split into training and test datasets with a 70/30 ratio stratified by class.
Three different classification algorithms were tested. First, the random forest algorithm (Breiman 2001) was selected because it is easy to implement, one of the most widely used image classifiers and also one of the most successful algorithms in a recent benchmark study on image classification algorithms (Pirotti et al. 2016). We optimized the algorithm for the mtry parameter and used repeated 10-fold cross-validation to identify the optimal model settings. Second, we used the elastic net algorithm (Zou and Hastie 2017). Elastic net provides automatic variable selection via shrinkage technique identifying parameters with low explanatory power, setting their coefficients to nearly zero. Further, elastic net applies regularization to prevent the model from overfitting. Despite its interesting features, elastic net was rarely tested on image datasets. We trained the elastic net with a 10-fold cross-validation but without hyperparameter tuning as this was done automatically by the algorithm. The third classifier we used was the artificial neural network (ANN). ANNs can be considered complex non-linear versions of logistic regression (Venables and Ripley 2002) using a network of hidden layers to learn from the data via feedback loops. Neural networks, in particular deep learning methods, have gained strongly in popularity for image classification, recently (Li et al. 2018). Here, we used the standard feed-forward neural network as implemented in the nnet library (Venables and Ripley 2002). We calibrated the network by varying the number of hidden layers from one to ten.
Each classifier was evaluated on an independent test dataset. We measured the performance using three accuracy measures. First is overall accuracy (OA), which measures the general agreement of the predictions with the true class labels. OA is a standard parameter in classification exercises. Second, we use the kappa coefficient (Cohen 1960), which provides information on the agreement of observed versus an expected accuracy. Kappa can be applied to multiclass classifiers to evaluate the overall performance of a classifier. Values of kappa above 0.8 are considered to be excellent (Landis and Koch 1977). Although it is strongly criticized for being correlated with OA and for its philosophy of chance-based agreement (Olofsson et al. 2014), we still use it here as a measure for reference. Finally, we used the F1-single class measure for the class “Elymus.” F1 is the harmonic average of two other accuracy measures called precision and recall. F1 is often used when no focus on either precision or recall is required but the classifier should be balanced. Variable importance was measured in percentage of occurrence within the cross-validated models, or in other words, how often a parameter was used relative to the number of all models. All steps during the classification and evaluation were done in the software R v.3.4 (R Core Team, 2019) using the package caret (Kuhn and Johnson 2013).
In order to evaluate the differences between the field-based polygons and the OBIA-based mapping, a comparison with regard to location, shape, and area in hectare of Elymus polygons was done. In addition, we conducted an overlap analysis in QGIS. Polygonal overlap was measured in hectare and percentage. We post-processed the OBIA polygons by removing all polygons which could not be identified as a correct “Elymus” patch. For this, we created a hectare grid across the CIR image and checked each polygon whether it contained E. athericus patches or not. Typical misclassifications involved areas with shadows, water runnels, or small tracks that had a similar texture like the “Elymus” class. The overlap analysis was then repeated for the post-processed polygons.
The image segmentation algorithm was tested with nine different parameter settings. Spatial radius and spectral distance ranged between values of 10 and 40, while the minimum size parameter was kept constant at a value of 20 pixels. The outcomes of the different settings are shown for an example location in Fig. 2. An increase of the spatial radius parameter led to larger polygons (Fig. 2a, d, h, g). However, many small polygons remain in the area of the “Elymus” patch, which reflect the strongly heterogeneous texture of Elymus athericus patches. An increase in the spectral range parameter led to increasingly larger polygons reducing the overall number of small polygons. This resulted in wrongly placed boundaries, in particular for all spectral values of 40 (Fig. 2c, f, i). Low spatial and spectral values (Fig. 2a) yielded many small polygons, being not able to capture the “Elymus” patches correctly, while high spatial and spectral values (Fig. 2i) caused too large polygons with wrong boundaries. The average solution (spatial = 20, spectral = 20; Fig. 2d) was later identified as the optimal configuration.
The classification of the polygon segments was done for nine different parameter settings and three different machine learning algorithms: random forest, elastic net, and artificial neural networks. Based on three common accuracy measures, i.e., OA, kappa, F1, we evaluated the performance of the classification outcomes (Table 1). All accuracy measures decreased with increased spectral range parameter values as this led to larger polygon segments (Fig. 2). The increase of spatial radius had a less strong effect. High accuracy was always detected for spatial (sp) = 20, except for the first model (Table 1). Models with sp = 30 or spectral range (sr) = 40 always performed worse. The overall highest accuracy was found for artificial neural network (ANN) with the setting sp = 20, sr = 20 (Table 1), while the worst model had the setting sp = 10, sr = 40. Interestingly, the model that best classified the “Elymus” class was the model sp = 10, sp = 20, with F1 = 0.954, followed by the best ANN model with F1 = 0.931. With regard to the algorithms used, there was no algorithm which clearly performed better than the others. However, the ANN model often had the highest overall performance or was at least as good as the others while elastic net always scored last. The elastic net model with sp = 10, sr = 40 was the worst model with very low accuracy values (Table 1). We decided to choose ANN over the random forest as the final model as the other classes were better modeled with the ANN (see F1 in Table 2). Further, the vegetation map produced by ANN appeared more precise when compared to the vegetation map based on the random forest model with sp = 10, sr = 20.
The confusion matrix for the ANN model (Table 2) showed that Elymus samples were partly confused with the class “mixed saltmarsh,” “bare soil,” or “water.” Classes that were not “Elymus” but were classified as “Elymus” were “mixed saltmarsh,” “bare soil,” and “Limonium.” No other large misclassifications were observed indicating a good performance of the ANN model. Several classes had a low number of test samples, e.g., for “Limonium,” “mudflat,” and “path,” but were still well classified with F1 values over 0.9. The class “path” was the worst performing class but still had an accuracy of 0.929.
The importance of the image parameters did not differ much between the different algorithms. The vegetation indices were always more important than the textural parameters and the canopy height was in between. The mean values and the standard deviations of NDVI, NDWI, and NIR had always importance values above 75%. The textural values were always below 40%. Due to the different numbers of cross-validation runs, the importance of the parameters cannot be directly compared. Also, the output of the elastic net algorithm did not provide an overall importance but only class-wise importance values. Hence, we only give this rather coarse interpretation of parameter importance. In sum, the ratio of spectral versus textural importance values is approximately 75:25 for all algorithms used.
Comparison of field survey– and OBIA-based mapping of Elymus athericus
We compared the vegetation mapping of Elymus athericus dominated stands versus the OBIA-based map of E. athericus polygons for visual and spatial agreement. Considering the classification, both mapping techniques resulted in similar area sizes. According to the field survey, 6.29 ha were covered by the vegetation type Elymus athericus, while the OBIA-based approach resulted in 6.22 ha, or 35.0% and 34.6% of the study area. However, the overlap between both polygon datasets was only 70% or 4.2 ha. When the mapped polygons were weighted by the cover estimates per polygon, the weighted E. athericus area was slightly smaller with 4.77 ha (26.5%) of the study area. This roughly corresponds to the overlap of OBIA and field survey polygons with 4.2 ha.
A visual comparison (Fig. 3) revealed that manual mapping commonly overestimated the extent of E. athericus patches locally. For example, in Fig. 3a, Boxes 1 and 2 contain large polygons outlined by the manual approach, yet the OBIA-based map (Fig. 3b) show many fine-structured patches in the same area. Box 3 shows a sharp boundary drawn with the manual approach; however, the OBIA-based map extends in this area more accurately. Here, the OBIA-based approach found many small singular patches, while the manual approach, which required a coverage of at least 30% to be classified as the E. athericus vegetation type, ignored this part. On the other hand, the OBIA-based map also produced many false-positive patches by identifying small water runnels or shadows as E. athericus patches in the large area covered by mixed saltmarsh which is generally free of E. athericus (box 4). Hence, the general pattern of the distribution of E. athericus is in agreement between the two methods; however, on a finer spatial scale, OBIA led to finer and more accurate delimitation of E. athericus patches but also to many small false areas.
After post-processing the OBIA-based polygons, many were eliminated in the eastern part of the study area and on the dyke, leaving 5.91 ha of E. athericus cover. This was equal to a difference of 0.31 ha in comparison to the original OBIA-based polygons and 0.38 ha compared to the field-based polygons. The overlap of the post-processed polygons and the field-based polygons did only change marginally by 1%; hence, most of the area that was wrongly classified as E. athericus was in areas near boxes 3 and 4 (Fig. 3).
Drones, or UAS (unmanned aerial systems), have seen frequent successful applications in conservation biology for mapping endangered or problematic plant species in wetland ecosystems over the last years. In this study, we successfully conducted a UAS flight campaign in a saltmarsh ecosystem, classified the area covered by the tall grass Elymus athericus and compared our results to the distribution of E. athericus mapped by a field survey in the study area.
We found that field-based maps of E. athericus patches were in good spatial agreement with the OBIA-based maps, showing the same amount of area covered by Elymus. However, we found that field-based maps were rather based on few large polygons that also covered areas where E. athericus was not present, thus overestimating its total cover. The OBIA-based maps instead revealed a more realistic picture consisting of many single polygon fragments, thus better delineating local patches. However, OBIA-based maps also overestimated E. athericus in areas where the species was not observed by the field-based survey and where it was not present. The area difference between the two maps was 30% or ca. 2 ha which is a significant amount. The study done by Tay et al. (2018) also found good agreement between field-based cover estimates and cover estimates of a pixel-based classification (R2 = 0.79) of northern German meadow vegetation, specifically targeting Jacobaea vulgaris. However, they found that cover of J. vulgaris was systematically underestimated which was mainly caused by different ways of measuring cover (the rosette was included in the field survey, but the UAS only measured the flower head). In a different context, Hill et al. (2017) compared three methods, i.e., field survey, manual digitization, and pixel-based classification of UAS-images, to map Iris pseudacorus at two lakes in British Columbia, Canada. They found very little overlap of only 7% between the field survey and the classified drone-based maps. This was caused by the difficulties of correctly locating the Iris populations in the GIS as the ground truth was gathered from canoe. The manual digitization was considered the most accurate but also time-consuming method. These studies suggest that drone-based imagery does not yield optimal results when compared to ground cover estimates, as such comparisons are difficult to achieve. Our findings that the OBIA-based map mainly overestimates in areas where E. athericus did not occur, but yields a more realistic picture in areas where field-based polygons overestimate, are promising. The error caused by many small false-positive polygons can be easily cleaned by either fine-tuning the OBIA method, deleting polygons based on unique image features, or manually deleting superfluous polygons. Although this will add to the required overall processing time, it will also increase the credibility and usability of the final map. In sum, image segmentation using the large-scale mean shift segmentation algorithm (LSMS, Michel et al. 2015) with varying levels of spatial and spectral thresholds on a VHR-multispectral drone imagery was of higher accuracy in terms of delineation of E. athericus patches when compared to field-based maps.
The quality of the classification of the image segments resulting from the object-based image analysis (OBIA) ranged for kappa between 0.51 and 0.94. We compared three different types of classifiers, i.e., artificial neural networks, elastic net, and random forest. We found no other study that compared the elastic net as a classifier for remotely sensed imagery, but it was constantly the worst in our study. It is unclear why its performance was much lower than the others. One possible explanation is that it allowed only the tuning of the regularization parameter lambda, which might have not been flexible enough. The other two classifiers (ANN, RF) were on par. Many other studies found that ANN and even more often RF were very good classifiers (Poona and Ismail 2013; Chabot et al. 2016; Oldeland et al. 2017, Silveira et al. 2019). Hence, these can be recommended for future studies. However, few studies presented a thorough examination of the parameterization of the LSMS spatial-spectral thresholds as we did (e.g., Gonçalves et al. 2019). Often studies report fixed threshold values according to object size and its spectral variation. For example, Sosa-Herrera et al. (2019) used the same LSMS algorithm as we did, and mapped the health status of Capsicum annuum crops using a UAS. They set a fixed spatial threshold of 5 and the spectral threshold to 15 based on estimated values. Another study on vegetation of cork oak woodland (De Luca et al. 2019) found that values for the spatial threshold above 10 made the calculations very time consuming and thus skipped the mean shift smoothing-step in the image segmentation workflow. We run our LSMS on a standard PC with eight cores and 8 GB RAM; the script containing command lines for nine models was written in a batch file and all calculations ran within 12 h. The classification step took about 30 min for the 27 different models. In contrast to manually comparing parameter values, the batch script containing different parameter settings greatly optimized the LSMS workflow. We recommend using such a grid-wise tuning approach to optimize thresholds for future studies that apply image segmentation on the UAS imagery.
The methodology described in this study allowed us to map Elymus athericus with high accuracy with two 30-min UAS flights. Although other studies argued that UAS-based campaigns are quick but require a lot of time for image processing and classification (Hill et al. 2017; Tay et al. 2018), we found that these steps can be done with a reasonable effort. Of course, the general workflow has to be established in terms of batch files containing command line code and R-scripts for running the classification. But once established, the workflow can then be applied on any scene; hence, especially for ongoing monitoring projects, it is worth the investment. A similar approach was invented with the SegOptim-R package (Gonçalves et al. 2019), which provides such a workflow as a ready-to-use open-source software package. Once established, the classification algorithm based on the training data can be applied to image data collected by the same camera sensor at new sites or new time points, and the resulting maps can improve the information base for environmental management. Thus, our approach provides support for long-term, repetitive monitoring while optimizing costs and field surveys. This is particularly important for sites of low accessibility such as wetlands (Boon et al. 2016) or when vegetation becomes relatively small in comparison to the landscape scale (Turner et al. 2019). Minimizing in situ mapping and control operations is a great advantage of using UAS-based remote sensing strategies. In general, this approach can allow environmental managers to monitor the distribution and abundance of plants in similar situations once the classification models are adjusted to the respective species. Moreover, the development of new, lightweight multispectral sensors using on-board radiometric calibration encourages the transferability of classification models to other areas.
However, some limitations of our approach also became obvious. Besides the many technical challenges, such as calibration, image registration, and processing, which are discussed in detail elsewhere (Manfreda et al. 2018), we will focus on three more applied challenges. First, there is a clear discrepancy between field-based and OBIA-based polygons in terms of spatial resolution and also in area statistics. Thus, there is no direct way of converting the obtained values from one method to the other and care needs to be taken if ongoing field-based monitoring is to be replaced by pure UAS-based monitoring. Second, post-processing of image segmentation is usually required due to obvious misclassifications by the algorithm, in this case in the area of low growing mixed saltmarsh. This may be the case even though the accuracy evaluation shows very high rates of agreement between train and test data. Consequently, a fully automatic approach is hardly achievable and expert judgment will always play a role in post-processing of image segments. Third, there is clearly a lack of standardization for UAS-based vegetation mapping efforts. There are many studies that describe the necessary steps to set up a UAS mission (e.g., Tmušić et al. 2020), but actually very little agreement was reached on how to appropriately analyze the very-high-resolution imagery made available by these UAS missions. Clearly this is complicated by the many different possible applications. Here, we proposed an object-based image segmentation approach, from which we believe it is highly suited for the task of mapping large conspicuous patches of a single plant species. The recent advent of deep learning methods for VHR-image classification might further improve and facilitate mapping of vegetation (Kattenborn et al. 2019) potentially making OBIA methods superfluous.
Drones or UAS offer capabilities for mapping the occurrence, dynamic or extent of plant species in a given conservation management setting with high accuracies. UAS-acquired very-high resolution image data generate additional valuable geospatial information for management just in time when needed at relatively low cost. We were able to map the distribution of the grass species Elymus athericus in a managed saltmarsh and compared field- and UAS-based maps of the species distribution. At the coarse scale, the patterns of both approaches were in good agreement. However, on a finer scale, the field-based maps overestimated coverage where E. athericus was present, while the UAS-based maps overestimated coverage in areas where the species was generally absent. After post-processing, the UAS-based maps yielded an area estimate of about 1–2 ha less compared to the coarse polygons resulting from manual, field-based mapping. Furthermore, we found that the classification of vegetation using object-based image segmentation can lead to very high accuracies, but a comparison of different classification algorithms and optimally parameterized thresholds for the segmentation algorithm is of high importance. Once the workflow is established, UAS-based surveys significantly increase the objectivity of long-term monitoring of plant species distributions with comparable effort. The main advantages of the drone-based workflow are the objectivity, reproducibility in the next monitoring interval, just-in-time produced images from the same point in time as the ground controls or field surveys are carried out, and images of the study area with a much higher resolution than satellite or conventional aerial imagery can provide. As such, we are convinced that UAS-based remote sensing techniques will be integrated step by step in applied conservation management.
Alvarez-Taboada, F., Paredes, C., & Julián-Pelaz, J. (2017). Mapping of the invasive species Hakea sericea using unmanned aerial vehicle (UAV) and WorldView-2 imagery and an object-oriented approach. Remote Sensing, 9(9), 913. https://doi.org/10.3390/rs9090913.
Bakker, J. P., Kuijper, D. P., & Stahl, J. (2009). Community ecology and management of salt marshes. In H. A. Verhoef & P. J. Morin (Eds.), Community ecology processes, models, and applications (pp. 131–147). Oxford: Oxford University Press.
Bakker, J. P., Schrama, M., Esselink, P., Daniels, P., Bhola, N., Nolte, S., de Vries, Y., Veeneklaas, R. M., & Stock, M. (2020). Long-term effects of sheep grazing in various densities on marsh properties and vegetation dynamics in two different salt-marsh zones. Estuaries and Coasts, 43, 298–315.
Boon, M. A., Greenfield, R., & Tesfamichael, S. (2016). Unmanned aerial vehicle (UAV) photogrammetry produces accurate high-resolution orthophotos, point clouds and surface models for mapping wetlands. South African Journal of Geomatics, 5(2), 186–200. https://doi.org/10.4314/sajg.v5i2.7.
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.
Chabot, D., Dillon, C., Ahmed, O., & Shemrock, A. (2016). Object-based analysis of UAS imagery to map emergent and submerged invasive aquatic vegetation: a case study. Journal of Unmanned Vehicle Systems, 5(1), 27–33. https://doi.org/10.1139/juvs-2016-0009.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104.
Conrad, O., Bechtel, B., Bock, M., Dietrich, H., Fischer, E., Gerlitz, L., Wehberg, J., Wichmann, V., & Böhner, J. (2015). System for Automated Geoscientific Analyses (SAGA) v. 2.1.4. Geoscientific Model Development, 8(7), 1991–2007. https://doi.org/10.5194/gmd-8-1991-2015.
De Luca, G., Silva, J. M. N., Cerasoli, S., Araújo, J., Campos, J., Di Fazio, S., & Modica, G. (2019). Object-based land cover classification of cork oak woodlands using UAV imagery and Orfeo ToolBox. Remote Sensing, 11(10), 1238. https://doi.org/10.3390/rs11101238.
Friese, J., Temming, A., & Dänhardt, A. (2018). Grazing management affects fish diets in a Wadden Sea salt marsh. Estuarine, Coastal and Shelf Science, 212, 341–352. https://doi.org/10.1016/j.ecss.2018.07.014.
Gonçalves, J., Pôças, I., Marcos, B., Mücher, C. A., & Honrado, J. P. (2019). SegOptim—a new R package for optimizing object-based image analyses of high-spatial resolution remotely-sensed data. International Journal of Applied Earth Observation and Geoinformation, 76, 218–230. https://doi.org/10.1016/j.jag.2018.11.011.
Hill, D. J., Tarasoff, C., Whitworth, G. E., Baron, J., Bradshaw, J. L., & Church, J. S. (2017). Utility of unmanned aerial vehicles for mapping invasive plant species: a case study on yellow flag iris (Iris pseudacorus L.). International Journal of Remote Sensing, 38(8–10), 2083–2105. https://doi.org/10.1080/01431161.2016.1264030.
Huang, X., Zhang, L., & Li, P. (2007). Classification and extraction of spatial features in urban areas using high-resolution multispectral imagery. IEEE Geoscience and Remote Sensing Letters, 4(2), 260–264. https://doi.org/10.1109/LGRS.2006.890540.
UNEP-WCMC, & IUCN. (2020). Protected planet: the world database on protected areas (WDPA) [Online], [version 10/2019]. Cambridge: UNEP-WCMC and IUCN Available at: www.protectedplanet.net.
Kattenborn, T., Eichel, J., & Fassnacht, F. E. (2019). Convolutional neural networks enable efficient, accurate and fine-grained segmentation of plant species and communities from high-resolution UAV imagery. Scientific Reports, 9(1), 17656. https://doi.org/10.1038/s41598-019-53797-9.
Kucharczyk, M., Hay, G. J., Ghaffarian, S., & Hugenholtz, C. H. (2020). Geographic object-based image analysis: a primer and future directions. Remote Sensing, 12(12), 2012. https://doi.org/10.3390/rs12122012.
Kuhn, M., & Johnson, K. (2013). Applied predictive modeling. New York: Springer.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310.
Li, Y., Zhang, H., Xue, X., Jiang, Y., & Shen, Q. (2018). Deep learning for remote sensing image classification: a survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(6), e1264. https://doi.org/10.1002/widm.1264.
Manfreda, S., McCabe, M. F., Miller, P. E., Lucas, R., Pajuelo Madrigal, V., Mallinis, G., et al. (2018). On the use of unmanned aerial systems for environmental monitoring. Remote Sensing, 10(4), 641. https://doi.org/10.3390/rs10040641.
Mandema, F. S., Tinbergen, J. M., Ens, B. J., Koffijberg, K., Dijkema, K. S., & Bakker, J. P. (2015). Moderate livestock grazing of salt, and brackish marshes benefits breeding birds along the mainland coast of the Wadden Sea. The Wilson Journal of Ornithology, 127(3), 467–476.
McFeeters, S. K. (1996). The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features. International Journal of Remote Sensing, 17(7), 1425–1432. https://doi.org/10.1080/01431169608948714.
McInerney, D., & Kempeneers, P. (2015). Orfeo Toolbox. In D. McInerney & P. Kempeneers (Eds.), Open Source Geospatial Tools (pp. S. 199–S. 217). Springer International Publishing. https://doi.org/10.1007/978-3-319-01824-9_13.
Michel, J., Youssefi, D., & Grizonnet, M. (2015). Stable mean-shift algorithm and its application to the segmentation of arbitrarily large remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 53(2), 952–964. https://doi.org/10.1109/TGRS.2014.2330857.
Nolte, S., Wanner, A., Stock, M., & Jensen, K. (2019). Elymus athericus encroachment in Wadden Sea salt marshes is driven by surface elevation change. Applied Vegetation Science, 22(3), 454–464. https://doi.org/10.1111/avsc.12443.
Oldeland, J., et al. (2017). The potential of UAS derived image features for discriminating savannah tree species. In R. Díaz-Delgado et al. (Eds.), The roles of remote sensing in nature conservation (pp. 183–201). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-64332-8_10.
Olofsson, P., Foody, G. M., Herold, M., Stehman, S. V., Woodcock, C. E., & Wulder, M. A. (2014). Good practices for estimating area and assessing accuracy of land change. Remote Sensing of Environment, 148, 42–57. https://doi.org/10.1016/j.rse.2014.02.015.
Petersen, J., Bas, K. & Stock, M. (2014). TMAP-typology of coastal vegetation in the Wadden Sea area. Version 1.0. www.waddensea-secretariat.org, Wilhelmshaven Germany. Accessed 09 Jan 2020.
Pétillon, J., Ysnel, F., Canard, A., & Lefeuvre, J.-C. (2005). Impact of an invasive plant (Elymus athericus) on the conservation value of tidal salt marshes in western France and implications for management: responses of spider populations. Biological Conservation, 126(1), 103–117. https://doi.org/10.1016/j.biocon.2005.05.003.
Pirotti, F., Sunar, F., & Piragnolo, M. (2016). Benchmark of machine learning methods for classification of a Sentinel-2 image. ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B7, 335–340. https://doi.org/10.5194/isprsarchives-XLI-B7-335-2016.
Poona, N. K., & Ismail, R. (2013). Discriminating the occurrence of pitch canker fungus in Pinus radiata trees using QuickBird imagery and artificial neural networks. Southern Forests: a Journal of Forest Science, 75(1), 29–40. https://doi.org/10.2989/20702620.2012.748255.
QGIS Development Team 2019. QGIS geographic information system. Open Source Geospatial Foundation. www.qgis.org
R Core Team (2019). R: a language and environment for statistical computing. R Foundation for Statistical Computing. www.r-project.org
Revermann, R. & Luther-Mosebach, J. (2019) Monitoring der Salzwiesen auf den Halligen Hooge, Gröde und Nordstrandischmoor. Jahresbericht 2019. Unpublished report for Landesamt für Landwirtschaft, Umwelt und ländliche Räume (LLUR). 108 pp.
Rickert, C., Fichtner, A., Van Klink, R., & Bakker, J. P. (2012). α-and β-diversity in moth communities in salt marshes is driven by grazing management. Biological Conservation, 146(1), 24–31. https://doi.org/10.1016/j.biocon.2011.11.024.
Rominger, K., & Meyer, S. E. (2019). Application of UAV-based methodology for census of an endangered plant species in a fragile habitat. Remote Sensing, 11(6), 719. https://doi.org/10.3390/rs11060719.
Samiappan, S., Turnage, G., Hathcock, L., Casagrande, L., Stinson, P., & Moorhead, R. (2017a). Using unmanned aerial vehicles for high-resolution remote sensing to map invasive Phragmites australis in coastal wetlands. International Journal of Remote Sensing, 38(8–10), 2199–2217. https://doi.org/10.1080/01431161.2016.1239288.
Samiappan, S., Turnage, G., Hathcock, L. A., & Moorhead, R. (2017b). Mapping of invasive phragmites (common reed) in Gulf of Mexico coastal wetlands using multispectral imagery and small unmanned aerial systems. International Journal of Remote Sensing, 38(8–10), 2861–2882. https://doi.org/10.1080/01431161.2016.1271480.
Silveira, E. M. O., Silva, S. H. G., Acerbi-Junior, F. W., Carvalho, M. C., Carvalho, L. M. T., Scolforo, J. R. S., & Wulder, M. A. (2019). Object-based random forest modelling of aboveground forest biomass outperforms a pixel-based approach in a heterogeneous and mountain tropical environment. International Journal of Applied Earth Observation and Geoinformation, 78, 175–188. https://doi.org/10.1016/j.jag.2019.02.004.
Sosa-Herrera, J. A., Vallejo-Pérez, M. R., Álvarez-Jarquín, N., Cid-García, N. M., & López-Araujo, D. J. (2019). Geographic object-based analysis of airborne multispectral images for health assessment of Capsicum annuum L. crops. Sensors, 19(21), 4817. https://doi.org/10.3390/s19214817.
Tay, J. Y. L., Erfmeier, A., & Kalwij, J. M. (2018). Reaching new heights: can drones replace current methods to study plant population dynamics? Plant Ecology, 219(10), 1139–1150. https://doi.org/10.1007/s11258-018-0865-8.
Tmušić, G., Manfreda, S., Aasen, H., James, M. R., Gonçalves, G., Ben-Dor, E., Brook, A., Polinova, M., Arranz, J. J., Mészáros, J., Zhuang, R., Johansen, K., Malbeteau, Y., de Lima, I. P., Davids, C., Herban, S., & McCabe, M. F. (2020). Current practices in UAS-based environmental monitoring. Remote Sensing, 12(6), 1001. https://doi.org/10.3390/rs12061001.
Tucker, C. J. (1979). Red and photographic infrared linear combinations for monitoring vegetation. Remote Sensing of Environment, 8(2), 127–150.
Turner, D. J., Malenovský, Z., Lucieer, A., Turnbull, J. D., & Robinson, S. A. (2019). Optimizing spectral and spatial resolutions of unmanned aerial system imaging sensors for monitoring Antarctic vegetation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(10), 3813–3825. https://doi.org/10.1109/JSTARS.2019.2938544.
Valéry, L., Bouchard, V., & Lefeuvre, J.-C. (2004). Impact of the invasive native species Elymus athericus on carbon pools in a salt marsh. Wetlands, 24(2), 268–276. https://doi.org/10.1672/0277-5212(2004)024[0268:IOTINS]2.0.CO;2.
Van Klink, R., Nolte, S., Mandema, F. S., Lagendijk, D. G., WallisDeVries, M. F., Bakker, J. P., et al. (2016). Effects of grazing management on biodiversity across trophic levels–the importance of livestock species and stocking density in salt marshes. Agriculture, Ecosystems & Environment, 235, 329–339. https://doi.org/10.1016/j.agee.2016.11.001.
Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S. New York: Springer-Verlag. https://doi.org/10.1007/978-0-387-21706-2.
Wan, H., Wang, Q., Jiang, D., Fu, J., Yang, Y., & Liu, X. (2014). Monitoring the invasion of Spartina alterniflora using very high resolution unmanned aerial vehicle imagery in Beihai, Guangxi (China). The Scientific World Journal, 2014, 1–7. https://doi.org/10.1155/2014/638296.
Wanner, A., Suchrow, S., Kiehl, K., Meyer, W., Pohlmann, N., Stock, M., & Jensen, K. (2014). Scale matters: Impact of management regime on plant species richness and vegetation type diversity in Wadden Sea salt marshes. Agriculture, Ecosystems & Environment, 182, 69–79. https://doi.org/10.1016/j.agee.2013.08.014.
Zou, H., & Hastie, T. (2017). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B: Statistical Methodology, 301–320. https://email@example.com/(ISSN)1467-9868.TOP_SERIES_B_RESEARCH.
This work was part of the biennial monitoring of saltmarshes assigned by the LLUR, managed by Iris Postel whom we thank for the opportunity to work on this subject. We further thank Ruth und Nommen Kruse, from Nordstrandischmoor, for letting us work on their pastures and hosting us during the various field surveys. We also thank two anonymous reviewers for their recommendations.
Open Access funding enabled and organized by Projekt DEAL.
Conflict of interest
The authors declare that they have no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Oldeland, J., Revermann, R., Luther-Mosebach, J. et al. New tools for old problems — comparing drone- and field-based assessments of a problematic plant species. Environ Monit Assess 193, 90 (2021). https://doi.org/10.1007/s10661-021-08852-2
- Vegetation mapping
- Nature conservation
- Salt marsh
- Elymus athericus