Abstract
Obtaining high-accuracy land use/land cover (LULC) maps is very costly; therefore, the use of the global LULC maps may prove to be very effective in several domains, including for geographic information system (GIS) applications. However, it is essential to assess the accuracy of LULC maps before using them. The objective of this study was to assess the accuracy of the two latest free and high-resolution (10 m) global land cover maps, namely, European Space Agency (ESA) WorldCover2020 and Environmental Systems Research Institute (ESRI) 2020 Land Cover in Tartous governorate (Syria), using geospatial techniques. Two sampling methods are used to assess the accuracy of the two LULC maps: stratified random sampling (SRS) and equalized stratified random (ESR). The overall accuracy (OA) and kappa coefficient were calculated, in addition to other accuracy assessment indicators. In the first method, the OA of the ESA WorldCover2020 map increased from 74.4 (global accuracy) to 78.3% (local accuracy). On the other hand, the OA of the ESRI 2020 Land Cover map decreased by 16%, from 86 (global accuracy) to 74.1% (local accuracy). The kappa coefficient for the ESA WorldCover2020 map was 0.72 against 0.62 for ESRI 2020 Land Cover map. In the second method, the OA reached 70% and 73% for the ESA WorldCover2020 map and the ESRI 2020 Land Cover map, respectively. Furthermore, the kappa coefficient for the ESA WorldCover2020 map was 0.66 against 0.69 for ESRI 2020 Land Cover map. A comparison was also carried out between the eight classes of two LULC maps. In addition, the map of agreement and disagreement between ESA and ESRI land cover 2020 datasets was created, which highlighted that the disagreement was not uniformly distributed in the study area.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alali I, Mahmoud G (2019) A study suitable for the geographical distribution of the population with the distribution of services in Tartous Governorate. Tartous Univ J Res Sci Stud 3(1):105–126
Chozom K, Nimasow G (2021) GIS- and AHP-based land suitability analysis of Malus domestica Borkh. (apple) in West Kameng district of Arunachal Pradesh, India. Appl Geomat. Springer 13(3):349–360. https://doi.org/10.1007/S12518-021-00354-7
Clark A et al (2022) Multiscale object-based classification and feature extraction along Arctic coasts. Remote Sens. Multidisciplinary Digital Publishing Institute 14(13):2982. https://doi.org/10.3390/rs14132982
Dong S et al (2020) Stratified even sampling method for accuracy assessment of land use/land cover classification: a case study of Beijing, China. Int J Remote Sens. Taylor & Francis 41(16):6427–6443. https://doi.org/10.1080/01431161.2020.1739349
ESA (2020) WorldCover Product User Manual | V 1 . 0. Tech. Rep. Available at. https://worldcover2020.esa.int/data/docs/WorldCover_PUM_V1.1.pdf. Accessed 27 Oct 2021
ESA (2021) Product validation report (D12-PVR) Tech. Rep. Available at: https://worldcover2020.esa.int/data/docs/WorldCover_PVR_V1.1.pdf. Accessed 27 Oct 2021
ESRI (2021) AI enables rapid creation of global land cover map, arcuser - Summer 2021, pp 12–13. Available at: https://www.esri.com/about/newsroom/wp-content/uploads/2021/08/global.pdf. Accessed 27 Oct 2021
ESRI (2022) Diff (spatial analyst). Available at: https://pro.arcgis.com/en/pro-app/2.8/tool-reference/spatial-analyst/diff.htm. Accessed 2 Feb 2022
Fielding AH, Bell JF (1997) A review of methods for the assessment of prediction errors in conservation presence/absence models. Environ Conserv. Cambridge University Press 24(1):38–49. https://doi.org/10.1017/S0376892997000088
Foody GM (2009) Sample size determination for image classification accuracy assessment and comparison. Int J Remote Sens. Taylor & Francis 30(20):5273–5291. https://doi.org/10.1080/01431160903130937
Fritz S, See L (2005) Comparison of land cover maps using fuzzy agreement. Int J Geogr Inf Sci. Taylor & Francis 19(7):787–807. https://doi.org/10.1080/13658810500072020
Huang D et al (2017) Accuracy assessment model for classification result of remote sensing image based on spatial sampling. SPIE 11(4):046023. https://doi.org/10.1117/1.JRS.11.046023
Ismail MH, Jusoff K (2008) Satellite data classification accuracy assessment based from reference dataset - Universiti Putra Malaysia Institutional Repository. Int J Comput Inf Sci Eng 2(2):96–102. Available at: http://psasir.upm.edu.my/id/eprint/7638/. Accessed 26 Feb 2022
Jenness J, Wynne JJ (2005) Cohen’s Kappa and classification table metrics 2.0: An ArcView 3.x extension for accuracy assessment of spatially explicit models. Open-file report of 2005-1363. Flagstaff, AZ: U.S. Geological Survey, Southwest Biological Science Center, p 86
Karra K et al (2021) Global land use / land cover with Sentinel 2 and deep learning. In: IEEE International Geoscience and Remote Sensing Symposium IGARSS. Institute of Electrical and Electronics Engineers (IEEE), pp 4704–4707. https://doi.org/10.1109/IGARSS47720.2021.9553499
Linyucheva A, Kindlmann P (2021) A review of global land cover maps in terms of their potential use for habitat suitability modelling. Eur J Environ Sci. Charles University in Prague 11(1):46–61. https://doi.org/10.14712/23361964.2021.6
Lurz PWW et al (2001) Predicting grey squirrel expansion in North Italy: a spatially explicit modelling approach. Landsc Ecol. Springer 16(5):407–420. https://doi.org/10.1023/A:1017508711713
Manakos I et al (2018) Comparison of global and continental land cover products for selected study areas in South Central and Eastern European Region. Remote Sens. Multidisciplinary Digital Publishing Institute 10(12):1967. https://doi.org/10.3390/RS10121967
MoAAR (2022) The agricultural investment map in Tartous Governorate, The Ministry of Agriculture and Agrarian Reform (MoAAR) in Syria. Available at: http://www.moaar.gov.sy/site_ar/syriamap/tartos.htm. Accessed 7 Jan 2022
Möller M et al (2013) A framework for the geometric accuracy assessment of classified objects. Int J Remote Sens. Taylor & Francis 34(24):8685–8698. https://doi.org/10.1080/01431161.2013.845319
Mommert M et al (2021) Power plant classification from remote imaging with deep learning. In: IEEE International Geoscience and Remote Sensing Symposium IGARSS. Institute of Electrical and Electronics Engineers (IEEE), pp 6391–6394. https://doi.org/10.1109/IGARSS47720.2021.9553219
Monserud RA, Leemans R (1992) Comparing global vegetation maps with the Kappa statistic. Ecol Model. Elsevier 62(4):275–293. https://doi.org/10.1016/0304-3800(92)90003-W
Nuhu SK et al (2021) A new hybrid modelling approach for an eco-industrial park site selection. Chem Eng Trans 89:343–348. https://doi.org/10.3303/CET2189058
Olofsson P et al (2014) Good practices for estimating area and assessing accuracy of land change. Remote Sens Environ. Elsevier 148:42–57. https://doi.org/10.1016/J.RSE.2014.02.015
Oxoli D et al (2019) Extending accuracy assessment procedures of global coverage land cover maps through spatial association analysis. Int Arch Photogramm Remote Sens Spatial Inf Sci. Copernicus GmbH XLII-2-W13(2/W13):1601–1607. https://doi.org/10.5194/ISPRS-ARCHIVES-XLII-2-W13-1601-2019
Rwanga SS et al (2017) Accuracy assessment of land use/land cover classification using remote sensing and GIS. Int J Geosci. Scientific Research Publishing 8(4):611–622. https://doi.org/10.4236/IJG.2017.84033
Shetty S et al (2021) Assessing the effect of training sampling design on the performance of machine learning classifiers for land cover mapping using multi-temporal remote sensing data and Google Earth engine. Remote Sens. Multidisciplinary Digital Publishing Institute 13(8):1433. https://doi.org/10.3390/RS13081433
Silva JO et al (2022) Analytic hierarchy process (AHP) for a landfill site selection in Chachapoyas and Huancas (NW Peru): modeling in a GIS-RS environment. Adv Civ Eng. Edited by X. Fan 2022:1–15. https://doi.org/10.1155/2022/9733322
Sisay G, Gebre SL, Getahun K (2020) GIS-based potential landfill site selection using MCDM-AHP modeling of Gondar Town, Ethiopia. Afr Geogr Rev. Routledge 40(2):105–124. https://doi.org/10.1080/19376812.2020.1770105
Sresto MA et al (2022) A GIS and remote sensing approach for measuring summer-winter variation of land use and land cover indices and surface temperature in Dhaka district, Bangladesh. Heliyon. Elsevier 8(8):e10309. https://doi.org/10.1016/J.HELIYON.2022.E10309
Stehman SV (2009) Sampling designs for accuracy assessment of land cover. Int J Remote Sens. Taylor & Francis 30(20):5243–5272. https://doi.org/10.1080/01431160903131000
Stehman SV, Foody GM (2019) Key issues in rigorous accuracy assessment of land cover products. Remote Sens Environ. Elsevier 231:111199. https://doi.org/10.1016/J.RSE.2019.05.018
Sun B, Chen X, Zhou Q (2016) Uncertainty assessment of Globeland30 land cover data set over Central Asia. Int Arch Photogramm Remote Sens Spatial Inf Sci. Copernicus GmbH XLI-B8:1313–1317. https://doi.org/10.5194/ISPRS-ARCHIVES-XLI-B8-1313-2016
Tsendbazar NE et al (2018) Developing and applying a multi-purpose land cover validation dataset for Africa. Remote Sens Environ. Elsevier 219:298–309. https://doi.org/10.1016/J.RSE.2018.10.025
Wagner JE, Stehman SV (2015) Optimizing sample size allocation to strata for estimating area and map accuracy. Remote Sens Environ. Elsevier 168:126–133. https://doi.org/10.1016/J.RSE.2015.06.027
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
The authors were compliant with the ethical standards.
Consent to Participate
All authors actively participated in the writing and reviewing of the manuscript.
Consent for Publication
All authors are aware of this submission.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chaaban, F., El Khattabi, J. & Darwishe, H. Accuracy Assessment of ESA WorldCover 2020 and ESRI 2020 Land Cover Maps for a Region in Syria. J geovis spat anal 6, 31 (2022). https://doi.org/10.1007/s41651-022-00126-w
Accepted:
Published:
DOI: https://doi.org/10.1007/s41651-022-00126-w