An Evaluation System for the Conservation of Geomorphological Assets: Landforms in South Korea

Landforms are spaces for human life, habitats for animals and plants, and areas that provide various ecological services. However, human development has undermined landform where it should be kept as an important human asset. In South Korea, to reduce this damage, a system was created to evaluate the conservation value of landforms, and either designate them as conservation areas or obtain permission for their development in advance. However, the general public, who demands the development of landforms continuously, have frequently questioned the subjectivity of the evaluation criteria used for the conservation of landforms. National Institute of Ecology (NIE) in South Korea was carried out a project which was to increase the reliability of these criteria by modifying the conservation evaluation system into a quantitative system. This paper aims to introduce the geomorphological survey as a part of the Investigation of National Environment (INE), and an improved evaluation system via the Delphi, the Analytic Hierarchy Process (AHP), on-site verification, etc. As a result of this quantitative evaluation using detailed scoring indicators, specific criteria, and weights for evaluation, there is a low correlation between the indicators, and this confirmed that each indicator was evaluated correctly. In addition, as the quantitative evaluation results and the experts’ opinions generally coincided with the final evaluation grades and values, this indirectly confirmed that the experts who participated in the 4th INE agreed with the evaluation results. This research demonstrates a method that can be used to improve the objective assessment of landforms by experts’ opinion surveys. Future research could use the assessment system developed in this research and apply it to other surveys or countries.


Introduction
Assessments of geomorphological features are carried out to evaluate and mitigate the environmental effects of development or to designate areas with geomorphological and geological assets as conservation areas. One such evaluation is the environmental impact assessment (EIA), which has been adopted in many countries; the geomorphology in the EIA is concerned with natural disasters, in natural environments and landmark countries (Cavallin et al. 1994). Other assessments address conservation areas such as world heritage and geoparks (Eder 1999;Reis and Henriques 2009;Henriques and Brilha 2017), or geological heritage issues related to intrinsic, cultural and aesthetic, economic, research, educational, and functional values (Gray 2004). Although outstanding geomorphological assets and landscapes should be conserved, some are destroyed because they are developed before they can be converted into a conservation area.
The content of the evaluation of geomorphological features at the universal scale may differ in each country because the content reflects the national status and legal regulations. As a result, geological heritage areas are irregularly protected globally (Reis and Henriques 2009). National conserved areas are classified as protected areas (PA) and key biodiversity areas (KBAs) by IUCN, and natural world heritage sites (NWH), biosphere reserves (BR), and geoparks by UNESCO. The current guidelines from these organizations define the categories of protected areas and their characteristics (Dudley 2008;UNESCO 2013UNESCO , 2015. The guidelines present several categories as global standards, and the review process is performed by advisory committee meetings and expert field inspections. Generally, the review process is conducted through qualitative evaluations, but in some protected areas such as KBAs and geoparks, the processes are conducted using quantitative methods according to global standard criteria (IUCN 2016) and self-evaluation forms (UNESCO 2014). Standard criteria for designating globally recognized conservation areas are broad and comparative because the criteria are universally applied. Generally, the review process is conducted through qualitative evaluations, but in some protected areas such as KBAs and geoparks, the processes are conducted using quantitative methods according to global standard criteria (IUCN 2016) and self-evaluation forms (UNESCO 2014). Standard criteria for designating globally recognized conservation areas are broad and comparative because the criteria are universally applied. Geodiversity is an element that composes natural diversity and means diversity of abiotic elements. It can be defined as geological heritage, geomorphological heritage, or palaeontological heritage, in reality. The major purpose of each heritage is geoconservation, which leads to the stages of inventory, evaluation, conservation, and monitoring (Brilha 2016). For the inventory and evaluation of geoheritages, it is important to clarify what their purpose is. This is because the evaluation method can be different depending on the purpose of the inventory (Brilha 2016). In the next step, an assessment frame can be developed by selecting an assessment indicators and elements appropriate for the purpose. An important element in the assessment frame is to select the elements and criteria for evaluation. Many research have introduced the criteria in each study; however, the criteria and parameters used in the methods are often unclear and ambiguous (Mucivuna et al. 2019).
In South Korea, there are two inventory projects related to geoheritage. One is geological heritage, and the geosite is discovered and evaluated, and the sites are designated as geopark. The primary purpose of geopark is to preserve geoheritage, but it is promoting geoheritage through application to the tourism industry. Another inventory is geomorphological heritage, and its final goal is to designate it as a conservation area to prevent damage to excellent geographic resources due to development. In evaluating the target site of geoheritage and geomorphological heritage, criteria for evaluating scientific values overlap. The evaluation methods of the two heritages share evaluation indicators such as representativeness, scarcity, diversity, reproducibility, specificity, and scale, but they have evaluation items appropriate for the purpose of each project. For example, the evaluation of geomorphical resources focuses on the scientific value to evaluate its intrinsic value and investigate its attributes. On the other hand, in the evaluation of geological resources, in addition to the scientific value, ancillary values such as accessibility, convenience, and protection facilities are also evaluated (Korea National Park Service [KNPS] 2014). Therefore, an assessment frame suitable for each purpose should be studied.
The Investigation of National Environment (INE) for the conservation of the natural environment has occurred every 5 years as required by article 30 of the National Environmental Conservation Act since 1987. The last investigation, which was the fourth investigation, was completed in 2018, and the fifth investigation began in 2019. One of the survey's goals is to investigate "the peculiarity of geomorphological features, geological features, and natural scenery" and evaluate the value for conservation (Ministry of Environment [MOE] 2010). The same act established the Ecological and Nature Map, which is generated by the survey results and has three graded zones and a separately managed zone. The three graded zones are based on the natural characteristics and value of topographic features. The separately managed zones are conserved areas pursuant to the provisions of another act. In addition, the map is utilized for comprehensive planning regarding the national environment, environmental impact assessments, and development plans.
The graded zones of the topographical features are evaluated by eight indicators that include representativeness, scarcity, specificity, reproduction, academic, and educational value. The evaluation used qualitative methods in the third investigation (Seo 2005;Yun and Shin 2015); however, the evaluation had several problems, including subjectivity and differences in the results between the investigators because of unclear and ambiguous criteria. Therefore, it suggested that a quantitative evaluation was necessary (Yun and Shin 2015). In 2015, the MOE and NIE carried out a joint project to improve the evaluation criteria with South Korean geomorphologists, and the developed evaluation was utilized in the 4th INE (Kang and Lee 2015).
The purposes of this research are to introduce a revised evaluation system for the conservation of topographical features in South Korea and to verify the effectiveness of the new system introduced in the 4th INE using the results of the INE performed by previous and developed systems. The aim is to also deliberate on the evaluation system's potential application to other surveys or countries with similar circumstances.

Data Collection
The 4th INE began in 2014, took 5 years, and ended in 2018. The INE is composed of various environmental sections, such as geomorphological, vegetation, flora, and fauna survey. Of them, the geomorphological component investigates approximately 10,000 geomorphological units by surveying 180 teams over 5 years. The geomorphological survey aims to search for new landforms distributed throughout the country, describe the characteristics of the landform according to the INE guidelines, and evaluate the value and conservation grades of the landform.
The geomorphological units are classified into five categories, mountain, stream, coastal, karst, and volcanic, to reflect the topography of South Korea. Two categories within the five categories are considered erosion/weathering and sedimentary landforms. Finally, the geomorphological units are divided into a total of 113 landform units. For example, mountainous sedimentary landforms are classified into patterned ground, block stream, block field, talus, and mountain wetlands. The surveyed terrain is recorded along with the terrains' name, location, boundary, evaluation result, description, and photographs. The revised assessment system was conducted over 3 years, 2016-2018, and a total of 5635 terrains were surveyed. Of these, 2936 terrains were surveyed in the 3rd INE and reexamined in the 4th INE, along with 2699 newly surveyed terrains. In this research, the 2936 terrains' data were analyzed to discuss the improvement effects. Several parts of the data that could not be used to compare the results from the 3rd and 4th INE were removed, and subsequently, 2656, 92, and 94 s-, third-, and fourth-grade terrains, respectively, were used.

Data Analysis
The re-evaluated terrains were analyzed to verify the effectiveness of the developed assessment system. For the statistical analysis, the third survey results, which consisted of high, medium, and low grades, were scored with a 3-2-1, and then compared with the fourth survey results. The paired t-test was used to confirm the statistical significance of the change in the third and fourth conservation grades, and SPSS 12.0 was used for this comparison. The paired t-test is an appropriate method as it verifies the average difference between two sets of data after data collection and before and after the experimental treatment of the same sample.
Previous research on the 3rd INE (Yun and Shin 2015) has analyzed the correlation between the evaluation indicators and demonstrated that the indicators could be duplicated because the definition of the indicators and criteria was not clear. Therefore, in order to analyze the independent variables among the evaluation indicators in the improved evaluation system, a correlation analysis between the evaluation indicators was conducted using the results from the 4th INE.

Previous Evaluation System
The South Korean geomorphological survey of the INE began with the second survey (1997). The survey was conducted by setting up a survey section within an index dividing South Korea into a regular grid, and the geomorphological units were then classified and evaluated by geomorphologists. No evaluation criteria were included in this process. From the third survey, the values of the geomorphological units were evaluated using the following eight indicators set by the MOE: -Representativeness: highly assessed if the setting, processes, characteristics, and shapes of the geomorphological units are typically well represented. -Scarcity: highly assessed if it demonstrates less frequent geomorphological units, such as dunes and wetlands in high elevation, fewer local occurrences, and relative scarcity according to regional characteristics. -Specificity: highly assessed if it is associated with unusual natural phenomena (geyser, wind-holes, etc.). -Impossibility of reproduction: highly assessed if there is a greater probability of change in the natural or artificial environment, and is less likely to be reshaped in the current environment. -Academic and educational values: highly assessed if it is an object of research and natural education. -Naturalness: highly assessed if it is well preserved in its natural state, and less artificial damage or changes are present. -Diversity: highly assessed if the same units are distributed in clusters, or various units are formed in the same area. -Scale: highly assessed if it is larger than most geomorphological units of its type.
The pre-evaluations divided the value of the geomorphological unit into "high, medium, and low" according to the above method, and a rating according to the number of high and medium grades. For example, if a unit received seven or more high grades, the value became grade I. Also, if it got five or six high grades, then the value became grade II.
However, the pre-evaluation system is problematic, as confusion may occur when assigning value according to the number of high and medium grades, and raising the grade according to the number of middle grade (Yun and Shin 2015). In order to solve this problem, Yun and Shin proposed a method of evaluating the scores without using high-medium-low. They suggested that detailed evaluation guidelines for each indicator should be prepared to avoid mistakes due to the unspecified definitions and criteria, and weight should be set in consideration of the relative importance of the indicator. Most importantly, they emphasized the need for discussion and consultation with geomorphologist in all of these processes.

Method and Process for Developing the System
This research used the Delphi and AHP to develop the evaluation system for the conservation grade of geomorphological units. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback (Skulmoski et al. 2007). The previous eight indicators posed problems for experts evaluating geomorphological assets subjectively because of broad and uncertain indicator definitions. Therefore, the first step toward revising the system was the creation of sub-items.
An expanded sub-item was selected based on the eight indicators set by the MOE (the initial item of Table 1). To select the best items among the expanded sub-items, questionnaire surveys were conducted twice with 31 geomorphology experts who had experience with the national environmental survey. Twenty-one surveyed experts responded.
In the first survey, the appropriateness of the initial items was ranked using a Likert-7-point scale with open/closed questions, and personal opinions on the items were also included. Expert responses were analyzed with statistical methods such as the mean, standard deviation, and content validity ratio (CVR), and then the initial item was revised with the statistical results and expert opinions. In the second questionnaire, the revised items and statistical analysis results were provided to the 21 experts, and the importance of each item was evaluated again in the same way. The second questionnaire responses were analyzed for increasing consensus, decreasing convergence, and increasing tendency with the first questionnaire responses. Finally, detailed evaluation indexes were extracted (Table 1, final item).
In the next step, the weighted values were calculated using the AHP because each item might have different weights to evaluate. AHP needs hierarchy for analyzing, the top-level set the evaluation of the geomorphological assets, and the intermediate level was eight indicators. The lowest level was 13 final items selected through the Delphi analysis.
When experts evaluate criteria, they weigh individual targets differently. Therefore, the second step analyzed the weight for each sub-item through the AHP analysis. The AHP is a theory of measurement through pairwise comparisons and relies on the judgments of experts to derive a priority scale (Saaty 2008). To make the pairwise comparisons, this study used a 1-9 scale (1: equally important; 3: slightly important; 5: essential or very important; 7: definitely important; and 9: absolutely important). The AHP survey selected 22 experts who participated in the Delphi survey and geomorphologists who had not participated in the Delphi survey but had taken part in the field survey. The AHP analysis was conducted by calculating pairwise comparison matrices as the geometric mean. For the final result, the consistency index (CI) was calculated and the logical consistency was evaluated. More detailed information on the above process can be found in Kang and Lee's (2015) previous study.
Verifying the ratings on-site is essential for these improved assessment criteria. For verification, we carried out field surveys with two or three experts on 50 geomorphological units in five categories (mountain, stream, coastal, karst, volcanic topography). If there were differences between the experts' results, they were revised through discussion.

Developed Evaluation System
The improved assessment criteria are as follows (Appendix 1 and Table 2): Eight indicators (scarcity, specificity, representativeness, academic educational value, naturalness, diversity, irreproducibility, scale) and 13 sub-items (frequency, pattern, differentiation, typicality, regional representativeness, academic value, educational value, conservation, landscape diversity, components, natural history, sensitivity, size) were established. The sub-items were divided into three scores, and evaluation criteria are presented in Appendix 1. In the field, the characteristics of the geomorphological unit are investigated according to the format of Appendices 2 and 3 , and the value of each indicator is evaluated based on the information. When the weight is reflected in this result, the topographic value grade is derived.
The weight for each sub-item is illustrated in Table 2. The total score is obtained by summarizing the evaluation items, criteria, and weights as follows: where I = score of evaluation item, W = weight of each item, and n = number of evaluation item.
The total score should determine its inclusion on the ecological and natural map. In this step, the score distribution for each grade was set by comparing the pre-assessment system, field verification results, and score distribution simulation using the results of 3rd INE. The total score from Eq. 1 was from 10 to 30 points, and grades I, II, III, and IV should be within 10-30 points. The previous evaluation system is an equal division method according to the number of high scores. If that method was applied by totaling the 3-2-1 scores, there would be 25 or more points for grade I, 20-24 for grade II, 15-19 for grade III, and 10-14 for grade IV.
Therefore, the score between grades I and II is divided by 25 points. The score from the on-site verification had a distribution of 17.88-30 points for grade I, 14.1-25.12 points for  Figure 1 illustrates the distribution of the total scores according to the grade. The score distributions of grades I and IV are different, but there are overlapping segments in grades II and III. Therefore, the overlapping segment should be randomly classified between grades II and III. A simulation result of the total score distribution is the normal distribution of median 20, with the first quartile (25%) at 18.3 and the third quartile (75%) at 21.7, and 50% of the total results are within 18.3-21.7 points. The most important aspect of the classification is the demarcation between grades I and II. This demarcation was set to 25 points, reflecting the numerical results such as 25 points in the equal division and 25.12 or more in the on-site verification results and the experts' opinions. Additionally, according to Eq. 2 below, y is more than 25 points for grade I, more than 20.8 and less than 25 for grade II, more than 15.2 and less than 20.8 for grade III, and less than 15.2 for grade IV.
where x = total score from Eq. 1 and y = transformed score.

Topography Survey on the 4th INE Survey
The 2842 geomorphological features reinvestigated were composed of 1023 stream landforms, 918 coastal landforms, 719 mountain landforms, 41 karst landforms, 112 volcanic landforms, and 29 others features. Figure 2 illustrates the distribution of the total score and weighted values of the 4th INE, which was completed using the improved assessment system. Figure 2a illustrates the distribution of the total scores between 13 and 38 points. The mode value is 28, and the next values are 30 and 32 points in order. When each item is multiplied by the weight, the distribution of the value changes, as illustrated in Fig. 2b. After weighting, the theoretical score distribution changes to 10-30 points, and the distribution of the surveyed values is confirmed to be a minimum of 10 and a maximum of 29.7. The mode was 22 points, which included 377 terrains. As the weight is applied, the graph moves to the left, and as the interval decreases, the frequency of the specific value increases.
The 4th INE total scores had 142 grade I, 1454 grade II, 927 grade III, and 319 grade IV landforms. Among them, 7 landforms were included in grade I and 39 landforms in grade II; 1.6% of the total landforms were upgraded from a lower grade by the expert opinions. Figure 3 illustrates the change of grade from the third survey. Approximately 52.6% of the landforms that were grade II in the 3rd INE remained unchanged. However, 42.5% of the landforms (2) y = 3.6x Among the 182 upgraded landforms, coastal landforms were the highest rate, making up 47% of the total, followed by mountain and stream landforms. Stream landforms were downgraded at the highest rate of 42%, followed by coastal and mountain landforms at 29% and 27%, respectively (Fig. 4). Both coastal and river landforms experienced many grade changes in either direction.

Average and Correlation Analyses of the Indicators
The averages of each sub-indicator of the 3rd and 4th INE were compared to verify the changes before and after the improved evaluation system. As a result, the average of each sub-indicator of the 4th survey decreased compared to the  Fig. 3 The number of upgrade and downgrade geomorphological features between 3rd and 4th INE surveys, and the distribution the features 3rd survey, and statistically significant changes were confirmed. This means that the re-evaluated landforms were generally downgraded compared to the previous assessment, as illustrated in the results in "Topography Survey on the 4th INE Survey." Table 3 illustrates the results of the paired sample t-test according to the divided groups, as upgrade or downgrade. When analyzing the changes in the average by group with upgraded landforms, the averages of  the typicality, frequency, pattern, differentiation, sensitivity, natural history, conservation, component diversity, and scale are higher than those of the 3rd survey. Among the indicators, there were statistically significant changes for differentiation, sensitivity, conservation, and scale. For regional representation and academic value, although the grade was raised, there was a significant decrease in the average. In the downgraded landform group, there was a significant decrease in all of the sub-indicators. As a result of the correlation analysis of the sub-indicators, statistically significant correlations were analyzed in all of the items except the regional representative-sensitive and frequency-components, as illustrated in Table 4. The highest correlation was the academic-educational value, with a correlation of 0.560, and the frequency-pattern also showed a relatively high correlation of 0.404. The high correlation results are reasonable because landforms with high research value may be used academically to produce various research results. Frequency and pattern also have a high correlation because landforms concentrated or distributed in a specific pattern have a relatively low distribution frequency. However, in these two cases, the high correlation means that there is a possibility of a double evaluation in the system. The other indicators showed significant correlation coefficients, but most of them showed low correlations below 0.4.

Implication of the Developed Assessment System
The improvement of the evaluation system has an impact on the internal and external aspects of the evaluation system. It is necessary to discuss whether the problems in the previous evaluation system have been solved in the revised assessment system. Externally, it is about whether the quantitative evaluation is necessary not only in Korea but also in other researches and regions.
As mentioned in the introduction, in the previous evaluation system, the evaluation was not accurately evaluated because the definition of the evaluation items was ambiguous. As a result, there was a problem that the correlation between several items was increased (Yun and Shin 2015). To solve this problem, the developed assessment system subdivided the items. As the results demonstrated, it is possible to confirm that the correlation between the indicators is lowered through increasing the independence of each indicator by defining detailed sub-indicators. In particular, experts who participated in the survey to develop this assessment system also participate in INE at the same time. Therefore, the participants understand the definition of each indicator. In addition, the weight of each item was calculated. The weight of Table 4 The result of correlation analysis between sub-indicators by Spearman's rho method **p < 0.01, *p < 0.05 1: regional representativeness; 2: typicality; 3: frequency; 4: pattern; 5: differentiation; 6: sensitivity; 7: natural history; 8: academic value; 9: educational value; 10: conservation; 11: components, 12: landscape diversity; 13: size the evaluation indicators changes its contribution to the results according to the importance of the evaluation indicators. According to the weighted results, scarcity, specificity, and representativeness were the most important factors in evaluating the conservation grade of the landform. This allocates a higher score to unique landforms than general spaces because the purpose of the geomorphological survey in South Korea is to preserve landforms. However, the weighted results are not permanent. As they should be recalculated periodically as the natural environment, perspectives, and academic issues change, the focal points of each expert in evaluating the landform can change. The previous evaluation system was a method of judging the grade of terrains based on the opinion of experts according to the definition of evaluation indicators. This approach relies on the experts' knowledge and judgment, and it is inevitably affected by the subjectivity of the investigator; experts may assess different results for the same landforms. This subjectivity prompted researchers to consider whether scored criteria or universal assessment methods for evaluating conservation areas were necessary. Therefore, various methods have been proposed to improve the objective criteria and develop an absolute evaluation system (Sowińska-Świerkosz 2017). Many researchers have recently provided indicators for qualitative and quantitative assessments for natural and cultural heritage, landscapes, tourism sustainability, and ecosystem services. The revised assessment system of INE is also following the academic flow of references. Quantitative assessment system provides criteria for evaluation scores. Therefore, it is possible to reduce the deviation of assessment results among experts. In addition, the experts can provide evidence for evaluation results. Therefore, conflicts between stakeholders due to reliability issues are expected to decrease. However, the revised assessment system also needs to be supplemented. Several researches have demonstrated the trends in widely recognized social and economic indicators as well as evaluation indicators of spaces (Sowińska-Świerkosz 2017). However, the purpose of improving assessment system was to clarify a definition and subdivide the previous items. Therefore, items on social and economic influences are not sufficient. Almost items focus on the assessment of the status of the geomorphological assets except academic and education value. However, a geomorphological survey and assessment of the conservation value of the topography would benefit from the inclusion of social or economic indicators. This is a limitation of the current system, and it is considered a point to be improved further in the future. If this evaluation system is used with other surveys or in other countries, it may be possible to add social, economic, and policy indicators depending on the characteristics of the terrain and the purpose of the survey.

Countermeasure for the Grade Changes
The comparison of the third and fourth survey results confirmed up-and downgrades in the landforms' conservation grades. The changes were caused by the natural changes of the landform, improvement of the detailed evaluation criteria and weighted scores, or a combination of both. For example, if the grade changed for mountain landforms, this does not change very much in the short term, and it can be classified as a change due to the improvement of the evaluation criteria. Some landforms were upgraded when the representativeness increased due to its designation as a protected area, geosite, or natural monument. On the other hand, the grade change in stream and coastal landforms can be understood by natural changes because these landforms can change in the short term. For example, sedimentary landforms such as tidal flats and coastal dunes have been verified as being upgraded by natural reconstruction resulting in increasing sediment volume and area over time. In this case, the scores of the preservation and the scale indicators increased, and at the same time, the academic and education values increased.
The lowered grades were found in many cases of terrain damaged by development. In South Korea, river projects were conducted between the third and fourth surveys, which resulted in a decrease in the naturalness of the streams or the simplification of various geomorphological units (Jeong 2009). In addition, coastal landforms still exposed to high development pressures (Kang et al. 2017). Therefore, these landforms were relatively lower grades due to direct damage by development or indirect changes by various facilities. In other case, the geomorphological units such as talus, tor, marine, and river terraces, which were frequently surveyed in the 3rd INE, were continuously distributed, so their grades were lowered due to their scale and scarcity scores.
The results of the INE by the MOE are used as references in other surveys, and when establishing environmental policies and plans. Depending on the grade, sites can be designated as an ecological landscape conservation area after a thorough, specific investigation has been conducted. In addition, the results reflected in the ecological and natural maps are mandatory for environmental impact assessments, and the surveyed data is shared with the geopark secretariat for geosite discovery in South Korea. Therefore, the high-grade landforms are designated as a conservation area or for conservation activities based on various systems, but if landform grades are lowered, the institutional basis for landform conservation is diminished, which may accelerate development. Fortunately, to prevent these problems, the INE and ecological and natural maps complement these problems at an upper level. Various conservation grades with vegetation and endangered species are marked on the map. The conservation value is recognized as a habitat for the animals and plants living there even if the landform itself or the landscape value is reduced. Therefore, if the survey system is used in other surveys, the value of the landform itself and other values such as social, economic, environmental, and ecological values are considered and evaluated together.

Conclusions
This paper introduced an evaluation system and improvement process of the landform conservation evaluation performed as part of the topographic survey of South Korea's natural environment survey. In addition, the implications and applicability of the improved evaluation system were discussed through the application results of the 4th INE.
To improve the clarity and quantitative assessment of the landform evaluation system, the evaluation indicators, criteria, and weight of each indicator were set using the geomorphologists' survey. Although the indicators followed those from the previous assessment system, the definition of each indicator was clarified and the weights were set for each to arrive at the evaluation results for the INE. As the weighting is an index that reflects the experts' perception of the importance of geomorphological resources, it is meaningful as a topic for future geomorphological research. In addition, as the sub-indicators and weights are not permanent, they will be continuously improved to reflect the current situation in accordance with the objectives, and the sub-indicators and weights can be changed according to the topography of any country.
As a result of applying the improved evaluation system, the downtrend of the conservation grades was verified. The qualitative assessment evaluated as a relative high grades, while quantitative assessments are likely to be downgraded based upon the results from the 3rd and 4th INE. Geomorphological assets can be reduced with a strict quantitative evaluation; however, various values, including the ecological value as well as the value of the landform itself, can be combined and complemented. Downgrades can be considered positive as they reduce socio-economic losses in terms of reducing civil complaints and protecting private property rights.
Landforms are spaces where various stakeholders, including the people who live, use, and enjoy the space, are intertwined with the various animals and plants living in the space. As demonstrated, a single evaluation system does not meet the needs of these various stakeholders. Therefore, it is considered necessary to evaluate various aspects other than the evaluation of the scientific and spatial phenomena of the geomorphological assets (Table 5). (2) Geomorphological unit that is not designated as a specific area, but is expressed in topographic maps, sightseeing maps, signs 2 (3) Other than (1), (2) 1 Typicality Typicality of geomorphological process and form (1) Geomorphological unit that shows typicality of geomorphological process and form 3 0.9 (2) Geomorphological unit that shows typicality of either geomorphological process or form 2 (3) Unknown cause and form of formation 1 Appendix 1 (2) Geomorphological unit is rare in the survey map compared to the national distribution 2 (3) Universal distribution 1 Pattern Distribution pattern (1) Geomorphological unit that is concentrated or covered by the distribution characteristics of the tectonic, geology, and soil is localized to a specific region 3 1.2 (2) Geomorphological unit such as (1) appears in several places 2 (3) Geomorphological unit distributes without any unique pattern 1 Specificity Differentiation Specificity of landform, process, component materials (1) Geomorphological unit that has a specificity of both geometry and constituent materials (geology, soil, etc.) 3 1.6 (2) Geomorphological unit that has a specificity of either geometry or constituent materials (geology, soil, etc.)

2
(3) Other than (1), (2) 1 Impossibility of reproduction Sensitivity Easily changed by climate, processes, etc (1) Geomorphological unit can be rapidly removed due to external factors, and cannot be restored to natural (or artificial) processes 3 0.4 (2) Geomorphological unit can be rapidly removed due to external factors but can be restored by natural ( Level of study area use (1) Studies have been actively carried out, and academic results have been actively researched as a study subject or a case study area 3 0.7 (2) Geomorphological unit that has the potential of geomorphological research 2 (3) Other than (1), (2) 1 Educational value Visiting for field study, educational tourism (1) Geomorphological unit frequently mentioned in texts, lectures, etc 3 0.6 (2) Geomorphological unit that is likely to be used as an educational place 2 (3) Geomorphological unit that is unlikely to be used as an educational place 1 Naturalness Conservation Degree of damage to geomorphology and designating conservation sites (1) Geomorphological unit is set to a specific conservation area or is well preserved within the boundary without damage 3 0.9 (2) 60% -80% of the area within the boundary of the geomorphological unit is preserved 2 (3) Less than 60% of the area within the boundary of the geomorphological unit is preserved (2) Any of the measured long axis, short axis, or remarks are larger than average for geomorphological units 2 (3) The measured long axis, short axis, and height are smaller than average for geomorphological units 1 Notice Points to the total score can be added by other items and content that are not considered in the above items but considered important by the judgment of experts. For example, when the terrain is related to unusual natural phenomena, and the identification of specific motifs and plants Table 5 (continued)