Abstract
Machine learning algorithms, including supervised and unsupervised learning ones, have been widely used in mineral prospectivity mapping. Supervised learning algorithms require the use of numerous known mineral deposits to ensure the reliability of the training results. Unsupervised learning algorithms can be applied to areas with rare or no known deposits. Reinforcement learning (RL) is a type of machine learning algorithm that differs from supervised and unsupervised learning models in that the learning process is performed interactively by the agent and environment. The environment feeds the agent with reward signals and states, and the agent synthetically evaluates the mineralization potential of each state based on these rewards. In this study, a deep RL framework was constructed for mineral prospectivity mapping, and a case study for mapping gold prospectivity in northwest Hubei Province, China, was used to test the framework. The deep RL agent extracted the information of known mineralization by automatically interacting with the environment while simultaneously mining potential mineralization information from the unlabeled dataset. Its comparison with random forest and isolation forest models demonstrates that deep RL performs better regardless of the number of known mineral deposits because of its unique reward and feedback mechanism. The delineated high-potential areas show a strong spatial correlation with known gold deposits and can therefore provide significant clues for future prospecting in the study area.
Similar content being viewed by others
References
Abedi M, Norouzi GH, Torabi SA (2013) Clustering of mineral prospectivity area as an unsupervised classification approach to explore copper deposit. Arab J Geosci 6:3601–3613. https://doi.org/10.1007/s12517-012-0615-5
Aitchison J (1986) The statistical analysis of compositional data. Springer, Berlin. https://doi.org/10.1007/978-94-009-4109-0
Bellman R (1957) A Markovian decision process. J Math Mech 6:679–684. https://doi.org/10.1512/iumj.1957.6.56038
Bohez S, Verbelen T, De Coninck E, Vankeirsbilck B, Simoens P, Dhoedt B (2017) Sensor fusion for robot control through deep reinforcement learning. In: IEEE international conference on intelligent robots and systems, pp 2365–2370. https://doi.org/10.1109/iros.2017.8206048
Cai Q, Cui C, Xiong Y, Wang W, Xie Z, Zhang M (2022) A survey on deep reinforcement learning for data processing and analytics. In: IEEE transactions on knowledge and data engineering. https://doi.org/10.1109/TKDE.2022.3155196
Cao H, Zhang S, Santosh M, Zheng L, Tang L, Li D, Zhang X, Zhang Y (2015) The Luanchuan Mo–W–Pb–Zn–Ag magmatic–hydrothermal system in the east Qinling metallogenic belt, China: constrains on metallogenesis from C–H–O–S–Pb isotope compositions and Rb–Sr isochron ages. J Asian Earth Sci 111:751–780. https://doi.org/10.1016/j.jseaes.2015.06.005
Carranza EJM (2008) Geochemical anomaly and mineral prospectivity mapping in GIS. In: Hale M (ed) Handbook of exploration and environmental geochemistry, pp 3–351. https://doi.org/10.1016/s0168-6275(08)x0001-7
Carranza EJM (2011) Analysis and mapping of geochemical anomalies using logratio-transformed stream sediment data with censored values. J Geochem Explor 110:167–185. https://doi.org/10.1016/j.gexplo.2011.05.007
Carranza EJM, Hale M, Faassen C (2008) Selection of coherent deposit-type locations and their application in data-driven mineral prospectivity mapping. Ore Geol Rev 33:536–558. https://doi.org/10.1016/j.oregeorev.2007.07.001
Chen Y (1996) Fluidization model for intracontinental collision and its metallogenic significance: theoretical inference and evidences from gold deposits, the eastern Qinling mountains. Earth Sci Front 3:123–130. (in Chinese with English abstract)
Chen Y (1998) Fluidization model for continental collision in special reference to study ore-forming fluid of gold deposits in the eastern Qinling mountains, China. Prog Nat Sci 8:385–393
Chen Y (2006) Orogenic-type deposits and their metallogenic model and exploration potential. Geol China 33:1181–1196. https://doi.org/10.3969/j.issn.1000-3657.2006.06.001. (in Chinese with English abstract)
Chen Y (2010) Indosinian tectonic setting, magmatism and metallogenesis in Qinling orogen, central China. Geol China 37:854–865. https://doi.org/10.3969/j.issn.1000-3657.2010.04.003. (in Chinese with English abstract)
Chen Y (2015) Mineral potential mapping with a restricted Boltzmann machine. Ore Geol Rev 71:749–760. https://doi.org/10.1016/j.oregeorev.2014.08.012
Chen Y, Santosh M (2014) Triassic tectonics and mineral systems in the Qinling orogen, central China. Geol J 49:338–358. https://doi.org/10.1002/gj.2618
Chen Y, Wu W (2019) Isolation forest as an alternative data-driven mineral prospectivity mapping method with a higher data-processing efficiency. Nat Resour Res 28:31–46. https://doi.org/10.1007/s11053-018-9375-6
Chen C, Dai H, Liu Y, He B (2011) Mineral prospectivity mapping integrating multi-source geology spatial data sets and logistic regression modelling. In: Proceedings 2011 IEEE international conference on spatial data mining and geographical knowledge services, Fuzhou, China, pp 214–217. https://doi.org/10.1109/ICSDM.2011.5969034
Cheng Q (2007) Mapping singularities with stream sediment geochemical data for prediction of undiscovered mineral deposits in Gejiu, Yunnan Province, China. Ore Geol Rev 32:314–324. https://doi.org/10.1016/j.oregeorev.2006.10.002
Cheng Q (2012) Singularity theory and methods for mapping geochemical anomalies caused by buried sources and for predicting undiscovered mineral deposits in covered areas. J Geochem Explor 122:55–70. https://doi.org/10.1016/j.gexplo.2012.07.007
Deng J, Wang Q (2016) Gold mineralization in China: metallogenic provinces, deposit types and tectonic framework. Gondwana Res 36:219–274. https://doi.org/10.1016/j.gr.2015.10.003
Dong Y, Zhang G, Neubauer F, Liu X, Genser J, Hauzenberger C (2011) Tectonic evolution of the Qinling orogen, China: review and synthesis. J Asian Earth Sci 41:213–237. https://doi.org/10.1016/j.jseaes.2011.03.002
Dong H, Ding Z, Zhang S (2020) Deep reinforcement learning: fundamentals, research and applications. Springer, Singapore. https://doi.org/10.1007/978-981-15-4095-0
Dong J, Chen S, Li Y, Du R, Steinfeld A, Labi S (2021) Space-weighted information fusion using deep reinforcement learning: the context of tactical control of lane-changing autonomous vehicles and connectivity range assessment. Transp Res C Emerg Technol 128:103192. https://doi.org/10.1016/j.trc.2021.103192
Erharter GH, Hansen TF, Liu Z, Marcher T (2021) Reinforcement learning based process optimization and strategy development in conventional tunneling. Autom Constr 127:103701. https://doi.org/10.1016/j.autcon.2021.103701
Feng J, Li D, Gu J, Cao X, Shang R, Zhang X, Jiao L (2022) Deep reinforcement learning for semisupervised hyperspectral band selection. IEEE Trans Geosci Remote Sens 60:1–19. https://doi.org/10.1109/TGRS.2021.3049372
Filzmoser P, Hron K, Reimann C (2009a) Univariate statistical analysis of environmental (compositional) data: problems and possibilities. Sci Total Environ 407:6100–6108. https://doi.org/10.1016/j.scitotenv.2009.08.008
Filzmoser P, Hron K, Reimann C (2009b) Principal component analysis for compositional data with outliers. Environmetrics 20:621–632. https://doi.org/10.1002/env.966
Filzmoser P, Hron K, Reimann C (2010) The bivariate statistical analysis of environmental (compositional) data. Sci Total Environ 408:4230–4238. https://doi.org/10.1016/j.scitotenv.2010.05.011
Filzmoser P, Hron K, Reimann C (2012) Interpretation of multivariate outliers for compositional data. Comput Geosci 39:77–85. https://doi.org/10.1016/j.cageo.2011.06.014
Gao Y, Zhang Z, Xiong Y, Zuo R (2016) Mapping mineral prospectivity for Cu polymetallic mineralization in southwest Fujian Province, China. Ore Geol Rev 75:16–28. https://doi.org/10.1016/j.oregeorev.2015.12.005
Goodchild MF (1986) Spatial autocorrelation. Geo Books
Groves DI, Goldfarb RJ, Gebre-Mariam M, Hagemann SG, Robert F (1998) Orogenic gold deposits: a proposed classification in the context of their crustal distribution and relationship to other gold deposit types. Ore Geol Rev 13:7–27. https://doi.org/10.1016/S0169-1368(97)00012-7
Groves DI, Santosh M, Deng J, Wang Q, Yang L, Zhang L (2020) A holistic model for the origin of orogenic gold deposits and its implications for exploration. Miner Deposita 55:275–292. https://doi.org/10.1007/s00126-019-00877-5
Guo J, Liu Q, Chen E (2022) A deep reinforcement learning method for multimodal data fusion in action recognition. IEEE Signal Process Lett 29:120–124. https://doi.org/10.1109/LSP.2021.3128379
Jia S (2015) Genesis study of Liudou gold deposit and Yindonggou silver-polymetallic deposit in western Wudang area (Ph.D. dissertation). Beijing (in Chinese with English abstract)
Koike K, Matsuda S, Suzuki T, Ohmi M (2002) Neural network-based estimation of principal metal contents in the Hokuroku district, northern Japan, for exploring Kuroko-type deposits. Nat Resour Res 11:135–156. https://doi.org/10.1023/A:1015520204066
Lei S, Tang G, Zhang Z (1998) Characteristics of structurally controlling mineralization in the Yingdonggou silvergold deposit, Zhushan, northwest Hubei. Geoscience 12:81–86. (in Chinese with English abstract)
Li H, Misra S (2021) Reinforcement learning based automated history matching for improved hydrocarbon production forecast. Appl Energy 284:116311. https://doi.org/10.1016/j.apenergy.2020.116311
Li J, Zhang Y, Luo Y (2003) Geological-geochemical characteristics and genesis analysis of Xujiapo gold-silver deposit in northwest Hubei province. Geol Sci Technol Inf 22:75–79. https://doi.org/10.3969/j.issn.1000-7849.2003.04.014. (in Chinese with English abstract)
Li Y, Wei X, Gao F, Yu J, Zhang H (2008) Geological characteristics and ore-forming mechanism for the gently dipping ore bodies in Yindonggou Ag–Au deposits, Hubei Province. Geol Surv Res 31:6–11. https://doi.org/10.3969/j.issn.1672-4135.2008.01.002. (in Chinese with English abstract)
Li W, Zhou W, Chen S, Li Y, Deng X, Zhong R (2010) Geological characteristics of the Yindonggou silver deposit in Hubei Province and its implication for ore genesis. Earth Sci Front 17:177–185. (in Chinese with English abstract)
Li J, Zhang X, Li Y (2011) Geological characteristics and prospecting prognosis of Santianmen gold deposit in Yunxi county, Hubei Province. Resour Environ Eng 25:22–28. https://doi.org/10.3969/j.issn.1671-1211.2011.01.005. (in Chinese with English abstract)
Li T, Zuo R, Zhao X, Zhao K (2022) Mapping prospectivity for regolith-hosted REE deposits via convolutional neural network with generative adversarial network augmented data. Ore Geol Rev 142:104–693. https://doi.org/10.1016/j.oregeorev.2022.104693
Liu F, Ting K, Zhou Z (2012) Isolation-based anomaly detection. ACM Trans Knowl Discov Data 6:1–39. https://doi.org/10.1145/2133360.2133363
Liu Y, Carranza EJM, Xia Q (2022) Developments in quantitative assessment and modeling of mineral resource potential: an overview. Nat Resour Res. https://doi.org/10.1007/s11053-022-10075-2
Liu P, Zhang Y, Bao F, Yao X, Zhang C (2023) Multi-type data fusion framework based on deep reinforcement learning for algorithmic trading. Appl Intell 53:1683–1706. https://doi.org/10.1007/s10489-022-03321-w
Luo H, Xu H, Cai Z, Hu S, Luo X (2004) The lead isotopic characteristics and the origin of Shejiayuan silver deposit in Yunxi, Hubei. Resour Environ Eng 18:37–40. https://doi.org/10.3969/j.issn.1671-1211.2004.z1.006. (in Chinese with English abstract)
Mao J, Pirajno F, Xiang J, Gao J, Ye H, Li Y, Guo B (2011) Mesozoic molybdenum deposits in the east Qinling-Dabie orogenic belt: characteristics and tectonic settings. Ore Geol Rev 43:264–293. https://doi.org/10.1016/j.oregeorev.2011.07.009
Meng Q, Zhang G (2000) Geologic framework and tectonic evolution of the Qinling orogen, central China. Tectonophysics 323:183–196. https://doi.org/10.1016/S0040-1951(00)00106-2
Michel A, Gross W, Schenkel F, Middelmann W (2020) Hyperspectral band selection within a deep reinforcement learning framework. In: IGARSS 2020–2020 IEEE international geoscience and remote sensing symposium, pp 52–55. https://doi.org/10.1109/IGARSS39084.2020.9324338
Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing Atari with deep reinforcement learning. http://arxiv.org/abs/1312.5602
Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, Petersen S, Beattie C, Sadik A, Antonoglou I, King H, Kumaran D, Wierstra D, Legg S, Hassabis D (2015) Human-level control through deep reinforcement learning. Nature 518:529–533. https://doi.org/10.1038/nature14236
Mou L, Saha S, Hua Y, Bovolo F, Bruzzone L, Zhu X (2022) Deep reinforcement learning for band selection in hyperspectral image classification. IEEE Trans Geosci Remote Sens 60:1–14. https://doi.org/10.1109/TGRS.2021.3067096
Oh M, Iyengar G (2019) Sequential anomaly detection using inverse reinforcement learning. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1480–1490. https://doi.org/10.1145/3292500.3330932
Pang G, van den Hengel A, Shen C, Cao L (2021) Toward deep supervised anomaly detection: reinforcement learning from partially labeled anomaly data. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp 1298–1308. https://doi.org/10.1145/3447548.3467417
Parsa M, Maghsoudi A (2021) Assessing the effects of mineral systems-derived exploration targeting criteria for random forests-based predictive mapping of mineral prospectivity in Ahar-Arasbaran area, Iran. Ore Geol Rev 138:104399. https://doi.org/10.1016/j.oregeorev.2021.104399
Pathak D, Agrawal P, Efros AA, Darrell T (2017) Curiosity-driven exploration by self-supervised prediction. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), Honolulu, HI, USA, pp 488–489. https://doi.org/10.1109/CVPRW.2017.70
Porwal A, Carranza EJM (2015) Introduction to the special issue: GIS-based mineral potential modelling and geological data analyses for mineral exploration. Ore Geol Rev 71:477–483. https://doi.org/10.1016/j.oregeorev.2015.04.017
Porwal A, Carranza EJM, Hale M (2006) Bayesian network classifiers for mineral potential mapping. Comput Geosci 32:1–16. https://doi.org/10.1016/j.cageo.2005.03.018
Reimann C, Filzmoser P, Garrett RG, Dutter R (2008) Statistical data analysis explained. https://doi.org/10.1002/9780470987605
Reimann C, Filzmoser P, Fabian K, Hron K, Birke M, Demetriades A, Dinelli E, Ladenberger A (2012) The concept of compositional data analysis in practice—total major element concentrations in agricultural and grazing land soils of Europe. Sci Total Environ 426:196–210. https://doi.org/10.1016/j.scitotenv.2012.02.032
Rodriguez-Galiano VF, Chica-Olmo M, Chica-Rivas M (2014) Predictive modelling of gold potential with the integration of multisource information based on random forest: a case study on the Rodalquilar area, southern Spain. Int J Geogr Inf Sci 28:1336–1354. https://doi.org/10.1080/13658816.2014.885527
Saha P, Mukhopadhyay S (2020) Multispectral information fusion with reinforcement learning for object tracking in IoT edge devices. IEEE Sens J 20:4333–4344. https://doi.org/10.1109/JSEN.2019.2962834
Schaul T, Quan J, Antonoglou I, Silver D (2016) Prioritized experience replay. https://arxiv.org/abs/1511.05952
Schrittwieser J, Antonoglou I, Hubert T, Simonyan K, Sifre L, Schmitt S, Guez A, Lockhart E, Hassabis D, Graepel T, Lillicrap T, Silver D (2020) Mastering Atari, Go, chess and shogi by planning with a learned model. Nature 588:604–609. https://doi.org/10.1038/s41586-020-03051-4
Sheng Y, Tang L, Zhang S, Zhao Y, Santosh M, Li J, Hu X (2022) Distal gold mineralization associated with porphyry system: the case of Hongzhuang and Yuanling deposits, east Qinling, China. Ore Geol Rev 142:104–701. https://doi.org/10.1016/j.oregeorev.2022.104701
Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap T, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529:484–489. https://doi.org/10.1038/nature16961
Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A, Chen Y, Lillicrap T, Hui F, Sifre L, van den Driessche G, Graepel T, Hassabis D (2017) Mastering the game of Go without human knowledge. Nature 550:354–359. https://doi.org/10.1038/nature24270
Silver D, Hubert T, Schrittwieser J, Antonoglou I, Lai M, Guez A, Lanctot M, Sifre L, Kumaran D, Graepel T, Lillicrap T, Simonyan K, Hassabis D (2018) A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science 362:1140–1144. https://doi.org/10.1126/science.aar6404
Singer DA (2008) Mineral deposit densities for estimating mineral resources. Math Geosci 40:33–46. https://doi.org/10.1007/s11004-007-9127-3
Singer DA (2023) Targeting method of estimating number of undiscovered mineral deposits. Math Geosci 55:23–34. https://doi.org/10.1007/s11004-022-10021-1
Soranzo E, Guardiani C, Saif A, Wu W (2022) A reinforcement learning approach to the location of the non-circular critical slip surface of slopes. Comput Geosci 166:105–182. https://doi.org/10.1016/j.cageo.2022.105182
Sun AY (2020) Optimal carbon storage reservoir management through deep reinforcement learning. Appl Energy 278:115660. https://doi.org/10.1016/j.apenergy.2020.115660
Sun T, Li H, Wu K, Chen F, Zhu Z, Hu Z (2020) Data-driven predictive modelling of mineral prospectivity using machine learning and deep learning methods: a case study from southern Jiangxi Province, China. Minerals 10:102. https://doi.org/10.3390/min10020102
Sutton RS (1988) Learning to predict by the methods of temporal differences. Mach Learn 3:9–44. https://doi.org/10.1007/BF00115009
Sutton RS (1992) Introduction: the challenge of reinforcement learning. Mach Learn 8:225–227. https://doi.org/10.1007/BF00992695
Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. MIT Press
Tian Y (1997) Geology-geochemistry and ore genesis of Liudou gold deposits in Yunxi county, Hubei province. Prog Precambr Res 20:11–20. (in Chinese with English abstract)
Uchibe E, Doya K (2007) Constrained reinforcement learning from intrinsic and extrinsic rewards. In: 2007 IEEE 6th international conference on development and learning, London, UK, pp 163–168. https://doi.org/10.1109/DEVLRN.2007.4354030
Van Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double Q-learning. In: Proceedings of the AAAI conference on artificial intelligence. https://doi.org/10.1609/aaai.v30i1.10295
Wang D, Zhang B, Ma Z, Huang D, Lin Y (1991) Geological-geochemical investigation of the Yindonggou Xujiapo Au-Ag-multimetal metallogenic belt. Geol Explor 27:44–50. (in Chinese with English abstract)
Wang X, Zhang Q, Zhou G (2007) National-scale geochemical mapping projects in China. Geostand Geoanal Res 31:311–320. https://doi.org/10.1111/j.1751-908X.2007.00128.x
Wang X, Xie X, Zhang B, Hou Q (2011) Geochemical probe into China’s continental crust. Acta Geosci Sin 32:65–83. https://doi.org/10.3975/cagsb.2011.s1.05
Wang C, Deng J, Bagas L, Wang Q (2017) Zircon Hf–isotopic mapping for understanding crustal architecture and metallogenesis in the eastern Qinling orogen. Gondwana Res 50:293–310. https://doi.org/10.1016/j.gr.2017.04.008
Wang J, Zuo R, Xiong Y (2020) Mapping mineral prospectivity via semi-supervised random forest. Nat Resour Res 29:189–202. https://doi.org/10.1007/s11053-019-09510-8
Wu J, Li J, Li Y, Li T (2010) Geochemistry of inclusion and isotope and mineralization fluid feature of Santianmen gold deposit in Yunxixian, Hubei province. Mineral Resour Geol 24:172–179. https://doi.org/10.3969/j.issn.1001-5663.2010.02.014. (in Chinese with English abstract)
Xie X, Mu X, Ren T (1997) Geochemical mapping in China. J Geochem Explor 60:99–113. https://doi.org/10.1016/S0375-6742(97)00029-0
Xie X, Wang X, Zhang Q, Zhou G, Cheng H, Liu D, Cheng Z, Xu S (2008) Multi-scale geochemical mapping in China. Geochemistry: exploration. Environ Anal 8:333–341. https://doi.org/10.1144/1467-7873/08-184
Xiong Y, Zuo R (2016) Recognition of geochemical anomalies using a deep autoencoder network. Comput Geosci 86:75–82. https://doi.org/10.1016/j.cageo.2015.10.006
Xiong Y, Zuo R (2017) Effects of misclassification costs on mapping mineral prospectivity. Ore Geol Rev 82:1–9. https://doi.org/10.1016/j.oregeorev.2016.11.014
Xiong Y, Zuo R, Carranza EJM (2018) Mapping mineral prospectivity through big data analytics and a deep learning algorithm. Ore Geol Rev 102:811–817. https://doi.org/10.1016/j.oregeorev.2018.10.006
Xu T, Ma C, Lv X, Liu X (2012) Geological characteristics and prospecting direction of Shejiayuan silver gold deposits in Yunxi county, Hubei Province. Resour Environ Eng 26:104–110. https://doi.org/10.3969/j.issn.1671-1211.2012.02.003. (in Chinese with English abstract)
Yang Z, Si H, Zhong D (2022) Reinforcement learning based optimal dynamic policy determination for natural gas hydrate reservoir exploitation. J Nat Gas Sci Eng 101:104523. https://doi.org/10.1016/j.jngse.2022.104523
Yang F, Wang Z, Zuo R, Sun S, Zhou B (2023) Quantification of uncertainty associated with evidence layers in mineral prospectivity mapping using direct sampling and convolutional neural network. Nat Resour Res 32:79–98. https://doi.org/10.1007/s11053-022-10144-6
Yin B, Zuo R, Xiong Y (2022) Mineral prospectivity mapping via gated recurrent unit model. Nat Resour Res 31:2065–2079. https://doi.org/10.1007/s11053-021-09979-2
Yue S, Deng X (2019) Geological and ore-forming characteristics of Ag–Au and polymetallic deposits in northwestern Hubei, China. Earth Sci Front 26:106–128. (in Chinese with English abstract)
Yue S, Deng X, Bagas L (2014) Geology, isotope geochemistry, and ore genesis of the Yindonggou Ag–Au(–Pb–Zn) deposit, Hubei Province, China: ore genesis of the Yindonggou Ag–polymetal deposit. Geol J 49:442–462. https://doi.org/10.1002/gj.2561
Yun S, Kang JM, Ha J, Lee S, Ryu DW, Kwon J, Kim IM (2022) Deep learning-based ground vibration monitoring: reinforcement learning and RNN–CNN approach. IEEE Geosci Remote Sens Lett 19:1–5. https://doi.org/10.1109/LGRS.2021.3067974
Zhai Z, Chen W, Li X, Guo J (2009) A modified average reward reinforcement learning based on fuzzy reward function. In: Proceedings of the international multi-conference of engineers and computer scientists, pp 113–117
Zhang C, Zuo R (2021) Recognition of multivariate geochemical anomalies associated with mineralization using an improved generative adversarial network. Ore Geol Rev 136:104–264. https://doi.org/10.1016/j.oregeorev.2021.104264
Zhang G, Meng Q, Yu Z, Sun Y, Zhou D, Guo A (1996) Orogenesis and dynamics of the Qinling orogen. Sci China Ser D Earth Sci 26:225–234
Zhang Y, Cai J, Fu J, Wei C, Chen S (2000) Characteristics and metallogenic model of Shejiayuan silver-gold deposit, northwestern Hubei. Geol Mineral Resour South China 4:9–14. (in Chinese with English abstract)
Zhang S, Carranza EJM, Xiao K, Wei H, Yang F, Chen Z, Li N, Xiang J (2022) Mineral prospectivity mapping based on isolation forest and random forest: implication for the existence of spatial signature of mineralization in outliers. Nat Resour Res 31:1981–1999. https://doi.org/10.1007/s11053-021-09872-y
Zhou D, Zhuang G, Li G, Zhang D, Li X, Shu Y (2014) Characteristics of axial zoning of primary geochemcial halo and prediction model for deep gold orebody in the Santianmen gold deposit, Hubei. Mineral Explor 5:897–905. https://doi.org/10.3969/j.issn.1674-7801.2014.06.007. (in Chinese with English abstract)
Zhou Y, Wang J, Zuo R, Xiao F, Shen W, Wang S (2018) Machine learning, deep learning and Python language in field of geology. Acta Petrol Sin 34:3173–3178. (in Chinese with English abstract)
Zhou T, Chen M, Zou J (2020) Reinforcement learning based data fusion method for multi-sensors. IEEE/CAA J Autom Sin 7:1489–1497. https://doi.org/10.1109/JAS.2020.1003180
Zhou Y, Zuo R, Liu G, Yuan F, Mao X, Guo Y, Xiao F, Liao J, Liu Y (2021) The great-leap-forward development of mathematical geoscience during 2010–2019: big data and artificial intelligence algorithm are changing mathematical geoscience. Bull Mineral Petrol Geochem 40: 556–573. https://doi.org/10.19658/j.issn.1007-2802.2021.40.038. (in Chinese with English abstract)
Zhu F, Li W, Hu C (2017) Mineragraphy and 40Ar/39Ar geochronology of Yindonggou Ag–Au deposit, south Qinling mountains, China. Acta Mineral Sin 37:386–394. (in Chinese with English abstract)
Zuo R (2016) A nonlinear controlling function of geological features on magmatic–hydrothermal mineralization. Sci Rep 6:27127. https://doi.org/10.1038/srep27127
Zuo R (2020) Geodata science-based mineral prospectivity mapping: a review. Nat Resour Res 29:3415–3424. https://doi.org/10.1007/s11053-020-09700-9
Zuo R, Carranza EJM (2011) Support vector machine: a tool for mapping mineral prospectivity. Comput Geosci 37:1967–1975. https://doi.org/10.1016/j.cageo.2010.09.014
Zuo R, Wang Z (2020) Effects of random negative training samples on mineral prospectivity mapping. Nat Resour Res 29:3443–3455. https://doi.org/10.1007/s11053-020-09668-6
Zuo R, Xia Q, Wang H (2013) Compositional data analysis in the study of integrated geochemical anomalies associated with mineralization. Appl Geochem 28:202–211. https://doi.org/10.1016/j.apgeochem.2012.10.031
Zuo R, Xiong Y, Wang J, Carranza EJM (2019) Deep learning and its application in geochemical mapping. Earth Sci Rev 192:1–14. https://doi.org/10.1016/j.earscirev.2019.02.023
Zuo R, Wang J, Xiong Y, Wang Z (2021) The processing methods of geochemical exploration data: past, present, and future. Appl Geochem 132:105072. https://doi.org/10.1016/j.apgeochem.2021.105072
Acknowledgements
We would like to thank two reviewers’ comments and suggestions which helped us improve this study. This study was supported by the IAMG Mathematical Geosciences Student Awards and the National Natural Science Foundation of China (42172326).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shi, Z., Zuo, R. & Zhou, B. Deep Reinforcement Learning for Mineral Prospectivity Mapping. Math Geosci 55, 773–797 (2023). https://doi.org/10.1007/s11004-023-10059-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11004-023-10059-9