Abstract
How to solve the problem of distinguishing the minority spectra from the majority of the spectra is quite important in astronomy. In view of this, an unbalanced spectra classification method based on entropy (USCM) is proposed in this paper to deal with the unbalanced spectra classification problem. USCM greatly improves the performances of the traditional classifiers on distinguishing the minority spectra as it takes the data distribution into consideration in the process of classification. However, its time complexity is exponential with the training size, and therefore, it can only deal with the problem of small- and medium-scale classification. How to solve the large-scale classification problem is quite important to USCM. It can be easily obtained by mathematical computation that the dual form of USCM is equivalent to the minimum enclosing ball (MEB), and core vector machine (CVM) is introduced, USCM based on CVM is proposed to deal with the large-scale classification problem. Several comparative experiments on the 4 subclasses of K-type spectra, 3 subclasses of F-type spectra and 3 subclasses of G-type spectra from Sloan Digital Sky Survey (SDSS) verify USCM and USCM based on CVM perform better than \(k\)NN (\(k\) nearest neighbor) and SVM (support vector machine) in dealing with the problem of rare spectra mining respectively on the small- and medium-scale datasets and the large-scale datasets.
Similar content being viewed by others
References
Cai, J.H., Zhao, X.J., Sun, S.W., et al.: Res. Astron. Astrophys. 13(3), 334 (2013)
Dan, D.M., Hu, Z.Y., Zhao, Y.H.: Spectrosc. Spectr. Anal. 23(1), 182 (2003)
Deeming, T.J.: Mon. Not. R. Astron. Soc. 127, 493 (1964)
Deng, Z.H., Chung, F.L., Wang, S.T.: Pattern Recognit. 41(4), 1363 (2008)
Geobel, J., Stutz, J., Volk, K., et al.: Astron. Astrophys. 222(1–2), 5 (1989)
Gulati, R.K., Gupta, R., Gothoskar, P.: Astron. Astrophys. 322(3), 933 (1997)
Kim, J., Scott, C.D.: IEEE Trans. Pattern Anal. Mach. Intell. 32(10), 1822 (2010)
Li, X.R., Hu, Z.Y.: Int. J. Comput. Vis. 89(1), 1 (2010)
Liu, Z.T., Li, X.R., Wu, C.F., et al.: Chin. J. Electron. 35(1), 157 (2007)
Lv, S.G., Feng, Y.L.: J. Math. Anal. Appl. 38(1), 205 (2012)
Mahdi, B.: Astrophys. Space Sci. 337(1), 93 (2012)
Navarro, S.G., Corradi, R.L.M., Mampaso, A.: Astron. Astrophys. 538(A76), 1 (2012)
Penalver, B.A., Escolano, F.: IEEE Trans. Neural Netw. 20(11), 1756 (2009)
Stark, P.B., Herron, M.M., Matteson, A.: Appl. Spectrosc. 47(11), 1820 (1993)
Tsang, I.W., Kwok, J.T., Cheung, P.M.: J. Mach. Learn. Res. 6, 363 (2005)
Xu, X., Yang, J.F., Wu, F.C, et al.: Spectrosc. Spectr. Anal. 26(10), 1960 (2006)
Yang, J.F., Wu, C.F., Luo, A.L., et al.: Pattern Recognit. Artif. Intell. 19(3), 368 (2006)
Acknowledgements
We are very grateful to the anonymous referee for many useful comments and suggestions. This work is supported by Natural Science Foundation of Shanxi (Grant No. 2016011042) and Program for the outstanding Innovative Teams of Higher Learning Institutions of Shanxi.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liu, Zb., Zhao, Wj. An unbalanced spectra classification method based on entropy. Astrophys Space Sci 362, 98 (2017). https://doi.org/10.1007/s10509-017-3071-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10509-017-3071-6