Abstract
This paper proposes a novel feature selection approach to improve the classification accuracy and reduce the computational complexity in image steganalysis. It is a hybrid filter-wrapper approach based on improved Particle Swarm Optimization (PSO). It consists of two phases: the first phase is composed of two filter techniques namely t test and multiple-regression which selects the features based on their ability to discriminate images as stego or cover. The second phase further reduces the number of features by working on the significant features selected during the first phase using an improved PSO. This approach overcomes the disadvantages of global best PSO by integrating it with local best PSO and dynamically changing the population size (Hope/Rehope). The proposed approach is tested on two sets of features extracted from spatial domain (SPAM-Subtractive Adjacency Matrix) and transform domain (CCPEV-Cartesian Calibrated features extracted by Pevný) for four embedding algorithms nsF5, Outguess, Perturbed Quantization and Steghide using SVM (Support Vector Machine) classifier. Experimental results demonstrate that this approach significantly improves the classification accuracy and drastically reduces dimensionality as compared to results produced by some well-known feature selection algorithms.
Similar content being viewed by others
References
Cheddad A, Condell J, Curran K, McKevitt P (2010) Digital image steganography: survey and analysis of current methods. Sig Process 90(3):727–752
Adil F, Zahir T, Ibrahim K, Ibrahim H, Hussein A (2013) Toward an efficient and scalable feature selection approach for internet traffic classification. Comput Netw 57(9):2040–2057
Engelbrcht AP (2007) Computational intelligence: an introduction, second edition, John Wiley, ch 16
Avcibas I, Memon N, Bülent S (2003) Steganalysis using image quality metrics. IEEE Trans Image Process 12(2):221–229
Chih-Chung C, Chih-Jen L (2011) LIBSVM: a library for support vector machines. ACM Tran Intell Sys Technol 27:1–27:27, Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Cortes C, Vapnik V (1995) Support-vector networks. Mach Leaming 20:273–297 (Springer)
Dash M, Liu H (1997) Feature selection for classification. Intell Data Anal 1(3):131–156
Davidson JL, Jalan J (2010) Feature selection for steganalysis using mahalanobis distance. In: Proceedings of SPIE electronic imaging, media forensics and security II, San Jose CA SPIE Vol 7541;0401–12
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proc. of 6th international symposium on micro machine and human science, Nagoya, Japan, 39–43
Farid H (2002) Detecting hidden messages using higher-order Statistical models. In: Proc. IEEE Symp. Int’l Conf. on Image Processing (ICIP 2000), IEEE Press, 905–908
Feng T, Fu X, Zhang Y, Anu GB (2008) A genetic method for feature subset selection. Soft Comput 12:111–120
Fridrich J, Goljan M, Soukal D (2005) Perturbed quantization steganography. Multimed Syst 11:98–107
Gaurav KR, Ramesh KA (2009) Evaluation of feature selection measures for steganalysis, LNCS 5909. Springer-Verlag, Berlin, pp 432–439
Geetha S, Kamaraj N (2010) Optimized image steganalysis through feature selection using MBEGA. Int J Comput Netw Commun 161–175
Guoming C, Qiang C, Dong Z, Weiheng Z (2012) Particle swarm optimization feature selection for image steganalysis. IEEE Comput Soc 304–308
Guorong X, Zhu X, Chai P (2006) Feature selection based on the bhattacharyya distance. IEEE the 18th international conference on pattern recognition 1–4
Guyon I, Elisseeeff A (2003) An introduction to variable and feature selection. J Mach Learn 3:1157–1182
Hall M (2000) Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the 17th international conference on machine learning, 2000, pp 359–366
Hendtlass T (2005) A particle swarm algorithm for high dimensional, multi-optima problem spaces. In: Proceedings of swarm intelligence symposium, 149–154
Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recogn Lett 28:1825–1844
Jiang L, Zhang H, Cai Z (2006) Discriminatively improving naive bayes by evolutionary feature selection. Rom J Inf Sci Technol 9(3):163–174
Jiang L, Cai Z, Zhang H, Wang D (2012) Not so greedy: randomly selected naive bayes. Expert Sys Appl 39(12):11022–11028
Jianping H, Waibhav DT, Edward RD (2009) Performance of feature selection methods in the classification of high dimension data. Pattern Recognit 42:409–424
Lu JC, Liu FL, Luo XY (2014) Selection of image features for steganalysis based on the Fisher criterion. Digit Invest 11:57–66
Kohavi R, John G (1997) Wrappers for feature subset selection. Artif Intell J Spec Issue Relev 97(1–2):273–324
Kodovsky J, Fridrich J, Holub V (2012) Ensemble classifiers for steganalysis of digital media. IEEE Trans Inf Foren Secur 7:432–444
Kononenko I (1994) Estimating attributes: analysis and extensions of Relief. In: De Raedt L and Bergadano F (eds). Machine Learning: ECML-94. pp 171–182, SpringerVerlag
Lecocke M, Hess K (2007) An empirical study of univariate and genetic algorithm-based feature selection in binary classification with microarray data. Can Inf 2:313–327 (PMCID: PMC2675488)
Li-Yeh C, Sheng-Wei T, Cheng-Hong Y (2011) Improved binary particle swarm optimization using catfish effect for feature selection. Expert Syst Appl 38:12699–12707
Mamoun A, Shamsul H, Jema LA, Rafiqul I, John Y, Sitalakshmi V, Roderick B (2014) Hybrids of support vector machine wrapper and filter based framework for malware detection. J Netw 9(11):2878–2891
Mansour S, Mansoureh P, Shahram M (2012) Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks. Neural Comput Appl 21:1717–1728
Clerc M (2006). Particle swarm optimization, ISTE Ltd, ch 18. http://clerc.maurice.free.fr/pso/
Miche Y, Roue B, Lendasse A, Bas B (2006) A Feature selection methodology for steganalysis. Multimed Content Represent Classif Secur Lect Notes Comput Sci 4105:49–56
Mohammadi FG, Saniee AM (2014) Image steganalysis using a bee colony based feature selection algorithm. Engg Appl Artif Intell 31:35–43
Provos N (2001) Outguess tool (Online) http://www.outguess.org. Accessed 1 May 2014
Nissar A, Mirb AH (2010) Classification of steganalysis techniques: a study. Digit Signal Proc 20(6):1758–1770
Peng Y, Zhiqing Wu, Jiang J (2010) A novel feature selection for biomedical data classification. J Biomed Inform 43:15–23
Pevný T, Bas P, Fridrich J (2010) Steganalysis by subtractive pixel adjacency matrix. IEEE Trans Inf Foren Secur 5(2):215–224
Pevný T.,Fridrich, J. (2007). Merging Markov and DCT features for Multi-class JPEG steganalysis. In: Proc. SPIE Electronic Imaging, Security, Steganography, and Watermarking of Multimedia Contents IX, Vol. 6505:3–14
Rencher AC (1995) Methods of multivariate analysis. John Wiley, New York ch. 6, 10
Rita RC, Latika S (2014) Performance evaluation of filter approaches for blind steganalysis, In: proceedings of 2nd international conference on ERCICA (Elsevier), 606–611
Shutao Li, Chen Liao, Kwok JT (2006) Gene feature extraction Using T-test statistics and kernel partial least squares, ICONIP 2006, Part III, LNCS 4234, Springer-Verlag Berlin Heidelberg 11–20
Shetzl (2003) Steghide tool (Online). http://steghide.sourceforge.net/index.php. Accessed 20 May 2014
Westfeld A (2001) High capacity despite better steganalysis (F5—a steganographic algorithm). Information Hiding, 4th international workshop, volume 2137 of lecture Notes in computer science, Springer Verlag, 289–302
Xia BB, Zhao XF, Feng DG (2012) Improve steganalysis by MWM feature selection, Watermarking, Volume 2, InTech, 243–258
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chhikara, R.R., Sharma, P. & Singh, L. A hybrid feature selection approach based on improved PSO and filter approaches for image steganalysis. Int. J. Mach. Learn. & Cyber. 7, 1195–1206 (2016). https://doi.org/10.1007/s13042-015-0448-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-015-0448-0