Manifold Regularized Multi-view Feature Selection for Web Image Annotation
The features used in many multimedia analysis-based applications are frequently of very high dimension. Feature selection offers several advantages in highly dimensional cases. Recently, multi-task feature selection has attracted much attention, and has been shown to often outperform the traditional single-task feature selection. Current multi-task feature selection methods are either supervised or unsupervised. In this paper, we address the semi-supervised multi-task feature selection problem. We first introduce manifold regularization in multi-task feature selection to utilize the limited number of labeled samples and the relatively large amount of unlabeled samples. However, the graph constructed in manifold regularization from a single feature representation (view) may be unreliable. We thus propose to construct the graph using the heterogeneous feature representations from multiple views. The proposed method is called manifold regularized multi-view feature selection (MRMVFS), which can exploit the label information, label relationship, data distribution, as well as correlation among different kinds of features simultaneously to boost the feature selection performance. All these information are integrated into a unified learning framework to estimate feature selection matrix, as well as the adaptive view weights. Experimental results on a real-world web image dataset demonstrate the effectiveness and superiority of the proposed MRMVFS over other state-of-the-art feature selection methods.
KeywordsFeature selection multi-task multi-view manifold regularization
Unable to display preview. Download preview PDF.
- 3.Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from national university of singapore. In: ACM International Conference on Image and Video Retrieval (2009)Google Scholar
- 5.He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. In: Advances in Neural Information Processing Systems, pp. 507–514 (2005)Google Scholar
- 6.Li, J., Wang, J.Z.: Real-time computerized annotation of pictures. In: ACM Multimedia, pp. 911–920 (2006)Google Scholar
- 7.Li, Z., Yang, Y., Liu, J., Zhou, X., Lu, H.: Unsupervised feature selection using nonnegative spectral analysis. In: AAAI Conference on Artificial Intelligence (2012)Google Scholar
- 9.Molina, L.C., Belanche, L., Nebot, À.: Feature selection algorithms: A survey and experimental evaluation. In: International Conference on Data Mining, pp. 306–313 (2002)Google Scholar
- 10.Nie, F., Huang, H., Cai, X., Ding, C.: Efficient and robust feature selection via joint l2,1-norms minimization. In: Advances in Neural Information Processing Systems 23, pp. 1813–1821 (2010)Google Scholar
- 11.Obozinski, G., Taskar, B., Jordan, M.: Multi-task feature selection. In: ICML Workshop on Structural Knowledge Transfer for Machine Learning (2006)Google Scholar
- 12.Tang, J., Hu, X., Gao, H., Liu, H.: Unsupervised feature selection for multi-view data in social media. In: SIAM International Conference on Data Mining, pp. 270–278 (2013)Google Scholar
- 14.Yang, Y., Shen, H.T., Ma, Z., Huang, Z., Zhou, X.: l 2, 1-norm regularized discriminative feature selection for unsupervised learning. In: International Joint Conference on Artificial Intelligence, pp. 1589–1594 (2011)Google Scholar