Relative Stability of Random Projection-Based Image Classification
Our aim is to show that randomly generated transformation of high-dimensional data vectors, for example, images, could provide low dimensional features which are stable and suitable for classification tasks. We examine two types of projections: (a) global random projections, i.e., projections of the whole images, and (b) concatenated local projections of spatially-organized parts of an image (for example rectangular image blocks). In both cases, the transformed images provide good features for correct classification. The computational complexity of designing the transformation is linear with respect to the size of images and in case (b) it does not depend on the form of image partition. We have analyzed the stability of classification results with respect to random projection and to different randomly generated training sets. Experiments on the images of ten persons taken from the Extended Yale Database B demonstrate that the methods of classification based on Gaussian random projection are effective and positively comparable with PCA-based methods, both from the point of view of stability and classification accuracy.
This research was supported by grant 041/0145/17 at the Faculty of Electronics, Wrocław University of Science and Technology.
- 8.Brigham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Conference on Knowledge Discovery and Data Mining, vol. 16, pp. 245–250 (2001)Google Scholar
- 9.Fodor, I.K.: A survey of dimension reduction techniques. Technical report, Lawrence Livermore National Lab., CA (US) (2002)Google Scholar
- 22.Ng, A.Y., Jordan, M.I.: On discriminative vs. generative classifiers: a comparison of logistic regression and Naive Bayes. In: Advances in Neural Information Processing Systems, vol. 14, pp. 841–848 (2002)Google Scholar
- 25.Skubalska-Rafajłowicz, E.: Spatially-organized random projections of images for dimensionality reduction and privacy-preserving classification. In: Proceedings of 10th International Workshop on Multidimensional (nD) Systems (nDS), pp. 1–5 (2017)Google Scholar
- 27.Tsagkatakis, G., Savakis, A.: A random projections model for object tracking under variable pose and multi-camera views. In: Proceedings of the Third ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC, pp. 1–7 (2009)Google Scholar