Abstract
Deep Clustering learns cluster friendly salient features in embedded space. In our previous work of Global Average Pooled Deep Convolutional Embedded Clustering (GAPDCEC) algorithm, the last convolution layer feature maps are pooled to build the embedded space. This considers only spatial information retains in the last convolution layer of the encoder, which unable to capture discriminative features from entire convolutional layers. To address this issue, we propose a solution using concatenation of all convolutional layer outputs and then Global Average Pooling (GAP) is applied on the concatenated feature maps in the encoder. This will encourage the network to learn cluster friendly features of all convolutional layers. Our experimental results prove the efficiency of proposed Concatenated Global Average Pooled Deep Convolutional Embedded Clustering (CGAPDCEC).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Tao Y, Takagi K, Nakata K (2018) RDEC: integrating regularization into deep embedded clustering for imbalanced datasets. https://arxiv.org/abs/1812.02293
Chen G (2015) Deep learning with nonparametric clustering. https://arxiv.org/abs/1501.03084
Peng X, Xiao S, Feng J, Yau W-Y, Yi Z (2016) Deep subspace clustering with sparsity prior. In: IJCAI, pp 1925–1931
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Song C, Liu F, Huang Y, Wang L, Tan T (2013) Auto-encoder based data clustering.” In: Iberoamerican congress on pattern recognition. Springer, Berlin, pp 117–124
Yang B, Fu X, Sidiropoulos ND, Hong M (2017) Towards k-means-friendly spaces: simultaneous deep learning and clustering. In: Proceedings of the 34th International Conference on Machine Learning,vol 70. JMLR. org, pp 3861–3870
Xie J, Girshick R, Farhadi A (2016) Unsupervised deep embedding for clustering analysis. In: International conference on machine learning, pp 478–487
Hu W, Miyato T, Tokui S, Matsumoto E, Sugiyama M (2017) Learning discrete representations via information maximizing self-augmented training. https://arxiv.org/abs/1702.08720
Jiang Z, Zheng Y, Tan H, Tang B, Zhou H (2016) Variational deep embedding: An unsupervised and generative approach to clustering. https://arxiv.org/abs/1611.05148
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
Lin W-A, Chen J-C, Castillo CD, Chellappa R (2018) Deep density clustering of unconstrained faces. In: 2018 IEEE/CVF conference on computer vision and pattern recognition. IEEE, pp 8128–8137
Shah SA, VladlenKoltun (2018) Deep continuous clustering. https://arxiv.org/abs/1803.01449
Lee H, Grosse R, Ranganath R, Ng AY (2009) Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: Proceedings of the 26th annual international conference on machine learning. ACM, pp 609–616
Huang P, Huang Y, Wang W, Wang L (2014) Deep embedding network for clustering. In: 2014 22nd international conference on pattern recognition (ICPR). IEEE, pp 1532–1537
Peng X, Feng J, Xiao S, Lu J, Yi Z, Yan S (2017) Deep sparse subspace clustering. https://arxiv.org/abs/1709.08374
GhasediDizaji K, Herandi A, Deng C, Cai W, Huang H (2017) Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5736–5745
Kolla M, Venugopal T (2018) Semantic image clustering with global average pooled deep convolutional autoencoder. HELIX 8(4):3561–3566
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kolla, M., Venugopal, T. (2020). Concatenated Global Average Pooled Deep Convolutional Embedded Clustering. In: Kumar, A., Paprzycki, M., Gunjan, V. (eds) ICDSMLA 2019. Lecture Notes in Electrical Engineering, vol 601. Springer, Singapore. https://doi.org/10.1007/978-981-15-1420-3_84
Download citation
DOI: https://doi.org/10.1007/978-981-15-1420-3_84
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-1419-7
Online ISBN: 978-981-15-1420-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)