Abstract
In order to efficiently retrieve the same or similar fabric samples, a fabric image retrieval model based on deep hashing was proposed. The model was improved on the basis of MobileNetV1, and the performance of the model was improved by combining the h-swish activation function and attention mechanism module. The hashing method was used to solve the problem of low feature matching speed caused by high-dimensional feature output. By combining the label information and similarity information of the images, a new loss function was constructed, which solved the problem of low model accuracy caused by the large feature difference between similar samples and the small feature difference between heterogeneous samples in fabric images. The experimental results on self-built fabric image dataset showed that the feature extraction time of the proposed algorithm was 0.25 ms, and the MAP reached 93.2\(\%\), which can take into account the fabric retrieval speed and improve retrieval accuracy at the same time. As a result, it has certain application prospects.
Similar content being viewed by others
Data availability
Raw data cannot be provided due to laboratory policies or confidentiality agreements.
References
Ko, M.S., Lee, Y.H., Cho, C., Song, H.: In: 2021 International Conference on Information and Communication Technology Convergence (ICTC), pp. 1659–1661. IEEE (2021)
Karakasis, E.G., Papakostas, G.A., Koulouriotis, D.E., Tourassis, V.D.: A unified methodology for computing accurate quaternion color moments and moment invariants. IEEE Trans. Image Process. 23(2), 596–611 (2013)
Kshirsagar, D., Kulkarni, U.: In: 2016 IEEE International Conference on Advances in Electronics, Communication and Computer Technology (ICAECCT), pp. 68–75. IEEE (2016)
Kishore, D., Rao, C.S.: Content-based image retrieval system based on fusion of wavelet transform, texture and shape features. Math. Model. Eng. Probl. 8(1), 110–116 (2021)
Zhang, D., Lu, G.: A comparative study of curvature scale space and Fourier descriptors for shape-based image retrieval. J. Vis. Commun. Image Represent. 14(1), 39–57 (2003)
Zhang, N., Xiang, J., Wang, L., Gao, W., Pan, R.: Image retrieval of wool fabric. Part I: based on low-level texture features. Text. Res. J. 89(19–20), 4195–4207 (2019)
Shen, F., Lin, L., Wei, M., Liu, J., Zhu, J., Zeng, H., Cai, C., Zheng, L.: In: 2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC), pp. 247–251. IEEE (2019)
Li, H.A., Wang, D., Zhang, J., Li, Z., Ma, T.: Image super-resolution reconstruction based on multi-scale dual-attention. Connect. Sci. 1–19 (2023)
Xiang, J., Zhang, N., Pan, R., Gao, W.: Fabric image retrieval system using hierarchical search based on deep convolutional neural network. IEEE Access 7, 35405–35417 (2019)
Deng, D., Wang, R., Wu, H., He, H., Li, Q., Luo, X.: Learning deep similarity models with focus ranking for fabric image retrieval. Image Vis. Comput. 70, 11–20 (2018)
Tena, S., Hartanto, R., Ardiyanto, I.: In: 2021 4th International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp. 150–154. IEEE (2021)
Xiang, J., Zhang, N., Pan, R., Gao, W.: Wool fabric image retrieval based on soft similarity and listwise learning. Text. Res. J. 92(21–22), 4470–4483 (2022)
Zhang, N., Shamey, R., Xiang, J., Pan, R., Gao, W.: A novel image retrieval strategy based on transfer learning and hand-crafted features for wool fabric. Expert Syst. Appl. 191, 116229 (2022)
Koonce, B., Koonce, B.: Mobilenetv3. Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization, pp. 125–144 (2021)
Hu, J., Shen, L., Sun, G.: In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Liu, J., Li, C., Liang, F., Lin, C., Sun, M., Yan, J., Ouyang, W., Xu, D.: In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11486–11495 (2021)
Li, W.J., Wang, S., Kang, W.C.: Feature learning based deep supervised hashing with pairwise labels. arXiv:1511.03855 (2015)
Liu, H., Wang, R., Shan, S., Chen, X.: In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2064–2072 (2016)
Cao, Y., Long, M., Liu, B., Wang, J.: In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1229–1237 (2018)
Arora, C., Vijayarajan, V., Padmapriya, R.: In: Frontiers in Intelligent Computing: Theory and Applications: Proceedings of the 7th International Conference on FICTA (2018), vol. 2, pp. 304–314. Springer (2020)
Funding
This research was supported by National Key R &D Program of China (2022YFD2000600) and the Key R &D Program of Zhejiang Leading Goose Program (2022C02052).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by JG. The first draft of the manuscript was written by DW and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gui, J., Wu, D. & He, J. An efficient network based on double constrained loss for fabric image retrieval. SIViP 18, 305–313 (2024). https://doi.org/10.1007/s11760-023-02749-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-023-02749-y