Skip to main content
SpringerLink
Log in

A time-series matching approach for symmetric-invariant boundary image matching

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we address the problem of boundary image matching that supports symmetric invariance. Supporting the symmetric invariance is an important factor to provide more intuitive and more correct results in boundary image matching. Previous boundary image matching methods, however, deal with mainly image rotations without consideration of symmetric transformations. In this paper, we propose a time-series-based boundary image matching that supports the symmetric invariance as well as the previous rotation invariance. For this, we first formally define the concept of a boundary time-series and its symmetric time-series. We then present a novel notion of symmetric-rotation property that the rotation-invariant matching result is always the same for all possible symmetric angles. We next discuss how to efficiently extract a symmetric time-series from an image boundary by presenting the domain independent property that both time-series domain and image domain methods produce the same symmetric time-series. Experimental results show that the proposed symmetric-invariant matching provides the more intuitive result compared with the previous rotation-invariant matching. To our best knowledge, this is the first attempt that solves the symmetric-invariant boundary matching problem in the simple time-series domain rather than in the complex image domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. The naive matching performs rotation-invariant matching for every possible symmetric angles of 𝜃 = \(\frac {2\pi }{n}, \frac {4\pi }{n}, \cdots , 2\pi \).

  2. The datasets used in the experiments are found in the following ftp sites. - Original images: http://cs.kangwon.ac.kr/~data/Org-10000.zip. - Boundary time-series: http://cs.kangwon.ac.kr/~data/BoundTS-10000.tar.gz. - Symmetric time-series: http://cs.kangwon.ac.kr/~data/SymTS-10000.tar.gz. - Noise mixed time-series: http://cs.kangwon.ac.kr/~data/NoiseTS-10000.tar.gz.

  3. In this paper, we perform the image matching by using the boundary feature without considering the inner shapes of an object. Therefore, the heart image is retrieved as a matching result of the cup image since the extracted boundaries between cup and heart images are very similar with each other.

References

  1. Agrawal R, Faloutsos C, Swami A (1993) Efficient similarity search in sequence databases. In: Proceedings of the 4th international conference on foundations of data organization and algorithms. ACM, Chicago, pp 69–84

  2. Arashloo SR (2015) Multiscale binarised statistical image features for symmetric face matching using multiple descriptor fusion based on class-specific LDA. Pattern Analysis and Applications. Published online

  3. Carlet C, Gao G, Liu W (2014) A secondary construction and a transformation on rotation symmetric functions, and their action on bent and Semi-Bent functions. Combinatorial Theory, Series A 127:161–175

    Article  MathSciNet  MATH  Google Scholar 

  4. Gandhi A (2002) Content-based Image retrieval: plant species identification. MS thesis, oregon state university, Oregon

    Google Scholar 

  5. Gao L, Song J, Zou F, Zhang D, Shao J (2015) Scalable multimedia retrieval by deep learning hashing with relative similarity learning. In: Proceedings of the 23rd ACM international conference on multimedia. ACM, Brisbane, pp 903–906

  6. Han J, Kamber M, Pei J (2011) Data mining: concepts and techniques, 3rd edn. Morgan Kaufmann, Waltham

    MATH  Google Scholar 

  7. Han W-S, Lee J, Moon Y-S, Hwang S-W, Yu H (2011) A new approach for processing ranked subsequence matching based on ranked union. ACM SIGMOD, Athens, pp 457–468

  8. Hu R, Collomosse J (2013) A performance evaluation of gradient field HOG descriptor for sketch based image retrieval. Comput Vis Image Underst 117(7):790–806

    Article  Google Scholar 

  9. Jian A, Ross A, Prabhakar S (2001) Fingerprint matching using minutiae and texture features. In: Proceedings of the international conference on image processing. IEEE, Thessaloniki, pp 282– 285

  10. Kekre HB, Sudeep DT, Shrikant PS, Sowmya L, Jhuma G (2011) Shape content based image retrieval using LBG vector quantization. Int’l Journal of the Computer Science and Information Security 9(12):20–25

    Google Scholar 

  11. Keogh E, Wei L, Xi X, Vlachos M, Lee S-H, Protopapas P (2006) LB_Keogh supports exact indexing of shapes under rotation invariance with arbitrary representations and distance measures. In: Proceedings of the 23rd international conference on very large data base. ACM, Seoul, pp 882– 893

  12. Kim BS, Moon YS, Kim J (2008) Noise control boundary image matching using time-series moving average transform. In: Proceedings of the 19th international conference on database and expert systems applications. Springer, Turin, pp 362–375

  13. Kim B-S, Moon Y-S, Choi M-J, Kim J (2014) Interactive Noise-Controlled boundary image matching using the Time-Series moving average transform. Multimedia Tools and Applications 72(3):2543– 2571

    Article  Google Scholar 

  14. Kumar J, Ye P, Doermann D (2014) Structural similarity for document image classification and retrieval. Pattern Recogn Lett 43:119–126

    Article  Google Scholar 

  15. Lian G (2015) Rotation invariant color texture classification using multiple sub-DLBPs. Vis Commun Image Represent 31:1–13

    Article  Google Scholar 

  16. Liu Y, Zhang S, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40(1):262–282

    Article  MATH  Google Scholar 

  17. Loh W-K, Kim S-W, Whang K-Y (2004) A subsequence matching algorithm that supports normalization transform in Time-Series databases. Data Min Knowl Disc 9(1):5–28

    Article  MathSciNet  Google Scholar 

  18. Loh W-K, Kim S-P, Hong S-K, Moon Y-S (2015) Envelope-based boundary image matching for smart devices under arbitrary rotations. Multimedia Systems 21 (1):29–47

    Article  Google Scholar 

  19. Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2009) Supervised dictionary learning. Neural Inf Proces Syst 21:1033–1040

    Google Scholar 

  20. Moon Y-S, Whang K-Y, Han W-S (2002) General match: a subsequence matching method in Time-Series databases based on generalized windows. In: Proceedings of international conference on management of data. ACM SIGMOD, Madison, pp 382–393

  21. Moon Y-S, Kim B-S, Kim MS, Whang K-Y (2010) Scaling-Invariant Boundary image matching using Time-Series matching techniques. Data Knowl Eng 69 (10):1022–1042

    Article  Google Scholar 

  22. Moon Y-S, Lee BS (2014) Safe MBR-transformation in similar sequence matching. Inf Sci 270:28–40

    Article  MathSciNet  MATH  Google Scholar 

  23. Moon Y-S, Loh W-K (2015) Triangular inequality-based rotation-invariant boundary image matching for smart. Multimedia Systems 21(1):15–28

    Article  Google Scholar 

  24. Navarro G (2014) Spaces, Trees, and colors: the algorithmic landscape of document retrieval on sequences. ACM Comput Surv 146(4):52

    MATH  Google Scholar 

  25. Oscos GC, Khoshgoftaar TM, Wald R (2014) Rotation invariant face recognition survey. In: Proceedings of the 15th international conference on information reuse and integration. IEEE, Redwood City, pp 835– 840

  26. Patil PB, Kokare MB (2013) Interactive semantic image retrieval. J Inf Process Syst 9(3):349–364

    Article  Google Scholar 

  27. Pawlik M, Augsten N (2014) A Memory-Efficient tree edit distance algorithm. In: Proceedings of the 25th international conference on database and expert systems applications. Springer, Munich , pp 196–210

  28. Rath TM, Manmatha R (2003) Word image matching using dynamic time warping. In: Proceedings of IEEE conference on computer and pattern recognition. IEEE, Madison, pp 1–7

  29. Ruckschlossova T (2004) Homogeneous aggregation operators. In: Proceedings of the 8th international conference on fuzzy days. Springer, Dortmund, pp 555–563

  30. Shukla JA, Vibha P, Nagendra G (2015) Implementation of edge detection algorithms in real time on FPGA. In: Proceedings of the 5th international conference on engineering, institute of technology, Nirma University, pp 26–28

  31. Song J, Yang Y, Li X, Huang Z, Yang Y (2014) Robust hashing with local models for approximate similarity search. IEEE Trans on Cybernetics 44(7):1225–1236

    Article  Google Scholar 

  32. Sonka M, Hlavac V, Boyle R (2014) Image processing, analysis, and machine vision, cengage learning

  33. Suetens P, Fua P, Hanson AJ (1992) Computational strategies for object recognition. ACM Comput Surv 24(1):5–62

    Article  Google Scholar 

  34. Suli E, Mayers DF (2003) Introduction to numerical analysis. cambridge

  35. Sun Y, Zhao L, Huang S, Yan L, Dissanayake G (2014) L 2-SIFT: SIFT feature extraction and matching for large images in Large-Scale aerial photogrammetry. ISPRS J Photogramm Remote Sens 91:1– 16

    Article  Google Scholar 

  36. Vlachos M, Vagena Z, Yu PS, Athitsos V (2005) Rotation invariant indexing of shapes and line drawings. In: Proceedings of ACM conference on information and knowledge management. ACM, Bremen, pp 131–138

  37. Wan J, Wang D, Hoi SCH, Wu P, Zhang JZY, Li J (2014) Deep learning for Content-Based image retrieval: a comprehensive study. In: Proceedings of the 22nd ACM international conference on multimedia. ACM, Orlando, pp 157–166

  38. Wang Q, Kontos D, Li G, Megalooikonomou V (2004) Application of time series techniques to data mining and analysis of spatial patterns in 3D images. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing. IEEE, Montreal, pp 525–528

  39. Wang J, Shen HT, Song J, Ji J (2014) Hashing for similarity search: a survey, Data Structures and Algorithms. arXiv:1408.2927

  40. Xu Z, Cheng K, Ding Y, Tian Z, Zhao H (2015) A multiple genome sequence matching based on skipping tree. Int’l Journal of Machine Learning and Computing 5 (1):78–85

    Article  Google Scholar 

  41. Xu D, Alameda-Pineda X, Song J, Ricci E, Sebe N (2016) Academic coupled dictionary learning for sketch-based image retrieval. In: Proceedings of the 24th ACM international conference on multimedia. ACM, Amsterdam, pp 1326–1335

  42. Xu D, Song J, Alameda-Pineda X, Ricci E, Sebe N (2016) Multi-Paced Dictionary Learning for Cross-Domain Retrieval and Recognition. In: Proceedings of IEEE international conference on pattern recognition. IEEE, Cancun, pp 3228–3233

  43. Zhang D, Lu G (2004) Review of shape representation and description techniques. Pattern Recogn 37(1):1–19

    Article  Google Scholar 

  44. Zhu Y, Shasha D (2003) Warping indexes with envelope transforms for query by humming. In: Proceedings of international conference on management of data. ACM SIGMOD, San Diego, pp 181– 192

Download references

Acknowledgments

This work was partly supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. R7117-17-0214, Development of an Intelligent Sampling and Filtering Techniques for Purifying Data Streams) and the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2017R1A2B4008991, NRF-2017R1A2B4010205).

Author information

Authors and Affiliations

  1. Department of Computer Science, Kangwon National University, 1 Kangwondaehak-gil, Chuncheon-si, Gangwon, 24341, Republic of Korea

    Sanghun Lee, Hajin Kim, Mi-Jung Choi & Yang-Sae Moon

Authors
  1. Sanghun Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hajin Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mi-Jung Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yang-Sae Moon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mi-Jung Choi.

Additional information

The preliminary Korean version of this paper was published in KIPS Trans. on Software and Data Engineering, Vol. 4, No. 10, pp. 431–438, Oct. 2015. This is an extended and formalized version of that paper.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, S., Kim, H., Choi, MJ. et al. A time-series matching approach for symmetric-invariant boundary image matching. Multimed Tools Appl 77, 20979–21001 (2018). https://doi.org/10.1007/s11042-017-5323-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5323-4

Keywords

Search

Navigation