Skip to main content
Log in

Optimization of Dynamic Time Warping Algorithm for Abnormal Signal Detection

  • Regular Paper
  • Published:
International Journal of Data Science and Analytics Aims and scope Submit manuscript

Abstract

This paper proposes an algorithm based on a combination of DTW lower bound functions and Sakoe–Chiba constraints to improve the time efficiency of DTW distance measurement, which suffers from a high computational complexity and low efficiency while ensuring measurement accuracy. First, the Sakoe–Chiba-DTW algorithm is used to optimize the template and threshold in the original sequence. Then, different combinations of lower bound functions are introduced to filter out sequences that do not meet the similarity requirements compared to the optimized threshold, reducing the number of DTW calculations to improve efficiency. The proposed algorithm is evaluated on 5 sets of self-built data samples for the detection and removal of interference signals caused by redundant objects. The results show that the algorithm achieves the same level of accuracy as traditional DTW algorithm, but saves up to 73880 s in detection time, greatly improving efficiency and having significant implications for data mining tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Dau, H.A., Silva, D.F., Petitjean, F., Forestier, G., Bagnall, A., Mueen, A., Keogh, E.: Optimizing dynamic time warping’s window width for time series data mining applications. Data Min. Knowl. Disc. 32(4), 1074–1120 (2018)

    Article  MathSciNet  Google Scholar 

  2. Fu, T.,c: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)

  3. Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)

    Article  Google Scholar 

  4. Wang, Q.: A longest common subsequence length algorithm with matching path constraints. J. Electron. Inf. 39(11), 2615–2619 (2017)

    MathSciNet  Google Scholar 

  5. Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26(1), 43–49 (1978)

    Article  MATH  Google Scholar 

  6. Berndt, D.J.: Finding patterns in time series: A dynamic programming approach. Advances in Knowledge Discovery and Data Mining (1996)

  7. Salvador, S., Chan, P.: Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 11(5), 561–580 (2007)

    Article  Google Scholar 

  8. Li, Z., Zhang, F., Li, K., Zhang, X.: Toward accurate dynamic time warping in linear time and space. Softw. J. 25(03), 560–5875 (2014)

    Google Scholar 

  9. Zhang, Z., Tavenard, R., Bailly, A., Tang, X., Tang, P., Corpetti, T.: Dynamic time warping under limited warping path length. Inf. Sci. 393, 91–107 (2017)

    Article  Google Scholar 

  10. Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)

  11. Yi, B.-K., Jagadish, H.V., Faloutsos, C.: Efficient retrieval of similar time sequences under time warping. In: Proceedings 14th International Conference on Data Engineering, pp. 201–208 (1998). IEEE

  12. Kim, S.-W., Park, S., Chu, W.W.: An index-based approach for similarity search supporting time warping in large sequence databases. In: Proceedings 17th International Conference on Data Engineering, pp. 607–614 (2001). IEEE

  13. Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)

    Article  Google Scholar 

  14. Lemire, D.: Faster sequential search with a two-pass dynamic-time-warping lower bound. arXiv preprint arXiv:0807.1734 (2008)

  15. Herrera, R.H., van der Baan, M.: Guided seismic-to-well tying based on dynamic time warping. In: 2012 SEG Annual Meeting (2012). OnePetro

  16. Strle, B., Mozina, M., Bratko, I.: Qualitative approximation to dynamic time warping similarity between time series data. In: Proceedings of the Workshop on Qualitative Reasoning (2009). Citeseer

  17. Yang, W., Kea, W., Xie, H.: Research on application of adaptive weighted DTW algorithm in rehabilitation training system. Int. Core J. Eng. 7(3), 86–95 (2021)

    Google Scholar 

  18. Hammerstrom, I., Kuhn, M., Wittneben, A.: Channel adaptive scheduling for cooperative relay networks. In: IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004, vol. 4, pp. 2784–2788 (2004). IEEE

  19. Wang, S., Zhai, G., Yang, W.: Study on closed-loop control of shock process for permanent magnet shaker in particle impact noise detection. In: 2008 International Conference on Electrical Machines and Systems, pp. 2102–2107 (2008). IEEE

  20. Li, D.: Implementation inspection of aerospace products and their prevention and control standards. Space Stand. 01, 17–20 (2006)

    Google Scholar 

  21. Du, Y., Lv, D., Pan, W., Zhu, W., Lu, J.: Research on application of adaptive weighted DTW algorithm in rehabilitation training system. Reliab. Environ. Test Electron. Prod. 01, 34–39 (2005)

    Google Scholar 

Download references

Funding

This research work was supported by the National Natural Science Foundation of China (51607059), the Natural Science Foundation of Heilongjiang Province (JJ2020LH1310, QC2017059), the Postdoctoral Fund of Heilongjiang Province (LBH-Z16169), the Basic Scientific Research Fund of Universities in Heilongjiang Province (2020-KYYWF-1006), and the Scientific and Technological Achievements Cultivation of Heilongjiang Provincial Department of Education (TSTAU-C2018016).

Author information

Authors and Affiliations

Authors

Contributions

YR and GT conceived the proposed ideas. GT developed theories and methods. YR conducted experiments, and CL, YY, and CR verified the proposed method. All authors discussed the findings and contributed to the final manuscript.

Corresponding author

Correspondence to Guotao Wang.

Ethics declarations

Conflict of interest

The authors declare that there are no conflicts of interest to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Teng, Y., Wang, G., He, C. et al. Optimization of Dynamic Time Warping Algorithm for Abnormal Signal Detection. Int J Data Sci Anal (2023). https://doi.org/10.1007/s41060-023-00446-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s41060-023-00446-0

Keywords

Navigation