Abstract
This paper proposes an algorithm based on a combination of DTW lower bound functions and Sakoe–Chiba constraints to improve the time efficiency of DTW distance measurement, which suffers from a high computational complexity and low efficiency while ensuring measurement accuracy. First, the Sakoe–Chiba-DTW algorithm is used to optimize the template and threshold in the original sequence. Then, different combinations of lower bound functions are introduced to filter out sequences that do not meet the similarity requirements compared to the optimized threshold, reducing the number of DTW calculations to improve efficiency. The proposed algorithm is evaluated on 5 sets of self-built data samples for the detection and removal of interference signals caused by redundant objects. The results show that the algorithm achieves the same level of accuracy as traditional DTW algorithm, but saves up to 73880 s in detection time, greatly improving efficiency and having significant implications for data mining tasks.
Similar content being viewed by others
References
Dau, H.A., Silva, D.F., Petitjean, F., Forestier, G., Bagnall, A., Mueen, A., Keogh, E.: Optimizing dynamic time warping’s window width for time series data mining applications. Data Min. Knowl. Disc. 32(4), 1074–1120 (2018)
Fu, T.,c: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)
Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)
Wang, Q.: A longest common subsequence length algorithm with matching path constraints. J. Electron. Inf. 39(11), 2615–2619 (2017)
Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26(1), 43–49 (1978)
Berndt, D.J.: Finding patterns in time series: A dynamic programming approach. Advances in Knowledge Discovery and Data Mining (1996)
Salvador, S., Chan, P.: Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 11(5), 561–580 (2007)
Li, Z., Zhang, F., Li, K., Zhang, X.: Toward accurate dynamic time warping in linear time and space. Softw. J. 25(03), 560–5875 (2014)
Zhang, Z., Tavenard, R., Bailly, A., Tang, X., Tang, P., Corpetti, T.: Dynamic time warping under limited warping path length. Inf. Sci. 393, 91–107 (2017)
Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)
Yi, B.-K., Jagadish, H.V., Faloutsos, C.: Efficient retrieval of similar time sequences under time warping. In: Proceedings 14th International Conference on Data Engineering, pp. 201–208 (1998). IEEE
Kim, S.-W., Park, S., Chu, W.W.: An index-based approach for similarity search supporting time warping in large sequence databases. In: Proceedings 17th International Conference on Data Engineering, pp. 607–614 (2001). IEEE
Keogh, E., Ratanamahatana, C.A.: Exact indexing of dynamic time warping. Knowl. Inf. Syst. 7(3), 358–386 (2005)
Lemire, D.: Faster sequential search with a two-pass dynamic-time-warping lower bound. arXiv preprint arXiv:0807.1734 (2008)
Herrera, R.H., van der Baan, M.: Guided seismic-to-well tying based on dynamic time warping. In: 2012 SEG Annual Meeting (2012). OnePetro
Strle, B., Mozina, M., Bratko, I.: Qualitative approximation to dynamic time warping similarity between time series data. In: Proceedings of the Workshop on Qualitative Reasoning (2009). Citeseer
Yang, W., Kea, W., Xie, H.: Research on application of adaptive weighted DTW algorithm in rehabilitation training system. Int. Core J. Eng. 7(3), 86–95 (2021)
Hammerstrom, I., Kuhn, M., Wittneben, A.: Channel adaptive scheduling for cooperative relay networks. In: IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004, vol. 4, pp. 2784–2788 (2004). IEEE
Wang, S., Zhai, G., Yang, W.: Study on closed-loop control of shock process for permanent magnet shaker in particle impact noise detection. In: 2008 International Conference on Electrical Machines and Systems, pp. 2102–2107 (2008). IEEE
Li, D.: Implementation inspection of aerospace products and their prevention and control standards. Space Stand. 01, 17–20 (2006)
Du, Y., Lv, D., Pan, W., Zhu, W., Lu, J.: Research on application of adaptive weighted DTW algorithm in rehabilitation training system. Reliab. Environ. Test Electron. Prod. 01, 34–39 (2005)
Funding
This research work was supported by the National Natural Science Foundation of China (51607059), the Natural Science Foundation of Heilongjiang Province (JJ2020LH1310, QC2017059), the Postdoctoral Fund of Heilongjiang Province (LBH-Z16169), the Basic Scientific Research Fund of Universities in Heilongjiang Province (2020-KYYWF-1006), and the Scientific and Technological Achievements Cultivation of Heilongjiang Provincial Department of Education (TSTAU-C2018016).
Author information
Authors and Affiliations
Contributions
YR and GT conceived the proposed ideas. GT developed theories and methods. YR conducted experiments, and CL, YY, and CR verified the proposed method. All authors discussed the findings and contributed to the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there are no conflicts of interest to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Teng, Y., Wang, G., He, C. et al. Optimization of Dynamic Time Warping Algorithm for Abnormal Signal Detection. Int J Data Sci Anal (2023). https://doi.org/10.1007/s41060-023-00446-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s41060-023-00446-0