Abstract
Time series anomaly detection plays a pivotal role across diverse fields, including cybersecurity, healthcare and industrial monitoring. While Machine Learning and Deep Learning approaches have shown remarkable performance in these problems, finding a balance between simplicity and accuracy remains a persistent challenge. Also, although the potential of NLP methods is heavily expanding, their application in time series analysis is still to be explored, which could benefit greatly due to the properties of latent features. In this paper, we propose WETAD, a novel approach for unsupervised anomaly detection based on the representation of time series data as text, in order to leverage the use of well-established word embeddings. To showcase the performance of the model a series of experiments were conducted on a diverse set of anomaly detection datasets widely used in the literature. Results demonstrate our approach can compete and even outperform state-of-the-art approaches with a simple, yet effective model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Disambiguation: Do not confuse with the classical meaning in NLP.
References
Arenas-García, J., Gómez-Verdejo, V., Navia-Vazquez, A.: RLS adaptation of one-class SVM for time series novelty detection (2004)
Audibert, J., Michiardi, P., Guyard, F., Marti, S., Zuluaga, M.A.: Usad: Unsupervised anomaly detection on multivariate time series. KDD ’20, New York, NY, USA, Association for Computing Machinery, pp. 3395-3404 (2020)
Dau, H.A., et al.: The ucr time series archive (2019)
Deng, A., Hooi, B.: Graph neural network-based anomaly detection in multivariate time series (2021)
Horak, M., Chandrasekaran, S., Tobar, G.: Nlp based anomaly detection for categorical time series (2022)
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., Soderstrom, T.: Detecting spacecraft anomalies using LSTMs and nonparametric dynamic thresholding. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery, ACM (07 2018)
Jin, Y., Qiu, C., Sun, L., Peng, X., Zhou, J.: Anomaly detection in time series via robust PCA. In: 2017 2nd IEEE International Conference on Intelligent Transportation Engineering (ICITE), pp. 352–355 (2017)
Keogh, E.J., Pazzani, M.J.: Scaling up dynamic time warping for datamining applications. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’00, New York, NY, USA, Association for Computing Machinery, pp. 285–289 (2000)
Khurana, D., Koli, A., Khatter, K., Singh, S.: Natural language processing: state of the art, current trends and challenges. Multimed. Tools Appl. 82(3), 3713–3744 (2022)
Li, D., Chen, D., Shi, L., Jin, B., Goh, J., Ng, S.K.: Mad-gan: Multivariate anomaly detection for time series data with generative adversarial networks (2019)
Lin, J., Keogh, E., Wei, L., Lonardi, S.: Experiencing sax: A novel symbolic representation of time series. Data Min. Knowl. Discov. 15, 107–144 (2007)
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., Shroff, G.: Lstm-based encoder-decoder for multi-sensor anomaly detection (2016)
Martínez, A., Sánchez, L., Couso, I.: Engine health monitoring for engine fleets using fuzzy radviz. In: 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp. 1–8 (2013)
Melamud, O., McClosky, D., Patwardhan, S., Bansal, M.: The role of context types and dimensionality in learning word embeddings. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, California, Association for Computational Linguistics, pp. 1030–1040 (2016)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality (2013)
Moody, G., Mark, R.: The impact of the MIT-BIH arrhythmia database. IEEE Eng. Med. Biol. Mag. 20(3), 45–50 (2001)
Nakamura, T., Imamura, M., Mercer, R., Keogh, E.J.: Merlin: Parameter-free discovery of arbitrary length anomalies in massive time series archives. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 1190–1195 (2020)
Nalmpantis, C., Vrakas, D. In: Signal2Vec: Time Series Embedding Representation, pp. 80–90 (2019)
Nedelkoski, S., Bogatinovski, J., Mandapati, A.K., Becker, S., Cardoso, J., Kao, O.: Multi-source distributed system data for AI-powered analytics. In: Brogi, A., Zimmermann, W., Kritikos, K. (eds.) Service-Oriented and Cloud Computing, pp. 161–176. Springer International Publishing, Cham (2020)
Palacios, A., Martínez, A., Sánchez, L., Couso, I.: Sequential pattern mining applied to aeroengine condition monitoring with uncertain health data. Eng. Appl. Artif. Intell. 44, 10–24 (2015)
Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Rosso, G.: Extreme value theory for time series using peak-over-threshold method (2015)
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., Pei, D.: Robust anomaly detection for multivariate time series through stochastic recurrent neural network. KDD ’19, New York, NY, USA, Association for Computing Machinery, pp. 2828–2837 (2019)
Tabassum, N., Menon, S., Jastrzȩbska, A.: Time-series classification with safe: Simple and fast segmented word embedding-based neural time series classifier. Inform. Process. Manage. 59(5), 103044 (2022)
Tuli, S., Casale, G., Jennings, N.R.: Tranad: Deep transformer networks for anomaly detection in multivariate time series data (2022)
Yu, Q., Jibin, L., Jiang, L.: An improved arima-based traffic anomaly detection algorithm for wireless sensor networks. Int. J. Distrib. Sensor Netw. 2016, 1–9 (2016)
Zhao, H., et al.: Multivariate time-series anomaly detection via graph attention network (2020)
Zhong, S., Fu, S., Lin, L., Fu, X., Cui, Z., Wang, R.: A novel unsupervised anomaly detection for gas turbine using isolation forest. 06, 1–6 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Pérez, L., Costa, N., Sánchez, L. (2023). Enhancing Time Series Anomaly Detection Using Discretization and Word Embeddings. In: García Bringas, P., et al. 18th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2023). SOCO 2023. Lecture Notes in Networks and Systems, vol 750. Springer, Cham. https://doi.org/10.1007/978-3-031-42536-3_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-42536-3_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42535-6
Online ISBN: 978-3-031-42536-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)