Abstract
Internet of things (IoT) applications deploy massive number of sensors to monitor the system and environment. Anomaly detection on streaming sensor data is an important task for IoT maintenance and operation. However, there are two major challenges for anomaly detection in real IoT applications: (1) many sensors report categorical values rather than numerical readings; (2) the end users may not understand the detection results, they require additional knowledge and explanations to make decision and take action. Unfortunately, most existing solutions cannot satisfy such requirements. To bridge the gap, we design and develop an eXplainable Anomaly Detection System (XADS) for categorical sensor data. XADS trains models from historical normal data and conducts online monitoring. XADS detects the anomalies in an explainable way: the system not only reports anomalies’ time periods, types, and detailed information, but also provides explanations on why they are abnormal, and what the normal data look like. Such information significantly helps the decision making for users. Moreover, XADS requires limited parameter setting in advance, yields high accuracy on detection results and comes with a user-friendly interface, making it an efficient and effective tool to monitor a wide variety of IoT applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Li, X., Han, J.: Mining approximate top-k subspace anomalies in multi-dimensional time-series data. In: 33rd International Conference on Very Large Data Bases, pp. 447–458 (2007)
Gao, Y., Yang, T., Xu, M., Xing, N.: An unsupervised anomaly detection approach for spacecraft based on normal behavior clustering. In: 2012 Fifth International Conference on Intelligent Computation Technology and Automation, pp. 478–481 (2012)
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., Soderstrom, T.: Detecting spacecraft anomalies using LSTMs and nonparametric dynamic thresholding. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 387–395 (2018)
Tang, L.A., Cui, B., Li, H., Miao, G., Yang, D., Zhou, X.: Effective variation management for pseudo periodical streams. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, pp. 257–268 (2007)
Wu, H., Salzberg, B., Zhang, D.: Online event-driven subsequence matching over financial data streams. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, pp. 23–34 (2004)
Wu, H., Sharp, G.C., Salzberg, B., Kaeli, D., Shirato, H., Jiang, S.B.: A finite state model for respiratory motion analysis in image guided radiation therapy. Phys. Med. Biol. 49(23), 5357 (2004)
Wu, H., Salzberg, B., Sharp, G.C., Jiang, S.B., Shirato, H., Kaeli, D.: Subsequence matching on structured time series data. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pp. 682–693 (2005)
Schwabacher, M., Oza, N., Matthews, B.: Unsupervised anomaly detection for liquid-fueled rocket propulsion health monitoring. J. Aerosp. Comput. Inf. Commun. 6(7), 464–482 (2009)
Tang, S., Shelden, D.R., Eastman, C.M., Pishdad-Bozorgi, P., Gao, X.: A review of building information modeling (BIM) and the internet of things (IoT) devices integration: present status and future trends. Autom. Constr. 101, 127–139 (2019)
Chen, H., Horak, M., Narayanappa, S., Woodward, K.: Integrating AI into planning, diagnostic, and prescription systems for human & robotic deep space exploration missions. In: AAAI 2018 Fall Symposium Series (2018)
Yuan, P., Tang, L.A., Chen, H., Sato, M., Woodward, K.: 3D histogram based anomaly detection for categorical sensor data in Internet of Things. Submitted to VLDB Workshop on Very Large Internet of Things (VLIoT 2022)
Hodge, V., Austin, J.: A survey of outlier detection methodologies. Artif. Intell. Rev. 22(2), 85–126 (2004)
Tamboli, J., Shukla, M.: A survey of outlier detection algorithms for data streams. In: 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), pp. 3535–3540 (2006)
Panjei, E., Gruenwald, L., Leal, E., Nguyen, C., Silvia, S.: A survey on outlier explanations. VLDB J., 1–32 (2021). https://doi.org/10.1007/s00778-021-00721-1
Acknowledgements
The authors would like to thank Matthew Horak, Giovanni A Tobar, Sowmya S Chandrasekaran, and Sadananda Narayanappa from Lockheed Martin Space for the constructive comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yuan, P., Tang, LA., Chen, H., Sato, M., Woodward, K. (2023). Explainable Anomaly Detection System for Categorical Sensor Data in Internet of Things. In: Amini, MR., Canu, S., Fischer, A., Guns, T., Kralj Novak, P., Tsoumakas, G. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2022. Lecture Notes in Computer Science(), vol 13718. Springer, Cham. https://doi.org/10.1007/978-3-031-26422-1_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-26422-1_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26421-4
Online ISBN: 978-3-031-26422-1
eBook Packages: Computer ScienceComputer Science (R0)
