Abstract
Sensor data often contains noise, outliers, missing values, and a significant number of duplicate values. The causes of such data quality problems include the sensors’ internal errors, a harsh environment in which the sensors are deployed, and data loss occurring during wireless transmission. Sensor data fusion consists of three steps, data pre-processing, data mining, and data post-processing. This chapter discusses data pre-processing and data mining. Data pre-processing includes data cleaning, outlier detection, missing values recovery, data reduction, and data prediction, etc. Neighbourhood support and tempo-spatial pattern extraction are introduced and applied to a generic sensor state model for event detection. The concept of in-network database is also introduced by presenting WSNs as a virtual distributed database.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Allison, P.D.: Missing Data Thousand Oaks. Sage Publications, CA (2001)
Akcan, H., Brönnimann, H.: A new deterministic data aggregation method for wireless sensor networks. Elsevier J. Sig. Process. 87(12), 2965–2977 (2007)
Basu, S., Meckesheimer, M.: Automatic outlier detection for time series: an application to sensor data. Knowl. Inf. Syst. 11(2), 137–154 (2007)
Bontempi, G., Borgne, Y. L.: An adaptive modular approach to the mining of sensor network data. In: Proceedings of 1st International Workshop on Data Mining in Sensor Networks as part of the SIAM International Conference on Data Mining (Newport Beach, CA, 21–23 April 2005), pp. 3–9. SIAM Press (2005)
Chok, H., Gruenwald, L.: An online spatio-temporal association rule mining framework for analysing and estimating sensor data. In: Proceedings of the 2009 International Database Engineering and Applications Symposium, pp. 217–226. Cetraro, Calabria, Italy (2009)
Chu, F., Wang, Y., Parker, D.S., Zaniolo, C.: Data cleaning using belief propagation. In: Proceedings of the 2nd international workshop on Information quality in information systems, pp. 99–104. Baltimore, Maryland, (2005)
Elnahrawy, E., Nath, B.: Cleaning and querying noisy sensors. In: Proceedings of 2nd ACM International Conference on Wireless Sensor Networks and Applications, pp. 78–87. San Diego, CA, USA, (2003)
Govindan, R., Hellerstein, J., Hong, W., Madden, S., Franklin, M., Shenker, S.: The sensor network as a database. Technical Report 02-771, Computer Science Department, University of Southern California (2002)
Halatchev, M., Gruenwald, L.: Estimating missing values in related sensor data streams. In: Proceedings of the International Conference on Management of Data, pp. 83–94. Goa, India (2005)
Han, J., Kamber, M., Pei, J.: Data mining concepts and techniques. Morgan Kaufmann, MA, USA (2011)
Jeffery, S. R., Alonso, G., Franklin, M. J., Hong, W., Widom, J.: A pipelined framework for online cleaning of sensor data streams. In: Proceedings of the 22nd International Conference on Data Engineering, pp. 140–143. Atlanta, GA (2006)
Kim, C.H., Park, K., Fu, J., Elmasri, R.: Architectures for streaming data processing in sensor networks. In: Proceedings of the 3rd ACS/IEEE International Conference on Computer Systems and Applications, p. 59. Washington, DC (2005)
Moon, T.K.: The expectation maximization algorithm. IEEE Sig. Process. Mag. 13, 47–60 (1996)
Mukherji, A., Rundensteiner, E.A., Brown, D.C., Raghavan, V.: SNIF TOOL: Sniffing for patterns in continuous streams. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management, pp. 369–378. Napa Valley, California, USA (2008)
Santini, S., Römer, K.: An adaptive strategy for quality-based data reduction in wireless sensor networks. In: Proceedings of the 3rd International Conference on Networked Sensing Systems, pp. 29–36. Chicago (2006)
Silberstein, A., Braynard, R., Filpus, G., Puggioni, G., Gelfand, A., Munagala, K., Yang, J.: Data-driven processing in sensor networks. In: Proceedings of 3rd Biennial Conference on Innovative Data Systems Research (CIDR), pp. 10–21. Asilomar, California (2007)
Tan, P.: Knowledge discovery from sensor data, available online at: http://www.sensorsmag.com/sensors/article/articleDetail.jsp?id=317466 (2006)
Xue, W., Luo, Q., Chen, L., Liu, Y.: Contour map matching for event detection in sensor networks. In: Proceedings of the ACM SIGMOD international Conference on Management of Data, pp. 145–156. Chicago, USA, (2006)
Yang, Y., May, A., Yang, S.H.: Sensor data processing for emergency response. Int. J. Emergency Manage. 7(3/4), 233–248 (2010)
Yang, Y., May, A., Yang, S.H.: A generic state model with neighbourhood support from wireless sensor networks for emergency event detection. Int. J. Emergency Manage. 8(2), 135–152 (2012)
Zhuang, Y., Chen, L., Wang, X.S., Lian, X.: A weighted moving average-based approach for cleaning sensor data. In: Proceedings of 27th International Conference on Distributed Computing Systems (ICDC’07), pp. 38–45. Toronto (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Yang, SH. (2014). Sensor Data Fusion and Event Detection. In: Wireless Sensor Networks. Signals and Communication Technology. Springer, London. https://doi.org/10.1007/978-1-4471-5505-8_8
Download citation
DOI: https://doi.org/10.1007/978-1-4471-5505-8_8
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-5504-1
Online ISBN: 978-1-4471-5505-8
eBook Packages: EngineeringEngineering (R0)