Abstract
The real-time data processing is becoming a key aspect in relation to the Internet of things (IoT) applications. The IoT is characterized by the heterogeneity of the devices, and for that reason, the data providing rate of each one is variable and unpredictable. Because the data arriving rate from the data sources could exceed the data processing rate, the use of the load-shedding techniques is necessary. The metadata-guided processing strategy is a real-time data processing schema which the project definitions are based on a framework. Here, a new load-shedding technique based on the measurement project definition is introduced. This allows balancing between the data variability and the priority, retaining the important data based on the expert’s knowledge from the project definition and the variations of the data series related to each metric.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Provost, F., Fawcett, T.: Data science and its relationship to big data and data-driven decision making. Big Data 1(1), 51–59 (2013)
Mohan, L., Potnis, D.: Real-time decision-making to serve the unbanked poor in the developing world. In: Proceedings of the 2017 ACM SIGMIS Conference on Computers and People Research, Bangalore (2017)
Morales, G., Bifet, A.: SAMOA: scalable advanced massive online analysis. J. Mach. Learn. Res. 16, 149–153 (2015)
Jankov, D., Sikdar, S., Mukherjee, R., Teymourian, K. Jermaine, C.: Real-time high-performance anomaly detection over data streams: grand challenge. In: 11th ACM International Conference on Distributed and Event-based Systems, Barcelona, Spain (2017)
Saatkamp, K., Breitenbucher, U., Leymann, F., Wurster, M.: Generic driver injection for automated IoT application deployments. In: 19th International Conference on Information Integration and Web-based Applications & Services, Salzburg, Austria (2017)
Diván, M., Martín, M.: Towards a consistent measurement stream processing from heterogeneous data sources. Int. J. Electri. Comput. Eng. (IJECE) 7(6), 3164–3175 (2017)
Diván, M., Sánchez Reynoso, M.: Behavioural similarity analysis for supporting the recommendation in PAbMM. In: 1st International Conference on Infocom Technologies and Unmanned Systems (ICTUS), Dubai (2017)
Querzoni, L., Rivetti, N.: Data streaming and its application to stream processing: tutorial. In: 11th ACM International Conference on Distributed and Event-based Systems, Barcelona, Spain (2017)
Kalyvianaki, E., Fiscato, M., Salonidis, T. Pietzuch, P.: THEMIS: fairness in federated stream processing under overload. In: 2016 International Conference on Management of Data, San Francisco, California, USA (2016)
Pham, T., Chrysanthis, P., Labrinidis, A.: Avoiding class warfare: managing continuous queries with differentiated classes of service. VLDB J.—Int. J. Very Large Data Bases 25(2), 197–221 (2016)
Rivetti, N., Busnel, Y., Querzoni, L.: Load-aware shedding in stream processing systems. In 10th ACM International Conference on Distributed and Event-based Systems, Irvine, California (2016)
Diván, M., Sánchez Reynoso, M.: Fostering the interoperability of the measurement and evaluation project definitions in PAbMM. In: 7nd International Conference on Realiability, Infocom Technologies and Optimization (ICRITO’2018), Noida (2018)
Diván, M.: Applying the real-time monitoring based on wireless sensor networks: the Bajo Giuliani Project. In: 7th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO’2018), Noida, India (2018)
James, J., Witten, D., Hastie, T., Tibshirani, R.: An introduction to statistical learning with applications in R, 8th edn. Springer Science+Business Media, New York (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Diván, M.J., Sánchez Reynoso, M.L. (2020). A Load-Shedding Technique Based on the Measurement Project Definition. In: Jain, V., Patnaik, S., Popențiu Vlădicescu, F., Sethi, I. (eds) Recent Trends in Intelligent Computing, Communication and Devices. Advances in Intelligent Systems and Computing, vol 1006. Springer, Singapore. https://doi.org/10.1007/978-981-13-9406-5_122
Download citation
DOI: https://doi.org/10.1007/978-981-13-9406-5_122
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9405-8
Online ISBN: 978-981-13-9406-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)