Abstract
Unlike processing snapshot queries in a traditional DBMS, the processing of continuous queries in a data stream management system (DSMS) needs to satisfy quality requirements such as processing delay. When the system is overloaded, quality degrades significantly thus load shedding becomes necessary. Maintaining the quality of queries is a difficult problem because both the processing cost and data arrival rate are highly unpredictable. We propose a quality adaptation framework that adjusts the application behavior based on the current system status. We leverage techniques from the area of control theory in designing the quality adaptation framework. Our simulation results demonstrate the effectiveness of the control-based quality adaptation strategy. Comparing to solutions proposed in previous works, our approach achieves significantly better quality with less waste of resources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., Zdonik, S.: Monitoring Streams - A New Class of Data Management Applications. In: Procs. of the 28th VLDB Conf., pp. 84–89 (2002)
Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Motwani, R., Nishizawa, I., Srivastava, U., Thomas, D., Barma, R., Widom, J.: STREAM: The Stanford Stream Data Manager. IEEE Data Engineering Bulletin 26, 19–26 (2003)
Chandrasekaran, S., Deshpande, A., Franklin, M., Hellerstein, J., Hong, W., Krishnamurthy, S., Madden, S., Raman, V., Reiss, F., Shah, M.: TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In: Proceedings of 1st CIDR Conference (2003)
Olston, C., Jiang, J., Widom, J.: Adaptive Filters for Continuous Queries over Distributed Data Streams. In: Proceedings of ACM SIGMOD 2003, pp. 563–574 (2003)
Tatbul, N., Çetintemel, U., Zdonik, S., Cherniack, M., Stonebraker, M.: Load Shedding in a Data Stream Manager. In: Proceedings of the 29th VLDB Conference, pp. 309–320 (2003)
Zhang, M., Madhyastha, T., Chan, N., Papadimitriou, S., Faloutsos, C.: Data Mining Meets Performance Evaluation: Fast Algorithms for Modeling Bursty Traffic. In: Proceedings of the 18th ICDE Conference, pp. 507–516 (2002)
Nahrstedt, K., Steinmetz, R.: Resource Management in Networked Multimedia Systems. IEEE Computer 28, 52–63 (1995)
Arasu, A., Babcock, B., Babu, S., Datar, M., Rosenstein, J., Ito, K., Nishizawa, I., Widom, J.: Query Processing, Resource Management, and Approximation in a Data Stream Management System. In: Procs. of 1st CIDR Conf. (2003)
Babcock, B., Datar, M., Motwani, R.: Load Shedding for Aggregation Queries over Data Streams. In: Procs. of ICDE Conf. (2004)
Lu, C., Stankovic, J., Tao, G., Han, S.: Feedback Control Real-Time Scheduling: Framework, Modeling, and Algorithms. Journal of Real-Time Systems 23, 85–126 (2002)
Babcock, B., Babu, S., Datar, M., Motwani, R.: Chain: Operator Scheduling for Memory Minimization in Data Stream Systems. In: Proceedings of ACM SIGMOD 2003, pp. 253–264 (2003)
Cheng, R., Kalashnikov, D., Prabhakar, S.: Evaluating Probabilistic Queries over Imprecise Data. In: Proceedings of ACM SIGMOD 2003, pp. 551–562 (2003)
Franklin, G.F., Powell, J.D., Workman, M.L.: Digital Control of Dynamic Systems. Edison-Wesley, Massachusetts (1990)
Paraskevopoulos, P.N.: Modern Control Engineering. Marcel Dekker, New York (2002)
Abdelzaher, T., Sharma, V., Lu, C.: A Utilization Bound for Aperiodic Tasks and Priority Driven Scheduling. IEEE Trans. on Computers 53, 334–350 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tu, YC., Hefeeda, M., Xia, Y., Prabhakar, S., Liu, S. (2005). Control-Based Quality Adaptation in Data Stream Management Systems. In: Andersen, K.V., Debenham, J., Wagner, R. (eds) Database and Expert Systems Applications. DEXA 2005. Lecture Notes in Computer Science, vol 3588. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11546924_73
Download citation
DOI: https://doi.org/10.1007/11546924_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28566-3
Online ISBN: 978-3-540-31729-6
eBook Packages: Computer ScienceComputer Science (R0)