Skip to main content
Log in

Satisfaction-based query replication

An automatic and self-adaptable approach for replicating queries in the presence of autonomous participants

  • Published:
Distributed and Parallel Databases Aims and scope Submit manuscript

Abstract

In large-scale Internet-based distributed systems, participants (consumers and providers) are typically autonomous, i.e. they may have special interests towards queries and other participants. In this context, a way to avoid a participant to voluntarily leave the system is satisfying its interests when allocating queries. However, participants satisfaction may also be negatively affected by the failures of other participants. Query replication is a solution to deal with providers failures, but, it is challenging because of autonomy: it cannot only quickly overload the system, but also it can dissatisfy participants with uninteresting queries. Thus, a natural question arises: should queries be replicated? If so, which ones? and how many times? In this paper, we answer these questions by revisiting query replication from a satisfaction and probabilistic point of view. We propose a new algorithm, called S b QR, that decides on-the-fly whether a query should be replicated and at which rate. As replicating a large number of queries might overload the system, we propose a variant of our algorithm, called S b QR+. The idea is to voluntarily fail to allocate as many replicas as required by consumers for low critical queries so as to keep resources for high critical queries during query-intensive periods. Our experimental results demonstrate that our algorithms significantly outperform the baseline algorithms from both the performance and satisfaction points of view. We also show that our algorithms automatically adapt to the criticality of queries and different rates of participant failures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Assayad, I., Girault, A., Kalla, H.: A Bi-criteria scheduling heuristics for distributed embedded systems under reliability and real-time constraints. In: DSN (2004)

    Google Scholar 

  2. Balazinska, M., Balakrishnan, H., Madden, S.R., Stonebraker, M.: Fault-tolerance in the Borealis distributed stream processing system. ACM Trans. Database Syst. 33(1), 1–44 (2008)

    Article  Google Scholar 

  3. Berten, V., Goossens, J., Jeannot, E.: A probabilistic approach for fault tolerant multiproc. Real-time scheduling. In: IPDPS (2006)

    Google Scholar 

  4. Bhagwan, R., Savage, S., Voelker, G.M.: Understanding availability. In: IPTPS (2003)

    Google Scholar 

  5. Budhiraja, N., Marzullo, K., Schneider, F., Toueg, S.: The primary-backup approach. In: Distributed Systems, pp. 199–216. ACM Press, New York (1993)

    Google Scholar 

  6. Castro, M., Costa, M., Rowstron, A.: Performance and dependability of structured peer-to-peer overlays. In: DSN (2004)

    Google Scholar 

  7. Chandramouli, B., Bond, C., Babu, S., Yang, J.: Query suspend and resume. In: SIGMOD (2007)

    Google Scholar 

  8. Ghosh, S., Melhem, R., Mossé, D.: Fault-tolerant scheduling on a hard real-time multiprocessor system. In: IPDPS (1994)

    Google Scholar 

  9. Girault, A., Kalla, H., Sorel, Y.: An active replication scheme that tolerates failures in dist. Embedded real-time systems. In: DSN (2003)

    Google Scholar 

  10. Hashimoto, K., Tsuchiya, T., Kikuno, T.: Effective scheduling of duplicated tasks for fault-tolerance in multiprocessor systems. IEICE Trans. Inf. Syst. E85-D(3) (2002)

  11. Kim, J., Lee, H., Lee, S.: Replicated process allocation for load distribution in fault-tolerant multicomputers. IEEE Comput. 46(4) (1997)

  12. Kossmann, D.: The state of the art in distributed query processing. ACM Comput. Surv. 32(4), 422–469 (2000)

    Article  Google Scholar 

  13. Ni, L., Harwood, A.: A comparative study on peer-to-peer failure rate estimation. In: ICPADS (2007)

    Google Scholar 

  14. Pentaris, F., Ioannidis, Y.: Query optimization in distributed networks of autonomous database systems. ACM Trans. Database Syst. 31(2) (2006)

  15. Pieper, S., Paul, J., Schulte, M.: A new era of performance evaluation. IEEE Comput. 40(9) (2007)

  16. Qu, H., Labrinidis, A., Mosse, D.: UNIT: user-centric transaction management in web-database systems. In: ICDE (2006)

    Google Scholar 

  17. Quiané-Ruiz, J.A., Lamarre, P., Cazalens, S., Valduriez, P.: Scaling up query allocation in the presence of autonomous participants. In: DASFAA (2011)

    Google Scholar 

  18. Quiané-Ruiz, J.A., Lamarre, P., Valduriez, P.: A self-adaptable query allocation framework for distributed information systems. VLDB J. 18(3), 649–674 (2009)

    Article  Google Scholar 

  19. Rahm, E., Marek, R.: Dynamic multi-resource load balancing in parallel DB systems. In: VLDB (1995)

    Google Scholar 

  20. Roussopoulos, M., Baker, M.: Practical load balancing for content requests in P2P networks. Distrib. Comput. 18(6) (2006)

  21. Saroiu, S., Gummadi, P.K., Gribble, S.D.: Measuring and analyzing the characteristics of Napters and Gnutella hosts. Multimed. Syst. 9(2), 170–184 (2003)

    Article  Google Scholar 

  22. Schneider, F.: Replication management using the state-machine approach. In: Distributed Systems, pp. 169–197. ACM Press, New York (1993)

    Google Scholar 

  23. Shatz, S., Wang, J.P., Goto, M.: Task alloc. for maximizing reliability of dist. com. systems. IEEE Comput. 41(9) (1992)

  24. Wolf, G., et al.: Query processing over incomplete autonomous databases. In: VLDB (2007)

    Google Scholar 

  25. Yu, H., Vahdat, A.: The costs and limits of availability for replicated services. In: SOSP (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jorge-Arnulfo Quiané-Ruiz.

Additional information

Communicated by M. Tamer Özsu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Quiané-Ruiz, JA., Lamarre, P. & Valduriez, P. Satisfaction-based query replication. Distrib Parallel Databases 30, 1–26 (2012). https://doi.org/10.1007/s10619-011-7086-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10619-011-7086-7

Keywords

Navigation