Advertisement

Supporting Fluctuating Transactional Workload

  • Ibrahima GueyeEmail author
  • Idrissa Sarr
  • Hubert Naacke
  • Joseph Ndong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9262)

Abstract

This work deals with a fluctuating workload as in social applications where users interact each other in a temporary fashion. The data on which a user group focuses form a bundle and can cause a peak if the frequency of interactions as well as the number of users is high. To manage such a situation, one solution is to partition data and/or to move them to a more powerful machine while ensuring consistency and effectiveness. However, two problems may be raised such as how to partition data in a efficient way and how to determine which part of data to move in such a way that data are located on one single site. To achieve this goal, we track the bundles formation and their evolution and measure their related load for two reasons: (1) to be able to partition data based on how they are required by user interactions; and (2) to assess whether a machine is still able of executing transactions linked to a bundle with a bounded latency. The main gain of our approach is to minimize the number of machines used while maintaining low latency at a low cost.

Keywords

Transaction Data placement Elasticity Load balancing 

References

  1. 1.
    Thomson, A., Diamond, T., Weng, S.C., Ren, K., Shao, P., Abadi, D.J.: Calvin: fast distributed transactions for partitioned database systems. In: SIGMOD, pp. 1–12 (2012)Google Scholar
  2. 2.
    Liu, B., Tatemura, J., Po, O., Hsiung, W.P., Hacigumus, H.: Automatic entity-grouping for oltp workloads. In: IEEE ICDE, pp. 712–723 (2014)Google Scholar
  3. 3.
    Apers, P.M.G.: Data allocation in distributed database systems. ACM TODS 13(3), 263–304 (1988)CrossRefGoogle Scholar
  4. 4.
    Madathil, D., Thota, R., Paul, P., Xie, T.: A static data placement strategy towards perfect load-balancing for distributed storage clusters. In: IEEE IPDPS, pp. 1–8 (2008)Google Scholar
  5. 5.
    Copeland, G., Alexander, W., Boughter, E., Keller, T.: Data placement in bubba. SIGMOD Rec. 17(3), 99–108 (1988)CrossRefGoogle Scholar
  6. 6.
    Mehta, M., DeWitt, D.J.: Data placement in shared-nothing parallel database systems. VLDB J. 6(1), 53–72 (1997)CrossRefGoogle Scholar
  7. 7.
    Sacca, D., Wiederhold, G.: Database partitioning in a cluster of processors. ACM TODS 10, 29–56 (1985)CrossRefzbMATHGoogle Scholar
  8. 8.
    Curino, C., Jones, E., Zhang, Y., Madden, S.: Schism: a workload-driven approach to database replication and partitioning. VLDB Endow. 3(1–2), 48–57 (2010)CrossRefGoogle Scholar
  9. 9.
    Abdul, Q., Kumar, K., Deshpande, A.: Sword: Scalable workload-aware data placement for transactional workloads. In: EDBT, pp. 430–441 (2013)Google Scholar
  10. 10.
    Trushkowsky, B., Bodík, P., Fox, A., Franklin, M.J., Jordan, M.I., Patterson, D.A.: The scads director: Scaling a distributed storage system under stringent performance requirements. In: 9th USENIX, FAST, pp. 12–12 (2011)Google Scholar
  11. 11.
    Serafini, M., Mansour, E., Aboulnaga, A., Salem, K., Rafiq, T., Minhas, U.F.: Accordion: elastic scalability for database systems supporting distributed transactions. PVLDB 7(12), 1035–1046 (2014)Google Scholar
  12. 12.
    Lee, J., Kwon, Y.S., Frber, F., Muehle, M., Lee, C., Bensberg, C., Lee, J.Y., Lee, A.H., Lehner, W.: Sap hana distributed in-memory database system: transaction, session, and metadata management. In: ICDE, IEEE Computer Society, pp. 1165–1173 (2013)Google Scholar
  13. 13.
    Pavlo, A., Curino, C., Zdonik, S.: Skew-aware automatic database partitioning in shared-nothing, parallel oltp systems. In: SIGMOD, pp. 61–72 (2012)Google Scholar
  14. 14.
    Redis Inc.: http://redis.io/. Online Retrieved on Aug 2014
  15. 15.
    Apache Storm: http://storm.incubator.apache.org/. Online Retrieved on Aug. 2014
  16. 16.
    Amstrong, T.G., Ponnekanti, V., Borthakur, D., Callaghan, M.: Linkbench: a database benchmark based on the facebook social graph. In: SIGMOD, PP. 1185–1196 (2013)Google Scholar
  17. 17.
    Amazon Web Services Pricing: http://aws.amazon.com/fr/ec2/pricing/. Online Retrieved on Nov 2014
  18. 18.
    Gueye, I.: Large scale web 2.0 transaction processing with on-demand dynamic resources adjustment: toward a transactional engine with energy saving. PhD thesis, University Cheikh Anta Diop (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Ibrahima Gueye
    • 1
    Email author
  • Idrissa Sarr
    • 1
  • Hubert Naacke
    • 2
    • 3
  • Joseph Ndong
    • 1
  1. 1.LID LaboratoryUniversity Cheikh Anta DiopDakarSenegal
  2. 2.Sorbonne UniversitésParisFrance
  3. 3.LIP6UPMC Univ Paris 06ParisFrance

Personalised recommendations