DRO+: A Systemic and Economical Approach to Improve Availability of Massive Database Systems

  • Kai Du
  • Huaimin Wang
  • Bo Deng
  • Yongheng Wang
  • Shuqiang Yang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4256)


Because of the huge scale and numerous components, a massive database system’s availability has become a serious challenge. Many database replication technologies are used to increase the MTTF, but few are provided to decrease MTTR in massive database systems where the traditional backup methods are not feasible for expensive human cost. Based on analyzing the characteristics of the data in massive databases, we propose a novel approach called Detaching Read-Only (DRO) mechanism and its variation DRO+. It decreases MTTR through reducing the size of physically changing data in every database by detaching data on node granularity. The analysis and experiment results show that our approach can not only reduce MTTR by an order of magnitude, but also reduce the expensive human cost without extra hardware cost.


Massive System Replication Mechanism Human Cost Database Cluster Massive Database 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gray, J., Szalay, A.: Science in an exponential world. Nature 440, 23 (2006)CrossRefGoogle Scholar
  2. 2.
    Gray, J., Shenoy, P.: Rules of Thumb in Data Engineering. In: ICDE 2000 (2000)Google Scholar
  3. 3.
    Becla, J., Wang, D.: Lessons Learned from Managing a Petabyte. In: CIDR 2005 (2005)Google Scholar
  4. 4.
    Gelman, B.: V2LDB. In: CIDR 2005 (2005)Google Scholar
  5. 5.
    Nagaraja, K., Li, X., Zhang, B., Bianchini, R., Martin, R., Nguyen, T.: Using Fault Injection and Modeling to Evaluate the Performability of Cluster-Based Services. In: Proceedings of the Usenix Symposium on Internet Technologies and Systems (March 2003)Google Scholar
  6. 6.
    Silberschatz, A., Korth, H.F., Sudarshan, S.: Database System Concepts, 4th edn., pp. 461–470. China Machine PressGoogle Scholar
  7. 7.
    Cecchet, E.: C-JDBC: a Middleware Framework for Database Clustering. IEEE Computer Society Technical Committee on Data Engineering (2004)Google Scholar
  8. 8.
    Breitbart, Y., Komondoor, R., Rastogi, R., Seshadri, S., Silberschatz, A.: Update Propagation Protocols For Replicated Databases. In: SIGMOD 1999 (1999)Google Scholar
  9. 9.
    Patterson, D.A., Brown, A., Broadwell, P., Candea, G., Chen, M., Cutler, J., Enriquez, P., Fox, A., Kiciman, E., Merzbacher, M., Oppenheimer, D., Sastry, N., Tetzlaff, W., Traupman, J., Treuhaft, N.: Recovery-Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies. UC Berkeley Computer Science Technical Report UCB//CSD-02-1175, March 15 (2002)Google Scholar
  10. 10.
    Cai, Y.D., Aydt, R., Brunner, R.J.: Optimized Data Loading for a Multi-Terabyte Sky Survey Repository. In: Proc. Super Computing 2005 (2005)Google Scholar
  11. 11.
    Szalay, A., Kunszt, P., Thakar, A., Gray, J., Brunner, R.: Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey. In: Proc. SIGMOD 2000 (2000)Google Scholar
  12. 12.
  13. 13.
    Wiesmann, M., Pedone, F., Schiper, A., Kemme, B., Alonso, G.: Transaction Replication Techniques: a Three Parameter Classification. In: SRDS 2000 (2000)Google Scholar
  14. 14.
    Abadi, D.J., Madden, S.R., Ferreira, M.C.: Integrating Compression and Execution in Column-Oriented Database Systems. In: Proceedings of SIGMOD 2006 (2006)Google Scholar
  15. 15.
    Hitt, E.F.: Total ownership cost use in management. In: Digital Avionics Systems Conference 1998 (1998)Google Scholar
  16. 16.
    Weikum, G., Moenkeberg, A., Hasse, C., Zabback, P.: Self-tuning Database Technology and Information Services: from Wishful Thinking to Viable Engineering. In: VLDB 2002 (2002)Google Scholar
  17. 17.
  18. 18.
    Gray, J., Helland, P., O’Neil, P., Shasha, D.: The Dangers of Replication and a Solution. In: ACM SIGMOD 1996 (1996)Google Scholar
  19. 19.
    Sousa, A., Pereira, J., Soares, L., Correia Jr., A., Rocha, L., Oliveira, R., Moura, F.: Testing the Dependability and Performance of Group Communication Based Database Replication Protocols. In: Dependable Systems and Networks (DSN) (2005)Google Scholar
  20. 20.
    Building Highly Available Database Servers Using Oracle Real Application Clusters. An Oracle White Paper (May 2001)Google Scholar
  21. 21.
    Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google File System. In: The ACM Symposium on Operating Systems Principles (SOSP) (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kai Du
    • 1
  • Huaimin Wang
    • 1
  • Bo Deng
    • 1
  • Yongheng Wang
    • 1
  • Shuqiang Yang
    • 1
  1. 1.National Laboratory for Parallel and Distributed ProcessingChangshaChina

Personalised recommendations