Advertisement

HCS: Expanding H-Code RAID 6 without Recalculating Parity Blocks in Big Data Circumstance

  • Shiying Xia
  • Yu Mao
  • Minsheng Tan
  • Weipeng Jing
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 503)

Abstract

This paper introduces a new RAID 6 expanding method HCS, which is facing the circumstance of big data. HCS expands H-Code manner RAID 6. Two key techniques are used to avoid parity blocks’ recalculating. The first one is anti-diagonal data blocks’ selection, and the other one is horizontal data migration. These two techniques ensure the data blocks are retained in the same verification zone, that is horizontal verification zone and anti-diagonal verification zone. Experimental results showed that, compared with SDM, which is also a fast expansion method, HCS can reduce 3.6% expansion time and promote 4.62% performance under four traces.

Keywords

Big data H-Code RAID expanding Horizontal coding Anti-diagonal parity Horizontal parity 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Patterson, D., Katz, G.R.: A case for redundant arrays of inexpensive disks(raid). In: Proceeding of the SIGMOD 1988 (1988)Google Scholar
  2. 2.
    Peter, M., Chen, E.K.L.: Raid: High-performance, reliable secondary storage. ACM Computing Surveys 26, 145–185 (1994)CrossRefGoogle Scholar
  3. 3.
    Wu, C., Wan, S.: H-code: A hybrid mds array code to optimize partial stripe writes in raid-6. In: Parallel and Distributed Processing Symposium (IPDPS), pp. 782–793 (2011)Google Scholar
  4. 4.
    Jin, C., Jiang, H.: P-code: A new raid-6 code with optimal properties. In: Proceedings of the 23rd International Conference on Supercomputing, pp. 360–369 (2009)Google Scholar
  5. 5.
    Cassuto, Y., Bruck, J.: Cyclic lowest density mds array codes. IEEE Trans. on Information Theory 55, 1721–1729 (2009)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Wu, C., He, X., Wu, G.: HDP code: A horizontal-diagonal parity code to optimize i/o load balancing in raid-6. In: Proceeding of the DSN 2011 (2011)Google Scholar
  7. 7.
    Xu, L., Bruck, J.: X-code: Mds array codes with optimal encoding. IEEE Trans. on Information Theory 45, 272–276 (1999)CrossRefMathSciNetMATHGoogle Scholar
  8. 8.
    Xu, L., Bruck, J.: Low-density mds codes and factors of complete graphs. IEEE Trans. on Information Theory 45, 1817–1826 (1999)CrossRefMathSciNetMATHGoogle Scholar
  9. 9.
    Corbett, P., English, B., Goel, A.: Row-diagonal parity for double disk failure correction. In: Proceedings of the 3rd USENIX Conference on File and Storage Technologies (2004), pp. 1–14 (2004)Google Scholar
  10. 10.
    Blaum, M., Brandy, J., Bruck, J.: Evenodd: An efficient scheme for tolerating double disk failure in raid architectures. IEEE Trans. on Computers 44, 192–202 (1995)CrossRefMATHGoogle Scholar
  11. 11.
    Blaum, M., Roth, R.: On lowest density mds codes. IEEE Trans. on Information Theory 45, 46–59 (1999)CrossRefMathSciNetMATHGoogle Scholar
  12. 12.
    Reed, I., Solomon, G.: Polynomial codes over certain finite fields. J. of the Society for Indus. and Applied Math., 300–304 (1960)Google Scholar
  13. 13.
    Plank, J.: The raid-6 liberation codes. In: Proc. of the FAST 2008 (2008)Google Scholar
  14. 14.
    Brown, N.: Online RAID-5 Resizing. Drivers/md/raid5.c in the source code of Linux Kernel 2.6.18, http://www.kernel.org/ (September 2006)
  15. 15.
    Gonzalez, J.L., Cortes, T.: Increasing the capacity of raid5 by online gradual assimilation. In: Proceedings of the International Workshop on Storage Network Architecture and Parallel I/Os - SNAPI 2004, pp. 17–24 (2004)Google Scholar
  16. 16.
    Blaum, M., Brandy, J., Bruck, J.: Slas: An efficient approach to scaling round-robin striped volumes. ACM Transactions on Storage 3 (2007)Google Scholar
  17. 17.
    Zhang, G., Zheng, W., Shu, J.: Alv: A new data redistribution approach to raid-5 scaling. IEEE Transactions on Computers 59, 345–357 (2010)CrossRefMathSciNetGoogle Scholar
  18. 18.
    Zheng, W., Zhang, G.: Fastscale: accelerate raid scaling by minimizing data migration. In: Proceedings of the 19th USENIX conference on File and Storage Technologies (2011)Google Scholar
  19. 19.
    Mao, Y., Wan, J., Zhu, Y., Xie, C.: A new parity-based migration method to expand raid-5. IEEE Transactions on Parallel and Distributed Systems 25, 1945–1954 (2014)CrossRefGoogle Scholar
  20. 20.
    Legg, C.B.: Method of increasing the storage capacity of a level five RAID disk array by adding, in a single step, a new parity block and n-1 new data blocks which respectively reside in a new columns (December 1999)Google Scholar
  21. 21.
    Corbett, P.F., Kleiman, S.R., English, R.M.: Semi-static distribution technique, US Patent 7,185,144 (February 2007)Google Scholar
  22. 22.
    Wu, C., He, X., Han, J., Tan, H.: Sdm: A stripe-based data migration scheme to improve the scalability of raid-6. In: 2012 IEEE International Conference on Cluster Computing (CLUSTER), pp. 284–292 (2012)Google Scholar
  23. 23.
    Jin, C., Jiang, H., Feng, D., Tian, L.: P-code: A new raid-6 code with optimal properties. In: Proceedings of the 23rd International Conference on Supercomputing (2009)Google Scholar
  24. 24.
    Corbett, P., English, B., Goel, A.: Row-diagonal parity for double disk failure correction. In: Proceedings of the 3rd USENIX Conference on File and Storage Technologies, pp. 1–14 (2004)Google Scholar
  25. 25.
    (DiskSim) University of Michigan and Carnegie Mellon University, http://www.pdl.cmu.edu/DiskSim
  26. 26.
    Narayanan, D., Donnelly, A., Rowstron, A.: Write offloading: Practical power manage-ment for enterprise storage. ACM Transactions on Storage 4, 1–23 (2008)CrossRefGoogle Scholar
  27. 27.
    (SNIA) Storage Networking Industry Association,FIU-Home2 block I/O trace (2010), http://iotta.snia.org/traces/414
  28. 28.
    (Storage) Financial1.spc and Financial2.spc., http://traces.cs.umass.edu/index.php/Storage/

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Shiying Xia
    • 1
  • Yu Mao
    • 2
  • Minsheng Tan
    • 1
  • Weipeng Jing
    • 3
  1. 1.University of South ChinaHengyangChina
  2. 2.Hengyang Normal UniversityChina
  3. 3.College of Information and Computer EngineeringNortheast Forestry UniversityChina

Personalised recommendations