FDTM: Block Level Data Migration Policy in Tiered Storage System

  • Xiaonan Zhao
  • Zhanhuai Li
  • Leijie Zeng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6289)

Abstract

ILM and tiered storage system are designed to address the challenge of achieving balance between cost and storage performance. However, both of them are hard to implement fully automatic data migration by traditional solutions for which are mainly relying on administrators experience and need huge manual work for data migration according to storage configuration and IO access patterns. This paper proposes a novel bi-directional migration policy FDTM based on block-level data valuation and fully automatic migration process. FDTM aims to get a trade-off between storage QoS and migration costs by introducing double thresholds to narrow the migration scope of block-level data objects. Experiment and analysis show that FDTM is efficient at block-level data migration comparing with traditional migration policies. In addition, it could help pave the way to implement tiered storage system with fully automatic data migration.

Keywords

Data migration policy data valuation feedback Tiered Storage System 
Download to read the full conference paper text

References

  1. 1.
    What is storage virtualization. Veritus white paper, http://file.doit.com.cn/upfiles/2006/1027/0_230404_f1.pdf
  2. 2.
    Anderson, E., Hall, J., Hartline, J.D., Hobbs, M., Karlin, A.R., et al.: An experimental study of data migration algorithms. In: Proceedings of the 5th International Workshop on Algorithm Engineering, pp. 145–158. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Bucy, J.S., Schindler, J., Schlosser, S.W., Ganger, G.R.: The disksim simulation environment version 4.0 reference manual. Technical report cmu-pdl-08-101, carnegie mellon university (2008)Google Scholar
  4. 4.
    Golubchik, L., Khanna, S., Khuller, S., Thurimella, R., Zhu, A.: Approximation algorithms for data placement on parallel disks (2000)Google Scholar
  5. 5.
    Jin, H., Xiong, M., Wu, S.: Information value evaluation model for ilm. In: Proceedings of the 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and parallel/Distributed Computing, pp. 543–548. IEEE Computer Society Press, Los Alamitos (2008)CrossRefGoogle Scholar
  6. 6.
    Johnson, T., Miller, E.L.: Performance measurements of tertiary storage devices. In: Proceedings of the 24rd International Conference on Very Large Data Bases, Morgan Kaufmann Publishers Inc., San Francisco (1998)Google Scholar
  7. 7.
    Khuller, S., Kim, Y.A., Wan, Y.C.: Algorithms for data migration with cloning. In: Proceedings of the Twenty-Second ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 27–36. ACM, San Diego (2003)CrossRefGoogle Scholar
  8. 8.
    Li, C., Zhou, L.Z., Xing, C.X.: A cost model for data placement and access path selection problem in fc-san. Journal of Software (05) (2004)Google Scholar
  9. 9.
    Li, J.T., Prabhakar, S.: Data placement for tertiary storage. In: Proceeding of the 10th NASA Goddard Conference on Mass Storage Systems and Technologies/19th IEEE Symposium on Mass Storage Systems (MSS 2002), Adelphi, Maryland, USA, pp. 193–207 (2002)Google Scholar
  10. 10.
    Lu, C., Alvarez, G.A., Wilkes, J.: Aqueduct: Online data migration with performance guarantees. In: Proceeding of the USENIX Conference on File and Storage Technologies (FAST), Monterey, pp. 219–230 (2002)Google Scholar
  11. 11.
    Massiglia, P.: Exploiting multi-tier file storage effectively. Snia tutorial, SNIA (2009), http://www.snia.org/education/tutorials/2009/spring/file/paulmassiglia_exploiting_multi-tier_file_storagev05.pdf
  12. 12.
    Myllymaki, J., Livny, M.: Disk-tape joins: Synchronizing disk and tape access. In: Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, Ottawa, Ontario, Canada, pp. 279–290. ACM Press, New York (1995)Google Scholar
  13. 13.
    Narayanan, D., Thereska, E., Donnelly, A., Elnikety, S., Rowstron, A.: Migrating server storage to ssds: analysis of tradeoffs. In: EuroSys 2009: Proceedings of the 4th ACM European Conference on Computer Systems, pp. 145–158. ACM Press, New York (2009)Google Scholar
  14. 14.
    Peterson, M.: Ilm and tiered storage. Snia tutorial (January 2006), http://www.snia.org/forums/dmf/knowledge/dmf-ilm_and_tiered_storage_20060221.pdf
  15. 15.
    Prabhakar, S., Agrawal, D., Abbadi, A.E., Singh, A.: A brief survey of tertiary storage systems and research. In: Proceedings of the 1997 ACM Symposium on Applied Computing, pp. 155–157. ACM, San Jose (1997)CrossRefGoogle Scholar
  16. 16.
    Reiner, B., Hahn, K.: Optimized management of large-scale data sets stored onttertiary storage systems. IEEE, Distributed Systems Online 5(5) (2004)Google Scholar
  17. 17.
    Seo, B., Zimmermann, R.: Efficient disk replacement and data migration algorithms for large disk subsystems. ACM Transactions on Storage 1(3), 316–345 (2005)CrossRefGoogle Scholar
  18. 18.
    Shah, G., Voruganti, K., Shivam, P., del Mar Alvarez Rohena, M.: Ace: Classification for information lifecycle management. NASA Mass Storage Systems and Technologies (2006)Google Scholar
  19. 19.
    Shepard, L.: Sgi infinitestorage data migration facility(dmf) a new frontier in date lifecycle management. White paper, sgi, http://www.sgi.com/pdfs/3631.pdf
  20. 20.
    SNIA: Ilm definition and scope an ilm framework (July 2004) http://www.snia.org/forums/dmf/programs/ilmi/dmf-ilm-vision2.4.pdf
  21. 21.
    SUN: Best practices in data classification for information lifecycle management. Sun white paper, http://www.sun.com/storage/white-papers/best_practices_data_classification_ilm.pdf
  22. 22.
    Wang, D., Shu, J.W., Xue, W., Shen, M.M.: Self-adaptive hierachical storage management in san based on block-level. Chinese High Technology Letters (02) (2007)Google Scholar
  23. 23.
    Watson, R.W.: High performance storage system scalability: Architecture, implementation and experience. In: Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 145–159. IEEE Computer Society, Los Alamitos (2005)CrossRefGoogle Scholar
  24. 24.
    Xu, N.: A frequency-based self-adaptive data hierarchy policy. SCIENCE and TECHNOLOGY ASSOCIATION FORUM (03) (2009)Google Scholar
  25. 25.
    Zhao, X.N., Li, Z.H., Zeng, L.J.: A hierarchical storage strategy based on block-level data valuation. In: The Proceeding of the Fourth International Conference on Networked Computing and Advanced Information Management 2008 NCM 2008, Korea, pp. 36–41. IEEE, Korea (2008)CrossRefGoogle Scholar
  26. 26.
    Zhao, X., Li, Z., Zhang, X., Zeng, L.: Block level data migration in tiered storage. In: Proceeding of International Conference on Computer and Network Technology (ICCNT 2010). IEEE Computer Society Press, Bangkok (2010)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2010

Authors and Affiliations

  • Xiaonan Zhao
    • 1
  • Zhanhuai Li
    • 1
  • Leijie Zeng
    • 1
  1. 1.School of Computer Science and TechnologyNorthwestern Polytechnical UniversityXi’anChina

Personalised recommendations