Abstract
ILM and tiered storage system are designed to address the challenge of achieving balance between cost and storage performance. However, both of them are hard to implement fully automatic data migration by traditional solutions for which are mainly relying on administrators experience and need huge manual work for data migration according to storage configuration and IO access patterns. This paper proposes a novel bi-directional migration policy FDTM based on block-level data valuation and fully automatic migration process. FDTM aims to get a trade-off between storage QoS and migration costs by introducing double thresholds to narrow the migration scope of block-level data objects. Experiment and analysis show that FDTM is efficient at block-level data migration comparing with traditional migration policies. In addition, it could help pave the way to implement tiered storage system with fully automatic data migration.
Chapter PDF
Similar content being viewed by others
References
What is storage virtualization. Veritus white paper, http://file.doit.com.cn/upfiles/2006/1027/0_230404_f1.pdf
Anderson, E., Hall, J., Hartline, J.D., Hobbs, M., Karlin, A.R., et al.: An experimental study of data migration algorithms. In: Proceedings of the 5th International Workshop on Algorithm Engineering, pp. 145–158. Springer, Heidelberg (2001)
Bucy, J.S., Schindler, J., Schlosser, S.W., Ganger, G.R.: The disksim simulation environment version 4.0 reference manual. Technical report cmu-pdl-08-101, carnegie mellon university (2008)
Golubchik, L., Khanna, S., Khuller, S., Thurimella, R., Zhu, A.: Approximation algorithms for data placement on parallel disks (2000)
Jin, H., Xiong, M., Wu, S.: Information value evaluation model for ilm. In: Proceedings of the 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and parallel/Distributed Computing, pp. 543–548. IEEE Computer Society Press, Los Alamitos (2008)
Johnson, T., Miller, E.L.: Performance measurements of tertiary storage devices. In: Proceedings of the 24rd International Conference on Very Large Data Bases, Morgan Kaufmann Publishers Inc., San Francisco (1998)
Khuller, S., Kim, Y.A., Wan, Y.C.: Algorithms for data migration with cloning. In: Proceedings of the Twenty-Second ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 27–36. ACM, San Diego (2003)
Li, C., Zhou, L.Z., Xing, C.X.: A cost model for data placement and access path selection problem in fc-san. Journal of Software (05) (2004)
Li, J.T., Prabhakar, S.: Data placement for tertiary storage. In: Proceeding of the 10th NASA Goddard Conference on Mass Storage Systems and Technologies/19th IEEE Symposium on Mass Storage Systems (MSS 2002), Adelphi, Maryland, USA, pp. 193–207 (2002)
Lu, C., Alvarez, G.A., Wilkes, J.: Aqueduct: Online data migration with performance guarantees. In: Proceeding of the USENIX Conference on File and Storage Technologies (FAST), Monterey, pp. 219–230 (2002)
Massiglia, P.: Exploiting multi-tier file storage effectively. Snia tutorial, SNIA (2009), http://www.snia.org/education/tutorials/2009/spring/file/paulmassiglia_exploiting_multi-tier_file_storagev05.pdf
Myllymaki, J., Livny, M.: Disk-tape joins: Synchronizing disk and tape access. In: Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, Ottawa, Ontario, Canada, pp. 279–290. ACM Press, New York (1995)
Narayanan, D., Thereska, E., Donnelly, A., Elnikety, S., Rowstron, A.: Migrating server storage to ssds: analysis of tradeoffs. In: EuroSys 2009: Proceedings of the 4th ACM European Conference on Computer Systems, pp. 145–158. ACM Press, New York (2009)
Peterson, M.: Ilm and tiered storage. Snia tutorial (January 2006), http://www.snia.org/forums/dmf/knowledge/dmf-ilm_and_tiered_storage_20060221.pdf
Prabhakar, S., Agrawal, D., Abbadi, A.E., Singh, A.: A brief survey of tertiary storage systems and research. In: Proceedings of the 1997 ACM Symposium on Applied Computing, pp. 155–157. ACM, San Jose (1997)
Reiner, B., Hahn, K.: Optimized management of large-scale data sets stored onttertiary storage systems. IEEE, Distributed Systems Online 5(5) (2004)
Seo, B., Zimmermann, R.: Efficient disk replacement and data migration algorithms for large disk subsystems. ACM Transactions on Storage 1(3), 316–345 (2005)
Shah, G., Voruganti, K., Shivam, P., del Mar Alvarez Rohena, M.: Ace: Classification for information lifecycle management. NASA Mass Storage Systems and Technologies (2006)
Shepard, L.: Sgi infinitestorage data migration facility(dmf) a new frontier in date lifecycle management. White paper, sgi, http://www.sgi.com/pdfs/3631.pdf
SNIA: Ilm definition and scope an ilm framework (July 2004) http://www.snia.org/forums/dmf/programs/ilmi/dmf-ilm-vision2.4.pdf
SUN: Best practices in data classification for information lifecycle management. Sun white paper, http://www.sun.com/storage/white-papers/best_practices_data_classification_ilm.pdf
Wang, D., Shu, J.W., Xue, W., Shen, M.M.: Self-adaptive hierachical storage management in san based on block-level. Chinese High Technology Letters (02) (2007)
Watson, R.W.: High performance storage system scalability: Architecture, implementation and experience. In: Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 145–159. IEEE Computer Society, Los Alamitos (2005)
Xu, N.: A frequency-based self-adaptive data hierarchy policy. SCIENCE and TECHNOLOGY ASSOCIATION FORUM (03) (2009)
Zhao, X.N., Li, Z.H., Zeng, L.J.: A hierarchical storage strategy based on block-level data valuation. In: The Proceeding of the Fourth International Conference on Networked Computing and Advanced Information Management 2008 NCM 2008, Korea, pp. 36–41. IEEE, Korea (2008)
Zhao, X., Li, Z., Zhang, X., Zeng, L.: Block level data migration in tiered storage. In: Proceeding of International Conference on Computer and Network Technology (ICCNT 2010). IEEE Computer Society Press, Bangkok (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 IFIP International Federation for Information Processing
About this paper
Cite this paper
Zhao, X., Li, Z., Zeng, L. (2010). FDTM: Block Level Data Migration Policy in Tiered Storage System. In: Ding, C., Shao, Z., Zheng, R. (eds) Network and Parallel Computing. NPC 2010. Lecture Notes in Computer Science, vol 6289. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15672-4_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-15672-4_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15671-7
Online ISBN: 978-3-642-15672-4
eBook Packages: Computer ScienceComputer Science (R0)