Improving Hypervisor Based SSD Caching with Logically Partitioned Blocks and Scanning in Cloud Environment

  • Hee Jung Park
  • Kyung Tae Kim
  • Byungjun Lee
  • Rhee Man Kil
  • Hee Yong Youn
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 612)


In the era of big data and cloudcomputing the virtual machine (VM) environment is important where multiple VMs of different operating system and application can be simultaneously run on the same host. In the VM environment the conventional hard disk drive (HDD) has limitations such as low random access performance and high power consumption. Solid State Drive (SSD) is an emerging storage technology, playing a critical role in revolutionizing the storage system design. Recently, SSD storage caching is widely studied for VM-based systems. The existing works on cache space allocation identify the space demand of each VM based on hit ratio. They are not effective for the VMs of shared SSD cache due to the filte ring effect of higher-level caches. In this paper we propose a novel hypervisor-based SSD caching scheme, employing a new metric to accurately determine the demand on SSD cache space of each VM. Computer simulation confirms that it substantially improves the accuracy of cache space allocation compared to the existing schemes. It also allows to display comparable hit ratio as the existing schemes with less amount of SSD cache for the VMs.


Cache allocation SSD caching Virtual machine Hit ratio Hypervisor 



This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2012R1A12040257 and 2014R1A1A2060398), the second Brain Korea 21 PLUS project, MSIP(Ministry of Science, ICT & Future Planning), Korea in the ICT R&D Program 2014 (1391105003), and Samsung Electronics (S-2014-0700-000).


  1. 1.
    Canim, M., Mihaila, G., et al.: SSD bufferpool extensions for database systems. In: Proceedings of the VLDB, pp. 1435–1446 (2010)Google Scholar
  2. 2.
    Luo, T., Lee, R., Mesnier, M.P., Chen, F., Zhang, X.: hStorage-DB: Heterogeneity aware data management to exploit the full capability of hybrid storage systems. In: PVLDB, pp. 1076–1087 (2012)Google Scholar
  3. 3.
    Qureshi, M.K., Patt, Y.N.: Utility-based cache partitioning: a low-overhead, high-performance, runtime mechanism to partition shared caches. In: MICRO (2006)Google Scholar
  4. 4.
    Smith, A.: Disk cache-miss ratio analysis and design considerations. ACM Trans. Comput. Syst. 3, 161–203 (1985)CrossRefGoogle Scholar
  5. 5.
    Kgil, T., Roberts, D., Mudge, T.: Improving NAND flash based disk caches. In: ISCA (2008)Google Scholar
  6. 6.
    Luo, T., et al.: S-CAVE: effective SSD caching to improve virtual machine storage performance. In: Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques, pp. 103–112 (2013)Google Scholar
  7. 7.
    Pritchett, T., Thottethodi, M.: Sievestore: a highly-selective, ensemble-level disk cache for cost-performance. In: Proceedings of the 37th International Symposium on Computer Architecture (ISCA 2010), pp. 163–174 (2010)Google Scholar
  8. 8.
    Stewart, C., Chakrabarti, A., Griffith, R.: Zoolander: efficiently meeting very strict, low-latency SLOs. In: Proceedings of the 10th International Conference on Autonomic Computing (ICAC), pp. 265–277 (2013)Google Scholar
  9. 9.
    Timothy, Z., Anshul, G., et al.: Saving cash by using less cache. In: Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing (2012)Google Scholar
  10. 10.
    Jinho, H., Wei, Z., et al.: UniCache: Hypervisor managed data storage in RAM and flash. In: 2014 IEEE 7th International Conference, pp. 216–223 (2014)Google Scholar
  11. 11.
    Narayanan, D., Thereska, E., Donnelly, A., Elnikety, S., Rowstron, A.: Migrating server storage to ssds: analysis of tradeoffs. In: Proceedings of the 4th ACM European Conference on Computer Systems, pp. 145–158. ACM, New York (2009)Google Scholar
  12. 12.
    Anchev, N., et al.: Optimal cache replacement policy for matrix multiplication. In: ICT Innovations 2012, pp. 71–80. Springer, Berlin (2012)Google Scholar
  13. 13.
    Park, S., Jung, D., Kang, J., Kim, J., Lee, J., CFLRU: a replacement algorithm for flash memory. In: Proceedings of International Conference on Compilers, pp. 234–241 (2006)Google Scholar
  14. 14.
    Shim, H., Seo, B., Kim, J., Maeng, S.: An adaptive partitioning scheme for DRAM-based cache in solid state drives. In: Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies (2010)Google Scholar
  15. 15.
    Jinjiang L., Yihua L., et al.: An efficient schema for cloud systems based on SSD cache technology. Math. Probl. Eng. 2013, 9 (2013) Article ID 109781Google Scholar
  16. 16.
    Jennings, B., Stadler, R.: Resource management in clouds: survey and research challenges. J. Netw. Syst. Manag. 23(3), 731–737 (2015)Google Scholar
  17. 17.
    Gulati, A., Shanmuganathan, G., Zhang, X., Varman, P.J.: Demand based hierarchical QoS using storage resource pools. In: Proceedings of 2012 USENIX Annual Technical Conference (ATC 2012), USENIX (2012)Google Scholar
  18. 18.
    Liao, X., Jin, H., Yu, J., Li, D.: A performance optimization mechanism for SSD in virtualized environment. Comput. J. 56, 992–1000 (2013)Google Scholar
  19. 19.
    Jinjiang, L., et al.: An efficient schema for cloud systems based on SSD cache technology. Math. Probl. Eng. 2013, 9 (2013) Article ID 109781Google Scholar
  20. 20.
    Krishnaveni, N., Sivakumar, G.: Survey on dynamic resource allocation strategy in cloud computing environment. Int. J. Comput. Appl. Technol. Res. (IJCATR) 2(6), 731–737 (2013)CrossRefGoogle Scholar
  21. 21.
    Ahn, J., Kim, C., Choi, Y.R., Huh, J.: Dynamic virtual machine scheduling in clouds for architectural shared resources. In: Proceedings of 4th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2012) (2012)Google Scholar
  22. 22.
    Jiang, S., Chen, F., Zhang, X.: CLOCK-Pro: an effective improvement of the CLOCK replacement. In: Proceedings of the USENIX ’05 (April 2005)Google Scholar
  23. 23.
    Janapsatya, A., Ignjatović, A., Peddersen, J., Parameswaran, S.: Dueling clock: adaptive cache replacement policy based on the clock algorithm. In: Proceedings of the Conference on Design, Automation and Test in Europe, DATE 2010, pp. 920–925 (2010)Google Scholar
  24. 24.
    SNIA IOTTA Repository. (2011)
  25. 25.
    UMass Trace Repository. (2007)

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Hee Jung Park
    • 1
  • Kyung Tae Kim
    • 1
  • Byungjun Lee
    • 1
  • Rhee Man Kil
    • 1
  • Hee Yong Youn
    • 1
  1. 1.College of Information and Communication EngineeringSungkyunkwan UniversitySuwonRepublic of Korea

Personalised recommendations