Skip to main content
SpringerLink
Log in

HAT: an efficient buffer management method for flash-based hybrid storage systems

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Flash solid-state drives (SSDs) provide much faster access to data compared with traditional hard disk drives (HDDs). The current price and performance of SSD suggest it can be adopted as a data buffer between main memory and HDD, and buffer management policy in such hybrid systems has attracted more and more interest from research community recently. In this paper, we propose a novel approach to manage the buffer in flash-based hybrid storage systems, named hotness aware hit (HAT). HAT exploits a page reference queue to record the access history as well as the status of accessed pages, i.e., hot, warm, and cold. Additionally, the page reference queue is further split into hot and warm regions which correspond to the memory and flash in general. The HAT approach updates the page status and deals with the page migration in the memory hierarchy according to the current page status and hit position in the page reference queue. Compared with the existing hybrid storage approaches, the proposed HAT can manage the memory and flash cache layers more effectively. Our empirical evaluation on benchmark traces demonstrates the superiority of the proposed strategy against the state-of-the-art competitors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. LaPedus M. SSDs: still not a “Solid State” Business. Electronic Engineering Times. http://www.eetimes.com/electronics-news/4206361/SSDs-Stillnot-a-solid-state-business, 2010

    Google Scholar 

  2. Momentus XT Solid State Hybrid Drives. http://www.seagate.com/www/en-us/products/laptops/laptop-hdd/

  3. http://windows.microsoft.com/en-US/windowsvista/products/features/performance

  4. Oracle. Deploying hybrid storage pools with Oracle flash technology and the Oracle Solaris ZFS file system. OracleWhite Paper, 2011, 1–17

    Google Scholar 

  5. Ou Y, Härder T. Trading memory for performance and energy. In: Proceedings of the 2011 Database Systems for Advanced Applications Workshops. 2011, 241–253

    Google Scholar 

  6. Wu X, Reddy A L N. Managing storage space in a flash and disk hybrid storage system. In: Proceedings of the 17th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. 2009, 1–4

    Google Scholar 

  7. Canim M, Mihaila G A, Bhattacharjee B, Ross K A, Lang C A. SSD bufferpool extensions for database systems. The Proceedings of the Very Large Database Endowment, 2010, 3(2): 1435–1446

    Google Scholar 

  8. Do J, Zhang D, Patel J M, DeWitt D J, Naughton J F, Halverson A. Turbocharging DBMS buffer pool using SSDs. In: Proceedings of the 2011 Special Interest Group on Management of Data Conference. 2011, 1113–1124

    Google Scholar 

  9. Kang W H, Lee S W, Moon B. Flash-based extended cache for higher throughput and faster recovery. The Proceedings of the Very Large Database Endowment, 2012, 5(11): 1615–1626

    Google Scholar 

  10. Lv Y, Cui B, Chen X, Li J. Hotness-aware buffer management for flashbased hybrid storage systems. In: Proceedings of the 22nd ACM International Conference on Conference on Information and Knowledge Management. 2013, 1631–1636

    Chapter  Google Scholar 

  11. Bouganim L, Jónsson B T, Bonnet P. uFLIP: Understanding flash IO patterns. In: Proceedings of the 4th Biennial Conference on Innovative Data Systems Research. 2009, 1–12

    Google Scholar 

  12. Chen F, Koufaty D A, Zhang X. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In: Proceedings of the 11th International Joint Conference Of SIGMETRICS and Performance on Measurement and Modeling of Computer Systems. 2009, 181–192

    Google Scholar 

  13. Agrawal N, Prabhakaran V, Wobber T, Davis J D, Manasse M S, Panigrahy R. Design tradeoffs for SSD performance. In: Proceedings of the 2008 USENIX Annual Technical Conference. 2008, 57–70

    Google Scholar 

  14. Cho J H, Shin D, Eom Y I. Kast: K-associative sector translation for NAND flash memory in real-time systems. In: Proceedings of the 2009 Conference on Design, Automation and Test in Europe. 2009, 507–512

    Google Scholar 

  15. Gupta A, Kim Y, Urgaonkar B. DFTL: a flash translation layer employing demand-based selective caching of page-level address mappings. In: Proceedings of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems. 2009, 229–240

    Chapter  Google Scholar 

  16. Bisson T, Brandt S A, Long D D E. A hybrid disk-aware spin-down algorithm with I/O subsystem support. In: Proceedings of the 26th IEEE International Performance Computing and Communications Conference. 2007, 236–245

    Google Scholar 

  17. Koltsidas I, Viglas S. Flashing up the storage layer. The Proceedings of the Very Large Database Endowment, 2008, 1(1): 514–525

    Google Scholar 

  18. Wu X, Reddy A L N. Exploiting concurrency to improve latency and throughput in a hybrid storage system. In: Proceedings of the 18th IEEE/ACMInternational Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. 2010, 14–23

    Google Scholar 

  19. Canim M, Bhattacharjee B, Mihaila G A, Lang C A, Ross K A. An object placement advisor for DB2 using solid state storage. The Proceed ings of the Very Large Database Endowment, 2009, 2(2): 1318–1329

    Google Scholar 

  20. Chen S. Flashlogging: exploiting flash devices for synchronous logging performance. In: Proceedings of the 2009 Special Interest Group on Management of Data Conference. 2009, 73–86

    Google Scholar 

  21. Debnath B K, Sengupta S, Li J. Flashstore: high throughput persistent key-value store. The Proceedings of the Very Large Database Endowment, 2010, 3(2): 1414–1425

    Google Scholar 

  22. Debnath B K, Sengupta S, Li J. Skimpystash: Ram space skimpy keyvalue store on flash-based storage. In: Proceedings of the 2011 Special Interest Group on Management of Data Conference. 2011, 25–36

    Google Scholar 

  23. Zhou Y, Chen Z, Li K. Second-level buffer cache management. IEEE Transactions on Parallel and Distributed System, 2004, 15(6): 505–519

    Article  MathSciNet  Google Scholar 

  24. Luo T, Lee R, Mesnier M P, Chen F, Zhang X. HStorage-DB: heterogeneity-aware data management to exploit the full capability of hybrid storage systems. The Proceedings of the Very Large Database Endowment, 2012, 5(10): 1076–1087

    Google Scholar 

  25. Jin P, Ou Y, Häoder T, Li Z. AD-LRU: an efficient buffer replacement algorithm for flash-based databases. Data & Knowledge Engineering, 2012, 83-102

  26. Li Z, Jin P, Su X, Cui K, Yue L. CCF-LRU: a new buffer replacement algorithm for flashmemory. IEEE Transactions on Consumer Electronics, 2009, 55(3): 1351–1359

    Article  Google Scholar 

  27. Johnson T, Shasha D. 2Q: a low overhead high performance buffer management replacement algorithm. In: Proceedings of the 20th International Conference on Very Large Data Bases. 1994, 439–450

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & Key Lab of High Confidence Software Technologies (Ministry of Education), Peking University, Beijing, 100871, China

    Yanfei Lv, Bin Cui & Xuexuan Chen

  2. National Computer network Emergency Response technical Team/Coordination Center of China, Beijing, 100029, China

    Yanfei Lv

  3. University of California, San Diego, 92093, USA

    Jing Li

Authors
  1. Yanfei Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bin Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xuexuan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Cui.

Additional information

Yanfei Lv is a staff in National Computer network Emergency Response technical Team /Coordination Center of China. He obtained his BS from Northeastern University, China in 2006 and PhD in 2013 from Peking University, China. His research interests include flash-based database, Hadoop, and big data.

Dr. Bin Cui is a professor in the School of EECS, Peking University, China. His research interests include database performance issues, query and index techniques, web data management, and data mining. He has served in the Technical Program Committee of various international conferences including SIGMOD, VLDB, and ICDE. He is currently in the Editorial Board of VLDB Journal, TKDE, DAPD, and Information Systems.

Xuexuan Chen is an employee of Google Switzerland working as a software engineer in search ads quality. He obtained his BS and MS from Department of Computer Science, Peking University, China in 2010 and 2013 respectively. From 2008 to 2013, his research work focused on flash-based database systems, especially on performance evaluation, buffer management algorithms, and index structures of relational database systems on top of flash-based SSDs.

Jing Li is currently a PhD student at Department of Computer Science and Engineering, University of California, San Diego, USA. Prior to that, he obtained his bachelor degree from Peking University, China in 2012. His research interests include database, architecture, and mobile computing.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lv, Y., Cui, B., Chen, X. et al. HAT: an efficient buffer management method for flash-based hybrid storage systems. Front. Comput. Sci. 8, 440–455 (2014). https://doi.org/10.1007/s11704-014-3364-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-014-3364-7

Keywords

Search

Navigation