Abstract
Key-value(KV) store is widely used in data-intensive applications due to its excellent scalability. It supports tremendous working data set and frequent data modifications. In this paper, we present SSD-assisted storage system (SASS), a novel high-throughput KV store design using massive hybrid storage. SASS meets three exclusive requirements of enterprise-class data management: supporting billions of key-value pairs, processing thousands of key-value pairs per second, and taking advantage of the distinct characteristics of flash memory as much as possible. To make full use of the high IOPS of sequential write on the SSD, all modification operations are packaged as operation logs and appended into SSD in the time order. To handle the tremendous number of key-value pairs on hard disk, a novel sparse index, which can be always kept in the SSD, is proposed. Moreover, we also propose an in-memory dense index for the operation logs on SSD. Our evaluation mainly characterizes the throughput of read and write, namely the ops/sec(get-set operations per second). Experiments show that our SASS design enjoys up to 96806 write ops/sec and 3072 read ops/sec over 2 billion key-value pairs.
This research was partially supported by the grants from the Natural Science Foundation of China (No. 61379050,91224008); the National 863 High-tech Program (No. 2013AA013204); Specialized Research Fund for the Doctoral Program of Higher Education(No. 20130004130001), and the Fundamental Research Funds for the Central Universities, and the Research Funds of Renmin University(No. 11XNL010).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jeremic, N., Mühl, G., Busse, A., Richling, J.: The pitfalls of deploying solid-state drive RAIDs. In: 4th Annual Haifa Experimental Systems Conference, pp. 14:1–14:13. ACM Press, Haifa (2011)
Balakrishnan, M., Kadav, A., Prabhakaran, V., Malkhi, D.: Differential RAID: Rethinking RAID for SSD reliability. In: 5th European Conference on Computer Systems, pp. 15–26. ACM Press, Paris (2010)
Gupta, A., Kim, Y., Urgaonkar, B.: DFTL: A flash translation layer employing demand-based selective caching of page-level address mappings. In: 14th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 229–240. ACM Press, Washington (2009)
Lee, S., Shin, D., Kim, Y.J., Kim, J.: Last: locality-aware sector translation for nand flash memory-based storage systems. ACM SIGOPS Operating Systems Review. 42(6), 36–42 (2008)
Bouganim, L., Jnsson, B., Bonnet, P.: uFLIP: Understanding flash IO patterns. In: Online Proceedings of the 4th Biennial Conference on Innovative Data Systems Research, pp. 1–12, Asilomar (2009)
Chen, F., Koufaty, D.A., Zhang, X.D.: Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In: 11th International Joint Conference on Measurement and Modeling of Computer Systems, pp. 181–192. ACM Press, Seattle (2009)
Chen, S.M.: FlashLogging: exploiting flash devices for synchronous logging performance. In: ACM SIGMOD International Conference on Management of Data, pp. 73–86. ACM Press, Rhode Island (2009)
Nath, S., Kansal, A.: FlashDB: dynamic self-tuning database for NAND flash. In: 6th International Conference on Information Processing in Sensor Networks, pp. 410–419. ACM Press, Massachusetts (2007)
Trirogiannis, D., Harizopoulos, S., Shah, M.A., Wiener, J.L., Graefe, G.: Query processing techniques for solid state drives. In: ACM SIGMOD International Conference on Management of Data, pp. 59–72. ACM Press, Rhode Island (2009)
Andersen, D.G., Franklin, J., Kaminsky, M., Phanishayee, A., Tan, L., Vasudevan, V.: FAWN: a fast array of wimpy nodes. In: 22nd Symposium on Operating Systems Principles, pp. 1–14. ACM Press, Montana (2009)
Debnath, B., Sengupta, S., Li, J.: FlashStore: high throught persistent key-value store. Proceedings of the VLDB Endowmen. 3(2), 1414–1425 (2010)
Debnath, B., Sengupta, S., Li, J.: ChunkStash: speeding up inline storage deduplication using flash memory. In: 2010 USENIX Conference on USENIX Annual Technical Conference, pp. 1–12. USENIX Association, Boston (2010)
Debnath, B., Sengupta, S., Li, J.: SkimpyStash: RAM space skimpy key-value store on flash-based storage. In: ACM SIGMOD International Conference on Management of Data, pp. 25–36. ACM Press, Athens (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, J., Guo, Z., Meng, X. (2015). SASS: A High-Performance Key-Value Store Design for Massive Hybrid Storage. In: Renz, M., Shahabi, C., Zhou, X., Cheema, M. (eds) Database Systems for Advanced Applications. DASFAA 2015. Lecture Notes in Computer Science(), vol 9049. Springer, Cham. https://doi.org/10.1007/978-3-319-18120-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-18120-2_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18119-6
Online ISBN: 978-3-319-18120-2
eBook Packages: Computer ScienceComputer Science (R0)