Abstract
Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
DeCandia, G., et al.: Dynamo: Amazon’s highly available key-value store. ACM SIGOPS Oper. Syst. Rev. 41(6), 205–220 (2007)
LevelDB. https://github.com/google/leveldb
RocksDB. https://github.com/facebook/rocksdb
Cassandra. https://cassandra.apache.org
Hbase. https://hbase.apache.org
Lee, C., Sim, D., Hwang, J., Cho, S.: F2FS: a new file system for flash storage. In: 13th USENIX Conference on File and Storage Technologies (FAST 15), pp. 273–286 (2015)
Min, C., Kim, K., Cho, H., Lee, S.W., Eom, Y.I.: SFS: random write considered harmful in solid state drives. In: 10th USENIX Conference on File and Storage Technologies (FAST 2012), p. 12 (2012)
Lim, H., Fan, B., Andersen, D.G., Kaminsky, M.: SILT: a memory-efficient, high-performance key-value store. In: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles (SOSP 2011), pp. 1–13 (2011)
O’Neil, P., Cheng, E., Gawlick, D., O’Neil, E.: The log-structured merge-tree (LSM-tree). Acta Informatica 33(4), 351–385 (1996)
Sears, R., Ramakrishnan, R.: bLSM: a general purpose log structured merge tree. In: Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, pp. 217–228 (2012)
Wu, X., Xu, Y., Shao, Z., Jiang, S.: LSM-trie: an LSM-tree-based ultra-large key-value store for small data items. In: 2015 USENIX Annual Technical Conference (USENIX ATC 2015), pp. 71–82 (2015)
Moshayedi, M., Wilkison, P.: Enterprise SSDs. Queue 6(4), 32–39 (2008)
Lee, J., Roh, H., Park, S.: External mergesort for flash-based solid state drives. IEEE Trans. Comput. 65(5), 1518–1527 (2016)
Roh, H., Park, S., Kim, S., Shin, M., Lee, S.W.: B+-tree index optimization by exploiting internal parallelism of flash-based solid state drives. Proc. VLDB Endow. 5(4), 286–297 (2011)
Li, Y., He, B., Yang, R.J., Luo, Q., Yi, K.: Tree indexing on solid state drives. Proc. VLDB Endow. 3(1–2), 1195–1206 (2010)
Tsirogiannis, D., Harizopoulos, S., Shah, M.A., Wiener, J.L., Graefe, G.: Query processing techniques for solid state drives. In: Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data, pp. 59–72 (2009)
Manning, C.: YAFFS: Yet another flash file system (2004)
Lee, S.W., Moon, B.: Design of flash-based DBMS: an in-page logging approach. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, pp. 55–66 (2007)
Acknowledgement
This research was supported by the MSIP, Korea, under the “SW Starlab” (IITP-2017-0-00477) supervised by the IITP (Institute for Information & communications Technology Promotion).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Song, K., Kim, J., Lee, D., Park, S. (2018). MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism. In: Lee, W., Choi, W., Jung, S., Song, M. (eds) Proceedings of the 7th International Conference on Emerging Databases. Lecture Notes in Electrical Engineering, vol 461. Springer, Singapore. https://doi.org/10.1007/978-981-10-6520-0_15
Download citation
DOI: https://doi.org/10.1007/978-981-10-6520-0_15
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-6519-4
Online ISBN: 978-981-10-6520-0
eBook Packages: EngineeringEngineering (R0)