A flexible and dynamic partition storage scheme based on key-value separation

Chao Zhou; Xu Ge

doi:10.1117/12.3038045

22 August 2024 A flexible and dynamic partition storage scheme based on key-value separation

Chao Zhou, Xu Ge

Proceedings Volume 13228, Fifth International Conference on Computer Communication and Network Security (CCNS 2024); 132280J (2024) https://doi.org/10.1117/12.3038045
Event: Fifth International Conference on Computer Communication and Network Security (CCNS 2024), 2024, Guangzhou, China

Abstract

In the field of key-value storage performance optimization, WiscKey has enhanced the write performance of key-value storage engines based on the Log-Structured Merge-tree (LSM-Tree) by introducing the concept of key-value separation, achieving significant progress in performance optimization of key-value storage systems. Building on this design concept, this paper proposes a new flexible and dynamic partition storage scheme based on key-value separation, named FlexiKV, aimed at optimizing range query performance in key-value separation systems. FlexiKV introduces dynamic value log partitioning and designs a comprehensive scoring mechanism based on access frequency and the number of key-value pairs, achieving effective data organization and storage. The scheme dynamically adjusts partitioning strategies to achieve a balanced distribution of data load and improves the efficiency of range queries in scenarios of data load skew.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Chao Zhou and Xu Ge "A flexible and dynamic partition storage scheme based on key-value separation", Proc. SPIE 13228, Fifth International Conference on Computer Communication and Network Security (CCNS 2024), 132280J (22 August 2024); https://doi.org/10.1117/12.3038045

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available