Tang, Y and Iyengar, A and Tan, W and Fong, L and Liu, L and Palanisamy, B
(2015)
Deferred lightweight indexing for log-structured key-value stores.
Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015.
11 - 20.
Abstract
The recent shift towards write-intensive workload on bigdata (e.g., financial trading, social user-generated data streams)has pushed the proliferation of log-structured key-value stores, represented by Google's BigTable [1], Apache HBase [2] andCassandra [3]. While providing key-based data access with aPut/Get interface, these key-value stores do not support value-based access methods, which significantly limits their applicability in modern web and database applications. In this paper, we present DELI, a DEferred Lightweight Indexing scheme on the log-structured key-value stores. To index intensively updated bigdata in real time, DELI aims at making the index maintenance as lightweight as possible. The key idea is to apply an append-only design for online index maintenance and to collect index garbage at carefully chosen time. DELI optimizes the performance of index garbage collection through tightly coupling its execution with a native routine process called compaction. The DELI'ssystem design is fault-tolerant and generic (to most key-valuestores), we implemented a prototype of DELI based on HBasewithout internal code modification. Our experiments show that the DELI offers significant performance advantage for the write-intensive index maintenance.
Share
Citation/Export: |
|
Social Networking: |
|
Details
Item Type: |
Article
|
Status: |
Published |
Creators/Authors: |
Creators | Email | Pitt Username | ORCID  |
---|
Tang, Y | | | | Iyengar, A | | | | Tan, W | | | | Fong, L | | | | Liu, L | | | | Palanisamy, B | BPALAN@pitt.edu | BPALAN | |
|
Date: |
7 July 2015 |
Date Type: |
Publication |
Access Restriction: |
No restriction; Release the ETD for access worldwide immediately. |
Journal or Publication Title: |
Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
Page Range: |
11 - 20 |
Event Type: |
Conference |
DOI or Unique Handle: |
10.1109/ccgrid.2015.150 |
Institution: |
University of Pittsburgh |
Schools and Programs: |
School of Information Sciences > Telecommunications |
Refereed: |
Yes |
ISBN: |
9781479980062 |
Date Deposited: |
23 Jun 2015 15:59 |
Last Modified: |
07 Dec 2021 12:55 |
URI: |
http://d-scholarship.pitt.edu/id/eprint/25451 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Altmetric.com
Actions (login required)
 |
View Item |