Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Deferred lightweight indexing for log-structured key-value stores

Tang, Y and Iyengar, A and Tan, W and Fong, L and Liu, L and Palanisamy, B (2015) Deferred lightweight indexing for log-structured key-value stores. Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015. 11 - 20.

[img]
Preview
PDF
Available under License : See the attached license file.

Download (399kB)
[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)

Abstract

© 2015 IEEE. The recent shift towards write-intensive workload on bigdata (e.g., financial trading, social user-generated data streams)has pushed the proliferation of log-structured key-value stores, represented by Google's BigTable [1], Apache HBase [2] andCassandra [3]. While providing key-based data access with aPut/Get interface, these key-value stores do not support value-based access methods, which significantly limits their applicability in modern web and database applications. In this paper, we present DELI, a DEferred Lightweight Indexing scheme on the log-structured key-value stores. To index intensively updated bigdata in real time, DELI aims at making the index maintenance as lightweight as possible. The key idea is to apply an append-only design for online index maintenance and to collect index garbage at carefully chosen time. DELI optimizes the performance of index garbage collection through tightly coupling its execution with a native routine process called compaction. The DELI'ssystem design is fault-tolerant and generic (to most key-valuestores), we implemented a prototype of DELI based on HBasewithout internal code modification. Our experiments show that the DELI offers significant performance advantage for the write-intensive index maintenance.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: Article
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Tang, Y
Iyengar, A
Tan, W
Fong, L
Liu, L
Palanisamy, Bbpalan@pitt.eduBPALAN
Date: 1 January 2015
Date Type: Publication
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Journal or Publication Title: Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015
Page Range: 11 - 20
Event Type: Conference
DOI or Unique Handle: 10.1109/ccgrid.2015.150
Institution: University of Pittsburgh
Schools and Programs: School of Information Sciences > Telecommunications
Refereed: Yes
ISBN: 9781479980062
Date Deposited: 23 Jun 2015 15:59
Last Modified: 13 Oct 2017 22:58
URI: http://d-scholarship.pitt.edu/id/eprint/25451

Metrics

Monthly Views for the past 3 years

Plum Analytics

Altmetric.com


Actions (login required)

View Item View Item