Deferred lightweight indexing for log-structured key-value stores

Tang, Y and Iyengar, A and Tan, W and Fong, L and Liu, L and Palanisamy, B (2015) Deferred lightweight indexing for log-structured key-value stores. Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015. 11 - 20.

Preview	PDF Available under License : See the attached license file. Download (399kB)
	Plain Text (licence) Available under License : See the attached license file. Download (1kB)

Abstract

The recent shift towards write-intensive workload on bigdata (e.g., financial trading, social user-generated data streams)has pushed the proliferation of log-structured key-value stores, represented by Google's BigTable [1], Apache HBase [2] andCassandra [3]. While providing key-based data access with aPut/Get interface, these key-value stores do not support value-based access methods, which significantly limits their applicability in modern web and database applications. In this paper, we present DELI, a DEferred Lightweight Indexing scheme on the log-structured key-value stores. To index intensively updated bigdata in real time, DELI aims at making the index maintenance as lightweight as possible. The key idea is to apply an append-only design for online index maintenance and to collect index garbage at carefully chosen time. DELI optimizes the performance of index garbage collection through tightly coupling its execution with a native routine process called compaction. The DELI'ssystem design is fault-tolerant and generic (to most key-valuestores), we implemented a prototype of DELI based on HBasewithout internal code modification. Our experiments show that the DELI offers significant performance advantage for the write-intensive index maintenance.

---

Share

Citation/Export:	Select format... Citation - Text Citation - HTML Endnote BibTex Dublin Core OpenURL MARC (ISO 2709) METS MODS EP3 XML Reference Manager Refer
Social Networking:	Share |

---

Details

Item Type:	Article
Status:	Published
Creators/Authors:	Creators Email Pitt Username ORCID Tang, Y Iyengar, A Tan, W Fong, L Liu, L Palanisamy, B BPALAN@pitt.edu BPALAN
Date:	7 July 2015
Date Type:	Publication
Access Restriction:	No restriction; Release the ETD for access worldwide immediately.
Journal or Publication Title:	Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015
Page Range:	11 - 20
Event Type:	Conference
DOI or Unique Handle:	10.1109/ccgrid.2015.150
Institution:	University of Pittsburgh
Schools and Programs:	School of Information Sciences > Telecommunications
Refereed:	Yes
ISBN:	9781479980062
Date Deposited:	23 Jun 2015 15:59
Last Modified:	07 Dec 2021 12:55
URI:	http://d-scholarship.pitt.edu/id/eprint/25451

---

Metrics

Monthly Views for the past 3 years

Plum Analytics

Altmetric.com

---

Actions (login required)

View Item