Please use this identifier to cite or link to this item:
Title: Lightweight indexing of observational data in log-structured storage
Authors: Wang, S.
Maier, D.
Ooi, B.C. 
Issue Date: Mar-2014
Citation: Wang, S.,Maier, D.,Ooi, B.C. (2014-03). Lightweight indexing of observational data in log-structured storage. Proceedings of the VLDB Endowment 7 (7) : 529-540. ScholarBank@NUS Repository.
Abstract: Huge amounts of data are being generated by sensing de- vices every day, recording the status of objects and the en- vironment. Such observational data is widely used in scien- tific research. As the capabilities of sensors keep improv- ing, the data produced are drastically expanding in pre- cision and quantity, making it a write-intensive domain. Log-structured storage is capable of providing high write throughput, and hence is a natural choice for managing large-scale observational data. In this paper, we propose an approach to indexing and querying observational data in log-structured storage. Based on key traits of observational data, we design a novel index approach called the CR-index (Continuous Range Index), which provides fast query performance without compromis- ing write throughput. It is a lightweight structure that is fast to construct and often small enough to reside in RAM. Our experimental results show that the CR-index is superior in handling observational data compared to other indexing techniques. While our focus is scientific data, we believe our index will be effective for other applications with similar properties, such as process monitoring in manufacturing. © 2014 VLDB Endowment.
Source Title: Proceedings of the VLDB Endowment
ISSN: 21508097
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Page view(s)

checked on Jan 26, 2023

Google ScholarTM


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.