Advertisement

An Efficient Quad-Tree Based Index Structure for Cloud Data Management

  • Linlin Ding
  • Baiyou Qiao
  • Guoren Wang
  • Chen Chen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6897)

Abstract

Recently, as a new computing infrastructure, cloud computing is getting more and more attention. How to improve the data management of cloud computing is becoming a research hot. Current cloud computing systems only support key-value insert and lookup operations. However, they can not effectively support complex queries and the management of multi-dimensional data due to lack of efficient index structures. Therefore, a scalable and reliable index structure is generally needed. In this paper, a novel quad-tree based multi-dimensional index structure is proposed for efficient data management and query processing in cloud computing systems. A local quad-tree index is built on each compute node to manage the data residing on the node. Then, the compute nodes are organized in a Chord-based overlay network. A portion of local indexes is selected from each compute node as a global index and published based on the overlay routing protocol. The global index with low maintenance cost can dramatically enhance the performance of query processing in cloud computing systems. Experiments show that the proposed index structure is scalable, efficient and reliable.

Keywords

Query Processing Index Structure Range Query Overlay Network Point Query 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. In: Proc. of OSDI, pp. 137–150 (2004)Google Scholar
  2. 2.
    DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., Vogels, W.: Dynamo: Amazon’s Highly Available Key-value Store. In: Proc. of SOSP, pp. 205–220 (2007)Google Scholar
  3. 3.
    Stoica, I., Morris, R., Karger, D.R., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proc. of SIGCOMM, pp. 149–160 (2001)Google Scholar
  4. 4.
    Kedem, G.: The Quad-CIF Tree: A Data Struture for Hierarchical On-Line Algorithms. In: Proc. of the 19th Design Automation Conference, pp. 352–357 (1982)Google Scholar
  5. 5.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R.M., Shenker, S.: A scalable content-addressable network. In: Proc. of SIGCOMM, pp. 161–172 (2001)Google Scholar
  6. 6.
    Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google file System. In: Proc. of SOSP, pp. 29–43 (2003)Google Scholar
  7. 7.
    Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: A Distributed Storage System for Structured Data. In: Proc. of OSDI, pp. 205–218 (2006)Google Scholar
  8. 8.
    Wu, S., Wu, K.-L.: An Indexing Framework for Efficient Retrieval on the Cloud. IEEE Data Eng. Bull. (DEBU) 32(1), 75–82 (2009)MathSciNetGoogle Scholar
  9. 9.
    Zhang, X., Ai, J., Wang, Z., Lu, J., Meng, X.: An Efficient Multi-Dimensional Index for Cloud Data Management. In: Proc. of CloudDb, pp. 17–24 (2009)Google Scholar
  10. 10.
    Guttman, A.: R-Trees: A Dynamic Index Structure for Spatial Searching In: Proc. of the ACM SIGMOD, pp. 47–57 (1984)Google Scholar
  11. 11.
    Bentley, J.L.: Multidimensional Binary Search Trees Used for Associative Searching. Commun. ACM 18(9), 509–517 (1975)CrossRefzbMATHGoogle Scholar
  12. 12.
    Wang, J., Wu, S., Gao, H., Li, J., Ooi, B.C.: Indexing Multi-dimensional Data in a Cloud System. In: Proc. of SIGMOD, pp. 591–602 (2010)Google Scholar
  13. 13.
    Tang, Y., Zhou, S., Xu, J.: LigHT: A Query-Efficient yet Low-Maintenance Indexing Scheme over DHTs. IEEE Trans. Knowl. Data Eng. (TKDE) 22(1), 59–75 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Linlin Ding
    • 1
    • 2
  • Baiyou Qiao
    • 1
    • 2
  • Guoren Wang
    • 1
    • 2
  • Chen Chen
    • 2
  1. 1.Key Laboratory of Medical Image Computing (NEU)Ministry of EducationChina
  2. 2.College of Information Science & EngineeringNortheastern UniversityChina

Personalised recommendations