Chapter

Cloud Computing

Part of the series Computer Communications and Networks pp 173-210

Date:

High-Performance Graph Data Management and Mining in Cloud Environments with X10

  • Miyuru DayarathnaAffiliated withWSO2, Inc.University of Moratuwa Email author 
  • , Toyotaro SuzumuraAffiliated withT.J. Watson Research Center, IBMBarcelona Supercomputing CenterUniversity of Tokyo

* Final gross prices may vary according to local VAT.

Get Access

Abstract

Large-scale graph data management and mining in cloud environments have been a widely discussed issue in recent times. The goal and the scope of this chapter is to discuss how X10 (a Partitioned Global Address Space (PGAS) language) has been applied for programming data-intensive systems. Specifically, we focus on the problem of creating scalable systems for storing and processing large-scale graph data on HPC clouds with X10. The chapter first discusses about large-scale graph processing with X10. Next, it describes the experience of designing and implementing a distributed graph database engine called Acacia with X10. We specifically focus on Acacia’s RDF extension. Finally, it will describe how a graph database benchmarking framework called XGDBench has been developed to analyze the performance of graph database servers. Overall the chapter describes our experiences of implementing such graph-based systems and frameworks with X10.