S3G2: A Scalable Structure-Correlated Social Graph Generator

  • Minh-Duc Pham
  • Peter Boncz
  • Orri Erling
Conference paper

DOI: 10.1007/978-3-642-36727-4_11

Volume 7755 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Pham MD., Boncz P., Erling O. (2013) S3G2: A Scalable Structure-Correlated Social Graph Generator. In: Nambiar R., Poess M. (eds) Selected Topics in Performance Evaluation and Benchmarking. TPCTC 2012. Lecture Notes in Computer Science, vol 7755. Springer, Berlin, Heidelberg

Abstract

Benchmarking graph-oriented database workloads and graph-oriented database systems is increasingly becoming relevant in analytical Big Data tasks, such as social network analysis. In graph data, structure is not mainly found inside the nodes, but especially in the way nodes happen to be connected, i.e. structural correlations. Because such structural correlations determine join fan-outs experienced by graph analysis algorithms and graph query executors, they are an essential, yet typically neglected, ingredient of synthetic graph generators. To address this, we present S3G2: a Scalable Structure-correlated Social Graph Generator. This graph generator creates a synthetic social graph, containing non-uniform value distributions and structural correlations, which is intended as test data for scalable graph analysis algorithms and graph database systems. We generalize the problem by decomposing correlated graph generation in multiple passes that each focus on one so-called correlation dimension; each of which can be mapped to a MapReduce task. We show that S3G2 can generate social graphs that (i) share well-known graph connectivity characteristics typically found in real social graphs (ii) contain certain plausible structural correlations that influence the performance of graph analysis algorithms and queries, and (iii) can be quickly generated at huge sizes on common cluster hardware.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Minh-Duc Pham
    • 1
  • Peter Boncz
    • 1
  • Orri Erling
    • 2
  1. 1.CWIThe Netherlands
  2. 2.OpenLink SoftwareU.K.