Technology Conference on Performance Evaluation and Benchmarking

TPCTC 2014: Performance Characterization and Benchmarking. Traditional to Big Data pp 64-81

A Scalable Framework for Universal Data Generation in Parallel

Conference paper

DOI: 10.1007/978-3-319-15350-6_5

Volume 8904 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Gu L., Zhou M., Kang Q., Zhou A. (2015) A Scalable Framework for Universal Data Generation in Parallel. In: Nambiar R., Poess M. (eds) Performance Characterization and Benchmarking. Traditional to Big Data. TPCTC 2014. Lecture Notes in Computer Science, vol 8904. Springer, Cham

Abstract

Nowadays, more and more companies, such as Amazon, Twitter and etc., are facing the big data problem, which requires higher performance to manage tremendous large data sets. Data management systems with a new architecture taking full advantages of computer hardware are emerging, on the purpose of maximizing the system performance and fulfilling customs’ current or even future requirements. How to test performance and confirm the suitability of the new data management system becomes a primary task of these companies. Hence, how to generate a scaled data set with desired volumes and in desired velocity effectively becomes a problem imperative to be solved, together with the goal to keep the characters of their real data set as many as possible (realistic). In this paper, we proposed PSUG to generate a realistic database in terms of required volume and velocity in a scalable parallel manner. Our extensive experimental studies confirm the efficiency and effectiveness of our proposed method.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Ling Gu
    • 1
  • Minqi Zhou
    • 1
  • Qiangqiang Kang
    • 1
  • Aoying Zhou
    • 1
  1. 1.Institute of Data Science and EngineeringEast China Normal UniversityShanghaiChina