BiDArch: BigData Architect, Generator of Big Data Solution Architectures

Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 735)

Abstract

The design of highly scalable architectures based on the Hadoop ecosystem is highly complex due to the wide and dynamic portfolio of available tools. The feasible solution generator for big data problems, BiDArch, allows to automatically establish a feasible architecture from the characterization of a problem in terms of tools features. This process enriches the solution proposed from semantic knowledge allowing the architect to not require a thorough knowledge of the ecosystem, getting him to focus mainly on the characterization of his problem or design goal.

Keywords

Big Data solutions Hadoop ecosystem Feasible architecture generator 

References

  1. 1.
    Achari, S.: Hadoop Essentials - Tackling the Challenges of Big Data with Hadoop. Packt Publishing (2015)Google Scholar
  2. 2.
    Roman, J.: The Hadoop ecosystem table. https://hadoopecosystemtable.github.io/
  3. 3.
    IBM, Inc.: The four V’s of big data. http://www.ibmbigdatahub.com/infographic/four-vs-big-data
  4. 4.
  5. 5.
    Apache Spark MLlib. http://spark.apache.org/mllib/
  6. 6.
  7. 7.
    MongoDB for giant ideas. https://www.mongodb.com/
  8. 8.
  9. 9.
    W3C. SPARQL Query Language for RDF. https://www.w3.org/TR/rdf-sparql-query/
  10. 10.
    Flask (A Python Microframework). http://flask.pocoo.org/
  11. 11.
  12. 12.
    JointJS: Visualize and interact with diagrams and graphs. https://www.jointjs.com/opensource
  13. 13.
    Sosa, J.: Generador de arquitecturas de solución sobre el ecosistema Hadoop para problemas de Big Data. https://webcat.uniandes.edu.co/uhtbin/webcat
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
    Hortonworks, Inc.: Hortonworks data platform. https://hortonworks.com/products/data-center/hdp/
  20. 20.
    Cloudera, Inc.: CDH is Cloudera’s 100% open source platform distribution. https://www.cloudera.com/products/open-source/apache-hadoop/key-cdh-components.html
  21. 21.
    MapR, Inc.: The MapR converged data platorm. https://mapr.com/products/mapr-converged-data-platform/
  22. 22.
    Grover, M., Malaska, T., Seidman, J., Saphira, G.: Hadoop Application Architectures, 1st edn. O’Reilly Media Inc., Sebastopol (2015)Google Scholar
  23. 23.
    Bijnens, N., Hausenblas, M.: Lambda Architecture. A repository dedicated to the Lambda Architecture (LA). http://lambda-architecture.net/
  24. 24.
    Kreps, J.: Questioning the Lambda Architecture. https://www.oreilly.com/ideas/questioning-the-lambda-architecture

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Systems and Computing Engineering Department, School of EngineeringUniversidad de los AndesBogotáColombia

Personalised recommendations