Abstract
Big data has drawn huge attention from researchers and policy and decision makers in governments and enterprises. As the speed of information growth exceeded Moore’s law at the beginning of this new century, excessive data is making great troubles to businesses and organizations. Nevertheless, great potential and highly useful value are hidden in the huge volume of data. Throughout this chapter, we will discuss the main big data architectures that help coping with the above challenges. These architectures are technology-independent reference architectures that generalize published implementation architectures of big data use cases. This chapter is of value for academics, practitioners, and entrepreneurs alike. The analysis of existing reference architectures and success cases will facilitate architecture design, and the selection of most suitable technologies or commercial solutions, when constructing big data systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Amatriain, X. (2013). Big & personal: Data and models behind Netflix recommendations. In Proceedings of the 2nd International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications (pp. 1–6).
Elmasri, R., & Navathe, S. B. (2015). Fundamentals of database systems (7th ed.). Pearson.
Fernandez, R. C., Pietzuch, P. R., Kreps, J., Narkhede, N., Rao, J., Koshy, J., Lin, D., Riccomini, C., & Wang, G. (2015). Liquid: Unifying nearline and offline big data integration. In CIDR.
Jagadish, H. V. (2015). Big data and science: Myths and reality. Big Data Research, 2(2), 49–52.
Klein, J., Buglak, R., Blockow, D., Wuttke, T., & Cooper, B. (2016). A reference architecture for big data systems in the national security domain. In 2016 IEEE/ACM 2nd International Workshop on Big Data Software Engineering (BIGDSE) (pp. 51–57). IEEE.
Kreps, J. (2014). Questioning the lambda architecture. Retrieved from https://www.oreilly.com/radar/questioning-the-lambda-architecture/
Kune, R., Konugurthi, P. K., Agarwal, A., Chillarige, R.-d. R., & Buyya, R. (2016). The anatomy of big data computing. Software: Practice and Experience, 46(1), 79–105.
Maier, M. W. (1998). Architecting principles for systems-of-systems. Systems Engineering: The Journal of the International Council on Systems Engineering, 1(4), 267–284.
Marz, N., & Warren, J. (2015). Big Data: Principles and best practices of scalable real-time data systems. Manning Publications.
Mishne, G., Dalton, J., Li, Z., Sharma, A., & Lin, J. (2013). Fast data in the era of big data: Twitter’s real-time related query suggestion architecture. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data (pp. 1147–1158).
Philip Chen, C. L., & Zhang, C.-Y. (2014). Data-intensive applications, challenges, techniques and technologies: A survey on big data. Information Sciences, 275, 314–347.
Samizadeh, I. (2018). A brief introduction to two data processing architectures—Lambda and kappa for big data. Retrieved from https://towardsdatascience.com/a-brief-introduction-to-two-data-processing-architectures-lambda-and-kappa-for-big-data-4f35c28005bb
Sumbaly, R., Kreps, J., & Shah, S. (2013). The big data ecosystem at LinkedIn. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data (pp. 1125–1134).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Garriga, M., Monsieur, G., Tamburri, D. (2023). Big Data Architectures. In: Liebregts, W., van den Heuvel, WJ., van den Born, A. (eds) Data Science for Entrepreneurship. Classroom Companion: Business. Springer, Cham. https://doi.org/10.1007/978-3-031-19554-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-19554-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-19553-2
Online ISBN: 978-3-031-19554-9
eBook Packages: Business and ManagementBusiness and Management (R0)