Abstract
Big Data usually refers to the unprecedented growth of data and associated processes to gather, store, process, and analyze them to provide organizations and users with useful insights and information. The intrinsic complexity and characteristics of systems handling Big Data require software architectures as founded drivers for these systems to meet functional and quality requirements. In light of the relevant role of software architectures for Big Data systems, we investigate the current state of the art of Big Data software architectures. This paper presents the results of a systematic mapping study that updates existing literature reviews on this topic. We selected and analyzed 23 primary studies published in the last five years. We identified 11 architecture-related quality requirements and six architectural modules relevant to the design of software architectures for Big Data systems, besides analyzing whether existing proposals of reference architectures comply with these requirements and modules. We expect the results presented in this paper can provide a continuous update of the state of the art while highlighting essential concerns in the design of software architectures for Big Data systems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Avci, C., Tekinerdogan, B., Athanasiadis, I.N.: Software architectures for Big Data: a systematic literature review. Big Data Anal. 5 (2020). https://doi.org/10.1186/s41044-020-00045-1
Beyer, M., Laney, D.: The importance of ‘Big Data’: A definition. Technical report, Gartner, USA, June 2012
Cloutier, R., Muller, G., Verma, D., Nilchiani, R., Hole, E., Bone, M.: The concept of reference architectures. Syst. Eng. 13(1), 14–27 (2010). https://doi.org/10.1002/sys.20129
Garcés, L., et al.: Three decades of software reference architectures: a systematic mapping study. J. Syst. Softw. 179 (2021). https://doi.org/10.1016/j.jss.2021.111004
Garner, P., et al.: When and how to update systematic reviews: Consensus and checklist. BMJ 354 (2016). https://doi.org/10.1136/bmj.i3507
Hai, R., Geisler, S., Quix, C.: Constance: an intelligent data lake system. In: Proceedings of the 2016 International Conference on Management of Data, pp. 2097–2100. ACM, USA (2016). https://doi.org/10.1145/2882903.2899389
ISO/IEC 25010: Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - System and software quality models. ISO, Switzerland (2011)
Janssen, M., Brous, P., Estevez, E., Barbosa, L.S., Janowski, T.: Data governance: Organizing data for trustworthy Artificial Intelligence. Govern. Inf. Q. 37(3) (2020). https://doi.org/10.1016/j.giq.2020.101493
Kim, H.Y., Cho, J.S.: Data Governance Framework for Big Data implementation with a case of Korea. In: Proceedings of the 2017 IEEE International Congress on Big Data (2017). https://doi.org/10.1109/bigdatacongress.2017.56
Kitchenham, B.A., Budgen, D., Brereton, P.: Evidence-Based Software Engineering and systematic reviews. Chapman and Hall/CRC Press, USA (2016)
Kumar, V.D., Alencar, P.: Software Engineering for Big Data projects: domains, methodologies and gaps. In: Proceedings of the 2016 IEEE International Conference on Big Data, pp. 2886–2895. IEEE, USA (2016). https://doi.org/10.1109/bigdata.2016.7840938
Laney, D.: 3D data management: Controlling Data Volume, Velocity, and Variety. Technical report, META Group, USA, February 2001
Mendes, E., Wohlin, C., Felizardo, K., Kalinowski, M.: When to update systematic literature reviews in Software Engineering. J. Syst. Softw. 167 (2020). https://doi.org/10.1016/j.jss.2020.110607
Montero, O., Crespo, Y., Piatini, M.: Big data quality models: a systematic mapping study. In: Paiva, A.C.R., Cavalli, A.R., Ventura Martins, P., Pérez-Castillo, R. (eds.) QUATIC 2021. CCIS, vol. 1439, pp. 416–430. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85347-1_30
Nakagawa, E.Y., Oquendo, F., Maldonado, J.C.: Reference architectures. In: Oussalah, M.C. (ed.) Software Architecture 1, pp. 55–82. ISTE/John Wiley & Sons Inc., United Kingdom (2014). https://doi.org/10.1002/9781118930960.ch2
NewVantage: Big Datra and AI Executive Survey 2021: Executive summary of findings. techreport, NewVantage Partners LLC, USA, January 2021
Petersen, K., Feldt, R., Mujtaba, S., Mattsson, M.: Systematic mapping studies in Software Engineering. In: Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, pp. 68–77. British Computer Society, United Kingdom (2008). https://doi.org/10.14236/ewic/ease2008.8
Petersen, K., Vakkalanka, S., Kuzniarz, L.: Guidelines for conducting systematic mapping studies in Software Engineering: an update. Inf. Softw. Technol. 64, 1–18 (2015). https://doi.org/10.1016/j.infsof.2015.03.007
Rahman, M.S., Reza, H.: Systematic mapping study of non-functional requirements in Big Data system. In: Proceedings of the 2020 IEEE International Conference on Electro Information Technology, pp. 025–031. IEEE, USA (2020). https://doi.org/10.1109/eit48999.2020.9208288
Sena, B., Allian, A.P., Nakagawa, E.Y.: Characterizing Big Data software architectures: a systematic mapping study. In: Proceedings of the 11th Brazilian Symposium on Software Components, Architectures, and Reuse. ACM, USA (2017). https://doi.org/10.1145/3132498.3132510
Sena, B., Garcés, L., Allian, A.P., Nakagawa, E.Y.: Investigating the applicability of architectural patterns in Big Data systems. In: Proceedings of the 25th Conference on Pattern Languages of Programs. ACM, USA (2018)
Wahyudi, A., Kuk, G., Janssen, M.: A process pattern model for tackling and improving big data quality. Inf. Syst. Front. 20(3), 457–469 (2018). https://doi.org/10.1007/s10796-017-9822-7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
da Costa, T.V.R., Cavalcante, E., Batista, T. (2022). Big Data Software Architectures: An Updated Review. In: Gervasi, O., Murgante, B., Hendrix, E.M.T., Taniar, D., Apduhan, B.O. (eds) Computational Science and Its Applications – ICCSA 2022. ICCSA 2022. Lecture Notes in Computer Science, vol 13375. Springer, Cham. https://doi.org/10.1007/978-3-031-10522-7_33
Download citation
DOI: https://doi.org/10.1007/978-3-031-10522-7_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10521-0
Online ISBN: 978-3-031-10522-7
eBook Packages: Computer ScienceComputer Science (R0)