Advertisement

An ICT Project Case Study from Education: A Technology Review for a Data Engineering Pipeline

  • Ioana CiuciuEmail author
  • Augusta Bianca Ene
  • Cosmin Lazar
Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 353)

Abstract

The paper presents a brief technology survey of existing tools to implement data ingestion pipelines in a classical Data Science project. Given the emergent nature of technologies and the challenges associated with any Big Data project, we propose to identify and discuss the main components of a data pipeline, from a data engineering perspective. The data pipeline is showcased with a case study from an ICT university project, where several teams of master students competed towards designing and implementing the best solution for a manufacturing data pipeline. The project proposes a research-based multidisciplinary approach to education, aiming at empowering students with a novel role in the process of learning, that of knowledge creators. Therefore, on the one hand, the paper discusses the main components of a Big Data pipeline and on the other hand it shows how these components are addressed and implemented within a concrete ICT project from education, realized in tight relation with the IT industry.

Keywords

Big Data Data pipeline Research-informed education ICT project management Virtual teams Collaborative work 

Notes

Acknowledgement

The present study was realized within the Advanced Fellowships 2018 offered by the STAR-UBB Institute from the Babes-Bolyai University [17]. The sensors and manufacturing use case were provided by Robert Bosch SRL. Romania.

References

  1. 1.
    Cavanillas, J.M., Curry, E., Wahlster, W. (eds.): New Horizons for a Data-Driven Economy. A Roadmap for Usage and Exploitation of Big Data in Europe. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-21569-3CrossRefGoogle Scholar
  2. 2.
    Marz, N., Warren, J.: Big Data. Principles and Best Practices of Scalable Realtime Data Systems. Manning, New York (2015)Google Scholar
  3. 3.
    White, T.: Hadoop: The Definitive Guide, 4th edn. O’Reilly Media Inc., USA (2015)Google Scholar
  4. 4.
    Sadalage, P.J., Fowler, M.: NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence. Addison-Wesley, Pearson Education, Inc., Boston (2013)Google Scholar
  5. 5.
    Dong, X.L., Srivastava, D.: Big Data Integration, Synthesis Lectures on Data Management. Morgan & Claypool, San Rafael (2015)Google Scholar
  6. 6.
    Gartner: Data catalogs are the new black in data management and analytics. https://www.gartner.com. Accessed 22 Mar 2019
  7. 7.
  8. 8.
    Curry, E., Ngonga, A., Domingue, J., Freitas, A., Strohbach, M., Becker, T., et al.: D2.2.2. Final version of the technical white paper. Public deliverable of the EU-Project BIG (318062; ICT-2011.4.4) (2014)Google Scholar
  9. 9.
    EDSA Homepage. http://edsa-project.eu/. Accessed 22 Mar 2019
  10. 10.
    LERU (League of European Universities): Excellent education in research rich universities (2017)Google Scholar
  11. 11.
    XDK Cross Domain Development Kit. https://xdk.bosch-connectivity.com/. Accessed 22 Mar 2019
  12. 12.
    High Performance Computing System and Private Cloud IBM IntelligentCluster, UBB. http://hpc.cs.ubbcluj.ro/. Accessed 22 Mar 2019
  13. 13.
    Bufnea D., et al.: Babes-Bolyai University’s High Performance Computing Center. Studia Universitatis Babes-Bolyai, Informatica Series, vol. LXI, no. 2, pp. 54–69 (2016)Google Scholar
  14. 14.
    BYTE Project Homepage. http://new.byte-project.eu/. Accessed 7 Jan 2019
  15. 15.
    Employers’ Association of the Software and Services Industry, ANIS Scholarships. https://www.anis.ro/burse-anis. Accessed 22 Mar 2019
  16. 16.
    Harland, T.: Teaching to enhance research. High. Educ. Res. Dev. 35(3), 461–472 (2016)MathSciNetCrossRefGoogle Scholar
  17. 17.
    STAR-UBB Institute (Institute of Advanced Studies in Science and Technology). http://starubb.institute.ubbcluj.ro/. Accessed 22 Mar 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Babes-Bolyai UniversityCluj-NapocaRomania
  2. 2.Robert Bosch SRL.Cluj-NapocaRomania

Personalised recommendations