Skip to main content

Software Project Management for Combined Software and Data Engineering

  • Chapter
  • First Online:
Software Project Management for Distributed Computing

Part of the book series: Computer Communications and Networks ((CCN))

  • 1470 Accesses

Abstract

This chapter presents a methodology for combining software and data engineering life cycles in large software projects. Software and data engineering use multiple stages to form a life cycle for the creation of a system. Large projects often have elements of both software and data engineering. These are usually kept independent from each other as the development approaches are quite divergent; software engineering tends to be top-down, prescriptive and rigid, while data engineering tends to be bottom-up, descriptive and fluid. The methodology presented in this chapter defines a system for sharing and reuse of artefacts between software and data engineering development processes, in spite of the differences in development philosophies. The methodology helps to identify dependencies to support project planning, reduces effort by reuse and collaboration and increases quality by application of best practices. The central aspect of the methodology is a table which is used to define the synchronisation points between the two development domains, where collaboration between the separate life cycles can occur. Developers engaged in either life cycle can use a synchronisation table created for the project to send and receive shared artefacts between life cycles. This work is informed by the development and management of the ALIGNED project, a large, multi-partner, interdisciplinary project that involves both software and data engineering.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Davies J, Gibbons J, Welch J, Crichton E (2014) Model-driven engineering of information systems: 10 years and 1000 versions. Sci Comput Program 2014:88–104

    Article  Google Scholar 

  2. Davies J, Gibbons J, Milward A, Milward D, Shah S, Solanki M, Welch J (2015) Domain specific modelling for clinical research. In: Proceedings of the workshop on domain-specific modeling. ACM, New York

    Google Scholar 

  3. Dimou A, Kontokostas D, Freudenberg M, Verborgh R, Lehmann J, Mannens E, Hellmann S, de Walle RV (2015) Assessing and refining mappings to rdf to improve dataset quality. In: Proceedings of the 14th international semantic web conference

    Google Scholar 

  4. Feeney KC, O’Sullivan D, Tai W, Brennan R (2014) Improving curated web-data quality with structured harvesting and assessment. Int J Semant Web Inf Syst 2014:35–62

    Article  Google Scholar 

  5. Schandl T, Blumauer, A (2010) PoolParty: SKOS thesaurus management utilizing linked data. In: The semantic web: research and applications: 7th extended semantic web conference, ESWC 2010, Heraklion, May 30–June 3, 2010, Proceedings, Part II, Springer, Berlin

    Google Scholar 

  6. Kontokostas D, Mader C, Dirschl C, Eck K, Leuthold M, Lehmann J, Hellmann S (2016) Semantically enhanced quality assurance in the JURION business use case. In: The semantic web. Latest advances and new domains: 13th international conference, ESWC 2016, Heraklion, Proceedings, Springer, May 29–June 2 2016

    Google Scholar 

  7. Royce WW (1970) Managing the development of large software systems. In: Proceedings of IEEE WESCON. Los Angeles

    Google Scholar 

  8. Larman C, Basili VR (2003) Iterative and incremental development: a brief history. Computer 2003:47–56

    Article  Google Scholar 

  9. Martin J (1991) Rapid application development. Macmillan Publishing Co., Indianapolis

    Google Scholar 

  10. Fowler M, Highsmith J (2001) The agile manifesto. Software Dev 9(8):28–35

    Google Scholar 

  11. Selic B (2003) The pragmatics of model-driven development. In: IEEE Softw. Sept 2003, pp 19–25

    Google Scholar 

  12. Auer S, Bühmann L, Dirschl C, Erling O, Hausenblas M, Isele R, Lehmann J, Martin M, Mendes PN, van Nuffelen B, Stadler C, Tramp S, Williams H (2012) Managing the life-cycle of linked data with the LOD2 stack. In: The semantic web – ISWC 2012: 11th International Semantic Web Conference, Boston, 11–15 Nov2012, Proceedings, Part II, Springer, Berlin/Heidelberg

    Google Scholar 

  13. Reiter R (1978) On closed world data bases. Springer US, Boston

    Book  Google Scholar 

  14. Hitzler P, Janowicz K (2013) Linked data, big data, and the 4th paradigm. Semantic Web 2013:233–235

    Google Scholar 

  15. Cleve A, Mens T, Hainaut J-L (2010) Data- intensive system evolution. Computer 2010:110–112

    Article  Google Scholar 

  16. Mattmann CA, Crichton DJ, Hart AF, Goodale C, Hughes JS, Kelly S, Cinquini L, Painter TH, Lazio J, Waliser D et al (2011) Architecting data-intensive software systems. Springer, New York

    Book  Google Scholar 

  17. Zaveri A, Rula A, Maurino A, Pietrobon R, Lehmann J, Auer S (2015) Quality assessment for linked data: a survey. Semant Web 2015:63–93

    Article  Google Scholar 

  18. Anderson, KM 2015 Embrace the challenges: software engineering in a big data world. In: Proceedings of the First International Workshop on BIG Data Software Engineering, IEEE Press, Piscataway

    Google Scholar 

  19. Qiu D, Li B, Su Z (2013) An empirical analysis of the co-evolution of schema and code in database applications. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering. ACM, New York

    Google Scholar 

  20. Bentley J (1986) Programming pearls. ACM, New York

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seyyed M. Shah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Shah, S.M., Welch, J., Davies, J., Gibbons, J. (2017). Software Project Management for Combined Software and Data Engineering. In: Mahmood, Z. (eds) Software Project Management for Distributed Computing. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-54325-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-54325-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-54324-6

  • Online ISBN: 978-3-319-54325-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics