Skip to main content
SpringerLink
Log in

Don’t Be Afraid of Failure—Insights from a Survey on the Failure of Data Science Projects

  • Chapter
  • First Online:
Apply Data Science

Abstract

Data Science projects fail more often than other projects. Many companies therefore still avoid addressing complex data-driven questions. Seeking the reason for failure only in the novelty and complexity of these projects is too short-sighted. A survey of 85 knowledge workers from companies of different sizes shows, in addition to problems for which established solutions already exist, also special challenges of the discipline of Data Science. These include in particular the lack of Data Science skills among the relevant groups in the company as well as the wrong approach to Data Science projects. The findings from this study can be used by companies and researchers to reduce the risk of failure by an appropriate project approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://twitter.com/nheudecker.

References

  1. Berman F, Rutenbar R, Hailpern B et al (2018) Realizing the potential of data science. Commun ACM 61(4):67–72

    Article  Google Scholar 

  2. Stodden V (2020) The data science life cycle: a disciplined approach to advancing data science as a science. Commun ACM 63(7):58–66

    Article  Google Scholar 

  3. van der Aalst W (2016) Data science in action. In: van der Aalst W (Hrsg) Process mining, Springer, Berlin, S 3–23

    Google Scholar 

  4. Cao L (2019) Data science: profession and education. IEEE Intell Syst 34(5):35–44

    Article  Google Scholar 

  5. Agarwal R, Dhar V (2014) Big data, data science, and analytics: the opportunity and challenge for IS research. Inf Syst Res 25(3):443–448

    Article  Google Scholar 

  6. Cao L (2017) Data science: challenges and directions. Commun ACM 60(8):59–68

    Article  Google Scholar 

  7. Schulz M, Neuhaus U, Kaufmann J, Badura S, Kühnel A, Badewitz W, Dann D, Kloker S, Alekozai EM, Lanquillon C (2020) Introducing DASC-PM: A Data Science Process Model, Australasian Conference on Information Systems (ACIS) Proceedings 2020, Wellington, New Zealand

    Google Scholar 

  8. Vicario G, Coleman S (2020) A review of data science in business and industry and a future view. Appl Stoch Model Bus Ind 36(1):6–18

    Article  MathSciNet  Google Scholar 

  9. Martínez-Plumed F, Contreras-Ochando L, Ferri C et al (2019) CRISP-DM twenty years later: from data mining processes to data science trajectories. IEEE Transactions on Knowledge and Data Engineering

    Google Scholar 

  10. Davenport TH, Patil DJ (2012) Data scientist. Harv Bus Rev 90(5):70–76

    Google Scholar 

  11. Conway D (2010) The data science VENN diagram. Dataists. drewconway.com/zia/2013/3/26/the-data-science-venn-diagram. Access date: 31. Jan. 2021

  12. Mikalef P, Giannakos, MN, Pappas IO et al (2018) The human side of big data: understanding the skills of the data scientist in education and industry. In: 2018 IEEE global engineering education conference, 503–512

    Google Scholar 

  13. Aho T, Sievi-Korte O, Kilamo T et al (2020) Demystifying data science projects: a look on the people and process of data science today. In: International conference on product-focused software process improvement, Springer, Cham, 153–167

    Google Scholar 

  14. Kross S, Guo PJ (2019) Practitioners teaching data science in industry and academia: expectations, workflows, and challenges. In: Proceedings of the 2019 CHI conference on human factors in computing systems, 1–14

    Google Scholar 

  15. Wirth R, Hipp J (2000) CRISP-DM: towards a standard process model for data mining. In: Proceedings of the 4th international conference on the practical applications of knowledge discovery and data mining, 1. Aufl. Springer, London

    Google Scholar 

  16. Cao L (2017) Data science: a comprehensive overview. ACM Comput Surv 50(3):1–42

    Article  Google Scholar 

  17. Saltz J, Crowston K (2017) Comparing data science project management methodologies via a controlled experiment. In: Proceedings of the 50th Hawaii international conference on system sciences, 1013–1022

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Hamburg, Deutschland

    Jule Aßmann

  2. NORDAKADEMIE Hochschule der Wirtschaft, Elmshorn, Deutschland

    Joachim Sauer & Michael Schulz

Authors
  1. Jule Aßmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joachim Sauer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Schulz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jule Aßmann .

Editor information

Editors and Affiliations

  1. FB Informatik, Hochschule Worms, Worms, Germany

    Thomas Barton

  2. FB Wirtschaft, Informatik, Recht (WIR), Technische Hochschule Wildau, Wildau, Germany

    Christian Müller

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Fachmedien Wiesbaden GmbH, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Aßmann, J., Sauer, J., Schulz, M. (2023). Don’t Be Afraid of Failure—Insights from a Survey on the Failure of Data Science Projects. In: Barton, T., Müller, C. (eds) Apply Data Science. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-38798-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-658-38798-3_5

  • Published:

  • Publisher Name: Springer Vieweg, Wiesbaden

  • Print ISBN: 978-3-658-38797-6

  • Online ISBN: 978-3-658-38798-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation