Skip to main content

Big Data—Technologies and Potential

  • Chapter
  • First Online:
Enterprise -Integration

Part of the book series: VDI-Buch ((VDI-BUCH))

Abstract

Recently, the term Big Data has gained tremendous popularity in business and academic discussions and is now prominently used in scientific publications (Jacobs, Communications of the ACM—A Blind person’s interaction with technology, 2009), business literature (Mayer-Schönberger and Cukier, Big Data. A revolution that will transform how we live, work, and think, 2013; McAfee and Brynjolfsson, Harvard Business Review 90, 2012), whitepapers and analyst reports (Brown et al., Big Data. The next frontier for innovation, competition, and productivity, 2011b; Economist Intelligence Unit 2012; Schroeck et al., Analytics: The real-world use of Big Data, 2012), as well as in popular magazines (Cukier 2010). While all these references somewhat associate the term with a new paradigm for data processing and analytics, the perception of what exactly it refers to are very diverse. The gap in the understanding of the phenomenon of Big Data is highlighted by the results of a recent study – in which respondents were asked to choose descriptions of the term Big Data – resulting in diverse characterizations such as, e.g., “A greater scope of information”, “New kinds of data and analysis” or “Real-time information” (Schroeck et al. 2012).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 69.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abadi DJ et al (2009) A comparison of approaches to large scale data analysis. In: Çetintemel U, Zdonik S (eds) Proceedings of the 35th SIGMOD International Conference on Management of Data. June 29–July 2, 2009, Providence, RI, USA. ACM Press, New York, pp 165–178

    Google Scholar 

  • Abadi DJ et al (2010) MapReduce and parallel DBMSs. Friends or Foes? Communications of the ACM. Amir Pnueli: Ahead of His Time 53(1):64–71

    Google Scholar 

  • Babu S, Widom J (2001) Continuous queries over data streams. ACM SIGMOD 30(3):109–120

    Article  Google Scholar 

  • Ballard C et al (2010) IBM InfoSphere Streams. Harnessing data in motio, 1st edn. International Technical Support Organisation, New York

    Google Scholar 

  • Barton D, Court D (2012) Making advanced analytics work for you. Harvard Bus Rev 90(10):79–83

    Google Scholar 

  • Biem A et al (2010) Real-time traffic information management using stream computing. Bull Tech Committee Data Eng 33(2):64–68

    Google Scholar 

  • Bollier D (2010) The promise and peril of Big Data. Aspen Institute, Communications and Society Program, Washington, DC

    Google Scholar 

  • Brown E et al (2010) Building Watson. An overview of the Deep QA Project. AI Magazine 31(3):59–79

    Google Scholar 

  • Brown B, Chui M, Manyika J (2011a) Are you ready for the era of ‘Big Data’? McKinsey & Company (ed). McKinsey Global Institute, o. O

    Google Scholar 

  • Brown B et al (2011b) Big Data. The next frontier for innovation, competition, and productivity. McKinsey & Company (ed). McKinsey Global Institute, o. O

    Google Scholar 

  • Brynjolfsson E, Hitt L, Kim H (2011) Strength in Numbers. How does data-driven decision-making affect firm performance? In: Beath C, Myers MD, Wei K (eds) Proceedings of the International Conference on Information Systems, Shanghai

    Google Scholar 

  • Cate F et al (2012) The challenge of ‘Big Data’ for data protection. Int Data Privy Law 2(2):47–49

    Article  Google Scholar 

  • Stonebraker M, Cetintemel U, Zdonik S (2005) The 8 requirements of real-time stream processing. ACM SIGMOD Record 34(4):42–47

    Article  Google Scholar 

  • Chansler R et al (2010) The hadoop distributed file system. In: Factor M, He X, Khatib MG (eds) 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST). 6–7 May 2010, Lake Tahoe, Nevada, USA. IEEE, Piscataway, NJ, S 1–10

    Google Scholar 

  • Cukier K (2010) Data, data, everywhere. A special report on managing information. The economist 2010, Feb 27th–March 5th, vol 394, Nr. 8671

    Google Scholar 

  • Davenport TH, Harris JG (2007) Competing on analytics. The new science of winning. Harvard Business School Press, Boston

    Google Scholar 

  • Davenport TH, Patil D (2012) Data scientist: the sexiest job of the 21st century. Harvard Bus Rev 90(10):70–76

    Google Scholar 

  • Davis K, Patterson D (2012) Ethics of Big Data. O’Reilly Media, Sebastopol

    Google Scholar 

  • Dean J, Ghemawat S (2008) MapReduce. Simplified data processing on large clusters. Communications of the ACM—50th anniversary issue: 1958–2008 51(1):107–113

    Google Scholar 

  • Economist Intelligence Unit (2012) The deciding factor. Big Data & decision making (ed) Capgemini

    Google Scholar 

  • Fowler M, Sadalage PJ (2012) NoSQL distilled. A brief guide to the emerging world of polygot persistence. Addison-Wesley, Boston

    Google Scholar 

  • Fromm H (2010) Analytic solutions for fraud management. Presentation at the “Journeed’Etudes: Techniques des assurances et assurances techniques”. Published in: Les Cahiers de la Mathématique Appliquée No. 6. Accessed 22 Nov, Brussels

    Google Scholar 

  • Gantz J, Reinsel D (2012) The digital universe in 2020. Big Data, bigger digital shadows, and biggest growth in the far East. IDC iView

    Google Scholar 

  • Gartner (2013) IT Glossary. http://www.gartner.com/it-glossary/big-data/. Accessed 5 Aug 2013

  • Ghoting A et al (2011) SystemML. Declarative Machine Learning on MapReduce. In: Proceedings of the 2011 IEEE 27th International Conference on Data Engineering (ed) IEEE Computer Society pp 131–142

    Google Scholar 

  • Gray J, Szalay A (2006) 2020 Computing. Science in an exponential world. Nature 440(7083):413–441

    Article  Google Scholar 

  • Guizzo E (2011) IBM’s Watson Jeopardy computer shuts down humans in final game. IEEE Spectrum o. Jg

    Google Scholar 

  • Halevi G et al (2012) Research trends. Special issue on Big Data. Research Trends 26(6):o. S

    Google Scholar 

  • Hilary M (2013) What is a data scientist? http://www.forbes.com/sites/danwoods/2012/03/08/hilary-mason-what-is-a-data-scientist/. Accessed 7 Aug 2013

  • Jacobs A (2009) The pathologies of Big Data. Commun ACM. A Blind Person’s Interact Technol 52(8):36–42

    Google Scholar 

  • Kiron D et al (2012) Sustainability nears a tipping point. MIT Sloan Manag Rev 53(2):69–74

    Google Scholar 

  • Laney D (2001) 3D data management: controlling data volume, velocity, and variety. META Group, o. O. (ed). Accessed 7 August 2001

    Google Scholar 

  • LaValle S, Lesser E, Shockley R (2011) Big Data, analytics and the path from insights to value. MITSloan Manag Rev 52(2):21–31

    Google Scholar 

  • Luckham D (2002) The power of events. An introduction to complex event processing in distributed enterprise systems. Wesley, Boston

    Google Scholar 

  • Luckham DC (2012) Event processing for business. organizing the real-time enterprise. Wiley, Hoboken

    Google Scholar 

  • Mayer-Schönberger V, Cukier K, (2013) Big Data. A revolution that will transform how we live, work, and think. Houghton Mifflin Harcourt, Boston

    Google Scholar 

  • McAfee A, Brynjolfsson E (2012) Big Data. The management revolution. Harvard Bus Rev 90(10):61–67

    Google Scholar 

  • Miller CC (2013) Data science. The numbers of our lives. The New York Times o. Jg. S o. S

    Google Scholar 

  • Polonetsky J, Tene O (2012) Privacy in the age of Big Data. A time for big decisions. Stanford Law Rev 64:63

    Google Scholar 

  • Polonetsky J, Tene O (2013) Big Data for all. Privacy and user control in the age of analytics. Northwestern J Technol Intellect Property 11(5):240–272

    Google Scholar 

  • Schroeck M et al (2012) Analytics: the real-world use of Big Data. How innovative enterprises extract value from uncertain data. IBM Global Business Services (ed). IBM Institute for Business Value, o. O

    Google Scholar 

  • Sicular S (2013) Gartner’s Big Data definition consists of three parts, not to be confused with three “V”s. http://www.forbes.com/sites/gartnergroup/2013/03/27/gartners-big-data-definition-consists-of-three-parts-not-to-be-confused-with-three-vs/. Accessed 6 Aug 2013

  • Stonebraker M (1986) The case for shared nothing. IEEE Database Eng Bull 9(1):4–9

    Google Scholar 

  • White T (2009) Hadoop. The definitive guide. O’Reilly, Sebastopol

    Google Scholar 

  • Zikopoulos P, Eaton C (2012) Understanding Big Data: analytics for enterprise class hadoop and streaming data. Osborne, New York

    Google Scholar 

Download references

Acknowledgments

We are grateful to Steven O. Kimbrough (Wharton School, University of Pennsylvania, USA) and Stefan Mueck (IBM Germany) for excellent comments on draft versions of this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hansjörg Fromm .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Fromm, H., Bloehdorn, S. (2014). Big Data—Technologies and Potential. In: Schuh, G., Stich, V. (eds) Enterprise -Integration. VDI-Buch. Springer Vieweg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41891-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-41891-4_9

  • Published:

  • Publisher Name: Springer Vieweg, Berlin, Heidelberg

  • Print ISBN: 978-3-642-41890-7

  • Online ISBN: 978-3-642-41891-4

  • eBook Packages: Computer Science and Engineering (German Language)

Publish with us

Policies and ethics