Abstract
IoT connects devices, humans, places, and even abstract items like events. Driven by smart sensors, powerful embedded microelectronics, high-speed connectivity and the standards of the internet, IoT is on the brink of disrupting today’s value chains. Big Data, characterized by high volume, high velocity and a high variety of formats, is a result of and also a driving force for IoT. The datafication of business presents completely new opportunities and risks. To hedge the technical risks posed by the interaction between “everything”, IoT requires comprehensive modelling tools. Furthermore, new IT platforms and architectures are necessary to process and store the unprecedented flow of structured and unstructured, repetitive and non-repetitive data in real-time. In the end, only powerful analytic tools are able to extract “sense” from the exponentially growing amount of data and, as a consequence, data science becomes a strategic asset. The era of IoT relies heavily on standards for technologies which guarantee the interoperability of everything. This paper outlines some fundamental standardization activities. Big Data approaches for real-time processing are outlined and tools for analytics are addressed. As consequence, IoT is a (fast) evolutionary process whose success in penetrating all dimensions of life heavily depends on close cooperation between standardization organizations, open source communities and IT experts.
Similar content being viewed by others
References
451 Research (2016) Open source big data projects—emergence of the converged data platform, Executive Brief 2016
Ayla Networks (2015) Build vs. buy. Manufacturers’ Biggest IoT Decision: Build or buy an IoT platform? White Paper
Bughin J, Chui N, Manyika J (2015) An executive’s guide to the Internet of Things The rate of adoption is accelerating. Here are six things you need to know. McKinsey Quarterly, August 2015
Charan R (2015) The Attackers’ advantage. Turning Uncertainty into breakthrough opportunities, New York
Cloudera (2016) Webinar
Dull T (2015) Big data and the Internet of Things: Two sides of the same coin? SAS Best Practices. http://www.sas.com/en_ph/insights/articles/big-data/big-data-and-iot-two-sides-of-the-same-coin.html
Gartner (2014) Gartner says 4.9 billion connected “Things” will be in use in 2015. In 2020, 25 Billion Connected “Things” Will Be in Use, Nov. 2014. http://Gartner.com/newsroom/id/2905717hadoop.apache.org/
Gruhn, Volker 2017. Big Picture: Engineering CPS. Presentation for the CPS.HUB NRW, April 28, 2017
Hauptfleisch K (2015) Über machine-to-machine und Internet der Dinge zur Industrie 4.0, Computerwoche, 11.07.2015
Heck D, Franco J-M (2016) Big Data at Air France, talend internal paper
Hewlett Packard Enterprise (2014) From hindsight to insight to foresight. Extend analytical capabilities with the HPE Vertica Analytics Platform. Technical white paper
http://www.libelium.com/casestudies. Dated August 29, 2016
http://www.zvei.org/Downloads/Automation/ZVEI-Faktenblatt-Industrie4_0-RAMI-4_0.pdf. Dated August 29, 2016
IDS (2017) http://www.industrialdataspace.org/en/
Inmon WH, Linstedt D (2015) Data architecture: a primer for the data scientist. Big Daga, Data Warehouse and Data Vault. Amsterdam etc
Jesse N (2014) Boosting Government Performance with Open Source Software?—A Roadmap for Germany/¿Impulsar el desempeño del estado con software de código abierto? - Plan de trabajo para Alemania, Conferencia Científica International (UCIENCIA 2014), La Habana
Koster M (2016) Data models for the Internet of Things. http://iot-datamodels.blogspot.de
Kubach U (2016) Das Internet der Dinge als Enabler für Industrie 4.0 Anwendungen. Talk at Hannover Messe, April 28, 2016. http://lambda-architecture.net/
Lauby Sh. (2015) Your data is not magic—friday Distraction. http://www.hrbartender.com/tag/big-data/. Accessed 18 Sep 2015
McLellan (2015) The internet of things and big data: Unlocking the power. ZDNet Special Feature: The Power of IoT and Big Data, March 2, 2015
Milenkovic M (2015) A case for interoperable IoT sensor data and meta-data formats. Ubiquity symposium: the internet of things. Ubiquity, Volume 2015, Issue November 2015
Provost F, Fawcett T (2013) Data science for businesses. What you Need to know about data mining and data-analytic thinking. Sebastopol
Raggett D (2015) Building the web of things, posted May 29, 2015. http://www3.org/blog/wotig/2015/05/29/ building-the-web-of-things/
Ransbotham S (2015) Ready or not, here IoT comes. MITSloan. Blog December 22, 2015. http://sloanreview.mit.edu/article/ready-or-not-here-iot-comes/
Sepia Alterra MDM-integration in die Unternehmens IT. Düsseldorf
Simmons Th (2014) Sensoren und Messtechnik: Schlüsseltechnologien des technischen Fortschritts. all-electronicsde. 27.05.2014
Siprell St (2016) Datenverarbeitung mit Sensoren. Javasprecturm 3/2016, p 50 ff
Trankler R, Kanoun O (2001) Recent advances in sensor technology. In: Instrumentation and measurement technology conference (IMTC), 2001 May 21–23. Proceedings of the 18th IEEE (vol 1)
VDI nachrichten (2016) Big Data weiter im Höhenflug. April 29, 2016, Nr. 17/18
Wilmer D (2016) The evolution of ETL and continuous integration. Talend blog. 15. June 2016. http://de.talend.com/blog/
Acknowledgements
The author is grateful for the information provided by Talend Inc., TIBCO Inc., Ayla Networks Inc. and Cumulocity GmbH as well as discussions with Dr. Gero Presser.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jesse, N. Internet of Things and Big Data: the disruption of the value chain and the rise of new software ecosystems. AI & Soc 33, 229–239 (2018). https://doi.org/10.1007/s00146-018-0807-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00146-018-0807-y