Abstract
The proliferation of IoT devices is ubiquitous. While there is significant ongoing research and development in the area of IoT devices and the associated challenges (Eg: power, space, ...), the end goal of an IoT deployment is often to process the collected data in order to run analytics (i.e., batch) or to react/respond (i.e., real-time). Therefore, the flow of data from individual sensors all the way up to the servers that analyze massive data needs needs to be carefully architected. Further, the flow of data can guide the design choices (CPU, RAM, Storage, Networking) of system at each step of the IoT data flow chain. This paper presents design considerations for this “end-to-end” flow of data from IoT device to server.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
S. Chen, H. Xu, D. Liu, B. Hu, H. Wang, A vision of IoT: applications, challenges, and opportunities with China perspective. IEEE Int. Things J. 1(4), 349–359 (2014)
D. Blaauw, IoT design space challenges: Circuits and systems, Symposium on VLSI Technology (VLSI-Technology): Digest of Technical Papers (Honolulu, HI 2014, 2014), pp. 1–2
J.B. Xu, Wendt, M. Potkonjak, Security of IoT systems: design challenges and opportunities, in Proceedings of the 2014 IEEE/ACM International Conference on Computer-Aided Design (ICCAD ’14) (IEEE Press, Piscataway, NJ, USA, 2014), pp. 417–423
D.G. KorzunSergey, I. BalandinAndrei, V. Gurtov, Deployment of Smart Spaces in Internet of Things: Overview of the Design Challenges: Internet of Things, Smart Spaces, and Next Generation Networking pp. 48–59 (2013)
S.C. Mukhopadhyay, N.K. Suryadevara, Internet of things: challenges and opportunities, in Internet of Things. Smart Sensors, Measurement and Instrumentation, ed. by S. Mukhopadhyay , vol 9 (Springer, Cham 2014)
Delta Encoding. https://en.wikipedia.org/wiki/Delta_encoding
M. Zaharia et al., Apache Spark: a unified engine for big data processing. Commun. ACM CACM Homepage 59(11), 56–65 (2016)
E. Friedman, K. Tzoumas, Introduction to Apache Flink: Stream Processing for Real Time and Beyond (O’Reilly Media, Inc. 2016)
Apache Kafka. https://kafka.apache.org/
TensorFlow. https://www.tensorflow.org
PySpark. http://spark.apache.org/docs/2.2.0/api/python/pyspark.html/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Dash, A. (2021). End-to-End Data Architecture Considerations for IoT. In: Kumar Pani, S., Pandey, M. (eds) Internet of Things: Enabling Technologies, Security and Social Implications. Services and Business Process Reengineering. Springer, Singapore. https://doi.org/10.1007/978-981-15-8621-7_2
Download citation
DOI: https://doi.org/10.1007/978-981-15-8621-7_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8620-0
Online ISBN: 978-981-15-8621-7
eBook Packages: EngineeringEngineering (R0)