Skip to main content
SpringerLink
Log in

Distributed Monitoring System for Microservices-Based IoT Middleware System

  • Conference paper
  • First Online:
Cloud Computing and Security (ICCCS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11063))

Included in the following conference series:

Abstract

Microservices based architecture is a promising middleware architecture of Internet of things for its advantages of agility and scalability. However, comparing to the native Service oriented Architecture (SOA), the widespread nature, no matter logically or physically, of this lightweight middleware system has made its organization, tracing and monitoring much harder, which could further compromise the effectiveness and performance. To this end, we design, implement and evaluate a new distributed monitoring system for microservices-based middleware of Internet of Things, which is designed as a cloud native system. This system is featured with supporting Kubernetes orchestration, instrument Java and Spring Cloud framework and owing the ability to obtain the performance metrics from all host and containers in an efficient way. Furthermore, it could collect the trace generated by a call from application frontend to each layered microservices, even fetching logging, and finally store them in a big data system for stream processing or map/reduce. The real implementation based evaluation has demonstrated the effectiveness of this system design.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Microservices. http://microservices.io

  2. Docker. https://www.docker.com

  3. Sigelman, B.H.: Dapper, a Large-Scale Distributed Systems Tracing Infrastructure. Google (2010). https://research.google.com/archieve/papers/dapper-2010-1.pdf

  4. OpenZipkin. http://zipkin.io

  5. Jaeger. http://jaeger.readthedocs.io/en/latest

  6. OpenTracing. http://opentracing.io

  7. Verma, A.: Large-scale cluster management at Google with Borg. Google (2015). https://research.google.com/pubs/archive/43438.pdf

  8. Prometheus. https://prometheus.io

  9. Github. https://github.com/tangfeixiong/go-to-docker/tree/master/metering

  10. Kubernetes. https://kubernetes.io

  11. cAdvisor. https://github.com/google/cadvisor

  12. heapster. https://github.com/kubernetes/heapster

  13. Docker Compose. https://github.com/dockre/compose

  14. OpenTSDB. http://opentsdb.net

  15. The OpenTracing Semantic Specification. https://github.com/opentracing/specification

  16. ElasticSearch. https://www.elastic.co/products/elasticsearch

  17. Kafka. https://kafka.apache.org

  18. Protocol Buffer. https://developers.google.com/protocol-buffers

  19. gRPC. https://grpc.io

  20. Redis. https://redis.io

  21. Spring Framework. https://projects.spring.io/spring-framework

  22. Spring Boot. https://projects.spring.io/spring-boot

  23. Apache thrift. https://thrift.apache.org

  24. Spring Cloud Netflix. https://cloud.spring.io/spring-cloud-netflix

  25. Apache spark. http://spark.apache.org

  26. Murphy, N.: Site Reliability Engineering. O’Reilly Media, Sebastopol (2016). http://shop.oreilly.com/product/0636920041528.do

    Google Scholar 

  27. Balalaie, A., Heydarnoori, A., Jamshidi, P.: Migrating to cloud-native architectures using microservices: an experience report. In: Celesti, A., Leitner, P. (eds.) ESOCC Workshops 2015. CCIS, vol. 567, pp. 201–215. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-33313-7_15

    Chapter  Google Scholar 

  28. Wolff, E.: Microservices: Flexible Software Architectures. CreateSpace Independent Publishing Platform (2016)

    Google Scholar 

  29. Xiao, Z., Wijegunaratne, I., Qiang, X.: Reflections on SOA and microservices. In: 4th International Conference on Enterprise Systems (ES), pp. 60–67 (2016)

    Google Scholar 

  30. Kratzke, N., Quint, P.-C.: Understanding cloud-native applications after 10 years of cloud computing - a systematic mapping study. J. Syst. Softw. 126, 1–16 (2017)

    Article  Google Scholar 

  31. Fowler, M.: Microservices resource guide (2016). http://martinfowler.com/microservices

  32. Richards, M.: Microservices Vs Service-oriented Architecture. O’Reilly Media, Sebastopol (2015)

    Google Scholar 

  33. Cerny, T., Donahoo, Michael J.: Survey on concern separation in service integration. In: Freivalds, R.M., Engels, G., Catania, B. (eds.) SOFSEM 2016. LNCS, vol. 9587, pp. 518–531. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49192-8_42

    Chapter  Google Scholar 

  34. Cerny, M., Donahoo, J., Pechanec, J.: Disambiguation and comparison of soa, microservices and self-contained systems. In: Proceedings of the International Conference on Research in Adaptive and Convergent Systems, RACS 2017, pp. 228–235. ACM, New York (2017)

    Google Scholar 

  35. Josuttis, N.: Soa in Practice. O’Reilly Media, Sebastopol (2007)

    Google Scholar 

  36. Conway, M.E.: How do committees invent. Datamation 14(4), 28–31 (1968)

    Google Scholar 

  37. Shelby, Z., Hartke, K., Bormann, C.: The Constrained Application Protocol (CoAP) (2014). http://coap.technology/

  38. Message Queue Telemetry Transport (MQTT). http://mqtt.org

  39. OneM2 M Alliance. http://onem2m.org

  40. Zhao, Y., Wu, J., Li, W., Lu, S., Chen, B.: Navigation-driven handoff minimization in wireless networks. Wirel. Commun., Mob. Comput. (2017)

    Google Scholar 

  41. FI-WARE project. http://fi-ware.org

  42. Havlik, D. et al.: Future Internet enablers for VGI applications (2013)

    Google Scholar 

  43. Chang, W., Jie, W.: Progressive or conservative: rationally allocate cooperative work in mobile social networks. IEEE Trans. Parallel Distrib. Syst. 26(7), 2020–2035 (2015)

    Article  Google Scholar 

  44. Chang, W., Jie, W., Tan, C.C.: Improving cooperative trajectory mapping applications with encounter-based error correction. Int. J. Parallel Emergent Distrib. Syst. 29(1), 68–89 (2014)

    Article  Google Scholar 

  45. Fielding, R.T.: Architectural styles and the design of network-based software architectures. Ph.D. dissertation, University of California, Irvine (2000)

    Google Scholar 

  46. Zhao, Y., Li, W., Wu, J., Lu, S.: Quantized conflict graphs for wireless network optimization. In: IEEE Conference on Computer Communications (INFOCOM 2015), Hong Kong, April 26–30, 2015

    Google Scholar 

  47. Theodoridis, E., Mylonas, G., Chatzigiannakis, I.: Developing aniot smart city framework. In: Fourth International Conference on Information, Intelligence, Systems and Applications (IISA) 2013, pp. 1–6, July 2013

    Google Scholar 

  48. ALMANAC project Web site. www.almanacproject.eu/

Download references

Author information

Authors and Affiliations

  1. Nari Group Corporation, State Grid Electric Power Research Institute, Beijing, China

    Rui Kang, Zhenyu Zhou, Jiahua Liu, Zhongran Zhou & Shunwang Xu

Authors
  1. Rui Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenyu Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiahua Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongran Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shunwang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rui Kang .

Editor information

Editors and Affiliations

  1. Nanjing University of Information Science and Technology, Nanjing, China

    Xingming Sun

  2. Nanjing University of Information Science and Technology, Nanjing, China

    Zhaoqing Pan

  3. Department of Computer Science, Purdue University, West Lafayette, IN, USA

    Elisa Bertino

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kang, R., Zhou, Z., Liu, J., Zhou, Z., Xu, S. (2018). Distributed Monitoring System for Microservices-Based IoT Middleware System. In: Sun, X., Pan, Z., Bertino, E. (eds) Cloud Computing and Security. ICCCS 2018. Lecture Notes in Computer Science(), vol 11063. Springer, Cham. https://doi.org/10.1007/978-3-030-00006-6_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00006-6_43

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00005-9

  • Online ISBN: 978-3-030-00006-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation