Advertisement

FSObserver: A Performance Measurement and Monitoring Tool for Distributed Storage Systems

  • Xiao ZhangEmail author
  • Lanxin Kong
  • Shunyi Zhu
  • Zhanhuai Li
  • Xiaonan Zhao
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11276)

Abstract

It is a big challenge to measure and monitor the performance of a large-scale distributed storage system accurately. We present a flexible approach based on the message analysis, named FSObserver, which can accurately and fine-grained trace individual request or response by observing network traffic. Experiments results show that our approach can get accurate performance with slight performance degradation.

Notes

Acknowledgment

This work is supported by the NFS of China under Grant No. 61472323 and No. 61502392 and the Ministry of Science and Technology of China, National Key Research and Development Program (No. 2018YFB1004401).

References

  1. 1.
    Yuan, D., Zheng, J., Park, S., Zhou, Y., Savage, S.: Improving software diagnosability via log enhancement. ACM Trans. Comput. Syst. (TOCS) 30(1), 4 (2012)CrossRefGoogle Scholar
  2. 2.
    Zhao, Y., Cao, Y., Chen, Y., Zhang, M., Goyal, A.: Rake: semantics assisted network-based tracing framework. IEEE Trans. Netw. Serv. Manage. 10(1), 3–14 (2013)CrossRefGoogle Scholar
  3. 3.
    Määttä, M., Räty, T.: Automatic model creation to support network monitoring. IEEE Access 2, 142–152 (2014)CrossRefGoogle Scholar
  4. 4.
    Gudu, D., Hardt, M., Streit, A.: Evaluating the performance and scalability of the Ceph distributed storage system. In: 2014 IEEE International Conference on Big Data (Big Data), pp. 177–182. IEEE (2014)Google Scholar
  5. 5.
    Wang, F., Nelson, M., Oral, S., Atchley, S.: Performance and scalability evaluation of the Ceph parallel file system. In: Proceedings of the 8th Parallel Data Storage Workshop, pp. 14–19. ACM (2013)Google Scholar
  6. 6.
    Oliner, A., Ganapathi, A., Xu, W.: Advances and challenges in log analysis. Commun. ACM 55(2), 55–61 (2012)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2018

Authors and Affiliations

  • Xiao Zhang
    • 1
    • 2
    Email author
  • Lanxin Kong
    • 1
  • Shunyi Zhu
    • 1
  • Zhanhuai Li
    • 1
    • 2
  • Xiaonan Zhao
    • 1
    • 2
  1. 1.School of Computer ScienceNorthwestern Polytechnical UniversityXi’anChina
  2. 2.MIIT Key Laboratory of Big Data Storage and ManagementXi’anChina

Personalised recommendations