Automatic Performance Simulation for Microservice Based Applications

  • Yao SunEmail author
  • Lun Meng
  • Peng Liu
  • Yan Zhang
  • Haopeng Chan
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 946)


As microservices can easily scale up and down to adapt to dynamic workloads, various Internet-based applications adopt the microservice architecture to provide online services. Existing works often model applications’ performance according to historical training data, but they using static models cannot adapt to dynamic workloads and complex applications. To address the above issue, this paper proposes an adaptive automatic simulation approach to evaluate applications’ performance. We first model applications’ performance with a queue-based model, which well represents the correlations between workloads and performance metrics. Then, we predict applications’ response time by adjusting the parameters of the application performance model with an adaptive fuzzy Kalman filter. Thus, we can predict the applications’ performance by simulating various dynamic workloads. Finally, we have deployed a typical microservice based application and simulated workloads in the experiment to validate our approach. Experimental results show that our approach on performance simulation is much more accurate and effective than existing ones in predicting response time.


Microservice Applications performance Fuzzy logic Kalman filter Performance simulation 



This work was supported by the Ministry of Education of Humanities and Social Science Research (grant 17YJCZH156 and grant 15YJCZH117), the National Social Science Foundation of China (grant 16CXW027), and Fundamental Research Fund for the Central Universities (grant 2014B00514).


  1. 1.
    Shanthikumar, J.G., Buzacott, J.A.: Open queueing network models of dynamic job shops. Int. J. Prod. Res. 19(3), 255–266 (1981)CrossRefGoogle Scholar
  2. 2.
    Kalman, R.E.: A new approach to linear filtering and prediction problems. Trans. ASME-J. Basic Eng. 82, 35–45 (1960)CrossRefGoogle Scholar
  3. 3.
    Sinopoli, B., Schenato, L., Franceschetti, M., et al.: Kalman filtering with intermittent observations. IEEE Trans. Autom. Control 49(9), 1453–1464 (2004)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Martinez, J.F., Ipek, E.: Dynamic multicore resource management: a machine learning approach. IEEE Micro 29(5), 8–17 (2009)CrossRefGoogle Scholar
  5. 5.
    Lama, P., Zhou, X.: Autonomic provisioning with self-adaptive neural fuzzy control for end-to-end delay guarantee. In: IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), pp. 151–160 (2010)Google Scholar
  6. 6.
    Lu, C., Lu, Y., Abdelzaher, T.F., et al.: Feedback control architecture and design methodology for service delay guarantees in web servers. IEEE Trans. Parallel Distrib. Syst. 17(9), 1014–1027 (2006)CrossRefGoogle Scholar
  7. 7.
    Lama, P., Guo, Y., Zhou, X.: Autonomic performance and power control for co-located Web applications on virtualized servers. In: IEEE/ACM 21st International Symposium on Quality of Service (IWQoS), pp. 1–10 (2013)Google Scholar
  8. 8.
    Lama, P., Zhou, X.: Efficient server provisioning with control for end-to-end response time guarantee on multitier clusters. IEEE Trans. Parallel Distrib. Syst. 23(1), 78–86 (2012)CrossRefGoogle Scholar
  9. 9.
    Cao, J., Zhang, W., Tan, W.: Dynamic control of data streaming and processing in a virtualized environment. IEEE Trans. Autom. Sci. Eng. 9(2), 365–376 (2012)CrossRefGoogle Scholar
  10. 10.
    Cherkasova, L., Phaal, P.: Session-based admission control: a mechanism for peak load management of commercial web sites. IEEE Trans. Comput. 51(6), 669–685 (2002)CrossRefGoogle Scholar
  11. 11.
    Robertsson, A., Wittenmark, B., Kihl, M., et al.: Design and evaluation of load control in web server systems. In: Proceedings of IEEE American Control Conference, vol. 3, pp. 1980–1985 (2004)Google Scholar
  12. 12.
    Xu, C.Z., Rao, J., Bu, X.: URL: a unified reinforcement learning approach for autonomic cloud management. J. Parallel Distrib. Comput. 72(2), 95–105 (2012)CrossRefGoogle Scholar
  13. 13.
    Karlsson, M., Karamanolis, C., Zhu, X.: Triage: performance isolation and differentiation for storage systems. In: IEEE International Workshop on Quality of Service, IWQOS, pp. 67–74 (2004)Google Scholar
  14. 14.
    Lama, P., Zhou, X.: Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee. ACM Trans. Auton. Adapt. Syst. 8(2), 9 (2013)CrossRefGoogle Scholar
  15. 15.
    Bodík, P., Griffith, R., Sutton, C., et al.: Statistical machine learning makes automatic control practical for internet datacenters. In: Proceedings of Conference on Hot Topics in Cloud Computing, pp. 12–21 (2009)Google Scholar
  16. 16.
    Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybern. 1, 116–132 (1985)CrossRefGoogle Scholar
  17. 17.
    Daum, F.E.: Extended Kalman Filters. In: Baillieul, J., Samad, T. (eds.) Encyclopedia of Systems and Control. Springer, London (2014). Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Yao Sun
    • 1
    • 2
    Email author
  • Lun Meng
    • 3
  • Peng Liu
    • 1
    • 2
  • Yan Zhang
    • 1
  • Haopeng Chan
    • 1
  1. 1.School of Software EngineeringJinling Institute of TechnologyNanjingChina
  2. 2.Nanjing Institute of Big DataNanjingChina
  3. 3.College of Public AdministrationHohai UniversityNanjingChina

Personalised recommendations