Advertisement

An Innovative Deep-Learning Algorithm for Supporting the Approximate Classification of Workloads in Big Data Environments

  • Alfredo CuzzocreaEmail author
  • Enzo Mumolo
  • Carson K. Leung
  • Giorgio Mario Grasso
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11872)

Abstract

In this paper, we describe AppxDL, an algorithm for approximate classification of workloads of running processes in big data environments via deep learning (deep neural networks). The Deep Neural Network is trained with some workloads which belong to known categories (e.g., compiler, file compressor, etc...). Its purpose is to extract the type of workload from the executions of reference programs, so that a Neural Model of the workloads can be learned. When the learning phase is completed, the Deep Neural Network is available as Neural Model of the known workloads. We describe the AppxDL algorithm and we report and discuss some significant results we have achieved with it.

Keywords

Workload classification Virtualized environment Deep learning 

Notes

Acknowledgments

This project is partially supported by NSERC (Canada) and University of Manitoba.

References

  1. 1.
    Van Do, T.: Comparison of allocation schemes for virtual machines in energy-aware server farms. Comput. J. 54(11), 1790–1797 (2011)CrossRefGoogle Scholar
  2. 2.
    Islam, S., Keung, J., Lee, K., Liu, A.: Empirical prediction models for adaptive resource provisioning in the cloud. Future Generation Comp. Syst. 28(1), 155–162 (2012)CrossRefGoogle Scholar
  3. 3.
    Garg, S.K., Toosi, A.N., Gopalaiyengar, S.K., Buyya, R.: SLA-based virtual machine management for heterogeneous workloads in a cloud datacenter. J. Netw. Comput. Appl. 45, 108–120 (2014)CrossRefGoogle Scholar
  4. 4.
    Akindele, A.B., Samuel, A.A.: Predicting cloud resource provisioning using machine learning techniques. In: IEEE CCECE, pp. 1–4 (2013)Google Scholar
  5. 5.
    Baum, L.E., Petrie, T.: Statistical inference for probabilistic functions of finite state Markov chains. Ann. Math. Stat. 37(6), 1554–1563 (1966)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Deng, Y., Shen, S., Huang, Z., Iosup, A., Lau, R.W.H.: Dynamic resource management in cloud-based distributed virtual environments. In: ACM Multimedia, pp. 1209–1212 (2014)Google Scholar
  7. 7.
    DiFranzo, D., Graves, A.: A farm in every window: a study into the incentives for participation in the windowfarm virtual community. In: WebSci 2011, p. 14 (2011)Google Scholar
  8. 8.
    Kousiouris, G., Menychtas, A., Kyriazis, D., Gogouvitis, S., Varvarigou, T.: Dynamic, behavioral-based estimation of resource provisioning based on high-level application terms in cloud platforms. Future Gener. Comput. Syst. 32, 27–40 (2014)CrossRefGoogle Scholar
  9. 9.
    Amiri, M., Feizi-Derakhshi, M.R., Mohammad-Khanli, L.: IDS fitted Q improvement using fuzzy approach for resource provisioning in cloud. J. Intell. Fuzzy Syst. 32(1), 229–240 (2017)CrossRefGoogle Scholar
  10. 10.
    Hou, H.S., Tretter, D.R., Vogel, M.J.: Interesting properties of thediscrete cosine transform. J. Vis. Commun. Image Represent. 3(1), 73–83 (1992)CrossRefGoogle Scholar
  11. 11.
    Chang, Y., Chang, R., Chuang, F.: A predictive method for workload forecasting in the cloud environment. In: Proceedings of Advanced Technologies, Embedded and Multimedia for Human-Centric Computing, pp. 577–585 (2014)Google Scholar
  12. 12.
    Chen, Z., Zhu, Y., Di, Y., Feng, S.: Self-Adaptive prediction of cloud resource demands using ensemble model and subtractive-fuzzy clustering based fuzzy neural network. Comput. Intell. Neurosci. 2015, 17:1–17:14 (2015)Google Scholar
  13. 13.
    Ramezani, F., Naderpour, M.: A fuzzy virtual machine workload prediction method for cloud environments. In: FUZZ-IEEE, pp. 1–6 (2017)Google Scholar
  14. 14.
    G. Bruder, F. Steinicke, A. Nchter, Poster: Immersive point cloud virtual environments. In: Proceedings of 3DUI 2014, pp. 161–162. Publisher, Location (2010)Google Scholar
  15. 15.
    Chuang, I.-H., Tsai, Y.-T., Horng, M.-F., Kuo, Y.-H., Hsu, J.-P.: A GA-based approach for resource consolidation of virtual machines in clouds. In: Nguyen, N.T., Attachoo, B., Trawiński, B., Somboonviwat, K. (eds.) ACIIDS 2014. LNCS (LNAI), vol. 8397, pp. 342–351. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-05476-6_35CrossRefGoogle Scholar
  16. 16.
    Bleikertz, S., Vogel, C., Gro, T.: Cloud radar: near real-time detection of security failures in dynamic virtualized infrastructures. In: ACSAC, pp. 26–35 (2014)Google Scholar
  17. 17.
    Hsiao, S.-W., Chen, Y.-N., Sun, Y.S., Chen, M.C.: Combining dynamic passive analysis and active fingerprinting for effective bot malware detection in virtualized environments. In: Lopez, J., Huang, X., Sandhu, R. (eds.) NSS 2013. LNCS, vol. 7873, pp. 699–706. Springer, Heidelberg (2013).  https://doi.org/10.1007/978-3-642-38631-2_59CrossRefGoogle Scholar
  18. 18.
    Vandromme, N., et al.: Life cycle assessment of videoconferencing with call management servers relying on virtualization, In: ICT4S 2014 (2014)Google Scholar
  19. 19.
    Standard Performance Evaluation Corporation. http://www.spec.org/cpu2006/CINT2006/
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
    Braun, P., Cameron, J.J., Cuzzocrea, A., Jiang, F., Leung, C.K.: Effectively and efficiently mining frequent patterns from dense graph streams on disk. Procedia Comput. Sci. 35, 338–347 (2014)CrossRefGoogle Scholar
  25. 25.
    Wu, Z., Yin, W., Cao, J., Xu, G., Cuzzocrea, A.: Community detection in multi-relational social networks. In: International Conference on Web Information Systems Engineering, pp. 43–56 (2013)Google Scholar
  26. 26.
    Cuzzocrea, A., Bertino, E.: Privacy preserving OLAP over distributed XML data: A theoretically-sound secure-multiparty-computation approach. J. Comput. Syst. Sci. 77(6), 965–987 (2011)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Universitá della CalabriaRendeItaly
  2. 2.Universitá di TriesteTriesteItaly
  3. 3.University of ManitobaWinnipegCanada
  4. 4.Universitá di MessinaMessinaItaly

Personalised recommendations