Skip to main content
SpringerLink
Log in

Web service QoS prediction: when collaborative filtering meets data fluctuating in big-range

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Service recommendation aims to help users to find the most suitable Web services based on their quality of service (QoS) preferences instead of searching through extensive volume of Web services using search engine manually. Accurate unknown QoS rating prediction is one of the key challenges in the analysis of service recommendation. Collaborative filtering (CF) is a well-known recommendation method that estimates missing ratings by employing a set of similar users to the active user. The core idea of CF consists of picking out an appropriate set of users and using them in the rating prediction process. However, the majority of existing CF methods are not well-designed for Web service QoS prediction as they ignore the implicit but important characteristic of Web service QoS data that fluctuate in big-range. In other words, through analysis of real-world QoS datasets, we observed that QoS ratings vary widely and they are highly skewed with large variances, as two main facts, which dramatically degrade the accuracy of CF methods in QoS prediction. Towards this problem, in this paper, we propose a big-range aware collaborative filtering approach dubbed BRACF to predict Web service QoS ratings accurately. Specifically, since big-range of QoS data can lead to similarity exaggeration, we design a simple yet effective similarity model which considers the influence of big-range among users’ QoS data for accurately characterizing the similarity between users. Moreover, the similarity model is seamlessly incorporated into CF model for identifying similar neighbor using Top-K strategy and then it generates QoS predictions by combining bias information. Through extensive experiments on two public real-world Web service QoS for datasets, as response time and throughput, we show that BRACF significantly outperforms state-of-the-art CF methods. We believe that this work demonstrates the potential impact of big range data for the accurate QoS prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. H. Haas, A. Brown, Web services glossary [OL], W3C Working Group Note, https://www.w3.org/TR/2004/NOTE-ws-gloss-20040211, accessed 2018.9.25

  2. Burt, H., Lothar, A.T., Brian, B., et al.: HEPCloud, A new paradigm for HEP facilities: CMS Amazon Web services investigation. Computing and Software for Big Science. 1(1), 1–15 (2017)

    Google Scholar 

  3. K. Charlotte, N. Thomas, I. Neena, A comparison of Amazon Web services and Microsoft Azure cloud platforms for high performance computing, Proc. of International Conference on Consumer Electronics, (2018) pp.1–4

  4. A. Guido, G. D. Fikru, H. Waqar, et al. On the performance of Web services and Google cloud messaging, Proc. Of IEEE International Conference on Computer and Information Technology, (2017) pp. 363–367

  5. K. Shinya, M. Naoki, Inferring calling relationship based on external observation for microservice architecture, Proc. of International Conference on Service Oriented Computing, (2017) pp.229–237

  6. Bouguettaya, A., Singh, M.P., Huhns, M.N., et al.: A service computing manifesto: the next 10 years. Communications of the ACM. 60(4), 64–72 (2017)

    Google Scholar 

  7. S. Lyu, J. Liu, M. Tang, et al. Three-level views of the Web service network: an empirical study based on ProgrammableWeb, Proc. of IEEE International Conference on Big Data, (2014) pp.374–381

  8. Jatoth, C., Gangadharan, G.R., Buyya, R.: Computational intelligence based QoS-aware web service composition: a systematic literature review. IEEE Trans. Serv. Comput. 10(3), 475–492 (2017)

    Google Scholar 

  9. Ran, S.: A model for Web services discovery with QoS. Sigecom Exchanges. 4(1), 1–10 (2003)

    Google Scholar 

  10. C. Yu, L. Huang, A Web service QoS prediction approach based on time- and location-aware collaborative filtering, Service Oriented Computing & Applications, 10(2)(2016)1–15

  11. Su, K., Xiao, B., Liu, B.: TAP: a personalized trust-aware QoS prediction approach for web service recommendation. Knowl.-Based Syst. 115, 55–65 (2016)

    Google Scholar 

  12. Luo, X., Lv, Y., Li, R.: Web service QoS prediction based on adaptive dynamic programming using fuzzy neural networks for cloud services [J]. IEEE Access. 3(3), 2260–2269 (2017)

    Google Scholar 

  13. S. Anu, An extension to UDDI for the discovery of user driven Web services, Proc. of International Conference on Distributed Computing and Internet Technology, (2016) pp.92–96

  14. Linden, G., Smith, B.: Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 7(1), 76–80 (York J, 2003)

  15. L. Shao, J. Zhang, Y. Wei, Personalized QoS prediction for Web service via collaborative filtering, Proc. of IEEE Conference on Web Services, (2007) pp.439–446

  16. Zheng, Z., Ma, H., Lyu, M., et al.: QoS-aware web service recommendation by collaborative filtering. IEEE Trans. Serv. Comput. 4(2), 140–152 (2011)

    Google Scholar 

  17. J. Li, J. Wang, Q. Sun, et al. Temporal influences-aware collaborative filtering for QoS-based service recommendation, Proc. of IEEE Conference on Services Computing, (2017) pp.471–474

  18. Qi, L., Zhou, Z., Yu, J., et al.: Data-sparsity tolerant Web service recommendation approach based on improved collaborative filtering. IEICE Transactions on Information & Systems. 100(9), 2092–2099 (2017)

    Google Scholar 

  19. Chen, Z., Shen, L., Li, F., et al.: Your neighbors alleviate cold-start: on geographical neighborhood influence to collaborative web service QoS prediction. Knowl.-Based Syst. 138, 188–201 (2017)

    Google Scholar 

  20. X. Chen, X. Liu, Z. Huang, et al. RegionKNN : a scalable hybrid collaborative filtering algorithm for personalized Web service recommendation. Proc. of 2010 IEEE International Conference on Web Services, (2010) pp. 9–16

  21. Harper, F.M., Konstan, J.A.: The MovieLens datasets. ACM Transactions on Interactive Intelligent Systems. 5(5), 1–19 (2016)

    Google Scholar 

  22. Chen, Z., Shen, L., Li, F.: Service selection approach considering the uncertainty of QoS data. Comput. Integr. Manuf. Syst. 19(10), 2652–2663 (2013)

    Google Scholar 

  23. L. Sheugh, S. H. Alizadeh, A note on pearson correlation coefficient as a metric of similarity in recommender system, Proc. of AI & Robotics, (2015) pp.1–6

  24. Zheng, Z., Ma, H., Lyu, M.R., et al.: Collaborative web services QoS prediction via neighborhood integrated matrix factorization. IEEE Transaction on Services Computing. 6(3), 1–10 (2013)

    Google Scholar 

  25. Chen, Z., Shen, L., Li, F.: ULMF: web service QoS collaborative prediction with explicit ratings and implicit user location. Journal of Internet Technology. 17(6), 1195–1205 (2016)

    Google Scholar 

  26. Gao, M., Ling, B., Yang, L., et al.: From similarity perspective: a robust collaborative filtering approach for service recommendations. Frontiers of Computer Science. 3, 1–16 (2018)

    Google Scholar 

  27. Yin, J., Lo, W., Deng, S., et al.: Colbar: a collaborative location-based regularization framework for QoS prediction. Inf. Sci. 265, 68–84 (2014)

    MathSciNet  Google Scholar 

  28. Xu, J., Zheng, Z., Lyu, M.R.: Web service personalized quality of service prediction via reputation-based matrix factorization. IEEE Transactions on Reliability. 65(1), 68–84 (2016)

    Google Scholar 

  29. Wu, H., Yue, K., Li, B., et al.: Collaborative QoS prediction with context-sensitive matrix factorization. Futur. Gener. Comput. Syst. 82, 669–678 (2018)

    Google Scholar 

  30. X. Ning, C. Desrosiers, G. Karypis, A comprehensive survey of neighborhood-based recommendation methods [B], Recommender Systems Handbook, Second Edition, Springer US, pp.37–76, 2015

  31. Z. Chen, L. Shen, F. Li, Web service QoS collaborative prediction approach considering range of QoS data [J], Computer Integrated Manufacturing Systems, vo.23, no.1, pp. 215–224, 2017

  32. Ahn, H.J.: A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Information Sciences. 178(1), 37–51 (2008)

    Google Scholar 

  33. Broder, A.: On the resemblance and containment of documents. Compression & Complexity of Sequences. 2(7), 1–9 (1997)

    Google Scholar 

  34. R. Paul, L. Neophytos, S. Mitesh, et al. GroupLens: An open architecture for collaborative filtering of netnews, Proc. of ACM conference on Computer Supported Cooperative Work, (1997) pp.175–186

  35. M. Schwarz, M. Lobur, Y. Stekh, Analysis of the effectiveness of similarity measures for recommender systems, Proc. of International Conference on The Experience of Designing and Application of CAD Systems in Microelectronics, (2017) pp.275–277

  36. L. Chen, Y. Feng, J. Wu, et al. An enhanced QoS prediction approach for service selection, Proc. of IEEE International Conference on Services Computing, (2011) pp.757–728

  37. W. Song, C. Lin, A. Forsman, et al. An Euclidean similarity measurement approach for hotel rating data analysis, Proc. of IEEE International Conference on Cloud Computing and Big Data Analysis, (2017) pp.293–298

  38. Zheng, Z., Zhang, Y., Lyu, M.R.: Investigating QoS of real-world web services [J]. IEEE Transaction on Services Computing. 7(1), 32–39 (2014)

    Google Scholar 

  39. Herlocker, J.L., Konstan, J.A., Terveen, L.G., et al.: Evaluating collaborative filtering recommender Systems. ACM Transaction on Information Systems. 22(1), 5–53 (2004)

    Google Scholar 

  40. B. Sarwar, G. Karypis, J. Konstan, et al. Item-based collaborative filtering recommendation algorithms, Proc. of International Conference on World Wide Web, (2001) pp.285–295

  41. Koren, Y.: Factor in the neighbors: scalable and accurate collaborative filtering. ACM Transactions on Knowledge Discovery form Data. 4(1), 1–24 (2010)

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under grant No.61772450, China Postdoctoral Science Foundation Grant under grant No.2018 M631764, No. 2017 M611187, Hebei Natural Science Foundation under grant No.F2019203287, No.F2017203307, Hebei Postdoctoral Research Program under grant No.B2018003009, and the Doctoral Fund of Yanshan University under grant No.BL18003.

Author information

Authors and Affiliations

  1. Colleague of Information Science and Engineering, Yanshan University, Qinhuangdao, China

    Zhen Chen, Limin Shen, Dianlong You & Jean Pepe Buanga Mapetu

  2. College of Computer and Communication Engineering, Northeastern University, Shenyang, China

    Feng Li

Authors
  1. Zhen Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Limin Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Feng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dianlong You
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jean Pepe Buanga Mapetu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zhen Chen or Limin Shen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Z., Shen, L., Li, F. et al. Web service QoS prediction: when collaborative filtering meets data fluctuating in big-range. World Wide Web 23, 1715–1740 (2020). https://doi.org/10.1007/s11280-020-00787-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-020-00787-x

Keywords

Search

Navigation