Skip to main content

Improving Robustness of Latent Feature Learning Using L1-Norm

  • Chapter
  • First Online:
Robust Latent Feature Learning for Incomplete Big Data

Part of the book series: SpringerBriefs in Computer Science ((BRIEFSCOMPUTER))

  • 202 Accesses

Abstract

In this era of information explosion, big data are generated from various industrial applications [1–4]. Realizing intelligent recommender systems (RSs) to filter the required information is a very challenging problem [5, 6]. Up to now, various methods have been proposed to implement an RS, among which collaborative filtering (CF) is very popular [7–13].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Luo, X., Zhou, M., Li, S., Hu, L., Shang, M.: Non-negativity constrained missing data estimation for high-dimensional and sparse matrices from industrial applications. IEEE Trans. Cybern. 50(5), 1844–1855 (2020)

    Article  Google Scholar 

  2. Luo, X., Zhou, M., Li, S., Shang, M.: An inherently nonnegative latent factor model for high-dimensional and sparse matrices from industrial applications. IEEE Trans. Ind. Inform. 14(5), 2011–2022 (2018)

    Article  Google Scholar 

  3. Wu, D., Zhang, P., He, Y., Luo, X.: A double-space and double-norm ensembled latent factor model for highly accurate web service QoS prediction. In: EEE Transactions on Services Computing, p. 1 (2022)

    Google Scholar 

  4. Luo, X., Chen, M., Wu, H., Liu, Z., Yuan, H., Zhou, M.: Adjusting learning depth in nonnegative latent factorization of tensors for accurately modeling temporal patterns in dynamic QoS data. IEEE Trans. Autom. Sci. Eng. 18(4), 2142–2155 (2021)

    Article  Google Scholar 

  5. Luo, X., et al.: Incorporation of efficient second-order solvers into latent factor models for accurate prediction of missing QoS data. IEEE Trans. Cybern. 48(4), 1216–1228 (2017)

    Article  Google Scholar 

  6. Luo, X., Zhou, M., Wang, Z., Xia, Y., Zhu, Q.: An effective scheme for QoS estimation via alternating direction method-based matrix factorization. IEEE Trans. Serv. Comput. 12(4), 503–518 (2016)

    Article  Google Scholar 

  7. Luo, X., Zhou, M., Xia, Y., Zhu, Q.: An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans. Ind. Inform. 10(2), 1273–1284 (2014)

    Article  Google Scholar 

  8. Luo, X., et al.: An incremental-and-static-combined scheme for matrix-factorization-based collaborative filtering. IEEE Trans. Autom. Sci. Eng. 13(1), 333–343 (2016)

    Article  Google Scholar 

  9. Luo, X., Liu, Z., Li, S., Shang, M., Wang, Z.: A fast non-negative latent factor model based on generalized momentum method. IEEE Trans. Syst. Man Cybern. Syst. 51(1), 610–620 (2018)

    Article  Google Scholar 

  10. Wu, L., Sun, P., Hong, R., Ge, Y., Wang, M.: Collaborative neural social recommendation. IEEE Trans. Syst. Man Cybern. Syst. 51, 464–476 (2018)

    Article  Google Scholar 

  11. Yu, Z., Wu, D., He, Y.: A robust latent factor analysis model for incomplete data recovery in wireless sensor networks. In: 2022 IEEE International Conference on Edge Computing and Communications (EDGE), pp. 178–183 (2022)

    Google Scholar 

  12. Wu, D., Luo, X., He, Y., Zhou, M.: A prediction-sampling-based multilayer-structured latent factor model for accurate representation to high-dimensional and sparse data. IEEE Trans. Neural Netw. Learn. Syst., 1–14 (2022)

    Google Scholar 

  13. Wu, D., Jin, L., Luo, X.: Pmlf: Prediction-sampling-based multilayer-structured latent factor analysis. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 671–680 (2020)

    Google Scholar 

  14. Luo, X., Ouyang, Y., Xiong, Z.: Improving neighborhood based collaborative filtering via integrated folksonomy information. Pattern Recogn. Lett. 33(3), 263–270 (2012)

    Article  Google Scholar 

  15. Luo, X., Wu, H., Yuan, H., Zhou, M.: Temporal pattern-aware QoS prediction via biased non-negative latent factorization of tensors. IEEE Trans. Cybern. 50(5), 1798–1809 (2019)

    Article  Google Scholar 

  16. Luo, X., Wang, Z., Shang, M.: An instance-frequency-weighted regularization scheme for non-negative latent factor analysis on high-dimensional and sparse data. IEEE Trans. Syst. Man Cybern. Syst. 51(6), 1–11 (2019)

    Google Scholar 

  17. Luo, X., Sun, J., Wang, Z., Li, S., Shang, M.: Symmetric and nonnegative latent factor models for undirected, high-dimensional, and sparse networks in industrial applications. IEEE Trans. Ind. Inform. 13(6), 3098–3107 (2017)

    Article  Google Scholar 

  18. Luo, X., Zhou, M., Li, S., You, Z., Xia, Y., Zhu, Q.: A nonnegative latent factor model for large-scale sparse matrices in recommender systems via alternating direction method. IEEE Trans. Neural Netw. Learn. Syst. 27(3), 579–592 (2016)

    Article  MathSciNet  Google Scholar 

  19. Smith, B., Linden, G.: Two decades of recommender systems at Amazon.com. IEEE Internet Comput. 21(3), 12–18 (2017)

    Article  Google Scholar 

  20. Yuan, Y., Luo, X., Shang, M.-S.: Effects of preprocessing and training biases in latent factor models for recommender systems. Neurocomputing. 275, 2019–2030 (2018)

    Article  Google Scholar 

  21. Ma, W., Li, N., Li, Y., Duan, J., Chen, B.: Sparse normalized least mean absolute deviation algorithm based on unbiasedness criterion for system identification with noisy input. IEEE Access. 6, 14379–14388 (2018)

    Article  Google Scholar 

  22. Ke, Q., Kanade, T.: Robust Subspace Computation Using L1 Norm: School of Computer Science. Carnegie Mellon University, Pittsburgh, PA (2003)

    Google Scholar 

  23. Zhu, X., Jing, X.-Y., Wu, D., He, Z., Cao, J., Yue, D., Wang, L.: Similarity-maintaining privacy preservation and location-aware low-rank matrix factorization for QoS prediction based web service recommendation. IEEE Trans. Serv. Comput. 14(3), 889–902 (2018)

    Article  Google Scholar 

  24. Wang, L., Gordon, M.D., Zhu, J.: Regularized least absolute deviations regression and an efficient algorithm for parameter tuning. In: Proceedings of the 6th IEEE International Conference on Data Mining (ICDM), pp. 690–700 (2006)

    Google Scholar 

  25. Koenker, R., Hallock, K.F.: Quantile regression. J. Econ. Perspect. 15(4), 143–156 (2001)

    Article  Google Scholar 

  26. Lakshminarayanan, B., Bouchard, G., Archambeau, C.: Robust Bayesian matrix factorisation. In: Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, pp. 425–433 (2011)

    Google Scholar 

  27. Luo, X., Zhou, Y., Liu, Z., Zhou, M.: Fast and accurate non-negative latent factor analysis on high-dimensional and sparse matrices in recommender systems. In: IEEE Transactions on Knowledge and Data Engineering, p. 1 (2021)

    Google Scholar 

  28. Goldstein, T., Osher, S.: The split Bregman method for L1-regularized problems. SIAM J. Imaging Sci. 2(2), 323–343 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  29. Ren, X., Song, M., Haihong, E., Song, J.: Context-aware probabilistic matrix factorization modeling for point-of-interest recommendation. Neurocomputing. 241, 38–55 (2017)

    Article  Google Scholar 

  30. Yuan, Y., Luo, X., Shang, M., Wu, D.: A generalized and fast-converging non-negative latent factor model for predicting user preferences in recommender systems. In: Proceedings of The Web Conference 2020. Association for Computing Machinery, pp. 498–507 (2020)

    Google Scholar 

  31. Wu, D., Luo, X., Shang, M., He, Y., Wang, G., Zhou, M.: A deep latent factor model for high-dimensional and sparse matrices in recommender systems. IEEE Trans. Syst. Man Cybern. Syst. 51(7), 4285–4296 (2021)

    Article  Google Scholar 

  32. Wu, D., Luo, X., Shang, M., He, Y., Wang, G., Wu, X.: A data-aware latent factor model for web service QoS prediction. In: Advances in Knowledge Discovery and Data Mining, pp. 384–399. Springer, Cham (2019)

    Chapter  Google Scholar 

  33. Luo, X., Zhou, M., Li, S., Wu, D., Liu, Z., Shang, M.: Algorithms of unconstrained non-negative latent factor analysis for recommender systems. IEEE Trans. Big Data. 7(1), 227–240 (2021)

    Article  Google Scholar 

  34. Wu, D., Luo, X., Shang, M., He, Y., Wang, G., Wu, X.: A data-characteristic-aware latent factor model for web service QoS prediction. IEEE Trans. Knowl. Data Eng. 34(6), 2525–2538 (2022)

    Google Scholar 

  35. Luo, X., Zhou, Y., Liu, Z., Zhou, M.: Fast and accurate non-negative latent factor analysis on high-dimensional and sparse matrices in recommender systems. IEEE Trans. Knowl. Data Eng., 1–1 (2021)

    Google Scholar 

  36. Cherapanamjeri, Y., Gupta, K., Jain, P.: Nearly optimal robust matrix completion. In: Proceedings of the 34th International Conference on Machine Learning, JMLR, pp. 797–805 (2017)

    Google Scholar 

  37. Klopp, K.L., Tsybakov, A.B.: Robust matrix completion. Probab. Theory Relat. Fields. 169(1–2), 523–564 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  38. Mansour, H., Tian, D., Vetro, A.: Factorized robust matrix completion. In: Handbook of Robust Low-Rank and Sparse Matrix Decomposition: Applications in Image and Video Processing, vol. 5. CRC Press, Boca Raton, FL (2016)

    Google Scholar 

  39. He, Y., Wu, B., Wu, D., Wu, X.: On partial multi-task learning. In: ECAI 2020, pp. 1174–1181 (2020)

    Google Scholar 

  40. Han, Y., Yang, Y., Zhou, X.: Co-regularized ensemble for feature selection. In: Proceedings of 23rd International Joint Conference on Artificial Intelligence (IJCAI), pp. 1380–1386 (2013)

    Google Scholar 

  41. Wu, D., He, Q., Luo, X., Shang, M., He, Y., Wang, G.: A posterior-neighborhood-regularized latent factor model for highly accurate web service qos prediction. IEEE Trans. Serv. Comput. 15(2), 793–805 (2022)

    Article  Google Scholar 

  42. Shang, M., Luo, X., Liu, Z., Chen, J., Yuan, Y., Zhou, M.: Randomized latent factor model for high-dimensional and sparse matrices from industrial applications. IEEE/CAA J. Autom. Sin. 6(1), 131–141 (2019)

    Article  MathSciNet  Google Scholar 

  43. Xin, L., Yuan, Y., Zhou, M., Liu, Z., Shang, M.: Non-negative latent factor model based on β-divergence for recommender systems. IEEE Trans. Syst. Man Cybern. Syst. 51(8), 4612–4623 (2019)

    Article  Google Scholar 

  44. Shi, Q., Lu, H., Cheung, Y.-M.: Rank-one matrix completion with automatic rank estimation via L1-norm regularization. IEEE Trans. Neural Netw. Learn. Syst. 29(10), 4744–4757 (2017)

    Article  MathSciNet  Google Scholar 

  45. Sedhain, S., Menon, A.K., Sanner, S., Xie, L.: AutoRec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th International Conference on World Wide Web, pp. 111–112. ACM (2015)

    Google Scholar 

  46. Li, P., Wang, Z., Ren, Z., Bing, L., Lam, W.: Neural rating regression with abstractive tips generation for recommendation. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 345–354 (2017)

    Google Scholar 

  47. Wang, Q., Peng, B., Shi, X., Shang, T., Shang, M.: DCCR: deep collaborative conjunctive recommender for rating prediction. IEEE Access. 7, 60186–60198 (2019)

    Article  Google Scholar 

  48. Wu, D., Shang, M., Luo, X., Wang, Z.: An L1-and-L2-norm-oriented latent factor model for recommender systems. IEEE Trans. Neural Netw. Learn. Syst., 1–14 (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wu, D. (2023). Improving Robustness of Latent Feature Learning Using L1-Norm. In: Robust Latent Feature Learning for Incomplete Big Data. SpringerBriefs in Computer Science. Springer, Singapore. https://doi.org/10.1007/978-981-19-8140-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-8140-1_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-8139-5

  • Online ISBN: 978-981-19-8140-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics