Abstract
In this study, we propose a novel SeqMF model to solve the problem of predicting the next app launch during mobile device usage. Although this problem can be represented as a classical collaborative filtering problem, it requires proper modification since the data are sequential, the user feedback is distributed among devices, and the transmission of users’ data to aggregate common patterns must be protected against leakage. According to such requirements, we modify the structure of the classical matrix factorization model and update the training procedure to sequential learning. Since the data about user experience are distributed among devices, the federated learning setup is used to train the proposed sequential matrix factorization model. One more ingredient of our approach is a new privacy mechanism that guarantees the protection of the sent data from the users to the remote server. To demonstrate the efficiency of the proposed model, we use publicly available mobile user behavior data. We compare our model with sequential rules and models based on the frequency of app launches. The comparison is conducted in static and dynamic environments. The static environment evaluates how our model processes sequential data compared to competitors. The dynamic environment emulates the real-world scenario, where users generate new data by running apps on devices. Our experiments show that the proposed model provides comparable quality with other methods in the static environment. However, more importantly, our method achieves a better privacy-utility trade-off than competitors in the dynamic environment, which provides more accurate simulations of real-world usage.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AbdulRahman, S., Tout, H., Ould-Slimane, H., et al.: A survey on federated learning: the journey from centralized to distributed on-site learning and beyond. IEEE Internet Things J. 8(7), 5476–5497 (2020)
Akiba, T., Sano, S., Yanase, T., et al.: Optuna: a next-generation hyperparameter optimization framework. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2623–2631 (2019)
Aliannejadi, M., Zamani, H., Crestani, F., et al.: Context-aware target apps selection and recommendation for enhancing personal mobile assistants. ACM Trans. Inf. Syst. (TOIS) 39(3), 1–30 (2021)
Ammad-Ud-Din, M., Ivannikova, E., Khan, S.A., et al.: Federated collaborative filtering for privacy-preserving personalized recommendation system. arXiv preprint arXiv:1901.09888 (2019)
Baeza-Yates, R., Jiang, D., Silvestri, F., et al.: Predicting the next app that you are going to use. In: Proceedings of the Eighth ACM International Conference on Web Search And Data Mining, pp. 285–294 (2015)
Changmai, B.M., Nagaraju, D., Mohanty, D.P., et al.: On-device user intent prediction for context and sequence aware recommendation. arXiv preprint arXiv:1909.12756 (2019)
Chen, W.N., Kairouz, P., Ozgur, A.: Breaking the communication-privacy-accuracy trilemma. Adv. Neural. Inf. Process. Syst. 33, 3312–3324 (2020)
Costan, V., Lebedev, I., Devadas, S.: Sanctum: minimal hardware extensions for strong software isolation. In: 25th USENIX Security Symposium (USENIX Security 16), pp. 857–874 (2016)
Duchi, J.C., Wainwright, M., Jordan, M.I.: Minimax optimal procedures for locally private estimation. J. Am. Stat. Assoc. 113, 182–201 (2016)
Dwork, C., Kenthapadi, K., McSherry, F., et al.: Our data, ourselves: privacy via distributed noise generation. In: Advances in Cryptology-EUROCRYPT 2006: 24th Annual International Conference on the Theory and Applications of Cryptographic Techniques, St. Petersburg, Russia, May 28–June 1, 2006. Proceedings 25, pp. 486–503. Springer (2006a)
Dwork, C., McSherry, F., Nissim, K., et al.: Calibrating noise to sensitivity in private data analysis. In: Theory of Cryptography: Third Theory of Cryptography Conference, TCC 2006, New York, NY, USA, March 4–7, 2006, pp 265–284. Proceedings 3. Springer (2006b)
Dwork, C., Roth, A., et al.: The algorithmic foundations of differential privacy. Found. Trends® Theor. Comput. Sci. 9(3–4), 211–407 (2014)
Ekstrand, M.D., Riedl, J.T., Konstan, J.A., et al.: Collaborative filtering recommender systems. Found. Trends® Hum. Comput. Interact. 4(2), 81–173 (2011)
Erlingsson, Ú., Pihur, V., Korolova, A.: Rappor: randomized aggregatable privacy-preserving ordinal response. In: Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security, pp. 1054–1067 (2014)
Fang, H., Zhang, D., Shu, Y., et al.: Deep learning for sequential recommendation: algorithms, influential factors, and evaluations. ACM Trans. Inf. Syst. (TOIS) 39(1), 1–42 (2020)
Frolov, E., Oseledets, I.: Tensor-based sequential learning via Hankel matrix representation for next item recommendations. IEEE Access 11, 6357–6371 (2023)
Golub, G.H., Van Loan, C.F.: Matrix Computations. JHU Press, Baltimore (2013)
Gusak, J., Cherniuk, D., Shilova, A., et al.: Survey on efficient training of large neural networks. In: Proceedings of the 31st International Joint Conference on Artificial Intelligence IJCAI-22, Vienna, Austria, pp. 23–29 (2022)
Han, J., Ma, Y., Mei, Q., et al.: DeepRec: on-device deep learning for privacy-preserving sequential recommendation in mobile commerce. In: Proceedings of the Web Conference 2021 (WWW ’21), April 19–23, 2021, Ljubljana, Slovenia (2021)
He, R., McAuley, J.: Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th International Conference on Data Mining (ICDM), pp. 191–200. IEEE (2016)
He, X., Zhang, H., Kan, M.Y., et al.: Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 549–558 (2016)
Hidasi, B., Karatzoglou, A., Baltrunas, L., et al.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)
Hu, Y., Koren, Y., Volinsky, C.: Collaborative filtering for implicit feedback datasets. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 263–272. IEEE (2008)
Jannach, D., Ludewig, M., Lerche, L.: Session-based item recommendation in e-commerce: on short-term intents, reminders, trends and discounts. User Model. User-Adapt. Interact. 27, 351–392 (2017)
Kairouz, P., McMahan, H.B., Avent, B., et al.: Advances and open problems in federated learning. Found. Trends® Mach. Learn. 14(1–2), 1–210 (2021)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Li, H., Diao, X., Cao, J., et al.: Collaborative filtering recommendation based on all-weighted matrix factorization and fast optimization. IEEE Access 6, 25,248-25,260 (2018)
Li, W., Xia, Y., Chen, H.: Research on arm trustzone. GetMobile Mob. Comput. Commun. 22(3), 17–22 (2019)
Liao, Z.X., Li, S.C., Peng, W.C., et al.: On the feature discovery for app usage prediction in smartphones. In: 2013 IEEE 13th International Conference on Data Mining, pp. 1127–1132. IEEE (2013)
Ludewig, M., Jannach, D.: Evaluation of session-based recommendation algorithms. User Model. User-Adapt. Interact. 28(4–5), 331–390 (2018)
Minto, L., Haller, M., Livshits, B., et al.: Stronger privacy for federated collaborative filtering with implicit feedback. In: Proceedings of the 15th ACM Conference on Recommender Systems, pp. 342–350 (2021)
Neelakantan, A., Vilnis, L., Le, Q.V., et al.: Adding gradient noise improves learning for very deep networks. arXiv preprint arXiv:1511.06807 (2015)
Nguyên, T.T., Xiao, X., Yang, Y., et al.: Collecting and analyzing data from smart device users with local differential privacy. arXiv preprint arXiv:1606.05053 (2016)
Nikolakopoulos, A.N., Kalantzis, V., Garofalakis, J.D.: Eigenrec: An efficient and scalable latent factor family for top-n recommendation. arXiv preprint arXiv:1511.06033 47 (2015)
Ouyang, Y., Guo, B., Wang, Q., et al.: Learning dynamic app usage graph for next mobile app recommendation. IEEE Trans. Mob. Comput. (2022). https://doi.org/10.1109/TMC.2022.3161114
Parate, A., Böhmer, M., Chu, D., et al.: Practical prediction and prefetch for faster access to applications on mobile phones. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 275–284 (2013)
Qian, N.: On the momentum term in gradient descent learning algorithms. Neural Netw. 12(1), 145–151 (1999)
Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web, pp. 811–820 (2010)
Reyzin, L., Smith, A., Yakoubov, S.: Turning hate into love: compact homomorphic ad hoc threshold encryption for scalable MPC. In: International Symposium on Cyber Security Cryptography and Machine Learning, pp. 361–378. Springer (2021)
Shen, Z., Yang, K., Du, W., et al.: Deepapp: a deep reinforcement learning framework for mobile application usage prediction. In: Proceedings of the 17th Conference on Embedded Networked Sensor Systems, pp. 153–165 (2019)
Shin, C., Hong, J.H., Dey, A.K.: Understanding and prediction of mobile application usage for smart phones. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 173–182 (2012)
Shin, H., Kim, S., Shin, J., et al.: Privacy enhanced matrix factorization for recommendation with local differential privacy. IEEE Trans. Knowl. Data Eng. 30(9), 1770–1782 (2018)
Warner, S.: Randomized response: a survey technique for eliminating evasive answer bias. J. Am. Stat. Assoc. 60(309), 63–6 (1965)
Xu, Y., Lin, M., Lu, H., et al.: Preference, context and communities: a multi-faceted approach to predicting smartphone app usage patterns. In: Proceedings of the 2013 International Symposium on Wearable Computers, pp. 69–76 (2013)
Yao, A.C.C.: How to generate and exchange secrets. In: 27th Annual Symposium on Foundations of Computer Science (Sfcs 1986), pp. 162–167. IEEE (1986)
Yu, D., Li, Y., Xu, F., et al.: Smartphone app usage prediction using points of interest. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, no. 4, p. 174 (2018)
Zhang, C., Ding, X., Chen, G., et al.: Nihao: a predictive smartphone application launcher. In: Mobile Computing, Applications, and Services: 4th International Conference, MobiCASE 2012, Seattle, WA, USA, October 11–12, 2012, pp. 294–313. Revised Selected Papers 4, Springer (2013)
Zhang, S., Tay, Y., Yao, L., et al.: Next item recommendation with self-attention. arXiv preprint arXiv:1808.06414 (2018)
Zhao, S., Luo, Z., Jiang, Z., et al.: AppUsage2Vec: modeling smartphone app usage for prediction. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 1322–1333. IEEE (2019)
Zheng, W., Wu, Y., Wu, X., et al.: A survey of Intel SGX and its applications. Front. Comput. Sci. 15, 1–15 (2021)
Funding
This work was supported by the Russian Science Foundation under Grant 22-21-00911.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Saiapin, A., Balitskiy, G., Bershatsky, D. et al. Federated privacy-preserving collaborative filtering for on-device next app prediction. User Model User-Adap Inter (2024). https://doi.org/10.1007/s11257-024-09395-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11257-024-09395-0