Role-Based Clustering for Collaborative Recommendations in Crowdsourcing System

  • Qiao Liao
  • Xiangmin Zhou
  • Daling WangEmail author
  • Shi Feng
  • Yifei Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11788)


Crowdsourcing as a distributed problem-solving and business production model has attracted much attention in recent years. In crowdsourcing systems, task recommendation can help workers to select suitable tasks on crowdsourcing platforms as well as help requesters to receive good outputs. However, as one of the most successful recommendation approaches, current clustering-based models in crowdsourcing are challenged by multi-preference and cold-start problems. This paper proposes a role-based clustering model, which transforms a large-sparse worker-task rating matrix into a set of role-based clusters that are small, independent and rating intensive worker-task rating matrices, leading to better quality and performance in task recommendation. Specifically, we first cluster a worker-task rating matrix into a set of clusters in terms of the role identification and distribution operations. The clusters are further extended to include all their external worker (task) roles. Then, the task recommendation results with respect to a worker are generated by operating over the clusters involving the worker’s activities, which captures the worker’s preferences in multiple areas. Moreover, the model discovers the structure information from the clustering results and crowdsourcing datasets, by which tasks can be recommended to new workers interactively without their interest profiles. We evaluated our method over the benchmark dataset from NAACL 2010 workshop. The results show the high superiority of our proposed recommendation method over crowdsourcing platforms.


Role-based clustering Task recommendation Cold-start Multi-preference Crowdsourcing system 



The work was supported by the National Key R&D Program of China under grant 2018YFB1004700, and National Natural Science Foundation of China (61772122, 61872074).


  1. 1.
    Dueck, D., Morris, Q.D., Frey, B.J.: Multi-way clustering of microarray data using probabilistic sparse matrix factorization. Bioinformatics 21(Suppl. 1), i144–i151 (2005)CrossRefGoogle Scholar
  2. 2.
    Elahi, M., Ricci, F., Rubens, N.: Active learning in collaborative filtering recommender systems. Comput. Sci. Rev. 20(C), 29–50 (2016)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Gao, M., Cao, F., Huang, J.Z.: A cross cluster-based collaborative filtering method for recommendation. In: ICIA, pp. 447–452 (2013)Google Scholar
  4. 4.
    Jannach, D., Zanker, M., Felfernig, A., Friedrich, G.: Recommender Systems: An Introduction (2010)Google Scholar
  5. 5.
    Klašnja-Milićević, A., Ivanović, M., Nanopoulos, A.: Recommender systems in e-learning environments: a survey of the state-of-the-art and possible extensions. Artif. Intell. Rev. 44(4), 571–604 (2015)CrossRefGoogle Scholar
  6. 6.
    Li, N., Mo, W., Shen, B.: Task recommendation with developer social network in software crowdsourcing. In: ISEC, pp. 9–16 (2017)Google Scholar
  7. 7.
    O’Connor, M.: Clustering items for collaborative filtering. In: ACM SIGIR Workshop on Recommender Systems: Algorithms and Evaluation (1999)Google Scholar
  8. 8.
    Qin, D., Zhou, X., Chen, L., Huang, G., Zhang, Y.: Dynamic connection-based social group recommendation. TKDE 1–14 (2019)Google Scholar
  9. 9.
    Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2007)Google Scholar
  10. 10.
    Sarwar, B.M., Riedl, J., Konstan, J.: Recommender systems for large-scale e-commerce: scalable. In: ICCIT (2002)Google Scholar
  11. 11.
    Ungar, L.H.: Clustering methods for collaborative filtering. In: AAAI Workshop on Recommendation Systems (1998)Google Scholar
  12. 12.
    Xu, B., Bu, J., Chen, C., Cai, D.: An exploration of improving collaborative recommender systems via user-item subgroups. In: WWW, pp. 21–30 (2012)Google Scholar
  13. 13.
    Yue, S., Larson, M., Hanjalic, A.: Collaborative filtering beyond the user-item matrix:a survey of the state of the art and future challenges. ACM Comput. Surv. 47(1), 1–45 (2014)Google Scholar
  14. 14.
    Yuen, M.C., Chen, L.J., King, I.: A survey of human computation systems. In: CSE, pp. 723–728 (2009)Google Scholar
  15. 15.
    Yuen, M.C., King, I., Leung, K.S.: A survey of crowdsourcing systems. In: PASSAT, pp. 766–773 (2012)Google Scholar
  16. 16.
    Yuen, M.C., King, I., Leung, K.S.: Task recommendation in crowdsourcing systems. In: CrowdKDD, pp. 22–26 (2012)Google Scholar
  17. 17.
    Yuen, M.-C., King, I., Leung, K.-S.: TaskRec: probabilistic matrix factorization in task recommendation in crowdsourcing systems. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds.) ICONIP 2012. LNCS, vol. 7664, pp. 516–525. Springer, Heidelberg (2012). Scholar
  18. 18.
    Yuen, M.C., King, I., Leung, K.S.: TaskRec: a task recommendation framework in crowdsourcing systems. Neural Process. Lett. 41(2), 223–238 (2015)CrossRefGoogle Scholar
  19. 19.
    Zhou, X., Chen, L., Zhang, Y., Cao, L., Huang, G., Wang, C.: Online video recommendation in sharing community. In: SIGMOD, pp. 1645–1656 (2015)Google Scholar
  20. 20.
    Zhou, X., et al.: Enhancing online video recommendation using social user interactions. VLDB J. 26(5), 637–656 (2017)CrossRefGoogle Scholar
  21. 21.
    Zhou, X., Zhou, X., Chen, L., Bouguettaya, A.: Efficient subsequence matching over large video databases. VLDB J. 21(4), 489–508 (2012)CrossRefGoogle Scholar
  22. 22.
    Zhu, J., Shen, B., Hu, F.: A learning to rank framework for developer recommendation in software crowdsourcing. In: APSEC, pp. 285–292 (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Qiao Liao
    • 1
    • 3
  • Xiangmin Zhou
    • 2
  • Daling Wang
    • 1
    Email author
  • Shi Feng
    • 1
  • Yifei Zhang
    • 1
  1. 1.School of Computer Science and EngineeringNortheastern UniversityShenyangChina
  2. 2.School of ScienceRMIT UniversityMelbourneAustralia
  3. 3.Tianjin Artificial Intelligence Innovation CenterTianjinChina

Personalised recommendations