Evaluating Recommender System Using Multiagent-Based Simulator

Case Study of Collaborative Filtering Simulation
  • Ryosuke Saga
  • Kouki Okamoto
  • Hiroshi Tsuji
  • Kazunori Matsumoto
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 156)


This paper describes a agent-based simulation system to evaluate recommender systems. Recommender systems have attracted attention to present items found by preference of users. Many algorithms for recommender system are developed but the comparisons between their algorithms are difficult because of limited data set and the difficulty of constructing simulator environment. In order to resolve them, we develop agent-based recommender system simulator. This simulator constructs the simulator environment based on the network model, and lets recommender agent recommend items to agents, evaluates the items, and summarizes(outputs) the recommendation results. In the experiment on 100 agents, we can confirm the usability of our simulator because of recapturing the feature of collaborative filtering by this simulator.


Recommender System Collaborative Filter Computer Support Cooperative Work Simulator User Recommendation Result 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Resnick, P., Varian, H.R.: Recommender systems. Commun. ACM. 40, 56–58 (1997)CrossRefGoogle Scholar
  2. 2.
    Adomavicius, G., Tuzhilin, A.: Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions. IEEE Transactions on Knowledge and Data Engineering 17, 734–749 (2005)CrossRefGoogle Scholar
  3. 3.
    Saga, R., Tsuji, H.: Sales Records Based Recommender System for TPO-Goods. IEEJ Transactions on Electronics, Information and Systems 126, 661–666 (2006)CrossRefGoogle Scholar
  4. 4.
    Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of netnews. In: Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, pp. 175–186. ACM, Chapel Hill (1994)CrossRefGoogle Scholar
  5. 5.
    Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based Collaborative Filtering Recommendation Algorithms. In: Proc. 10th International Conference on the World Wide Web, pp. 285–295 (2001)Google Scholar
  6. 6.
    Pazzani, M.J.: A Framework for Collaborative, Content-Based and Demographic Filtering. Artifical Intelligence Review 13, 393–408 (1999)CrossRefGoogle Scholar
  7. 7.
    Linden, G., Smith, B., York, J.: recommendations: item-to-item collaborative filtering. IEEE Internet Computing 7, 76–80 (2003)CrossRefGoogle Scholar
  8. 8.
    Claypool, M., Gokhale, A., Miranda, T., Murnikov, P., Netes, D., Sartin, M.: Combining Content-Based and Collaborative Filters in an Online Newspaper. In: Proceedings of ACM SIGIR Workshop on Recommender Systems (1999)Google Scholar
  9. 9.
    Herlocker, J.L., Konstan, J.A., Terveen, L.G., Riedl, J.T.: Evaluating collaborative filtering recommender systems. ACM Transaction on Information Systems 22, 5–53 (2004)CrossRefGoogle Scholar
  10. 10.
    Watts, D.J., Strogatz, S.H.: Collective dynamics of ‘small-world’ networks. Nature 393, 440–442 (1998)CrossRefGoogle Scholar
  11. 11.
    Albert, R., Barabasi, A.-L.: Statistical mechanics of complex networks. Reviews of Modern Physics 74, 47–97 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  12. 12.
    Amaral, L.A.N., Ottino, J.M.: Complex networks. The European Physical Journal B - Condensed Matter 38, 147–162 (2004)CrossRefGoogle Scholar
  13. 13.
    Cano, P., Celma, O., Koppenberger, M., Buldú, J.M.: The Topology of Music Recommendation Networks. Physics, 0512266 (2005)Google Scholar
  14. 14.
    Breese, J., Heckerman, D., Kadie, C.: Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In: Proceedings of the14th Annual Conference on Uncertainty in Artificial Intelligence (UAI 1998), pp. 43–52 (1998)Google Scholar

Copyright information

© Springer-Verlag GmbH Berlin Heidelberg 2013

Authors and Affiliations

  • Ryosuke Saga
    • 1
  • Kouki Okamoto
    • 2
  • Hiroshi Tsuji
    • 1
  • Kazunori Matsumoto
    • 2
  1. 1.Osaka Prefecture UniversitySakaiJapan
  2. 2.Kanagawa Institute of TechnologyAtsugiJapan

Personalised recommendations