A Novel Web Page Analysis Method for Efficient Reasoning of User Preference

  • Seunghwa Lee
  • Minchul Jung
  • Eunseok Lee
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5068)


The amount of information on the Web is rapidly increasing. Recommender systems can help users selectively filter this information based on their preferences. One way to obtain user preferences is to analyze characteristics of content that is accessed by the user. Unfortunately, web pages may contain elements irrelevant to user interests (e.g., navigation bar, advertisements, and links.). Hence, existing analysis approaches using the TF-IDF method may not be suitable. This paper proposes a novel user preference analysis system that eliminates elements that repeatedly appear in web pages. It extracts user interest keywords in the identified primary content. Also, the system has features that collect the anchor tag, and track the user’s search route, in order to identify keywords that are of core interest to the user. This paper compares the proposed system with pure TF-IDF analysis method. The analysis confirms its effectiveness in terms of the accuracy of the analyzed user profiles.


Recommendation system User preference User profile TF-IDF 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Melamed, D., Shapira, B., Elovici, Y.: MarCol: A Market-Based Recommender System. IEEE Intelligent Systems 22(3), 74–78 (2007)CrossRefGoogle Scholar
  2. 2.
    Aciar, S., Zhang, D., Simoff, S., Debenham, J.: Informed Recommender: Basing Recommendations on Consumer Product Reviews. IEEE Intelligent Systems 22(3), 39–47 (2007)CrossRefGoogle Scholar
  3. 3.
    Balabanovic, M., Shoham, Y.: Fab: Content-based, Collaborative Recommendation. Communication of the ACM, 66–72 (March 1997)Google Scholar
  4. 4.
    Linden, G., Smith, B., York, J.: Recommendations Item-to-Item Collaborative Filtering. IEEE Internet Computing, 76–80 (January 2003)Google Scholar
  5. 5.
    Robertson, S.: Understanding Inverse Document Frequency: on theoretical arguments for IDF. Journal of documentation 60(5), 503–520 (2005)CrossRefGoogle Scholar
  6. 6.
    Salton, G.: Introduction to Modern Information Retrieval. Mcgraw Hill, New York (1983)zbMATHGoogle Scholar
  7. 7.
    Debnath, S., Mitra, P., Pal, N., Giles, C.: Automatic Identification of Informative Sections of Web Pages. IEEE Transactions on Knowledge and Data Engineering 17(9), 1233–1246 (2005)CrossRefGoogle Scholar
  8. 8.
    Chang, S., Sikora, T., Puri, A.: Overview of the MPEG-7 Standard. IEEE Transactions on Circuits and Systems for Video Technology 11(6) (June 2001)Google Scholar
  9. 9.
    Beil, F., Ester, M., Xu, X.: Frequent Term-Based Text Clustering. In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge Discovery and Data Mining, pp. 436–442 (2002)Google Scholar
  10. 10.
    Pazzani, M., Muramatsu, J., Billsus, D.: Syskill & Webert: Identifying interesting web sites. In: Proceedings of the 13th national conference on Artificial Intelligence (1996)Google Scholar
  11. 11.
    Chen, L., Sycara, K.: WebMate: A Personal Agent for Browsing and Searching. In: Proceedings of the 2nd international conference on Autonomous Agent, pp. 132–139 (1998)Google Scholar
  12. 12.
    Pierre, S., Kacan, C., Probst, W.: An agent –based approach for integrating user profile into a knowledge management process. Elsevier Knowledge-Based Systems 13, 307–314 (2000)CrossRefGoogle Scholar
  13. 13.
    Lin, S., Ho, J.: Discovering Informative Content blocks from Web Documents. In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge Discovery and Data Mining, July 2002, pp. 588–593 (2002)Google Scholar
  14. 14.
    Ramaswamy, L., Lyengar, A., Liu, L., Douglis, F.: Automatic Fragment Detection in Dynamic Web Pages and Its Impact on Caching. IEEE Transactions on Knowledge and Data Engineering 17(6), 859–874 (2005)CrossRefGoogle Scholar
  15. 15.
  16. 16.
    Armstrong, R., Freitag, D., Joachims, T., Mitchell, T.: WebWatcher: A Learning Apprentice for the World Wide Web (February 1995)Google Scholar
  17. 17.
    Frakes, W.B., Baeza-Yates, R.: Information Retrieval: Data Structures and Algorithms. Prentice-Hall, Englewood Cliffs (1992)Google Scholar
  18. 18.
    Yu, Z., Zhou, X.: TV3P: An Adaptive Assistant for Personalized TV. IEEE Transaction on Consumer Electronics 50(1), 393–399 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Seunghwa Lee
    • 1
  • Minchul Jung
    • 1
  • Eunseok Lee
    • 1
  1. 1.School of Information and Communication EngineeringSungkyunkwan UniversitySuwonSouth Korea

Personalised recommendations