Using Internet Glossaries to Determine Interests from Home Pages

  • Edwin Portscher
  • James Geller
  • Richard Scherl
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2738)


There are millions of home pages on the web. Each page contains valuable data about the page’s owner that can be used for marketing purposes. These pages have to be classified according to interests. The traditional Information Retrieval approach requires large training sets that are classified by human experts. Knowledge-based methods, which use handcrafted rules, require a significant investment to develop the rule base. Both these approaches are very time consuming. We are using glossaries, which are freely available on the Internet, to determine interests from home pages. Processing of these glossaries can be automated and requires little human effort and time, compared to the other two approaches. Once the terms have been extracted from these glossaries, they can be used to infer interests from the home pages of web users. This paper describes the system we have developed for classifying home pages by interests. On an experiment of 400 pages, we found that the glossary with the highest number of word matches is the correct interest in 44.75% of the pages. The correct interest is in the top three highest returned interests in 72.25% of the pages, and the correct interest is in the top five returned interest matches in 84.5% of the pages.


Natural Language Processing Home Page Word Match Information Retrieval Method Page Classification 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Attardi, G., Gullí, A., Sebastiani, F.: Automatic Web page categorization by link and context analysis. In: Hutchison, C., Lanzarone, G. (eds.) Proceedings of THAI-1999, 1st European Symposium on Telematics, Hypermedia and Artificial Intelligence, Varese, IT, pp. 105–119 (1999)Google Scholar
  2. 2.
    Glover, E.J., Tsioutsiouliklis, K., Lawrence, S., Pennock, D.M., Flake, G.W.: Using Web Structure for Classifying and Describing Web Pages. In: Proceedings of WWW-2002, International Conference on the World Wide Web (2002)Google Scholar
  3. 3.
    Gelfand, B., Wulfekuler, M., Punch, W.F.: Automated concept extraction from plain text. Papers from the AAAI 1998 Workshop on Text Categorization, Madison, WI, pp. 13–17 (1998)Google Scholar
  4. 4.
    Furnkranz, J.: Using Links for Classifying Web-pages. Technical Report OEFAI TR-98-29. Austrian Research Institute for Artificial IntelligenceGoogle Scholar
  5. 5.
    Mase, H.: Experiments on Automatic Web Page Categorization for IR System. Technical Report. Department of Computer Science, Stanford University (1998)Google Scholar
  6. 6.
    Asirvathan, A.P., Ravi, K.K.: Web Page Classification based on Document Structure. International Institute of Information Technology (2001)Google Scholar
  7. 7.
    Pierre, J.M.: Practical Issues for Automated Categorization of Web Sites. In: ECDL 2000 Workshop on the Semantic Web (2000)Google Scholar
  8. 8.
    Apte, C., Damerau, F., Weiss, S.: Automated Learning of Decision Rules for Text Categorization. ACM Transactions on Information Systems, 233–240 (July 1994)Google Scholar
  9. 9.
    Yu, H., Chang, K.C.-C., Han, J.: Heterogeneous Learner for Web Page Classification. In: Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM 2002), Maebashi, Japan, pp. 538–545 (December 2002)Google Scholar
  10. 10.
    Tai, S.-M., Yang, C.-Z., Chen, I.-X.: Improved Automatic Web-Page Classification by Neighbor Text Percolation. Department of Computer Engineering and Science, Yuan Ze University Kaohsiung, Taiwan, November 23 (2002)Google Scholar
  11. 11.
    Chakrabarti, S.: Mining the Web: Discovering Knowledge from Hypertext Data. Morgan Kaufmann Publishers, San Francisco (2003)Google Scholar
  12. 12.
    Jackson, P., Moulinier, I.: Natural Language Processing for Online Applications: Text Retrieval, Extraction and Categorization. John Benjamins Publishing Company, Amsterdam (2002)Google Scholar
  13. 13.
    Hayes, P.J., Weinstein, S.P.: CONSTRUE/TIS: a system for content-based indexing of a database of news stories. In: Rappaport, A., Smith, R. (eds.) Proceedings of IAAI-1990, 2nd Conference on Innovative Applications of Artificial Intelligence, pp. 49–66. AAAI Press, Menlo Park (1990)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Edwin Portscher
    • 1
  • James Geller
    • 1
  • Richard Scherl
    • 2
  1. 1.New Jersey Institute of TechnologyNewark
  2. 2.Monmouth UniversityWest Long Branch

Personalised recommendations