Web Feed Clustering and Tagging Aggregator Using Topological Tree-Based Self-Organizing Maps

  • Richard T. Freeman
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5788)


With the rapid and dramatic increase in web feeds published by different publishers, providers or websites via Really Simple Syndication (RSS) and Atom, users cannot be expected to scan, select and consume all the content manually. This is leading to an information overload for consumers as the amount of content increases. With this growth there is a need to make the content more accessible and allow it to be efficiently searched and explored. This can be partially achieved by structuring and organising the content dynamically into topics or categories. Typical approaches make use of categorisation or clustering, however these approaches have a number of limitations such as the inability to represent the connections between topics and being heavy dependent on fixed parameters.

In this paper we apply the topological tree method, to dynamically identify categories, on financial and business news feed dataset. The topological tree method is used to automatically organise an aggregation of the financial news feeds into self-discovered topics and allows a drill down into sub-topics. The news feeds, organised using the topological tree method, are discussed against those of typical web aggregators. A discussion is made on the criterions of representing news feeds, and the advantages of presenting underlying topics and providing a clear view of the connections between news topics. The topological tree has been found to be a superior representation, and well suited for organising financial news content and could be applied to categorise and filter news more efficiently for market abuse detection.


Feed aggregator document clustering RSS Atom blog news feed weblogs web clustering self-organizing maps topological tree neural networks post retrieval clustering taxonomy generation enterprise content management enterprise search information management topic maps 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Freeman, R.T.: Web Document Search, Organisation and Exploration Using Self-Organising Neural Networks, PhD Thesis, Faculty of Engineering and Physical Sciences, School of Electrical & Electronic Engineering, University of Manchester, Manchester (2004)Google Scholar
  2. 2.
    Qamra, A., Tseng, B., Chang, E.Y.: Mining blog stories using community-based and temporal clustering. In: 15th ACM international conference on Information and knowledge management CIKM, pp. 58–67. ACM, New York (2006)Google Scholar
  3. 3.
    Paliouras, G., Alexandros, M., Ntoutsis, C., Alexopoulos, A., Skourlas, C.: PNS: Personalized Multi-Source News Delivery. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds.) KES 2006. LNCS (LNAI), vol. 4252, pp. 1152–1161. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Li, X., Yan, J., Deng, Z.-H., Ji, L., Fan, W., Zhang, B., Chen, Z.: A Novel Clustering-based RSS Aggregator. In: 16th international conference on World Wide Web, pp. 1309–1310. ACM, New York (2007)CrossRefGoogle Scholar
  5. 5.
    Agarwal, N., Galan, M., Liu, H., Subramanya, S.: Clustering Blogs with Collective Wisdom. In: 8th International Conference on Web Engineering, ICWE 2008, pp. 336–339. IEEE, Los Alamitos (2008)CrossRefGoogle Scholar
  6. 6.
    Huang, W., Webster, D.: Enabling Context-Aware Agents to Understand Semantic Resources on The WWW and The SemanticWeb. In: International Conference on Web Intelligence (WI 2004), pp. 138–144. IEEE, Los Alamitos (2004)Google Scholar
  7. 7.
    Webster, D., Huang, W., Mundy, D., Warren, P.: Context-Orientated News Filtering for Web 2.0 and Beyond. In: 15th International World Wide Web Conference, pp. 1001–1002. ACM, New York (2006)CrossRefGoogle Scholar
  8. 8.
    Thelwall, M., Prabowo, R.: Identifying and Characterizing Public Science-Related Fears From RSS Feeds. Journal of the American Society for Information Science and Technology 58(3), 379–390 (2007)CrossRefGoogle Scholar
  9. 9.
    Kohonen, T.: Self-Organizing Maps. Third Extended edn. Springer, Heidelberg (2001)Google Scholar
  10. 10.
    Freeman, R.T.: Topological Tree Clustering of Web Search Results. In: Corchado, E., Yin, H., Botti, V., Fyfe, C. (eds.) IDEAL 2006. LNCS, vol. 4224, pp. 789–797. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Freeman, R.T.: Topological Tree Clustering of Social Network Search Results. In: Yin, H., Tino, P., Corchado, E., Byrne, W., Yao, X. (eds.) IDEAL 2007. LNCS, vol. 4881, pp. 760–769. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  12. 12.
    Salton, G.: Automatic text processing - the transformation, analysis, and retrieval of information by computer. Addison-Wesley, Reading (1989)Google Scholar
  13. 13.
    Freeman, R.T., Yin, H.: Web content management by self-organization. IEEE Transactions on Neural Networks 16(5), 1256–1268 (2005)CrossRefGoogle Scholar
  14. 14.
    Freeman, R.T., Yin, H.: Adaptive topological tree structure for document organisation and visualisation. Neural Networks 17(8-9), 1255–1271 (2004)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Richard T. Freeman
    • 1
  1. 1.Capgemini, Financial Services GBUTechnology Consulting GroupSurreyUnited Kingdom

Personalised recommendations