Skip to main content

A Hybrid Approach for Improving Web Document Clustering Based on Concept Mining

  • Conference paper
  • First Online:
Emerging Research in Computing, Information, Communication and Applications

Abstract

With the rapid development of the Internet, huge volumes of text data are also increasing. These rapidly growing data generate challenges for users such as access, organizing, and analyzing the required information expeditiously. Document clustering techniques mostly rely on the statistical analysis of a term. It can be hard to identify in situations when multiple terms have the same frequency value, but one term is more important in terms of meaning than the other. Also, the process to discover more relevant information regarding a user query on the Web is uncontrollable. The proposed system tries to implement a concept-based document clustering model that clusters the Web documents based on the semantics or theme of the text data. The semantic analysis is done with the help of the semantic role labeler (SRL) to find the terms that contribute more to the meaning of the sentence. This system is called a concept-based analysis mechanism (CBAM). This system can provide accurate and robust document similarity calculation as well as concept identification that lead to improved results in Web document clustering.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Feldman, R., Dagan, I.: Knowledge discovery in textual databases (KDT). In: Proceedings of First International Conference Knowledge Discovery and Data Mining, pp. 112–117 (1995)

    Google Scholar 

  2. Oikonomakou, N., Vazirgiannis, M.: A review of web document clustering approaches. In: Data Mining and Knowledge Discovery Handbook, pp. 921–943 (2005)

    Google Scholar 

  3. Shehata, S., Karray, F., Kamel, M.: An efficient concept based mining model for enhancing text clustering. IEEE Trans. Knowl. Data Eng. 22(10) (2010)

    Google Scholar 

  4. Shehata, S., Karray, F., Kamel, M.: Enhancing text clustering using concept-based mining model. In: Proceedings of Sixth IEEE International Conference Data Mining (ICDM) (2006)

    Google Scholar 

  5. Salton, G., Wong, A., Yang, C.S.: A vector space model for automatic indexing. Comm. ACM 18(11), 112–117 (1975)

    Article  MATH  Google Scholar 

  6. Vadivelou, G., Ilavarasan, E.: Performance evaluation of semantic approaches for automatic clustering of similar web services. In: IEEE World Congress on Computing and Communication Technologies (WCCCT), pp. 237–242 (2014)

    Google Scholar 

  7. Talavera, L., Bejar, J.: Generality-based conceptual clustering with probabilistic concepts. IEEE Trans. Pattern Anal. Mach. Intell. 23(2), 196–206 (2001)

    Article  Google Scholar 

  8. Iosif, E., Potamianos, A.: Unsupervised semantic similarity computation between terms using web documents. IEEE Trans. Knowl. Data Eng. 22(11), 1637–1647 (2010)

    Google Scholar 

  9. Mahalle, M.S.D., Shah, K.: Document clustering by using semantics. Int. J. Sci. Eng. Res. 3(9) (2012)

    Google Scholar 

  10. Pradhan, S., Hacioglu, K., Ward, W., Martin, J.H., Jurafsky, D.: Semantic role parsing: adding semantic structure to unstructured text. In: Proceedings of Third IEEE International Conference Data Mining (ICDM), pp. 629–632 (2003)

    Google Scholar 

  11. Pradhan, S., Hacioglu, K., Krugler, V., Ward, W., Martin, J.H., Jurafsky, D.: Support vector learning for semantic argument classification. Mach. Learn. 60(1–3), 11–39 (2005)

    Article  Google Scholar 

  12. Jurafsky, D., Martin, J.H.: Speech and language processing. Prentice hall (2000)

    Google Scholar 

  13. Aas, K., Eikvil, L.: Text categorization: a survey, Technical Report 941, Norwegian Computing Center (June 1999)

    Google Scholar 

  14. Kingsbury, P., Palmer, M.: Propbank: the next level of treebank. In: Proceedings of Workshop Treebanks and Lexical Theories (2003)

    Google Scholar 

  15. Sumathi, M., Karthik, S.: A survey on semantic similarity between words in semantic web, In: IEEE International Conference on Radar, Communication and Computing (ICRCC), pp. 213–216 (2012)

    Google Scholar 

  16. Bollegala, D., Matsuo, Y., Ishizuka, M.: A web search engine-based approach to measure semantic similarity between words. IEEE Trans. Knowl. Data Eng. 23, 977–990 (2011)

    Google Scholar 

  17. Steinbach, M., Karypis, G., Kumar, V.: A comparison of document clustering techniques. In: KDD Workshop on Text Mining’00 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rajendra B. Petkar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Petkar, R.B., Patil, S.S. (2016). A Hybrid Approach for Improving Web Document Clustering Based on Concept Mining. In: Shetty, N., Prasad, N., Nalini, N. (eds) Emerging Research in Computing, Information, Communication and Applications . Springer, Singapore. https://doi.org/10.1007/978-981-10-0287-8_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-0287-8_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-0286-1

  • Online ISBN: 978-981-10-0287-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics