Collecting Novel Technical Terms from the Web by Estimating Domain Specificity of a Term
This paper proposes a method of domain specificity estimation of technical terms using the Web. In the proposed method, it is assumed that, for a certain technical domain, a list of known technical terms of the domain is given. Technical documents of the domain are collected through the Web search engine, which are then used for generating a vector space model for the domain. The domain specificity of a target term is estimated according to the distribution of the domain of the sample pages of the target term. We apply this technique of estimating domain specificity of a term to the task of discovering novel technical terms that are not included in any of existing lexicons of technical terms of the domain. Out of randomly selected 1,000 candidates of technical terms per a domain, we discovered about 100 ~ 200 novel technical terms.
Unable to display preview. Download preview PDF.
- 3.Huang, C.-C., Lin, K.-M., Chien, L.-F.: Automatic training corpora acquisition through Web mining. In: Proceedings of IEEE/WIC/ACM International Conference on Web Intelligence, pp. 193–199 (2005)Google Scholar
- 4.Liu, B., Li, X., Lee, W.S., Yu, P.S.: Text classification by labeling words. In: Proceedings of the 19th AAAI, pp. 425–430 (2004)Google Scholar
- 6.Utsuro, T., Kida, M., Tonoike, M., Sato, S.: Towards automatic domain classification of technical terms: Estimating domain specificity of a term using the Web. In: Ng, H.T., Leong, M.-K., Kan, M.-Y., Ji, D. (eds.) AIRS 2006. LNCS, vol. 4182, pp. 633–641. Springer, Heidelberg (2006)CrossRefGoogle Scholar