Information Flow Analysis with Chinese Text
This article investigates the effectiveness of an information inference mechanism on Chinese text. The information inference derives implicit associations via computation of information flow on a high dimensional conceptual space, which is approximated by a cognitively motivated lexical semantic space model, namely Hyperspace Analogue to Language (HAL). A dictionary-based Chinese word segmentation system was used to segment words. To evaluate the Chinese-based information flow model, it is applied to query expansion, in which a set of test queries are expanded automatically via information flow computations and documents are retrieved. Standard recall-precision measures are used to measure performance. Experimental results for TREC-5 Chinese queries and People Daily’s corpus suggest that the Chinese information flow model significantly increases average precision, though the increase is not as high as those achieved using English corpus. Nevertheless, there is justification to believe that the HAL-based information flow model, and in turn our psychologistic stance on the next generation of information processing systems, have a promising degree of language independence.
KeywordsInformation Flow Average Precision Latent Semantic Analysis Query Term Query Expansion
Unable to display preview. Download preview PDF.
- 1.Barwise, J., Seligman, J.: Information Flow: The Logic of Distributed Systems. Cambridge Tracts in Theoretical Computer Science 44 (1997)Google Scholar
- 2.Bruza, P.D., Song, D.: Inferring Query Models by Information Flow Analysis. In: Proceedings of the 11th International ACM Conference on Information and Knowledge Management (CIKM 2002), pp. 260–269 (2002)Google Scholar
- 4.Burgess, C., Livesay, L., Lund, K.: Explorations in Context Space: Words, Sentences, Discourse. In: Foltz, P.W. (ed.) Quantitative Approaches to Semantic Knowledge Representation, vol. 25(2&3), pp. 179–210 (1998)Google Scholar
- 5.Gärdenfors, P.: Conceptual Spaces: The Geometry of Thought. MIT Press, Cambridge (2000)Google Scholar
- 8.Robertson, S.E., Walker, S., Spark-Jones, K., Hancock-Beaulieu, M.M., Gatford, M.: OKAPI at TREC-3. In: Proceedings of the 3rd Text Retrieval Conference (TREC-3), pp. 109–126 (1994)Google Scholar
- 10.Text Retrieval Conference (TREC), National Institution of Standards and Technology( NIST), http://trec.nist.gov/data/
- 11.Cheong, P., Song, D., Bruza, P.D., Wong, K.F.: Information Flow Analysis with Chinese Text. In: Su, K.-Y., Tsujii, J., Lee, J.-H., Kwong, O.Y. (eds.) IJCNLP 2004. LNCS (LNAI), vol. 3248, pp. 91–98. Springer, Heidelberg (2005)Google Scholar