Overview of INEX 2007 Link the Wiki Track

  • Darren Wei Che Huang
  • Yue Xu
  • Andrew Trotman
  • Shlomo Geva
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4862)


Wikipedia is becoming ever more popular. Linking between documents is typically provided in similar environments in order to achieve collaborative knowledge sharing. However, this functionality in Wikipedia is not integrated into the document creation process and the quality of automatically generated links has never been quantified. The Link the Wiki (LTW) track at INEX in 2007 aimed at producing a standard procedure, metrics and a discussion forum for the evaluation of link discovery. The tasks offered by the LTW track as well as its evaluation present considerable research challenges. This paper briefly described the LTW task and the procedure of evaluation used at LTW track in 2007. Automated link discovery methods used by participants are outlined. An overview of the evaluation results is concisely presented and further experiments are reported.


Wikipedia Link Discovery Assessment Evaluation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Denoyer, L., Gallinari, P.: The Wikipedia XML Corpus. SIGIR Forum. 40(1), 64–69 (2006)CrossRefGoogle Scholar
  2. 2.
    Wilkinson, R., Smeaton, A.F.: Automatic Link Generation. ACM Computing Surveys 31(4) (December 1999)Google Scholar
  3. 3.
    Ellis, D., Furner-Hines, J., Willett, P.: On the Measurement of Inter-Linker Consistency and Retrieval Effectiveness in Hypertext Database. In: Proceedings of the 17th Annual International Conference on Research and Development in Information Retrieval, Dublin, Ireland, July 1994, pp. 51–60 (1994)Google Scholar
  4. 4.
    Green, S.J.: Building Hypertext Links By Computing Semantic Similarity. IEEE Transactions on Knowledge and Data Engineering 11(5), 713–730 (1999)CrossRefGoogle Scholar
  5. 5.
    Allan, J.: Building Hypertext using Information Retrieval. Information Processing and Management 33(2), 145–159 (1997)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Green, S.J.: Automated Link Generation: Can We Do Better than Term Repetition? In: Proceedings of the 7th International World Wide Web Conference, Brisbane, Australia, April 14-18, pp. 75–84 (1998)Google Scholar
  7. 7.
    Zeng, J., Bloniarz, O.A.: From Keywords to Links: an Automatic Approach. In: Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC 2004), April 5-7, pp. 283–286 (2004)Google Scholar
  8. 8.
    Adafre, S.F., de Rijke, M.: Discovering missing links in Wikipedia. In: Proceedings of the SIGIR 2005 Workshop on Link Discovery: Issues, Approaches and Applications, Chicago, IL, USA, August 21-24 (2005)Google Scholar
  9. 9.
    Jenkins, N.: Can We Link It (2007),
  10. 10.
    Krowne, A.: An Architecture for Collaborative Math and Science Digital Libraries. Thesis for Master of Science Virginia Polytechnic Institute and State University (July 19, 2003)Google Scholar
  11. 11.
    Gardner, J., Krowne, A., Xiong, L.: NNexus: Towards an Automatic Linker for a Massively-Distributed Collaborative Corpus. In: Proceedings of the International Conference on Collaborative Computing: Networking, Applications and Worksharing, November 17-20, pp. 1–3 (2006)Google Scholar
  12. 12.
    Norris, J.R.: Markov chains, Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge (1999)Google Scholar
  13. 13.
    Ollivier, Y., Senellart, P.: Finding Related Pages Using Green Measures: An Illustration with Wikipedia. In: Proceedings of the 22nd National Conference on Artificial Intelligence (AAAI 2007), Vancouver, Canada, July 22-26 (2007)Google Scholar
  14. 14.
    Schönhofen, P.: Identifying decument topics using the Wikipedia category network. In: Proceedings of the 2006 IEEE/EIC/ACM International Conference on Web Intelligence (WI 2006), Hong Kong, December 18-22 (2006)Google Scholar
  15. 15.
    Strube, M., Ponzetto, S.P.: WikiRelate! Computing Semantic Relatedness Using Wikipedia. In: Proceedings of the 21th National Conference on Artificial Intelligence (AAAI 2006), Boston, Massachusetts, USA, July 16-17, pp. 16–20 (2006)Google Scholar
  16. 16.
    Gabrilovich, E., Markovitch, S.: Computing Semantic Relatedness using Wikipedia-based Explicit Semantic Analysis. In: Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007), Hyderabad, India, January 6-12 (2007)Google Scholar
  17. 17.
    Kumar, R., Raghavan, P., Rajagopalan, S., Tomkins, A.: Trawling the Web for Emerging Cyber-Communities. Computer Networks 31(11-16), 1481–1493 (1999)CrossRefGoogle Scholar
  18. 18.
    Jeh, G., Widom, J.: SimRank: a measure of structural-context similarity. In: Proceedings of the 8th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2002), Edmonton, Canada, July 23-26, pp. 538–543 (2002)Google Scholar
  19. 19.
    Kessler, M.M.: Bibliographic coupling between scientific papers. American Documentation 14(10-25) (1963)Google Scholar
  20. 20.
    Dean, J., Henzinger, M.R.: Finding related pages in the World Wide Web. Computer Networks 31(11-16), 1467–1479 (1999)CrossRefGoogle Scholar
  21. 21.
    Kleinberg, J.: Authoritative sources in a hyperlinked environment. In: Proceedings of the 9th Annual ACM–SIAM Symposium on Discrete Algorithms, San Francisco, CA, USA, January 25-27, pp. 668–677 (1998)Google Scholar
  22. 22.
    Schamber, L.: Relevance and Information Behavior, Annual review of information science and technology, vol. 29, pp. 3–48. Information Today, Medford (1994)Google Scholar
  23. 23.
    Vakkari, P., Hakala, N.: Changes in relevance criteria and problem stages in task performance. Journal of Documentation 56(5), 540–562 (2000)CrossRefGoogle Scholar
  24. 24.
    Kekäläinen, J., Järvelin, K.: Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology 53(13), 1120–1129 (2002)CrossRefGoogle Scholar
  25. 25.
    Huang, W.C., Xu, Y., Geva, S.: Overview of INEX 2007 Link the Wiki track. In: Pre-Proceedings of the INEX 2007 Conference, Dagstuhl, Germany (2007)Google Scholar
  26. 26.
    Itakura, K.Y., Clarke, C.L.A.: University of Waterloo at INEX2007: Ad Hoc and Link-the-Wiki Tracks. In: Pre-Proceedings of the INEX 2007 Conference, Dagstuhl, Germany, pp. 380–387 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Darren Wei Che Huang
    • 1
  • Yue Xu
    • 1
  • Andrew Trotman
    • 1
  • Shlomo Geva
    • 1
  1. 1.Faculty of Information TechnologyQueensland University of TechnologyBrisbaneAustralia

Personalised recommendations