Experiments on Average Distance Measure
ADM (Average Distance Measure) is an IR effectiveness metric based on the assumptions of continuous relevance and retrieval. This paper presents some novel experimental results on two different test collections: TREC 8, re-assessed on 4-levels relevance judgments, and TREC 13 TeraByte collection. The results confirm that ADM correlation with standard measures is high, even when using less data, i.e., few documents.
Unable to display preview. Download preview PDF.
- 1.Della Mea, V., Di Gaspero, L., Mizzaro, S.: Evaluating ADM on a four-level relevance scale document set from NTCIR. In: Proceedings of NTCIR Workshop 4 Meeting - Supplement Vol. 2, pp. 30–38 (2004)Google Scholar
- 3.Mizzaro, S.: A new measure of retrieval effectiveness (Or: What’s wrong with precision and recall). In: Ojala, T. (ed.) International Workshop on Information Retrieval (IR 2001), pp. 43–52 (2001)Google Scholar
- 4.Sormunen, E.: Liberal relevance criteria of TREC - Counting on negligible documents? In: Jarvelin, K., Beaulieu, M., Baeza-Yates, R., Myaeng, S. (eds.) Proceedings of the 25th ACM SIGIR Conference, August 11-15, pp. 324–330 (2002)Google Scholar