Non-Euclidean or Non-metric Measures Can Be Informative
Statistical learning algorithms often rely on the Euclidean distance. In practice, non-Euclidean or non-metric dissimilarity measures may arise when contours, spectra or shapes are compared by edit distances or as a consequence of robust object matching [1,2]. It is an open issue whether such measures are advantageous for statistical learning or whether they should be constrained to obey the metric axioms.
The k-nearest neighbor (NN) rule is widely applied to general dissimilarity data as the most natural approach. Alternative methods exist that embed such data into suitable representation spaces in which statistical classifiers are constructed . In this paper, we investigate the relation between non-Euclidean aspects of dissimilarity data and the classification performance of the direct NN rule and some classifiers trained in representation spaces. This is evaluated on a parameterized family of edit distances, in which parameter values control the strength of non-Euclidean behavior. Our finding is that the discriminative power of this measure increases with increasing non-Euclidean and non-metric aspects until a certain optimum is reached. The conclusion is that statistical classifiers perform well and the optimal values of the parameters characterize a non-Euclidean and somewhat non-metric measure.
KeywordsEdit Distance Neighbor Distance Prototype Selection Approximate String Match Dissimilarity Data
- 1.Dubuisson, M., Jain, A.: Modified Hausdorff distance for object matching. In: ICPR, vol. 1, pp. 566–568 (1994)Google Scholar
- 2.Jacobs, D., Weinshall, D., Gdalyahu, Y.: Classification with Non-Metric Dist.: Image Retrieval and Class Representation. TPAMI 22, 583–600 (2000)Google Scholar
- 6.Schölkopf, B., Smola, A.: Learning with Kernels. MIT Press, Cambridge (2002)Google Scholar
- 7.Veltkamp, R., Hagedoorn, M.: State-of-the-art in shape matching. Technical Report UU-CS-1999-27, Utrecht University, The Netherlands (1999)Google Scholar
- 8.Pękalska, E., Duin, R., Günter, S., Bunke, H.: On not making dissimilarities Euclidean. In: S+SSPR, pp. 1145–1154 (2004)Google Scholar
- 10.Haasdonk, B.: Feature space interpretation of SVMs with indefinite kernels. TPAMI 25, 482–492 (2005)Google Scholar
- 11.Laub, J., Müller, K.R.: Feature discovery in non-metric pairwise data. JMLR, 801–818 (2004)Google Scholar
- 13.Graepel, T., Herbrich, R., Schölkopf, B., Smola, A., Bartlett, P., Müller, K.R., Obermayer, K., Williamson, R.: Classification on proximity data with LP-machines. In: ICANN, pp. 304–309 (1999)Google Scholar
- 14.Tax, D., Veenman, C.: Tuning the hyperparameter of an auc-optimized classifier. In: BNAIC, pp. 224–231 (2005)Google Scholar
- 15.Andreu, G., Crespo, A., Valiente, J.M.: Selecting the toroidal self-organizing feature maps (TSOFM) best organized to object recogn. In: ICNN, pp. 1341–1346 (1997)Google Scholar