An Improved Training Algorithm for the Linear Ranking Support Vector Machine

  • Antti Airola
  • Tapio Pahikkala
  • Tapio Salakoski
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6791)


We introduce an O(ms + mlog(m)) time complexity method for training the linear ranking support vector machine, where m is the number of training examples, and s the average number of non-zero features per example. The method generalizes the fastest previously known approach, which achieves the same efficiency only in restricted special cases. The excellent scalability of the proposed method is demonstrated experimentally.


binary search tree cutting plane optimization learning to rank support vector machine 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Airola, A., Pahikkala, T., Salakoski, T.: Training linear ranking SVMs in linearithmic time using red-black trees. Pattern Recognition Letters (in press, 2011)Google Scholar
  2. 2.
    Bayer, R.: Symmetric binary B-trees: Data structure and maintenance algorithms. Acta Informatica 1, 290–306 (1972)CrossRefMATHMathSciNetGoogle Scholar
  3. 3.
    Chapelle, O., Keerthi, S.S.: Efficient algorithms for ranking with SVMs. Information Retrieval 13, 201–215 (2010)CrossRefGoogle Scholar
  4. 4.
    Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms. MIT Press, Cambridge (2001)MATHGoogle Scholar
  5. 5.
    Freund, Y., Iyer, R., Schapire, R.E., Singer, Y.: An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research 4, 933–969 (2003)MATHMathSciNetGoogle Scholar
  6. 6.
    Fürnkranz, J., Hüllermeier, E.: Preference learning. Künstliche Intelligenz 19(1), 60–61 (2005)MATHGoogle Scholar
  7. 7.
    Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression. In: 9th International Conference on Articial Neural Networks, pp. 97–102. Institute of Electrical Engineers (1999)Google Scholar
  8. 8.
    Joachims, T.: Optimizing search engines using clickthrough data. In: Hand, D., Keim, D., Ng, R. (eds.) 8th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 133–142. ACM Press, New York (2002)Google Scholar
  9. 9.
    Joachims, T.: Training linear SVMs in linear time. In: Eliassi-Rad, T., Ungar, L., Craven, M., Gunopulos, D. (eds.) 12th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 217–226. ACM Press, New York (2006)CrossRefGoogle Scholar
  10. 10.
    Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research 5, 361–397 (2004)Google Scholar
  11. 11.
    Pahikkala, T., Tsivtsivadze, E., Airola, A., Boberg, J., Järvinen, J.: An efficient algorithm for learning to rank from preference graphs. Machine Learning 75(1), 129–165 (2009)CrossRefGoogle Scholar
  12. 12.
    Smola, A.J., Vishwanathan, S.V.N., Le, Q.: Bundle methods for machine learning. In: McCallum, A. (ed.) Advances in Neural Information Processing Systems 20. MIT Press, Cambridge (2007)Google Scholar
  13. 13.
    Teo, C.H., Vishwanathan, S.V.N., Smola, A., Le, Q.V.: Bundle methods for regularized risk minimization. Journal of Machine Learning Research 11, 311–365 (2010)MATHMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Antti Airola
    • 1
  • Tapio Pahikkala
    • 1
  • Tapio Salakoski
    • 1
  1. 1.University of Turku and Turku Centre for Computer Science (TUCS)TurkuFinland

Personalised recommendations