Probabilistic Ranking Support Vector Machine

  • Nguyen Thi Thanh Thuy
  • Ngo Anh Vien
  • Nguyen Hoang Viet
  • TaeChoong Chung
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5552)


Recently, Support Vector Machines (SVMs) have been applied very effectively in learning ranking functions (or preference functions).They intend to learn ranking functions with the principles of the large margin and the kernel trick. However, the output of a ranking function is a score function which is not a calibrated posterior probability to enable post-processing. One approach to deal with this problem is to apply a generalized linear model with a link function and solve it by calculating the maximum likelihood estimate. But, if the link function is nonlinear, maximizing the likelihood will face with difficulties. Instead, we propose a new approach which train an SVM for a ranking function, then map the SVM outputs into a probabilistic sigmoid function whose parameters are trained by using cross-validation. This method will be tested on three data-mining datasets and compared to the results obtained by standard SVMs.


SVM Ranking SVM Probabilistic SVM Probabilistic ranking SVM 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, Chichester (1998)zbMATHGoogle Scholar
  2. 2.
    Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. In: Data Mining and Knowledge Discovery. Springer, Heidelberg (1998)Google Scholar
  3. 3.
    Platt, J.C.: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In: Advances in Large Margin Classifiers. MIT Press, Cambridge (1999)Google Scholar
  4. 4.
    Wahba, G.: Support Vector Machine, Reproducing Kernel Hilbert Spaces and the Randomized GACV. In: Advances in Kernel Methods: Support Vector Learning. MIT Press, Cambridge (1999)Google Scholar
  5. 5.
    Gill, P.E., Murray, W., Wright, M.H.: Practical Optimization. Academic Press, London (1981)zbMATHGoogle Scholar
  6. 6.
    Yu, H.: SVM Selective Sampling for Ranking with Application to Data Retrieval. In: ACM Special Interest Group on Knowledge Discovery in Data, USA (2005)Google Scholar
  7. 7.
    Herbrich, R., Graepel, T., Obermayer, K.: Large Margin Rank Boundaries for Ordinal Regression. In: Advances in Large Margin Classifiers. MIT Press, Cambridge (2000)Google Scholar
  8. 8.
    Cao, Y., Xu, J., Liu, T.Y., Li, H., Huang, Y., Hon, H.W.: Adapting Ranking SVM to Document Retrieval. In: ACM SIGIR 2006, USA (2006)Google Scholar
  9. 9.
    Noble, W.S.: Support Vector Machine Applications in Computational Biology. In: Schoelkopf, B., Tsuda, K., Vert, J.P. (eds.) Kernel Methods in Computational Biology, pp. 71–92. MIT Press, Cambridge (2004)Google Scholar
  10. 10.
    Taylor, J.S.: Nello Cristianini. Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, Cambridge (2000)Google Scholar
  11. 11.
    Yeh, J.Y., Lin, J.Y.: Learning to Rank for Information Retrieval Using Genetic Programming. In: SIGIR 2007, Amsterdam, Netherlands (2007)Google Scholar
  12. 12.
    Radlinski, F., Joachims, T., Chain, Q.: Learning to Rank from Implicit Feedback. In: ACM SIGKDD (2005)Google Scholar
  13. 13.
    Acevedo, F.J., Maldonado, S., Domínguez, E., Narváez, A., López, F.: Probabilistic Support Vector Machines for Multi-Class Alcohol Identification. Journal: Sensors and Actuators B: Chemical (2006) ISSN: 0925-4005Google Scholar
  14. 14.
    Ana, M.B., Nikolik, D., Curfs, L.M.G.: Probabilistic SVM Outputs for Pattern Recognition Using Aanalytical Geometry. Neurocomputing 62 (2004)Google Scholar
  15. 15.
    Lin, H., Liu, T., Chuang, J.: A Probabilistic SVM Approach for Background Scene Initialization. In: International Conference on Image Processing (2002)Google Scholar
  16. 16.
    Tao, Q., Liu, T.Y., Lai, W., Zhang, X.D., Wang, D.S., Li, H.: Ranking with Multiple Hyperplanes (2007)Google Scholar
  17. 17.
    Yu, H., Hwang, S.W., Chang, K.C.C.: Enabling Soft Queries for Data Retrieval. Information Systems (2007)Google Scholar
  18. 18.
    Freund, Y., Iyer, R., Schapire, R.E., Singer, Y.: An Efficient Boosting Algorithm for Combining Preferences. Journal of Machine Learning Research (2003)Google Scholar
  19. 19.
    McCullagh, P., Nelder, J.A.: Generalized Linear Models. Chapman and Hall, London (1983)Google Scholar
  20. 20.
    Fahrmeir, L., Tutz, G.: Multivariate Statistical Modelling Based on Generalized Linear Models. Springer, Heidelberg (2001)CrossRefzbMATHGoogle Scholar
  21. 21.
    Yu, H., Kim, Y., Hwang, S.W.: RVM: An Efficient Method for Learning Ranking SVM. Technical Report, Department of Computer Science and Engineering, Pohang University of Science and Technology (POSTECH) (2008),
  22. 22.
    Liu, T.Y., Xu, J., Qin, T., Xiong, W., Li, H.: LETOR: Benchmark Dataset for Research on Learning to Rank for Information Retrieval. In: SIGIR 2007: Proceedings of the Learning to Rank Workshop in the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (2007)Google Scholar
  23. 23.
    Chang, C.C., Lin, C.J.: LIBSVM: A Library for Support Vector Machines(2001),
  24. 24.
    Jakulin, A., Mozina, M., Demsar, J., Bratko, I., Zupan, B.: Nomograms for Visualizing Support Vector Mchines (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Nguyen Thi Thanh Thuy
    • 1
  • Ngo Anh Vien
    • 1
  • Nguyen Hoang Viet
    • 1
  • TaeChoong Chung
    • 1
  1. 1.Artificial Intelligence Lab, Department of Computer Engineering, School of Electronics and InformationKyungHee University SeoCheon, GiHeung, YongIn, GyeongGiDoSouth Korea

Personalised recommendations