Fisher Score-Based Feature Selection for Ordinal Classification: A Social Survey on Subjective Well-Being

  • María Pérez-OrtizEmail author
  • Mercedes Torres-Jiménez
  • Pedro Antonio Gutiérrez
  • Javier Sánchez-Monedero
  • César Hervás-Martínez
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9648)


This paper approaches the problem of feature selection in the context of ordinal classification problems. To do so, an ordinal version of the Fisher score is proposed. We test this new strategy considering data from an European social survey concerning subjective well-being, in order to understand and identify the most important variables for a person’s happiness, which is represented using ordered categories. The input variables have been chosen according to previous research, and these have been categorised in the following groups: demographics, daily activities, social well-being, health and habits, community well-being and personality/opinion. The proposed strategy shows promising results and performs significantly better than its nominal counterpart, therefore validating the need of developing specific ordinal feature selection methods. Furthermore, the results of this paper can shed some light on the human psyche by analysing the most and less frequently selected variables.


Feature Selection Feature Selection Method Hausdorff Distance Mean Absolute Error European Social Survey 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Linley, P.A., Maltby, J., Wood, A.M., Osborne, G., Hurling, R.: Measuring happiness: the higher order factor structure of subjective and psychological well-being measures. Pers. Individ. Differ. 47, 878–884 (2009)CrossRefGoogle Scholar
  2. 2.
    Diener, E.: Subjective well-being: the science of happiness and a proposal for a national index. Am. Psychol. 55, 34–43 (2000)CrossRefGoogle Scholar
  3. 3.
    Self, A., Thomas, J., Randall, C.: Measuring national well-being: Life in the uk (2012). Accessed 8 December 2015Google Scholar
  4. 4.
    Keyes, C.L., Shmotkin, D., Ryff, C.D.: Optimizing well-being: the empirical encounter of two traditions. J. Pers. Soc. Psychol. 82, 1007 (2002)CrossRefGoogle Scholar
  5. 5.
    Gutiérrez, P.A., Pérez-Ortiz, M., Sánchez-Monedero, J., Fernández-Navarro, F., Hervás-Martínez, C.: Ordinal regression methods: survey and experimental study. IEEE Trans. Knowl. Data Eng. 28, 127–146 (2016)CrossRefGoogle Scholar
  6. 6.
    Gu, Q., Li, Z., Han, J.: Generalized fisher score for feature selection. CoRR abs/1202.3725 (2012)Google Scholar
  7. 7.
    Bixter, M.T.: Happiness, political orientation, and religiosity. Personality Individ. Differ. 72, 7–11 (2015)CrossRefGoogle Scholar
  8. 8.
    Luengo, J., García, S., Herrera, F.: On the choice of the best imputation methods for missing values considering three groups of classification methods. Knowl. Inf. Syst. 32, 77–108 (2012)CrossRefGoogle Scholar
  9. 9.
    Pérez-Ortiz, M., Gutiérrez, P.A., Hervás-Martínez, C.: Projection-based ensemble learning for ordinal regression. IEEE Trans. Cybern. 44, 681–694 (2014)CrossRefGoogle Scholar
  10. 10.
    Baccianella, S., Esuli, A., Sebastiani, F.: Feature selection for ordinal text classification. Neural Comput. 26, 557–591 (2014)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Mukras, R., Wiratunga, N., Lothian, R., Chakraborti, S., Harper, D.: Information gain feature selection for ordinal text classification using probability re-distribution. In: The IJCAI 2007 Workshop on Text Mining and Link Analysis, Hyderabad, IN (2007)Google Scholar
  12. 12.
    Eiter, T., Mannila, H.: Distance measures for point sets and their computation. Acta Inform. 34, 103–133 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Sun, B.Y., Li, J., Wu, D.D., Zhang, X.M., Li, W.B.: Kernel discriminant learning for ordinal regression. IEEE Trans. Knowl. Data Eng. 22, 906–910 (2010)CrossRefGoogle Scholar
  14. 14.
    Baccianella, S., Esuli, A., Sebastiani, F.: Evaluation measures for ordinal regression. In: Proceedings of the Ninth International Conference on Intelligent Systems Design and Applications (ISDA 2009), Pisa, Italy (2009)Google Scholar
  15. 15.
    Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • María Pérez-Ortiz
    • 1
    Email author
  • Mercedes Torres-Jiménez
    • 1
  • Pedro Antonio Gutiérrez
    • 2
  • Javier Sánchez-Monedero
    • 1
  • César Hervás-Martínez
    • 2
  1. 1.Department of Quantitative MethodsUniversidad Loyola AndalucíaCórdobaSpain
  2. 2.Department of Computer Science and Numerical AnalysisUniversity of CórdobaCórdobaSpain

Personalised recommendations