Journal of Business and Psychology

, Volume 26, Issue 1, pp 1–9 | Cite as

Relative Importance Analysis: A Useful Supplement to Regression Analysis

Article

Abstract

This article advocates for the wider use of relative importance indices as a supplement to multiple regression analyses. The goal of such analyses is to partition explained variance among multiple predictors to better understand the role played by each predictor in a regression equation. Unfortunately, when predictors are correlated, typically relied upon metrics are flawed indicators of variable importance. To that end, we highlight the key benefits of two relative importance analyses, dominance analysis and relative weight analysis, over estimates produced by multiple regression analysis. We also describe numerous situations where relative importance weights should be used, while simultaneously cautioning readers about the limitations and misconceptions regarding the use of these weights. Finally, we present step-by-step recommendations for researchers interested in incorporating these analyses in their own work and point them to available web resources to assist them in producing these weights.

Keywords

Relative importance Predictor importance Relative weight analysis Dominance analysis Multiple regression 

References

  1. Aguinis, H., Werner, S., Abbott, J. L., Angert, C., Park, J. H., & Kohlhausen, D. (2010). Customer-centric science: Reporting research results with rigor, relevance, and practical impact in mind. Organizational Research Methods, 13, 515–539.CrossRefGoogle Scholar
  2. Azen, R., & Budescu, D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129–148.CrossRefPubMedGoogle Scholar
  3. Azen, R., & Budescu, D. V. (2006). Comparing predictors in multivariate regression models: an extension of dominance analysis. Journal of Educational and Behavioral Statistics, 31, 157–180.CrossRefGoogle Scholar
  4. Azen, R., & Traxel, N. M. (2009). Using dominance analysis to determine predictor importance in logistic regression. Journal of Educational and Behavioral Statistics, 34, 319–347.CrossRefGoogle Scholar
  5. Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542–551.CrossRefGoogle Scholar
  6. Budescu, D. V., & Azen, R. (2004). Beyond global measures of relative importance: Some insights from dominance analysis. Organizational Research Methods, 7(3), 341–350.CrossRefGoogle Scholar
  7. Cortina, J. M., & Landis, R. S. (2009). When small effect sizes tell a big story, and when large effect sizes don’t. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 287–308). New York: Routledge.Google Scholar
  8. Courville, T., & Thompson, B. (2001). Use of structure coefficients in published multiple regression articles: β is not enough. Educational and Psychological Measurement, 61, 229–248.Google Scholar
  9. Darlington, R. B. (1968). Multiple regression in psychological research and practice. Psychological Bulletin, 69, 161–182.CrossRefPubMedGoogle Scholar
  10. Fabbris, L. (1980). Measures of predictor variable importance in multiple regression: An additional suggestion. Quality & Quantity, 4, 787–792.CrossRefGoogle Scholar
  11. Hocking, R. R. (1976). The analysis and selection of variables in linear regression. Biometrics, 32, 1–49.CrossRefGoogle Scholar
  12. Johnson, J. W. (2000). A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1–19.CrossRefGoogle Scholar
  13. Johnson, J. W. (2004). Factors affecting relative weights: The influence of sampling and measurement error. Organizational Research Methods, 7, 283–299.CrossRefGoogle Scholar
  14. Johnson, J. W., & LeBreton, J. M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238–257.CrossRefGoogle Scholar
  15. Krasikova, D., LeBreton, J. M., & Tonidandel, S. (2011). Estimating the relative importance of variables in multiple regression models. In G. P. Hodgkinson & J. K. Ford (Eds.), International review of industrial and organizational psychology. Indianapolis, IN: Wiley.Google Scholar
  16. LeBreton, J. M., Hargis, M. B., Griepentrog, B., Oswald, F. L., & Ployhart, R. E. (2007). A multidimensional approach for evaluating variables in organizational research and practice. Personnel Psychology, 60, 475–498.CrossRefGoogle Scholar
  17. LeBreton, J. M., Ployhart, R. E., & Ladd, R. T. (2004). A Monte Carlo comparison of relative importance methodologies. Organizational Research Methods, 7, 258–282.CrossRefGoogle Scholar
  18. LeBreton, J. M., & Tonidandel, S. (2008). Multivariate relative importance: Extending relative weight analysis to multivariate criterion spaces. Journal of Applied Psychology, 93, 329–345.CrossRefPubMedGoogle Scholar
  19. LeBreton, J. M. & Tonidandel, S. (2009, April). Estimating relative importance of interactive and other higher-order effects. Paper presented at the 24th annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.Google Scholar
  20. Martell, R. F., Lane, D. M., & Emrich, C. (1996). Male-female differences: A computer simulation. American Psychologist, 51, 157–158.CrossRefGoogle Scholar
  21. Miller, A. J. (1990). Subset selection in regression. London: Chapman & Hall.Google Scholar
  22. O’Boyle, E. H., Jr., Humphrey, R. H., Pollack, J. M., Hawver, T. H., & Story, P. A. (2010). The relation between emotional intelligence and job performance: A meta-analysis. Journal of Organizational Behavior. doi:10.1002/job.714.
  23. Thall, P. F., Russell, K. E., & Simon, R. M. (1997). Variable selection in regression via repeated data splitting. Journal of Computational and Graphical Statistics, 6, 416–434.CrossRefGoogle Scholar
  24. Tonidandel, S., & LeBreton, J. M. (2010). Determining the relative importance of predictors in logistic regression: An extension of relative weights analysis. Organizational Research Methods, 13, 767–781.CrossRefGoogle Scholar
  25. Tonidandel, S., LeBreton, J. M., & Johnson, J. W. (2009). Determining the statistical significance of relative weights. Psychological Methods, 14, 387–399.CrossRefPubMedGoogle Scholar
  26. Tonidandel, S., LeBreton, J., & Perkins, J. (2006). Applying relative importance to multivariate analysis of variance. In J. Cortina (Chair), Devoting rashly something as holy, ye must then reconsider: Revisiting methodological sacred cows. Symposium conducted at the 21st Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas, Texas.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.Davidson CollegeDavidsonUSA
  2. 2.Purdue UniversityWest LafayetteUSA

Personalised recommendations