Abstract
In this paper, the analysis and test of ipsative data will be discussed, and some alternative methods will be suggested. Following a review of the literature about ipsative measurement, the Competing Values Framework will be presented as a major application in the field of organizational culture and values. An alternative approach for the intra-individual analysis and test of ipsative data will be suggested, which consists of: (i) a method that uses closed part-wise geometric means as a descriptive statistic; (ii) a nonparametric bootstrap test to create confidence intervals; and (iii) a permutation test to evaluate equivalence between ipsative scores. All suggested methods satisfy the three basic statistical requirements for the analysis of ipsative data, that is: scale invariance, permutation invariance, and subcompositional coherence. Our suggested approach can correctly compute and compare organizational culture profiles within the same organization, as will be demonstrated with an example. However, the problem of drawing inter-organizational contrasts in ipsative measurement still remains unsolved. Also, our alternative approach only allows for a relative interpretation of the results.
Similar content being viewed by others
References
Aitchison, J.: The statistical analysis of compositional data (with discussion). J. R. Stat. Soc. B 44(2), 139–177 (1982)
Aitchison, J.: The Statistical Analysis of Compositional Data. Chapman & Hall, London (1986)
Aitchison, J.: On criteria for measures of compositional difference. J. Math. Geol. 24(4), 365–379 (1992)
Aitchison, J.: The one-hour course in compositional data analysis or compositional data analysis is simple. In: Pawlowsky-Glahn, V. (ed.) Proceedings of IAMG’97: The Third Annual Conference of the International Association for Mathematical Geology, pp. 3–35. International Center for Numerical Methods in Engineering (CIMNE), Barcelona (1997)
Aitchison, J.: Postscript: a concise guide to developments in compositional data analysis since 1986. In: Aitchison, J. (ed.) The Statistical Analysis of Compositional Data, 2nd edn, pp. 1–20. The Blackburn Press, Caldwell (2003)
Allport, G.W.: The functional autonomy of motives. Am. J. Psych. 50, 141–156 (1937)
Alwin, D.F., Krosnick, J.A.: The measurement of values in surveys: a comparison of ratings and rankings. Public Opin. Quat. 49(4), 535–552 (1985)
Anderson, S.B., Ball, S., Murphy, R.T.: Concepts and techniques for evaluating education and training programs. Encyclopedia of Educational Evaluation. Jossey-Bass, San Francisco (1975)
Baron, H.: Strengths and limitations of ipsative measurement. J. Occup. Organ. Psychol. 69(1), 49–56 (1996)
Bartram, D.: The relationship between ipsatized and normative measures of personality. J. Occup. Organ. Psychol. 69(1), 25–39 (1996)
Bartram, D.: Increasing validity with forced-choice criterion measurement formats. Int. J. Sel. Assess. 15(3), 263–272 (2007)
Baumgartner, H., Steenkamp, J.-B.E.M.: Response styles in marketing research: A cross-national investigation. J. Mark. Res. 38(2), 143–156 (2001)
Berkshire, J.R., Highland, R.W.: Forced-choice performance rating: A methodological study. Pers. Psychol. 6(3), 355–378 (1953)
Berrio, A.A.: An organizational culture assessment using the competing values framework: a profile of Ohio State University extension. J. Ext. 41(2), 1–15 (2003)
Billheimer, D., Guttorp, P., Fagan, W.: Statistical interpretation of species composition. J. Am. Stat. Assoc. 96(456), 1205–1214 (2001)
Bowen, C.-C., Martin, B.A., Hunt, S.T.: A comparison of ipsative and normative approaches for ability to control faking in personality questionnaires. Int. J. Organ. Anal. 10(3), 240–259 (2002)
Braunscheidel, M.J., Suresh, N.C., Boisnier, A.D.: Investigating the impact of organizational culture on supply chain integration. Hum. Resour. Manag. 49(5), 883–911 (2010)
Brown, A., Bartram, D.: Development and Psychometric Properties of OPQ32r: Supplement to the OPQ32 Technical Manual. SHL Group, Thames Ditton, Surrey (1999)
Brown, A., Bartram, D.: Doing less but getting more: Improving forced-choice measures with IRT. Paper presented at the 24th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA (2009).
Buccianti, A., Mateu-Figueras, G., Pawlowski-Glahn, V.: Compositional Data Analysis in the Geosciences: From Theory to Practice, p. 264. The Geological Society Publishing House, Bath (2006)
Butler, A., Bierman, S., Marion, G.: Compositional Data Module: Statistical Methods for Environmental Risk Assessment. The University of Edinburgh, Biomathematics and Statistics Scotland, Edinburgh (2005)
Callis, R., Engram, W.C., McGowan, J.F.: Coding the Kuder preference record–vocational. J. Appl. Psychol. 38(5), 359–363 (1954)
Cameron, K.S.: Measuring organizational effectiveness in institutions of higher education. Adm. Sci. Quat. 23(4), 604–632 (1978)
Cameron, K.S.: A process for changing organizational culture. The University of Michigan Business School, Ann Arbor. http://competingvalues.com/competingvalues.com/wp-content/uploads/2009/07/A-Process-for-Changing-Organizational-Culture.pdf (2004). Accessed 23 January 2014
Cameron, K.S.: An Introduction to the Competing Values Framework. Haworth Organizational Culture White Paper, Englewood (2009)
Cameron, K.S., Quinn, R.E.: Diagnosing and Changing Organizational Culture: Based on the Competing Values Framework. Addison-Wesley, Reading (1999)
Cameron, K.S., Quinn, R.E.: Diagnosing and Changing Organizational Culture: Based on the Competing Values Framework. Jossey-Bass, San Francisco (2006)
Cameron, K.S., Quinn, R.E.: Diagnosing and Changing Organizational Culture: Based on the Competing Values Framework, 3rd edn. Jossey-Bass, San Francisco (2011)
Campbell, D.P.: Occupations 10 years later of high school seniors with high scores on the SVIB life insurance salesman scale. J. Appl. Psychol. 50(5), 369–372 (1966)
Campbell, J.P.: On the nature of organizational effectiveness. In: Goodman, P.S., Pennings, J.M. (eds.) New Perspectives on Organizational Effectiveness, pp. 13–55. Jossey-Bass, San Francisco (1977)
Cattell, R.B.: Psychological measurement: ipsative, normative, and interactive. Psychol. Rev. 51(5), 293–303 (1944)
Çeliksöz, N.E., van Eijnatten, F.M., Holloway, S.S.: NPC Values Survey: Baseline Measures Results. Confidential Research Report for the Company. Eindhoven University of Technology, Eindhoven (2010)
Chan, A.: Corporate culture as a clan organization. Manag. Decis. 35(2), 94–99 (1997)
Chan, W.: Analyzing ipsative data in psychological research. Behav. Metr. 30(1), 99–121 (2003)
Chan, W., Bentler, P.M.: The covariance structure analysis of ipsative data. Sociol. Methods Res. 22(2), 214–247 (1993)
Chan, W., Bentler, P.M.: Covariance structure analysis of partially additive ipsative data using restricted maximum likelyhood estimation. Multivar. Behav. Sci. 31(3), 289–312 (1996)
Chan, W., Bentler, P.M.: Covariance structure analysis of ordinal ipsative data. Psychometrika 63(4), 369–399 (1998)
Cheung, M.W.L.: A direct estimation method on analyzing ipsative data with Chan and Bentler’s (1993) method. Struct. Equ. Model 11(2), 217–243 (2004)
Cheung, M.W.L.: Recovering pre-ipsative information from additive ipsatized data: A factor score approach. Educ. Psychol. Meas. 66(4), 565–588 (2006)
Cheung, M.W.L., Chan, W.: Reducing uniform response bias with ipsative measurement in multiple group confirmatory factor analysis. Struct. Equ. Model 9(1), 55–77 (2002)
Christiansen, N., Burns, G.N., Montgomery, G.E.: Reconsidering forced-choice item formats for applicant personality assessment. Hum. Perform. 18(3), 267–307 (2005)
Clemans, W.V.: An Analytical and Empirical Examination of Some Properties of Ipsative Measures. Psychometric Monograph No. 14. Psychometric Society, Richmond (1966)
Closs, S.J.: Ipsative versus normative interpretation of test scores, or “what do you mean by like? Bull. Br. Psychol. Soc. 29(3), 289–299 (1976)
Closs, S.J.: On the factoring and interpretation of ipsative data. J. Occup. Organ. Psychol. 69(1), 41–47 (1996)
Cornwell, J.M., Dunlap, W.P.: On the questionable soundness of factoring ipsative data: a response to Saville & Willson (1991). J. Occup. Organ. Psychol. 67(2), 89–100 (1994)
Cunningham, W.H., Cunningham, I.C.M., Green, R.T.: The ipsative process to reduce response set bias. Public Opin. Quat. 41(3), 379–384 (1977)
Denison, D.R., Mishra, A.K.: Toward a theory of organizational culture and effectiveness. Organ. Sci. 6(2), 204–223 (1995)
Dunlap, W.P., Cornwell, J.M.: Factor analysis of ipsative measures. Multivar. Behav. Res. 29(1), 115–126 (1994)
Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman & Hall, New York (1993)
Egozcue, J.J., Pawlowsky-Glahn, V., Mateu-Figueras, G., Barceló-Vidal, C.: Isometric logratio transformations for compositional data analysis. J. Math. Geol. 35(3), 279–300 (2003)
Fedorak, S., Coles, E.M.: Ipsative vs normative interpretation of test scores. A comment to Allen & Foreman’s (1976) norms on Edwards Personal Preference Schedule for female Australian therapy students. Percept. Mot. Skills 48(3), 919–922 (1979)
Fisher, R.A.: The Design of Experiments. Hafner, New York (1966)
Gaylin, N.L.: Ipsative measures: In search of paradigmatic change and a science of subjectivity. Person-Cent. Rev. 4(4), 429–445 (1989)
Globalpark: Enterprise Feedback Suite (EFS) Survey. http://globalpark.com; http://www.questback.co.uk/solutions/online-research/online-survey.html (2010). Accessed 23 January 2014
Gordon, L.V.: Validities of the forced-choice and questionnaire methods of personality measurement. J. Appl. Psychol. 35(6), 407–412 (1951)
Greenacre, M.: Measuring subcompositional incoherence. Math. Geosci. 43(6), 681–693 (2011)
Guilford, J.P.: When not to factor analyze. Psychol. Bull. 49(1), 26–37 (1952)
Gurwitz, P.M.: Ipsative rescaling: An answer to the response set problem in segmentation analysis. J. Advert. Res. 27(3), 37–42 (1987)
Hartnell, C.A., Ou, A.Y., Kinicki, A.: Organizational culture and organizational effectiveness: a meta-analytic investigation of the competing values framework’s theoretical suppositions. J. Appl. Psychol. 96(4), 677–694 (2011)
Helfrich, C.D., Li, Y.-F., Mohr, D.C., Meterko, M., Sales, A.E.: Assessing an organizational culture instrument based on the competing values framework: exploratory and confirmatory factor analyses. Implement. Sci. 2(1), 13 (2007)
Hicks, L.E.: Some properties of ipsative, normative and forced-choice normative measures. Psychol. Bull. 74(3), 167–184 (1970)
Horst, P.: Factor Analysis of Data Matrices. Holt, Rinehart & Winston, New York (1965)
Howard, L.W.: Validating the competing values model as a representation of organizational cultures. Int. J. Organ. Anal. 6(3), 231–250 (1998)
Igo, T., Skitmore, M.: Diagnosing the organizational culture of an Australian engineering consultancy using the competing values framework. Constr. Innov. 6(2), 121–139 (2006)
Jackson, D.J., Alwin, D.F.: The factor analysis of ipsative measures. Sociol. Methods Res. 9(2), 218–238 (1980)
Johnson, C.E., Wood, R., Blinkhorn, S.F.: Spuriouser and spuriouser: The use of ipsative personality tests. J. Occup. Psychol. 61(2), 153–162 (1988)
Kaarst-Brown, M.L., Nicholson, S., Von Dran, G.M., Stanton, J.M.: Organizational cultures of libraries as a strategic resource. Libr. Trends 53(1), 33–53 (2004)
Kalliath, T.J., Bluedorn, A.C., Gillespie, D.F.: Confirmatory factor analysis of the competing values instrument. Educ. Psychol. Meas. 59(1), 143–158 (1999)
Kamakura, W.A., Mazzon, J.A.: Values segmentation: a model for the measurement of values and value systems. J. Consum. Res. 18(9), 208–218 (1991)
Kolb, D.A.: On management and the learning process. Calif. Manag. Rev. 18(3), 21–31 (1976)
Kolb, D.A.: Experiential Learning: Experience as the Source of Learning and Development. Prentice-Hall, Englewood Cliffs (1984)
Kolb, A.Y., Kolb, D.A.: The Kolb Learning Style Inventory - Version 3.1: 2005 Technical Specifications. Haygroup: Experience Based Learning Systems Inc., Boston (2005)
Kwam, P., Walker, A.: Validating the competing values model as a representation of organizational culture through inter-institutional comparisons. Organ. Anal. 12(1), 21–37 (2004)
Lamond, D.: The value of Quinn’s competing values model in an Australian context. J. Manag. Psychol. 18(1/2), 46–59 (2003)
Loo, R.: Issues in factor-analyzing ipsative measures: The learning style inventory (LSI-1985) example. J. Bus. Psychol. 14(1), 149–154 (1999)
Marston, W.M.: Emotions of Normal People. Taylor & Francis, Routledge (1999). (1999 re-issued; original work published in 1928)
Martín-Fernandez, J.A., Barceló-Vidal, C., Pawlowsky-Glahn, V.: Dealing with zeros and missing values in compositional data sets using nonparametric imputation. Math. Geol. 35(3), 253–278 (2003)
Martinussen, M., Richardsen, A.M., Vårum, H.W.: Validation of an ipsative personality measure (DISCUS). Scand. J. Psychol. 42(5), 411–416 (2001)
Massy, W.F., Lodahl, T.M., Frank, R.E.: Colinearity in the Edwards personal preference schedule. J. Appl. Psychol. 50(2), 121–124 (1966)
Matthews, G., Oddy, K.: Ipsative and normative scales in adjectival measurement of personality: problems of bias and discrepancy. Int. J. Sel. Assess. 5(3), 169–182 (1997)
McCarty, J.A., Shrum, J.: The measurement of personal values in survey research: a test of alternative rating procedures. Public Opin. Quat. 64(3), 271–298 (2000)
McClean, J.E., Chissom, B.S.: Multivariate analysis of Ipsative Data: Problems and Solutions. Paper presented at the Annual Meeting of the Mid-South Educational Research Association, Memphis (1986).
Meade, A.W.: Psychometric problems and issues involved with creating and using ipsative measures for selection. J. Occup. Organ. Psychol. 77(4), 531–552 (2004)
Meglino, B.M., Ravlin, E.C.: Individual values in organizations: concepts, controversies, and research. J. Manag. 24(3), 351–389 (1998)
Mintzberg, H.: Structure in Fives: Designing Effective Organizations. Prentice Hall, Englewood Cliffs (1983)
Odén, A., Wedel, H.: Arguments for Fisher’s permutation test. Ann. Stat. 3(2), 518–520 (1975)
Oney-Yazic, E., Arditi, D., Uwakweh, B.O.: Organizational Culture in US Construction Companies. Paper presented at the Joint International Conference on Construction, Culture, Innovation and Management (CCIM), November 26–29, Dubai (2006).
Ouchi, W.G.: A conceptual framework for the design of organizational control mechanisms. Manag. Sci. 25(9), 833–848 (1979)
Ouchi, W.G.: Theory Z: How American Business Can Meet the Japanese Challenge. Addison-Wesley, Reading (1981)
Ouchi, W.G.: The M-form society: Lessons from business management. Hum. Resour. Manag. 23(2), 191–213 (1984)
Pawlowsky-Glahn, V., Egozcue, J.J., Tolosana-Delgado, R.: Lecture Notes on Compositional-Data Analysis. Unpublished manuscript, http://dugi-doc.udg.edu/bitstream/10256/297/1/CoDa-book.pdf (2007). Accessed 23 January 2014
Plotkin Group: Measuring people’s full potential: Ipsative versus normative. Yardstick 13(3), 1 (2007)
Quinn, R.E.: Beyond Rational Management: Mastering the Paradoxes and Competing Demands of High Performance. Jossey-Bass, San Francisco (1988)
Quinn, R.E., Cameron, K.S.: Organizational life cycles and shifting criteria of effectiveness: some preliminary evidence. Manag. Sci. 29(1), 33–51 (1983)
Quinn, R.E., Kimberly, J.R.: Paradox, planning and perseverance: Guidelines for managerial practice. In: Kimberly, J.R., Quinn, R.E. (eds.) Managing Organizational Transitions, pp. 295–313. Dow Jones-Irwin, Homewood (1984)
Quinn, R.E., Rohrbaugh, J.: A competing values approach to organizational effectiveness. Public Product. Rev. 5(2), 122–140 (1981)
Quinn, R.E., Rohrbaugh, J.: A spatial model of effectiveness criteria: towards a competing values approach to organizational analysis. Manag. Sci. 29(3), 363–377 (1983)
Quinn, R.E., Spreitzer, G.M.: The psychometrics of the competing values culture instrument and an analysis of the impact of organizational culture on quality of life. In: R. Woodman, R., Pasmore, W. (eds.) Research in Organizational Change and Development, vol. 5, pp. 115–142. JAI Press, Greenwich (1991).
R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/ (2007). Accessed 23 January 2014
Ralston, D.A., Terpstra-Tong, J., Terpstra, R.H., Wang, X., Egri, C.: Today’s state-owned enterprises of China: are they dying dinosaurs or dynamic dynamos? Strateg. Manag. J. 27(9), 825–843 (2006)
Rhee, Y., Moon, B.: Organizational culture and strategic communication practice: Testing the competing values model (CVM) and employee communication strategies (ECS) model in Korea. Int. J. Strateg. Commun. 3(1), 52–67 (2009)
Rinkevics, K., Torkar, R.: Equality in cumulative voting: a systematic review and an improvement proposal. Inf. Softw. Technol. 55(2), 267–287 (2013)
Rokeach, M.: Beliefs, Attitudes and Values. Jossey-Bass, San Francisco (1970)
Saville, P., Willson, E.: The reliability and validity of normative and ipsative approaches in the measurement of personality. J. Occup. Organ. Psychol. 64(3), 219–238 (1991)
Schepers, P., van den Berg, P.T.: Social factors of work-environment creativity. J. Bus. Psychol. 21(3), 407–428 (2007)
Sharon, A.T.: Eliminating bias from student ratings of college instructors. J. Appl. Psychol. 54(3), 278–281 (1970)
Sisson, E.D.: Forced-choice: the new army rating. Pers. Psychol. 1(3), 365–381 (1948)
Sousa-Poza, A., Nystrom, H., Wiebe, H.: A cross-cultural study of the differing effects of corporate culture on TQM in three countries. Int. J. Qual. Reliab. Manag. 18(7), 744–761 (2001)
Stanton, J.M.: Organizational cultures of libraries as a strategic resource. Libr. Trends 53(1), 33–53 (2004)
Steenkamp, J.-B.E.M., Baumgartner, H.: Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 25(1), 78–90 (1998)
Steenkamp, J.-B., Allenby, G., Gupta, S., Verducci, J.: Methodological and statistical concerns of the experimental behavioral researcher. J. Consum. Psychol. 10(1/2), 41–43 (2001)
Stephenson, W.: Correlating persons instead of tests. Character Personal. 4(1), 17–24 (1935)
Strong Jr, E.K.: Predictive value of the Vocational Interest Test. J. Educ. Psychol. 26, 332 (1935)
Talbot, C.: Measuring Public Value: A Competing Values Approach. Manchester Business School, Herbert Simon Institute, Manchester, Report for The Work Foundation (2008)
Tatsuoka, M.M.: Multivariate Analysis: Techniques for Educational and Psychological Research. Wiley, New York (1971)
Übius, Ü., Alas, R.: Organizational culture types as predictors of corporate social responsibility. Eng. Econ. 61(1), 90–99 (2009)
Unipark: The Academic Program of Questback, http://www.unipark.com/64-1-about-unipark.htm (2013). Accessed 23 January 2014
Van den Boogaart, K.G.: Using the R Package Compositions, version 0.9.1. http://www.stat.boogaart.de/compositions/ (2005). Accessed 23 January 2014
Van den Boogaart, K.G., Tolosana-Delgado, R.: Compositions: a unified R package to analyze compositional data. Comput. Geosci. 34(4), 320–338 (2008)
Van den Boogaart, K.G., Tolosana-Delgado, R., Bren, M.: Package Compositions, Version 1.30-2. The Comprehensive R Archive Network (CRAN) Repository. http://cran.r-project.org/web/packages/compositions/compositions.pdf (2013). Accessed 23 January 2014
Van Leeuwen, D.M., Mandabach, K.H.: A note on the reliability of ranked items. Sociol. Methods Res. 31(1), 87–105 (2002)
Varner, C.H.: An Examination of an Academic Library CultureUusing a Competing Values Framework. Unpublished PhD Thesis, Dissertation, Illinois State University, Normal. Abstracts International, 58, 01A, UMI No. 0014 (1996).
Vries, A.L.M. de: The Merit of Ipsative Measurement: Second Thoughts and Minute Doubts. Ph.D. Thesis, Maastricht University, Maastricht (2007).
Weber, M.: The Theory of Social and Economic Organization. Oxford University Press, Oxford (1947). translated by A. M. Henderson and T. Parsons
Welch, W.J.: Construction of permutation tests. J. Am. Stat. Assoc. 85(411), 693–698 (1990)
Wilkins, A.L., Ouchi, W.G.: Efficient cultures: exploring the relationship between culture and organizational performance. Adm. Sci. Quat. 28(3), 468–481 (1983)
Williamson, O.E.: Markets and Hierarchies: Analysis and Antitrust Implications. Free Press, New York (1975)
Yu, T., Wu, N.: A review of study on the competing values framework. Int. J. Bus. Manag. 4(7), 37–42 (2009)
Zammuto, R.F.: Organizational adaptation: Some implications of organizational ecology for strategic choice. J. Manag. Stud. 25(2), 105–120 (1988)
Zammuto, R.F., Krakower, J.Y.: Quantitative and qualitative studies of organizational culture. In: Woodman, R., Pasmore, W. (eds.) Research in Organizational Change and Development, vol. 5, pp. 83–114. JAI Press, Greenwich (1991)
Zammuto, R.F., O’Connor, E.J.: Gaining advanced manufacturing technologies’ benefits: The roles of organizational design and culture. Acad. Manag. Rev. 17(4), 701–728 (1992)
Acknowledgments
The authors would like to thank Dr. Lieuwe Dijkstra, Naki Eray Çeliksöz, and Odinga Nimako for their participation or support in the empirical research that was used as an illustration in this paper, or for their help with the initial analyses of the data. Also, the authors are very much grateful for the suggestions of the anonimous reviewers.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
van Eijnatten, F.M., van der Ark, L.A. & Holloway, S.S. Ipsative measurement and the analysis of organizational values: an alternative approach for data analysis. Qual Quant 49, 559–579 (2015). https://doi.org/10.1007/s11135-014-0009-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-014-0009-8