Skip to main content

Overly ambitious critics and the Medici Effect: a reply to Kampen and Tamás

Quality & Quantity volume 49, pages 523–537 (2015)Cite this article

Abstract

The critical audit of Q methodology by Kampen and Tamás contains many errors of fact and understanding—indeed, a resistance to understanding that is compared to the Medicis’ stance toward Galileo. Following a brief historical summary of similar ill-advised critiques of Q methodology in the 80 years since its introduction, responses are presented to various of the points raised: on the nature of subjectivity, the universe of subjective communicability (concourse) and samples drawn from it, the role of factor analysis and factor interpretation, the forced Q-sort distribution, the ratio between the number of participants and the number of statements in the Q sample, and sources of researcher bias.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Notes

  1. We would be remiss were we not to mention two other Q journals (Journal of Human Subjectivity and Q-Methodology and Theory, the latter in Korean) as well as several other books on Q technique and its methodology—-by Block (2008), Iliescu (2005), Khoshgooyanfard (2008), Kim (2008), Kim (2007), McKeown and Thomas (2013), Prasith-rathsint and Sookasame (2007), Said and Stricklin (2013), Thorsen and Allgood (2010) and Watts and Stenner (2012)—-of which Kampen and Tamás are apparently unaware, as they apparently also are of the 60 chapters and dozen encyclopedia entries on Q methodology (e.g., Brown and Good 2010, Smith 2001, pp. 319–343 ), not to mention the more than 50 books that utilize Q (e.g., Kanra 2009).

  2. A search in SCOPUS using the search string TITLE-ABS-KEY(Q-method OR Q-sort OR Q-methodology OR Q-methodological OR “Q method” OR “Q sort” OR “Q methodology” OR “Q methodological”) identified 1,922 articles. The number of published articles increased from an average of 10 per year in the years up to 1990, to 35 in the years 1991–2000, and 92 in the years 2001–2013. These articles were published in source titles from the life sciences, health sciences, physical sciences, and social sciences and humanities, with psychology (21.8 %), medicine (19.4 %), and social sciences (15.3 %) as the principal subject areas.

  3. In September 2013, the 29th annual Q conference was held in Kampen and Tamás’s country of residence, the Netherlands (see http://qmethod.org/), offering them an easy opportunity to share and discuss their concerns with the international Q community (among attendants, scholars from 12 universities and research organizations in the Netherlands).

  4. Unknown to one another, Danielson and Brown were reviewers of two separate earlier versions and rendered critical commentary that Kampen and Tamás have apparently elected not to take into account.

  5. By our count, Kampen and Tamás’s search procedure missed at least 30 Q publications appearing in 2010 (10 of them in an edited book on Q methodology) and that were announced on the Q-Method electronic discussion list, which has a subscribership of more than 800 scholars (but not Kampen or Tamás).

  6. We have never before encountered this argument and have no idea where Kampen and Tamás got it, but it is important to note that the data of Q methodology are not responses to individual statements alone, but more importantly in their relationships, as when they are rank-ordered (as in Q sorting). In this connection, Brown (1980, pp. 265–267) has shown that for \(N\) \(=\) 33 statements (which is below average in size), there were more than 44 trillion different Q sorts possible, or more than 6,000 times as many different Q sorts as there are humans on Earth. Not all of these different ways are uncorrelated, of course, but the numbers do seem to leave enough maneuvering room for the usual study, which typically employs fewer than 50 participants.

  7. Pett et al. (2003, pp. 47–48) state that there is no empirical evidence on the ratio of number of subjects to number of items that is required for undertaking factor analysis and that little agreement exists among authorities in factor analysis about rules of thumb to be used.

  8. Kampen and Tamás elect not to examine Q methodology’s parallels to quantum theory (Sect. 1), which is a pity since their implicit commitment to a Newtonian conception of science (as was the case with Wittenborn before them) goes some distance in explaining their inability to achieve a substantial grasp of Q methodology. A glimpse into Q’s quantum connection can be gotten by examining the series on “William James, Niels Bohr, and Complementarity,” beginning with Stephenson ’s (1986) first of five articles in Psychological Record.

References

  • Baker, R., van Exel, J., Mason, H., Stricklin, M.: Connecting Q and surveys: a test of three methods to explore factor membership in a large sample. Operant. Subject. 34, 38–58 (2010)

    Google Scholar 

  • Baker, R., Wildman, J., Mason, H., Donaldson, C.: Q-ing for health–a new approach to eliciting the public’s views on health care resource allocation. Health Econ. 23, 283–297 (2014)

    Google Scholar 

  • Billard, S.: How Q methodology can be democratized. Fem. Psychol. 9, 357–366 (1999)

    Article  Google Scholar 

  • Block, J.: The Q-Sort Method in Personality Assessment and Psychiatric Research. Thomas, Springfield (1961)

    Book  Google Scholar 

  • Block, J.: The Q-Sort in Character Appraisal: Encoding Subjective Impressions of Persons Quantitatively. American Psychological Association, Washington (2008)

    Book  Google Scholar 

  • Bolland, J.M.: The search for structure: an alternative to the forced Q-sort technique. Polit. Methodol. 11(1–2), 91–107 (1985)

    Google Scholar 

  • Brown, H.I.: Galileo on the telescope and the eye. J. Hist. Ideas 46, 487–501 (1985)

    Article  Google Scholar 

  • Brown, S.R.: Political Subjectivity: Applications of Q Methodology in Political Science. Yale University Press, New Haven (1980)

    Google Scholar 

  • Brown, S.R.: Q methodology and naturalistic subjectivity. In: Midgley, B.D., Morris, E.K. (eds.) Modern Perspectives on J.R. Kantor and Interbehaviorism, pp. 251–268. Context Press, Reno (2006)

    Google Scholar 

  • Brown, S.R., Good, J.M.M.: Q methodology. In: Salkind, N.J. (ed.) Encyclopedia of Research Design, vol. 3, pp. 1149–1155. Sage, Thousand Oaks (2010)

    Google Scholar 

  • Burt, C.L., Stephenson, W.: Alternative views on correlations between persons. Psychometrika 4, 269–281 (1939)

    Article  Google Scholar 

  • Cartwright, D.S.: A computational procedure for tau correlation. Psychometrika 22, 97–104 (1957)

    Article  Google Scholar 

  • Cattell, R.B.: On the disuse and misuse of P, Q, Qs and O techniques in clinical psychology. J. Clin. Psychol. 7, 203–214 (1951)

    Article  Google Scholar 

  • Conover, P.J., Feldman, S.: Group identification, values, and the nature of political beliefs. Am. Polit. Q. 12, 151–175 (1984)

    Article  Google Scholar 

  • Cragan, J.F., Shields, D.C.: The identifying characteristics of public fire safety educators: an empirical analysis. In: Cragan, J.F., Shields, D.C. (eds.) Applied Communication Research: A Dramatistic Approach, pp. 219–234. Waveland, Prospect Heights (1981)

    Google Scholar 

  • Cronbach, L.J., Gleser, G.C.: Review of the study of behavior: Q-technique and its methodology, by W. Stephenson. Psychometrika 19, 327–330 (1954)

    Article  Google Scholar 

  • Cuppen, E., Breukers, S., Hisschemöller, M., Bergsma, E.: Q methodology to select participants for a stakeholder dialogue on energy options from biomass in the Netherlands. Ecol. Econ. 69, 579–591 (2010)

    Article  Google Scholar 

  • Danielson, S.: Q method and surveys: three ways to combine Q and R. Field Methods 21, 219–237 (2009)

    Article  Google Scholar 

  • De Graaf, G., van Exel, J.: Using Q-methodology in administrative ethics. Public Integr. 11, 63–78 (2009)

    Article  Google Scholar 

  • Garrard, J., Hausman, W.: The priority sort: an empirical approach to program planning and evaluation. Am. J. Soc. Psychiatry, 5(5), 29–36 (1985). [Reprinted. In: D.S. Cordray M.W. Lipsey (eds.): Evaluation Studies Review Annual, vol. 11, pp. 279–286. Sage, Beverly Hills (1986)].

    Google Scholar 

  • Gould, P.: A new Q too? Operant Subject. 8, 42–53 (1985)

    Google Scholar 

  • Howard, L.W.: Quest-sort: a paper-and-pencil alternative to card-sorting Q samples. Operant Subject. 19, 12–22 (1995–1996)

    Google Scholar 

  • Iliescu, D.: Metodologia Q. Communicare.ro, Budapest (2005). [Romanian]

    Google Scholar 

  • Jackson, D.M., Bidwell, C.E.: A modification of Q-technique. Educ. Psychol. Meas. 19, 221–232 (1959)

    Article  Google Scholar 

  • Jedeloo, S., van Staa, A., Latour, J.M., van Exel, N.J.A.: Preferences for health care and self-management among Dutch adolescents with chronic conditions: A Q-methodological investigation. Int. J. Nurs. Stud. 47, 593–603 (2010)

    Article  Google Scholar 

  • Johnson, R.M.: Q analysis of large samples. J. Mark. Res. 7, 104–105 (1970)

    Article  Google Scholar 

  • Kampen, J., Tamás, P.: Overly ambitious: contributions and current status of Q methodology. Qual. Quan. (2014). doi:10.1007/s11135-013-9944-z

  • Kanra, B.: Islam, Democracy and Dialogue in Turkey: Deliberating in Divided Societies. Ashgate, Farnham (2009)

    Google Scholar 

  • Khoshgooyanfard, A.R.: Q-methodology. Research Center of IRIB (Islamic Republic of Iran Broadcasting) Publication, Tehran (2008). [Persian]

    Google Scholar 

  • Killam, L.A., Montgomery, P., Luhanga, F.L., Adamic, P., Carter, L.M.: Views on unsafe nursing students in clinical learning. Int. J. Nurs. Educ. Scholarsh. 7(1), article 36 (2010)

    Google Scholar 

  • Kim, H.K.: Q Methodology: Philosophy of Science, Theories, Analysis, and Application. CommunicationBooks, Seoul (2008). [Korean]

    Google Scholar 

  • Kim, S.E.: Q Methodology and Social Sciences. Goldwell, Busan (2007). [Korean]

    Google Scholar 

  • Kitzinger, C.: The Social Construction of Lesbianism (Inquiries in Social Construction series). Sage, London (1987)

    Google Scholar 

  • Loevinger, J.: Person and population as psychometric concepts. Psychol. Rev. 72, 143–155 (1965)

    Article  Google Scholar 

  • McKeown, B.F., Thomas, D.B.: Q methodology (Quantitative Applications in the Social Sciences Series), vol. 66, 2nd edn. Sage, Thousand Oaks (2013)

    Google Scholar 

  • Mowrer, O.H.: “Q-technique”–description, history, and critique. In: Mowrer, O.H. (ed.) Psychotherapy, pp. 316–375. Ronald, New York (1953)

    Google Scholar 

  • Nahinsky, I.E.: A Q sort analysis of variance involving the dimensions of sorts, groups, and items. J. Exp. Educ. 35(3), 36–41 (1967)

    Article  Google Scholar 

  • Neff, W.S., Cohen, J.: A method for the analysis of the structure and internal consistency of Q-sort arrays. Psychol. Bull. 68, 361–368 (1967)

    Article  Google Scholar 

  • Peterson, R.S., Owens, P.D., Martorana, P.V.: The group dynamics Q-sort in organizational research: a new method for studying familiar problems. Organ. Res. Methods 2, 107–139 (1999)

    Article  Google Scholar 

  • Pett, M.A., Lackey, N.R., Sullivan, J.J.: Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research. Sage, Thousand Oaks (2003)

    Google Scholar 

  • Phillips, E.L., Raiford, A., El-Batrawi, S.: The Q sort reevaluated. J. Consult. Psychol. 29, 422–425 (1965)

    Article  Google Scholar 

  • Prasith-rathsint, S., Sookasame, K.: Variety of Innovative Research Methods: Q Methodology: A Scientific Study of Subjectivity (Concepts, Theory and Application). Samlada, Bangkok (2007). [Thai]

    Google Scholar 

  • Sabini, J.B., Silver, M.: Some senses of subjective. In: Secord, P.F. (ed.) Explaining Human Behavior: Consciousness, Human Action and Social Structure, pp. 71–91. Sage, Beverly Hills (1982)

    Google Scholar 

  • Said, G., Stricklin, M. (eds.): In: Anais da 1\(^{o}\) conferencia internacional sobre metodologia Q: Analises qualitative e quantitative na pesquisa cientfica. EDUFPI, Teresina, Piauí, Brazil (2013)

  • Smith, N.W.: Current Systems in Psychology: History, Theory, Research, and Applications. Wadsworth/Thomson Learning, Belmont (2001)

    Google Scholar 

  • Stainton Rogers, W.: Explaining Health and Illness: An Exploration of Diversity. Harvester Wheatsheaf, Exeter (1991)

    Google Scholar 

  • Stenner, P. (Ed.) (2008–2009). Special Issue: Q and constructivism: Between discursive practice and subjective process. Operant Subjectivity, 32, entire issue.

  • Stephenson, W.: Technique of factor analysis. Nature 136, 297 (1935a)

    Article  Google Scholar 

  • Stephenson, W.: Correlating persons instead of tests. Character Pers. 4, 17–24 (1935b)

    Article  Google Scholar 

  • Stephenson, W.: The foundations of psychometry: four factor systems. Psychometrika 1, 195–209 (1936)

    Article  Google Scholar 

  • Stephenson, W.: A note on Professor R.B. Cattell’s methodological adumbrations. J. Clin. Psychol. 8, 206–207 (1952)

    Article  Google Scholar 

  • Stephenson, W.: The Study of Behavior: Q-Technique and Its Methodology. University of Chicago Press, Chicago (1953)

    Google Scholar 

  • Stephenson, W.: Comments on Cronbach and Gleser’s review of: The study of behavior: Q-technique and its methodology. Psychometrika 19, 331–333 (1954)

    Google Scholar 

  • Stephenson, W.: The Play Theory of Mass Communication. University of Chicago Press, Chicago (1967)

    Google Scholar 

  • Stephenson, W.: Concourse theory of communication. Communication 3, 21–40 (1978)

    Google Scholar 

  • Stephenson, W.: Against interpretation. Operant Subject. 6, 73–125 (1983)

    Google Scholar 

  • Stephenson, W.: William James, Niels Bohr, and complementarity: I-Concepts. Psychol. Record 36, 519–527 (1986)

    Google Scholar 

  • Sundland, D.M.: The construction of Q-sorts: a criticism. Psychol. Rev. 69, 62–64 (1962)

    Article  Google Scholar 

  • Thomas, D.B., Baas, L.R.: The issue of generalization in Q methodology: “Reliable schematics” revisited. Operant Subject. 16, 18–36 (1992–1993)

    Google Scholar 

  • Thompson, B., Frankiewicz, R.G., Ward, G.R.: Cross-technique validation of attitude measures. Operant Subject. 6, 37–50 (1983)

    Google Scholar 

  • Thorsen, A.A., Allgood, E. (eds.): [Q-Metodologi: En Velegnet Måte å utforske Subjektivitet.] Trondheim. Tapir Academic Press, Norway (2010)

  • Van Exel, N.J.A., de Graaf, G., Brouwer, W.B.F.: Give me a break! Associations between informal caregivers’ attitudes toward respite care and characteristics of caregivers, care recipients and the care giving situation. Health Policy 88, 73–87 (2008)

    Article  Google Scholar 

  • Vermaire, J.H., Hoogstraten, J., Van Loveren, C., Poorterman, J.H.G., Van Exel, N.J.A.: Attitudes towards oral health among parents of 6-year-old children at risk of developing caries. Community Dent. Oral Epidemiol. 38, 507–520 (2010)

    Article  Google Scholar 

  • Vogel, J., Lowham, E.: Building consensus for constructive action: a study of perspectives on natural resource management. J. For. 105, 20–26 (2007)

    Google Scholar 

  • Watts, S., Stenner, P.: Doing Q methodology: theory, method, and interpretation. Qual. Res. Psychol. 2, 67–91 (2005)

    Article  Google Scholar 

  • Watts, S., Stenner, P.: Doing Q Methodological Research: Theory, Method and Interpretation. Sage, Thousand Oaks (2012)

    Book  Google Scholar 

  • Wittenborn, J.R.: Contributions and current status of Q methodology. Psychol. Bull. 58, 132–142 (1961)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Foundations, Leadership, and Administration, College of Education, Health, and Human Services, Kent State University, Kent, OH , 44242, USA

    Steven R. Brown

  2. Department of Geography, Geology, and the Environment, Slippery Rock University, Slippery Rock, PA , 16057, USA

    Stentor Danielson

  3. Institute of Health Policy and Management (iBMG), Erasmus University, Rotterdam, The Netherlands

    Job van Exel

Authors
  1. Steven R. Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stentor Danielson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Job van Exel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Steven R. Brown.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Brown, S.R., Danielson, S. & van Exel, J. Overly ambitious critics and the Medici Effect: a reply to Kampen and Tamás. Qual Quant 49, 523–537 (2015). https://doi.org/10.1007/s11135-014-0007-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-014-0007-x

Keywords

  • Q methodology
  • R methodology
  • Subjectivity
  • Factor analysis