Skip to main content
SpringerLink
Log in

The Two-Factor Solution to Allen and Meyer’s (1990) Affective Commitment Scale: Effects of Negatively Worded Items

  • Published:
Journal of Business and Psychology Aims and scope Submit manuscript

Abstract

Purpose

Affective organizational commitment is a construct important to both practitioners and researchers; thus, construct-valid measurement is needed. Allen and Meyer’s (J Occup Psychol 63:1–18, 1990) Affective Commitment Scale is a popular measure of affective organizational commitment. Although conceptualized as unidimensional, a two-factor solution sometimes emerges. Whether the two factors are substantive, reflecting AC-love and AC-joy constructs, or methodological, reflecting positively and negatively worded items, is unclear. This issue is examined in five studies.

Design/Methodology/Approach

In a new approach, conditions designed to produce cognitive fatigue are manipulated. Support for the method factor interpretation would be provided if the two-factor solution emerges only when participants are fatigued and negatively worded items are present. Cross-sample analyses are also conducted.

Findings

Analyses indicated that the two-factor solution fit the data well only when (a) participants were cognitively fatigued and (b) negatively worded items were present. This finding extended to both students and employees, and it held regardless of which items were negatively worded or whether negatively worded items were emphasized.

Implications

Results suggest that the second factor is likely methodological and seems to result from careless responding or fatigue on negatively worded items. It is suggested that users modify the items to be positively worded or administer the scale when respondents have sufficient cognitive resources to respond.

Originality/Value

This study was the first to use experimental methodology to test whether the two-factor solution is methodological or substantive. Results provide guidance for improving the scale’s construct validity in research and in practical applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance and normative commitment to the organization. Journal of Occupational Psychology, 63, 1–18.

    Article  Google Scholar 

  • Anastasi, A. (1982). Psychological testing (5th ed.). New York: Macmillan.

    Google Scholar 

  • Atchley, P., & Chan, M. (2011). Potential benefits and costs of concurrent task engagement to maintain vigilance: A driving simulator investigation. Human Factors, 53, 3–12. doi:10.1177/0018720810391215.

    Article  PubMed  Google Scholar 

  • Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60, 361–370. doi:10.1177/00131640021970592.

    Article  Google Scholar 

  • Benson, J., & Hocevar, D. (1985). The impact of item phrasing on the validity of attitude scales for elementary school children. Journal of Educational Measurement, 22, 231–240.

    Article  Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037/0033-2909.107.2.238.

    Article  PubMed  Google Scholar 

  • Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606. doi:10.1037/0033-2909.88.3.588.

    Article  Google Scholar 

  • Bergami, M. & Bagozzi, R. P. (2000). Self-categorization, affective commitment, and group self-esteem as distinct aspects of social identity in the organization. British Journal of Social Psychology. doi:10.1348/014466600164633.

  • Billiet, J. B., & McClendon, M. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608–628. doi:10.1207/S15328007SEM0704_5.

    Article  Google Scholar 

  • Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21, 230–258. doi:10.1177/0049124192021002005.

    Article  Google Scholar 

  • Carmeli, A., Gilat, G., & Weisberg, J. (2006). Perceived external prestige, organizational identification, and affective commitment: A stakeholder approach. Corporate Reputation Review, 9(1), 92–104. doi:10.1057/palgrave.crr.1550014.

    Article  Google Scholar 

  • Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.

  • Conrad, K. J., Wright, B. D., McKnight, P., McFall, M., Fontana, A., & Rosenheck, R. (2004). Comparing traditional and Rasch analyses of the Mississippi PTSD Scale: Revealing limitations of reverse-scored items. Journal of Applied Measurement, 5, 1–16.

    Google Scholar 

  • Cook, J., & Wall, T. (1980). New work attitude measures of trust, organizational commitment, and personal need non-fulfillment. Journal of Occupational Psychology, 53, 39–52.

    Article  Google Scholar 

  • Cordery, J. L., & Sevastos, P. P. (1993). Responses to the original and revised Job Diagnostic Survey: Is education a factor in responses to negatively worded items? Journal of Applied Psychology, 78, 141–143.

    Article  Google Scholar 

  • Culpepper, R. A. (2000). A test of revised scales for the Meyer and Allen (1991) three-component commitment construct. Educational and Psychological Measurement, 60, 604–616. doi:10.1177/00131640021970754.

    Article  Google Scholar 

  • Dunham, R. B., Grube, J. A., & Castaneda, M. B. (1994). Organizational commitment: The utility of an integrative definition. Journal of Applied Psychology, 79, 370–380. doi:10.1177/00131640021970754.

    Article  Google Scholar 

  • Gilbert, D. T., & Hixon, J. G. (1991). The trouble of thinking: Activation and application of stereotypic beliefs. Journal of Personality and Social Psychology, 60, 509–517. doi:10.1037/0022-3514.60.4.509.

    Article  Google Scholar 

  • Golembiewski, R. T., Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133–157.

    Article  Google Scholar 

  • Greenberger, E., Chen, C., Dmitrieva, J., & Farruggia, S. P. (2003). Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: Do they matter? Personality and Individual Differences, 35, 1241–1254. doi:10.1016/S0191-8869(02)00331-8.

    Article  Google Scholar 

  • Grier, R. A., Warm, J. S., Dember, W. N., Matthews, G., Galinsky, T. L., Szalma, J. L., et al. (2003). The vigilance decrement reflects limitations in effortful attention, not mindlessness. Human Factors, 45, 349–359. doi:10.1518/hfes.45.3.349.27253.

    Article  PubMed  Google Scholar 

  • Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170. doi:10.1037/h0076546.

    Article  Google Scholar 

  • Hart, S. G. (2006). Nasa-task load index (NASA-TLX); 20 years later. Human Factors and Ergonomics Society Annual Meeting Proceedings (pp. 904–908). Human Factors and Ergonomics Society.

  • Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload (pp. 139–183). Amsterdam: North Holland Press.

    Chapter  Google Scholar 

  • Harvey, R. J., Billings, R. S., & Nilan, K. J. (1985). Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. Journal of Applied Psychology, 70, 461–468. doi:10.1037/0021-9010.70.3.461.

    Article  Google Scholar 

  • Helton, W. S., & Russell, P. N. (2011). The effects of arousing negative and neutral picture stimuli on target detection in a vigilance task. Human Factors, 53, 132–141. doi:10.1177/0018720811401385.

    Article  PubMed  Google Scholar 

  • Herche, J., & Engelland, B. (1996). Reversed-polarity items and scale unidimensionality. Journal of the Academy of Marketing Science, 24, 366–374. doi:10.1177/0092070396244007.

    Article  Google Scholar 

  • Idaszak, J. R., & Drasgow, F. (1987). A revision of the Job Diagnostic Survey: Elimination of a measurement artifact. Journal of Applied Psychology, 72, 69–74. doi:10.1037/0021-9010.72.1.69.

    Article  Google Scholar 

  • Jöreskog, K. G., & Sörbom, D. (2006). LISREL 8.8 for Windows [Computer software]. Lincolnwood, IL: Scientific Software International, Inc.

    Google Scholar 

  • Lai, J. C. (1994). Differential predictive power of the positively versus the negatively worded items of the Life Orientation Test. Psychological Reports, 75, 1507–1515.

    Article  PubMed  Google Scholar 

  • Magazine, S. L., Williams, L. J., & Williams, M. L. (1996). A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen’s Affective and Continuance Commitment Scales. Educational and Psychological Measurement, 56, 241–250. doi:10.1177/0013164496056002005.

    Article  Google Scholar 

  • Marsh, H. W. (1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810–819. doi:10.1037/0022-3514.70.4.810.

    Article  PubMed  Google Scholar 

  • Mathews, B. P., & Shepherd, J. L. (2002). Dimensionality of Cook and Wall’s (1980) British Organizational Commitment Scale revisited. Journal of Occupational and Organizational Psychology, 75, 369–375. doi:10.1348/096317902320369767.

    Article  Google Scholar 

  • Melnick, S. A., & Gable, R. K. (1990). The use of negative item stems: A cautionary note. Educational Research Quarterly, 14, 31–36.

    Google Scholar 

  • Merritt, S. M., & Ilgen, D. R. (2008). Not all trust is created equal: Disposition and history-based trust in human-automation interactions. Human Factors, 50, 194–210. doi:10.1518/001872008X288574.

    Article  PubMed  Google Scholar 

  • Meyer, J. P., & Allen, N. J. (1991). A three-component conceptualization of organizational commitment. Human Resource Management Review, 1, 61–89. doi:10.1016/1053-4822(91)90011-Z.

    Article  Google Scholar 

  • Meyer, J. P., Stanley, D. J., Herscovitch, L., & Topolnytsky, L. (2002). Affective, continuance, and normative commitment to the organization: A meta-analysis of antecedents, correlates, and consequences. Journal of Vocational Behavior, 61, 20–52. doi:10.1006/jvbe.2001.1842.

    Article  Google Scholar 

  • Mikulka, P. J., Scerbo, M. W., & Freeman, F. G. (2002). Effects of a biocybernetic system on vigilance performance. Human Factors, 44, 654–664. doi:10.1518/0018720024496944.

    Article  PubMed  Google Scholar 

  • Millsap, R. E., & Hartog, S. B. (1988). Alpha, beta, and gamma change in evaluation research: A structural equation approach. Journal of Applied Psychology, 73, 574–584. doi:10.1037/0021-9010.73.3.574.

    Article  Google Scholar 

  • Motl, R. W., Conroy, D. E., & Horan, P. M. (2000). The Social Physique Anxiety Scale: Example of the potential consequence of negatively worded items in factorial validity studies. Journal of Applied Measurement, 1, 327–345.

    PubMed  Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Peterson, N. A., Speer, P. W., & Hughey, J. (2006). Measuring sense of community: A methodological interpretation of the factor structure debate. Journal of Community Psychology, 34, 453–469. doi:10.1002/jcop.20109.

    Article  Google Scholar 

  • Pilotte, W. J., & Gable, R. K. (1990). The impact of positive and negative item stems on the validity of a computer anxiety scale. Educational and Psychological Measurement, 50, 603–610. doi:10.1177/0013164490503016.

    Article  Google Scholar 

  • Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Roszkowski, M. J., & Soven, J. (2009). Shifting gears: Consequences of including two negatively worded items in the middle of a positively worded questionnaire. Assessment & Evaluation in Higher Education, 35, 113–130. doi:10.1080/02602930802618344.

    Article  Google Scholar 

  • Schmitt, N., & Stults, D. M. (1985). Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement, 9, 367–373. doi:10.1177/014662168500900405.

    Article  Google Scholar 

  • Schriesheim, C. A., & Eisenbach, R. J. (1995). An exploratory and confirmatory factor-analytic investigation of item wording effects on the obtained factor structures of survey questionnaire measures. Journal of Management, 21, 1177–1193. doi:10.1177/014920639502100609.

    Article  Google Scholar 

  • Schriesheim, C. A., Eisenbach, R. J., & Hill, K. D. (1991). The effect of negation and polar opposite item reversals on questionnaire reliability and validity: An experimental investigation. Educational and Psychological Measurement, 51, 67–78. doi:10.1177/0013164491511005.

  • Schriesheim, C. A., & Hill, K. D. (1981). Controlling acquiescence response bias by item reversals: The effect on questionnaire validity. Educational and Psychological Measurement, 41, 1101–1114. doi:10.1177/001316448104100420.

    Article  Google Scholar 

  • Smit, A. S., Eling, P. A. T. M., & Coenen, A. M. L. (2003). Mental effort causes vigilance decrease due to resource depletion. Acta Psychologica, 115, 35–42. doi:10.1016/j.actpsy.2003.11.001.

    Article  Google Scholar 

  • Spector, P. E., Van Katwyk, P. T., Brannick, M. T., & Chen, P. Y. (1997). When two factors don’t reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659–677.

    Article  Google Scholar 

  • Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number of factors. Paper presented at the annual spring meeting of the Psychometric Society, Iowa City, IA.

  • Temple, J. G., Warm, J. S., Dember, W. N., Jones, K. S., LaGrange, C. M., & Matthews, G. (2000). The effects of signal salience and caffeine on performance, workload, and stress in an abbreviated vigilance task. Human Factors, 42, 183–194. doi:10.1518/hfes.45.3.349.27253.

    Article  PubMed  Google Scholar 

  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. doi:10.1177/109442810031002.

    Article  Google Scholar 

  • Vandenberg, R. J., & Self, R. M. (1993). Assessing newcomers’ changing commitments to the organization during the first 6 months of work. Journal of Applied Psychology, 78, 557–568. doi:10.1037/0021-9010.78.4.557.

    Article  Google Scholar 

  • Warm, J. S., Parasuraman, R., & Matthews, G. (2010). Vigilance requires hard mental work and is stressful. Human Factors, 50, 433–441. doi:10.1518/001872008X312152.

    Article  Google Scholar 

  • Woods, C. M. (2006). Careless responding to reverse-worded items: Implications for confirmatory factor analysis. Journal of Psychopathology and Behavioral Assessment, 28, 186–191. doi:10.1007/s10862-005-9004-7.

    Article  Google Scholar 

Download references

Acknowledgments

The author would like to thank Therese Macan, Wanyi Ma, and Tracy Mulderig for their assistance with this project.

Author information

Authors and Affiliations

  1. University of Missouri – St. Louis, 421 Stadler Hall, 8001 Natural Bridge Road, St. Louis, MO, 63121, USA

    Stephanie M. Merritt

Authors
  1. Stephanie M. Merritt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephanie M. Merritt.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Merritt, S.M. The Two-Factor Solution to Allen and Meyer’s (1990) Affective Commitment Scale: Effects of Negatively Worded Items. J Bus Psychol 27, 421–436 (2012). https://doi.org/10.1007/s10869-011-9252-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10869-011-9252-3

Keywords

Search

Navigation