Abstract
Despite the pervasiveness of rating discrepancy in organizations, there has been little research to examine how this common phenomenon occurring in performance appraisal influences an employee’s work relationships with an organization and a leader. In a field study surveying 147 R&D workers who were evaluated under forced distribution rating system, the present research explored this question by focusing on how rating discrepancy would affect an employee’s turnover intention and perceived leader-member exchange (LMX). With polynomial regression analysis and response surface methodology in a real-time research design, it was found that there were nonlinear relationships between rating discrepancy and turnover intention and LMX, respectively, and that these non-linear relationships were not symmetrical.
Similar content being viewed by others
Notes
Rating discrepancy between self and a supervisor (or someone in a leader position) in the present study is in consideration of the purpose of the study to examine the effect of rating discrepancy on an employee’s work relationships with an organization or a leader. We presumed that the implication of rating discrepancy between self and a peer or a subordinate on our two focal work relationships would be relatively trivial.
References
Ackerman, P. L., & Kanfer, R. 1993. Integrating laboratory and field study for improving selection: Development of a battery for predicting air traffic controller success. Journal of Applied Psychology, 78: 413–432.
Adams, J. S. 1965. Inequity in social exchange. In L. Berkowitz (Ed.). Advances in experimental social psychology: 267–299. New York: Academic.
Alloy, L. B., & Tabachnik, N. 1984. Assessment of covariation by humans and animals: The joint influence of prior expectations and current situational information. Psychology Review, 91: 112–149.
Austin, W., & Walster, E. 1974. Reactions to confirmations and disconfirmations of expectancies of equity and inequity. Journal of Personality and Social Psychology, 30: 208–216.
Bandura, A. 1997. Self-efficacy: The exercise of control. New York: Freeman.
Bauer, T. N., & Green, S. G. 1996. Development of leader-member exchange: A longitudinal test. Academy of Management Journal, 39: 1538–1567.
Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. 2001. Bad is stronger. Review of General Psychology, 5: 323–370.
Blakely, G. L. 1993. The effects of performance rating discrepancies on supervisors and subordinates. Organizational Behavior and Human Decision Processes, 54: 57–80.
Blau, P. 1964. Exchange and power in social life. New York: Wiley.
Brislin, R. W., Lonner, W. J., & Thorndike, E. M. 1973. Cross-cultural research methods. New York: Wiley.
Brockner, J. 1988. Self-esteem at work: Theory, research, and practice. Lexington: Lexington Books.
Brockner, J., Ackerman, G., & Fairchild, G. 2001. When do elements of procedural faiarness make a difference? A classification of moderating influences. In J. Greenberg & Cropanzano (Eds.). Advances in organizational justice: 179–212. Palo Alto: Stanford University Press.
Brown, M., Hyatt, D., & Benson, J. 2010. Consequences of the performance appraisal experience. Personnel Review, 39: 375–396.
Chen, G. 2005. Newcomer adaptation in teams: Multilevel antecedents and outcomes. Academy of Management Journal, 48: 101–116.
Chen, G., & Klimoski, R. J. 2003. The impact of expectations on newcomer performance in teams as mediated by work characteristics, social exchanges, and empowerment. Academy of Management Journal, 46: 591–607.
Chen, N. Y.-F., & Tjosvold, D. 2007. Guanxi and leader-member relationships between American managers and Chinese employees: Open-minded dialogue as mediator. Asia Pacific Journal of Management, 24(2): 171–189.
Church, A. T., Anderson-Harumi, C. A., del Prado, A. M., Curtis, G. J., Tanaka-Matsumi, J., Valdez Medina, J. L., Mastor, K. A., White, F. A., Miramontes, L. A., & Katigbak, M. S. 2008. Culture, cross-role consistency, and adjustment: Testing trait and cultural psychology perspectives. Journal of Personality and Social Psychology, 95: 739–755.
Conlon, D. E. 1993. Some tests of the self-interest and group-level models of procedural justice: evidence from an organizational appeal procedure. Academy of Management Journal, 36: 1109–1124.
Daniel, S. J., Lee, D., & Reitsperger, W. D. 2014. Raising quality consciousness among Chinese manufacturing personnel: Testing the effectiveness of performance management tools. Asia Pacific Journal of Management, 31(2): 549–573.
Dansereau, F., Graen, G., & Haga, W. 1975. A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role-making process. Organizational Behavior and Human Performance, 13: 46–78.
DeConinck, J. B. 2011. The effects of leader-member exchange and organizational identification on performance and turnover among salespeople. Journal of Personal Selling & Sales Management, 31: 21–34.
DeVellis, R. F. 1991. Scale development: Theories and applications. Newbury Park: Sage.
Duarte, N. T., Goodson, J. R., & Klich, N. R. 1993. How do I like thee? Let me appraise the ways. Journal of Organizational Behavior, 14: 239–249.
Duarte, N. T., Goodson, J. R., & Klich, N. R. 1994. Effects of dyadic quality and duration on performance appraisal. Academy of Management Journal, 37: 499–521.
Dusterhoff, C., Cunningham, J. B., & MacGregor, J. N. 2014. The effects of performance rating, leader-member exchange, perceived utility, and organizational justice on performance appraisal satisfaction: Applying a moral judgment perspective. Journal of Business Ethics, 119: 265–273.
Edwards, J. R. 2001. Ten difference score myths. Organizational Research Methods, 4: 265–287.
Edwards, J. R., & Rothbard, N. P. 1999. Work and family stress and well-being: An examination of person-environment fit in the work and family domains. Organizational Behavior and Human Decision Processes, 77: 85–129.
Eisenberger, R., Huntington, R., Hutchison, S., & Sowa, D. 1986. Perceived organizational support. Journal of Applied Psychology, 71: 500–507.
Eisenberger, R., Stinglhamber, F., Vandenberghe, C., Sucharski, I. L., & Rhoades, L. 2002. Perceived supervisor support: Contributions to perceived organizational support and employee retention. Journal of Applied Psychology, 87: 565–573.
Elicker, J. D., Levy, P. E., & Hall, R. J. 2006. The role of leader-member exchange in the performance appraisal process. Journal of Management, 32: 531–551.
English, T. & Chen, S. 2011. Self-concept consistency and culture: The differential impact of two forms of consistency. Personality and Social Psychology Bulletin, 37 (6): 838–849.
Epstein, S. 1973. The self-concept revisited: Or a theory of a theory. American Psychologist, 28: 404–416.
Erdogan, B. 2002. Antecedents and consequences of justice perceptions in performance appraisals. Human Resource Management Review, 12: 555–578.
Falcione, R. L., & Wilson, C. E. 1988. Socialization processes in organizations. In G. M. Goldhaber & G. A. Barnett (Eds.). Handbook of organizational communication: 151–169. Norwood: Ablex.
Farh, J. L., Tsui, A. S., Xin, K. R., & Cheng, B. 1998. The influence of relational demography and guanxi: The Chinese case. Organization Science, 9: 471–488.
Forger, R., & Konovsky, M. 1989. Effect of procedural and distributive justice on reactions to pay raise decisions. Academy of Management Journal, 32: 115–130.
Freedman, A. 2006. Companies balance values and results in performance reviews. Human Resource Executive Online: Aug. http://www.hreonline.com/HRE/story.jsp?storyId=5620245, Accessed Jan. 9, 2009.
Gerstner, C. R., & Day, D. A. 1997. Meta-analytic review of leader-member exchange theory: Correlates and construct issues. Journal of Applied Psychology, 82: 827–844.
Graen, G. B., & Scandura, T. A. 1987. Toward a psychology of dyadic organizing. Research in Organizational Behavior, 9: 175–208.
Graen, G. B., & Uhl-Bien, M. 1995. Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level, multi-domain perspective. Leadership Quarterly, 6: 219–247.
Griffeth, R. W., & Hom, P. W. 1995. The employee turnover process. Research in Personnel and Human Resources Management, 13: 245–293.
Grote, D. 2005. Forced ranking: Making performance management work. Boston: Harvard Business School Press.
Guralnik, O., Rozmarin, E., & So, A. 2004. Forced distribution: Is it right for you?. Human Resource Development Quarterly, 15: 561–568.
Hazels, B., & Sasse, C. M. 2008. Forced ranking: A review. S. A. M. Advanced Management Journal, 73: 35–40.
Hogg, M. A., Martin, R., Epitropaki, O., Mankad, A., Svensson, A., & Weeden, K. 2005. Effective leadership in salient groups: Revisiting leader-member exchange theory from the perspective of the social identity theory of leadership. Personality and Social Psychology Bulletin, 31: 991–1004.
Holzbach, R. L. 1978. Rater bias in performance ratings: Superior, self- and peer ratings. Journal of Applied Psychology, 63: 579–588.
Hom, P. W., Caranikas-Walker, F., Prussia, G. W., & Griffeth, R. W. 1992. A meta-analytical structural equations analysis of a model of employee turnover. Journal of Applied Psychology, 77: 890–909.
Hom, P. W., & Griffeth, R. W. 1995. Employee turnover. Cincinnati: South-Western College Publishing.
Hunt, S. D., Wood, V. R., & Chonko, L. B. 1989. Corporate ethical values and organizational commitment in marketing. Journal of Marketing, 53: 79–90.
Ilgen, D. R. 1986. Laboratory research: A question of when, not if. In E. A. Locke (Ed.). Generalizing from laboratory to field settings: 257–267. Lexington: Lexington Books.
Irving, P. G., & Meyer, J. P. 1994. Re-examination of the met-expectations hypothesis: A longitudinal analysis. Journal of Applied Psychology, 79: 937–949.
Judge, T. A., Bono, J. E., & Locke, E. A. 2000. Personality and job satisfaction: The mediating role of job characteristics. Journal of Applied Psychology, 85: 237–249.
Judge, T. A., Locke, E. A., Durham, C. C., & Kluger, A. N. 1998. Dispositional effects on job and life satisfaction: The role of core evaluations. Journal of Applied Psychology, 83: 17–34.
Jussim, L., Yen, H., & Aiello, J. R. 1995. Self-consistency, self-enhancement, and accuracy in reactions to feedback. Journal of Experimental Social Psychology, 31: 322–356.
Keeping, L. M., & Levy, P. E. 2000. Performance appraisal reactions: Measurement, modeling and method bias. Journal of Applied Psychology, 85: 708–723.
Kim, T., Liu, Z., & Diefendorff, J. M. 2015. Leader-member exchange and job performance: The effects of taking charge and organizational tenure. Journal of Organizational Behavior, 36(2): 216–231.
Konovsky, M. A. 2000. Understanding procedural justice and its impact on business organizations. Journal of Management, 26: 489–511.
Korman, A. K. 1976. Hypothesis of work behavior revisited and an extension. Academy of Management Review, 1: 50–63.
Korsgaard, M. A. 1996. The impact of self-appraisals on reactions to feedback from others: The role of self-enhancement and self-consistency concerns. Journal of Organizational Behavior, 17: 301–311.
Kristof-Brown, A. L., & Stevens, C. K. 2001. Goal congruence in project teams: Does the fit between members’ personal mastery and performance goals matter?. Journal of Applied Psychology, 86: 1083–1095.
Kunter, M. H., Nachtsheim, C. J., Neter, J., & Li, W. 2005. Applied linear statistical models, 5th ed. New York: McGraw-Hill Irwin.
Landy, F. J., & Farr, J. L. 1983. The measurement of work performance: Methods, theory, and applications. New York: Academic.
Levy, P. E., Cawley, B. D., & Foti, R. J. 1998. Reactions to appraisal discrepancies: Performance ratings and attributions. Journal of Business and Psychology, 12: 427–455.
Lind, E. A. 2001. Fairness heuristic theory: Justice judgments as pivotal cognitions in organizational relations. In J. Greenberg & R. Cropanzano (Eds.). Advances in organizational justice: 56–88. Stanford: Stanford University Press.
Lind, E. A., Kanfer, R., & Earley, P. C. 1990. Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. Journal of Personality and Social Psychology, 59: 952–959.
Loi, R., Hang-yue, N., & Foley, S. 2006. Linking employees’ justice perceptions to organizational commitment and intention to leave: The mediating role of perceived organizational support. Journal of Occupational and Organizational Psychology, 79: 101–120.
Louis, M. R. 1980. Surprise and sense making: What newcomers experience in entering unfamiliar organizational settings. Administrative Science Quarterly, 25: 226–251.
McFarlin, C., & Sweeney, P. D. 1992. Distributive and procedural justice as predictors of satisfaction with personal and organizational outcomes. Academy of Management Journal, 35: 626–637.
Michaels, C. E., & Spector, P. E. 1982. Causes of employee turnover: A test of the Mobley, Griffeth, Hand, and Meglino model. Journal of Applied Psychology, 67: 53–59.
Mobley, W. H. 1977. Intermediate linkages in the relationship between job satisfaction and employee turnover. Journal of Applied Psychology, 62: 237–240.
Mobley, W. H. 1982. Employee turnover: Causes, consequences, control. Reading: Addison-Wesley.
Mobley, W. H., Horner, S. O., & Hollingsworth, A. T. 1978. An evaluation of precursors of hospital employee turnover. Journal of Applied Psychology, 63: 408–416.
Murphy, K. R., & Cleveland, J. N. 1995. Understanding performance appraisal: Social, organizational, and goal-based perspective. Thousand Oaks: Sage.
Ngo, H., Loi, R., Foley, S., Zheng, X., & Zhang, L. 2013. Perceptions of organizational context and job attitudes: The mediating effect of organizational identification. Asia Pacific Journal of Management, 30(1): 149–168.
Oliver, R. L. 1976. Hedonic reactions to the disconfirmation of product performance expectations: Some moderating conditions. Journal of Applied Psychology, 61: 246–250.
Olson, J. C., & Dover, P. A. 1979. Disconfirmation of consumer expectations through product trial. Journal of Applied Psychology, 64: 179–189.
Olson, J. M., Roese, N. J., & Zanna, M. P. 1996. Expectancies. In E. T. Higgins & A. W. Kruglanski (Eds.). Social psychology: Handbook of basic principles: 211–238. New York: Guilford.
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. 2003. Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5): 879–903.
Price, J. L., & Mueller, C. W. 1981. A causal model of turnover for nurses. Academy of Management Journal, 24: 543–565.
Ramaswami, S. N., Agarwal, S., & Bhargava, M. 1993. Work alienation of marketing employees: Influence of task, supervisory, and organizational structure factors. Journal of the Academy of Marketing Science, 21: 179–193.
Raudenbush, S. W., & Bryk, A. S. 2002. Hierarchical linear models: Applications and data analysis method, 2nd ed. Thousand Oaks: Sage.
Scandura, T. A., & Williams, E. A. 2000. Research methodology in management: Current practices, trends, and implications for future research. Academy of Management Journal, 43: 1248–1264.
Shadish, W. R., Cook, T. D., & Campbell, D. T. 2002. Experimental and quasi-experimental design for generalized causal inference. Boston: Houghton-Mifflin.
Shrauger, J. S. 1975. Responses to evaluation as a function of initial self-perceptions. Psychological Bulletin, 82: 581–596.
Srivastava, A., Locke, E. A., & Judge, T. A. 2002. Dispositional causes of task satisfaction: The mediating role of chosen level of task complexity. Presented at the “Core self-evaluations: New developments and research findings” symposium, Society for Industrial and Organizational Psychology Annual Meetings, Toronto.
Suh, E. M. 2002. Culture, identity consistency, and subjective well-being. Journal of Personality and Social Psychology, 83: 1378–1391.
Swann, W. B., Griffin, J. J., Predmore, S. C., & Gaines, B. 1987. The cognitive-affective crossfire: When self-consistency confronts self-enhancement. Journal of Personality and Social Psychology, 52: 881–889.
Tangirala, S., & Ramanujam, R. 2008. Exploring nonlinearity in employee voice: The effects of personal control and organizational identification. Academy of Management Journal, 51: 1189–1203.
Taylor, M. S., Tracy, K. B., Renard, M. K., Harrison, J. K., & Carroll, S. J. 1995. Due process in performance appraisal: a quasi-experiment in procedural justice. Administrative Science Quarterly, 40: 495–523.
Taylor, S. E., & Brown, J. 1988. Illusion and well-being: A social psychological perspective on mental health. Psychological Bulletin, 103: 193–210.
Thibaut, J. W., & Walker, L. 1975. Procedural justice: A decision-making theory of visual detection. Psychology Review, 61: 401–409.
Tyler, T. R. 1987. Conditions leading to value-expressive effects in judgments of procedural justice: A test of four models. Journal of Personality and Social Psychology, 57: 830–838.
Van den Bos, K. 2003. On the subjective quality of social justice: The role of affect as information in the psychology of justice judgments. Journal of Applied Psychology, 85: 482–498.
Van den Bos, K., Wilke, H. A., Lind, E. A., & Vermunt, R. 1998. Evaluating outcomes by means of the fair process effect: Evidence for different processes in fairness and satisfaction judgments. Journal of Personality and Social Psychology, 74: 1493–1503.
Van den Bos, K., Peters, S. L., Bobocel, D. R., & Ybema, J. F. 2006. On preferences and doing the right thing: satisfaction with advantageous inequity when cognitive processing is limited. Journal of Experimental Social Psychology, 42: 273–289.
Walster, E., Walster, G. W., & Berscheid, E. 1978. Equity: Theory and research. Boston: Allyn & Bacon.
Weary, G. 1979. Self-serving attributional biases: Perceptual or response distortions. Journal of Personality and Social Psychology, 37: 1418–21.
Weiss, H. M., & Cropanzano, R. 1996. Affective events theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. Research in Organizational Behavior, 18: 1–74.
Williams, L. J., & Hazer, J. T. 1986. Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71: 219–231.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kwak, W.J., Choi, S.B. Effect of rating discrepancy on turnover intention and leader-member exchange. Asia Pac J Manag 32, 801–824 (2015). https://doi.org/10.1007/s10490-015-9414-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10490-015-9414-3