Journal of Business and Psychology

, Volume 22, Issue 3, pp 191–207 | Cite as

Factors Influencing Employee Intentions to Provide Honest Upward Feedback Ratings

Article

Abstract

Based on current research involving rater motivation, we examined several factors hypothesized to influence employee intentions to provide honest upward feedback. Survey data were collected from a demographically diverse sample of hospital employees (n = 203). In summary, we found empirical support for generalizing extant models of rater motivation to an upward feedback context: cynicism towards upper management and the upward feedback process, understanding upward feedback, and opportunity to observe their supervisors were the primary predictors of employee intentions to provide honest upward feedback ratings, mediated by the (a) extent to which employees perceived positive benefits would result from rating their supervisors honestly, (b) the extent to which employees feared retaliation by their supervisors, and (c) rater self-efficacy.

Keywords

Upward feedback Multisource feedback Multi-rater feedback Performance appraisal Rater motivation Rater participation Rater accuracy 

Notes

Acknowledgements

The authors would like to thank Dr. Tony Calabrese, Director of Psychology Services at Pine Grove Recovery Center, for his assistance in facilitating data collection. This article was based on Austin F. R. Smith’s dissertation under the supervision of Vincent J. Fortunato. The authors contributed equally to this article.

References

  1. Abraham, R. (2000). Organizational cynicism: Bases and consequences. Genetic, Social, and General Psychology Monographs, 126, 269–292.PubMedGoogle Scholar
  2. Ajzen, I. (1985). In J. Kuhl & J. Beckman (Eds.), From intentions to actions: A theory of planned behavior. Heidelberg: Springer.Google Scholar
  3. Antonioni, D., & Woehr, D. J. (2001). Improving the quality of multisource rater performance. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 114–129). San Francisco, CA: Jossey-Bass.Google Scholar
  4. Armitage, C. J., & Conner, M. (2001). Efficacy of the theory of planned behaviour: A meta-analytic review. British Journal of Social Psychology, 40, 471–499.PubMedCrossRefGoogle Scholar
  5. Atwater, L., & Waldman, D. (1998). Accountability in 360-degree feedback. HR Magazine, 43, 96–102.Google Scholar
  6. Atwater, L. E., Waldman, D. A., Atwater, D., & Cartier, P. (2000). An upward feedback field experiment: Supervisors’ cynicism, reactions, and commitment to subordinates. Personnel Psychology, 53, 275–297.CrossRefGoogle Scholar
  7. Avis, J. M., & Kudisch, J. D. (2000). Factors influencing subordinates’ willingness to participate in upward feedback. Paper presented at the 21st annual Industrial & Organizational Behavior Graduate Conference, Knoxville, TN.Google Scholar
  8. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.Google Scholar
  9. Baron, R. E., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182.PubMedCrossRefGoogle Scholar
  10. Bernardin, H. J., & Tyler, C. L. (2001). Legal and ethical issues in multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 447–462). San Francisco, CA: Jossey-Bass.Google Scholar
  11. Bracken, D. W. (1994). Straight talk about multirater feedback. Training and Development, 48, 44–51.Google Scholar
  12. Bracken, D. W., & Timmreck, C. W. (2001). Success and sustainability: A systems view of multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 478–494). San Francisco, CA: Jossey-Bass.Google Scholar
  13. Bracken, D. W., Timmreck, C. W., & Church, A. H. (Eds.). (2001). The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes. San Francisco: Jossey-Bass.Google Scholar
  14. Church, A. H. (1995). First-rate multirater feedback. Training and Development, 49, 42–43.Google Scholar
  15. Church, A. H., & Bracken, D. W. (1997). Advancing the state of the art of 360-degree feedback: Guest editors’ comments on the research and practice of multirater assessment methods. Group and Organizational Management, 22, 149–161.CrossRefGoogle Scholar
  16. Church, A. H., & Waclawski, J. (1998). Making multirater feedback systems work. Quality Progress, 31, 81–89.Google Scholar
  17. Church, A. H., & Waclawski, J. (2001). A five-phase framework for designing a successful multisource feedback system. Consulting Psychology Journal: Practice and Research, 53, 82–95.CrossRefGoogle Scholar
  18. Dalton, M. (1998). Best practices: Five rationales for using 360-degree feedback in organizations. In W. W. Tornow & M. London (Eds.), Maximizing the value of 360-degree feedback: A process for successful individual and organizational development (pp. 59–77). San Francisco, CA: Jossey-Bass.Google Scholar
  19. Davis, L. T. (2000, April). The effect of organizational factors on intended rating behavior. Poster session presented at the 15th annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.Google Scholar
  20. Dean, J. W., Brandes, P., & Dharwadkar, R. (1998). Organizational cynicism. Academy of Management Review, 23, 341–352.CrossRefGoogle Scholar
  21. DeCotiis, T., & Petit, A. (1978). The performance appraisal process: A model and some testable propositions. Academy of Management Review, 3, 635–646.PubMedCrossRefGoogle Scholar
  22. Edwards, M. R., & Ewen, A. (1996). 360-degree feedback: The powerful new model for employee assessment and performance improvement. New York: AMACON.Google Scholar
  23. Edwards, M. R., & Ewen, A. (2001). Readiness for multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 33–47). San Francisco, CA: Jossey-Bass.Google Scholar
  24. Farr, J. L., & Newman, D. A. (2001). Rater selection: Sources of feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 96–113). San Francisco, CA: Jossey-Bass.Google Scholar
  25. Funderburg, S. A., & Levy, P. A. (1997). The influence of individual and contextual variables on 360-degree feedback system attitudes. Group and Organizational Management, 22, 210–235.CrossRefGoogle Scholar
  26. Harris, M. M. (1994). Rater motivation in the performance appraisal context: A theoretical framework. Journal of Management, 20, 737–756.CrossRefGoogle Scholar
  27. Heneman, R. L., & Wexley, K. N. (1983). The effects of delay in rating and amount of information observed on performance rating accuracy. Academy of Management Journal, 26, 677–686.CrossRefGoogle Scholar
  28. Jöreskog, K. G., & Sörbom, D. (1992). LISREL VIII: Analysis of linear structural relations. Mooresville, IN: Scientific Software, Inc.Google Scholar
  29. Kudisch, J. D., Fortunato, V. J., & Smith, A. F. R. (2006). Contextual and individual difference factors predicting individuals' desire to provide upward feedback. Group and Organization Management, 31, 509–529.Google Scholar
  30. Lehr, C. O., & Facteau, J. D. (1992, May). Individual and contextual factors related to subordinate appraisal system effectiveness. Paper presented at the 7th annual conference for the Society of Industrial and Organizational Psychology, Montreal.Google Scholar
  31. Lepsinger, R., & Lucia, A. D. (1997). The art and science of 360 degree feedback. San Francisco, CA: Jossey-Bass.Google Scholar
  32. London, M. (2001). The great debate: Should multisource feedback be used for administrative or development only? In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 368–388). San Francisco, CA: Jossey-Bass.Google Scholar
  33. Longnecker, C. O. (1989). Truth or consequences: Politics and performance appraisals. Business Horizons, 32, 76–82.CrossRefGoogle Scholar
  34. Longnecker, C. O., Sims, H. P., & Gioia, D. A. (1987). Behind the mask: The politics of employee appraisal. The Academy of Management Executive, 1, 183–193.Google Scholar
  35. MacKinnon, D. P., Warsi, G., & Dwyer, J. H. (1995). A simulation study of mediated effect measures. Multivariate Behavioral Research, 30(1), 41–62.CrossRefGoogle Scholar
  36. Milliman, J. F., Zawacki, R. A., Schulz, B., Wiggins, S., & Norman, C. A. (1995). Customer service drives 360-degree goal setting. Personnel Journal, 74, 136–142.Google Scholar
  37. Mohrman, A. M., & Lawler, E. E. (1983). Motivation and performance appraisal behavior. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory (pp. 173–198). Hillsdale, NJ: Erlbaum.Google Scholar
  38. Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.Google Scholar
  39. Napier, N. K., & Latham, G. P. (1986). Outcome expectancies of people who conduct performance appraisals. Personnel Psychology, 39, 827–837.CrossRefGoogle Scholar
  40. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd edn.). New York: McGraw Hill.Google Scholar
  41. Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organization research: Problems and prospects. Journal of Management, 12, 531–544.CrossRefGoogle Scholar
  42. Pollack, D. M., & Pollack, L. J. (1996). Using 360-feedback in performance appraisal. Public Personnel Management, 25, 507–529.Google Scholar
  43. Preacher, K. J., & Leonardelli, G. J. (2001, March). Calculation for the Sobel test: An interactive calculation tool for mediation tests (Computer software). Available from http://www.unc.edu/~preacher/sobel.htm.
  44. Rotolo, C. T., & Kudisch, J. D. (1996). Important considerations in developing and implementing a successful multi-source assessment system. International Personnel Management Association News, 14, 18–19.Google Scholar
  45. Sobel, M. E. (1986). Some new results on indirect effects and their standard errors in covariance structural models. In N. Tuma (Ed.), Sociological methodology 1986 (pp. 159–186). Washington DC: American Sociological Association.Google Scholar
  46. Tornow, W. W., & London, M. (1998). Maximizing the value of 360-degree feedback: A process for successful individual and organizational development. San Francisco, CA: Jossey-Bass.Google Scholar
  47. Tornow, W. W., & Tornow, C. P. (2001). Linking multisource feedback content with organizational needs. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 48–62). San Francisco, CA: Jossey-Bass.Google Scholar
  48. Tziner, A. (1999). The relationship between distal and proximal factors and the use of political considerations in performance appraisal. Journal of Business and Psychology, 14, 217–231.CrossRefGoogle Scholar
  49. Tziner, A., & Murphy, K. R. (1999). Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology, 13, 407–419.CrossRefGoogle Scholar
  50. Tziner, A., Murphy, K. R., & Cleveland, J. N. (2001). Relationships between attitudes toward organizations and performance appraisal systems and rating behavior. International Journal of Selection and Assessment, 9, 226–241.CrossRefGoogle Scholar
  51. Tziner, A., Murphy, K. R., & Cleveland, J. N. (2002). Does conscientiousness moderate the relationship between attitudes and beliefs regarding performance appraisal and rating behavior? International Journal of Selection and Assessment, 10, 218–224.CrossRefGoogle Scholar
  52. Tziner, A., Murphy, K. R., & Cleveland, J. N. (2005). Contextual and rater factors affecting rater behavior. Group and Organization Management, 30, 89–98.CrossRefGoogle Scholar
  53. Tziner, A., Murphy, K. R., Cleveland, J. N., Beaudin, G., & Marchand, S. (1998). Impact of rater beliefs regarding performance appraisal and its organizational context on appraisal quality. Journal of Business and Psychology, 12, 457–467.CrossRefGoogle Scholar
  54. Vance, R. J., Brooks, S. M., & Tesluk, P. E. (1995, May). Organizational cynicism, cynical cultures, and organizational change efforts. Paper presented at the 10th Annual Conference of the Society of Industrial and Organizational Psychology, Orlando, FL.Google Scholar
  55. Van Velsor, E. (1998). Designing 360-degree feedback to enhance involvement, self-determination, and commitment. In W. W. Tornow & M. London (Eds.), Maximizing the value of 360-degree feedback: A process for successful individual and organizational development (pp. 149–195). San Francisco, CA: Jossey-Bass.Google Scholar
  56. Waldman, D. A., & Atwater, L. E. (1998). The power of 360 degree feedback: How to leverage performance evaluations for top productivity. Houston: Gulf Publishing.Google Scholar
  57. Waldman, D. A., & Atwater, L. E. (2001). Confronting barriers to successful implementation of multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 463–477). San Francisco, CA: Jossey-Bass.Google Scholar
  58. Westerman, J. W., & Rosse, J. G. (1997). Reducing the threat of rater nonparticipation in 360-degree feedback systems: An exploratory examination of antecedents to participation in upward ratings. Group and Organizational Management, 22, 288–309.CrossRefGoogle Scholar
  59. Wimer, S., & Nowack, K. M. (1998). Thirteen common mistakes using 360-degree feedback. Training and Development, 52, 69–78.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  1. 1.Department of PsychologyUniversity of Southern MississippiHattiesburgUSA
  2. 2.Personnel Decisions InternationalNew YorkUSA
  3. 3.Department of PsychologyBoise State UniversityBoiseUSA
  4. 4.People Business LLCBoiseUSA

Personalised recommendations