Advertisement

When Does 360-Degree Feedback Create Behavior Change? And How Would We Know It When It Does?

  • David W. BrackenEmail author
  • Dale S. Rose
Article

Abstract

360-degree feedback has great promise as a method for creating both behavior change and organization change, yet research demonstrating results to this effect has been mixed. The mixed results are, at least in part, because of the high degree of variation in design features across 360 processes. We identify four characteristics of a 360 process that are required to successfully create organization change, (1) relevant content, (2) credible data, (3) accountability, and (4) census participation, and cite the important research issues in each of those areas relative to design decisions. In addition, when behavior change is created, the data must be sufficiently reliable to detect it, and we highlight current and needed research in the measurement domain, using response scale research as a prime example.

Keywords

360-Degree feedback Behavior change Organization change Multisource feedback Human resource systems 

References

  1. Antonioni, D., & Woehr, D. J. (2001). Improving the quality of multisource rater performance. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.Google Scholar
  2. Atwater, L. E., & Brett, J. F. (2005). Antecedents and consequences of reactions to developmental 360° feedback. Journal of Vocational Behavior, 66, 532–548.CrossRefGoogle Scholar
  3. Atwater, L. E., & Waldman, D. (1998). Accountability in 360-degree feedback. HR Magazine, 43, 96–104.Google Scholar
  4. Atwater, L. W., Wang, M., Smither, J. W., & Fleenor, J. W. (2009). Are cultural characteristics associated with the relationship between self and others’ ratings of leadership? Journal of Applied Psychology, 94, 876–886.PubMedCrossRefGoogle Scholar
  5. Bass, B. M., Cascio, W. F., & O’Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59(3), 313–320.CrossRefGoogle Scholar
  6. Bono, J., & Colbert, A. (2005). Understanding responses to multi-source feedback: the role of core self-evaluations. Personnel Psychology, 58, 171–203.CrossRefGoogle Scholar
  7. Bracken, D. W. (1994). Straight talk about multirater feedback. Training & Development, 48, 44–51.Google Scholar
  8. Bracken, D. W. (1996). Multisource (360-degree) feedback: surveys for individual and organizational development. In A. I. Kraut (Ed.), Organizational surveys. San Francisco: Jossey-Bass.Google Scholar
  9. Bracken, D. W., & Paul, K. B. (1993, May). The effects of scale type and demographics on upward feedback. Paper presented at the Society for Industrial and Organizational Society Annual Conference, San Francisco, CA.Google Scholar
  10. Bracken, D. W., & Timmreck, C. W. (2001a). Success and Sustainability: a systems view of multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.Google Scholar
  11. Bracken, D. W., & Timmreck, C. W. (2001b). Guidelines for multisource feedback when used for decision making purposes. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.Google Scholar
  12. Bracken, D. W., Timmreck, C. W., & Church, A. H. (2001a). The handbook of multisource feedback. San Francisco: Jossey-Bass.Google Scholar
  13. Bracken, D. W., Timmreck, C. W., Fleenor, J. W., & Summers, L. (2001b). 360 degree feedback from another angle. Human Resource Management, 40(1), 3–20.CrossRefGoogle Scholar
  14. Brett, J., & Atwater, L. (2001). 360-degree feedback: accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology, 86, 930–942.PubMedCrossRefGoogle Scholar
  15. Caputo, P., & Roch, S. (2009, April). Rating formats and perceptions of performance appraisal fairness. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.Google Scholar
  16. Church, A. H., Walker, A. G., & Brockner, J. (2002). Multisource feedback for organization development and change. In J. Waclawski & A. H. Church (Eds.), Organization development: a data-driven approach to organizational change. San Francisco: Jossey-Bass.Google Scholar
  17. Conway, J., & Huffcutt, A. (1997). Psychometric properties of multi-source performance ratings: a meta-analysis of subordinate, supervisor, peer and self ratings. Human Performance, 10, 331–360.CrossRefGoogle Scholar
  18. Craig, S. B., & Hannum, K. (2006). Research update: 360-degree performance assessment. Consulting Psychology Journal: Research and Practice, 58, 117–122.CrossRefGoogle Scholar
  19. Dalton, M. A. (1997). When the purpose of using multi-rater feedback is behavior change. In D. Bracken, et al. (Eds.), Should 360 degree feedback be used only for development purposes?. Greensboro, NC: Center for Creative Leadership.Google Scholar
  20. DeNisi, A. S., & Kluger, A. N. (2000). Feedback effectiveness: can 360-degree appraisals be improved? Academy of Management Executive, 14, 129–139.CrossRefGoogle Scholar
  21. Edwards, M., & Ewen, A. (1996). 360° feedback: the powerful new tool for employee assessment and performance improvement. New York: AMACOM.Google Scholar
  22. English, A. E., Rose, D. S., & McClellan, J. (2009, April). Rating scale label effects on leniency bias in 360-degree feedback. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.Google Scholar
  23. Fleenor, J. W., Taylor, S., & Chappelow, C. (2008). Leveraging the impact of 360-degree feedback. San Francisco: Pfeiffer.Google Scholar
  24. Gillespie, T. L. (2005). Internationalizing 360-degree feedback: are subordinate ratings comparable? Journal of Business and Psychology, 19(3), 361–382.CrossRefGoogle Scholar
  25. Goldsmith, M., & Morgan, H. (2004). Leadership is a contact sport: the “follow-up” factor in management development. Strategy + Business, 36, 71–79.Google Scholar
  26. Goldsmith, M., & Underhill, B. O. (2001). Multisource feedback for executive development. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.Google Scholar
  27. Greguras, G. J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. Journal of Applied Psychology, 83, 960–968.CrossRefGoogle Scholar
  28. 3D Group (2002). Benchmark study of North American 360-degree feedback practices. 3D Group Technical Report #8214. Berkeley, CA: Data Driven Decisions, Inc.Google Scholar
  29. 3D Group (2004). Current practices in 360-degree feedback. 3D Group Technical Report #8251. Berkeley, CA: Data Driven Decisions, Inc.Google Scholar
  30. 3D Group (2009). Current practices in 360-degree feedback: A benchmark study of North American companies. 3D Group Technical Report #8326. Berkeley, CA: Data Driven Decisions, Inc.Google Scholar
  31. Harris, M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 43–62.CrossRefGoogle Scholar
  32. Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32(2–3), 325–351.CrossRefGoogle Scholar
  33. Healy, M. C., & Rose, D. S. (2003). Validation of a 360-degree feedback instrument against sales: content matters. Paper presented at the 18th annual convention of the Society for Industrial and Organizational Psychology, Orlando, FL.Google Scholar
  34. Heidemeier, H., & Moser, K. (2009). Self-other agreement in job performance ratings: a meta-analytic test of a process model. Journal of Applied Psychology, 94, 353–370.PubMedCrossRefGoogle Scholar
  35. Kaiser, R. B., & Kaplan, R. E. (2006, May). Are all scales created equal? Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, Dallas, TX.Google Scholar
  36. Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284.CrossRefGoogle Scholar
  37. Lepsinger, R., & Lucia, A. D. (1998). The art and science of 360 degree feedback. San Francisco: Jossey-Bass.Google Scholar
  38. Lepsinger, R., & Lucia, A. D. (2009). The art and science of 360 degree feedback (2nd ed.). San Francisco: Jossey-Bass.Google Scholar
  39. London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture and the longitudinal performance management process. Human Resource Management Review, 12, 81–100.CrossRefGoogle Scholar
  40. London, M., Smither, J. W., & Adsit, D. L. (1998). Accountability: the Achilles’ heel of multisource feedback. Group and Organization Management, 22, 162–184.CrossRefGoogle Scholar
  41. Longenecker, C. O., Sims, H. P., & Gioia, D. A. (1987). Behind the mask: the politics of employee appraisal. The Academy of Management Executive, 1(3), 183–193.CrossRefGoogle Scholar
  42. Morgeson, F. P., Mumford, T. V., & Campion, M. A. (2005). Coming full circle: using research and practice to address 27 questions about 360-degree feedback programs. Consulting Psychology Journal: Research and Practice, 57, 196–209.CrossRefGoogle Scholar
  43. Mount, M. K., Judge, T. A., Scullen, S. E., Sytsma, M. R., & Hezlett, S. A. (1998). Trait, rater, and level effects in 360-degree performance ratings. Personnel Psychology, 51, 557–569.CrossRefGoogle Scholar
  44. Nowack, K. M. (2009). Leveraging multirater feedback to facilitate successful behavioral change. Consulting Psychology Journal: Practice and Research., 61(4), 280–297.CrossRefGoogle Scholar
  45. Pfau, B., & Kay, I. (2002). Does 360-degree feedback negatively affect company performance? Studies show that 360-degree feedback may do more harm than good. What’s the problem? HRMagazine, 47(6), 54–60.Google Scholar
  46. Rose, D. S., Farrell, T., & Robinson, G. N. (2004). Are narrative comments in 360-degree feedback useful or useless? Technical Report #8253. Berkeley, CA: Data Driven Decisions, Inc.Google Scholar
  47. Shipper, F., Hoffman, R. C., & Rotondo, D. M. (2007). Does the 360-feedback process create actionable knowledge equally across cultures? Academy of Management Learning & Education, 6(1), 33–50.CrossRefGoogle Scholar
  48. Siefert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. Journal of Applied Psychology, 88(3), 561–569.CrossRefGoogle Scholar
  49. Smith, A. F. R., & Fortunato, V. J. (2008). Factors influencing employee intentions to provide honest upward feedback ratings. Journal of Business and Psychology, 22, 191–207.CrossRefGoogle Scholar
  50. Smither, J. W., & Walker, A. G. (2004). Are the characteristics of narrative comments related to improvement in multirater feedback ratings over time? Journal of Applied Psychology, 89, 575–581.PubMedCrossRefGoogle Scholar
  51. Smither, J. W., London, M., Flautt, R., Vargas, Y., & Kucine, I. (2003). Can working with an executive coach improve multisource feedback ratings over time? A quasi-experimental field study. Personnel Psychology, 56, 23–44.CrossRefGoogle Scholar
  52. Smither, J. W., Walker, A. G., & Yap, M. K. T. (2004). An examination of the equivalence of web-based versus paper-and-pencil upward feedback ratings: Rater- and ratee-level analyses. Educational and Psychological Measurement, 64(1), 40–61.CrossRefGoogle Scholar
  53. Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. Personnel Psychology, 58, 33–66.CrossRefGoogle Scholar
  54. Thach, E. (2002). The impact of executive coaching and 360 feedback on leadership effectiveness. Leadership and Organization Development Journal, 23, 205–214.CrossRefGoogle Scholar
  55. Tornow, W., & London, M. (1998). Maximizing the value of 360-degree feedback: a process for successful individual and organization development. San Francisco: Jossey-Bass.Google Scholar
  56. Waldman, D. A., & Atwater, L. E. (1998). The power of 360° feedback. Houston, TX: Gulf Publishing Company.Google Scholar
  57. Waldman, D., Atwater, L., & Antonioni, D. (1998). Has 360 feedback gone amok? Academy of Management Executive, 12, 86–94.CrossRefGoogle Scholar
  58. Walker, A., & Smither, J. W. (1999). A five-year study of upward feedback: what managers do with their results matters. Personnel Psychology, 52(2), 393–423.CrossRefGoogle Scholar
  59. Yukl, G., & Lepsinger, R. (1995). How to get the most out of 360-degree feedback. Training, 32, 45–50.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.OrgVitality, LLCAtlantaUSA
  2. 2.3D GroupEmeryvilleUSA

Personalised recommendations