Skip to main content
SpringerLink
Log in

When Does 360-Degree Feedback Create Behavior Change? And How Would We Know It When It Does?

  • Published:
Journal of Business and Psychology Aims and scope Submit manuscript

Abstract

360-degree feedback has great promise as a method for creating both behavior change and organization change, yet research demonstrating results to this effect has been mixed. The mixed results are, at least in part, because of the high degree of variation in design features across 360 processes. We identify four characteristics of a 360 process that are required to successfully create organization change, (1) relevant content, (2) credible data, (3) accountability, and (4) census participation, and cite the important research issues in each of those areas relative to design decisions. In addition, when behavior change is created, the data must be sufficiently reliable to detect it, and we highlight current and needed research in the measurement domain, using response scale research as a prime example.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. The authors have had frequent interaction with Allan Church on this topic over the years, and note that his views and practices have evolved to be more supportive of the use of 360-degree feedback for decision-making purposes.

References

  • Antonioni, D., & Woehr, D. J. (2001). Improving the quality of multisource rater performance. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Atwater, L. E., & Brett, J. F. (2005). Antecedents and consequences of reactions to developmental 360° feedback. Journal of Vocational Behavior, 66, 532–548.

    Article  Google Scholar 

  • Atwater, L. E., & Waldman, D. (1998). Accountability in 360-degree feedback. HR Magazine, 43, 96–104.

    Google Scholar 

  • Atwater, L. W., Wang, M., Smither, J. W., & Fleenor, J. W. (2009). Are cultural characteristics associated with the relationship between self and others’ ratings of leadership? Journal of Applied Psychology, 94, 876–886.

    Article  PubMed  Google Scholar 

  • Bass, B. M., Cascio, W. F., & O’Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59(3), 313–320.

    Article  Google Scholar 

  • Bono, J., & Colbert, A. (2005). Understanding responses to multi-source feedback: the role of core self-evaluations. Personnel Psychology, 58, 171–203.

    Article  Google Scholar 

  • Bracken, D. W. (1994). Straight talk about multirater feedback. Training & Development, 48, 44–51.

    Google Scholar 

  • Bracken, D. W. (1996). Multisource (360-degree) feedback: surveys for individual and organizational development. In A. I. Kraut (Ed.), Organizational surveys. San Francisco: Jossey-Bass.

    Google Scholar 

  • Bracken, D. W., & Paul, K. B. (1993, May). The effects of scale type and demographics on upward feedback. Paper presented at the Society for Industrial and Organizational Society Annual Conference, San Francisco, CA.

  • Bracken, D. W., & Timmreck, C. W. (2001a). Success and Sustainability: a systems view of multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Bracken, D. W., & Timmreck, C. W. (2001b). Guidelines for multisource feedback when used for decision making purposes. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Bracken, D. W., Timmreck, C. W., & Church, A. H. (2001a). The handbook of multisource feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Bracken, D. W., Timmreck, C. W., Fleenor, J. W., & Summers, L. (2001b). 360 degree feedback from another angle. Human Resource Management, 40(1), 3–20.

    Article  Google Scholar 

  • Brett, J., & Atwater, L. (2001). 360-degree feedback: accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology, 86, 930–942.

    Article  PubMed  Google Scholar 

  • Caputo, P., & Roch, S. (2009, April). Rating formats and perceptions of performance appraisal fairness. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

  • Church, A. H., Walker, A. G., & Brockner, J. (2002). Multisource feedback for organization development and change. In J. Waclawski & A. H. Church (Eds.), Organization development: a data-driven approach to organizational change. San Francisco: Jossey-Bass.

    Google Scholar 

  • Conway, J., & Huffcutt, A. (1997). Psychometric properties of multi-source performance ratings: a meta-analysis of subordinate, supervisor, peer and self ratings. Human Performance, 10, 331–360.

    Article  Google Scholar 

  • Craig, S. B., & Hannum, K. (2006). Research update: 360-degree performance assessment. Consulting Psychology Journal: Research and Practice, 58, 117–122.

    Article  Google Scholar 

  • Dalton, M. A. (1997). When the purpose of using multi-rater feedback is behavior change. In D. Bracken, et al. (Eds.), Should 360 degree feedback be used only for development purposes?. Greensboro, NC: Center for Creative Leadership.

    Google Scholar 

  • DeNisi, A. S., & Kluger, A. N. (2000). Feedback effectiveness: can 360-degree appraisals be improved? Academy of Management Executive, 14, 129–139.

    Article  Google Scholar 

  • Edwards, M., & Ewen, A. (1996). 360° feedback: the powerful new tool for employee assessment and performance improvement. New York: AMACOM.

    Google Scholar 

  • English, A. E., Rose, D. S., & McClellan, J. (2009, April). Rating scale label effects on leniency bias in 360-degree feedback. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, New Orleans, LA.

  • Fleenor, J. W., Taylor, S., & Chappelow, C. (2008). Leveraging the impact of 360-degree feedback. San Francisco: Pfeiffer.

  • Gillespie, T. L. (2005). Internationalizing 360-degree feedback: are subordinate ratings comparable? Journal of Business and Psychology, 19(3), 361–382.

    Article  Google Scholar 

  • Goldsmith, M., & Morgan, H. (2004). Leadership is a contact sport: the “follow-up” factor in management development. Strategy + Business, 36, 71–79.

    Google Scholar 

  • Goldsmith, M., & Underhill, B. O. (2001). Multisource feedback for executive development. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Greguras, G. J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. Journal of Applied Psychology, 83, 960–968.

    Article  Google Scholar 

  • 3D Group (2002). Benchmark study of North American 360-degree feedback practices. 3D Group Technical Report #8214. Berkeley, CA: Data Driven Decisions, Inc.

  • 3D Group (2004). Current practices in 360-degree feedback. 3D Group Technical Report #8251. Berkeley, CA: Data Driven Decisions, Inc.

  • 3D Group (2009). Current practices in 360-degree feedback: A benchmark study of North American companies. 3D Group Technical Report #8326. Berkeley, CA: Data Driven Decisions, Inc.

  • Harris, M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 43–62.

    Article  Google Scholar 

  • Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32(2–3), 325–351.

    Article  Google Scholar 

  • Healy, M. C., & Rose, D. S. (2003). Validation of a 360-degree feedback instrument against sales: content matters. Paper presented at the 18th annual convention of the Society for Industrial and Organizational Psychology, Orlando, FL.

  • Heidemeier, H., & Moser, K. (2009). Self-other agreement in job performance ratings: a meta-analytic test of a process model. Journal of Applied Psychology, 94, 353–370.

    Article  PubMed  Google Scholar 

  • Kaiser, R. B., & Kaplan, R. E. (2006, May). Are all scales created equal? Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, Dallas, TX.

  • Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284.

    Article  Google Scholar 

  • Lepsinger, R., & Lucia, A. D. (1998). The art and science of 360 degree feedback. San Francisco: Jossey-Bass.

    Google Scholar 

  • Lepsinger, R., & Lucia, A. D. (2009). The art and science of 360 degree feedback (2nd ed.). San Francisco: Jossey-Bass.

    Google Scholar 

  • London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture and the longitudinal performance management process. Human Resource Management Review, 12, 81–100.

    Article  Google Scholar 

  • London, M., Smither, J. W., & Adsit, D. L. (1998). Accountability: the Achilles’ heel of multisource feedback. Group and Organization Management, 22, 162–184.

    Article  Google Scholar 

  • Longenecker, C. O., Sims, H. P., & Gioia, D. A. (1987). Behind the mask: the politics of employee appraisal. The Academy of Management Executive, 1(3), 183–193.

    Article  Google Scholar 

  • Morgeson, F. P., Mumford, T. V., & Campion, M. A. (2005). Coming full circle: using research and practice to address 27 questions about 360-degree feedback programs. Consulting Psychology Journal: Research and Practice, 57, 196–209.

    Article  Google Scholar 

  • Mount, M. K., Judge, T. A., Scullen, S. E., Sytsma, M. R., & Hezlett, S. A. (1998). Trait, rater, and level effects in 360-degree performance ratings. Personnel Psychology, 51, 557–569.

    Article  Google Scholar 

  • Nowack, K. M. (2009). Leveraging multirater feedback to facilitate successful behavioral change. Consulting Psychology Journal: Practice and Research., 61(4), 280–297.

    Article  Google Scholar 

  • Pfau, B., & Kay, I. (2002). Does 360-degree feedback negatively affect company performance? Studies show that 360-degree feedback may do more harm than good. What’s the problem? HRMagazine, 47(6), 54–60.

    Google Scholar 

  • Rose, D. S., Farrell, T., & Robinson, G. N. (2004). Are narrative comments in 360-degree feedback useful or useless? Technical Report #8253. Berkeley, CA: Data Driven Decisions, Inc.

  • Shipper, F., Hoffman, R. C., & Rotondo, D. M. (2007). Does the 360-feedback process create actionable knowledge equally across cultures? Academy of Management Learning & Education, 6(1), 33–50.

    Article  Google Scholar 

  • Siefert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. Journal of Applied Psychology, 88(3), 561–569.

    Article  Google Scholar 

  • Smith, A. F. R., & Fortunato, V. J. (2008). Factors influencing employee intentions to provide honest upward feedback ratings. Journal of Business and Psychology, 22, 191–207.

    Article  Google Scholar 

  • Smither, J. W., & Walker, A. G. (2004). Are the characteristics of narrative comments related to improvement in multirater feedback ratings over time? Journal of Applied Psychology, 89, 575–581.

    Article  PubMed  Google Scholar 

  • Smither, J. W., London, M., Flautt, R., Vargas, Y., & Kucine, I. (2003). Can working with an executive coach improve multisource feedback ratings over time? A quasi-experimental field study. Personnel Psychology, 56, 23–44.

    Article  Google Scholar 

  • Smither, J. W., Walker, A. G., & Yap, M. K. T. (2004). An examination of the equivalence of web-based versus paper-and-pencil upward feedback ratings: Rater- and ratee-level analyses. Educational and Psychological Measurement, 64(1), 40–61.

    Article  Google Scholar 

  • Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. Personnel Psychology, 58, 33–66.

    Article  Google Scholar 

  • Thach, E. (2002). The impact of executive coaching and 360 feedback on leadership effectiveness. Leadership and Organization Development Journal, 23, 205–214.

    Article  Google Scholar 

  • Tornow, W., & London, M. (1998). Maximizing the value of 360-degree feedback: a process for successful individual and organization development. San Francisco: Jossey-Bass.

    Google Scholar 

  • Waldman, D. A., & Atwater, L. E. (1998). The power of 360° feedback. Houston, TX: Gulf Publishing Company.

    Google Scholar 

  • Waldman, D., Atwater, L., & Antonioni, D. (1998). Has 360 feedback gone amok? Academy of Management Executive, 12, 86–94.

    Article  Google Scholar 

  • Walker, A., & Smither, J. W. (1999). A five-year study of upward feedback: what managers do with their results matters. Personnel Psychology, 52(2), 393–423.

    Article  Google Scholar 

  • Yukl, G., & Lepsinger, R. (1995). How to get the most out of 360-degree feedback. Training, 32, 45–50.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. OrgVitality, LLC, PO Box 88491, Atlanta, GA, 30356, USA

    David W. Bracken

  2. 3D Group, Emeryville, CA, USA

    Dale S. Rose

Authors
  1. David W. Bracken
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dale S. Rose
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David W. Bracken.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bracken, D.W., Rose, D.S. When Does 360-Degree Feedback Create Behavior Change? And How Would We Know It When It Does?. J Bus Psychol 26, 183–192 (2011). https://doi.org/10.1007/s10869-011-9218-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10869-011-9218-5

Keywords

Search

Navigation