Skip to main content
Log in

Predicting the gap: perceptual congruence between American principals and their teachers’ ratings of leadership effectiveness

  • Published:
Educational Assessment, Evaluation and Accountability Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

The aim of this study is to determine the extent to which principals’ self-ratings of leadership effectiveness coincide with their teachers’ perceptions of their leadership effectiveness. Furthermore, we explore several characteristics of teachers and principals in an attempt to identify the factors that may predict congruence in perceptions of leadership. This study draws from survey data of 76 principals and over 2100 teachers who completed parallel forms of a 72-item Learning-Centered Leadership survey (VAL-ED©) in the USA. Teacher and principal characteristics are incorporated into a multivariate regression analysis. Although there is zero difference in the overall sample, teachers and principals within any given school seldom share the same perspective. Principals’ self-efficacy was a strong predictor of principals rating themselves higher than the teachers. Interestingly, the more time a teacher spent with a principal, the less congruence they shared. This research has identified rather large disparities in perceptions of leadership between teachers and their principals. Such a gap suggests that teachers have information and perspectives on school leadership distinct from the principals’ information and perspectives. This research provides evidence that structured teacher feedback may provide a useful avenue for principals seeking additional perspectives on their leadership effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. A detailed analysis of the reliability and validity of the VAL-ED can be found in Porter et al. (2010); A full explication of the conceptual and theoretical foundations of the VAL-ED can be found in Murphy et al. (2007).

  2. The data for this paper are part of a larger project studying the effect of feedback and coaching on school leaders where additional data were collected.

References

  • Adkison, J. A. (1981). Women in school administration: a review of the research. Review of Educational Research, 51(3), 311.

    Article  Google Scholar 

  • Atwater, L., Ostroff, C., Yammarino, F. J., & Fleenor, J. W. (1998). Self-other agreement: does it really matter? Personal Psychology, 51, 577–598.

    Article  Google Scholar 

  • Atwater, L., Roush, P., & Fischthal, A. (1995). The influence of upward feedback on self- and follower ratings of leadership. Personnel Psychology, 48(1), 35–59.

  • Atwater, L., & Yammarino, F. J. (1992). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions? Personal Psychology, 45, 141–163.

    Article  Google Scholar 

  • Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37(2), 122.

    Article  Google Scholar 

  • Bandura, A. (1997). Self-efficacy: the exercise of control. New York: Freeman.

    Google Scholar 

  • Bandura, A. (2006). Guide for constructing self-efficacy scales. Self-Efficacy Beliefs of Adolescents, 5, 307–337.

    Google Scholar 

  • Benlian, A. (2013). Are we aligned… enough? The effects of perceptual congruence between service teams and their leaders on team performance. Journal of Service Research. doi:10.1177/1094670513516673.

    Google Scholar 

  • Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47(10), 1114.

    Article  Google Scholar 

  • Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatric Services, 62(12), 1423–1429.

    Article  Google Scholar 

  • Blase, J., & Blase, J. (1999). Principals’ instructional leadership and teacher development: teachers’ perspectives. Educational Administration Quarterly, 35(3), 349.

    Article  Google Scholar 

  • Bono, J. E., & Colbert, A. E. (2005). Understanding responses to multisource feedback: the role of core self-evaluations. Personnel Psychology, 58(1), 171–203.

  • Boyd, B. B., & Jensen, J. M. (1972). Perceptions of the first-line supervisor’s authority: a study in superior-subordinate communication. The Academy of Management Journal, 15(3), 331–342.

    Article  Google Scholar 

  • Brooks, S. P., & Gelman, A. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7, 434–455.

    Google Scholar 

  • Brutus, S., Fleenor, J. W., & McCauley, C. D. (1999). Demographic and personality predictors of congruence in multi-source ratings. The Journal of Management Development, 18(5), 417–435.

    Article  Google Scholar 

  • Conway, J. M., & Huffcutt, A. I. (1997). Psychometric properties of multisource performance ratings: a meta-analysis of subordinate, supervisor, peer, and self-ratings. Human Performance, 10(4), 331–360.

  • Church, A. H. (1997). Do you see what I see? an exploration of congruence in ratings from muItiple perspectives. Journal of Applied Psychology, 27(11), 983–1020.

    Google Scholar 

  • Clark, D., Martorell, P., & Rockoff, J. (2009). School Principals and School Performance. CALDER. Available from http://www.urban.org/url.cfm?ID=1001427.

  • Cronbach, L. J., & Gleser, G. C. (1953). Assessing similarity between profiles. Psychological Bulletin, 50(6), 456–473.

    Article  Google Scholar 

  • Coburn, C. E., & Russell, J. L. (2008). District policy and teachers’ social networks. Educational Evaluation and Policy Analysis, 30(3), 203–235

  • Daubman, K. A., Heatherington, L., & Ahn, A. (1992). Gender and the self-presentation of academic achievement. Sex Roles, 27(3–4), 187–204.

  • Doud, J. L., & Keller, E. P. (1998). The K-8 principal in 1998: a ten-year study. Alexandria, VA: National Association of Elementary School Principals.

    Google Scholar 

  • Edwards, J. R. (1995). Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organizational Behavior and Human Decision Processes, 64(3), 307–324.

    Article  Google Scholar 

  • Festinger, L. (1957). A theory of cognitive dissonance. Stanford: Stanford University Press.

    Google Scholar 

  • Fiebig, D. G. (2001). Seemingly unrelated regression. A companion to theoretical econometrics, 101–121.

  • Fiedler, F. E. (1972). The effects of leadership training and experience: a contingency model interpretation. Administrative Science Quarterly, 17, 453–470.

    Article  Google Scholar 

  • Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–511.

    Article  Google Scholar 

  • Ginsberg, R., & Berry, B. (1990). The folklore of principal evaluation. Journal of Personnel Evaluation in Education, 3, 205–230.

    Article  Google Scholar 

  • Gist, M. E., & Mitchell, T. R. (1992). Self-efficacy: a theoretical analysis of its determinants and malleability. Academy of Management Review, 17, 183–211.

    Google Scholar 

  • Glasman, N. S. (1984). Student achievement and the school principal. Educational Evaluation and Policy Analysis, 6(3), 283–296.

    Article  Google Scholar 

  • Goe, L. (2007). The link between teacher quality and student outcomes: a research synthesis. Washington, DC: National Comprehensive Center for Teacher Quality.

  • Goldring, E., Cravens, X. C., Murphy, J., Porter, A. C., Elliott, S. N., & Carson, B. C. (2009). The evaluation of principals: what and how do states and urban districts assess leadership? The Elementary School Journal, 110(1), 19–39.

    Article  Google Scholar 

  • Greenwald, A. G., & Ronis, D. L. (1978). Twenty years of cognitive dissonance: case study of the evolution of a theory. Psychological Review, 85(1), 53.

  • Grissom, J. A., & Keiser, L. R. (2011). A supervisor like me: race, representation, and the satisfaction and turnover decisions of public sector employees. Journal of Policy Analysis and Management, 30(3), 557–580.

    Article  Google Scholar 

  • Gross, N. C., & Trask, A. E. (1976). The sex factor and the management of schools. New York: John Wiley & Sons.

    Google Scholar 

  • Hallinger, P. (2003). Leading educational change: Reflections on the practice of instructional and transformational leadership. Cambridge Journal of Education, 33(3), 329–352.

  • Hallinger, P., Bickman, L., & Davis, K. (1996). School context, principal leadership, and student reading achievement. The Elementary School Journal, 96(5), 527–549.

  • Hallinger, P., & Heck, R. H. (2010). Collaborative leadership and school improvement: understanding the impact on school capacity and student learning. School Leadership and Management, 30(2), 95–110.

  • Hallinger, P., & Murphy, J. (1985). Assessing the instructional management behavior of principals. The Elementary School Journal, 86(2), 217–247.

    Article  Google Scholar 

  • Ladd, H. F. (2011). Teachers’ perceptions of their working conditions: how predictive of planned and actual teacher movement? Educational Evaluation and Policy Analysis, 33(2), 235–261.

    Article  Google Scholar 

  • Leithwood, K., & Jantzi, D. (1990). Transformational leadership: how principals can help reform school cultures. School Effectiveness and School Improvement, 1(4), 249–280.

    Article  Google Scholar 

  • Leithwood, K. A., & Montgomery, D. J. (1986). Improving principal effectiveness: the principal profile. Toronto, Ontario: Ontario Institute for Studies in Education.

    Google Scholar 

  • Locke, E. A., Frederick, E., Lee, C., & Bobko, P. (1984). Effect of self-efficacy, goals, and task strategies on task performance. Journal of Applied Psychology, 69(2), 241.

    Article  Google Scholar 

  • Locke, E. A., & Latham, G. P. (1990). A theory of goal setting & task performance. Englewood Cliffs, NJ: Prentice-Hall, Inc.

  • Loeb, S., Darling-Hammond, L., & Luczak, J. (2005). How teaching conditions predict teacher turnover in California schools. Peabody Journal of Education, 80(3), 44–70.

    Article  Google Scholar 

  • Louis, K. S., Marks, H. M., & Kruse, S. (1996). Teachers’ professional community in restructuring schools. American Educational Research Journal, 33(4), 757–798.

  • Mandemakers, J. J., & Dykstra, P. A. (2008). Discrepancies in parent’s and adult child’s reports of support and contact. Journal of Marriage and Family, 70(2), 495–506.

    Article  Google Scholar 

  • McCauley, C. D., & Moxley, R. S. (1996). Developmental 360: how feedback can make managers more effective. Career Development International, 1(3), 15–19.

    Article  Google Scholar 

  • Moore, J. E. (2000). Why is this happening? A causal attribution approach to work exhaustion consequences. Academy of Management Review, 25, 335–349.

    Google Scholar 

  • Murphy, J., Elliott, S. N., Goldring, E., & Porter, A. C. (2007). Leadership for learning: a research-based model and taxonomy of behaviors. School Leadership and Management, 27(2), 179–201.

    Article  Google Scholar 

  • Murphy, J., & Hallinger, P. (1992). The principalship in an era of transformation. Journal of Educational Administration, 30(3), 77–78.

  • Polikoff, M. S., May, H., Porter, A. C., Elliott, S. N., & Goldring, E. (2009). An examination of differential item functioning on the Vanderbilt assessment of educational leadership. Journal of School Leadership, 19(6), 662–679.

    Google Scholar 

  • Porter, A. C., Murphy, J., Goldring, E., Elliott, S. N., Polikoff, M. S., & May, H. (2009). VAL-ED technical manual. Nashville, TN: Vanderbilt University.

    Google Scholar 

  • Porter, A. C., Polikoff, M. S., Goldring, E., Murphy, J., Elliot, S. N., & May, H. (2010). Investigating the validity and reliability of the Vanderbilt assessment of leadership in education. The Elementary School Journal, 111(2), 282–313.

    Article  Google Scholar 

  • Pedhazur, E. J. (1982). Multiple regression in behavioral research: Explanation and prediction. Holt Rinehart and Winston.

  • Reauthorization of ESEA, http://www2.ed.gov/policy/elsec/leg/blueprint/blueprint.pdf. Accessed 20 March 2010

  • Reeves, D. B. (2008). Assessing educational leaders: evaluating performance for improved individual and organizational results (2nd ed.). Thousand Oaks, CA: Corwin Press.

    Google Scholar 

  • Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. Social Psychology and Evaluation, 104.

  • Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14(2), 241–254.

    Article  Google Scholar 

  • Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys (vol. 519). Wiley Online Library.

  • Rotter, J. B. (1954). Social learning and clinical psychology. Englewood Cliffs, NJ: Prentice-Hall.

    Book  Google Scholar 

  • Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: theory, research, and practice. Journal of Clinical Psychology, 61(2), 145–153.

    Article  Google Scholar 

  • Shope, S. C. (2013). Developing an instrument to measure perceptual congruence among K-12 public school principals. Doctoral dissertation, Ohio University.

  • Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personality Psychology, 58, 33–66.

    Article  Google Scholar 

  • Stajkovic, A. D., & Luthans, F. (1998). Self-efficacy and work-related performance: a meta-analysis. Psychological Bulletin, 124, 240–261.

    Article  Google Scholar 

  • Tschannen-Moran, M., & Gareis, C. R. (2004). Principals’ sense of efficacy: assessing a promising construct. Journal of Educational Administration, 42(5), 573–585.

    Article  Google Scholar 

  • Urick, A., & Bowers, A. J. (2013). What are the different types of principals across the United States? A latent class analysis of principal perception of leadership. Educational Administration Quarterly, 0013161X13489019.

  • Weiner, B. (1985). An attributional theory of achievement motivation and emotion. Psychological Review, 92(4), 548–573. doi:10.1037/0033-295X.92.4.548.

    Article  Google Scholar 

  • Walker, A. G., Smither, J. W., Atwater, L. E., Dominick, P. G., Brett, J. F., & Reilly, R. R. (2010). Personality and multisource feedback improvement: a longitudinal investigation. Journal of Behavioral and Applied Management, 11(2), 175–204.

    Google Scholar 

  • Zellner, A. (1962). An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. Journal of the American Statistical Association, 57, 348–368.

    Article  Google Scholar 

Download references

Acknowledgments

This study was made possible through the generous support of the Improving Principal Leadership through Feedback and Coaching project from the U.S. Department of Education’s Institute of Education Sciences (IES). Funding for Peter Goff was provided by an IES grant through Vanderbilt’s ExpERT program for doctoral training (R305B040110).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter T Goff.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goff, P.T., Goldring, E. & Bickman, L. Predicting the gap: perceptual congruence between American principals and their teachers’ ratings of leadership effectiveness. Educ Asse Eval Acc 26, 333–359 (2014). https://doi.org/10.1007/s11092-014-9202-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11092-014-9202-5

Keywords

Navigation