Skip to main content
SpringerLink
Log in

A two-dimensional analysis of student ratings of instruction

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

Student ratings of instruction were analyzed in terms of two global factors. One factor, which includes items on advanced planning, presentation clarity, and increased student knowledge, was named “pedagogical skill.” The other factor taps information about class discussion, grading, and the availability of help and was named “rapport.” Ratings on the “skill” factor did not covary with class size or the leniency of the instructor's grading but did correlate with a reasonable external criterion of student learning. Ratings of “rapport” correlated inversely with class size and directly with average class grade and showed only a weak relationship to the external criterion of student learning. The “skill” factor showed more interclass stability than the “rapport” factor. Previous research studies which have examined the reliability and validity of instructional ratings and their relationship to student grades and class size have reported inconsistent findings. These inconsistencies appear to result from an inappropriate unidimensional analysis of ratings which should be examined in terms of two of more separate attitude dimensions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adams, H. L. Favorable student evaluations as a function of instructor's age.Improving College and University Teaching 1973,21 72.

    Google Scholar 

  • Aleamoni, L. M. and Yimer, M. An investigation of the relationship between colleague rating, student rating, research productivity, and academic rank in rating instructional effectiveness.Journal of Educational Psychology 1973,64 274–277.

    Google Scholar 

  • Bendig, A. W. A factor analysis of student ratings of psychology instructors on the Purdue scale.Journal of Educational Psychology 1954,45 385–393.

    Google Scholar 

  • Bresler, J. B. Teaching effectiveness and government awards.Science 1968,160 164–167.

    Google Scholar 

  • Brown, D. L. Faculty ratings and student grades: A university-wide multiple regression analysis.Journal of Educational Psychology 1976,68 573–578.

    Google Scholar 

  • Clark, K. E. and Keller, R. J. Student ratings of college teaching. In R. E. Eckert and R. I. Keller (Eds.),A University Looks At Its Program. Minneapolis, MN: The University of Minnesota Press, 1954.

    Google Scholar 

  • Cohen, S. A. and Berger, W. G. Dimensions of students' ratings of college instructors underlying subsequent achievement on course examinations.Proceedings of the 78th Annual Convention of the American Psychological Association 1970,5 605–606. (Summary)

    Google Scholar 

  • Costin, F. A graduate course in the teaching of psychology: Description and evaluation.Journal of Teacher Education 1968,19 425–432.

    Google Scholar 

  • Creager, J. A. A multiple-factor analysis of the Purdue rating scale for instructors.Purdue University Studies in Higher Education 1950,70 75–96.

    Google Scholar 

  • Dent, P. L. and Lewis, D. L. Teaching effectiveness and measures of research quality.Educational Research Quarterly 1976,1 3–16.

    Google Scholar 

  • Deshpande, A. S., Webb, S. C., and Marks, E. Student perceptions of engineering instructor behaviors and their relationships to the evaluation of instructors and courses.American Educational Research Journal 1976,7 289–306.

    Google Scholar 

  • Downie, N. W. Student evaluation of faculty.Journal of Higher Education 1952,23 495–496, 503.

    Google Scholar 

  • Ebel, R. L. Estimation of the reliability of ratings.Psychometrika 1951,16 407–424.

    Google Scholar 

  • Elliott, D. H. Characteristics and relationships of various criteria of colleges and university teaching.Purdue University Studies in Higher Education 1950,70 5–61.

    Google Scholar 

  • Feldman, K. A. Grades and college students' evaluations of their courses and teachers.Research in Higher Education 1976a,4 69–111.

    Google Scholar 

  • Feldman, K. A. The superior college teacher from the students' view.Research in Higher Education 1976b,5 243–288.

    Google Scholar 

  • Finkbeiner, C. T., Lathrop, J. S., and Schverger, J. M. Course and instructor evaluation: Some dimensions of a questionnaire.Journal of Educational Psychology 1973,64 159–163.

    Google Scholar 

  • Frey, P. W. Student ratings of teaching: Validity of several rating factors.Science 1973,182 83–85.

    Google Scholar 

  • Frey, P. W. Validity of student instructional ratings: Does timing matter?J. Higher Education 1976,67 327–336.

    Google Scholar 

  • Frey, P. W., Leonard, D. W., and Beatty, W. W. Student ratings of instruction: Validation research.American Educational Research Journal 1975,12 435–447.

    Google Scholar 

  • Gage, N. L. The appraisal of college teaching.Journal of Higher Education 1961,32 17–22.

    Google Scholar 

  • Gessner, P. K. Evaluation of instruction.Science 1973,180 566–570.

    Google Scholar 

  • Goodhartz, A. S. Student attitudes and opinions relating to teaching at Brooklyn College.School and Society 1948,68 345–349.

    Google Scholar 

  • Guthrie, E. R. The evaluation of teaching: A progress report. Seattle, Wash.: University of Washington, 1954.

    Google Scholar 

  • Harry, J. and Goldner, N. S. The Null relationship between teaching and research.Sociology of Education 1972,45 47–60.

    Google Scholar 

  • Hayes, J. R. Research, teaching, and faculty fate.Science 1971,172 227–230.

    Google Scholar 

  • Heilman, J. D. and Armentrout, W. D. The rating of college teachers on ten traits by their students.Journal of Educational Psychology 1936,27 197–216.

    Google Scholar 

  • Hildebrand, M., Wilson, R. C., and Dienst, E. R.Evaluating University Teaching. Berkeley: Center for Research and Development in Higher Education, University of California, 1971.

    Google Scholar 

  • Hoyt, D. P. Interrelationships among instructional effectiveness, publication record, and monetary reward.Research in Higher Education 1974,2 81–88.

    Google Scholar 

  • Isaacson, R. L., McKeachie, W. J., Milholland, J. E., Lin, Y. G., Hofeller, M., Baerwaldt, J. W., and Zinn, K. Dimensions of student evaluations of teaching.Journal of Educational Psychology 1964,55 344–351.

    Google Scholar 

  • Jiobu, R. M. and Pollis, C. A. Student evaluations of courses and instructors.American Sociologist 1971,6 317–321.

    Google Scholar 

  • Kohlan, R. G. A comparison of faculty evaluations early and late in the course.Journal of Higher Education 1973,44 587–595.

    Google Scholar 

  • Kossoff, E. Evaluating college professors by “scientific” methods.American Scholar 1971,41 79–93.

    Google Scholar 

  • Kulik, J. A. and Kulik, C. C. Student ratings of instruction.Teaching of Psychology 1974,1 51–57.

    Google Scholar 

  • Linsky, A. S. and Straus, M. A. Student evaluations, research productivity, and eminence of college faculty.Journal of Higher Education 1975,46 89–102.

    Google Scholar 

  • Lofthouse, S. Thoughts on “publish or perish”.Higher Education 1974,3 59–80.

    Google Scholar 

  • Lovell, G. D. and Haner, C. F. Forced-choice applied to college faculty rating.Educational and Psychological Measurement 1955,15 291–304.

    Google Scholar 

  • Marsh, H. W., Fleiner, H., and Thomas, C. S. Validity and usefulness of student evaluations of instructional quality.Journal of Educational Psychology 1975,67 833–839.

    Google Scholar 

  • McDaniel, E. D. and Feldhusen, J. F. Relationships between faculty ratings and indexes of service and scholarship.Proceedings of the 78th Annual Convention of the American Psychological Association 1970,5 619–620.

    Google Scholar 

  • Morsh, J. E., Burgess, G. G., and Smith, P. N. Student achievement as a measure of instructor effectiveness.Journal of Educational Psychology 1956,47 79–88.

    Google Scholar 

  • Naftulin, D. H., Ware, J. E., and Donnelly, F. A. The Doctor Fox lecture: A paradigm of educational seduction.Journal of Medical Education 1973,48 630–635.

    Google Scholar 

  • Nie, N. H., Hull, C. H., Jenkins, J. G., Steinbrenner, K., and Bent, D. H.Statistical Package for the Social Sciences. New York: McGraw-Hill, 1975.

    Google Scholar 

  • Pritchard, W. M. Student evaluation of college physics teaching.Journal of Research in Science Teaching 1972,9 383–384.

    Google Scholar 

  • Rayder, N. F. College student ratings of instructors.The Journal of Experimental Education 1968,37 76–81.

    Google Scholar 

  • Remmers, H. H. To what extent do grades influence student ratings of instructors.Journal of Educational Research 1930,21 314–316.

    Google Scholar 

  • Remmers, H. H., Martin, F. D., and Elliott, D. N. Are students' ratings of instructors related to their grades?Purdue University Studies in Higher Education 1949,66 17–26.

    Google Scholar 

  • Riley, J. W., Ryan, B. F., and Lifschitz, M.The Student Looks at his Teacher. New Brunswick, NJ: Rutgers Univ. Press, 1950.

    Google Scholar 

  • Rodin, M. and Rodin, B. Student evaluations of teachers.Science 1972,177 1164–1166.

    Google Scholar 

  • Rosenshine, B., Cohen, A., and Furst, N. Correlates of student preference ratings.Journal of College Student Personnel 1973,14 269–272.

    Google Scholar 

  • Solomon, D. Teacher behavior dimensions, course characteristics, and student evaluations of teachers.American Educational Research Journal 1966,3 35–47.

    Google Scholar 

  • Smalzreid, N. T. and Remmers, H. H. A factor analysis of the Purdue rating scale for instructors.Journal of Educational Psychology 1943,34 363–367.

    Google Scholar 

  • Spencer, R. E. and Aleamoni, L. M. A student course evaluation questionnaire.Journal of Educational Measurement 1970,7 209–210.

    Google Scholar 

  • Stallings, W. M. and Singhal, S. Some observations on the relationship between research productivity and student evaluation of courses and teaching. In. V. Crockenberg (Ed.),Aera Paper Abstracts. Washington, D.C.: American Educational Research Association, 1969.

    Google Scholar 

  • Sullivan, A. M. and Skanes, G. R. Validity of student evaluation of teaching and the characteristics of successful instructors.Journal of Educational Psychology 1974,66 584–590.

    Google Scholar 

  • Turner, R. L. Good teaching and its contexts.Phi Delta Kappan 1970,52 155–158.

    Google Scholar 

  • Voeks, V. W. Publications and teaching effectiveness.Journal of Higher Education 1962,23 212–218.

    Google Scholar 

  • Ware, J. and Williams, R. The Doctor Fox effect: A study of lecturer effectiveness and ratings of instruction.Journal of Medical Education 1975,50 149–155.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Northwestern University, 60201, Evanston, IL

    Peter W. Frey

Authors
  1. Peter W. Frey
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Frey, P.W. A two-dimensional analysis of student ratings of instruction. Res High Educ 9, 69–91 (1978). https://doi.org/10.1007/BF00979187

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00979187

Key words

Search

Navigation