Skip to main content
Log in

The significance of circumstances for college students' ratings of their teachers and courses

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

Although firm generalizations and conclusions cannot yet be drawn from the extant research on the effects on teacher and course ratings of the circumstances surrounding these evaluations, at least some studies have shown that college students' ratings of their teachers and courses are somewhat higher when students remain anonymous rather than identifying themselves, when the purported use of the ratings is an official or administrative one for use in salary, promotion, or tenure considerations rather than otherwise, and when the instructor is present rather than absent during the rating session. (The differences between each of these contrasted circumstances are usually rather small and do not inevitably appear across studies.) Certain variations in rating format have been found to make a difference in the ratings obtained, whereas other have not. From limited evidence, the exact timing (or occasion) of evaluation appears not to be important to ratings. Variability in sampling procedures, as it affects the composition of students available to complete rating forms, may or may not turn out to be a generally important element in ratings (as directly relevant data are collected). The analysis concludes with a discussion of (1) the presumed “bias” in ratings produced in certain of the rating conditions and (2) the more general issue of the comparability of ratings made in different circumstances of evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Abrami, P. C., Leventhal, L., Perry, R. P., and Breen, L. J. Course evaluation: How?Journal of Educational Psychology, 1976,68 300–304.

    Google Scholar 

  • Aleamoni, L. M., and Hexner, P. Z. The effect of different sets of instructions on student course and instructor evaluation. Research Report No. 339. Urbana-Champaign, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois, 1973.

    Google Scholar 

  • Anikeef, A. M. Factors affecting student evaluation of college faculty members.Journal of Applied Psychology 1953,37 458–460.

    Google Scholar 

  • Baril, G. L., and Skaggs, C. T., The effects of course evaluation format on response bias. Unpublished manuscript, n.d.

  • Baril, G. L., and Skaggs, C. T. Student-faculty evaluation project: Item development and validation. Report No. 375-1. Orono, Maine: Office of Testing and Research, University of Maine at Orono, 1975.

    Google Scholar 

  • Baril, G. L., and Skaggs, C. T. Selecting items for a college course evaluation form.College Student Journal 1976,10 183–187.

    Google Scholar 

  • Bendig, A. W. A statistical report on a revision of the Miami Instructor Rating Sheet.Journal of Educational Psychology, 1952,43 423–429.

    Google Scholar 

  • Bledsoe, J. C. Insight into one's own teaching through feedback from students' evaluations.Psychological Reports, 1975,37 1189–1190.

    Google Scholar 

  • Blum, M. L. An investigation of the relation existing between students' grades and their ratings of the instructor's ability to teach.Journal of Educational Psychology, 1936,27, 217–221.

    Google Scholar 

  • Brooks, D. W., and Levenson, H. Questions and answers about answers to questions.Journal of Chemical Education, 1974,51 161–162.

    Google Scholar 

  • Brown, D. L. Faculty ratings and student grades: A university-wide multiple regression analysis.Journal of Educational Psychology, 1976,68 573–578.

    Google Scholar 

  • Carrier, N. A., Howard, G. S., and Miller, W. G. Course evaluations: When?Journal of Educational Psychology, 1974,66 609–613.

    Google Scholar 

  • Centra, J. A. Two studies on the utility of student ratings for improving teaching: I. The effectiveness of student feedback in modifying college instruction. II. Self-ratings of college teachers: a comparison with student ratings. SIR Report No. 2. Princeton, N. J.: Educational Testing Service, 1972.

    Google Scholar 

  • Centra, J. A. The influence of different directions on student ratings of instruction.Journal of Educational Measurement, 1976,13 277–282.

    Google Scholar 

  • Centra, J. A., and Creech, F. R. The relationship between student, teacher, and course characteristics and student ratings of teacher effectiveness. PR-76-1. Princeton, N.J.: Educational Testing Service, 1976.

    Google Scholar 

  • Colliver, J. A. A report on student evaluation of faculty teaching performance at Sangamon State University. Technical Paper No. 1. Springfield, Ill.: Division of Academic Affairs, Office of the Vice President, Sangamon State University, 1972.

    Google Scholar 

  • Cooke, L. S. An analysis of certain factors which affect student attitudes toward a basic college course, effective living. Unpublished doctoral dissertation, Michigan State College, 1952.

  • Cope, R. C., McMillin, J. G., and Richardson, J. M. A study of the relationship between quality instruction as perceived by students and research productivity in academic departments. Final Report, Project No. 1-J-010, Grant No. OEC-X-72-0021, U.S. Department of Health, Education and Welfare, Office of Education, 1972.

  • Costin, F. A graduate course in the teaching of psychology: Description and evaluation.Journal of Teacher Education, 1968,19 425–432.

    Google Scholar 

  • Crooks, T. J., and Smock, H. R. Student ratings of instructors related to student achievement. Unpublished manuscript, 1974.

  • Cynamon, M., and Weeden, S. U. Emotional factors in the reliability of student rating of teachers.Journal of Educational Research, 1958,51 629–632.

    Google Scholar 

  • Davis, R. H. Student Instructional Rating System (SIRS): Technical bulletin. East Lansing: Michigan State University, 1969.

    Google Scholar 

  • Doyle, K. O., Jr. Construction and evaluation of scales for rating college instructors. Unpublished doctoral dissertation, University of Minnesota, 1972.

  • Feldman, K. A. Grades and college students' evaluations of their courses and teachers.Research in Higher Education, 1976,4 69–111. (a)

    Google Scholar 

  • Feldman, K. A. The superior college teacher from the students' view.Research in Higher Education, 1976,5 243–288. (b)

    Google Scholar 

  • Feldman, K. A. Consistency and variability among college students in rating their teachers and courses: A review and analysis.Research in Higher Education, 1977,6 223–274.

    Google Scholar 

  • Feldman, K. A. Course characteristics and college students' ratings of their teachers: What we know and what we don't.Research in Higher Education, 1978,9 199–242.

    Google Scholar 

  • Flood Page, C.Student evaluation of teaching: The American experience. London: Society for Research into Higher Education, 1974.

    Google Scholar 

  • Follman, J., Lavely, C., Silverman, S., and Merica, J. Student raters' referents in rating college teaching effectiveness.Journal of Psychology, 1974,86 247–249.

    Google Scholar 

  • Follman, J., Lucoff, M., Small, L., and Power, F. Kinds of keys of student ratings of faculty teaching effectiveness.Research in Higher Education, 1974,2 173–179.

    Google Scholar 

  • Follman, J., Merica, J., and Silverman, S. College students' ratings of trait names, definitions, descriptions, and combinations.Psychology, 1974,11 11–12. (a)

    Google Scholar 

  • Follman, J., Merica, J. A., and Silverman, S. Negative numbers and order of numbers in student ratings.Perceptual and Motor Skills, 1974,38 10. (b)

    Google Scholar 

  • Frey, P. W. Validity of student instructional ratings as a function of their timing.Journal of Higher Education, 1976,47 327–336.

    Google Scholar 

  • Gillmore, G. M., and Naccarato, R. W. The effect of factors outside the instructor's control on student ratings of instruction. Seattle: Educational Assessment Center, University of Washington, 1975.

    Google Scholar 

  • Goodman, L. A. Some alternatives to ecological correlation.American Journal of Sociology, 1959,64 610–625.

    Google Scholar 

  • Grasha, A. F. The role of internal instructor frames of reference in the student rating process.Journal of Educational Psychology 1975,67 451–460.

    Google Scholar 

  • Guilford, J. P.Psychometric methods (2nd ed.) New York: McGraw-Hill, 1954.

    Google Scholar 

  • Hammond, J. L. Two sources of error in ecological correlations.American Sociological Review 1973,38 764–777.

    Google Scholar 

  • Hillery, J. M., and Yukl, G. A. Convergent and discriminant validation of student ratings of college instructors. Paper read at the annual meeting of the Midwestern Psychological Association, 1971.

  • Jaeger, R. M., and Freijo, T. D. Some psychometric questions in the evaluation of professors.Journal of Educational Psychology 1974,66 416–423.

    Google Scholar 

  • Leftwich, W. H., and Remmers, H. H. A comparison of graphic and forced-choice ratings of teaching performance at the college and university level.Purdue Universities Studies in Higher Education, No. 92, 1962, 3–31.

  • Mirus, R. Some implications of student evaluation of teachers.Journal of Economic Education 1973,5 35–37.

    Google Scholar 

  • Murray, H. G. The reliability and validity of student ratings of faculty teaching ability. Unpublished manuscript, n.d.

  • Murray, H. G. Predicting student ratings of college teaching from peer ratings of personality traits.Teaching of Psychology 1975,2 66–69.

    Google Scholar 

  • Office of Evaluation Services. Student Instructional Rating System responses and student characteristics. SIRS Research Report No. 4. East Lansing: Michigan State University, 1972.

    Google Scholar 

  • Parish, T. S., Perrin, D. W., Prawat, R. S., and Palazzo, R. F. Student related characteristics and evaluations of instructors.Journal of Instructional Psychology 1977,4 22–27.

    Google Scholar 

  • Pohlmann, J. T. Summary of research on the relationship between student characteristics and student evaluations of instruction at Southern Illinois University, Carbondale. Technical Report 1.1-72. Carbondale: Counseling and Testing Center, Southern Illinois University, Carbondale, 1972.

    Google Scholar 

  • Pratt, M., and Pratt, T. A. E. C. A study of student-teacher grading interaction process.Improving College and University Teaching 1976,24 73–81.

    Google Scholar 

  • Remmers, H. H., and Brandenburg, G. C. Experimental data on the Purdue Rating Scale for Instructors.Educational Administration and Supervision 1927,13 519–527.

    Google Scholar 

  • Richards, C. F. A college looks through the eyes of its students.Educational and Administration Supervision 1946,32 278–286.

    Google Scholar 

  • Robinson, W. S. Ecological correlations and the behavior of individuals.American Sociological Review 1950,15 351–357.

    Google Scholar 

  • Ronning, R. R., and Walsh, U. R. Effects of student anonymity-nonanonymity on the factor structure of a teacher rating form.Research in Higher Education 1977,6 363–371.

    Google Scholar 

  • Root, A. R. Student ratings of teachers.Journal of Higher Education 1931,2 311–315.

    Google Scholar 

  • Schwab, D. P. Manual for the Course Evaluation Instrument. Madison: Graduate School of Business and Industrial Relations Research Institute, University of Wisconsin-Madison, 1976.

    Google Scholar 

  • Sharon, A. T., and Bartlett, C. J. Effect of instructional conditions in producing leniency on two types of rating scales.Personnel Psychology 1969,22 251–263.

    Google Scholar 

  • Sheehan, D. S. On the invalidity of student ratings for administrative personnel decisions.Journal of Higher Education 1975,46 687–700.

    Google Scholar 

  • Showers, B. The effects of three kinds of response options on student ratings of instruction. SIRS Research Report No. 5. East Lansing: Office of Evaluation Services, Michigan State University, 1974.

    Google Scholar 

  • Smeltzer, C. H., and Harter, R. S. Comparison of anonymous and signed ratings of teachers.Educational Outlook 1934,8 76–84.

    Google Scholar 

  • Stang, D. J., and Seiler, L. H.Improving College and University Teaching Yearbook 1977, 1977, 7–9.

  • Stone, E. F. Rabinowitz, S., and Spool, M. D. Effect of anonymity on student evaluations of faculty performance.Journal of Educational Psychology 1977,69 274–280.

    Google Scholar 

  • Stone, E. F., Spool, M. D., and Rabinowitz, S. Effects of anonymity and retaliatory potential on student evaluations of faculty performance.Research in Higher Education 1977,6 313–325.

    Google Scholar 

  • Stuit, D. B., and Ebel, R. L. Instructor rating at a large state university.College and University 1952,27 247–254.

    Google Scholar 

  • Tetenbaum, T. The factor invariance of student ratings of instruction under three sets of directions.Research in Higher Education 1977,6 11–23.

    Google Scholar 

  • Van Horn, C. An analysis of the 1968 course and instructor evaluation report. Institutional Research Bulletin No. 2-68. West Lafayette, Ind.: Measurement and Research Center, Purdue University, 1968.

    Google Scholar 

  • Weerts, R. R., and Whitney, D. R. The effect of student, course, and instructor characteristics on types of items used in student evaluation of instruction. Paper read at the annual meeting of the National Council on Measurement in Education, 1975.

  • Wofford, J. C., and Willoughby, T. L. Attitudes and scholastic behavior.Journal of Educational Research 1968,61 360–362.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Feldman, K.A. The significance of circumstances for college students' ratings of their teachers and courses. Res High Educ 10, 149–172 (1979). https://doi.org/10.1007/BF00976227

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00976227

Key words

Navigation