Abstract
Although firm generalizations and conclusions cannot yet be drawn from the extant research on the effects on teacher and course ratings of the circumstances surrounding these evaluations, at least some studies have shown that college students' ratings of their teachers and courses are somewhat higher when students remain anonymous rather than identifying themselves, when the purported use of the ratings is an official or administrative one for use in salary, promotion, or tenure considerations rather than otherwise, and when the instructor is present rather than absent during the rating session. (The differences between each of these contrasted circumstances are usually rather small and do not inevitably appear across studies.) Certain variations in rating format have been found to make a difference in the ratings obtained, whereas other have not. From limited evidence, the exact timing (or occasion) of evaluation appears not to be important to ratings. Variability in sampling procedures, as it affects the composition of students available to complete rating forms, may or may not turn out to be a generally important element in ratings (as directly relevant data are collected). The analysis concludes with a discussion of (1) the presumed “bias” in ratings produced in certain of the rating conditions and (2) the more general issue of the comparability of ratings made in different circumstances of evaluation.
Similar content being viewed by others
References
Abrami, P. C., Leventhal, L., Perry, R. P., and Breen, L. J. Course evaluation: How?Journal of Educational Psychology, 1976,68 300–304.
Aleamoni, L. M., and Hexner, P. Z. The effect of different sets of instructions on student course and instructor evaluation. Research Report No. 339. Urbana-Champaign, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois, 1973.
Anikeef, A. M. Factors affecting student evaluation of college faculty members.Journal of Applied Psychology 1953,37 458–460.
Baril, G. L., and Skaggs, C. T., The effects of course evaluation format on response bias. Unpublished manuscript, n.d.
Baril, G. L., and Skaggs, C. T. Student-faculty evaluation project: Item development and validation. Report No. 375-1. Orono, Maine: Office of Testing and Research, University of Maine at Orono, 1975.
Baril, G. L., and Skaggs, C. T. Selecting items for a college course evaluation form.College Student Journal 1976,10 183–187.
Bendig, A. W. A statistical report on a revision of the Miami Instructor Rating Sheet.Journal of Educational Psychology, 1952,43 423–429.
Bledsoe, J. C. Insight into one's own teaching through feedback from students' evaluations.Psychological Reports, 1975,37 1189–1190.
Blum, M. L. An investigation of the relation existing between students' grades and their ratings of the instructor's ability to teach.Journal of Educational Psychology, 1936,27, 217–221.
Brooks, D. W., and Levenson, H. Questions and answers about answers to questions.Journal of Chemical Education, 1974,51 161–162.
Brown, D. L. Faculty ratings and student grades: A university-wide multiple regression analysis.Journal of Educational Psychology, 1976,68 573–578.
Carrier, N. A., Howard, G. S., and Miller, W. G. Course evaluations: When?Journal of Educational Psychology, 1974,66 609–613.
Centra, J. A. Two studies on the utility of student ratings for improving teaching: I. The effectiveness of student feedback in modifying college instruction. II. Self-ratings of college teachers: a comparison with student ratings. SIR Report No. 2. Princeton, N. J.: Educational Testing Service, 1972.
Centra, J. A. The influence of different directions on student ratings of instruction.Journal of Educational Measurement, 1976,13 277–282.
Centra, J. A., and Creech, F. R. The relationship between student, teacher, and course characteristics and student ratings of teacher effectiveness. PR-76-1. Princeton, N.J.: Educational Testing Service, 1976.
Colliver, J. A. A report on student evaluation of faculty teaching performance at Sangamon State University. Technical Paper No. 1. Springfield, Ill.: Division of Academic Affairs, Office of the Vice President, Sangamon State University, 1972.
Cooke, L. S. An analysis of certain factors which affect student attitudes toward a basic college course, effective living. Unpublished doctoral dissertation, Michigan State College, 1952.
Cope, R. C., McMillin, J. G., and Richardson, J. M. A study of the relationship between quality instruction as perceived by students and research productivity in academic departments. Final Report, Project No. 1-J-010, Grant No. OEC-X-72-0021, U.S. Department of Health, Education and Welfare, Office of Education, 1972.
Costin, F. A graduate course in the teaching of psychology: Description and evaluation.Journal of Teacher Education, 1968,19 425–432.
Crooks, T. J., and Smock, H. R. Student ratings of instructors related to student achievement. Unpublished manuscript, 1974.
Cynamon, M., and Weeden, S. U. Emotional factors in the reliability of student rating of teachers.Journal of Educational Research, 1958,51 629–632.
Davis, R. H. Student Instructional Rating System (SIRS): Technical bulletin. East Lansing: Michigan State University, 1969.
Doyle, K. O., Jr. Construction and evaluation of scales for rating college instructors. Unpublished doctoral dissertation, University of Minnesota, 1972.
Feldman, K. A. Grades and college students' evaluations of their courses and teachers.Research in Higher Education, 1976,4 69–111. (a)
Feldman, K. A. The superior college teacher from the students' view.Research in Higher Education, 1976,5 243–288. (b)
Feldman, K. A. Consistency and variability among college students in rating their teachers and courses: A review and analysis.Research in Higher Education, 1977,6 223–274.
Feldman, K. A. Course characteristics and college students' ratings of their teachers: What we know and what we don't.Research in Higher Education, 1978,9 199–242.
Flood Page, C.Student evaluation of teaching: The American experience. London: Society for Research into Higher Education, 1974.
Follman, J., Lavely, C., Silverman, S., and Merica, J. Student raters' referents in rating college teaching effectiveness.Journal of Psychology, 1974,86 247–249.
Follman, J., Lucoff, M., Small, L., and Power, F. Kinds of keys of student ratings of faculty teaching effectiveness.Research in Higher Education, 1974,2 173–179.
Follman, J., Merica, J., and Silverman, S. College students' ratings of trait names, definitions, descriptions, and combinations.Psychology, 1974,11 11–12. (a)
Follman, J., Merica, J. A., and Silverman, S. Negative numbers and order of numbers in student ratings.Perceptual and Motor Skills, 1974,38 10. (b)
Frey, P. W. Validity of student instructional ratings as a function of their timing.Journal of Higher Education, 1976,47 327–336.
Gillmore, G. M., and Naccarato, R. W. The effect of factors outside the instructor's control on student ratings of instruction. Seattle: Educational Assessment Center, University of Washington, 1975.
Goodman, L. A. Some alternatives to ecological correlation.American Journal of Sociology, 1959,64 610–625.
Grasha, A. F. The role of internal instructor frames of reference in the student rating process.Journal of Educational Psychology 1975,67 451–460.
Guilford, J. P.Psychometric methods (2nd ed.) New York: McGraw-Hill, 1954.
Hammond, J. L. Two sources of error in ecological correlations.American Sociological Review 1973,38 764–777.
Hillery, J. M., and Yukl, G. A. Convergent and discriminant validation of student ratings of college instructors. Paper read at the annual meeting of the Midwestern Psychological Association, 1971.
Jaeger, R. M., and Freijo, T. D. Some psychometric questions in the evaluation of professors.Journal of Educational Psychology 1974,66 416–423.
Leftwich, W. H., and Remmers, H. H. A comparison of graphic and forced-choice ratings of teaching performance at the college and university level.Purdue Universities Studies in Higher Education, No. 92, 1962, 3–31.
Mirus, R. Some implications of student evaluation of teachers.Journal of Economic Education 1973,5 35–37.
Murray, H. G. The reliability and validity of student ratings of faculty teaching ability. Unpublished manuscript, n.d.
Murray, H. G. Predicting student ratings of college teaching from peer ratings of personality traits.Teaching of Psychology 1975,2 66–69.
Office of Evaluation Services. Student Instructional Rating System responses and student characteristics. SIRS Research Report No. 4. East Lansing: Michigan State University, 1972.
Parish, T. S., Perrin, D. W., Prawat, R. S., and Palazzo, R. F. Student related characteristics and evaluations of instructors.Journal of Instructional Psychology 1977,4 22–27.
Pohlmann, J. T. Summary of research on the relationship between student characteristics and student evaluations of instruction at Southern Illinois University, Carbondale. Technical Report 1.1-72. Carbondale: Counseling and Testing Center, Southern Illinois University, Carbondale, 1972.
Pratt, M., and Pratt, T. A. E. C. A study of student-teacher grading interaction process.Improving College and University Teaching 1976,24 73–81.
Remmers, H. H., and Brandenburg, G. C. Experimental data on the Purdue Rating Scale for Instructors.Educational Administration and Supervision 1927,13 519–527.
Richards, C. F. A college looks through the eyes of its students.Educational and Administration Supervision 1946,32 278–286.
Robinson, W. S. Ecological correlations and the behavior of individuals.American Sociological Review 1950,15 351–357.
Ronning, R. R., and Walsh, U. R. Effects of student anonymity-nonanonymity on the factor structure of a teacher rating form.Research in Higher Education 1977,6 363–371.
Root, A. R. Student ratings of teachers.Journal of Higher Education 1931,2 311–315.
Schwab, D. P. Manual for the Course Evaluation Instrument. Madison: Graduate School of Business and Industrial Relations Research Institute, University of Wisconsin-Madison, 1976.
Sharon, A. T., and Bartlett, C. J. Effect of instructional conditions in producing leniency on two types of rating scales.Personnel Psychology 1969,22 251–263.
Sheehan, D. S. On the invalidity of student ratings for administrative personnel decisions.Journal of Higher Education 1975,46 687–700.
Showers, B. The effects of three kinds of response options on student ratings of instruction. SIRS Research Report No. 5. East Lansing: Office of Evaluation Services, Michigan State University, 1974.
Smeltzer, C. H., and Harter, R. S. Comparison of anonymous and signed ratings of teachers.Educational Outlook 1934,8 76–84.
Stang, D. J., and Seiler, L. H.Improving College and University Teaching Yearbook 1977, 1977, 7–9.
Stone, E. F. Rabinowitz, S., and Spool, M. D. Effect of anonymity on student evaluations of faculty performance.Journal of Educational Psychology 1977,69 274–280.
Stone, E. F., Spool, M. D., and Rabinowitz, S. Effects of anonymity and retaliatory potential on student evaluations of faculty performance.Research in Higher Education 1977,6 313–325.
Stuit, D. B., and Ebel, R. L. Instructor rating at a large state university.College and University 1952,27 247–254.
Tetenbaum, T. The factor invariance of student ratings of instruction under three sets of directions.Research in Higher Education 1977,6 11–23.
Van Horn, C. An analysis of the 1968 course and instructor evaluation report. Institutional Research Bulletin No. 2-68. West Lafayette, Ind.: Measurement and Research Center, Purdue University, 1968.
Weerts, R. R., and Whitney, D. R. The effect of student, course, and instructor characteristics on types of items used in student evaluation of instruction. Paper read at the annual meeting of the National Council on Measurement in Education, 1975.
Wofford, J. C., and Willoughby, T. L. Attitudes and scholastic behavior.Journal of Educational Research 1968,61 360–362.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Feldman, K.A. The significance of circumstances for college students' ratings of their teachers and courses. Res High Educ 10, 149–172 (1979). https://doi.org/10.1007/BF00976227
Issue Date:
DOI: https://doi.org/10.1007/BF00976227