Abstract
An extensive review of the research concerning the effect of different variables on student ratings is presented. A study is then reported comparing the effects of different sets of instructions on student evaluations of the course and instructor. The results indicated that the students who were informed that the results of their ratings would be used for administrative decisions rated the course and instructor more favorably on all aspects than students who were informed that the results of their ratings would only be used by the instructor.
Similar content being viewed by others
References
Aleamoni, L.M. (1972). Results Interpretation Manual: Illinois Course Evaluation Questionnaire, Form 66 and Form 32. Research Report No. 331. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Aleamoni, L. M. (1978). “Development and faetorial validation of the Arizona course/instructor evaluation questionnaire”, Educational and Psychological Measurement 38(4): 1063–1067.
Aleamoni, L. M. and Graham, M. H. (1974). “The relationship between CEQ ratings and instructor's rank, class size and course level”, Journal of Educational Measurement 11(3): 189–202.
Aleamoni, L. M. and Spencer, R. E. (1973). “The Illinois course evaluation questionnaire: a description of its development and a report of some of its results”, Educational and Psychological Measurement 33(3): 669–684.
Aleamoni, L. M. and Thomas, G. S. (1977). Is the Instructor's Rating of the Class Related to the Class' Rating of the Instructor? Research Report No. 1. Tucson, Ariz.: Office of Instructional Research and Development, University of Arizona.
Aleamoni, L. M. and Yimer, M. (1973). “An investigation of the relationship between colleague rating, student rating, research productivity, and academic rank in rating instructional effectiveness”, Journal of Educational Psychology 64(3): 274–277.
Aleamoni, L. M. and Yimer, M. (1974). Graduating Senior Ratings Relationship to Colleague Rating, Student Rating, Research Productivity and Academic Rank in Rating Instructional Effectiveness. Research Report No. 352. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Anikeef, A. M. (1953). “Factors affecting student evaluation of college faculty members”, Journal of Applied Psychology 37: 458–460.
Ashton, R. H. (1975). “Correlations of rates of teaching effectiveness: Gordon's survey of interpersonal values”, Psychological Reports 36: 890.
Barnoski, R. P. and Sockloff, A. L. (1976). “A validation study of the faculty and course evaluation (FACE) instrument“, Educational and Psychological Measurement 36(2): 391–400.
Bausell, R. and Magoon, J. (1972). “Expected grades in a course, gradepoint average, and student ratings of instructor”, Educational and Psychological Measurement 32(4): 1013–1023.
Bendig, A. W. (1952). “A preliminary study of the effect of academic level, sex, and course variables on student rating of psychology instructors”, Journal of Psychology 34: 2–126.
Bendig, A. W. (1953a). “Relation of level of course achievement of students, instructor and course ratings in introductory psychology”, Educational and Psychological Measurement 13: 437–488.
Bendig, A. W. (1953b). “Student achievement in introductory psychology and student ratings of the competence and empathy of their instructors”, Journal of Psychology 36: 427–433.
Bendig, A. W. (1954). “A factor analysis of student ratings of psychology instructors on the Purdue scale”, Journal of Educational Psychology 45: 385–393.
Berkshire, J. R. and Highland, R. W. (1953). “Forced-choice performance rating—a methodological study”, Personnel Psychology 6: 356–378.
Blum, M. L. (1936). “An investigation of the relation existing between students' grades and their ratings of the instructor's ability to teach”, Journal of Educational Psychology 27: 217–221.
Borgatta, E. F. (1970). “Student ratings of faculty”, American Association of University Professors. Bulletin 56: 6–7.
Braun, C. (1976). “Teacher expectation: sociopsychological dynamics”, Review of Educational Research 46(2): 185–213.
Caffrey, B. (1969). “Lack of bias in student evaluations of teachers”, Proceedings of the 77th Annual Convention of the American Psychological Association 4: 641–642.
Centra, J. A. (1973). “The Student as Godfather? The Impact of Student Ratings on Academia”, in A. L. Sockloff, ed., Proceedings of the First Invitational Conference on Faculty Effectiveness as Evaluated by Students. Philadelphia, Pa.: Measurement and Research Center, Temple University.
Centra, J. A. (1976). “The influence of different directions on student ratings of instruction”, Journal of Educational Measurement 13(4): 277–282.
Centra, J. A. and Linn, R. L. (1976). “Student points of view in ratings of college instruction”, Educational and Psychological Measurement 36(3): 693–703.
Clark, K. E. and Keller, R. J. (1954). “Student Ratings of College Teaching,” in R. A. Eckert, ed., A University Looks at Its Program. Minneapolis, Minn.: University of Minnesota Press.
Cohen, J. and Humphreys, L. G. (1960). “Memorandum to faculty.” Department of Psychology, University of Illinois (mimeographed).
Cohen, S. A. and Berger, W. G. (1970). “Dimensions of students' ratings of college instructors underlying subsequent achievement on course examination”, Proceedings of the 78th Annual Convention of the American Psychological Association 5: 605–606.
Costin, F. (1966). Intercorrelations Between Students' and Course Chairmen's Ratings of Instructors. Urbana, Ill.: Division of General Studies, University of Illinois.
Costin, F., Greenough, W. T. and Menges, R. J. (1971).“Student ratings of college teaching: reliability, validity, and usefulness”, Review of Educational Research 41: 511–535.
Crittenden, K. S., Norr, J. L., and LeBailly, R. K. (1975). “Size of university classes and student evaluations of teaching”, Journal of Higher Education 46: 461–470.
Deming, W. E. (1972). “Memorandum on teaching”, The American Statistician 26(1): 47.
Deshpande, A. S., Webb, S. C., and Marks, E. (1970). “Student perceptions of engineering instructor behaviors and their relationships to the evaluation of instructors and courses”, American Educational Research Journal 7(3): 289–305.
Downie, N. W. (1952). “Student evaluation of faculty”, Journal of Higher Education 23: 495–496, 503.
Doyle, K. O. and Whitely, S. E. (1974). “Student ratings as criteria for effective teaching”, American Educational Research Journal 11(3): 259–274.
Drucker, A. J. and Remmers, H. H. (1950). “Do alumni and students differ in their attitudes toward instructors?” Purdue University Studies in Higher Education 70: 62–64.
Drucker, A. J. and Remmers, H. H. (1951). “Do alumni and students differ in their attitudes toward instructors?” Journal of Educational Psychology 42: 129–143.
Echandia, P. P. (1964). “A methodological study and factor analytic validation of forcedchoice performance ratings of college accounting instructors”, Dissertation Abstracts 25(4): 2605–2606.
Eckert, R. E. (1950). “Ways of evaluating college teaching”, School and Society 71: 65–69.
Elashoff, D. J. and Snow, R. E. (1971). Pygmalion Reconsidered: A Case Study in Statistical Inference: Reconsideration of the Rosenthal-Jacobson Data on Teacher Expectancy. Belmont, Cal.: Wordsworth Publishing Company.
Elliott, D. H. (1950). “Characteristics and relationships of various criteria of college and university teaching”, Purdue University Studies in Higher Education 70: 5–61.
Elmore, P. B. and LaPointe, K. A. (1974). “Effects of teacher sex and student sex on the evaluation of college instructors”, Journal of Educational Psychology 66(3): 386–389.
Everly, J. C. and Aleamoni, L. M. (1972). “The rise and fall of the advisor...students attempt to evaluate their instructors”, Journal of the National Association of Colleges and Teachers of Agriculture 16(2): 43–45.
Frey, P. W. (1973). “Student ratings of teaching: validity of several rating factors”, Science 182: 83–85.
Frey, P. W., Leonard, D. W., and Beatty, W. W. (1975). “Student ratings of instruction: validation research”, American Educational Research Journal 12(4): 435–447.
Gage, N. L. (1961). “The appraisal of college teaching”, Journal of Higher Education 32: 17–22.
Garverick, C. S. and Carter, H. D. (1962). “Instructor ratings and expected grades”, California Journal of Educational Research 13: 218–221.
Gessner, P. K. (1973). “Evaluation of instruction”, Science 180: 566–569.
Gillmore, G. M. (1973). Estimates of Reliability Coefficients for Items and Subscales of the Illinois Course Evaluation Questionnaire. Research Report No. 341. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois.
Gillmore, G. M. and Brandenburg, D. C. (1974). Would the Proportion of Students Taking a Class as a Requirement Affect the Student Rating of the Course? Research Report No. 347. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois.
Goodhartz, A. S. (1948). “Student attitudes and opinions relating to teaching at Brooklyn College”, School and Society 68: 345–349.
Greenwood, G. E., Hazelton, A., Smith, A. B., and Ware, W. G. (1976). “A study of the validity of four types of student ratings of college teaching assessed on a criterion of student achievement gains”, Research in Higher Education 5: 171–178.
Guthrie, E. R. (1949). “The evaluation of teaching”, Educational Record 30: 109–115.
Guthrie, E. R. (1954). The Evaluation of Teaching: A Progress Report. Seattle, Washington: University of Washington.
Hayes, J. R. (1971). “Research, teaching and faculty fate,” Science 172: 227–230.
Heilman, J. D. and Armentrout, W. D. (1936). “The rating of college teachers on ten traits by their studients,” Journal of Educational Psychology 27: 197–216.
Hildebrand, M., Wilson, R. C., and Dienst, E. R. (1971). Evaluating University Teaching. Berkeley, Cal.: Center for Research and Development in Higher Education, University of California at Berkeley.
Hillery, J. M. and Yuk, G. A. (1974). “Convergent and discriminant validation of student ratings of college instructors,” JSAS Catalog of Selected Documents in Psychology 4: 26.
Hogan, T. P. (1973). “Similarity of student ratings across instructors, courses and time,” Research in Higher Education 1: 149–154.
Holmes, D. S. (1971). “The teaching assessment blank: a form for the student assessment of college instructors,” Journal of Experimental Education 39: 34–38.
Hudelson, E. (1951). “The validity of student rating of instructors,” School and Society 73: 265–266.
Isaacson, R. L., McKeachie, W. J., Milholland, J. E., Lin, Y. G., Hofeller, M., Baerwaldt, J. W., and Zinn, K. L. (1964). “Dimensions of student evaluations of teaching,” Journal of Educational Psychology 55: 344–351.
Jiobu, R. M., and Pollis, C. A. (1971). “Student evaluations of courses and instructors,” The American Socieologist 6: 317–321.
Kennedy, W. R. (1975). “Grades expected and grades received-their relationship to students' evaluation of faculty performance,” Journal of Educational Psychology 67: 109–115.
Kohlan, R. G. (1973). “A comparison of faculty evaluations early and late in the course,” Journal of Higher Education 44: 587–595.
Kooker, E. W. (1968). “The relationship of known college grades to course ratings on student-selected items,” Journal of Psychology 69: 209–215.
Lehmann, I. J. (1966). “The college faculty as perceived by graduates and nongraduates,” Journal of Educational Measurement 3(2): 169–173.
Linsky, A. S. and Straus, M. A. (1975). “Student evaluations, research productivity, and eminence of college faculty,” Journal of Higher Education 46(1): 89–102.
Lovell, G. D. and Haner, C. F. (1955). “Forced-choice applied to college faculty rating,” Educational and Psychological Measurement 15: 291–304.
Marsh, H. W. (1977). “The validity of students' evaluations: classroom evaluations of instructors independently nominated as best and worst teachers by graduating seniors,” American Educational Research Journal 14(4): 441–447.
Marsh, H. W., Overall, J. U., and Kesler, S. P. (1979). “Class size, students' evaluations, and instructional effectiveness,” American Educational Research Journal 16(1): 57–69.
Maslow, A. H. and Zimmerman, W. (1956). “College teaching ability, scholarly activity and personality,” Journal of Educational Psychology 47: 185–189.
McDaniel, E. D. and Feldhusen, J. F. (1970). “Relationships between faculty ratings and indexes of service and scholarship,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 619–620.
McGrath, E. J. 1962. “Characteristics of outstanding college teachers,” Journal of Higher Education 33: 148.
McKeachie, W. J., Lin, Y., and Mann, W. (1971). “Student ratings of teacher effectiveness: validity studies,” American Educational Research Journal 8(3): 435–445.
Menges, R. J. (1973). “The New Reporters: Students Rate Instruction,” in C. R. Pace, ed., New Directions in Higher Education: Evaluating Learning and Teaching, San Francisco, Cal.: Jossey-Bass.
Null, E. J. and Nicholson, E. W. (1972). “Personal variables of students and their perception of university instructors,” College Student Journal 6: 6–9.
Berry, R. R. and Baumann, R. R. (1973). “Criterla for the evaluation of college teaching: their reliability and validity at the University of Toledo,” in A. L. Sockloff, ed., Proceedings of the First Invitational Conference on Faculty Effectiveness as Evaluated by Students. Philadelphia, Pa.: Measurement and Research Center, Temple University.
Pohlmann, J. T. (1975). “A multivariate analysis of selected class characteristics and student ratings of instruction,” Multivariate Behavioral Research 10(1): 81–91.
Rayder, N. F. (1968). “College student ratings of instructors,” Journal of Experimental Education 37: 76–81.
Remmers, H. H. (1928). “The relationship between students' marks and students' attitudes toward instructors,” School and Society 28: 759–760.
Remmers, H. H. (1930). “To what extent do grades influence student ratings of instructors?” Journal of Educational Research 21: 314–316.
Remmers, H. H. (1939). “Appraisal of college teaching through ratings and student opinion,“ in 27th Yearbook of the National Society of College Teachers of Education. Chicago, Ill.: University of Chicago Press.
Remmers, H. H. (1960). Manual of Instructions for the Purdue Rating Scale for Instructors, revised edition. West Lafayette, Indiana: University Book Store.
Remmers, H. H. and Elliott, D. N. (1949). “The Indiana college and university staff-evaluation program,” School and Society 70: 168–171.
Remmers, H. H., Martin, F. D., and Elliott, D. N. (1949). “Are students' ratings of instructors related to their grades?” Purdue University Studies in Higher Education 66: 17–26.
Riley, J. W., Ryan, B. F., and Lipschitz, M. (1950). The Student Looks at his Teacher. New Brunswick, N. J.: Rutgers University Press.
Rodin, M., Frey, P. W., and Gessner, P. K. (1975). “Student evaluation,” Science 187: 555–559.
Rodin, M. and Rodin, B. (1972). “Student evaluations of teachers,” Science 177: 1164–1166.
Rosenshine, B., Cohen, A., and Furst, N. (1973). “Correlates of student preference ratings,” Journal of College Student Personnel 14: 269–272.
Rosenthal, R. (1973). “The Pygmalion effect lives,” Psychology Today 7: 56–63.
Rosenthal, R. and Jacobson, L. (1968). Pygmalion in the Classroom. New York: Holt, Rinehart and Winston.
Rubenstein, J. and Mitchell, H. (1970). “feeling free, student involvement, and appreciation,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 623–624.
Russell, H. E. (1951). “Interrelations of Some Indices of Instructor Effectiveness.” Unpublished doctoral dissertation, University of Pittsburgh.
Russel, H. E. and Bendig, A. W. (1953). “Investigation of the relations of student ratings of psychology instructors to their course achievement when academic aptitude is controlled,” Educational and Psychological Measurement 13: 626–635.
Schuh, A. J. and Crivelli, M. A. (1973). “Animadversion error in student evaluations of faculty teaching effectiveness,” Journal of Applied Psychology 58: 259–260.
Schwab, D. P. (1975). “Course and student characteristic correlates of the course evaluation instrument,” Journal of Applied Psychology 60: 742–747.
Scott, C. A. (1977). “Student ratings and instructor-defined extenuating circumstances,” Journal of Educational Psychology 69: 744–747.
Sharon, A. T. and Bartlett, C. J. (1969). “Effect of instructional conditions in producing leniency on two types of rating scales,” Personnel Psychology 22: 251–263.
Singhal, S. (1968). Illinois Course Evaluation Questionnaire Items by Rank of Instructor, Sex of the Instructor, and Sex of the Student. Research Report No. 282. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Snow, R. E. (1969). “Unfinished Pygmalion,” Contemporary Psychology 14: 197–199.
Solomon, D. (1966). “Teacher behavior dimensions, course characteristics, and student evaluations of teachers,” American Educational Research Journal 3: 35–47.
Spencer, R. E. (1968). The Illinois Course Evaluation Questionnaire: Manual of Interpretation. Research Report No. 270. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Spencer, R. E., and Aleamoni, L. M. (1970). “A student course evaluation questionnaire,” Journal of Educational Measurement 7: 209–210.
Spencer, R. E. and Levitz, L. (1966). The Effects of Grade Expected on Students' Evaluation of Rhetoric 101–102. Research Report No. 244. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Stallings, W. M. and Singhal, S. (1968). Some Observations on the Relationships Between Productivity and Student Evaluations of Courses and Teaching Research Report No. 274. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Stallings, W. M. and Spencer, R. E. (1967). Ratings of Instructors in Accountancy 101 from Video-Tape Clips. Research Report No. 265. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Starrak, J. A. (1934). “Student rating of instructor,” Journal of Higher Education 5: 88–90.
Stewart, C. T. and Malpass, L. F. (1966). “Estimates of achievement and ratings of instructors,” Journal of Educational Research 59: 347–350.
Subkoviak, M. J. and Levin, J. R. (1974). “Determining the characteristics of the ideal professor: an alternative approach,” Journal of Educational Measurement 11(4): 269–276.
Sullivan, A. M. and Skanes, G. R. (1974). “Validity of student evaluation of teaching and the characteristics of successful instructors,” Journal of Educational Psychology 66: 584–590.
Swanson, R. A. and Sisson, D. J. (1971). “The development, evaluation, and utilization of a departmental faculty appraisal system,” Journal of Industrial Teacher Education 9(1): 64–79.
Taylor, E. K. and Wherry, R. J. (1951). “A study of leniency in two rating systems,” Personnel Psychology 4: 39–47.
Thorndike, R. L. (1968). “Review of Pygmalion in the Classroom by R. Rosenthal and L. Jacobson,” American Educational Research Journal 5: 708–711.
Treffinger, D. J. and Feldhusen, J. F. (1970). “Predicting students' rating of instruction,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 621–622.
Voeks, V. W. (1962). “Publications and teaching effectiveness,” Journal of Higher Education 33: 212.
Voeks, V. W. and French, G. M. (1960). “Are student-ratings of teachers affected by grades?” Journal of Higher Education 31: 330–334.
Walker, B. D. (1969). “An investigation of selected variables relative to the manner in which a population of junior college students evaluate their teachers,” Dissertation Abstracts 29(9-B): 3474.
Weaver, C. H. (1960). “Instructor rating by college students,” Journal of Educational Psychology 51: 21–25.
Weigel, R. G., Oetting, E. R., and Tasto, D. L. (1971). “Differences in course grades and student ratings of teacher performance,” School and Society 99: 60–62.
White, W. F., Hsu, Y. M., and Means, R. S. (1978). “Prediction of student ratings of college instructors from multiple achievement test variables,” Educational and Psychological Measurement 38(4): 1077–1083.
Wood, K., Linsky, A. S., and Straus, M. A. (1974). “Class size and student evaluations of faculty,” Journal of Higher Education 45: 524–534.
Yongkittikul, C., Gillmore, G. M., and Brandenburg, D. C. (1974). Does the Time of Course Meeting Affect Course Ratings by Students?. Research Report No. 346. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.
Author information
Authors and Affiliations
Additional information
The authors are indebted to Professor Robert A. Waller for cooperating in obtaining the data on his two history courses.
Rights and permissions
About this article
Cite this article
Aleamoni, L.M., Hexner, P.Z. A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation. Instr Sci 9, 67–84 (1980). https://doi.org/10.1007/BF00118969
Issue Date:
DOI: https://doi.org/10.1007/BF00118969