Skip to main content
Log in

A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

An extensive review of the research concerning the effect of different variables on student ratings is presented. A study is then reported comparing the effects of different sets of instructions on student evaluations of the course and instructor. The results indicated that the students who were informed that the results of their ratings would be used for administrative decisions rated the course and instructor more favorably on all aspects than students who were informed that the results of their ratings would only be used by the instructor.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aleamoni, L.M. (1972). Results Interpretation Manual: Illinois Course Evaluation Questionnaire, Form 66 and Form 32. Research Report No. 331. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Aleamoni, L. M. (1978). “Development and faetorial validation of the Arizona course/instructor evaluation questionnaire”, Educational and Psychological Measurement 38(4): 1063–1067.

    Google Scholar 

  • Aleamoni, L. M. and Graham, M. H. (1974). “The relationship between CEQ ratings and instructor's rank, class size and course level”, Journal of Educational Measurement 11(3): 189–202.

    Google Scholar 

  • Aleamoni, L. M. and Spencer, R. E. (1973). “The Illinois course evaluation questionnaire: a description of its development and a report of some of its results”, Educational and Psychological Measurement 33(3): 669–684.

    Google Scholar 

  • Aleamoni, L. M. and Thomas, G. S. (1977). Is the Instructor's Rating of the Class Related to the Class' Rating of the Instructor? Research Report No. 1. Tucson, Ariz.: Office of Instructional Research and Development, University of Arizona.

    Google Scholar 

  • Aleamoni, L. M. and Yimer, M. (1973). “An investigation of the relationship between colleague rating, student rating, research productivity, and academic rank in rating instructional effectiveness”, Journal of Educational Psychology 64(3): 274–277.

    Google Scholar 

  • Aleamoni, L. M. and Yimer, M. (1974). Graduating Senior Ratings Relationship to Colleague Rating, Student Rating, Research Productivity and Academic Rank in Rating Instructional Effectiveness. Research Report No. 352. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Anikeef, A. M. (1953). “Factors affecting student evaluation of college faculty members”, Journal of Applied Psychology 37: 458–460.

    Google Scholar 

  • Ashton, R. H. (1975). “Correlations of rates of teaching effectiveness: Gordon's survey of interpersonal values”, Psychological Reports 36: 890.

    Google Scholar 

  • Barnoski, R. P. and Sockloff, A. L. (1976). “A validation study of the faculty and course evaluation (FACE) instrument“, Educational and Psychological Measurement 36(2): 391–400.

    Google Scholar 

  • Bausell, R. and Magoon, J. (1972). “Expected grades in a course, gradepoint average, and student ratings of instructor”, Educational and Psychological Measurement 32(4): 1013–1023.

    Google Scholar 

  • Bendig, A. W. (1952). “A preliminary study of the effect of academic level, sex, and course variables on student rating of psychology instructors”, Journal of Psychology 34: 2–126.

    Google Scholar 

  • Bendig, A. W. (1953a). “Relation of level of course achievement of students, instructor and course ratings in introductory psychology”, Educational and Psychological Measurement 13: 437–488.

    Google Scholar 

  • Bendig, A. W. (1953b). “Student achievement in introductory psychology and student ratings of the competence and empathy of their instructors”, Journal of Psychology 36: 427–433.

    Google Scholar 

  • Bendig, A. W. (1954). “A factor analysis of student ratings of psychology instructors on the Purdue scale”, Journal of Educational Psychology 45: 385–393.

    Google Scholar 

  • Berkshire, J. R. and Highland, R. W. (1953). “Forced-choice performance rating—a methodological study”, Personnel Psychology 6: 356–378.

    Google Scholar 

  • Blum, M. L. (1936). “An investigation of the relation existing between students' grades and their ratings of the instructor's ability to teach”, Journal of Educational Psychology 27: 217–221.

    Google Scholar 

  • Borgatta, E. F. (1970). “Student ratings of faculty”, American Association of University Professors. Bulletin 56: 6–7.

    Google Scholar 

  • Braun, C. (1976). “Teacher expectation: sociopsychological dynamics”, Review of Educational Research 46(2): 185–213.

    Google Scholar 

  • Caffrey, B. (1969). “Lack of bias in student evaluations of teachers”, Proceedings of the 77th Annual Convention of the American Psychological Association 4: 641–642.

    Google Scholar 

  • Centra, J. A. (1973). “The Student as Godfather? The Impact of Student Ratings on Academia”, in A. L. Sockloff, ed., Proceedings of the First Invitational Conference on Faculty Effectiveness as Evaluated by Students. Philadelphia, Pa.: Measurement and Research Center, Temple University.

    Google Scholar 

  • Centra, J. A. (1976). “The influence of different directions on student ratings of instruction”, Journal of Educational Measurement 13(4): 277–282.

    Google Scholar 

  • Centra, J. A. and Linn, R. L. (1976). “Student points of view in ratings of college instruction”, Educational and Psychological Measurement 36(3): 693–703.

    Google Scholar 

  • Clark, K. E. and Keller, R. J. (1954). “Student Ratings of College Teaching,” in R. A. Eckert, ed., A University Looks at Its Program. Minneapolis, Minn.: University of Minnesota Press.

    Google Scholar 

  • Cohen, J. and Humphreys, L. G. (1960). “Memorandum to faculty.” Department of Psychology, University of Illinois (mimeographed).

  • Cohen, S. A. and Berger, W. G. (1970). “Dimensions of students' ratings of college instructors underlying subsequent achievement on course examination”, Proceedings of the 78th Annual Convention of the American Psychological Association 5: 605–606.

    Google Scholar 

  • Costin, F. (1966). Intercorrelations Between Students' and Course Chairmen's Ratings of Instructors. Urbana, Ill.: Division of General Studies, University of Illinois.

    Google Scholar 

  • Costin, F., Greenough, W. T. and Menges, R. J. (1971).“Student ratings of college teaching: reliability, validity, and usefulness”, Review of Educational Research 41: 511–535.

    Google Scholar 

  • Crittenden, K. S., Norr, J. L., and LeBailly, R. K. (1975). “Size of university classes and student evaluations of teaching”, Journal of Higher Education 46: 461–470.

    Google Scholar 

  • Deming, W. E. (1972). “Memorandum on teaching”, The American Statistician 26(1): 47.

    Google Scholar 

  • Deshpande, A. S., Webb, S. C., and Marks, E. (1970). “Student perceptions of engineering instructor behaviors and their relationships to the evaluation of instructors and courses”, American Educational Research Journal 7(3): 289–305.

    Google Scholar 

  • Downie, N. W. (1952). “Student evaluation of faculty”, Journal of Higher Education 23: 495–496, 503.

    Google Scholar 

  • Doyle, K. O. and Whitely, S. E. (1974). “Student ratings as criteria for effective teaching”, American Educational Research Journal 11(3): 259–274.

    Google Scholar 

  • Drucker, A. J. and Remmers, H. H. (1950). “Do alumni and students differ in their attitudes toward instructors?” Purdue University Studies in Higher Education 70: 62–64.

    Google Scholar 

  • Drucker, A. J. and Remmers, H. H. (1951). “Do alumni and students differ in their attitudes toward instructors?” Journal of Educational Psychology 42: 129–143.

    Google Scholar 

  • Echandia, P. P. (1964). “A methodological study and factor analytic validation of forcedchoice performance ratings of college accounting instructors”, Dissertation Abstracts 25(4): 2605–2606.

    Google Scholar 

  • Eckert, R. E. (1950). “Ways of evaluating college teaching”, School and Society 71: 65–69.

    Google Scholar 

  • Elashoff, D. J. and Snow, R. E. (1971). Pygmalion Reconsidered: A Case Study in Statistical Inference: Reconsideration of the Rosenthal-Jacobson Data on Teacher Expectancy. Belmont, Cal.: Wordsworth Publishing Company.

    Google Scholar 

  • Elliott, D. H. (1950). “Characteristics and relationships of various criteria of college and university teaching”, Purdue University Studies in Higher Education 70: 5–61.

    Google Scholar 

  • Elmore, P. B. and LaPointe, K. A. (1974). “Effects of teacher sex and student sex on the evaluation of college instructors”, Journal of Educational Psychology 66(3): 386–389.

    Google Scholar 

  • Everly, J. C. and Aleamoni, L. M. (1972). “The rise and fall of the advisor...students attempt to evaluate their instructors”, Journal of the National Association of Colleges and Teachers of Agriculture 16(2): 43–45.

    Google Scholar 

  • Frey, P. W. (1973). “Student ratings of teaching: validity of several rating factors”, Science 182: 83–85.

    Google Scholar 

  • Frey, P. W., Leonard, D. W., and Beatty, W. W. (1975). “Student ratings of instruction: validation research”, American Educational Research Journal 12(4): 435–447.

    Google Scholar 

  • Gage, N. L. (1961). “The appraisal of college teaching”, Journal of Higher Education 32: 17–22.

    Google Scholar 

  • Garverick, C. S. and Carter, H. D. (1962). “Instructor ratings and expected grades”, California Journal of Educational Research 13: 218–221.

    Google Scholar 

  • Gessner, P. K. (1973). “Evaluation of instruction”, Science 180: 566–569.

    Google Scholar 

  • Gillmore, G. M. (1973). Estimates of Reliability Coefficients for Items and Subscales of the Illinois Course Evaluation Questionnaire. Research Report No. 341. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois.

    Google Scholar 

  • Gillmore, G. M. and Brandenburg, D. C. (1974). Would the Proportion of Students Taking a Class as a Requirement Affect the Student Rating of the Course? Research Report No. 347. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois.

    Google Scholar 

  • Goodhartz, A. S. (1948). “Student attitudes and opinions relating to teaching at Brooklyn College”, School and Society 68: 345–349.

    Google Scholar 

  • Greenwood, G. E., Hazelton, A., Smith, A. B., and Ware, W. G. (1976). “A study of the validity of four types of student ratings of college teaching assessed on a criterion of student achievement gains”, Research in Higher Education 5: 171–178.

    Google Scholar 

  • Guthrie, E. R. (1949). “The evaluation of teaching”, Educational Record 30: 109–115.

    Google Scholar 

  • Guthrie, E. R. (1954). The Evaluation of Teaching: A Progress Report. Seattle, Washington: University of Washington.

    Google Scholar 

  • Hayes, J. R. (1971). “Research, teaching and faculty fate,” Science 172: 227–230.

    Google Scholar 

  • Heilman, J. D. and Armentrout, W. D. (1936). “The rating of college teachers on ten traits by their studients,” Journal of Educational Psychology 27: 197–216.

    Google Scholar 

  • Hildebrand, M., Wilson, R. C., and Dienst, E. R. (1971). Evaluating University Teaching. Berkeley, Cal.: Center for Research and Development in Higher Education, University of California at Berkeley.

    Google Scholar 

  • Hillery, J. M. and Yuk, G. A. (1974). “Convergent and discriminant validation of student ratings of college instructors,” JSAS Catalog of Selected Documents in Psychology 4: 26.

    Google Scholar 

  • Hogan, T. P. (1973). “Similarity of student ratings across instructors, courses and time,” Research in Higher Education 1: 149–154.

    Google Scholar 

  • Holmes, D. S. (1971). “The teaching assessment blank: a form for the student assessment of college instructors,” Journal of Experimental Education 39: 34–38.

    Google Scholar 

  • Hudelson, E. (1951). “The validity of student rating of instructors,” School and Society 73: 265–266.

    Google Scholar 

  • Isaacson, R. L., McKeachie, W. J., Milholland, J. E., Lin, Y. G., Hofeller, M., Baerwaldt, J. W., and Zinn, K. L. (1964). “Dimensions of student evaluations of teaching,” Journal of Educational Psychology 55: 344–351.

    Google Scholar 

  • Jiobu, R. M., and Pollis, C. A. (1971). “Student evaluations of courses and instructors,” The American Socieologist 6: 317–321.

    Google Scholar 

  • Kennedy, W. R. (1975). “Grades expected and grades received-their relationship to students' evaluation of faculty performance,” Journal of Educational Psychology 67: 109–115.

    Google Scholar 

  • Kohlan, R. G. (1973). “A comparison of faculty evaluations early and late in the course,” Journal of Higher Education 44: 587–595.

    Google Scholar 

  • Kooker, E. W. (1968). “The relationship of known college grades to course ratings on student-selected items,” Journal of Psychology 69: 209–215.

    Google Scholar 

  • Lehmann, I. J. (1966). “The college faculty as perceived by graduates and nongraduates,” Journal of Educational Measurement 3(2): 169–173.

    Google Scholar 

  • Linsky, A. S. and Straus, M. A. (1975). “Student evaluations, research productivity, and eminence of college faculty,” Journal of Higher Education 46(1): 89–102.

    Google Scholar 

  • Lovell, G. D. and Haner, C. F. (1955). “Forced-choice applied to college faculty rating,” Educational and Psychological Measurement 15: 291–304.

    Google Scholar 

  • Marsh, H. W. (1977). “The validity of students' evaluations: classroom evaluations of instructors independently nominated as best and worst teachers by graduating seniors,” American Educational Research Journal 14(4): 441–447.

    Google Scholar 

  • Marsh, H. W., Overall, J. U., and Kesler, S. P. (1979). “Class size, students' evaluations, and instructional effectiveness,” American Educational Research Journal 16(1): 57–69.

    Google Scholar 

  • Maslow, A. H. and Zimmerman, W. (1956). “College teaching ability, scholarly activity and personality,” Journal of Educational Psychology 47: 185–189.

    Google Scholar 

  • McDaniel, E. D. and Feldhusen, J. F. (1970). “Relationships between faculty ratings and indexes of service and scholarship,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 619–620.

    Google Scholar 

  • McGrath, E. J. 1962. “Characteristics of outstanding college teachers,” Journal of Higher Education 33: 148.

    Google Scholar 

  • McKeachie, W. J., Lin, Y., and Mann, W. (1971). “Student ratings of teacher effectiveness: validity studies,” American Educational Research Journal 8(3): 435–445.

    Google Scholar 

  • Menges, R. J. (1973). “The New Reporters: Students Rate Instruction,” in C. R. Pace, ed., New Directions in Higher Education: Evaluating Learning and Teaching, San Francisco, Cal.: Jossey-Bass.

    Google Scholar 

  • Null, E. J. and Nicholson, E. W. (1972). “Personal variables of students and their perception of university instructors,” College Student Journal 6: 6–9.

    Google Scholar 

  • Berry, R. R. and Baumann, R. R. (1973). “Criterla for the evaluation of college teaching: their reliability and validity at the University of Toledo,” in A. L. Sockloff, ed., Proceedings of the First Invitational Conference on Faculty Effectiveness as Evaluated by Students. Philadelphia, Pa.: Measurement and Research Center, Temple University.

    Google Scholar 

  • Pohlmann, J. T. (1975). “A multivariate analysis of selected class characteristics and student ratings of instruction,” Multivariate Behavioral Research 10(1): 81–91.

    Google Scholar 

  • Rayder, N. F. (1968). “College student ratings of instructors,” Journal of Experimental Education 37: 76–81.

    Google Scholar 

  • Remmers, H. H. (1928). “The relationship between students' marks and students' attitudes toward instructors,” School and Society 28: 759–760.

    Google Scholar 

  • Remmers, H. H. (1930). “To what extent do grades influence student ratings of instructors?” Journal of Educational Research 21: 314–316.

    Google Scholar 

  • Remmers, H. H. (1939). “Appraisal of college teaching through ratings and student opinion,“ in 27th Yearbook of the National Society of College Teachers of Education. Chicago, Ill.: University of Chicago Press.

    Google Scholar 

  • Remmers, H. H. (1960). Manual of Instructions for the Purdue Rating Scale for Instructors, revised edition. West Lafayette, Indiana: University Book Store.

    Google Scholar 

  • Remmers, H. H. and Elliott, D. N. (1949). “The Indiana college and university staff-evaluation program,” School and Society 70: 168–171.

    Google Scholar 

  • Remmers, H. H., Martin, F. D., and Elliott, D. N. (1949). “Are students' ratings of instructors related to their grades?” Purdue University Studies in Higher Education 66: 17–26.

    Google Scholar 

  • Riley, J. W., Ryan, B. F., and Lipschitz, M. (1950). The Student Looks at his Teacher. New Brunswick, N. J.: Rutgers University Press.

    Google Scholar 

  • Rodin, M., Frey, P. W., and Gessner, P. K. (1975). “Student evaluation,” Science 187: 555–559.

    Google Scholar 

  • Rodin, M. and Rodin, B. (1972). “Student evaluations of teachers,” Science 177: 1164–1166.

    Google Scholar 

  • Rosenshine, B., Cohen, A., and Furst, N. (1973). “Correlates of student preference ratings,” Journal of College Student Personnel 14: 269–272.

    Google Scholar 

  • Rosenthal, R. (1973). “The Pygmalion effect lives,” Psychology Today 7: 56–63.

    Google Scholar 

  • Rosenthal, R. and Jacobson, L. (1968). Pygmalion in the Classroom. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • Rubenstein, J. and Mitchell, H. (1970). “feeling free, student involvement, and appreciation,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 623–624.

    Google Scholar 

  • Russell, H. E. (1951). “Interrelations of Some Indices of Instructor Effectiveness.” Unpublished doctoral dissertation, University of Pittsburgh.

  • Russel, H. E. and Bendig, A. W. (1953). “Investigation of the relations of student ratings of psychology instructors to their course achievement when academic aptitude is controlled,” Educational and Psychological Measurement 13: 626–635.

    Google Scholar 

  • Schuh, A. J. and Crivelli, M. A. (1973). “Animadversion error in student evaluations of faculty teaching effectiveness,” Journal of Applied Psychology 58: 259–260.

    Google Scholar 

  • Schwab, D. P. (1975). “Course and student characteristic correlates of the course evaluation instrument,” Journal of Applied Psychology 60: 742–747.

    Google Scholar 

  • Scott, C. A. (1977). “Student ratings and instructor-defined extenuating circumstances,” Journal of Educational Psychology 69: 744–747.

    Google Scholar 

  • Sharon, A. T. and Bartlett, C. J. (1969). “Effect of instructional conditions in producing leniency on two types of rating scales,” Personnel Psychology 22: 251–263.

    Google Scholar 

  • Singhal, S. (1968). Illinois Course Evaluation Questionnaire Items by Rank of Instructor, Sex of the Instructor, and Sex of the Student. Research Report No. 282. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Snow, R. E. (1969). “Unfinished Pygmalion,” Contemporary Psychology 14: 197–199.

    Google Scholar 

  • Solomon, D. (1966). “Teacher behavior dimensions, course characteristics, and student evaluations of teachers,” American Educational Research Journal 3: 35–47.

    Google Scholar 

  • Spencer, R. E. (1968). The Illinois Course Evaluation Questionnaire: Manual of Interpretation. Research Report No. 270. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Spencer, R. E., and Aleamoni, L. M. (1970). “A student course evaluation questionnaire,” Journal of Educational Measurement 7: 209–210.

    Google Scholar 

  • Spencer, R. E. and Levitz, L. (1966). The Effects of Grade Expected on Students' Evaluation of Rhetoric 101–102. Research Report No. 244. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Stallings, W. M. and Singhal, S. (1968). Some Observations on the Relationships Between Productivity and Student Evaluations of Courses and Teaching Research Report No. 274. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Stallings, W. M. and Spencer, R. E. (1967). Ratings of Instructors in Accountancy 101 from Video-Tape Clips. Research Report No. 265. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

  • Starrak, J. A. (1934). “Student rating of instructor,” Journal of Higher Education 5: 88–90.

    Google Scholar 

  • Stewart, C. T. and Malpass, L. F. (1966). “Estimates of achievement and ratings of instructors,” Journal of Educational Research 59: 347–350.

    Google Scholar 

  • Subkoviak, M. J. and Levin, J. R. (1974). “Determining the characteristics of the ideal professor: an alternative approach,” Journal of Educational Measurement 11(4): 269–276.

    Google Scholar 

  • Sullivan, A. M. and Skanes, G. R. (1974). “Validity of student evaluation of teaching and the characteristics of successful instructors,” Journal of Educational Psychology 66: 584–590.

    Google Scholar 

  • Swanson, R. A. and Sisson, D. J. (1971). “The development, evaluation, and utilization of a departmental faculty appraisal system,” Journal of Industrial Teacher Education 9(1): 64–79.

    Google Scholar 

  • Taylor, E. K. and Wherry, R. J. (1951). “A study of leniency in two rating systems,” Personnel Psychology 4: 39–47.

    Google Scholar 

  • Thorndike, R. L. (1968). “Review of Pygmalion in the Classroom by R. Rosenthal and L. Jacobson,” American Educational Research Journal 5: 708–711.

    Google Scholar 

  • Treffinger, D. J. and Feldhusen, J. F. (1970). “Predicting students' rating of instruction,” Proceedings of the 78th Annual Convention of the American Psychological Association 5: 621–622.

    Google Scholar 

  • Voeks, V. W. (1962). “Publications and teaching effectiveness,” Journal of Higher Education 33: 212.

    Google Scholar 

  • Voeks, V. W. and French, G. M. (1960). “Are student-ratings of teachers affected by grades?” Journal of Higher Education 31: 330–334.

    Google Scholar 

  • Walker, B. D. (1969). “An investigation of selected variables relative to the manner in which a population of junior college students evaluate their teachers,” Dissertation Abstracts 29(9-B): 3474.

    Google Scholar 

  • Weaver, C. H. (1960). “Instructor rating by college students,” Journal of Educational Psychology 51: 21–25.

    Google Scholar 

  • Weigel, R. G., Oetting, E. R., and Tasto, D. L. (1971). “Differences in course grades and student ratings of teacher performance,” School and Society 99: 60–62.

    Google Scholar 

  • White, W. F., Hsu, Y. M., and Means, R. S. (1978). “Prediction of student ratings of college instructors from multiple achievement test variables,” Educational and Psychological Measurement 38(4): 1077–1083.

    Google Scholar 

  • Wood, K., Linsky, A. S., and Straus, M. A. (1974). “Class size and student evaluations of faculty,” Journal of Higher Education 45: 524–534.

    Google Scholar 

  • Yongkittikul, C., Gillmore, G. M., and Brandenburg, D. C. (1974). Does the Time of Course Meeting Affect Course Ratings by Students?. Research Report No. 346. Urbana, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois at Urbana-Champaign.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

The authors are indebted to Professor Robert A. Waller for cooperating in obtaining the data on his two history courses.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aleamoni, L.M., Hexner, P.Z. A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation. Instr Sci 9, 67–84 (1980). https://doi.org/10.1007/BF00118969

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00118969

Keywords

Navigation