Abstract
First, the longitudinal nature of student ratings of instructors has not received deserved emphasis from researchers. Second, the use of item banks for designing student rating questionnaires, especially for instructor feedback, has needed attention. These two factors are investigated in this study, which tracks 304 instructors over a four semester period. It was found that the type of questionnaire generated from the item bank led to statistically significant differences among designated groups. The longitudinal analysis, however, indicated only minor improvement over time, regardless of whether or not an instructor chose to use items yielding specific feedback on the instructional components of a course. Additionally, although main effect differences were noted between teaching assistants and regular faculty, other results were very similar.
Similar content being viewed by others
References
Aiken, L. R. (1975). Procedures and problems in designing a college course evaluation questionnaire.College and University 50: 247–253.
Aleamoni, L. M. (1978). The usefulness of student evaluations in improving college teaching.Instructional Science 7: 95–105.
Aleamoni, L. M., and Graham, M. H. (1974). The relationship between CEQ ratings and instructor's rank, class size, and course level.Journal of Educational Measurement 11: 189–202.
Aleamoni, L. M., and Yimer, M. (1973). An investigation of the relationship between colleague rating, student rating, research productivity and academic rank in rating instructional effectiveness.Journal of Educational Psychology 64: 274–277.
Brandenburg, D. C., Slinde, J. A., and Batista, E. E. (1977). Student ratings of instruction: Validity and normative interpretations.Research in Higher Education 7: 67–78.
Brown, D. L. (1976). Faculty ratings and student grades: A university-wide multiple regression analysis.Journal of Educational Psychology 68: 573–578.
Centra, J. A. (1973). Effectiveness of student feedback in modifying college instruction.Journal of Educational Psychology 65: 395–401.
Centra, J. A. (1980).Determining Faculty Performance. San Francisco: Jossey-Bass.
Cohen, P. A. (1980). Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings.Research in Higher Education 13: 321–341.
Delaney, E. L. (1976). The relationships of student ratings of instruction to student, instructor and course characteristics. Paper presented at the annual meeting of AERA. ERIC Document Reproduction Service ED 128 365.
Elmore, P. B., and Pohlmann, J. J. (1978). Effect of teacher, student and class characteristics on the evaluation of college instructors,Journal of Educational Psychology 70: 187–192.
Erickson, G. R., and Erickson, B. L. (1979). Improving college teaching: An evaluation of a teaching consultation procedure.Journal of Higher Education 50: 670–683.
Feldman, K. A. (1976). Grades and college students' evaluations of their courses and teachers.Research in Higher Education 4: 69–111.
Feldman, K. A. (1977). Consistency and variability among college students in rating their teachers and courses: A review and analysis.Research in Higher Education 6: 223–274.
Feldman, K. A. (1978). Course characteristics and college students' ratings of their teachers: What we know and what we don't.Research in Higher Education 9: 199–242.
Feldman, K. A. (1979). The significance of circumstances for college students' rating of their teachers and courses.Research in Higher Education 10: 149–172.
Freedman, R. D., Stumpf, S. A., and Aguanno, J. C. (1979). Validity of the Course-Faculty Instrument (CFI): Intrinsic and extrinsic variables.Educational and Psychological Measurement 39: 153–159.
Gage, N. L. (1961). The appraisal of college teaching: An analysis of ends and means.Journal of Higher Education 32: 17–22.
Hogan, J. P. (1973). Similarity of student ratings across instructors, courses, and time.Research in Higher Education 1: 149–154.
Hoyt, D. P., and Howard, G. S. (1978). The evaluation of faculty development programs.Research in Higher Education 8: 25–38.
Kerlinger, F. N., and Pedhazur, E. J. (1973).Multiple Regression in Behavioral Research. New York: Holt, Rinehart and Winston.
Kirk, R. B. (1968).Experimental Design: Procedures for the Behavioral Sciences. Belmont, Calif.: Brooks/Cole.
Kulik, J. A., and Kulik, C. C. (1974). Student ratings of instruction.Teaching of Psychology 1: 51–57.
Marsh, H. W. (1983). Multidimensional ratings of teacher effectiveness by students from different academic settings and their relationship to student/course/instructor characteristics.Journal of Educational Psychology 75: 150–166.
Marsh, H. W. (1980). The influence of student, course, and instructor characteristics in evaluations of university teaching.American Educational Research Journal 17: 219–237, 1980.
Marsh, H. W., and Overall, J. U. (1979). Long-term stability of students' evaluations: A note on Feldman's consistency and variability among college students in rating their teachers and courses.Research In Higher Education 10: 139–147.
Nevill, D. D., Ware, W. B., and Smith, A. B. (1978). A comparison of student ratings of teaching assistants and faculty members.American Educational Research Journal 15: 25–37.
Office of Instructional Resources (1978).Instructor and Course Evaluation System (ICES) Newsletter, No. 1–4. Urbana, Ill: University of Illinois.
Overall, J. C., and Spiegel, D. K. (1969). Concerning least squares analysis of experimental data.Psychological Bulletin 72: 311–322.
Pedhazur, E. J. (1977). Coding subjects in repeated measures designs.Psychological Bulletin 84: 298–305.
Rotem, A., and Glasman, N. S. (1979). On the effectiveness of students' evaluative feedback to university instructors.Review of Educational Research 49: 497–511.
Sullivan, A. M., and Skines, G. R. (1974). Validity of student evaluation of teaching and the characteristics of successful instructors.Journal of Educational Psychology 66: 584–590.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gray, D.M., Brandenburg, D.C. Following student ratings over time with a catalog-based system. Res High Educ 22, 155–168 (1985). https://doi.org/10.1007/BF00974912
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00974912