Abstract
The use of aggregated student evaluations of their courses and course elements (e.g., subject functionality, affect, difficulty, graded assignments) is suggested as an efficient and useful means of obtaining program and department assessments. Given that the instruments used to collect student evaluations are valid (if they are not, they should not be used for any purpose), then averaging class data is likely to provide a valid and reliable index of program and department effectiveness as evaluated by students.
Program and department assessment data are presented and discussed for a large northeastern professional school. Large and significant differences in the ratings of program elements were found. Although many of the elements designed into the program by the administration and faculty were perceived as operational by the students, some discrepancies between the design and student perceptions existed. Substantial departmental differences were also found which indicated areas of strength and weakness both within and across departments. The potential usefulness of the assessment for internal change and development is discussed.
Similar content being viewed by others
References
Aleamoni, L. M., and Spencer, R. E. The Illinois Course Evaluation Questionnaire: A description of its development and a report of some of its results.Educational and Psychological Measurement 1973,33 669–684.
Cohen, J., and Cohen, P.Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, N.J.: Lawrence Erlbaum Associates, 1975.
Costin, F., Greenough, W. T., and Menges, R. J. Student ratings of college teaching: Reliability, validity, and usefulness.Review of Educational Research 1971,41 511–535.
Doyle, K. O., Jr.Student evaluation of instruction. Lexington, MA: Lexington Books, 1975.
Feldman, K. A. Consistency and variability among college students in rating their teachers and courses: A review and analysis.Research in Higher Education 1977,6 223–274.
Freedman, R. D., and Stumpf, S. A. Student evaluations of courses and faculty based on a perceived learning criterion: Scale construction, validation, and comparison of results.Applied Psychological Measurement 1978,2 189–201.
Freedman, R. D., Stumpf, S. A., and Aguanno, J. C. Validity of the Course-Faculty Instrument (CFI): Intrinsic and extrinsic variables.Educational and Psychological Measurement 1979,39 153–158.
Freedman, R. D., Stumpf, S. A., and Krieger, K. M. Business students' perceptions of subject matter, their learning, evaluation of courses, and school comparisons. Paper presented at the38th Annual Meeting of the Academy of Management, San Francisco, August 1978.
Grush, J. E., and Costin, F. The student as consumer of the teaching process.American Educational Research Journal 1975,12 55–66.
Kulik, J. A., and McKeachie, W. J. The evaluation of teachers in higher education. In F. Kerlinger (Ed.),Review of Research in Education (Vol. 3). Itadca, Ill.: F. E. Peacock Publishers, 1975, pp. 210–240.
McFillen, J. M. A factor analytic approach to instructor and course evaluation and composite scale reliability.Proceedings of the 36th Annual Meeting of the Academy of Management 1976,36 38–42.
McKeachie, W. J., Lin, Y., and Mann, W. Student ratings of teaching effectiveness: Validity studies.American Educational Research Journal 1971,8 435–445.
Peterson, R. A., Kerin, R. A., and Martin, W. S. Teaching effectiveness in the decision sciences: The use of student evaluations.Decision Sciences 1978,9 712–724.
Rodin, M., and Rodin, B. Student evaluation of teachers.Science 1972,177 1164–1166.
Schwab, D. P.Manual for the Course Evaluation Instrument. Graduate School of Business and Industrial Relations Institute, University of Wisconsin-Madison, 1976.
Sockloff, A. L. Instruments for student evaluation of faculty: Ideal and actual. In A. L. Sockloff (Ed.),Proceedings: The first invitational conference on faculty effectiveness as evaluated by students. Philadelphia: Measurement and Research Center, Temple University, 1973, pp. 132–151.
Stumpf, S. A., Freedman, R. D., and Krieger, K. M. Validity extension of the Course-Faculty Instrument (CFI).Research in Higher Education 1979,11 13–22.
Wallace, M., and Schwab, D. P. The validation of a teaching effectiveness measure in two business schools.Proceedings of the 33rd annual meeting of the Academy of Management 1973,33 229–235.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Stumpf, S.A. Assessing academic program and department effectiveness using student evaluation data. Res High Educ 11, 353–363 (1979). https://doi.org/10.1007/BF00975625
Issue Date:
DOI: https://doi.org/10.1007/BF00975625