Abstract
Little is known about the effects of Ratemyprofessors.com teaching evaluations relative to university-administered teaching evaluations in students. Therefore, this study investigated differences in use and consideration of these evaluation sources. It also investigated the effects of evaluation source, evaluation valence (mostly positive or mostly negative), and their interaction on students’ decision making, self-efficacy for a course, and expectations about academic outcomes. Participants were 223 undergraduates who viewed either mostly positive or mostly negative teaching evaluations about a fictitious professor and were told that were from either university-administered teaching evaluations or Ratemyprofessors.com. Evaluation valence, but not source, affected participants’ decision making, self-efficacy, and expectations about the professor’s course. Implications for student self-efficacy and expectations are discussed. Additionally, recommendations for students who choose to use Ratemyprofessors.com to inform their course decision making are provided.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, K. J., & Smith, G. (2005). Students’ preconceptions of professors: Benefits and barriers according to ethnicity and gender. Hispanic Journal of Behavioral Sciences, 27, 184–201.
Atzmüller, C., & Steiner, P. M. (2010). Experimental vignette studies in survey research. Methodology, 6, 128–138. https://doi.org/10.1027/1614-2241/a000014.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215. https://doi.org/10.1037/0033-295X.84.2.191.
Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37, 122–147. https://doi.org/10.1037/0003-066X.37.2.122.
Bandura, A. (1989). Human agency in social cognitive theory. American Psychologist, 44, 1175–1184. https://doi.org/10.1037/0003-066X.44.9.1175.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
Basow, S. A. (1995). Student evaluations of college professors: Gender matters. Journal of Educational Psychology, 87, 656–665. https://doi.org/10.1037/0022-0663.87.4.656.
Bleske-Rechek, A., & Fritsch, A. (2011). Student consensus on Ratemyprofessors.com. Practical Assessment, Research & Evaluation, 16(1), 18.
Boehmer, D. M., & Wood, W. C. (2017). Student vs. faculty perspectives on quality instruction: Gender bias, “hotness”, and “easiness” in evaluating teaching. Journal of Education for Business, 92, 173–178. https://doi.org/10.1080/08832323.2017.1313189.
Boswell, S. S. (2016). Ratemyprofessors is hogwash (but I care): Effects of Ratemyprofessors and university-administered teaching evaluations on professors. Computers in Human Behavior, 56, 155–162. https://doi.org/10.1016/j.chb.2015.11.045.
Brown, M. J., Baillie, M., & Fraser, S. (2009). Rating Ratemyprofessors.com: A comparison of online and official student evaluations of teaching. College Teaching, 57, 89–92. https://doi.org/10.3200/CTCH.57.2.89-92.
Brown, C. L., & Kosovich, S. M. (2015). The impact of professor reputation and course attributes on student course selection. Research in Higher Education, 56, 496–509. https://doi.org/10.1007/s11162-014-9356-5.
Buck, G. H. (2004). Vox populi? The Alberta Journal of Educational Research, 50(3), 217–220.
Carnevale, D. (2006). University of Saskatchewan fires tenured professor accused of maligning colleagues on Ratemyprofessors website. The Chronicle of Higher Education, 52(27), A28.
Caron, P. (2006). Tenured professor fired for maligning colleagues on RateMyProfessors.com. http://taxprof.typepad.com/taxprof_blog/2006/02/tenured_profess.html.
Chemers, M. M., Hu, L.-T., & Garcia, B. F. (2001). Academic self-efficacy and first year college student performance and adjustment. Journal of Educational Psychology, 93, 55–64. https://doi.org/10.1037/0022-0663.93.1.55.
Clayson, D. E. (2014). What does ratemyprofessors.com actually rate? Assessment & Evaluation in Higher Education, 39, 678–698. https://doi.org/10.1080/02602938.2013.861384.
Cohen, J. (1988). Statistical power for the behavioral sciences. New Jersey: Lawrence Erlbaum Associates.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. https://doi.org/10.1037/0033-2909.112.1.155.
Coladarci, T., & Kornfeld, I. (2007). RateMyProfessor.scom versus formal in-class student evaluations of teaching. Practical Assessment, Research, & Evaluation, 12(1), 6.
Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34, 65. https://doi.org/10.1080/02602930801895695.
Edwards, A., & Edwards, C. (2013). Computer-mediated word-of-mouth communication: The influence of mixed reviews on student perceptions of instructors and courses. Communication Education, 62(4), 412–424. https://doi.org/10.1080/03634523.2013.800217.
Edwards, C., Edwards, A., Qing, Q., & Wahl, S. T. (2007). The influence of computer-mediated word-of-mouth communication on student perceptions of instructors and attitudes toward learning course content. Communication Education, 56(3), 255–277. https://doi.org/10.1080/03634520701236866.
Edwards, A., Edwards, C., Shaver, C., & Oaks, M. (2009). Computer-mediated word-of-mouth communication on Ratemyorofessorscom: Expectancy effects on student cognitive and behavioral learning. Journal of Computer-Mediated Communication, 14(2), 368–392. https://doi.org/10.1111/j.1083-6101.2009.01445.x.
El-Alayli, A., Hansen-Brown, A. A., & Ceynar, M. (2018). Dancing backward in high heels: Female professors experience more work demands and special favor requests, particularly from academically entitled students. Sex Roles. https://doi.org/10.1007/s11199-017-0872-6.
Erdfelder, E., Faul, F., & Buchner, A. (1996). GPOWER: A general power analysis program. Behavioral Research Methods, Instruments, & Computers, 28, 1–11. https://doi.org/10.3758/BF03203630.
Faul, F., Erdfelder, E., Lang, A., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. https://doi.org/10.3758/BF03193146.
Felton, J., Mitchell, J., & Stinson, M. (2004). Web-based student evaluations of professors: the relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29, 91–108. https://doi.org/10.1080/0260293032000158180.
Field, J. R., Bergiel, B. J., & Viosca, R. C. (2008). An exploratory study of student use and perceived accuracy of faculty evaluations on Ratemyprofessors.com. Competition Forum, 6, 378–383.
Flaherty, C. (2018). Bye, bye chili pepper. https://www.insidehighered.com/news/2018/07/02/rate-my-professors-ditches-its-chili-pepper-hotness-quotient.
Freng, S., & Webber, D. (2009). Turning up the heat on online teaching evaluations: Does “hotness” matter? Teaching of Psychology, 36, 189–193. https://doi.org/10.1080/00986280902959739.
George, D., Dixon, S., Stansal, E., Gelb, S. L., & Pheri, T. (2008). Time diary and questionnaire assessment of factors associated with academic and personal success among university undergraduates. Journal of American College Health, 56(6), 706–715. https://doi.org/10.3200/JACH.56.6.706-715.
Good, M., & Adams, G. R. (2008). Linking academic social environments, ego-identity formation, ego virtues, and academic success. Adolescence, 43(170), 221–236.
Gotlieb, J. (2011). Classroom entertainment, upgrades, and student evaluations of business professors. Journal of the Academy of Business Education, 13, 118–136.
Gross, P. (2008). French courts say “non” to “rate my teacher”. https://www.techradar.com/news/internet/web/french-courts-say-non-to-rate-my-teacher-257018.
Gump, S. E. (2005). The cost of cutting class: Attendance as a predictor of student success. College Teaching, 53, 21–26. https://doi.org/10.3200/CTCH.53.1.21-26.
Hartman, K. B., Hunt, J. B., & Childers, C. Y. (2013). Effects of eWOM valence: examining consumer choice using evaluations of teaching. Journal of Behavioral Studies in Business, 6, 1–12.
Hayes, M. W., & Prus, J. (2014). Student use of quantitative and qualitative information on Ratemyprofessors.com for course selection. College Student Journal, 48, 675–688.
Hayles, N. K., & Gessler, N. (2005). Rating RateMyProfessorscom. English Studies in Canada, 31(4), 6–9. https://doi.org/10.1353/esc.2007.0045.
Hinz, A. (2011). Attitudes of German teachers and students toward public online ratings of teacher quality. Electronic Journal of Research in Educational Psychology, 9(2), 745–764.
Ingraham, K. C., Davidson, S. J., & Yonge, O. (2018). Student-faculty relationships and its impact on academic outcomes. Nurse Education Today, 71, 17–21. https://doi.org/10.1016/j.nedt.2018.08.021.
Jaschik, S. (2006). RateMyProfessors: hidden camera edition. https://www.insidehighered.com/news/2006/11/02/rmp.
Johnson, R. R., & Crews, A. D. (2013). My professor is hot! Correlates of Ratemyprofessors.com ratings for criminal justice and criminology faculty members. American Journal of Criminal Justice, 38(4), 639–656. https://doi.org/10.1007/s12103-012-9186-y.
Joye, S. W., & Wilson, J. H. (2015). Professor age and gender affect student perceptions and grades. Journal of the Scholarship of Teaching and Learning, 15(4), 126–138.
Karpen, S. C., Jia, L., & Rydell, R. J. (2012). Discrepancies between implicit and explicit attitude measures as an indicator of attitude strength. European Journal of Social Psychology, 42, 24–29. https://doi.org/10.1002/ejsp.849.
Katrevich, A. V., & Aruguete, M. S. (2017). Recognizing challenges and predicting success in first-generation university students. Journal of STEM Education: Innovations and Research, 18(2), 40–44.
Kindred, J., & Mohammed, S. N. (2005). He will crush you like an academic ninja!: Exploring teacher ratings on Ratemyprofessors.com. Journal of Computer-Mediated Communication, 10(3), 9. https://doi.org/10.1111/j.1083-6101.2005.tb00257.x.
Komarraju, M., Musulkin, S., & Bhattacharya, G. (2010). Role of student-faculty interactions in developing college students’ academic self-concept, motivation, and achievement. Journal of College Student Development, 51, 332–342. https://doi.org/10.1353/csd.0.0137.
Kowai-Bell, N., Guadagno, R. E., Little, T., & Ballew, J. L. (2012). Professors are people too: The impact of informal evaluations of professors on students and professors. Social Psychology of Education, 15, 337–351. https://doi.org/10.1007/s11218-012-9181-7.
Kowai-Bell, N., Guadagno, R. E., Little, T., Preiss, N., & Hensley, R. (2011). Rate my expectations: How online evaluations of professors impact students’ perceived control. Computers in Human Behavior, 27, 1862–1867. https://doi.org/10.1016/j.chb.2011.04.009.
Kwak, D. W., Sherwood, C., & Tang, K. K. (2018). Class attendance and learning outcome. Empirical Economics, 1, 1. https://doi.org/10.1007/s00181-018-1434-7.
Landry, N. M., Kurkul, K. E., & Poirier, C. R. (2010). Online faculty rating sites: Examining how students perceive and use Ratemyprofessors.com. Psi Chi Journal of Undergraduate Research, 15, 139–142.
Lawson, R. A., & Stephenson, E. F. (2005). Easiness, Attractiveness, and Faculty Evaluations: Evidence from RateMyProfessors.com. Atlantic Economic Journal, 33(4), 485–486. https://doi.org/10.1007/s11293-005-2873-z.
Legg, A. M., & Wilson, J. H. (2012). RateMyProfessors.com offers bias evaluations. Assessment & Evaluation in Higher Education, 37, 89–97. https://doi.org/10.1080/02602938.2010.507299.
Lewandowski, G., Higgins, E., & Nardon, N. N. (2012). Just a harmless website?: An experimental examination of Ratemyprofessors.com’s effect on student evaluations. Assessment & Evaluation in Higher Education, 37, 987–1002. https://doi.org/10.1080/02602938.2011.594497.
Liu, J., Hu, J., & Furutan, O. (2013). The influence of student perceived professors’ “hotness” on expertise, motivation, learning outcomes, and course satisfaction. Journal of Education for Business, 88, 94–100. https://doi.org/10.1080/08832323.2011.652695.
Masnick, M. (2008). France decides that expressing an opinion about your teachers should be illegal. https://www.techdirt.com/articles/20080304/005526425.shtml.
Montell, G. (2006). The art of the bogus rating. https://www.chronicle.com/article/The-Art-of-the-Bogus-Rating/46887.
Murray, K. B., & Zdravkovic, S. (2016). Does MTV really do a good job of evaluating professors? An empirical test of the internet site RateMyProfessors.com. Journal of Education for Business, 91, 138–147. https://doi.org/10.1080/08832323.2016.1140115.
Otto, J., Sanford, D. A., & Ross, D. N. (2008). Does Ratemyprofessor.com really rate my professor? Assessment & Education in Higher Education, 33, 355–368. https://doi.org/10.1080/02602930701293405.
Pajares, F. (1997). Current directions in self-efficacy research. In M. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (pp. 1–49). Greenwich: JAI Press.
Punyanunt-Carter, N., & Carter, S. L. (2015). Students’ gender bias in teaching evaluations. Higher Learning Research Communications, 5(3), 28–37. https://doi.org/10.18870/hlrc.v5i3.234.
Qualtrics. (2019). Qualtrics Research Core. https://www.qualtrics.com/research-core/.
Ratemyprofessors.com. (2020a). About Ratemyprofessors.com. http://www.ratemyprofessors.com/About.jsp.
Ratemyprofessors.com. (2020b). Can you explain the rating scale? https://help.ratemyprofessors.com/article/31-rating-scale.
Reed, D. K., Rimel, H., & Hallett, A. (2016). Note-taking interventions for college students: A synthesis and meta-analysis of the literature. Journal of Research on Educational Effectiveness, 9, 307–333. https://doi.org/10.1080/19345747.2015.1105894.
Reid, L. D. (2010). The role of perceived race and gender in the evaluation of college teaching on RateMyProfessors.com. Journal of Diversity in Higher Education, 3, 137–152. https://doi.org/10.1037/a0019865.
Ritter, K. (2008). E-valuating learning: Rate My Professors and public rhetorics of pedagogy. Rhetoric Review, 3, 259–280. https://doi.org/10.1080/07350190802126177.
Rosen, A. S. (2017). Correlations, trends and potential biases among publicly accessible web-based student evaluations of teaching: a large-scale study of RateMyProfessors.com data. Assessment & Evaluation in Higher Education, 43, 31–44. https://doi.org/10.1080/02602938.2016.1276155.
Schudde, L. (2019). Short- and long-term impacts of engagement experiences with faculty and peers at community colleges. Review of Higher Education, 42, 385–426. https://doi.org/10.1353/rhe.2019.0001.
Simonton, T. (2018). No more chili pepper: RateMyProfessors ditches ‘hotness’ ratings. https://www.chronicle.com/article/No-More-Chili-Pepper-/243809.
Sohr-Preston, S. L., Boswell, S. S., McCaleb, K., & Robertson, D. (2016). Professor gender, age, and “hotness” in influencing college students’ generation and interpretation of professor ratings. Higher Learning Research Communications. https://doi.org/10.18870/hlrc.v6i3.328.
Solberg, V. S., O’Brien, K., Villarreal, P., Kennel, R., & Davis, B. (1993). Self-efficacy of Hispanic college students: Validation of the College Self-Efficacy instrument. Hispanic Journal of Behavioral Sciences, 15, 80–95. https://doi.org/10.1177/07399863930151004.
Solberg, V. S., & Villarreal, P. (1997). Examination of self-efficacy, social support, and stress as predictors of psychological and physical distress among Hispanic college students. Hispanic Journal of Behavioral Sciences, 19, 182–201. https://doi.org/10.1177/07399863970192006.
Stonebraker, R. J., & Stone, G. S. (2015). Too old to teach? The effect of age on college and university professors. Research in Higher Education, 56, 793–812. https://doi.org/10.1007/s11162-015-9374-y.
Subtirelu, N. C. (2015). “She does have an accent but…”: Race and language ideology in students’ evaluations of mathematics instructors on RateMyProfessors.com. Language in Society, 44, 35–62. https://doi.org/10.1017/S0047404514000736.
Svanum, S., & Aigner, C. (2011). The influences of course effort, mastery and performance goals, grade expectancies, and earned course grades on student ratings and course satisfaction. British Journal of Educational Psychology, 81, 667–679. https://doi.org/10.1111/j.2044-8279.2010.02011.x.
Svanum, S., & Bigatti, S. M. (2006). The influences of course effort and outside activities on grades in a college course. Journal of College Student Development, 47, 564–576. https://doi.org/10.1353/csd.2006.0063.
Theyson, K. C. (2015). Hot or not: The role of instructor quality and gender on the formation of positive illusions among students using RateMyProfessors.com. Practical Research and Assessment, 20(4). http://pareonline.net/getvn.asp?v=20&n=4
Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84(1), 55–61. https://doi.org/10.3200/JOEB.84.1.55-61.
Tinto, V. (1999). Taking retention seriously: Rethinking the first year of college. NACADA Journal, 19(2), 5–9. https://doi.org/10.12930/0271-9517-19.2.5.
Turner, E. A., Chandler, M., & Heffer, R. W. (2009). The influence of parenting styles, academic motivation, and self-efficacy on academic performance and college students. Journal of College Student Development, 50, 337–346. https://doi.org/10.1353/csd.0.0073.
Wright, S. L., Jenkins-Guarnieri, M. A., & Murdock, J. L. (2012). Career development among first-year college students: College self-efficacy, student persistence, and academic success. Journal of Career Development, 40, 292–310. https://doi.org/10.1177/0894845312455509.
Ratemyprofessors.com (n.d.). Ratings categories. http://www.ratemyprofessors.com/Categories.jsp.
Yermack, J., & Forsyth, D. R. (2016). Students’ implicit theories of university professors. Scholarship of Teaching and Learning in Psychology, 2, 169–178.
Zajacova, A., Lynch, S. M., & Espenshade, T. J. (2005). Self-efficacy, stress, and academic success in college. Research in Higher Education, 46(6), 677–706. https://doi.org/10.1007/s11162-004-4139-z.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Boswell, S.S., Sohr-Preston, S.L. I checked the prof on ratemyprofessors: effect of anonymous, online student evaluations of professors on students’ self-efficacy and expectations. Soc Psychol Educ 23, 943–961 (2020). https://doi.org/10.1007/s11218-020-09566-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11218-020-09566-y