Professor Gender, Age, and “Hotness” in Influencing College Students’ Generation and Interpretation of Professor Ratings
Undergraduate psychology students rated expectations of a bogus professor (randomly designated a man or woman and hot versus not hot) based on an online rating and sample comments as found on RateMyProfessors.com (RMP). Five professor qualities were derived using principal components analysis (PCA): dedication, attractiveness, enhancement, fairness, and clarity. Participants rated current psychology professors on the same qualities. Current professors were divided based on gender (man or woman), age (under 35 or 35 and older), and attractiveness (at or below the median or above the median). Using multivariate analysis of covariance (MANCOVA), students expected hot professors to be more attractive but lower in clarity. They rated current professors as lowest in clarity when a man and 35 or older. Current professors were rated significantly lower in dedication, enhancement, fairness, and clarity when rated at or below the median on attractiveness. Results, with previous research, suggest numerous factors, largely out of professors’ control, influencing how students interpret and create professor ratings. Caution is therefore warranted in using online ratings to select courses or make hiring and promotion decisions.
Abel, M. H., & Meltzer, A. L. (2007). Student ratings of a male and female professors’ lecture on sex discrimination in the workforce. Sex Roles, 57, 173–180. doi:10.1007/s11199-007-9245-x
Adamson, G., O'Kane, D., & Shevlin, M. (2005). Students' ratings of teaching effectiveness: A laughing matter? Psychological Reports, 96, 225-226. doi:10.2466/PR0.96.1.225-226
Ahmadi, M., Helms, M. M., & Raiszadeh, F. (2001). Business students' perceptions of faculty evaluations. International Journal of Educational Management, 15, 12-22. doi:10.1108/09513540110366097
Ambady, N., & Rosenthal, R. (1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology, 64, 431-441. Retrieved from http://www.apa.org/pubs/journals/psp/
Arbuckle, J., & Williams, B. D. (2003). Students' perceptions of expressiveness: Age and gender effects on teacher evaluations. Sex Roles, 49, 507-516. doi:10.1023/A:1025832707002
Bachen, C. M., McLoughlin, M. M., & Garcia, S. S. (1999). Assessing the role of gender in college students’ evaluations of faculty. Communication Education, 48, 193-210. doi:10.1080/03634529909379169
Basow, S. A. (2000). Best and worst professors: Gender patterns in students' choices. Sex Roles, 43, 407-417. doi:10.1023/A:1026655528055
Basow, S. A., & Silberg, N. T. (1987). Student evaluations of college professors: Are female and male professors rated differently? Journal of Educational Psychology, 79, 308-314. doi:10.1037/0022-0618.104.22.1688
Bennett, S. K. (1982). Student perceptions of and expectations for male and female instructors: Evidence relating to the question of gender bias in teaching evaluation. Journal of Educational Psychology, 74, 170-179. doi:10.1037/0022-0622.214.171.124
Bianchini, S., Lissoni, F., & Pezzoni, M. (2013). Instructor characteristics and students' evaluation of teaching effectiveness: Evidence from an Italian engineering school. European Journal of Engineering Education, 38, 38-57. Retrieved from www.tandfonline.com/loi/ceee20
Bonds-Raacke, J., & Raacke, J. D. (2007). The relationship between physical attractiveness of professors and students’ ratings of professor quality. Journal of Psychiatry, Psychology and Mental Health, 1, 1-7. Retrieved from http://www.scientificjournals.org/Journals2011/j_of_psychiatry_and_psychology1_2011.htm
Borboa, D., Joseph, M., & Spake, D. F. (2012). Use of technology in higher education: A preliminary analysis of student views. Society for Marketing Advances Proceedings, 157-158. Retrieved from http://www.marketingadvances.org/
Boswell, S. S. (2016). Ratemyprofessors is hogwash (but I care): Effects of Ratemyprofessors and university-administered teaching evaluations on professors. Computers in Human Behavior, 56, 155-162. doi:10.1016/j.chb.2015.11.045
Buck, S., & Tiene, D. (1989). The impact of physical attractiveness, gender, and teaching philosophy on teacher evaluations. The Journal of Educational Research, 82, 172-177. doi:10.1080/00220671.1989.10885887
Burns-Glover, A. L., & Veith, D. J. (1995). Revisiting gender and teaching evaluations: Sex still makes a difference. Journal of Social Behavior and Personality, 10, 69-80.
Cacioppo, J. T., Gardner,W. L., & Berntson, G. G. (1999). The affect system has parallel and integrative processing components: form follows function. Journal of Personality and Social Psychology, 76, 839-855. doi:10.1037/0022-35126.96.36.1999
Carnevale, D. (2006). University of Saskatchewan fires tenured professor accused of maligning colleagues on ratemyprofessors web site. The Chronicle of Higher Education, 52, A28.
Carver, C. S., & Scheier, M. F. (1990). Origins and functions of positive and negative affect: A control-process view. Psychological Review, 97, 19-35. doi:10.1037/0033-295X.97.1.19.
Cashin, W. E. (1992). Student ratings: The need for comparative data. Instructional Evaluation and Faculty Development, 12, 146.
Cahyadi, V. (2004). The effect of interactive engagement teaching on student understanding of introductory physics at the faculty of engineering, University of Surabaya, Indonesia. Higher Education Research and Development, 23, 455-464. Retrieved from http://www.tandfonline.com/toc/cher20/current
Chia, R. C., Allred, L. J., Grossnickle, W. F., & Lee, G. W. (1998). Effects of attractiveness and gender on the perception of achievement-related variables. The Journal of Social Psychology, 138, 471-477. doi:10.1080/00224549809600401
Clayson, D. E., & Sheffet, M. J. (2006). Personality and the student evaluation of teaching. Journal of Marketing Education, 28, 149-160. doi:10.1177/0273475306288402
Coladarci, T., & Kornfield, I. (2007). RateMyProfessors.com versus formal in-class student evaluations of teaching. Practical Assessment, Research & Evaluation, 12, 1-15. Retrieved from http://pareonline.net
Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34, 51–65. doi:10.1080/02602930801895695
Dion, K., Berscheid, E., & Walster, E. (1972). What is beautiful is good. Journal of Personality and Social Psychology, 24, 285-290. doi:10.1037/h0033731
Divoky, J.J., & M.A. Rothermel (1988). Student perceptions of the relative importance of dimensions of teaching performance across type of class. Educational Research Quarterly, 12, 40–45.
Eadie, B. (1996). Instructor credibility and style of dress; Performance in groups at an Irish gay bar. Spectra, 32, 11-13.
Eagly, A. H., Ashmore, R. D., Makhijani, M. G., & Longo, L. C. (1991). What is beautiful is good, but…: A meta-analytic review of research on the physical attractiveness stereotype. Psychological Bulletin, 110, 109-128. doi:10.1037/0033-2909.110.1.109
Edwards, C., Edwards, A., Qing, Q., & Wahl, S. T. (2007). The influence of computer-mediated word-of-mouth communication on student perceptions of instructors and attitudes toward learning course content. Communication Education, 56, 255-277. doi:10.1080/03634520701236866
Edwards, A., Edwards, C., Shaver, C., & Oaks, M. (2009). Computer‐mediated word‐of‐mouth communication on Ratemyprofessors.com: Expectancy effects on student cognitive and behavioral learning. Journal of Computer‐Mediated Communication, 14, 368-392. doi:10.1111/j.1083-6101.2009.01445.x
Feldman, K.A. (1978). Course characteristics and college students’ ratings of their teachers: What we know and what we don’t. Research in Higher Education, 9, 199–242. doi:10.1007/BF00976997
Feldman, K. A. (1983). The seniority and instructional experience of college teachers as related to the evaluations they receive from their students. Research in Higher Education, 18, 3-124. doi: 10.1007/BF00992080
Feldman, K. A. (1986). The perceived instructional effectiveness of college teachers as related to their personality and attitudinal characteristics: A review and synthesis. Research in Higher Education, 24, 139-213. doi:10.1007/BF00991885
Felton, J., Koper, P. T., Mitchell, J., & Stinson, M. (2008). Attractiveness, easiness and other issues: Student evaluations of professors on ratemyprofessors.com. Assessment & Evaluation in Higher Education, 33, 45-61. doi:10.1080/02602930601122803
Felton, J., Mitchell, J., & Stinson, M. (2004). Web-based student evaluations of professors: the relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29, 91-108. doi:10.1080/0260293032000158180
Field, A. (2013). Discovering statistics using IBM SPSS Statistics (4th ed.). London: SAGE.
Freng, S., & Webber, D. (2009). Turning up the heat on online teaching evaluations: Does "hotness" matter?. Teaching Of Psychology, 36, 189-193. Retrieved from http://top.sagepub.com/
Frenzel, A. C., Goetz, T., Ludtke, O., Pekrun, R., & Sutton, R. E. (2009). Emotional transmission in the classroom: Exploring the relationship between teacher and student enjoyment. Journal of Educational Psychology, 101, 705-716. doi:10.1037/a0014695
Garner, R. L. (2006). Humor in pedagogy. College Teaching, 54, 177-180. Retrieved from http://www.tandfonline.com/toc/vcol20/current
Gehrt, K., Louie, T. A., & Osland, A. (2015). Student and professor similarity: Exploring the effects of gender and relative age. Journal of Education for Business, 90, 1-9. doi:10.1080/08832323.2014.968514
Goldberg, G., & Callahan, J. (1991). Objectivity of student evaluations of instructors. Journal of Education for Business, 66, 377-378. doi:10.1080/08832323.1991.10117505
Gotlieb, J. (2011). Classroom entertainment, grades and student evaluations of business professors. Journal of the Academy of Business Education, 12, 118-136. Retrieved from http://www.abeweb.org/
Griesemer, J. A. (2011). Using social media to enhance undergraduate business students learning experiences. Proceedings of the Northeast Business & Economics Association, 201-204.
Hamermesh, D., & Parker, A. (2005). Beauty in the classroom: Instructors' pulchritude and putative pedagogical productivity. Economics of Education Review, 24, 369-376.
Hart, J., & Driver, J. (1978). Teacher evaluation as a function of student and instructor personality. Teaching of Psychology, 5, 198-200. doi:10.1207/s15328023top0504_8
Hartman, K. B., & Hunt, J. B. (2013). What Ratemyprofessors.com reveals about how and why students evaluate their professors: a glimpse into the student mindset. Marketing Education Review, 23, 151e161. http://dx.doi.org/10.2753/MER1052-8008230204
Hossain, T. M. (2009). Hot or not: An analysis of online professor-shopping behavior of business students. Journal of Education for Business, 85, 165-171. doi:10.1080/08832320903252439
Howard, C. (2014). Ranking America’s top colleges 2014. Forbes, Retrieved from http://www.forbes.com/sites/carolinehoward/2014/07/30/ranking-americas-top-colleges-2014/
Huntsinger, J. R., & Smith, C. T. (2009). First thought, best thought: Positive mood maintains and negative mood degrades implicit-explicit attitude correspondence. Personality and Social Psychology Bulletin, 35, 187-197. doi:10.1177/0146167208327000
Jenkins, S.J., & Downs, E. (2001). Relationship between faculty personality and student evaluation of courses. College Student Journal, 35, 636–40. Retrieved from http://www.projectinnovation.com/college-student-journal.html
Johnson, R. R., & Crews, A. D. (2013). My professor is hot! Correlates of RateMyProfessors.com ratings for criminal justice and criminology faculty members. American Journal of Criminal Justice, 38, 639-656. doi:10.1007/s12103-012-9186-y
Johnson, S. K., Podratz, K. E., Dipboye, R. L., & Gibbons, E. (2010). Physical attractiveness biases in ratings of employment suitability: Tracking down the “beauty is beastly” effect. The Journal of Social Psychology, 150, 301-318. doi:10.1080/00224540903365414
Joye, S., & Wilson, J. H. (2015). Professor age and gender affect student perceptions and grades. Journal of the Scholarship of Teaching and Learning, 15, 126-138. doi:10.14434/josotl.v15i4.13466
Karpen, S. C., Jia, L., & Rydell, R. J. (2012). Discrepancies between implicit and explicit attitude measures as an indicator of attitude strength. European Journal of Social Psychology, 42, 24-29. doi:10.1002/ejsp.849
Keiner, L. E., & Gilman, C. S. (2015). Implementation of interactive engagement teaching methods in a physical oceanography course. Journal of College Science Teaching, 45, 70-77. Retrieved from http://www.nsta.org/college/
Kindred, J., & Mohammed, S. N. (2005). “He will crush you like an academic ninja!”: Exploring teacher ratings on Ratemyprofessors.com. Journal of Computer‐Mediated Communication, 10, article 9. doi:10.1111/j.1083-6101.2005.tb00257.x
Kinney, D. P., & Smith, S. P. (1992). Age and teaching performance. Journal of Higher Education, 63, 282-302. doi:10.2307/1982016
Kohn, J., & Hatfield, L. (2006). The role of gender in teaching effectiveness ratings of faculty. Academy of Educational Leadership Journal, 10, 121-137. Retrieved from http://www.alliedacademies.org/academy-of-educational-leadership-journal/
Kowai-Bell, N., Guadagno, R. E., Little, T., Preiss, N., & Hensley, R. (2011). Rate my expectations: how online evaluations of professors impact students' perceived control. Computers in Human Behavior, 27, 1862-1867. doi:10.1016/j.chb.2011.04.009.
Landry, N. M., Kurkul, K. E., & Poirier, C. R. (2010). Online faculty rating sites: Examining how students perceive and use Ratemyprofessors.com. Psi Chi Journal of Undergraduate Research, 15, 139e142. Retrieved from http://www.psichi.org/?page=journal_main
Lawson, R. A., & Stephenson, E. F. (2005). Easiness, attractiveness, and faculty evaluations: Evidence from ratemyprofessors.com. Atlantic Economic Journal, 33, 485-486. doi:10.1007/s11293-005-2873-z
Legg, A. M., & Wilson, J. H. (2012). RateMyProfessors.com offers biased evaluations. Assessment & Evaluation in Higher Education, 37, 89e97. doi:10.1080/02602938. 2010.507299.
Lewandowski Jr, G. W., Higgins, E., & Nardone, N. N. (2012). Just a harmless website?: an experimental examination of RateMyProfessors.com’s effect on student evaluations. Assessment & Evaluation in Higher Education, 37, 987-1002. doi:10.1080/02602938.2011.594497
Liu, J., Hu, J., & Furutan, O. (2013). The influence of student perceived professors’ 'hotness' on expertise, motivation, learning outcomes, and course satisfaction. Journal of Education for Business, 88, 94-100. doi:10.1080/08832323.2011.652695
MacNell, L., Driscoll, A., & Hunt, A. (2015). What's in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40(4), 291-303. Retrieved from http://link.springer.com/journal/10755
Mehng, S. A. (2015). When is physical attractiveness not beneficial? Perceptions of warmth and competence, emotions, and job behaviors (Unpublished doctoral dissertation). University of Minnesota.
Mertler, C. A. & Vannatta, R. A. (2005). Advanced and multivariate statistical methods (3rd ed.). Glendale, CA: Pyrczak.
Messner, M. (2000). White guy habitus in the classroom: Challenging the reproduction of privilege. Men and masculinities, 2, 457-469. doi:10.1177/1097184X00002004005
Micari, M., & Pazos, P. (2012). Connecting to the professor: Impact of the student-faculty relationship in a highly challenging course. College Teaching, 60, 41-47. doi:10.1080/87567555.2011.627576.
Montell, G. (2006). The art of the bogus rating. The Chronicle of Higher Education. Retrieved from http://chronicle.com/article/The-Arts-of-the-Bogus-Rating/46887/
Moritsch, B. G., & Suter, W. N. (1988). Correlates of halo error in teacher evaluation. Educational Research Quarterly, 12, 29-34.
National Center for Educational Statistics (2016). Nontraditional undergraduates: Definition and data. Retrieved from https://nces.ed.gov/pubs/web/97578e.asp
O'Toole, D. M., Spinelli, M. A., & Wetzel, J. N. (2000). The important learning dimensions in the school of business: A survey of students and faculty. Journal of Education for Business, 75(6), 338-342. Retrieved from http://www.tandfonline.com/toc/vjeb20/current
Otto, J., Sanford, D. J., & Ross, D. N. (2008). Does ratemyprofessor.com really rate my professor? Assessment & Evaluation in Higher Education, 33, 1-16. doi:10.1080/02602930701293405
Pannapacker, W.A. (2007). The inescapability of your past. The Chronicle of Higher Education, 53, B11.
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37, 91-105. doi:10.1207/S15326985EP3702_4
Petchers, M.K., & Chow, J. C. (1988). Sources of variations in students’ evaluations of instruction in a graduate social work program. Journal of Social Work Education, 24, 35–42. doi:10.1080/10437797.1988.10672095
Ratemyprofessors. (2016a). Aboutratemyprofessors.com. Retrieved from http://www.ratemyprofessors.com/About.jsp
Ratemyprofessors. (2016b). How do you tally your ratings? Retrieved from http://www.ratemyprofessors.com/help.jsp#tally
Ratemyprofessors. (2016c). Why didn’t the chili pepper I gave my professor show up? Retrieved from http://www.ratemyprofessors.com/help.jsp#hotness
Reid, L. D. (2010). The role of perceived race and gender in the evaluation of college teaching on RateMyProfessors.com. Journal of Diversity in Higher Education, 3, 137-152. doi:10.1037/a0019865
Richmond, A. S., Berglund, M. B., Epelbaum, V. B., & Klein, E. M. (2015). a + (b₁) professor–student rapport + (b₂) humor + (b₃) student engagement = (Ŷ ) student ratings of instructors. Teaching of Psychology, 42, 119-125. doi:10.1177/0098628315569924
Riniolo, T. C., Johnson, K. C., Sherman, T. R., & Misso, J. A. (2006). Hot or not: Do professors perceived as physically attractive receive higher student evaluations? Journal of General Psychology, 133, 19-35. doi:10.3200/GENP.133.1.19-35
Romano, S. T., & Bordieri, J. E. (1989). Physical attractiveness stereotypes and students’ perceptions of college professors.
Psychological Reports, 64, 1099-1102. doi:10.2466/pr0.1989.64.3c.1099
Rousseau, G. K., & Rogers, W. A. (1998). Computer usage patterns of university faculty members across the life span. Computers in Human Behavior, 14, 417-428. doi:10.1016/S0747-5632(98)00014-4
Rydell, R. J., McConnell, A. R., & Mackie, D. M. (2008). Consequences of discrepant explicit and implicit attitudes: cognitive dissonance and increased information processing. Journal of Experimental Social Psychology, 44, 1526-1532. doi:10.1016/j.jesp.2008.07.006
Saeed, N., Yun, Y., & Sinnappan, S. (2009). Emerging web technologies in higher education: A case of incorporating blogs, podcasts and social bookmarks in a web programming course based on students' learning styles and technology preferences. Journal of Educational Technology & Society, 12, 98-109. Retrieved from http://www.ifets.info
Scherr, F.C., & Scherr, S. S. (1990). Bias in student evaluations of teacher effectiveness. Journal of Education for Business, 65, 356–358. Retrieved from http://www.tandfonline.com/toc/vjeb20/current
Sebastian, R.J., & Bristow, D. (2008). Formal or informal? The impact of style of dress and forms of address on business students’ perceptions of professors. Journal of Education for Business, 83, 196-201. doi:10.3200/JOEB.83.4.196-201
Sinclair, L., & Kunda, Z. (2000). Motivated stereotyping of women: She's fine if she praised me but incompetent if she criticized me. Personality and Social Psychology Bulletin, 26, 1329-1342. doi:10.1177/0146167200263002
Sonntag, M. E., Bassett, J. F., & Snyder, T. (2009). An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com. Assessment & Evaluation in Higher Education, 34, 499e504. http://dx.doi.org/10.1080/02602930802079463
Smith, C. T., & Nosek, B. A. (2011). Affective focus increases the concordance between implicit and explicit attitudes. Social Psychology, 42, 300-313. doi:10.1027/1864-9335/a000072
Stonebraker, R., & Stone, G. (2015). Too old to teach? The effect of age on college and university professors. Research in Higher Education, 56, 793-812. doi:10.1007/s11162-015-9374-y
Stuber, J. M., Watson, A., Carle, A., & Staggs, K. (2009). Gender expectations and on-line evaluations of teaching: Evidence from RateMyProfessors.com. Teaching in Higher Education, 14, 387-399. doi:10.1080/13562510903050137
Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84, 55-61.doi:10.3200/JOEB.84.1.55-61
Theyson, K. C. (2015). Hot or not: The role of instructor quality and gender on the formation of positive illusions among students using RateMyProfessors.com. Practical Research and Assessment, 20. Retrieved from http://pareonline.net/getvn.asp?v=20&n=4
Torok, S. E., McMorris, R. F., & Lin, W. (2004). Is humor an appreciated teaching tool? Perceptions of professors’ teaching styles and use in humor. College Teaching, 52, 14-20. doi:10.3200/CTCH.52.1.14-20
Vodanovich, S. J., & Piotrowski, C. (2005). Faculty attitudes toward web-based instruction may not be enough: Limited use and obstacles to implementation. Journal of Educational Technology Systems, 33, 309-318. doi:10.2190/V2N7-DMC4-2JWB-5Q88
Walsh, D. J., & Maffei, M. J. (1994). Never in a class by themselves: An Examination of behaviors affecting the student-professor relationship. Journal on Excellence in College Teaching, 5, 23-49.
Wheeless, L.R. (1974). The effects of attitude, credibility, and homophily on selective exposure to information. Speech Monographs, 41, 329-338. Retrieved from http://www.tandfonline.com/toc/rcmm19/41/4#.Vyzl7XoYE20
Widmeyer, W. N., & Loy, J. W. (1988). When you're hot, you're hot! Warm-cold effects in first impressions of persons and teaching effectiveness. Journal of Educational Psychology, 80, 118-121. doi:10.1037/0022-06188.8.131.52
Wilson, J., Beyer, D., & Monteiro, H. (2014). Professor age affects student ratings: Halo effect for younger teachers. College Teaching, 62, 20-24.
Wilson, R. (1998). New research casts doubt on value of student evaluations of professors. Chronicle of Higher Education, 44, A12-A14.
Zabaleta, F. (2007). The use and misuse of student evaluations of teaching. Teaching In Higher Education, 12, 55-76.
Copyright (c) 2016 Sara L. Sohr-Preston, Stefanie S. Boswell, Kayla McCaleb, Deanna Robertson
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with HLRC agree to the following terms:
- Authors retain copyright and publishing rights without restrictions and grant the journal right of first publication. Authors grant Laureate Education, Inc. a license to publish and distribute the work under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in HLRC.
- Authors who submit manuscripts are to declare that their submission to HLRC is not simultaneously under consideration for publication in another journal and has not been published elsewhere previously.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the HLRC's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in HLRC.
- Pre-refereeing and pre-publication: To ensure consistency in the information available to researchers and to safeguard the blind peer-review process, authors are asked to abstain from self-archiving or posting online the submitted manuscript before the review process is complete.
- Post-refereeing and post-publication: Authors are free to self-archive and distribute the peer-reviewed and editorially reviewed version of their work. As a full open access journal, there is no embargo period. Authors are encouraged to archive the published PDF version, which includes a suggested citation with all pertinent information, including a digital object identifier (DOI). If the author decides to self-archive or distribute the work in a format other than the published PDF, the author must include the assigned DOI and acknowledge the work was first published in HLRC.