Professor Gender, Age, and “Hotness” in Influencing College Students’ Generation and Interpretation of Professor Ratings

  • Sara L. Sohr-Preston Southeastern Louisiana University http://orcid.org/0000-0001-6247-7400
  • Stefanie S. Boswell University of the Incarnate Word
  • Kayla McCaleb Southeastern Louisiana University
  • Deanna Robertson Southeastern Louisiana University
Keywords: professor ratings, bias, higher education, psychology faculty, teaching

Abstract

Undergraduate psychology students rated expectations of a bogus professor (randomly designated a man or woman and hot versus not hot) based on an online rating and sample comments as found on RateMyProfessors.com (RMP). Five professor qualities were derived using principal components analysis (PCA): dedication, attractiveness, enhancement, fairness, and clarity. Participants rated current psychology professors on the same qualities. Current professors were divided based on gender (man or woman), age (under 35 or 35 and older), and attractiveness (at or below the median or above the median). Using multivariate analysis of covariance (MANCOVA), students expected hot professors to be more attractive but lower in clarity. They rated current professors as lowest in clarity when a man and 35 or older. Current professors were rated significantly lower in dedication, enhancement, fairness, and clarity when rated at or below the median on attractiveness. Results, with previous research, suggest numerous factors, largely out of professors’ control, influencing how students interpret and create professor ratings. Caution is therefore warranted in using online ratings to select courses or make hiring and promotion decisions. 

Author Biographies

Sara L. Sohr-Preston, Southeastern Louisiana University

Department of Psychology

Assistant Professor

Stefanie S. Boswell, University of the Incarnate Word

Department of Psychology

Associate Professor

Kayla McCaleb, Southeastern Louisiana University

Department of Psychology

Graduate Student

Deanna Robertson, Southeastern Louisiana University

Department of Psychology

Undergraduate Student

References

Abel, M. H., & Meltzer, A. L. (2007). Student ratings of a male and female professors’ lecture on sex discrimination in the workforce. Sex Roles, 57, 173–180. doi:10.1007/s11199-007-9245-x

Adamson, G., O'Kane, D., & Shevlin, M. (2005). Students' ratings of teaching effectiveness: A laughing matter? Psychological Reports, 96, 225-226. doi:10.2466/PR0.96.1.225-226

Ahmadi, M., Helms, M. M., & Raiszadeh, F. (2001). Business students' perceptions of faculty evaluations. International Journal of Educational Management, 15, 12-22. doi:10.1108/09513540110366097

Ambady, N., & Rosenthal, R. (1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology, 64, 431-441. Retrieved from http://www.apa.org/pubs/journals/psp/

Arbuckle, J., & Williams, B. D. (2003). Students' perceptions of expressiveness: Age and gender effects on teacher evaluations. Sex Roles, 49, 507-516. doi:10.1023/A:1025832707002

Bachen, C. M., McLoughlin, M. M., & Garcia, S. S. (1999). Assessing the role of gender in college students’ evaluations of faculty. Communication Education, 48, 193-210. doi:10.1080/03634529909379169

Basow, S. A. (2000). Best and worst professors: Gender patterns in students' choices. Sex Roles, 43, 407-417. doi:10.1023/A:1026655528055

Basow, S. A., & Silberg, N. T. (1987). Student evaluations of college professors: Are female and male professors rated differently? Journal of Educational Psychology, 79, 308-314. doi:10.1037/0022-0663.79.3.308

Bennett, S. K. (1982). Student perceptions of and expectations for male and female instructors: Evidence relating to the question of gender bias in teaching evaluation. Journal of Educational Psychology, 74, 170-179. doi:10.1037/0022-0663.74.2.170

Bianchini, S., Lissoni, F., & Pezzoni, M. (2013). Instructor characteristics and students' evaluation of teaching effectiveness: Evidence from an Italian engineering school. European Journal of Engineering Education, 38, 38-57. Retrieved from www.tandfonline.com/loi/ceee20

Bonds-Raacke, J., & Raacke, J. D. (2007). The relationship between physical attractiveness of professors and students’ ratings of professor quality. Journal of Psychiatry, Psychology and Mental Health, 1, 1-7. Retrieved from http://www.scientificjournals.org/Journals2011/j_of_psychiatry_and_psychology1_2011.htm

Borboa, D., Joseph, M., & Spake, D. F. (2012). Use of technology in higher education: A preliminary analysis of student views. Society for Marketing Advances Proceedings, 157-158. Retrieved from http://www.marketingadvances.org/

Boswell, S. S. (2016). Ratemyprofessors is hogwash (but I care): Effects of Ratemyprofessors and university-administered teaching evaluations on professors. Computers in Human Behavior, 56, 155-162. doi:10.1016/j.chb.2015.11.045

Buck, S., & Tiene, D. (1989). The impact of physical attractiveness, gender, and teaching philosophy on teacher evaluations. The Journal of Educational Research, 82, 172-177. doi:10.1080/00220671.1989.10885887

Burns-Glover, A. L., & Veith, D. J. (1995). Revisiting gender and teaching evaluations: Sex still makes a difference. Journal of Social Behavior and Personality, 10, 69-80.

Cacioppo, J. T., Gardner,W. L., & Berntson, G. G. (1999). The affect system has parallel and integrative processing components: form follows function. Journal of Personality and Social Psychology, 76, 839-855. doi:10.1037/0022-3514.76.5.839

Carnevale, D. (2006). University of Saskatchewan fires tenured professor accused of maligning colleagues on ratemyprofessors web site. The Chronicle of Higher Education, 52, A28.

Carver, C. S., & Scheier, M. F. (1990). Origins and functions of positive and negative affect: A control-process view. Psychological Review, 97, 19-35. doi:10.1037/0033-295X.97.1.19.

Cashin, W. E. (1992). Student ratings: The need for comparative data. Instructional Evaluation and Faculty Development, 12, 146.

Cahyadi, V. (2004). The effect of interactive engagement teaching on student understanding of introductory physics at the faculty of engineering, University of Surabaya, Indonesia. Higher Education Research and Development, 23, 455-464. Retrieved from http://www.tandfonline.com/toc/cher20/current

Chia, R. C., Allred, L. J., Grossnickle, W. F., & Lee, G. W. (1998). Effects of attractiveness and gender on the perception of achievement-related variables. The Journal of Social Psychology, 138, 471-477. doi:10.1080/00224549809600401

Clayson, D. E., & Sheffet, M. J. (2006). Personality and the student evaluation of teaching. Journal of Marketing Education, 28, 149-160. doi:10.1177/0273475306288402

Coladarci, T., & Kornfield, I. (2007). RateMyProfessors.com versus formal in-class student evaluations of teaching. Practical Assessment, Research & Evaluation, 12, 1-15. Retrieved from http://pareonline.net

Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34, 51–65. doi:10.1080/02602930801895695

Dion, K., Berscheid, E., & Walster, E. (1972). What is beautiful is good. Journal of Personality and Social Psychology, 24, 285-290. doi:10.1037/h0033731

Divoky, J.J., & M.A. Rothermel (1988). Student perceptions of the relative importance of dimensions of teaching performance across type of class. Educational Research Quarterly, 12, 40–45.

Eadie, B. (1996). Instructor credibility and style of dress; Performance in groups at an Irish gay bar. Spectra, 32, 11-13.

Eagly, A. H., Ashmore, R. D., Makhijani, M. G., & Longo, L. C. (1991). What is beautiful is good, but…: A meta-analytic review of research on the physical attractiveness stereotype. Psychological Bulletin, 110, 109-128. doi:10.1037/0033-2909.110.1.109

Edwards, C., Edwards, A., Qing, Q., & Wahl, S. T. (2007). The influence of computer-mediated word-of-mouth communication on student perceptions of instructors and attitudes toward learning course content. Communication Education, 56, 255-277. doi:10.1080/03634520701236866

Edwards, A., Edwards, C., Shaver, C., & Oaks, M. (2009). Computer‐mediated word‐of‐mouth communication on Ratemyprofessors.com: Expectancy effects on student cognitive and behavioral learning. Journal of Computer‐Mediated Communication, 14, 368-392. doi:10.1111/j.1083-6101.2009.01445.x

Feldman, K.A. (1978). Course characteristics and college students’ ratings of their teachers: What we know and what we don’t. Research in Higher Education, 9, 199–242. doi:10.1007/BF00976997

Feldman, K. A. (1983). The seniority and instructional experience of college teachers as related to the evaluations they receive from their students. Research in Higher Education, 18, 3-124. doi: 10.1007/BF00992080

Feldman, K. A. (1986). The perceived instructional effectiveness of college teachers as related to their personality and attitudinal characteristics: A review and synthesis. Research in Higher Education, 24, 139-213. doi:10.1007/BF00991885

Felton, J., Koper, P. T., Mitchell, J., & Stinson, M. (2008). Attractiveness, easiness and other issues: Student evaluations of professors on ratemyprofessors.com. Assessment & Evaluation in Higher Education, 33, 45-61. doi:10.1080/02602930601122803

Felton, J., Mitchell, J., & Stinson, M. (2004). Web-based student evaluations of professors: the relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29, 91-108. doi:10.1080/0260293032000158180

Field, A. (2013). Discovering statistics using IBM SPSS Statistics (4th ed.). London: SAGE.

Freng, S., & Webber, D. (2009). Turning up the heat on online teaching evaluations: Does "hotness" matter?. Teaching Of Psychology, 36, 189-193. Retrieved from http://top.sagepub.com/

Frenzel, A. C., Goetz, T., Ludtke, O., Pekrun, R., & Sutton, R. E. (2009). Emotional transmission in the classroom: Exploring the relationship between teacher and student enjoyment. Journal of Educational Psychology, 101, 705-716. doi:10.1037/a0014695

Garner, R. L. (2006). Humor in pedagogy. College Teaching, 54, 177-180. Retrieved from http://www.tandfonline.com/toc/vcol20/current

Gehrt, K., Louie, T. A., & Osland, A. (2015). Student and professor similarity: Exploring the effects of gender and relative age. Journal of Education for Business, 90, 1-9. doi:10.1080/08832323.2014.968514

Goldberg, G., & Callahan, J. (1991). Objectivity of student evaluations of instructors. Journal of Education for Business, 66, 377-378. doi:10.1080/08832323.1991.10117505

Gotlieb, J. (2011). Classroom entertainment, grades and student evaluations of business professors. Journal of the Academy of Business Education, 12, 118-136. Retrieved from http://www.abeweb.org/

Griesemer, J. A. (2011). Using social media to enhance undergraduate business students learning experiences. Proceedings of the Northeast Business & Economics Association, 201-204.

Hamermesh, D., & Parker, A. (2005). Beauty in the classroom: Instructors' pulchritude and putative pedagogical productivity. Economics of Education Review, 24, 369-376.

Hart, J., & Driver, J. (1978). Teacher evaluation as a function of student and instructor personality. Teaching of Psychology, 5, 198-200. doi:10.1207/s15328023top0504_8

Hartman, K. B., & Hunt, J. B. (2013). What Ratemyprofessors.com reveals about how and why students evaluate their professors: a glimpse into the student mindset. Marketing Education Review, 23, 151e161. http://dx.doi.org/10.2753/MER1052-8008230204

Hossain, T. M. (2009). Hot or not: An analysis of online professor-shopping behavior of business students. Journal of Education for Business, 85, 165-171. doi:10.1080/08832320903252439

Howard, C. (2014). Ranking America’s top colleges 2014. Forbes, Retrieved from http://www.forbes.com/sites/carolinehoward/2014/07/30/ranking-americas-top-colleges-2014/

Huntsinger, J. R., & Smith, C. T. (2009). First thought, best thought: Positive mood maintains and negative mood degrades implicit-explicit attitude correspondence. Personality and Social Psychology Bulletin, 35, 187-197. doi:10.1177/0146167208327000

Jenkins, S.J., & Downs, E. (2001). Relationship between faculty personality and student evaluation of courses. College Student Journal, 35, 636–40. Retrieved from http://www.projectinnovation.com/college-student-journal.html

Johnson, R. R., & Crews, A. D. (2013). My professor is hot! Correlates of RateMyProfessors.com ratings for criminal justice and criminology faculty members. American Journal of Criminal Justice, 38, 639-656. doi:10.1007/s12103-012-9186-y

Johnson, S. K., Podratz, K. E., Dipboye, R. L., & Gibbons, E. (2010). Physical attractiveness biases in ratings of employment suitability: Tracking down the “beauty is beastly” effect. The Journal of Social Psychology, 150, 301-318. doi:10.1080/00224540903365414

Joye, S., & Wilson, J. H. (2015). Professor age and gender affect student perceptions and grades. Journal of the Scholarship of Teaching and Learning, 15, 126-138. doi:10.14434/josotl.v15i4.13466

Karpen, S. C., Jia, L., & Rydell, R. J. (2012). Discrepancies between implicit and explicit attitude measures as an indicator of attitude strength. European Journal of Social Psychology, 42, 24-29. doi:10.1002/ejsp.849

Keiner, L. E., & Gilman, C. S. (2015). Implementation of interactive engagement teaching methods in a physical oceanography course. Journal of College Science Teaching, 45, 70-77. Retrieved from http://www.nsta.org/college/

Kindred, J., & Mohammed, S. N. (2005). “He will crush you like an academic ninja!”: Exploring teacher ratings on Ratemyprofessors.com. Journal of Computer‐Mediated Communication, 10, article 9. doi:10.1111/j.1083-6101.2005.tb00257.x

Kinney, D. P., & Smith, S. P. (1992). Age and teaching performance. Journal of Higher Education, 63, 282-302. doi:10.2307/1982016

Kohn, J., & Hatfield, L. (2006). The role of gender in teaching effectiveness ratings of faculty. Academy of Educational Leadership Journal, 10, 121-137. Retrieved from http://www.alliedacademies.org/academy-of-educational-leadership-journal/

Kowai-Bell, N., Guadagno, R. E., Little, T., Preiss, N., & Hensley, R. (2011). Rate my expectations: how online evaluations of professors impact students' perceived control. Computers in Human Behavior, 27, 1862-1867. doi:10.1016/j.chb.2011.04.009.

Landry, N. M., Kurkul, K. E., & Poirier, C. R. (2010). Online faculty rating sites: Examining how students perceive and use Ratemyprofessors.com. Psi Chi Journal of Undergraduate Research, 15, 139e142. Retrieved from http://www.psichi.org/?page=journal_main

Lawson, R. A., & Stephenson, E. F. (2005). Easiness, attractiveness, and faculty evaluations: Evidence from ratemyprofessors.com. Atlantic Economic Journal, 33, 485-486. doi:10.1007/s11293-005-2873-z

Legg, A. M., & Wilson, J. H. (2012). RateMyProfessors.com offers biased evaluations. Assessment & Evaluation in Higher Education, 37, 89e97. doi:10.1080/02602938. 2010.507299.

Lewandowski Jr, G. W., Higgins, E., & Nardone, N. N. (2012). Just a harmless website?: an experimental examination of RateMyProfessors.com’s effect on student evaluations. Assessment & Evaluation in Higher Education, 37, 987-1002. doi:10.1080/02602938.2011.594497

Liu, J., Hu, J., & Furutan, O. (2013). The influence of student perceived professors’ 'hotness' on expertise, motivation, learning outcomes, and course satisfaction. Journal of Education for Business, 88, 94-100. doi:10.1080/08832323.2011.652695

MacNell, L., Driscoll, A., & Hunt, A. (2015). What's in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40(4), 291-303. Retrieved from http://link.springer.com/journal/10755

Mehng, S. A. (2015). When is physical attractiveness not beneficial? Perceptions of warmth and competence, emotions, and job behaviors (Unpublished doctoral dissertation). University of Minnesota.

Mertler, C. A. & Vannatta, R. A. (2005). Advanced and multivariate statistical methods (3rd ed.). Glendale, CA: Pyrczak.

Messner, M. (2000). White guy habitus in the classroom: Challenging the reproduction of privilege. Men and masculinities, 2, 457-469. doi:10.1177/1097184X00002004005

Micari, M., & Pazos, P. (2012). Connecting to the professor: Impact of the student-faculty relationship in a highly challenging course. College Teaching, 60, 41-47. doi:10.1080/87567555.2011.627576.

Montell, G. (2006). The art of the bogus rating. The Chronicle of Higher Education. Retrieved from http://chronicle.com/article/The-Arts-of-the-Bogus-Rating/46887/

Moritsch, B. G., & Suter, W. N. (1988). Correlates of halo error in teacher evaluation. Educational Research Quarterly, 12, 29-34.

National Center for Educational Statistics (2016). Nontraditional undergraduates: Definition and data. Retrieved from https://nces.ed.gov/pubs/web/97578e.asp

O'Toole, D. M., Spinelli, M. A., & Wetzel, J. N. (2000). The important learning dimensions in the school of business: A survey of students and faculty. Journal of Education for Business, 75(6), 338-342. Retrieved from http://www.tandfonline.com/toc/vjeb20/current

Otto, J., Sanford, D. J., & Ross, D. N. (2008). Does ratemyprofessor.com really rate my professor? Assessment & Evaluation in Higher Education, 33, 1-16. doi:10.1080/02602930701293405

Pannapacker, W.A. (2007). The inescapability of your past. The Chronicle of Higher Education, 53, B11.

Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37, 91-105. doi:10.1207/S15326985EP3702_4

Petchers, M.K., & Chow, J. C. (1988). Sources of variations in students’ evaluations of instruction in a graduate social work program. Journal of Social Work Education, 24, 35–42. doi:10.1080/10437797.1988.10672095

Ratemyprofessors. (2016a). Aboutratemyprofessors.com. Retrieved from http://www.ratemyprofessors.com/About.jsp

Ratemyprofessors. (2016b). How do you tally your ratings? Retrieved from http://www.ratemyprofessors.com/help.jsp#tally

Ratemyprofessors. (2016c). Why didn’t the chili pepper I gave my professor show up? Retrieved from http://www.ratemyprofessors.com/help.jsp#hotness

Reid, L. D. (2010). The role of perceived race and gender in the evaluation of college teaching on RateMyProfessors.com. Journal of Diversity in Higher Education, 3, 137-152. doi:10.1037/a0019865

Richmond, A. S., Berglund, M. B., Epelbaum, V. B., & Klein, E. M. (2015). a + (b₁) professor–student rapport + (b₂) humor + (b₃) student engagement = (Ŷ ) student ratings of instructors. Teaching of Psychology, 42, 119-125. doi:10.1177/0098628315569924

Riniolo, T. C., Johnson, K. C., Sherman, T. R., & Misso, J. A. (2006). Hot or not: Do professors perceived as physically attractive receive higher student evaluations? Journal of General Psychology, 133, 19-35. doi:10.3200/GENP.133.1.19-35

Romano, S. T., & Bordieri, J. E. (1989). Physical attractiveness stereotypes and students’ perceptions of college professors.

Psychological Reports, 64, 1099-1102. doi:10.2466/pr0.1989.64.3c.1099

Rousseau, G. K., & Rogers, W. A. (1998). Computer usage patterns of university faculty members across the life span. Computers in Human Behavior, 14, 417-428. doi:10.1016/S0747-5632(98)00014-4

Rydell, R. J., McConnell, A. R., & Mackie, D. M. (2008). Consequences of discrepant explicit and implicit attitudes: cognitive dissonance and increased information processing. Journal of Experimental Social Psychology, 44, 1526-1532. doi:10.1016/j.jesp.2008.07.006

Saeed, N., Yun, Y., & Sinnappan, S. (2009). Emerging web technologies in higher education: A case of incorporating blogs, podcasts and social bookmarks in a web programming course based on students' learning styles and technology preferences. Journal of Educational Technology & Society, 12, 98-109. Retrieved from http://www.ifets.info

Scherr, F.C., & Scherr, S. S. (1990). Bias in student evaluations of teacher effectiveness. Journal of Education for Business, 65, 356–358. Retrieved from http://www.tandfonline.com/toc/vjeb20/current

Sebastian, R.J., & Bristow, D. (2008). Formal or informal? The impact of style of dress and forms of address on business students’ perceptions of professors. Journal of Education for Business, 83, 196-201. doi:10.3200/JOEB.83.4.196-201

Sinclair, L., & Kunda, Z. (2000). Motivated stereotyping of women: She's fine if she praised me but incompetent if she criticized me. Personality and Social Psychology Bulletin, 26, 1329-1342. doi:10.1177/0146167200263002

Sonntag, M. E., Bassett, J. F., & Snyder, T. (2009). An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com. Assessment & Evaluation in Higher Education, 34, 499e504. http://dx.doi.org/10.1080/02602930802079463

Smith, C. T., & Nosek, B. A. (2011). Affective focus increases the concordance between implicit and explicit attitudes. Social Psychology, 42, 300-313. doi:10.1027/1864-9335/a000072

Stonebraker, R., & Stone, G. (2015). Too old to teach? The effect of age on college and university professors. Research in Higher Education, 56, 793-812. doi:10.1007/s11162-015-9374-y

Stuber, J. M., Watson, A., Carle, A., & Staggs, K. (2009). Gender expectations and on-line evaluations of teaching: Evidence from RateMyProfessors.com. Teaching in Higher Education, 14, 387-399. doi:10.1080/13562510903050137

Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84, 55-61.doi:10.3200/JOEB.84.1.55-61

Theyson, K. C. (2015). Hot or not: The role of instructor quality and gender on the formation of positive illusions among students using RateMyProfessors.com. Practical Research and Assessment, 20. Retrieved from http://pareonline.net/getvn.asp?v=20&n=4

Torok, S. E., McMorris, R. F., & Lin, W. (2004). Is humor an appreciated teaching tool? Perceptions of professors’ teaching styles and use in humor. College Teaching, 52, 14-20. doi:10.3200/CTCH.52.1.14-20

Vodanovich, S. J., & Piotrowski, C. (2005). Faculty attitudes toward web-based instruction may not be enough: Limited use and obstacles to implementation. Journal of Educational Technology Systems, 33, 309-318. doi:10.2190/V2N7-DMC4-2JWB-5Q88

Walsh, D. J., & Maffei, M. J. (1994). Never in a class by themselves: An Examination of behaviors affecting the student-professor relationship. Journal on Excellence in College Teaching, 5, 23-49.

Wheeless, L.R. (1974). The effects of attitude, credibility, and homophily on selective exposure to information. Speech Monographs, 41, 329-338. Retrieved from http://www.tandfonline.com/toc/rcmm19/41/4#.Vyzl7XoYE20

Widmeyer, W. N., & Loy, J. W. (1988). When you're hot, you're hot! Warm-cold effects in first impressions of persons and teaching effectiveness. Journal of Educational Psychology, 80, 118-121. doi:10.1037/0022-0663.80.1.118

Wilson, J., Beyer, D., & Monteiro, H. (2014). Professor age affects student ratings: Halo effect for younger teachers. College Teaching, 62, 20-24.

Wilson, R. (1998). New research casts doubt on value of student evaluations of professors. Chronicle of Higher Education, 44, A12-A14.

Zabaleta, F. (2007). The use and misuse of student evaluations of teaching. Teaching In Higher Education, 12, 55-76.

Published
2016-09-30
How to Cite
Sohr-Preston, S., Boswell, S., McCaleb, K., & Robertson, D. (2016). Professor Gender, Age, and “Hotness” in Influencing College Students’ Generation and Interpretation of Professor Ratings. Higher Learning Research Communications, 6(3). https://doi.org/10.18870/hlrc.v6i3.328
Section
Articles