Social Psychology of Education

, Volume 17, Issue 3, pp 401–417 | Cite as

In the eye of the examinee: likable examiners interfere with performance

Article

Abstract

We investigated effects of examiners’ ascribed likability and examiners’ gender on test performance during a standardized face-to-face testing situation assessing self-estimated and de facto verbal knowledge. One hundred fourteen nonpsychology students were individually tested by one of 22 examiners. A moderated regression analysis revealed a significant three-way interaction of test taker’s gender, examiner’s gender, and examiner’s likability on de facto knowledge: Men and women showed lower scores on de facto knowledge with a same-gender examiner rated as likable compared to their performance with a likable opposite-gender examiner or in interaction with a nonlikable examiner.

Keywords

Examiner effect Test administration effect Likability  Same-gender interaction Objectivity 

References

  1. Aiken, L. R., & Groth-Marnat, G. (2006). Psychological testing and assessment (12th ed.). Boston: Pearson Allyn & Bacon.Google Scholar
  2. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River (NJ): Prentice Hall.Google Scholar
  3. Anderson, C., John, O. P., Keltner, D., & Kring, A. M. (2001). Who attains social status? Effects of personality and physical attractiveness in social groups. Journal of Personality and Social Psychology, 81, 116–132. doi: 10.1037/0022-3514.81.1.116.CrossRefGoogle Scholar
  4. Argyle, M. (1969). Social interaction. Chicago: Aldine.Google Scholar
  5. Banaji, M. R., & Greenwald, A. G. (1995). Implicit gender stereotyping in judgments of fame. Journal of Personality and Social Psychology, 68, 181–198. doi: 10.1037/0022-3514.68.2.181.CrossRefGoogle Scholar
  6. Barnes, M. L., & Rosenthal, R. (1985). Interpersonal effects of experimenter attractiveness, attire, and gender. Journal of Personality and Social Psychology, 48, 435–446. doi: 10.1037/0022-3514.48.2.435.CrossRefGoogle Scholar
  7. Blanton, H., Buunk, B. P., Gibbons, F. X., & Kuyper, H. (1999). When better-than-others compares upward: The independent effects of comparison choice and comparative evaluation on academic performance. Journal of Personality and Social Psychology, 76, 420–430. doi: 10.1037/0022-3514.76.3.420.CrossRefGoogle Scholar
  8. Burn, S. M. (1996). The Social Psychology of Gender. New York (NY): McGraw-Hill.Google Scholar
  9. Cash, T. F., Cash, D. W., & Butters, J. W. (1983). “Mirror, Mirror, on the Wall..?”: Contrast effects and self-evaluations of physical attractiveness. Personality and Social Psychology Bulletin, 9, 351–358. doi: 10.1177/0146167283093004.CrossRefGoogle Scholar
  10. Chaiken, S. (1979). Communicator physical attractiveness and persuasion. Journal of Personality and Social Psychology, 37, 1387–1397. doi: 10.1037/0022-3514.37.8.1387.CrossRefGoogle Scholar
  11. Clarke, P., Sproston, K., & Thomas, R. (2003). An investigation into expectation-led interview effects in health surveys. Social Science and Medicine, 56, 2221–2228. doi: 10.1016/S0277-9536(02)00238-1.CrossRefGoogle Scholar
  12. Cronbach, L. J. (1956). Assessment of individual differences. Annual Review of Psychology, 7, 173–196. doi: 10.1146/annurev.ps.07.020156.001133.CrossRefGoogle Scholar
  13. Daelmans, H. E. M., Scherpbier, A. J. J. A., Van der Vleuten, C. P. M., & Donker, A. J. M. (2001). Reliability of clinical oral examinations re-examined. Medical Teacher, 23, 422–424. doi: 10.1080/01421590120042973.CrossRefGoogle Scholar
  14. Davies, A. P. C., Goetz, A. T., & Shackelford, T. K. (2008). Exploiting the beauty in the eye of the beholder: The use of physical attractiveness as a persuasive tactic. Personality and Individual Differences, 45, 302–306. doi: 10.1016/j.paid.2008.04.016.CrossRefGoogle Scholar
  15. DeWall, C. N., & Maner, J. K. (2008). High status men (but not women) capture the eye of the beholder. Evolutionary Psychology, 2, 328–341.Google Scholar
  16. Diekman, A. B., & Eagly, A. H. (2000). Stereotypes as dynamic constructs: Women and men of the past, present, and future. Personality and Social Psychology Bulletin, 26, 1171–1188. doi: 10.1177/0146167200262001.CrossRefGoogle Scholar
  17. Dion, K. K., & Stein, S. (1978). Physical attractiveness and interpersonal influence. Journal of Experimental Social Psychology, 14, 97–108. doi: 10.1016/0022-1031(78)90063-X.CrossRefGoogle Scholar
  18. Domino, G., & Domino, M. L. (2006). Psychological testing: An introduction (2nd ed.). Cambrigde: Cambrigde University Press.CrossRefGoogle Scholar
  19. Dovidio, J. F., & Gaertner, S. L. (1986). Prejudice, discrimination, and racism. Orlando: Academic Press Inc.Google Scholar
  20. Eagly, A. H., & Karau, S. J. (2002). Role congruity theory of prejudice toward female leaders. Psychological Review, 109, 573–598. doi: 10.1037/0033-295X.109.3.573.CrossRefGoogle Scholar
  21. Elfenbein, H. A., & Ambady, N. (2002). Is there an in-group advantage in emotion recognition? Psychological Bulletin, 128, 243–249. doi: 10.1037/0033-2909.128.2.243.CrossRefGoogle Scholar
  22. Elliot, A. J., & Church, M. A. (2003). A motivational analysis of defensive pessimism and self-handicapping. Journal of Personality, 71, 233–249. doi: 10.1111/1467-6494.7103005.CrossRefGoogle Scholar
  23. Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7, 117–140. doi: 10.1177/001872675400700202.CrossRefGoogle Scholar
  24. Friedman, H. S., Riggio, R. E., & Casella, D. F. (1988). Nonverbal skill, personal charisma, and initial attraction. Personality and Social Psychology Bulletin, 14, 203–211. doi: 10.1177/0146167288141020.CrossRefGoogle Scholar
  25. Gatz, M., & Cotton, B. (1994). Age as a dimension of diversity: The experience of being old. In E. J. Trickett, R. J. Watts, & D. Birman (Eds.), Human Diversity: Perspectives on people in context. San Francisco, CA: Jossey-Bass.Google Scholar
  26. Gilbert, D. T., Giesler, R. B., & Morris, K. A. (1995). When comparisons arise. Journal of Personality and Social Psychology, 69, 227–236. doi: 10.1037/0022-3514.69.2.227.CrossRefGoogle Scholar
  27. Graziano, W. G., Varca, P. E., & Levy, J. C. (1982). Race of examiner effects and the validity of intelligence-tests. Review of Educational Research, 52, 469–497. doi: 10.2307/1170263.CrossRefGoogle Scholar
  28. Groesz, L. M., Levine, M. P., & Murnen, S. K. (2002). The effect of experimental presentation of thin media images on body satisfaction: A meta-analytic review. International Journal of Eating Disorders, 31, 1–16. doi: 10.1002/eat.10005.CrossRefGoogle Scholar
  29. Gurung, R. A. R., & Vespia, K. M. (2007). Looking good, teaching well? Linking liking, looks, and learning. Teaching of Psychology, 34, 5–10. doi: 10.1207/s15328023top3401_2.Google Scholar
  30. Hamermesh, D. S., & Parker, A. (2005). Beauty in the classroom: Instructors’ pulchritude and putative pedagogical productivity. Economics of Education Review, 24, 369–376. doi: 10.1016/j.econedurev.2004.07.013.CrossRefGoogle Scholar
  31. Hargreaves, D. A., & Tiggemann, M. (2009). Muscular ideal media images and men’s body image: Social comparison processing and individual vulnerability. Psychology of Men & Masculinity, 10, 109–119. doi: 10.1037/a0014691.CrossRefGoogle Scholar
  32. Harris, M. J., & Rosenthal, R. (1985). Mediation of interpersonal expectancy effects—31 meta-analyses. Psychological Bulletin, 97, 363–386. doi: 10.1037/0033-2909.97.3.363.CrossRefGoogle Scholar
  33. Hönekopp, J. (2006). Once more: Is beauty in the eye of the beholder? Relative contributions of private and shared taste to judgments of facial attractiveness. Journal of Experimental Psychology: Human Perception and Performance, 32, 199–209. doi: 10.1037/0096-1523.32.2.199.Google Scholar
  34. Hogg, M. A., & Vaughan, G. M. (2008). Social Psychology (5th ed.). Harlow: Pearson Education.Google Scholar
  35. Horai, J., Naccari, N., & Fatoullah, E. (1974). The effect of expertise and physical attractiveness upon opinion agreement and liking. Sociometry, 37, 601–606. doi: 10.2307/2786431.CrossRefGoogle Scholar
  36. Horn, J. L., & Cattell, R. B. (1966). Refinement and test of the theory of fluid and crystallized general intelligence. Journal of Educational Psychology, 57, 253–270. doi: 10.1037/h0023816.CrossRefGoogle Scholar
  37. Huang, M. H. (2009). Race of the interviewer and the black-white test score gap. Social Science Research, 38, 31–40. doi: 10.1016/j.ssresearch.2008.07.004.Google Scholar
  38. Jackson, L. A. (1992). Physical appearance and gender: Sociobiological and sociocultural perspectives. Albany: State University of New York Press.Google Scholar
  39. Judice, T. N., & Neuberg, S. L. (1998). When interviewers desire to confirm negative expectations: Self-fulfilling prophecies and inflated applicant self-perceptions. Basic and Applied Social Psychology, 20, 175–190. doi: 10.1207/s15324834basp2003_1.CrossRefGoogle Scholar
  40. Kakkar, S. B. (2004). Educational Psychology. New Dehli: Prentice-Hall of India Pvt. Ltd.Google Scholar
  41. Karremans, J. C., Verwijmeren, T., Pronk, T. M., & Reitsma, M. (2009). Interacting with women can impair men’s cognitive functioning. Journal of Experimental Social Psychology, 45, 1041–1044. doi: 10.1016/j.jesp.2009.05.004.CrossRefGoogle Scholar
  42. Katz, I., Roberts, S. O., & Robinson, J. M. (1965). Effects of task-difficulty, race of administrator, and instructions on digit-symbol performance of Negroes. Journal of Personality and Social Psychology, 2, 53–59. doi: 10.1037/h0022080.CrossRefGoogle Scholar
  43. Kite, M. E., Stockdale, G. D., Whitley, B. E., & Johnson, B. T. (2005). Attitudes toward younger and older adults: An updated meta-analytic review. Journal of Social Issues, 61, 241–266. doi: 10.1111/j.1540-4560.2005.00404.x.CrossRefGoogle Scholar
  44. Kruglanski, A. W., & Mayseless, O. (1990). Classic and current social comparison research: Expanding the perspective. Psychological Bulletin, 108, 195–208. doi: 10.1037/0033-2909.108.2.195.CrossRefGoogle Scholar
  45. Langlois, J. H., Kalakanis, L., Rubenstein, A. J., Larson, A., Hallam, M., & Smoot, M. (2000). Maxims or myths of beauty? A meta-analytic and theoretical review. Psychological Bulletin, 126, 390–423. doi: 10.1037/0033-2909.126.3.390.CrossRefGoogle Scholar
  46. Lytton, H., & Romney, D. M. (1991). Parents Differential Socialization of Boys and Girls—a Metaanalysis. Psychological Bulletin, 109, 267–296. doi: 10.1037/0033-2909.109.2.267.CrossRefGoogle Scholar
  47. Maner, J. K., Gailliot, M. T., Rouby, D. A., & Miller, S. L. (2007). Can’t take my eyes off you: Attentional adhesion to mates and rivals. Journal of Personality and Social Psychology, 93, 389–401. doi: 10.1037/0022-3514.93.3.389.CrossRefGoogle Scholar
  48. Maner, J. K., Kenrick, D. T., Becker, D. V., Delton, A. W., Hofer, B., Wilbur, C. J., et al. (2003). Sexually selective cognition: Beauty captures the mind of the beholder. Journal of Personality and Social Psychology, 85, 1107–1120. doi: 10.1037/0022-3514.85.6.1107.CrossRefGoogle Scholar
  49. Maner, J. K., Miller, S. L., Rouby, D. A., & Gailliot, M. T. (2009). Intrasexual vigilance: The implicit cognition of romantic rivalry. Journal of Personality and Social Psychology, 97, 74–87. doi: 10.1037/a0014055.CrossRefGoogle Scholar
  50. Marcus, D. K., & Rowland, S. M. (2003). Sex differences in judgments of physical attractiveness: A social relations analysis. Personality and Social Psychology Bulletin, 29, 325–335. doi: 10.1177/0146167202250193.CrossRefGoogle Scholar
  51. Meier, L. L. (2008). IRSE. Interactions in multiple linear regression with SPSS and excel (Version 1.6) [Computer software and manual]: Retrieved 23.7.2010 from http://www.urenz.ch/irse.
  52. Meyer, D. K., & Turner, J. C. (2006). Re-conceptualizing emotion and motivation to learn in classroom contexts. Educational Psychology Review, 18, 377–390. doi: 10.1007/s10648-006-9032-1.CrossRefGoogle Scholar
  53. Montepare, J. M., & Zebrowitz, L. A. (1998). Person perception comes of age: The salience and significance of age in social judgments. Advances in Experimental Social Psychology, 30, 93–161.CrossRefGoogle Scholar
  54. Nedelec, J. L., & Beaver, K. M. (2011). Beauty is in the sex of the beholder: An examination of the effects of interviewer characteristics on assessment of respondent attractiveness. Personality and Individual Differences, 51, 930–934. doi: 10.1016/j.paid.2011.07.025.CrossRefGoogle Scholar
  55. Norem, J. K., & Cantor, N. (1986). Anticipatory and post hoc cushioning strategies: Optimism and defensive pessimism in “risky” situations. Cognitive Therapy and Research, 10, 347–362. doi: 10.1007/BF01173471.CrossRefGoogle Scholar
  56. Ortner, T. M., & Sieverding, M. (2008). Where are the gender differences? Male priming boosts spatial skills in women. Sex Roles, 59, 274–281. doi: 10.1007/s11199-008-9448-9.CrossRefGoogle Scholar
  57. Ortner, T. M., & Vormittag, I. (2011). Test administrator’s gender affects female and male students’ self-estimated verbal general knowledge. Learning and Instruction, 21, 14–21. doi: 10.1016/j.learninstruc.2009.09.003.CrossRefGoogle Scholar
  58. Pekrun, R. (1992). The impact of emotions on learning and achievement—Towards a theory of cognitive motivational mediators. Applied Psychology-an International Review-Psychologie Appliquee-Revue Internationale, 41, 359–376. doi: 10.1111/j.1464-0597.1992.tb00712.x.CrossRefGoogle Scholar
  59. Pokorny, A. D., & Frazier, S. H. (1966). An evaluation of oral examinations. Journal of Medical Education, 41, 28–40.Google Scholar
  60. Raudenbush, S. W., & Byrk, A. S. (2002). Hierarchical linear models. Applications and data analysis methods (2nd ed.). Thousand Oaks: Sage Publications.Google Scholar
  61. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Pedagogiske Institut.Google Scholar
  62. Reis, H. T., Wheeler, L., Spiegel, N., Kernis, M. H., Nezlek, J., & Perri, M. (1982). Physical attractiveness in social interaction: II. Why does appearance affect social experience? Journal of Personality and Social Psychology, 43, 979–996. doi: 10.1037/0022-3514.43.5.979.CrossRefGoogle Scholar
  63. Riggio, R. E., Widaman, K. F., Tucker, J. S., & Salinas, C. (1991). Beauty is more than skin deep: Components of attractiveness. Basic and Applied Social Psychology, 12, 423–439. doi: 10.1207/s15324834basp1204_4.CrossRefGoogle Scholar
  64. Rosenthal, R. (1976). Experimenter effects in behavioral research. New York, N.Y.: Appleton Century Crofts.Google Scholar
  65. Rosenthal, R. (1995). Critiquing Pygmalion: A 25-year perspective. Current Directions in Psychological Science, 4, 171–172. doi: 10.1111/1467-8721.ep10772607.CrossRefGoogle Scholar
  66. Rosenthal, R., & Rubin, D. B. (1978). Interpersonal expectancy effects—1st 345 studies. Behavioral and Brain Sciences, 1, 377–386. doi: 10.1017/S0140525X00075506.CrossRefGoogle Scholar
  67. Rumenik, D. K., Capasso, D. R., & Hendrick, C. (1977). Experimenter sex effects in behavioral research. Psychological Bulletin, 84, 852–877. doi: 10.1037/0033-2909.84.5.852.CrossRefGoogle Scholar
  68. Sattler, J. M., & Theye, F. (1967). Procedural, situational, and interpersonal variables in individual intelligence testing. Psychological Bulletin, 68, 347–360. doi: 10.1037/h0025153.CrossRefGoogle Scholar
  69. Schutz, P. A., & Davis, H. A. (2000). Emotions and self-regulation during test taking. Educational Psychologist, 35, 243–256. doi: 10.1207/S15326985EP3504_03.CrossRefGoogle Scholar
  70. Sinclair, L., & Kunda, Z. (2000). Motivated stereotyping of women: She’s fine if she praised me but incompetent if she criticized me. Personality and Social Psychology Bulletin, 26, 1329–1342. doi: 10.1177/0146167200263002.CrossRefGoogle Scholar
  71. Steele, C. M. (1997). A threat in the air—How stereotypes shape intellectual identity and performance. American Psychologist, 52, 613–629. doi: 10.1037/0003-066X.52.6.613.CrossRefGoogle Scholar
  72. Stuart-Hamilton, I. (1996). Dictionary of psychological testing, assessment, and treatment (Rev ed.). London: Kingsley.Google Scholar
  73. Sui, J., & Liu, C. H. (2009). Can beauty be ignored? Effects of facial attractiveness on covert attention. Psychonomic Bulletin & Review, 16, 276–281. doi: 10.3758/PBR.16.2.276.CrossRefGoogle Scholar
  74. Suls, J., & Wheeler, L. (Eds.). (2000). Handbook of social comparison: Theory and research. New York: Kluwer Academic/Plenum Publishers.Google Scholar
  75. Swami, V., & Furnham, A. (2008). The psychology of physical attraction. London: Routledge.Google Scholar
  76. Taylor, S. E., & Lobel, M. (1989). Social comparison activity under threat: Downward evaluation and upward contacts. Psychological Review, 96, 569–575. doi: 10.1037/0033-295X.96.4.569.CrossRefGoogle Scholar
  77. Tesser, A. (1986). Some effects of self-evaluation maintenance on cognition and action. In R. M. Sorrentino & E. T. Higgins (Eds.), The handbook of motivation and cognition: Foundations of social behavior (pp. 435–464). New York: Guilford Press.Google Scholar
  78. Tesser, A., & Campbell, J. (1983). Self-definition and self-evaluation maintenance. In J. Suls & A. Greenwald (Eds.), Social psychological perspectives on the self (Vol. 2), (pp. 1–31).Google Scholar
  79. Tesser, A., Millar, M., & Moore, J. (1988). Some affective consequences of social comparison and reflection processes: The pain and pleasure of being close. Journal of Personality and Social Psychology, 54, 49–61. doi: 10.1037/0022-3514.54.1.49.CrossRefGoogle Scholar
  80. Thornton, B., & Moore, S. (1993). Physical attractiveness contrast effect: Implications for self-esteem and evaluations of the social self. Personality and Social Psychology Bulletin, 19, 474–480. doi: 10.1023/A:1018867409265.CrossRefGoogle Scholar
  81. Vorauer, J. D., & Kumhyr, S. M. (2001). Is this about you or me? Self-versus-other-directed judgments and feelings in response to intergroup interaction. Personality and Social Psychology Bulletin, 27, 706–719. doi: 10.1177/0146167201276006.CrossRefGoogle Scholar
  82. Wagner-Menghin, M. M. (2004). Der Lexikon-Wissen-Test (LEWITE). Computergestützte Testvorgabe und Auswertung. Wiener Testsystem) [Lexical-Knowledge-Test (LKT). Computerized presentation and scoring. Vienna Testing System]. Mödling: Schuhfried.Google Scholar
  83. Westmeyer, H. (2003). Objectivity. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (Vol. 2, pp. 629–632). London: Sage.Google Scholar
  84. Wittenborn, J. R. (1957). The theory and technique of assessment. Annual Review of Psychology, 8, 331–356. doi: 10.1146/annurev.ps.08.020157.001555.CrossRefGoogle Scholar
  85. Wood, J. V. (1989). Theory and research concerning social comparison of personal attributes. Psychological Bulletin, 106, 231–248. doi: 10.1037/0033-2909.106.2.231.CrossRefGoogle Scholar
  86. Yang, M. L., & Yu, R. R. (2008). The interviewer effect when there is an education gap with the respondent: Evidence from a survey on biotechnology in Taiwan. Social Science Research, 37, 1321–1331. doi: 10.1016/j.ssresearch.2008.05.008.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2014

Authors and Affiliations

  1. 1.Division for Psychological Assessment, Department of PsychologyFree University BerlinBerlinGermany
  2. 2.Division for Psychological Assessment, Department of PsychologyUniversity of SalzburgSalzburgAustria

Personalised recommendations