Abstract
In this chapter, we propose evaluation and decision-making as activities which, properly reconstructed from conventional norms, can be leveraged to change who and what receives access, opportunities, recognition, and status in higher education. We critically review seminal perspectives on faculty evaluation and decision-making, advance a new framework for equitable evaluation and decision-making in higher education, and consider the relevance of this framework in four functional areas of faculty practice: admission of graduate students, hiring, peer review, and curriculum and instruction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Fields are “arenas of production, circulation, and appropriation and exchange of goods, services, knowledge, or status, and the competitive positions held by actors in their struggle to accumulate, exchange, and monopolize different kinds of power resources” (Oxford 2019).
- 2.
A related concept is legitimation, defined as the process of being accepted or deemed worthy according to existing norms and placed within a framework through which things are viewed as right (Tyler 2006). As a central and ongoing cultural activity, legitimation shapes both the cognitive and sociocultural functions of faculty, departments, and institutions (Gonzales 2013; Gonzales and Terosky 2016).
- 3.
We conducted a targeted search for literature on undergraduate and graduate/professional admissions within the Proquest ERIC database, limited to English language, peer-reviewed journal articles, and the following search terms: “undergraduate admissions,” “college admissions,” “graduate admissions,” “doctoral admissions,” “masters admissions,” “professional school admissions,” “law school admissions,” “medical school admissions,” and “business school admissions.” These searches turned up 3387 overlapping results. Duplicates were removed. We reviewed titles and abstracts to ensure a focus on admissions in the USA, yielding 285 articles. The literature roughly fell into three areas, though not mutually exclusive: admissions criteria and efficacy for these items to predict academic performance, the ways admissions processes are carried out, and the impacts of enacting varying academic missions through criteria evaluation.
- 4.
In a study of medical students, MCAT predicted 1st year success in clerkships of White students but did not predict performance of racially minoritized students (White et al. 2009). In another professional school setting, the GMAT was found to be a good predictor of GPA in business and management programs, especially for non-US students, (Koys 2005; Sireci and Talento-Miller 2006). However, the test also differentially and negatively predicted success for women and racially minoritized students (Hedlund et al. 2006). These results combined show that while standardized tests offer some degree of correlation with academic success for some students, they may not add much and over reliance on them can have detrimental impact on access for marginalized groups of students (Smith and Garrison 2005).
- 5.
For studies of grades’ differential validity in predicting future success, see Culpepper and Davenport (2009), Halberstam and Redstone (2005) Lanham et al. (2011), and White et al. (2009). It was the best predictor of graduation at HBCUs in one study (Lanham et al. 2011), but another study found that its predictive power decreases as average SAT and selectivity at an institution increases (Kobrin and Patterson 2011; Sawyer 2013).
- 6.
- 7.
We conducted a targeted search of the literature on faculty hiring through the ProQuest ERIC database with the search terms “faculty hiring.” The parameters were limited to a single search term given the dearth of literature on the topic. Limiting the results to peer -reviewed journal articles yielded 58 results. Forty-four articles adequately represented our conditions; that is, they consisted of empirical evaluations of the faculty hiring process, and represented various theoretical or conceptual approaches to diversifying faculty hiring. Though limited in number, these articles provided various access points to the study of faculty hiring decision processes from search committees, to organizational structures, to institutionalized values, to various cultures of the academy.
- 8.
We conducted a search of literature through the ProQuest ERIC database with the terms “peer review,” “peer review process,” “peer review bias,” “peer review + legitimate,” and “peer review + equity”. In limiting results to peer reviewed journal articles, the majority of the published scholarship centered peer review in the context of published scholarship. A smaller body of work discussed peer review in funding applications, thus our chapter centers peer review in the context of published scholarship.
- 9.
We choose this language in order to include people who are agender.
References
Aldridge, D. P. (2006). The limits of master narratives in history textbooks: An analysis of representations of Martin Luther King, Jr. Teacher’s College Review, 108(4), 662–686.
Alon, S., & Tienda, M. (2007). Diversity, opportunity, and the shifting meritocracy in higher education. American Sociological Review, 72(4), 487–511.
Alvarado, L. A. (2010). Dispelling the meritocracy myth: Lessons for higher education and student affairs educators. The Vermont Connection, 31(1), 10–20.
Anderson, K. J., & Smith, G. (2005). Students’ preconceptions of professors: Benefits and barriers according to ethnicity and gender. Hispanic Journal of Behavioral Sciences, 27(2), 184–201.
Apple, M. W. (1999). What counts as legitimate knowledge? The social production and use of reviews. Review of Educational Research, 69(4), 343–346.
Arum, R., & Roksa, J. (2011). Academically adrift: Limited learning on college campuses. Chicago: University of Chicago Press.
Bailyn, L. (2003). Academic careers and gender equity: Lessons learned from MIT 1. Gender, Work and Organization, 10(2), 137–153.
Baldwin, M. (2018). Scientific autonomy, public accountability, and the rise of “peer review” in the Cold War United States. Isis, 109(3), 538–558.
Barab, S. A., Barnett, M., & Squire, K. (2002). Developing an empirical account of a community of practice: Characterizing the essential tensions. The Journal of the Learning Sciences, 11(4), 489–542.
Bargh, J. A., & Chartrand, T. L. (1999). The unbearable automaticity of being. The American Psychologist, 54(7), 462–479.
Bastedo, M. N. (2009). Convergent institutional logics in public higher education: State policymaking and governing board activism. The Review of Higher Education, 32(2), 209–234.
Bastedo, M. N., & Bowman, N. A. (2017). Improving admission of low-SES students at selective colleges: Results from an experimental simulation. Educational Researcher, 46(2), 67–77.
Bastedo, M. N., & Jaquette, O. (2011). Running in place: Low-income students and the dynamics of higher education stratification. Educational Evaluation and Policy Analysis, 33(3), 318–339. https://doi.org/10.3102/0162373711406718.
Bastedo, M., Bowman, N., Glasener, K., & Kelly, J. (2018). What are we talking about when we talk about holistic review? Selective college admissions and its effects on low-SES students. The Journal of Higher Education, 89(5), 782–805. https://doi.org/10.1080/00221546.2018.1442633.
Battilana, J. (2006). Agency and institutions: The enabling role of individuals’ social position. Organization, 13(5), 653–676.
Bauman, G. L., Bustillos, L. T., Bensimon, E. M., Brown, M. C., & Bartee, R. (2005). Achieving equitable educational outcomes with all students: The institution’s roles and responsibilities. Washington, DC: Association of American Colleges and Universities.
Becher, T. (1981). Towards a definition of disciplinary cultures. Studies in Higher Education, 6(2), 109–122.
Becher, T. (1987). Disciplinary discourse. Studies in Higher Education, 12(3), 261–274.
Becher, T., & Trowler, P. R. (1989). Academic tribes and territories. Buckingham: SRHE.
Becher, T., & Trowler, P. R. (2001). Academic tribes and territories (2nd ed.). Buckingham: Open University Press.
Beckert, J., & Musselin, C. (2013). Constructing quality: The classification of goods in markets. Oxford, UK: Oxford University Press.
Bedeian, A. G. (2004). Peer review and the social construction of knowledge in the management discipline. Academy of Management Learning & Education, 3(2), 198–216.
Bell, R. L., & Chong, H. G. (2010). A caste and class among the relative frequency of faculty’s publications: A content analysis of refereed business journals. Journal of Leadership, Accountability and Ethics, 8(1), 65–89.
Bensimon, E. M. (2005). Closing the achievement gap in higher education: An organizational learning perspective. New Directions for Higher Education, 2005(131), 99–111.
Bensimon, E. M. (2012). The equity scorecard: Theory of change. In E. M. Bensimon & L. Malcom (Eds.), Confronting equity issues on campus: Implementing the equity scorecard in theory and practice (pp. 17–44). Sterling: Stylus.
Bensimon, E. M., & Malcom, L. E. (2012). Confronting equity issues on campus. Sterling: Stylus.
Bensimon, E. M., Rueda, R., Dowd, A. C., & Harris III, F. (2007). Accountability, equity, and practitioner learning and change. Metropolitan, 18(3), 28–45.
Berquist, W. H., & Pawlak, K. (2007). Engaging the six cultures of the academy: Revised and expanded edition of the four cultures of the academy. San Francisco: Jossey-Bass.
Bertrand, M., & Mullainathan, S. (2004). Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American Economic Review, 94(4), 991–1013.
Bielby, R., Posselt, J. R., Jaquette, O., & Bastedo, M. N. (2014). Why are women underrepresented in elite colleges and universities? A non-linear decomposition analysis. Research in Higher Education, 55(8), 735–760. https://doi.org/10.1007/s11162-014-9334-y.
Blankenship-Knox, A. E., Platt, E. R., & Read, H. (2017). Rewarding collegiality: The use of collegiality as a factor in faculty evaluation and employment decisions. Journal of Faculty Development, 31(2), 37–42.
Bok, D. (2009). Our underachieving colleges: A candid look at how much students learn and why they should be learning more-new edition (Vol. 2). Princeton: Princeton University Press.
Boltanski, L., & Thevenot, L. (2000) The reality of moral expectations: A sociology of situated judgment. Philosophical Explorations, 3(3), 208–231.
Boltanski, L., Thévenot, L., & Porter, C. (2006). On justification: Economies of worth. Princeton: Princeton University Press.
Boring, A. (2017). Gender biases in student evaluations of teaching. Journal of Public Economics, 145, 27–41.
Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3–15.
Bourdieu, P. (1998). The state nobility: Elite schools in the field of power. Stanford: Stanford University Press.
Bowman, N. A., & Bastedo, M. N. (2018). What role may admissions office diversity and practices play in equitable decisions? Research in Higher Education, 59(4), 430–447.
Brand, A. (2013). Point of view: Faculty appointments and the record of scholarship. eLife, 2, e00452.
Briihl, D., & Wasieleski, D. (2004). A survey of master’s-level psychology programs: Admissions criteria and program policies. Teaching of Psychology, 31(4), 252–256. https://doi.org/10.1207/s15328023top3104_5.
Brookfield, S. D. (2017). Becoming a critically reflective teacher. Wiley.
Brownell, S. E., & Tanner, K. D. (2012). Barriers to faculty pedagogical change: Lack of training, time, incentives, and… tensions with professional identity? CBE – Life Sciences Education, 11(4), 339–346.
Caffarella, R. S., & Zinn, L. F. (1999). Professional development for faculty: A conceptual framework of barriers and supports. Innovative Higher Education, 23(4), 241–254.
Caldwell, C., Shapiro, J. P., & Gross, S. J. (2007). Ethical leadership in higher education admission: Equality vs. equity. Journal of College Admission, 195, 14–19.
Campbell, C. M., & O’Meara, K. (2014). Faculty agency: Departmental contexts that matter in faculty careers. Research in Higher Education, 55(1), 49–74.
Carlin, P. S., Kidd, M. P., Rooney, P. M., & Denton, B. (2013). Academic wage structure by gender: The roles of peer review, performance, and market forces. Southern Economic Journal, 80(1), 127–146.
Carter, D. F., Dueñas, J. E. R., & Mendoza, R. (2019). Critical examination of the role of STEM in propagating and maintaining race and gender disparities. In M. B. Paulsen and L. W. Perna (Eds) Higher Education: Handbook of Theory and Research, 34 (39–97). Cham, Switzerland: Springer.
Christensen, D., Nance, W., & White, D. (2012). Academic performance in MBA programs: Do prerequisites really matter? Journal of Education for Business, 87(1), 42–47. https://doi.org/10.1080/08832323.2011.555790.
Christensen, M., Lykkegaard, E., Lund, O., & O’Neill, L. (2018). Qualitative analysis of MMI raters’ scorings of medical school candidates: A matter of taste? Advances in Health Sciences Education, 23(2), 289–310. https://doi.org/10.1007/s10459-017-9794-x.
Cipriano, R. E., & Buller, J. L. (2012). Rating faculty collegiality. Change: The Magazine of Higher Learning, 44(2), 45–48.
Cole, S. (1983). The hierarchy of the sciences? American Journal of Sociology, 89(1), 111–139.
Cole, S., & Simon, G. A. (1981). Chance and consensus in peer review. Science, 214(4523), 881–886.
Contreras, F. E. (2005). The reconstruction of merit post-proposition 209. Educational Policy, 19(2), 371–395.
Corbally, J. E., & Sergiovanni, T. J. (Eds.). (1986). Leadership and organizational culture: New perspectives on administrative theory and practice. Oxford: University of Illinois Press.
Correll, S. J., Benard, S., & Paik, I. (2007). Getting a job: Is there a motherhood penalty? American Journal of Sociology, 112(5), 1297–1338.
Culpepper, S. A., & Davenport, E. C. (2009). Assessing differential prediction of college grades by race/ethnicity with a multilevel model. Journal of Educational Measurement, 46(2), 220–242.
Cureton, E. E., Cureton, L. W., & Bishop, R. (1949). Predictions of success in graduate study at the University of Tennessee. American Psychologist, 4, 361–362.
Deephouse, D. L., & Suchman, M. (2008). Legitimacy in organizational institutionalism. In R. Greenwood, C. Oliver, K. Sahlin, & R. Suddaby (Eds.), The SAGE handbook of organizational institutionalism (pp. 49–77). Thousand Oaks: SAGE Publications.
Delgado, R. (1984). The imperial scholar: Reflections on a review of civil rights literature. University of Pennsylvania Law Review, 132(3), 561–578.
Delgado Bernal, D., & Villalpando, O. (2002). An apartheid of knowledge in academia: The struggle over the “legitimate” knowledge of faculty of color. Equity & Excellence in Education, 35(2), 169–180.
Dowd, A. C., & Bensimon, E. M. (2015). Engaging the “race question”: Accountability and equity in US higher education. New York: Teachers College Press.
Ehrenberg, R. G., Jakubson, G. H., Martin, M. L., Main, J. B., & Eisenberg, T. (2012). Diversifying the faculty across gender lines: Do trustees and administrators matter? Economics of Education Review, 31(1), 9–18.
Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research. Helsinki: Orienta-Konsultit.
Espeland, W. N., & Sauder, M. (2007). Rankings and reactivity: How public measures recreate social worlds. American Journal of Sociology, 113(1), 1–40.
Felix, E. R., Bensimon, E. M., Hanson, D., Gray, J., & Klingsmith, L. (2015). Developing agency for equity-minded change. New Directions for Community Colleges, 2015(172), 25–42.
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002). A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality and Social Psychology, 82, 878–902.
Freeman, S., & DiRamio, D. (2016). Elitism or pragmatism? Faculty hiring at top graduate programs In higher education administration. The Journal of the Professoriate, 8, 94–127.
Garces, L. M. (2014). Aligning diversity, quality, and equity: The implications of legal and public policy developments for promoting racial diversity in graduate studies. American Journal of Education, 120(4), 457–480.
Gay, G. (1990). Achieving educational equality through curriculum desegregation. The Phi Delta Kappan, 72(1), 56–62.
Gildersleeve, R. E. (2010). Access between and beyond borders. Journal of College Admission, 206, 3–10.
Gonzales, L. D. (2013). Faculty sensemaking and mission creep: Interrogating institutionalized ways of knowing and doing legitimacy. The Review of Higher Education, 36(2), 179–209.
Gonzales, L. D., & Núñez, A.-M. (2014). The ranking regime and the production of knowledge: Implications for academia. Education Analysis Policy Archives, 22(31). https://doi.org/10.14507/epaa.v22n31.2014.
Gonzales, L. D., & Rincones, R. (2012). Interdisciplinary scholars: Negotiating legitimacy at the core and from the margins. Journal of Further and Higher Education, 36(4), 495–518.
Gonzales, L. D., & Terosky, A. L. (2016). From the faculty perspective: Defining, earning, and maintaining legitimacy across academia. Teachers College Record, 118(7), 1–44.
Gordon, J. (2005). White on White: Researcher reflexivity and the logics of privilege in White schools undertaking reform. The Urban Review, 37(4), 279–302.
Guinier, L. (2015). The tyranny of the meritocracy: Democratizing higher education in America. Boston: Beacon Press.
Gutiérrez, K. D., & Rogoff, B. (2003). Cultural ways of learning: Individual traits or repertoires of practice. Educational Researcher, 32(5), 19–25.
Gutmann, A., & Thompson, D. (2009). Why deliberative democracy?. Princeton: Princeton University Press.
Halberstam, B., & Redstone, F. (2005). The predictive value of admissions materials on objective and subjective measures of graduate school performance in speech-language pathology. Journal of Higher Education Policy and Management, 27(2), 261–272. https://doi.org/10.1080/13600800500120183.
Hamann, J., & Beljean, S. (2017). Academic evaluation in higher education. In Encyclopedia of international higher education systems and institutions (pp. 1–7). Amsterdam: Springer.
Haro, R. (1995). Held to a higher standard: Latino executive selection in higher education. In R. V. Padilla & R. C. Chavez (Eds.), The leaning Ivory Tower: Latino professors in American universities (pp. B32–B33). Albany, NY: State University of New York Press.
Harper, S.R. (2012). Black male student success in higher education: A report from the National Black Male College Achievement Study. University of Pennsylvania, Graduate School of Education, Center for the Study of Race and Equity in Education.
Harper, S. R., & Hurtado, S. (2007). Nine themes in campus racial climates and implications for institutional transformation. New Directions for Student Services, 2007(120), 7–24.
Harper, S. R., Smith, E. J., & Davis, C. H., III. (2018). A critical race case analysis of black undergraduate student success at an urban university. Urban Education, 53(1), 3–25.
Harris, J. C., & Patton, L. D. (2018). Un/doing intersectionality through higher education research. The Journal of Higher Education, 1–26.
Hedlund, J., Wilt, J., Nebel, K., Ashford, S., & Sternberg, R. (2006). Assessing practical intelligence in business school admissions: A supplement to the graduate management admissions test. Learning and Individual Differences, 16(2), 101–127. https://doi.org/10.1016/j.lindif.2005.07.005.
Hesse-Biber, S. N. (2017). The practice of qualitative research (3rd ed.). Los Angeles: Sage.
Hirschauer, S. (2010). Editorial judgments: A praxeology of ‘voting’ in peer review. Social Studies of Science, 40(1), 71–103.
Hodum, R. L., & James, G. W. (2010). An observation of normative structure for college admission and recruitment officers. The Journal of Higher Education, 81(3), 317–338.
Hoffman, M. (1977). Moral internalization: Current theory and research. Advances in Experimental Social Psychology, 10, 85–133.
Hojat, M., Gonnella, J. S., & Caelleigh, A. S. (2003). Impartial judgment by the “gatekeepers” of science: Fallibility and accountability in the peer review process. Advances in Health Sciences Education, 8(1), 75–96.
Hora, M. T., & Ferrare, J. J. (2013). Instructional systems of practice: A multidimensional analysis of math and science undergraduate course planning and classroom teaching. Journal of the Learning Sciences, 22(2), 212–257.
Hora, M.T., & Holden, J.I. (2012). Exploring faculty decision-making processes for using instructional technology in the classroom. University of Wisconsin. (ERICDocument Reproduction Service No. ED530736).
Hook, b. (1994). Teaching to transgress: Education as the practice of freedom. New York: Routledge.
Hurtado, S. (1992). The campus racial climate: Contexts of conflict. The Journal of Higher Education, 63(5), 539–569.
Hyland, K. (1999). Academic attribution: Citation and the construction of disciplinary knowledge. Applied Linguistics, 20(3), 341–367.
Jaquette, O., Curs, B. R., & Posselt, J. R. (2016). Tuition rich, mission poor: Nonresident enrollment growth and the socioeconomic and racial composition of public research universities. The Journal of Higher Education, 87(5), 635–673.
June, A.W. (2017, November 22). When ‘collegiality’ and evaluating faculty collide. Chronicle of higher education. Retrieved April 1, 2019 from https://www.chronicle.com/article/When-Collegiality-and/241862
Kahneman, D. (2011). Thinking fast and slow. New York: Farrar, Straus, and Giroux.
Karabel, J. (2005). The chosen: The hidden history of admission and exclusion at Harvard, Yale, and Princeton. Boston: Houghton Mifflin Harcourt.
Karabel, J. (2006). The chosen: The hidden history of admission and exclusion at Harvard, Yale, and Princeton. New York: Houghton Mifflin Harcourt.
Kayes, P. E. (2006). New paradigms for diversifying faculty and staff in higher education: Uncovering cultural biases in the search and hiring process. Multicultural Education, 14(2), 65–69.
Kezar, A., & Gehrke, S. (2016). Faculty composition in four-year institutions: The role of pressures, values, and organizational processes in academic decision-making. The Journal of Higher Education, 87(3), 390–419.
Khan, S. (2012). The sociology of elites. Annual Review of Sociology, 38, 361–377.
Kobrin, J., & Patterson, B. (2011). Contextual factors associated with the validity of SAT scores and high school GPA for predicting first-year college grades. Educational Assessment, 16(4), 207–226. https://doi.org/10.1080/10627197.2011.635956.
Koys, D. J. (2005). The validity of the graduate management admissions test for non-US students. Journal of Education for Business, 80(4), 236–239. https://doi.org/10.3200/JOEB.80.4.236-239.
Kuncel, N. R., & Hezlett, S. A. (2007). Standardized tests predict graduate students’ success. Science, 315(5815), 1080–1081.
Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2001). A comprehensive meta-analysis of the predictive validity of the graduate record examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127(1), 162–181.
Kyllonen, P., Walters, A. M., & Kaufman, J. C. (2005). Noncognitive constructs and their assessment in graduate education: A review. Educational Assessment, 10(3), 153–184.
Laird, T. F. N., Shoup, R., Kuh, G. D., & Schwarz, M. J. (2008). The effects of discipline on deep approaches to student learning and college outcomes. Research in Higher Education, 49(6), 469–494.
Lamont, M. (2009). How professors think. Cambridge, MA: Harvard University Press.
Lamont, M. (2012). Toward a comparative sociology of valuation and evaluation. Annual Review of Sociology, 38, 201–221.
Lamont, M., Beljean, S., & Clair, M. (2014). What is missing? Cultural processes and causal pathways to inequality. Socio-Economic Review, 12(3), 573–608.
Lanham, B. D., Schauer, E. J., & Osho, G. S. (2011). A comprehensive analysis of the efficacy of non-cognitive measures: Predicting academic success in a historically Black university in South Texas. Journal of College Teaching & Learning, 8(4), 43–51. https://doi.org/10.19030/tlc.v8i4.4193.
Lannholm, G.V. (1968). Cooperative studies of predicting graduate school success. Graduate record examinations special report number 68-3.
Lattuca, L. R. (2005). Faculty work as learning: Insights from theories of cognition. New Directions for Teaching and Learning, 102, 13–21.
Lattuca, L. R., & Stark, J. S. (2011). Shaping the college curriculum: Academic plans in context. San Francisco: Wiley.
Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge, UK: Cambridge University Press.
Lee, C. D., & Chun, E. (2014). Search committees: A comprehensive guide to successful faculty, staff, and administrative searches (2nd ed.). Sterling: Stylus Publishing.
Liera, R. (2018). Faculty learning and agency for racial equity (Doctoral dissertation). University of Southern California.
Liera, R., & Dowd, A. C. (2018). Faculty learning at boundaries to broker racial equity. The Journal of Higher Education, 90, 1–24. https://doi.org/10.1080/00221546.2018.1512805.
Littleford, L., Buxton, K., Bucher, M., Simon-Dack, S., & Yang, K. (2018). Psychology doctoral program admissions: What master’s and undergraduate-level students need to know. Teaching of Psychology, 45(1), 75–83. https://doi.org/10.1177/0098628317745453.
Littler, J. (2017). Against meritocracy: Culture, power and myths of mobility. New York: Routledge.
Liu, A. (2011). Unraveling the myth of meritocracy within the context of US higher education. Higher Education, 62(4), 383–397.
MacNell, L., Driscoll, A., & Hunt, A. N. (2015). What’s in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40(4), 291–303.
Mann, S. J. (2001). Alternative perspectives on the student experience: Alienation and engagement. Studies in Higher Education, 26(1), 7–19.
March, J. G. (1994). Primer on decision making: How decisions happen. New York: Simon and Schuster.
Marine, S. B. (2017). Changing the frame: Queering access to higher education for trans∗ students. International Journal of Qualitative Studies in Education, 30(3), 217–233.
Massey, D. (2007). Categorically unequal: The American stratification system. New York: Russell Sage Foundation.
Mattern, K., & Patterson, B. (2013). Test of slope and intercept bias in college admissions: A response to Aguinis, Culpepper, and Pierce (2010). Journal of Applied Psychology, 98(1), 134–147. https://doi.org/10.1037/a0030610.
Mattern, K., Shaw, E., & Kobrin, J. (2011). An alternative presentation of incremental validity: Discrepant SAT and HSGPA performance. Educational and Psychological Measurement, 71(4), 638–662. https://doi.org/10.1177/0013164410383563.
McKenna, A., Yalvac, B., & Light, G.J. (2009). The role of collaborative reflection on shaping engineering faculty teaching approaches. Journal of Engineering Education, 98(1), 17–26.
Milkman, K. L., Akinola, M., & Chugh, D. (2015). What happens before? A field experiment exploring how pay and representation differentially shape bias on the pathway into organizations. Journal of Applied Psychology, 100(6), 1678–1712.
Miller, C. C. (2006). From the editors: Peer review in the organizational and management sciences: Prevalence and effects of reviewer hostility, bias, and dissensus. The Academy of Management Journal, 49(3), 425–431.
Miller, C., & Stassun, K. (2014). A test that fails. Nature, 510(7504), 303–304. https://doi.org/10.1038/nj7504-303a.
Miller, C. W., Zwickl, B. M., Posselt, J. R., Silvestrini, R. T., & Hodapp, T. (2019). Typical physics Ph. D. admissions criteria limit access to underrepresented groups but fail to predict doctoral completion. Science Advances, 5(1), eaat7550.
Milner, H. R., IV. (2007). Race, culture, and researcher positionality: Working through dangers seen, unseen, and unforeseen. Educational Researcher, 36(7), 388–400.
Mitchell, K. M., & Martin, J. (2018). Gender bias in student evaluations. PS: Political Science & Politics, 51(3), 648–652.
Morrison, G. Z. (2010). Two separate worlds: Students of color at a predominantly white university. Journal of Black Studies, 40(5), 987–1015.
Moore, D. A., Swift, S. A., Sharek, Z. S., & Gino, F. (2010). Correspondence bias in performance evaluation: Why grade inflation works. Personality and Social Psychology Bulletin, 36(6), 843–852.
Moses, M. S., & Chang, M. J. (2006). Toward a deeper understanding of the diversity rationale. Educational Researcher, 35(1), 6–11.
Moss-Racusin, C. (2012). Are science faculty biased against female students? Society of Personality and Social Psychology Connections. Retrieved from https://spsptalks.wordpress.com/2012/09/21/are-science-faculty-biased-against-female-students/
Mountford, M., Ehlert, M., Machell, J., & Cockrell, D. (2007). Traditional and personal admissions criteria: Predicting candidate performance in US educational leadership programmes. International Journal of Leadership in Education, 10(2), 191–210. https://doi.org/10.1080/13603120600935696.
Murphy, S., Klieger, D., Borneman, M., & Kuncel, N. (2009). The predictive power of personal statements in admissions: A meta-analysis and cautionary tale. College and University, 84(4), 83–86.
Museus, S.D., Ledesma, M., & Parker, T. (2015). Racism and racial equity in higher education. ASHE Higher Education Reader.
Nash, K. (2019). Neo-liberalisation, universities and the values of bureaucracy. The Sociological Review, 67(1), 178–193.
Neumann, A. (2009). Professing to learn: Creating tenured lives and careers in the American research university (No. 475). Baltimore: JHU Press.
Neumann, A. (2014). Staking a claim on learning: What we should know about learning in higher education and why. The Review of Higher Education, 37(2), 249–267.
Neumann, R., Parry, S., & Becher, T. (2002). Teaching and learning in their disciplinary contexts: A conceptual analysis. Studies in Higher Education, 27(4), 405–417.
Park, J. J., & Liu, A. (2014). Interest convergence or divergence? A critical race analysis of Asian Americans, meritocracy, and critical mass in the affirmative action debate. The Journal of Higher Education, 85(1), 36–64.
Pascarella, E. T. (1985). College environmental influences on learning and cognitive development: A critical review and synthesis. In J. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 1). New York: Agathon.
Pascarella, E. T., & Terenzini, P. T. (1991). How college affects students: Findings and insights from twenty years of research. San Francisco: Jossey-Bass.
Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (Vol. 2). Indianapolis: Jossey-Bass, An Imprint of Wiley.
Pascarella, E. T., Blaich, C., Martin, G. L., & Hanson, J. M. (2011). How robust are the findings of academically adrift? Change: The Magazine of Higher Learning, 43(3), 20–24.
Patton, L. D., Harper, S. R., & Harris, J. (2015). Using critical race theory to (re)interpret widely- studied topics related to students in U.S. higher education. In Martínez Alemán, A. M., Bensimon, E. M., Pusser, B. (Eds.), Critical approaches to the study of higher education (pp. 193–219). Baltimore, MD: Johns Hopkins University Press.
Paxton, P., & Bollen, K. A. (2003). Perceived quality and methodology in graduate department ratings: Sociology, political science, and economics. Sociology of Education, 76(1), 71–88.
Pittman, C. T. (2010). Race and gender oppression in the classroom: The experiences of women faculty of color with white male students. Teaching Sociology, 38(5), 183–196.
Posselt, J. R. (2014). Toward inclusive excellence in graduate education: Constructing merit and diversity in PhD admissions. American Journal of Education, 120(4), 481–514.
Posselt, J. R. (2015). Disciplinary logics in doctoral admissions: Understanding patterns of faculty evaluation. Journal of Higher Education, 86(6), 807–833. https://doi.org/10.1353/jhe.2015.0030.
Posselt, J. R. (2016). Inside graduate admissions: Merit, diversity, and faculty gatekeeping. Cambridge, MA: Harvard University Press.
Posselt, J. R. (2018). Trust networks: A new perspective on pedigree and the ambiguities of admissions. The Review of Higher Education, 41(4), 497–521.
Posselt, J.R., & Miller, C.W. (2018, May). It’s time for the talk. Inside Higher Ed.
Posselt, J. R., Jaquette, O., Bielby, R., & Bastedo, M. N. (2012). Access without equity: Longitudinal analyses of institutional stratification by race and ethnicity, 1972–2004. American Educational Research Journal, 49(6), 1074–1111. https://doi.org/10.3102/0002831212439456.
Posselt, J., Hernandez, T., Cochran, G., & Miller, C. (in press). Metrics first, diversity later? Making the short list and getting admitted to selective physics Ph.D. programs. Journal of Women and Minorities in Science and Engineering. https://doi.org/10.1615/JWomenMinorScienEng.2019027863
Potvin, G., Chari, D., & Hodapp, T. (2017). Investigating approaches to diversity in a national survey of physics doctoral degree programs: The graduate admissions landscape. Physical Review Physics Education Research, 13(2), 020142-1–020142-13.
Powell, W. W. (1985). Getting into print: The decision-making process in scholarly publishing. Chicago: University of Chicago Press.
Quaye, S. J., & Harper, S. R. (2007). Faculty accountability for culturally inclusive pedagogy and curriculua. Liberal Education, 93(3), 32–39.
Quaye, S. J., & Harper, S. R. (Eds.). (2014). Student engagement in higher education: Theoretical perspectives and practical approaches for diverse populations. New York: Routledge.
Raelin, J. (2008). Refereeing the game of peer review. Academy of Management Learning & Education, 7(1), 124–129.
Redding, A. B. (2013). Supporting international applicants and promoting an ethical model of global college admission. Journal of College Admission, 219, 8–15.
Rendón, L. I. (1994). Validating culturally diverse students: Toward a new model of learning and student development. Innovative Higher Education, 19(1), 33–51.
Rivera, L. A. (2017). When two bodies are (not) a problem: Gender and relationship status discrimination in academic hiring. American Sociological Review, 82(6), 1111–1138.
Roberts, T. J., & Shambrook, J. (2012). Academic excellence: A commentary and reflections on the inherent value of peer review. Journal of Research Administration, 43(1), 33–38.
Roberts, S. G., & Verhoef, T. (2016). Double-blind reviewing at EvoLang 11 reveals gender bias. Journal of Language Evolution, 1(2), 163–167.
Rogoff, B. (2003). The cultural nature of human development. New York: Oxford University Press.
Rose, G. (1997). Situating knowledges: Positionality, reflexivities and other tactics. Progress in Human Geography, 21(3), 305–320.
Rowland, F. (2002). The peer-review process. Learned Publishing, 15(4), 247–258.
Sagaria, M. A. D. (2002). An exploratory model of filtering in administrative searches: Toward counter-hegemonic discourses. The Journal of Higher Education, 73(6), 677–710.
Salinas, C. (2018). A case study for a new peer-review journal on race and ethnicity in American higher education. Publications, 6(2), 26.
Sandler, B.R. (1996). The chilly classroom climate: A guide to improve the education of women. Association of American Colleges, Project on the Status and Education of Women.
Sauder, M., & Espeland, W. N. (2009). The discipline of rankings: Tight coupling and organizational change. American Sociological Review, 74(1), 63–82.
Sawyer, R. (2013). Beyond correlations: Usefulness of high school GPA and test scores in making college admissions decisions. Applied Measurement in Education, 26(2), 89–112. https://doi.org/10.1080/08957347.2013.765433.
Schein, E. H. (1990). Organizational culture. The American Psychologist, 45(2), 109–119.
Schein, E. H. (2010). Organizational culture and leadership (Vol. 2). Hoboken: Wiley.
Schwartzman, R. (1997). Peer review as the enforcement of disciplinary orthodoxy. Southern Communication Journal, 63(1), 69–75.
Sedlacek, W. E. (2004). Beyond the big test: Noncognitive assessment in higher education. Indianapolis: Jossey-Bass, An Imprint of Wiley.
Seldin, P. (1995). Improving college teaching. Bolton: Anker Publishing Company.
Sensoy, O., & DiAngelo, R. (2017). “We are all for diversity, but…”: How faculty hiring committees reproduce whiteness and practical change for how they can change. Harvard Educational Review, 87(4), 557–581.
Shivpuri, S., Schmitt, N., Oswald, F., & Kim, B. (2006). Individual differences in academic growth: Do they exist, and can we predict them? Journal of College Student Development, 47(1), 69–86. https://doi.org/10.1353/csd.2006.0013.
Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14.
Siler, K., & Strang, D. (2017). Peer review and scholarly originality: Let 1,000 flowers bloom, but don’t step on any. Science, Technology, & Human Values, 42(1), 29–61.
Sinha, R., Oswald, F., Imus, A., & Schmitt, N. (2011). Criterion-focused approach to reducing adverse impact in college admissions. Applied Measurement in Education, 24(2), 137–161. https://doi.org/10.1080/08957347.2011.554605.
Sireci, S., & Talento-Miller, E. (2006). Evaluating the predictive validity of graduate management admission test scores. Educational and Psychological Measurement, 66(2), 305–317. https://doi.org/10.1177/0013164405282455.
Smith, M. J. (2008). Four steps to a paradigm shift: Employing critical perspectives to improve outreach to low-SES African-American and Latino students and their parents. Journal of College Admission, 201, 17–23. Retrieved from http://search.proquest.com/docview/219164492/.
Smith, D. G. (2009). Diversity’s promise for higher education: Making it work. Baltimore: The John Hopkins University Press.
Smith, D. G. (2015). Diversity’s promise for higher education: Making it work. Baltimore: JHU Press.
Smith, D. G., & Garrison, G. (2005). The impending loss of talent: An exploratory study challenging assumptions about testing and merit. Teachers College Record, 107(4), 629–653.
Smith, D. G., Wolf, L. E., Busenberg, B., et al. (1996). Achieving faculty diversity: Debunking the myths. Washington, DC: Association of American Colleges and Universities.
Smith, D. G., Turner, C. S. V., Osei-Kofi, N., & Richards, S. (2004). Interrupting the usual: Successful strategies for hiring diverse faculty. The Journal of Higher Education, 75(2), 133–160.
Solórzano, D., Ceja, M., & Yosso, T. (2000). Critical race theory, racial microaggressions, and campus racial climate: The experiences of African American college students. Journal of Negro Education, 60–73.
Sommerfeld, A. (2011). Recasting non-cognitive factors in college readiness as what they truly are: Non-academic factors. Journal of College Admission, 213, 18–22.
Sorey, K., & Duggan, M. H. (2008). Homeschoolers entering community colleges: Perceptions of admission officers. Journal of College Admission, 200, 22–28.
Squire, D.D. (2019). “It’s pretty essential”: A critical race counter-narrative of faculty of color understandings of diversity and equity in doctoral admissions. The Urban Review, 1–25.
Stanley, C. A. (2007). When counter narratives meet master narratives in the journal editorial-review process. Educational Researcher, 36(1), 14–24.
Stanny, C., Gonzalez, M., & McGowan, B. (2015). Assessing the culture of teaching and learning through a syllabus review. Assessment & Evaluation in Higher Education, 40(7), 898–913.
Stanton-Salazar, R. D. (2011). A social capital framework for the study of institutional agents and their role in the empowerment of low-status students and youth. Youth & Society, 43(3), 1066–1109.
Stegmeir, M. (2017). Muslims on campus: College-bound students, schools contend with rising intolerance. Journal of College Admission, 237, 34–39.
Stevens, M. (2007). Creating a class: College admissions and the education of elites. Cambridge, MA: Harvard University Press.
Storage, D., Horne, Z., Cimpian, A., & Leslie, S. J. (2016). The frequency of “brilliant” and “genius” in teaching evaluations predicts the representation of women and African Americans across fields. PLoS One, 11(3), e0150194.
Stupnisky, R. H., BrckaLorenz, A., Yuhas, B., & Guay, F. (2018). Faculty members’ motivation for teaching and best practices: Testing a model based on self-determination theory across institution types. Contemporary Educational Psychology, 53, 15–26.
Sulik, G., & Keys, J. (2014). “Many students really do not yet know how to behave!” The syllabus as a tool for socialization. Teaching Sociology, 42(2), 151–160.
Swartz, D.L. (2016). Bourdieu’s concept of field. Oxford Bibliographies. Retrieved from http://www.oxfordbibliographies.com/view/document/obo-9780199756384/obo-9780199756384-0164.xml
Tate, W. F., IV. (1997). Critical race theory and education: History, theory, and implications. Review of Research in Education, 23, 191–243.
Thomas, L., Kuncel, N., & Crede, M. (2007). Noncognitive variables in college admissions: The case of the non-cognitive questionnaire. Educational and Psychological Measurement, 67(4), 635–657. https://doi.org/10.1177/0013164406292074.
Thornton, P. H. (2004). Markets from culture: Institutional logics and organizational decisions in higher education publishing. Stanford: Stanford University Press.
Tierney, W. G. (1993). Building communities of difference: Higher education in the twenty-first century. Greenwood Publishing Group.
Tierney, W. G. (2008). The impact of culture on organizational decision-making: Theory and practice in higher education. Sterling: Stylus Publishing, LLC.
Tierney, W. G., & Bensimon, E. M. (1996). Promotion and tenure: Community and socialization in academe. Albany: SUNY Press.
Tierney, W. G., & Blumberg Corwin, Z. (2007). The tensions between academic freedom and institutional review boards. Qualitative Inquiry, 13(3), 388–398.
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017). Reviewer bias in single-versus double-blind peer review. Proceedings of the National Academy of Sciences, 114(48), 12708–12713.
Trix, F., & Psenka, C. (2003). Exploring the color of glass: Letters of recommendation for female and male medical faculty. Discourse & Society, 14(2), 191–220.
Turner, C. S. V. (2002). Diversifying the faculty: A guidebook for search committees. Washington, DC: Association of American Colleges and Universities.
Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.
Twombly, S. B. (2005). Values, policies, and practices affecting the hiring process for full-time arts and sciences faculty in community colleges. The Journal of Higher Education, 76(4), 423–447.
Tyler, T. R. (2006). Psychological perspectives on legitimacy and legitimation. Annual Review of Psychology, 57, 375–400.
Uzuner-Smith, S., & Englander, K. (2015). Exposing ideology within university policies: A critical discourse analysis of faculty hiring, promotion and remuneration practices. Journal of Education Policy, 30(1), 62–85.
Villarreal, C. D., Liera, R., & Malcom-Piqueux, L. (2019). The role of niceness in silencing racially minoritized faculty. In A. E. Castagno (Ed.), The price of nice: How good intentions maintain educational inequity. Minneapolis: University of Minnesota Press.
Weber, M. (1978). Economy and society: An outline of interpretive sociology (Vol. 2). Berkeley: University of California Press.
Wechsler, H. S. (2017). The qualified student: A history of selective college admission in America. New York: Routledge.
Wenger, E. (2010). Communities of practice and social learning systems: The career of a concept. In Social learning systems and communities of practice (pp. 179–198). London: Springer.
Wertsch, J. V. (1991). A sociocultural approach to socially shared cognition. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (p. 85–100). Washington, DC: American Psychological Association.
White, C. B., Dey, E. L., & Fantone, J. C. (2009). Analysis of factors that predict clinical performance in medical school. Advances in Health Sciences Education, 14(4), 623–623. https://doi.org/10.1007/s10459-009-9189-8.
Wilson, J. Q. (1989). Bureaucracy: What government agencies do and why they do it. New York: Basic Books.
Yosso, T. J. (2006). Critical race counterstories along the Chicana/Chicano educational pipeline. New York: Routledge.
Zwick, R. (2017). Who gets in?: Strategies for fair and effective college admissions. Cambridge, MA: Harvard University Press.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this entry
Cite this entry
Posselt, J., Hernandez, T.E., Villarreal, C.D., Rodgers, A.J., Irwin, L.N. (2020). Evaluation and Decision Making in Higher Education. In: Perna, L. (eds) Higher Education: Handbook of Theory and Research. Higher Education: Handbook of Theory and Research, vol 35. Springer, Cham. https://doi.org/10.1007/978-3-030-31365-4_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-31365-4_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31364-7
Online ISBN: 978-3-030-31365-4
eBook Packages: EducationReference Module Humanities and Social SciencesReference Module Education