Academic incivility can create divisiveness and affect learners’ sustainability towards degree attainment. Therefore, there is a need to empirically assess learner views on what constitutes academic incivility in higher education. To fill this gap, we developed the Incivility Indicators Instrument (i3), a multifaceted scale that measures the extent to which students view cumulative behaviors and dynamics as instances of academic incivility. To examine the reliability and factor structure of the i3, we conducted a two-part study with two samples of adults in the United States who were enrolled in higher education programs. In study 1 (N = 342), we conducted an exploratory factor analysis (EFA) and found the initial three-factor structure. In study 2, we administered the instrument to a validating sample (N = 510) and examined the stability of the three-factor model and scores through confirmatory factor analysis (CFA). In this study, we describe the results of the study, provide implications, and discuss future directions.
This is a preview of subscription content,to check access.
Access this article
Alexander-Snow, M. (2004). Dynamics of gender, ethnicity, and race in understanding classroom incivility. New Directions for Teaching and Learning, 2004(99), 21–31. https://doi.org/10.1002/tl.155
Alt, D., & Itzkovich, Y. (2019). The connection between perceived constructivist learning environments and faculty uncivil authoritarian behaviors. Higher Education, 77(3), 437–454. https://doi.org/10.1007/s10734-018-0281-y.
Altmiller, G. (2012). Student perceptions of incivility in nursing education: Implications for educators. Nursing Education Perspectives, 33(1), 15–20. https://doi.org/10.5480/1536-5026-33.1.15.
Ausbrooks, A. R., Jones, S. H., & Tijerina, M. S. (2ntel011). Now you see it, now you don’t: Faculty and student perceptions of classroom incivility in a social work program. Advances in Social Work, 12(2), 255–275. https://doi.org/10.18060/1932
Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. The reviewer’s guide to quantitative methods in the social sciences (pp. 98–122). Routledge.
Bjorklund, W. L., & Rehling, D. L. (2010). Student perceptions of classroom incivility. College Teaching, 58(1), 15–18. https://doi.org/10.1080/87567550903252801.
Boice, R. (1996). Classroom incivilities. Research in Higher Education, 37(1), 453–486.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford publications.
Buckley, T. R., & Foldy, E. G. (2010). A pedagogical model for increasing race-related multicultural counseling competency. The Counseling Psychologist, 38(5), 691–713. https://doi.org/10.1177/0011000009360917.
Burke, L. A., Karl, K., Peluchette, J., & Evans, W. R. (2014). Student incivility: A domain review. Journal of Management Education, 38(2), 160–191. https://doi.org/10.1177/1052562913488112.
Campbell, L. O., Frawley, C., & Tinstman Jones, J. (2023). Incivility Indicators Instrument (i3). Unpublished Instrument.
Campbell, L. O., Tinstman Jones, J. L., & Lambie, G. W. (2020). Online academic incivility among adult learners. Adult Learning, 31(3), 109–119. https://doi.org/10.1177/1045159520916489
Campbell, L. O., Tinstman Jones, J. L., Sutter, C. C., & Stickl-Haugen, J. (2022). Academic Incivility Scale. Unpublished Instrument.
Cho, E., & Kim, S. (2015). Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods, 18(2), 207–230.
Clark, C. M., & Springer, P. J. (2007). Incivility in nursing education: A descriptive study of definitions and prevalence. Journal of Nursing Education, 46(1), https://doi.org/10.3928/01484834-20070101-03.
Clark, C. M., Farnsworth, J., & Landrum, R. E. (2009). Development and description of the incivility in nursing education (INE) survey. Journal of Theory Construction & Testing, 13(1), 7–15.
Clark, C. M., Werth, L., & Ahten, S. (2012b). Cyber-bullying and incivility in the online learning environment, part 1: Addressing faculty and student perceptions. Nurse Educator, 37(4), 150–156. https://doi.org/10.1097/NNE.0b013e31825a87e5.
Clark, C. M., Barbosa-Leiker, C., Gill, L. M., & Nguyen, D. (2015). Revision and psychometric testing of the incivility in nursing education (INE) survey: Introducing the INE-R. Journal of Nursing Education, 54(6), 306–315. https://doi.org/10.3928/01484834-20150515-01.
DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Sage.
Dyer, R., Green, R., Pitts, M., & Millward, G. (1995). What’s the flaming problem? Or computer mediated communication–deindividuating or disinhibiting? In M. A. R. Kirby, A. J. Dix, & J. E. Finlay (Eds.), People and computers X (pp. 289–301). Cambridge University Press.
Eka, N. G. A., Chambers, D., & Narayanasamy, A. (2016). Perceived uncivil behavior in indonesian nursing education. Nurse Education in Practice, 20, 99–108.
Farrell, A. H., Provenzano, D. A., Spadafora, N., Marini, Z. A., & Volk, A. A. (2016). Measuring adolescent attitudes toward classroom incivility: Exploring differences between intentional and unintentional incivility. Journal of Psychoeducational Assessment, 34(6), 577–588. https://doi.org/10.1177/0734282915623446.
Feldmann, L. J. (2001). Classroom civility is another of our instructor responsibilities. College Teaching, 49(4), 137–140.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Pearson.
Holtz, H. K., Rawl, S. M., & Draucker, C. (2018). Types of faculty incivility as viewed by students in bachelor of science in nursing programs. Nursing Education Perspectives, 39(2), 85–90. https://doi.org/10.1097/01.NEP.0000000000000287.
Hu, L. & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/1070551990954011
Hudgins, T., Layne, D., Kusch, C. E., & Lounsbury, K. (2022). An analysis of the perceptions of incivility in Higher Education. Journal of Academic Ethics Advanced Online Publication, 1–15. https://doi.org/10.1007/s10805-022-09448-2.
Itzkovich, Y., & Dolev, N. (2017). The relationships between emotional intelligence and perceptions of faculty incivility in higher education. Do men and women differ? Current Psychology, 36(4), 905–918. https://doi.org/10.1007/s12144-016-9479-2.
Johnson-Bailey, J. (2015). Academic incivility and bullying as a gendered and racialized phenomena. Adult Learning, 26(1), 42–47. https://doi.org/10.1177/1045159514558414.
Kinsley, P., & Goldrick-Rab, S. (2015). Making the grade: The academic side of college among financial aid recipients. In A. E. Stich & C. Freie (Eds.), The working classes and higher education: Inequality of access, opportunity, and outcome (pp. 87–109).
Knepp, K. A. F. (2012). Understanding student and faculty incivility in higher education. Journal of Effective Teaching, 12(1), 33–46. https://files.eric.ed.gov/fulltext/EJ1092106.pdf.
Kuhlenschmidt, S. L., & Layne, L. E. (1999). Strategies for dealing with difficult behavior. New Directions for Teaching and Learning, 1999(77), 45–57.
Lambie, G. W., Blount, A. J., & Mullen, P. R. (2017). Establishing content-oriented evidence for psychological assessments. Measurement and Evaluation in Counseling and Development, 50(4), 210–216. https://doi.org/10.1080/07481756.2017.1336930
Lapidot-Lefler, N., & Barak, A. (2012). Effects of anonymity, invisibility, and lack of eye contact on toxic online disinhibition. Computers in Human Behavior, 28(2), 434–443.
Lasiter, S., Marchiondo, L., & Marchiondo, K. (2012). Student narratives of faculty incivility. Nursing Outlook, 60(3), 121–126. https://doi.org/10.1016/j.outlook.2011.06.001.
Levine, P. (2010). Teaching and learning civility. New Directions for Higher Education, 2010 (152),11–17. https://doi.org/10.1002/he.407.
Luparell, S., & Frisbee, K. (2019). Do uncivil nursing students become uncivil nurses? A national survey of faculty. Nurse Education Perspectives, 40(6), 322–327. https://doi.org/10.1097/01.NEP.0000000000000491.
Maslow, A. H. (1954). Motivation and personality. Harper Brothers.
Mullen, C., Bettez, S., & Wilson, C. (2011). Fostering community life and human civility in academic departments through covenant practice. Educational Studies, 47(3), 280–305. https://doi.org/10.1080/00131946.2011.573608.
Mvududu, N. H., & Sink, C. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766.
Natarajan, J., Muliira, J. K., & van der Colff, J. (2017). Incidence and perception of nursing students’ academic incivility in Oman. BMC Nursing, 16(1), https://doi.org/10.1186/s12912-017-0213-7.
Nordstrom, C. R., Bartels, L. K., & Bucy, J. (2009). Predicting and curbing classroom incivility in higher education. College Student Journal, 43(1), 74–86.
Page, M. B., Bishop, K., & Etmanski, C. (2021). Community belonging and values-based leadership as the antidote to bullying and incivility. Societies, 11(2), 29. https://doi.org/10.3390/soc11020029.
Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (volume 2). Jossey-Bass.
Royce, A. (2000). A survey of academic incivility at Indiana University: Preliminary report. Center for Survey Research.
Spadafora, N., Farrell, A. H., Provenzano, D. A., Marini, Z. A., & Volk, A. A. (2016). Temperamental differences and classroom incivility: Exploring the role of individual differences. Canadian Journal of School Psychology, 33(1), 44–62. https://doi.org/10.1177/0829573516648946.
Sterner, W., Jackson-Cherry, L., & Doll, J. (2011). Faculty and student perceptions of incivility behaviors in the counselor education classroom. Journal of Counselor Practice, 6(2), 94–114. https://doi.org/10.22229/fsp824385.
Sue, D. W., Rivera, D. P., Capodilupo, C. M., Lin, A. I., & Torino, G. C. (2010). Racial dialogues and white trainee fears: Implications for education and training. Cultural Diversity & Ethnic Minority Psychology, 16(2), 206–213. https://doi.org/10.1037/a0016112.
Sue, D. W., Calle, C. Z., Mendez, N., Alsaidi, S., & Glaeser, E. (2021). Microintervention strategies: What you can do to disarm and dismantle individual and systemic racism and bias. Wiley.
Tinstman Jones, J. L., Campbell, L. O., Stickl Haugen, J., & Sutter, C. C. (In Press). Coping responses for academic incivility scale: Development and implication for college students. College Student Journal.
Wagner, B., Holland, C., Mainous, R., Matcham, W., Li, G., & Luiken, J. (2019). Differences in perceptions of incivility among disciplines in higher education. Nurse Educator, 44(5), 265–269. https://doi.org/10.1097/NNE.0000000000000611.
Watson, J. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50(4), 232–238. https://doi.org/10.1080/07481756.2017.1336931.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Campbell, L.O., Frawley, C. & Tinstman Jones, J.L. Incivility Indicators Instrument (i3): Development and Initial Validation. J Acad Ethics 21, 669–684 (2023). https://doi.org/10.1007/s10805-023-09477-5