Skip to main content
SpringerLink
Log in

Incivility Indicators Instrument (i3): Development and Initial Validation

Journal of Academic Ethics Aims and scope Submit manuscript

Cite this article

Abstract

Academic incivility can create divisiveness and affect learners’ sustainability towards degree attainment. Therefore, there is a need to empirically assess learner views on what constitutes academic incivility in higher education. To fill this gap, we developed the Incivility Indicators Instrument (i3), a multifaceted scale that measures the extent to which students view cumulative behaviors and dynamics as instances of academic incivility. To examine the reliability and factor structure of the i3, we conducted a two-part study with two samples of adults in the United States who were enrolled in higher education programs. In study 1 (N = 342), we conducted an exploratory factor analysis (EFA) and found the initial three-factor structure. In study 2, we administered the instrument to a validating sample (N = 510) and examined the stability of the three-factor model and scores through confirmatory factor analysis (CFA). In this study, we describe the results of the study, provide implications, and discuss future directions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Alexander-Snow, M. (2004). Dynamics of gender, ethnicity, and race in understanding classroom incivility. New Directions for Teaching and Learning, 2004(99), 21–31. https://doi.org/10.1002/tl.155

  • Alt, D., & Itzkovich, Y. (2019). The connection between perceived constructivist learning environments and faculty uncivil authoritarian behaviors. Higher Education, 77(3), 437–454. https://doi.org/10.1007/s10734-018-0281-y.

    Article  Google Scholar 

  • Altmiller, G. (2012). Student perceptions of incivility in nursing education: Implications for educators. Nursing Education Perspectives, 33(1), 15–20. https://doi.org/10.5480/1536-5026-33.1.15.

    Article  Google Scholar 

  • Ausbrooks, A. R., Jones, S. H., & Tijerina, M. S. (2ntel011). Now you see it, now you don’t: Faculty and student perceptions of classroom incivility in a social work program. Advances in Social Work, 12(2), 255–275. https://doi.org/10.18060/1932

  • Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. The reviewer’s guide to quantitative methods in the social sciences (pp. 98–122). Routledge.

  • Bjorklund, W. L., & Rehling, D. L. (2010). Student perceptions of classroom incivility. College Teaching, 58(1), 15–18. https://doi.org/10.1080/87567550903252801.

    Article  Google Scholar 

  • Boice, R. (1996). Classroom incivilities. Research in Higher Education, 37(1), 453–486.

    Article  Google Scholar 

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford publications.

  • Buckley, T. R., & Foldy, E. G. (2010). A pedagogical model for increasing race-related multicultural counseling competency. The Counseling Psychologist, 38(5), 691–713. https://doi.org/10.1177/0011000009360917.

    Article  Google Scholar 

  • Burke, L. A., Karl, K., Peluchette, J., & Evans, W. R. (2014). Student incivility: A domain review. Journal of Management Education, 38(2), 160–191. https://doi.org/10.1177/1052562913488112.

    Article  Google Scholar 

  • Campbell, L. O., Frawley, C., & Tinstman Jones, J. (2023). Incivility Indicators Instrument (i3). Unpublished Instrument.

  • Campbell, L. O., Tinstman Jones, J. L., & Lambie, G. W. (2020). Online academic incivility among adult learners. Adult Learning, 31(3), 109–119. https://doi.org/10.1177/1045159520916489

  • Campbell, L. O., Tinstman Jones, J. L., Sutter, C. C., & Stickl-Haugen, J. (2022). Academic Incivility Scale. Unpublished Instrument.

  • Cho, E., & Kim, S. (2015). Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods, 18(2), 207–230.

    Article  Google Scholar 

  • Clark, C. M., & Springer, P. J. (2007). Incivility in nursing education: A descriptive study of definitions and prevalence. Journal of Nursing Education, 46(1), https://doi.org/10.3928/01484834-20070101-03.

  • Clark, C. M., Farnsworth, J., & Landrum, R. E. (2009). Development and description of the incivility in nursing education (INE) survey. Journal of Theory Construction & Testing, 13(1), 7–15.

    Google Scholar 

  • Clark, C. M., Werth, L., & Ahten, S. (2012b). Cyber-bullying and incivility in the online learning environment, part 1: Addressing faculty and student perceptions. Nurse Educator, 37(4), 150–156. https://doi.org/10.1097/NNE.0b013e31825a87e5.

    Article  Google Scholar 

  • Clark, C. M., Barbosa-Leiker, C., Gill, L. M., & Nguyen, D. (2015). Revision and psychometric testing of the incivility in nursing education (INE) survey: Introducing the INE-R. Journal of Nursing Education, 54(6), 306–315. https://doi.org/10.3928/01484834-20150515-01.

    Article  Google Scholar 

  • DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Sage.

  • Dyer, R., Green, R., Pitts, M., & Millward, G. (1995). What’s the flaming problem? Or computer mediated communication–deindividuating or disinhibiting? In M. A. R. Kirby, A. J. Dix, & J. E. Finlay (Eds.), People and computers X (pp. 289–301). Cambridge University Press.

  • Eka, N. G. A., Chambers, D., & Narayanasamy, A. (2016). Perceived uncivil behavior in indonesian nursing education. Nurse Education in Practice, 20, 99–108.

    Article  Google Scholar 

  • Farrell, A. H., Provenzano, D. A., Spadafora, N., Marini, Z. A., & Volk, A. A. (2016). Measuring adolescent attitudes toward classroom incivility: Exploring differences between intentional and unintentional incivility. Journal of Psychoeducational Assessment, 34(6), 577–588. https://doi.org/10.1177/0734282915623446.

    Article  Google Scholar 

  • Feldmann, L. J. (2001). Classroom civility is another of our instructor responsibilities. College Teaching, 49(4), 137–140.

    Article  Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Pearson.

  • Holtz, H. K., Rawl, S. M., & Draucker, C. (2018). Types of faculty incivility as viewed by students in bachelor of science in nursing programs. Nursing Education Perspectives, 39(2), 85–90. https://doi.org/10.1097/01.NEP.0000000000000287.

    Article  Google Scholar 

  • Hu, L. & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/1070551990954011

  • Hudgins, T., Layne, D., Kusch, C. E., & Lounsbury, K. (2022). An analysis of the perceptions of incivility in Higher Education. Journal of Academic Ethics Advanced Online Publication, 1–15. https://doi.org/10.1007/s10805-022-09448-2.

  • Itzkovich, Y., & Dolev, N. (2017). The relationships between emotional intelligence and perceptions of faculty incivility in higher education. Do men and women differ? Current Psychology, 36(4), 905–918. https://doi.org/10.1007/s12144-016-9479-2.

    Article  Google Scholar 

  • Johnson-Bailey, J. (2015). Academic incivility and bullying as a gendered and racialized phenomena. Adult Learning, 26(1), 42–47. https://doi.org/10.1177/1045159514558414.

    Article  Google Scholar 

  • Kinsley, P., & Goldrick-Rab, S. (2015). Making the grade: The academic side of college among financial aid recipients. In A. E. Stich & C. Freie (Eds.), The working classes and higher education: Inequality of access, opportunity, and outcome (pp. 87–109).

  • Knepp, K. A. F. (2012). Understanding student and faculty incivility in higher education. Journal of Effective Teaching, 12(1), 33–46. https://files.eric.ed.gov/fulltext/EJ1092106.pdf.

    Google Scholar 

  • Kuhlenschmidt, S. L., & Layne, L. E. (1999). Strategies for dealing with difficult behavior. New Directions for Teaching and Learning, 1999(77), 45–57.

  • Lambie, G. W., Blount, A. J., & Mullen, P. R. (2017). Establishing content-oriented evidence for psychological assessments. Measurement and Evaluation in Counseling and Development, 50(4), 210–216. https://doi.org/10.1080/07481756.2017.1336930

  • Lapidot-Lefler, N., & Barak, A. (2012). Effects of anonymity, invisibility, and lack of eye contact on toxic online disinhibition. Computers in Human Behavior, 28(2), 434–443.

    Article  Google Scholar 

  • Lasiter, S., Marchiondo, L., & Marchiondo, K. (2012). Student narratives of faculty incivility. Nursing Outlook, 60(3), 121–126. https://doi.org/10.1016/j.outlook.2011.06.001.

    Article  Google Scholar 

  • Levine, P. (2010). Teaching and learning civility. New Directions for Higher Education, 2010 (152),11–17. https://doi.org/10.1002/he.407.

  • Luparell, S., & Frisbee, K. (2019). Do uncivil nursing students become uncivil nurses? A national survey of faculty. Nurse Education Perspectives, 40(6), 322–327. https://doi.org/10.1097/01.NEP.0000000000000491.

    Article  Google Scholar 

  • Maslow, A. H. (1954). Motivation and personality. Harper Brothers.

  • Mullen, C., Bettez, S., & Wilson, C. (2011). Fostering community life and human civility in academic departments through covenant practice. Educational Studies, 47(3), 280–305. https://doi.org/10.1080/00131946.2011.573608.

    Article  Google Scholar 

  • Mvududu, N. H., & Sink, C. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766.

    Article  Google Scholar 

  • Natarajan, J., Muliira, J. K., & van der Colff, J. (2017). Incidence and perception of nursing students’ academic incivility in Oman. BMC Nursing, 16(1), https://doi.org/10.1186/s12912-017-0213-7.

  • Nordstrom, C. R., Bartels, L. K., & Bucy, J. (2009). Predicting and curbing classroom incivility in higher education. College Student Journal, 43(1), 74–86.

    Google Scholar 

  • Page, M. B., Bishop, K., & Etmanski, C. (2021). Community belonging and values-based leadership as the antidote to bullying and incivility. Societies, 11(2), 29. https://doi.org/10.3390/soc11020029.

    Article  Google Scholar 

  • Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (volume 2). Jossey-Bass.

  • Royce, A. (2000). A survey of academic incivility at Indiana University: Preliminary report. Center for Survey Research.

  • Spadafora, N., Farrell, A. H., Provenzano, D. A., Marini, Z. A., & Volk, A. A. (2016). Temperamental differences and classroom incivility: Exploring the role of individual differences. Canadian Journal of School Psychology, 33(1), 44–62. https://doi.org/10.1177/0829573516648946.

    Article  Google Scholar 

  • Sterner, W., Jackson-Cherry, L., & Doll, J. (2011). Faculty and student perceptions of incivility behaviors in the counselor education classroom. Journal of Counselor Practice, 6(2), 94–114. https://doi.org/10.22229/fsp824385.

    Article  Google Scholar 

  • Sue, D. W., Rivera, D. P., Capodilupo, C. M., Lin, A. I., & Torino, G. C. (2010). Racial dialogues and white trainee fears: Implications for education and training. Cultural Diversity & Ethnic Minority Psychology, 16(2), 206–213. https://doi.org/10.1037/a0016112.

    Article  Google Scholar 

  • Sue, D. W., Calle, C. Z., Mendez, N., Alsaidi, S., & Glaeser, E. (2021). Microintervention strategies: What you can do to disarm and dismantle individual and systemic racism and bias. Wiley.

  • Tinstman Jones, J. L., Campbell, L. O., Stickl Haugen, J., & Sutter, C. C. (In Press). Coping responses for academic incivility scale: Development and implication for college students. College Student Journal.

  • Wagner, B., Holland, C., Mainous, R., Matcham, W., Li, G., & Luiken, J. (2019). Differences in perceptions of incivility among disciplines in higher education. Nurse Educator, 44(5), 265–269. https://doi.org/10.1097/NNE.0000000000000611.

    Article  Google Scholar 

  • Watson, J. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50(4), 232–238. https://doi.org/10.1080/07481756.2017.1336931.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Learning Sciences and Educational Research, University of Central Florida, 4000 University Blvd, Orlando, FL, 32816-1650, USA

    Laurie O. Campbell

  2. Department of Counselor Education and School Psychology, University of Central Florida, 4000 University Blvd, Orlando, FL, 32816-1650, USA

    Caitlin Frawley

  3. Department of Counseling, Nova Southeastern, 3301 College Avenue, Orlando, FL, 33314, USA

    Jessica L. Tinstman Jones

Authors
  1. Laurie O. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Caitlin Frawley
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jessica L. Tinstman Jones
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Laurie O. Campbell.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Campbell, L.O., Frawley, C. & Tinstman Jones, J.L. Incivility Indicators Instrument (i3): Development and Initial Validation. J Acad Ethics 21, 669–684 (2023). https://doi.org/10.1007/s10805-023-09477-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10805-023-09477-5

Keywords

search

Navigation