Abstract
Perceived introversion mistreatment (PIM) has been discussed extensively in the popular press and online community, but has yet to be studied empirically, despite negative implications of PIM for employees and organizations. To assist fellow researchers who are interested in conducting research on this topic, the purpose of the present study was to develop and provide initial validation evidence for a measure of PIM. This study incorporated five independent samples, 974 participants, and multiwave (three months between administrations) and multisource data (social network individuals and work peers). The results indicate that the 10-item Perceived Introversion Mistreatment Scale (PIMS) is a reliable, unidimensional measure whose measurement is not biased by affect and is related to but discriminant from age, gender, and ethnic discrimination in addition to incivility, bullying, perceived organizational support, and leader member exchange. Further, PIM predicted CWB-O, symptoms of poor physical health, anxiety, depression, job satisfaction, and affective commitment above and beyond several mistreatment measures. Overall, the PIMS displays satisfactory psychometric properties and can offer valuable insight into workplace mistreatment beyond the topics currently studied in the mistreatment literature. Directions for future research and limitations are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data used in this study will be publically available at The Data Repository for University of Minnesota https://conservancy.umn.edu/handle/11299/166578
References
Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance and normative commitment to the organization. Journal of Occupational Psychology, 63(1), 1–18. https://doi.org/10.1111/j.2044-8325.1990.tb00506.x.
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103, 411–423. https://doi.org/10.1037/0033-2909.103.3.411.
Anderson, J. C., & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732–740. https://doi.org/10.1037/0021-9010.76.5.732.
Anderson, C., John, O. P., Keltner, D., & Kring, A. M. (2001). Who attains social status? Effects of personality and physical attractiveness in social groups. Journal of Personality and Social Psychology, 81, 116–132. https://doi.org/10.1037//0022-3514.81.1.116.
Andersson, L. M., & Pearson, C. M. (1999). Tit for tat? The spiraling effect of incivility in the workplace. Academy of Management Review, 24, 452–471. https://doi.org/10.5465/AMR.1999.2202131.
Azjen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control: From cognition to behavior (pp. 11–39). Springer-Verlag.
Barling, J. (1996). The prediction, experience, and consequences of workplace violence. In G. R. VandenBos & E. Q. Bulatao (Eds.), Violence on the job: Identifying risks and developing solutions (pp. 29–49). American Psychological Association.
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9–30. https://doi.org/10.1111/1468-2389.00160.
Bennett, R. J., & Robinson, S. L. (2000). Development of a measure of workplace deviance. Journal of Applied Psychology, 85, 349–360. https://doi.org/10.1037/0021-9010.85.3.349.
Bibby, C. L. (2008). Should I stay or should I leave? Perceptions of age discrimination, organizational justice, and employee attitudes on intentions to leave. Journal of Applied Management and Entrepreneurship, 13, 63–86.
Bowling, N. A., & Beehr, T. A. (2006). Workplace harassment from the victim’s perspective: A theoretical model and meta-analysis. Journal of Applied Psychology, 91, 998–1012. https://doi.org/10.1037/0021-9010.91.5.998.
Brayfield, A. H., & Rothe, H. F. (1951). An index of job satisfaction. Journal of Applied Psychology, 35, 307–311. https://doi.org/10.1037/h0055617.
Cain, S. (2013). Quiet: The power of introverts in a world that can’t stop talking. Random House Inc..
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5.
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–104. https://doi.org/10.1037/0021-9010.78.1.98.
Cortina, L. M., Magley, V. J., Williams, J. H., & Langhout, R. D. (2001). Incivility in the workplace: Incidence and impact. Journal of Occupational Health Psychology, 6, 64–80. https://doi.org/10.1037/1076-8998.6.1.64.
Coyne, I., Seigne, E., & Randall, P. (2000). Predicting workplace victim status from personality. European Journal of Work and Organizational Psychology, 9(3), 335–349. https://doi.org/10.1080/135943200417957.
Crandall, C. S., & Eshleman, A. (2003). A justification-suppression model of the expression and experience of prejudice. Psychological Bulletin, 129, 414–446. https://doi.org/10.1037/0033-2909.129.3.414.
Dipboye, R. L., & Halverson, S. K. (2004). Subtle (and not so subtle) discrimination in organizations. In R. W. Griffin & A. M. O’Leary-Kelly (Eds.), The dark side of organizational behavior (pp. 131–158). Jossey-Bass.
Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The mini-IPIP scales: Tiny-yet-effective measures of the Big Five factors of personality. Psychological Assessment, 18(2), 192–203. https://doi.org/10.1037/1040-3590.18.2.192.
Duffy, M. K., Ganster, D., & Pagon, M. (2002). Social undermining in the workplace. Academy of Management Journal, 45(2), 331–351. https://doi.org/10.2307/3069350.
Dumont, F. (2010). A history of personality psychology: Theory, science, and research from Hellenism to the twenty-first century. Cambridge University Press.
Einarsen, S. (1999). The nature and causes of bullying at work. International Journal of Manpower, 20, 16–27. https://doi.org/10.1108/01437729910268588.
Eisenberger, R., Armeli, S., Rexwinkel, B., Lynch, P. D., & Rhoades, L. (2001). Reciprocation of perceived organizational support. Journal of Applied Psychology, 86, 42–51. https://doi.org/10.1037/0021-9010.86.1.42.
Equal Employment Opportunity Commission. (2021). Discrimination by type. Retrieved from https://www.eeoc.gov/discrimination-type
Ferris, D. L., Brown, D. J., Berry, J. W., & Lian, H. (2008). The development and validation of the workplace ostracism scale. Journal of Applied Psychology, 93, 1348–1366. https://doi.org/10.1037/a0012743.
Fleeson, W. (2004). Moving personality beyond the person-situation debate: The challenge and the opportunity of within-person variability. Current Directions in Psychological Science, 13, 83–87 http://journals.sagepub.com/doi/abs/10.1111/j.0963-7214.2004.00280.x.
Foley, S., Hang-Yue, N., & Wong, A. (2005). Perceptions of discrimination and justice: Are there gender differences in outcomes? Group & Organization Management, 30, 421–450. https://doi.org/10.1177/1059601104265054.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39–50. https://doi.org/10.2307/3151312.
Fox, S., & Stallworth, L. E. (2005). Racial/ethnic bullying: Exploring links between bullying and racism in the US workplace. Journal of Vocational Behavior, 66, 438–456. https://doi.org/10.1016/j.jvb.2004.01.002.
Glasø, L., Matthiesen, S. B., Nielsen, M. B., & Einarsen, S. (2007). Do targets of workplace bullying portray a general victim personality profile? Scandinavian Journal of Psychology, 48(4), 313–319. https://doi.org/10.1111/j.1467-9450.2007.00554.x.
Goulder, A. W. (1960). The norm of reciprocity: A preliminary statement. American Sociological Review, 25, 161–178 https://www.jstor.org/stable/2092623.
Graen, G. B., & Uhl-Bien, M. (1995). Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective. The Leadership Quarterly, 6, 219–247. https://doi.org/10.1016/1048-9843(95)90036-5.
Harrison, D. A., & McLaughlin, M. E. (1991). Exploring the cognitive processes underlying responses to self-report instruments: Effects of item content on work attitude measures. Academy of Management Proceedings, 310-314. https://journals.aom.org/doi/pdf/10.5465/ambpp.1991.4977169
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191–205. https://doi.org/10.1177/1094428104263675.
Hershcovis, S. M., & Barling, J. (2010). Towards a multi-focal approach to workplace aggression: A meta-analytic review of outcomes from different perpetrators. Journal of Organizational Behavior, 31, 24–44. https://doi.org/10.1002/job.621.
Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology, 1(3), 333–342. https://doi.org/10.1111/j.1754-9434.2008.00058.x.
Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 2, 104–121. https://doi.org/10.1177/109442819800100106.
Hinkin, T. R., & Tracey, J. B. (1999). An analysis of variance approach to content validation. Organizational Research Methods, 2, 175–186. https://doi.org/10.1177/109442819922004.
Holden, R. R., & Jackson, D. N. (1979). Item subtlety and face validity in personality assessment. Journal of Consulting and Clinical Psychology, 47, 459–468. https://doi.org/10.1037/0022-006X.47.3.459.
Howard, M. C., Cogswell, J. E., & Smith, M. B. (2020). The antecedents and outcomes of workplace ostracism: A meta-analysis. Journal of Applied Psychology, 105, 577–596. https://doi.org/10.1037/apl0000453.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118.
Igou, E., Bless, H., & Schwarz, N. (2002). Making sense of standardized survey questions: The influence of reference periods and their repetition. Communication Monographs, 69(2), 179–187. https://doi.org/10.1080/714041712.
Jackon-Wright, Q. (2019). To promote inclusivity, stay away from personality assessments. The New York Times. https://www.nytimes.com/2019/08/22/smarter-living/inclusivity-diversity-personality-assessements-myers-briggs.html
Judge, T. A., Scott, B. A., & Ilies, R. (2006). Hostility, job attitudes, and workplace deviance: Test of a multilevel model. Journal of Applied Psychology, 91, 126–138. https://doi.org/10.1037/0021-9010.91.1.126.
Judge, T. A., Rodell, J. B., Klinger, R. L., Simon, L. S., & Crawford, E. R. (2013). Hierarchical representations of the five-factor model of personality in predicting job performance: Integrating three organizing frameworks with two theoretical perspectives. Journal of Applied Psychology, 98, 875–925. https://doi.org/10.1037/a0033901.
Kelloway, E. K., Gottlieb, B. H., & Barham, L. (1999). The source, nature, and direction of work and family conflict: A longitudinal investigation. Journal of Occupational Health Psychology, 4, 337–346. https://doi.org/10.1037/1076-899844337.
Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010). Method effects, measurement error, and substantive conclusions. Organizational Research Methods, 13, 435–455. https://doi.org/10.1177/2F1094428109352528.
Liden, R. C., & Maslyn, J. M. (1998). Multidimensionality of leader–member exchange: An empirical assessment through scale development. Journal of Management, 24, 43–72. https://doi.org/10.1016/S0149-2063(99)80053-1.
Linderbaum, B. A., & Levy, P. E. (2010). The development and validation of the feedback orientation scale (FOS). Journal of Management, 36, 1372–1405. https://doi.org/10.1177/0149206310373145.
Locke, E. A. (1976). The nature and causes of job satisfaction. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 1297–1343). Rand McNally.
Mackey, J. D., Frieder, R. E., Brees, J. R., & Martinko, M. J. (2017). Abusive supervision: A meta-analysis and empirical review. Journal of Management, 43, 1940–1965. https://doi.org/10.1177/0149206315573997.
Mackey, J. D., McAllister, C. P., Ellen III, B. P., & Carson, J. E. (2021). A meta-analysis of interpersonal and organizational workplace deviance research. Journal of Management, 47, 597–622. https://doi.org/10.1177/0149206319862612.
Matthews, R. A., & Ritter, K. (2016). A concise, content valid, gender invariant measure of workplace incivility. Journal of Occupational Health Psychology, 21, 352–365. https://doi.org/10.1037/ocp0000017.
McCord, M. A., & Joseph, D. A. (2020). A framework of negative responses to introversion at work. Personality and Individual Differences. Advance Online Publication. https://doi.org/10.1016/j.paid.2020.109944.
McCord, M. A., Joseph, D. L., Dhanani, L. Y., & Beus, J. M. (2018). A meta-analysis of sex and race differences in workplace mistreatment. Journal of Applied Psychology, 103, 137–163 https://doi.org/10.1037/apl0000250.
Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455. https://doi.org/10.1037/a0028085.
Nielsen, M. B., Glasø, L., & Einarsen, S. (2017). Exposure to workplace harassment and the five factor model of personality: A meta-analysis. Personality and Individual Differences, 104, 195–206. https://doi.org/10.1016/j.paid.2016.08.015.
Notelaers, G., Van der Heijden, B., Hoel, H., & Einarsen, E. (2019). Measuring bullying at work with the short-negative acts questionnaire: Identification of targets and criterion validity. Work & Stress, 33, 58–75. https://doi.org/10.1080/02678373.2018.1457736.
Organ, D. W. (1997). Organizational citizenship behavior: It's construct clean-up time. Human Performance, 10, 85–97. https://doi.org/10.1207/s15327043hup1002_2.
Peer, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon mechanical Turk. Behavior Research Methods, 46, 1023–1031. https://doi.org/10.3758/s13428-013-0434-y.
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569. https://doi.org/10.1146/annurev-psych-120710-100452.
Roehling, M. V., Roehling, P. V., & Wagstaff, M. F. (2013). Sex differences in perceived weight-based employment discrimination when weight discrimination is illegal. Employee Responsibilities and Rights Journal, 25(3), 159–176. https://doi.org/10.1007/s10672-013-9217-y.
Rothstein, M. G., & Goffin, R. D. (2006). The use of personality measures in personnel selection: What does current research support? Human Resource Management Review, 16, 155–180. https://doi.org/10.1016/j.hrmr.2006.03.004.
Rotundo, M., & Sackett, P. R. (2002). The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: A policy-capturing approach. Journal of Applied Psychology, 87, 66–80. https://doi.org/10.1037/0021-9010.87.1.66.
Sanchez, J. I., & Brock, P. (1996). Outcomes of perceived discrimination among Hispanic employees: Is diversity management a luxury or necessity? Academy of Management Journal, 39, 704–719. https://doi.org/10.2307/256660.
Schriesheim, C. A., Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993). Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. Journal of Management, 19, 385–417. https://doi.org/10.1016/0149-2063(93)90058-U.
Seo, Y., & Takekawa, S. (2006). Waves of globalization in East Asia: A historical perspective In J. Dator, D. Pratt, & Y. Seo (Eds.). Fairness, globalization, and public institutions: East Asia and beyond (pp. 219–249). University of Hawai’i Press.
Shaffer, J. A., & Postlethwaite, B. E. (2012). A matter of context: A meta-analytic investigation of the relative validity of contextualized and noncontextualized personality measures. Personnel Psychology, 65, 445–494. https://doi.org/10.1111/j.1744-6570.2012.01250.x.
Skarlicki, D. P., & Folger, R. (1997). Retaliation in the workplace: The roles of distributive, procedural, and interactional justice. Journal of Applied Psychology, 82, 434–443. https://doi.org/10.1037/0021-9010.82.3.434.
Snape, E., & Redman, T. (2003). Too old or too young? The impact of perceived age discrimination. Human Resource Management Journal, 13, 78–89. https://doi.org/10.1111/j.1748-8583.2003.tb00085.x.
Spector, P. E., & Jex, S. M. (1998). Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory. Journal of Occupational Health Psychology, 3, 356–367. https://doi.org/10.1037/1076-8998.3.4.356.
Spector, P. E., Bauer, J. A., & Fox, S. (2010). Measurement artifacts in the assessment of counterproductive work behavior and organizational citizenship behavior: Do we know what we think we know? Journal of Applied Psychology, 95, 781–790. https://doi.org/10.1037/a0019477.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn and Bacon.
Triandis, H. C. (1995). Individualism & collectivism. Westview Press.
Veit, C. T., & Ware, J. E. (1983). The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology, 51, 730–742. https://doi.org/10.1037/0022-006X.51.5.730.
Volpone, S. D., & Avery, D. R. (2013). It’s self defense: How perceived discrimination promotes employee withdrawal. Journal of Occupational Health Psychology, 18(4), 430–448 https://psycnet.apa.org/doi/10.1037/a0034016.
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063.
Westerberg, B., & McCord, M. A. (2021). The perceived controllability of the Big Five personality traits at work. Poster presented at the 36th annual meeting of the Society for Industrial and Organizational Psychology, Virtual.
Williams, L. J., & Anderson, S. E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management, 17, 601–617.
Williams, L. J., & Anderson, S. E. (1994). An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research. Journal of Applied Psychology, 79, 323–331. https://doi.org/10.1177/014920639101700305.
Wilmot, M. P., Wanberg, C. R., Kammeyer-Mueller, J. D., & Ones, D. S. (2019). Extraversion advantages at work: A quantitative review and synthesis of the meta-analytic evidence. Journal of Applied Psychology. Advance online publication. https://doi.org/10.1037/apl0000415.
Code Availability
Not applicable.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The author declares that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 25 kb)
Rights and permissions
About this article
Cite this article
McCord, M.A. Development and Validation of the Perceived Introversion Mistreatment Scale. Occup Health Sci 5, 437–471 (2021). https://doi.org/10.1007/s41542-021-00095-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41542-021-00095-4