Development and Validation of the Perceived Introversion Mistreatment Scale

McCord, Mallory A.

doi:10.1007/s41542-021-00095-4

Major Empirical Contribution
Published: 28 August 2021

Development and Validation of the Perceived Introversion Mistreatment Scale

Mallory A. McCord ORCID: orcid.org/0000-0002-5839-8520¹

Occupational Health Science volume 5, pages 437–471 (2021)Cite this article

316 Accesses
1 Citations
3 Altmetric
Metrics details

Abstract

Perceived introversion mistreatment (PIM) has been discussed extensively in the popular press and online community, but has yet to be studied empirically, despite negative implications of PIM for employees and organizations. To assist fellow researchers who are interested in conducting research on this topic, the purpose of the present study was to develop and provide initial validation evidence for a measure of PIM. This study incorporated five independent samples, 974 participants, and multiwave (three months between administrations) and multisource data (social network individuals and work peers). The results indicate that the 10-item Perceived Introversion Mistreatment Scale (PIMS) is a reliable, unidimensional measure whose measurement is not biased by affect and is related to but discriminant from age, gender, and ethnic discrimination in addition to incivility, bullying, perceived organizational support, and leader member exchange. Further, PIM predicted CWB-O, symptoms of poor physical health, anxiety, depression, job satisfaction, and affective commitment above and beyond several mistreatment measures. Overall, the PIMS displays satisfactory psychometric properties and can offer valuable insight into workplace mistreatment beyond the topics currently studied in the mistreatment literature. Directions for future research and limitations are discussed.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Data Availability

The data used in this study will be publically available at The Data Repository for University of Minnesota https://conservancy.umn.edu/handle/11299/166578

References

Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance and normative commitment to the organization. Journal of Occupational Psychology, 63(1), 1–18. https://doi.org/10.1111/j.2044-8325.1990.tb00506.x.
Article Google Scholar
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103, 411–423. https://doi.org/10.1037/0033-2909.103.3.411.
Article Google Scholar
Anderson, J. C., & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732–740. https://doi.org/10.1037/0021-9010.76.5.732.
Article Google Scholar
Anderson, C., John, O. P., Keltner, D., & Kring, A. M. (2001). Who attains social status? Effects of personality and physical attractiveness in social groups. Journal of Personality and Social Psychology, 81, 116–132. https://doi.org/10.1037//0022-3514.81.1.116.
Article PubMed Google Scholar
Andersson, L. M., & Pearson, C. M. (1999). Tit for tat? The spiraling effect of incivility in the workplace. Academy of Management Review, 24, 452–471. https://doi.org/10.5465/AMR.1999.2202131.
Article Google Scholar
Azjen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control: From cognition to behavior (pp. 11–39). Springer-Verlag.
Barling, J. (1996). The prediction, experience, and consequences of workplace violence. In G. R. VandenBos & E. Q. Bulatao (Eds.), Violence on the job: Identifying risks and developing solutions (pp. 29–49). American Psychological Association.
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9–30. https://doi.org/10.1111/1468-2389.00160.
Article Google Scholar
Bennett, R. J., & Robinson, S. L. (2000). Development of a measure of workplace deviance. Journal of Applied Psychology, 85, 349–360. https://doi.org/10.1037/0021-9010.85.3.349.
Article Google Scholar
Bibby, C. L. (2008). Should I stay or should I leave? Perceptions of age discrimination, organizational justice, and employee attitudes on intentions to leave. Journal of Applied Management and Entrepreneurship, 13, 63–86.
Google Scholar
Bowling, N. A., & Beehr, T. A. (2006). Workplace harassment from the victim’s perspective: A theoretical model and meta-analysis. Journal of Applied Psychology, 91, 998–1012. https://doi.org/10.1037/0021-9010.91.5.998.
Article Google Scholar
Brayfield, A. H., & Rothe, H. F. (1951). An index of job satisfaction. Journal of Applied Psychology, 35, 307–311. https://doi.org/10.1037/h0055617.
Article Google Scholar
Cain, S. (2013). Quiet: The power of introverts in a world that can’t stop talking. Random House Inc..
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5.
Article Google Scholar
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–104. https://doi.org/10.1037/0021-9010.78.1.98.
Article Google Scholar
Cortina, L. M., Magley, V. J., Williams, J. H., & Langhout, R. D. (2001). Incivility in the workplace: Incidence and impact. Journal of Occupational Health Psychology, 6, 64–80. https://doi.org/10.1037/1076-8998.6.1.64.
Article PubMed Google Scholar
Coyne, I., Seigne, E., & Randall, P. (2000). Predicting workplace victim status from personality. European Journal of Work and Organizational Psychology, 9(3), 335–349. https://doi.org/10.1080/135943200417957.
Article Google Scholar
Crandall, C. S., & Eshleman, A. (2003). A justification-suppression model of the expression and experience of prejudice. Psychological Bulletin, 129, 414–446. https://doi.org/10.1037/0033-2909.129.3.414.
Article PubMed Google Scholar
Dipboye, R. L., & Halverson, S. K. (2004). Subtle (and not so subtle) discrimination in organizations. In R. W. Griffin & A. M. O’Leary-Kelly (Eds.), The dark side of organizational behavior (pp. 131–158). Jossey-Bass.
Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The mini-IPIP scales: Tiny-yet-effective measures of the Big Five factors of personality. Psychological Assessment, 18(2), 192–203. https://doi.org/10.1037/1040-3590.18.2.192.
Article PubMed Google Scholar
Duffy, M. K., Ganster, D., & Pagon, M. (2002). Social undermining in the workplace. Academy of Management Journal, 45(2), 331–351. https://doi.org/10.2307/3069350.
Article Google Scholar
Dumont, F. (2010). A history of personality psychology: Theory, science, and research from Hellenism to the twenty-first century. Cambridge University Press.
Einarsen, S. (1999). The nature and causes of bullying at work. International Journal of Manpower, 20, 16–27. https://doi.org/10.1108/01437729910268588.
Article Google Scholar
Eisenberger, R., Armeli, S., Rexwinkel, B., Lynch, P. D., & Rhoades, L. (2001). Reciprocation of perceived organizational support. Journal of Applied Psychology, 86, 42–51. https://doi.org/10.1037/0021-9010.86.1.42.
Article Google Scholar
Equal Employment Opportunity Commission. (2021). Discrimination by type. Retrieved from https://www.eeoc.gov/discrimination-type
Ferris, D. L., Brown, D. J., Berry, J. W., & Lian, H. (2008). The development and validation of the workplace ostracism scale. Journal of Applied Psychology, 93, 1348–1366. https://doi.org/10.1037/a0012743.
Article Google Scholar
Fleeson, W. (2004). Moving personality beyond the person-situation debate: The challenge and the opportunity of within-person variability. Current Directions in Psychological Science, 13, 83–87 http://journals.sagepub.com/doi/abs/10.1111/j.0963-7214.2004.00280.x.
Article Google Scholar
Foley, S., Hang-Yue, N., & Wong, A. (2005). Perceptions of discrimination and justice: Are there gender differences in outcomes? Group & Organization Management, 30, 421–450. https://doi.org/10.1177/1059601104265054.
Article Google Scholar
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39–50. https://doi.org/10.2307/3151312.
Article Google Scholar
Fox, S., & Stallworth, L. E. (2005). Racial/ethnic bullying: Exploring links between bullying and racism in the US workplace. Journal of Vocational Behavior, 66, 438–456. https://doi.org/10.1016/j.jvb.2004.01.002.
Article Google Scholar
Glasø, L., Matthiesen, S. B., Nielsen, M. B., & Einarsen, S. (2007). Do targets of workplace bullying portray a general victim personality profile? Scandinavian Journal of Psychology, 48(4), 313–319. https://doi.org/10.1111/j.1467-9450.2007.00554.x.
Article PubMed Google Scholar
Goulder, A. W. (1960). The norm of reciprocity: A preliminary statement. American Sociological Review, 25, 161–178 https://www.jstor.org/stable/2092623.
Article Google Scholar
Graen, G. B., & Uhl-Bien, M. (1995). Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective. The Leadership Quarterly, 6, 219–247. https://doi.org/10.1016/1048-9843(95)90036-5.
Article Google Scholar
Harrison, D. A., & McLaughlin, M. E. (1991). Exploring the cognitive processes underlying responses to self-report instruments: Effects of item content on work attitude measures. Academy of Management Proceedings, 310-314. https://journals.aom.org/doi/pdf/10.5465/ambpp.1991.4977169
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191–205. https://doi.org/10.1177/1094428104263675.
Article Google Scholar
Hershcovis, S. M., & Barling, J. (2010). Towards a multi-focal approach to workplace aggression: A meta-analytic review of outcomes from different perpetrators. Journal of Organizational Behavior, 31, 24–44. https://doi.org/10.1002/job.621.
Article Google Scholar
Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology, 1(3), 333–342. https://doi.org/10.1111/j.1754-9434.2008.00058.x.
Article Google Scholar
Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 2, 104–121. https://doi.org/10.1177/109442819800100106.
Article Google Scholar
Hinkin, T. R., & Tracey, J. B. (1999). An analysis of variance approach to content validation. Organizational Research Methods, 2, 175–186. https://doi.org/10.1177/109442819922004.
Article Google Scholar
Holden, R. R., & Jackson, D. N. (1979). Item subtlety and face validity in personality assessment. Journal of Consulting and Clinical Psychology, 47, 459–468. https://doi.org/10.1037/0022-006X.47.3.459.
Article Google Scholar
Howard, M. C., Cogswell, J. E., & Smith, M. B. (2020). The antecedents and outcomes of workplace ostracism: A meta-analysis. Journal of Applied Psychology, 105, 577–596. https://doi.org/10.1037/apl0000453.
Article Google Scholar
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118.
Article Google Scholar
Igou, E., Bless, H., & Schwarz, N. (2002). Making sense of standardized survey questions: The influence of reference periods and their repetition. Communication Monographs, 69(2), 179–187. https://doi.org/10.1080/714041712.
Article Google Scholar
Jackon-Wright, Q. (2019). To promote inclusivity, stay away from personality assessments. The New York Times. https://www.nytimes.com/2019/08/22/smarter-living/inclusivity-diversity-personality-assessements-myers-briggs.html
Judge, T. A., Scott, B. A., & Ilies, R. (2006). Hostility, job attitudes, and workplace deviance: Test of a multilevel model. Journal of Applied Psychology, 91, 126–138. https://doi.org/10.1037/0021-9010.91.1.126.
Article Google Scholar
Judge, T. A., Rodell, J. B., Klinger, R. L., Simon, L. S., & Crawford, E. R. (2013). Hierarchical representations of the five-factor model of personality in predicting job performance: Integrating three organizing frameworks with two theoretical perspectives. Journal of Applied Psychology, 98, 875–925. https://doi.org/10.1037/a0033901.
Kelloway, E. K., Gottlieb, B. H., & Barham, L. (1999). The source, nature, and direction of work and family conflict: A longitudinal investigation. Journal of Occupational Health Psychology, 4, 337–346. https://doi.org/10.1037/1076-899844337.
Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010). Method effects, measurement error, and substantive conclusions. Organizational Research Methods, 13, 435–455. https://doi.org/10.1177/2F1094428109352528.
Liden, R. C., & Maslyn, J. M. (1998). Multidimensionality of leader–member exchange: An empirical assessment through scale development. Journal of Management, 24, 43–72. https://doi.org/10.1016/S0149-2063(99)80053-1.
Article Google Scholar
Linderbaum, B. A., & Levy, P. E. (2010). The development and validation of the feedback orientation scale (FOS). Journal of Management, 36, 1372–1405. https://doi.org/10.1177/0149206310373145.
Article Google Scholar
Locke, E. A. (1976). The nature and causes of job satisfaction. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 1297–1343). Rand McNally.
Mackey, J. D., Frieder, R. E., Brees, J. R., & Martinko, M. J. (2017). Abusive supervision: A meta-analysis and empirical review. Journal of Management, 43, 1940–1965. https://doi.org/10.1177/0149206315573997.
Mackey, J. D., McAllister, C. P., Ellen III, B. P., & Carson, J. E. (2021). A meta-analysis of interpersonal and organizational workplace deviance research. Journal of Management, 47, 597–622. https://doi.org/10.1177/0149206319862612.
Matthews, R. A., & Ritter, K. (2016). A concise, content valid, gender invariant measure of workplace incivility. Journal of Occupational Health Psychology, 21, 352–365. https://doi.org/10.1037/ocp0000017.
Article PubMed Google Scholar
McCord, M. A., & Joseph, D. A. (2020). A framework of negative responses to introversion at work. Personality and Individual Differences. Advance Online Publication. https://doi.org/10.1016/j.paid.2020.109944.
McCord, M. A., Joseph, D. L., Dhanani, L. Y., & Beus, J. M. (2018). A meta-analysis of sex and race differences in workplace mistreatment. Journal of Applied Psychology, 103, 137–163 https://doi.org/10.1037/apl0000250.
Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455. https://doi.org/10.1037/a0028085.
Article PubMed Google Scholar
Nielsen, M. B., Glasø, L., & Einarsen, S. (2017). Exposure to workplace harassment and the five factor model of personality: A meta-analysis. Personality and Individual Differences, 104, 195–206. https://doi.org/10.1016/j.paid.2016.08.015.
Article Google Scholar
Notelaers, G., Van der Heijden, B., Hoel, H., & Einarsen, E. (2019). Measuring bullying at work with the short-negative acts questionnaire: Identification of targets and criterion validity. Work & Stress, 33, 58–75. https://doi.org/10.1080/02678373.2018.1457736.
Article Google Scholar
Organ, D. W. (1997). Organizational citizenship behavior: It's construct clean-up time. Human Performance, 10, 85–97. https://doi.org/10.1207/s15327043hup1002_2.
Article Google Scholar
Peer, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon mechanical Turk. Behavior Research Methods, 46, 1023–1031. https://doi.org/10.3758/s13428-013-0434-y.
Article PubMed Google Scholar
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569. https://doi.org/10.1146/annurev-psych-120710-100452.
Article PubMed Google Scholar
Roehling, M. V., Roehling, P. V., & Wagstaff, M. F. (2013). Sex differences in perceived weight-based employment discrimination when weight discrimination is illegal. Employee Responsibilities and Rights Journal, 25(3), 159–176. https://doi.org/10.1007/s10672-013-9217-y.
Article Google Scholar
Rothstein, M. G., & Goffin, R. D. (2006). The use of personality measures in personnel selection: What does current research support? Human Resource Management Review, 16, 155–180. https://doi.org/10.1016/j.hrmr.2006.03.004.
Article Google Scholar
Rotundo, M., & Sackett, P. R. (2002). The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: A policy-capturing approach. Journal of Applied Psychology, 87, 66–80. https://doi.org/10.1037/0021-9010.87.1.66.
Article Google Scholar
Sanchez, J. I., & Brock, P. (1996). Outcomes of perceived discrimination among Hispanic employees: Is diversity management a luxury or necessity? Academy of Management Journal, 39, 704–719. https://doi.org/10.2307/256660.
Article Google Scholar
Schriesheim, C. A., Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993). Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. Journal of Management, 19, 385–417. https://doi.org/10.1016/0149-2063(93)90058-U.
Article Google Scholar
Seo, Y., & Takekawa, S. (2006). Waves of globalization in East Asia: A historical perspective In J. Dator, D. Pratt, & Y. Seo (Eds.). Fairness, globalization, and public institutions: East Asia and beyond (pp. 219–249). University of Hawai’i Press.
Shaffer, J. A., & Postlethwaite, B. E. (2012). A matter of context: A meta-analytic investigation of the relative validity of contextualized and noncontextualized personality measures. Personnel Psychology, 65, 445–494. https://doi.org/10.1111/j.1744-6570.2012.01250.x.
Article Google Scholar
Skarlicki, D. P., & Folger, R. (1997). Retaliation in the workplace: The roles of distributive, procedural, and interactional justice. Journal of Applied Psychology, 82, 434–443. https://doi.org/10.1037/0021-9010.82.3.434.
Article Google Scholar
Snape, E., & Redman, T. (2003). Too old or too young? The impact of perceived age discrimination. Human Resource Management Journal, 13, 78–89. https://doi.org/10.1111/j.1748-8583.2003.tb00085.x.
Article Google Scholar
Spector, P. E., & Jex, S. M. (1998). Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory. Journal of Occupational Health Psychology, 3, 356–367. https://doi.org/10.1037/1076-8998.3.4.356.
Article PubMed Google Scholar
Spector, P. E., Bauer, J. A., & Fox, S. (2010). Measurement artifacts in the assessment of counterproductive work behavior and organizational citizenship behavior: Do we know what we think we know? Journal of Applied Psychology, 95, 781–790. https://doi.org/10.1037/a0019477.
Article Google Scholar
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn and Bacon.
Triandis, H. C. (1995). Individualism & collectivism. Westview Press.
Veit, C. T., & Ware, J. E. (1983). The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology, 51, 730–742. https://doi.org/10.1037/0022-006X.51.5.730.
Article PubMed Google Scholar
Volpone, S. D., & Avery, D. R. (2013). It’s self defense: How perceived discrimination promotes employee withdrawal. Journal of Occupational Health Psychology, 18(4), 430–448 https://psycnet.apa.org/doi/10.1037/a0034016.
Article Google Scholar
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063.
Article Google Scholar
Westerberg, B., & McCord, M. A. (2021). The perceived controllability of the Big Five personality traits at work. Poster presented at the 36th annual meeting of the Society for Industrial and Organizational Psychology, Virtual.
Williams, L. J., & Anderson, S. E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management, 17, 601–617.
Article Google Scholar
Williams, L. J., & Anderson, S. E. (1994). An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research. Journal of Applied Psychology, 79, 323–331. https://doi.org/10.1177/014920639101700305.
Article Google Scholar
Wilmot, M. P., Wanberg, C. R., Kammeyer-Mueller, J. D., & Ones, D. S. (2019). Extraversion advantages at work: A quantitative review and synthesis of the meta-analytic evidence. Journal of Applied Psychology. Advance online publication. https://doi.org/10.1037/apl0000415.

Download references

Code Availability

Not applicable.

Author information

Authors and Affiliations

Department of Psychology, University of Minnesota Duluth, 320 Bohannon Hall, 127 Ordean Court, Duluth, MN, 55812, USA
Mallory A. McCord

Authors

Mallory A. McCord
View author publications
You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mallory A. McCord.

Ethics declarations

Conflict of Interest

The author declares that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

ESM 1

(DOCX 25 kb)

Rights and permissions

Reprints and Permissions

About this article

Cite this article

McCord, M.A. Development and Validation of the Perceived Introversion Mistreatment Scale. Occup Health Sci 5, 437–471 (2021). https://doi.org/10.1007/s41542-021-00095-4

Download citation

Received: 16 September 2020
Revised: 03 July 2021
Accepted: 07 July 2021
Published: 28 August 2021
Issue Date: December 2021
DOI: https://doi.org/10.1007/s41542-021-00095-4

Keywords

Measure development
Introversion
Workplace mistreatment
Measure validation
Discrimination