A significant proportion of voluntary employee turnover includes people who frequently move from job to job, known as job-hopping. Our work shows that language used in responding to interview questions on past behaviour and situational judgement is predictive of job-hopping motive as measured by the Job-Hopping Motives (JHM) Scale. The study is based on responses from over 45,000 job applicants who completed an online chat interview and self-rated themselves on JHM Scale. Five different methods of text representation were evaluated, namely four open-vocabulary approaches (TF-IDF, LDA, Glove word embeddings and Doc2Vec document embeddings) and one closed-vocabulary approach (LIWC). The Glove embeddings provided the best results with a correlation of r = 0.35 between sequences of words used and the JHM Scale. Further analysis also showed a correlation of r = 0.25 between language-based job-hopping motive and the personality trait Openness to experience and a correlation of r = − 0.09 with the trait Agreeableness.
This is a preview of subscription content,to check access.
Access this article
Lam, T., Lo, A., & Chan, J. (2002). New employees’ turnover intentions and organizational commitment in the Hong Kong hotel industry. Journal of Hospitality & Tourism Research, 26(3), 217–234. https://doi.org/10.1177/1096348002026003002.
Chatzky, J. (2018). Job-hopping is on the rise. Should you consider switching roles to make more money?” NBCNews. [Online]. https://www.nbcnews.com/better/business/job-hopping-rise-should-you-consider-switching-roles-make-more-ncna868641. Accessed 8 Apr 2020.
Lake, C. J., Highhouse, S., & Shrift, A. G. (2018). Validation of the job-hopping motives scale. Journal of Career Assessment, 26(3), 531–548. https://doi.org/10.1177/1069072717722765.
Ghiselli, E. (1974). Some perspectives for industrial psychology. American Psychologist, 29, 80–87. (01).
Barton, K., & Cattell, R. B. (1972). Personality factors related to job promotion and turnover. Journal of Counseling Psychology, 19(5), 430–435.
Jenkins, J. M. (1993). “Self-monitoring and turnover: The impact of personality on intent to leave. Journal of Organizational Behavior, 14(1), 83–91. https://doi.org/10.1002/job.4030140108.
Salgado, J. F. (2002). The big five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment, 10(1), 117–125. https://doi.org/10.1111/1468-2389.00198.
Timmerman, T. A. (2006). Predicting turnover with broad and narrow personality traits. International Journal of Selection and Assessment, 14(4), 392–399. https://doi.org/10.1111/j.1468-2389.2006.00361.x.
Zimmerman, R. D. (2008). Understanding the impact of personality traits on individuals’ turnover decisions: A meta-analytic path model. Personnel Psychology, 61(2), 309–348. https://doi.org/10.1111/j.1744-6570.2008.00115.x.
Bertrand, M., & Mullainathan, S. (2003). Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. National Bureau of Economic Research, Working Paper 9873, July. [Online]. http://www.nber.org/papers/w9873. Accessed 8 Apr 2020.
Kang, S. K., DeCelles, K. A., Tilcsik, A., & Jun, S. (2016). Whitened résumés: Race and self-presentation in the labor market. Administrative Science Quarterly, 61(3), 469–502. https://doi.org/10.1177/0001839216639577.
Golbeck, J., Robles, C., Edmondson, M., & Turner, K. (2011). Predicting personality from twitter. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing (pp. 149–156)
Sumner, C., Byers, A., Boochever, R., & Park, G. J. (2012). Predicting dark triad personality traits from twitter usage and a linguistic analysis of tweets. In 2012 11th international conference on machine learning and applications (Vol. 2, pp. 386–393)
Xue, D., Hong, Z., Guo, S., Gao, L., Wu, L., Zheng, J., et al. (2017). Personality recognition on social media with label distribution learning. IEEE Access, 5, 13478–13488.
Tadesse, M. M., Lin, H., Xu, B., & Yang, L. (2018). Personality predictions based on user behavior on the facebook social media platform. IEEE Access, 6, 61959–61969.
Wang, Z., Wu, C., Zheng, K., Niu, X., & Wang, X. (2019). SMOTETomek-based resampling for personality recognition. IEEE Access, 7, 129678–129689.
Iacobelli, F., Gill, A. J., Nowson, S., & Oberlander, J. (2011). Large scale personality classification of bloggers. In S. D’Mello, A. Graesser, B. Schuller, & J.-C. Martin (Eds.) Affective computing and intelligent interaction, series. Lecture notes in computer science (pp. 568–577). Springer
Jayaratne, M., & Jayatilleke, B. (2020). Predicting personality using answers to open-ended interview questions. IEEE Access, 8, 115345–115355.
Neuman, Y., & Cohen, Y. (2014). A vectorial semantics approach to personality assessment. Nature Scientific Reports, 4(1), 1–6.
Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241–293. https://doi.org/10.1111/peps.12052.
Mcdaniel, M., Whetzel, D., Schmidt, F., & Maurer, S. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599–616. (08).
P. Begley, & L. Dunne, Turnover and retention research report, 2018. [Online]. https://www.ahri.com.au/media/1222/turnover-and-retention-report_final.pdf. Accessed 1 Mar 2020.
Cho, S., Woods, R. H., Jang, S., & Erdem, M. (2006). Measuring the impact of human resource management practices on hospitality firms’ performances. International Journal of Hospitality Management, 25(2), 262–277.
Mahan, T., Nelms, D., & Bearden, C. (2018). Retention report: Truth & trends in turnover. [Online]. http://info.workinstitute.com/2018retentionreport. Accessed 1 Mar 2020.
Park, T.-Y., & Shaw, J. D. (2013). Turnover rates and organizational performance: A meta-analysis. Journal of Applied Psychology, 98(2), 268–309.
Harman, W. S., Lee, T. W., Mitchell, T. R., Felps, W., & Owens, B. P. (2007). The psychology of voluntary employee turnover. Current Directions in Psychological Science, 16(1), 51–54. https://doi.org/10.1111/j.1467-8721.2007.00474.x.
Ariyabuddhiphongs, V., & Marican, S. (2015). Big five personality traits and turnover intention among Thai hotel employees. International Journal of Hospitality & Tourism Administration, 16(4), 355–374. https://doi.org/10.1080/15256480.2015.1090257.
Hong, L. C., & Kaur, S. (2008). A relationship between organizational climate, employee personality and intention to leave. International Review of Business Research Papers, 4(3), 1–10.
Sarwar, A., Hameed, S., & Aftab, H. (2013). Study to explore the impact of personality traits on employee turnover in public and private sector. Middle-East Journal of Scientific Research, 16(9), 1249–1254.
Woo, S. E. (2011). A study of Ghiselli’s hobo syndrome. Journal of Vocational Behavior, 79, 461–469. (10).
Anderson, N., Salgado, J., & Hülsheger, U. (2010). Applicant reactions in selection: Comprehensive meta-analysis into reaction generalization versus situational specificity. International Journal of Selection and Assessment, 19, 291–304. (08).
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personnel Psychology, 57(3), 639–683. https://doi.org/10.1111/j.1744-6570.2004.00003.x.
Pennebaker, J. W., & King, L. A. (1999). Linguistic styles: Language use as an individual difference. Journal of Personality and Social Psychology, 77(6), 1296.
L. A. Fast and D. C. Funder. (2008). Personality as manifest in word use: Correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology, 94(2), 334–46.
Gill, A. J., Nowson, S., & Oberlander, J. (2009). What are they blogging about? personality, topic and motivation in blogs. In Third international AAAI conference on weblogs and social media. [Online]. https://www.aaai.org/ocs/index.php/ICWSM/09/paper/view/199. Accessed 12 Mar 2020.
Hirsh, J. B., & Peterson, J. B. (2009). Personality and language use in self-narratives. Journal of Research in Personality, 43(3), 524–527.
Qiu, L., Lin, H., Ramsay, J., & Yang, F. (2012). You are what you tweet: Personality expression and perception on twitter. Journal of Research in Personality, 46(6), 710–718.
Ashton, M. C., & Lee, K. (2007). Empirical, theoretical, and practical advantages of the HEXACO model of personality structure. Personality and Social Psychology Review,. https://doi.org/10.1177/1088868306294907.
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., et al. (2013). Personality, gender, and age in the language of social media: The open-vocabulary approach. PLoS One, 8(9), e73791. https://doi.org/10.1371/journal.pone.0073791.
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015). The development and psychometric properties of LIWC2015, accepted: 2015-09-16T13:00:41Z. [Online]. https://repositories.lib.utexas.edu/handle/2152/31333. Accessed 8 Apr 2020.
Christopher, M., Prabhakar, R., & Hinrich, S. (2008). Introduction to information retrieval. Cambridge University Press.
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Proceedings of the 26th international conference on neural information processing systems—volume 2, ser. NIPS’13. Curran Associates Inc. (pp. 3111–3119)
Pennington, J., Socher, R., & Manning, C. (2014). Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014 (pp. 1532–1543). [Online]. https://www.aclweb.org/anthology/D14-1162. Accessed 9 Apr 2020.
J. Camacho-Collados, & M. T. Pilehvar. (2018). From word to sense embeddings: A survey on vector representations of meaning. CoRR, vol.abs/1805.04032. [Online]. http://arxiv.org/abs/1805.04032. Accessed 8 Apr 2020.
Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. In Proceedings of the 31st international conference on international conference on machine learning—volume 32, ser. ICML’14. JMLR.org (pp. II–1188–II–1196)
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324.
Roberts, B. W., Kuncel, N. R., Shiner, R., Caspi, R., & Goldberg, L. R. (2007). The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science, 2(4), 313–345. https://doi.org/10.1111/j.1745-6916.2007.00047.x.
Lee, K., & Ashton, M. C. (2013). The H factor of personality: Why some people are manipulative, self-entitled, materialistic, and exploitive-and why it matters for everyone. Wilfrid Laurier University Press.
Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48(1), 26.
Heylighen, F., & Dewaele, J.-M. (2002). Variation in the contextuality of language: An empirical measure. Foundations of Science, 7(3), 293–340.
Coleman, M., & Liau, T. L. (1975). A computer readability formula designed for machine scoring. Journal of Applied Psychology, 60(2), 283–284.
Dale, E., & Chall, J. S. (1948). A formula for predicting readability: Instructions. Educational Research Bulletin, 27(2), 37–54.
Devlin, J., Chang, M., Lee, K., Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. CoRR, vol.abs/1810.04805. [Online]. http://arxiv.org/abs/1810.04805
Conflict of interest
Both authors are employed at PredictiveHire, the creator of the FirstInterview product that was used to collect the data for the research.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Jayaratne, M., Jayatilleke, B. Predicting job-hopping motive of candidates using answers to open-ended interview questions. J Comput Soc Sc 5, 611–628 (2022). https://doi.org/10.1007/s42001-021-00138-4