Skip to main content

Generating Personalized Behavioral Feedback for a Virtual Job Interview Training System Through Adversarial Learning

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2022)

Abstract

Job interviews are usually high-stakes social situations where professional and behavioral skills are required for a satisfactory outcome. In order to increase the chances of recruitment technological approaches have emerged to generate meaningful feedback for job candidates. We extended an interactive virtual job interview training system with a Generative Adversarial Network (GAN)-based approach that first detects behavioral weaknesses and subsequently generates personalized feedback. To evaluate the usefulness of the generated feedback, we conducted a mixed-methods pilot study using mock-ups from the job interview training system. The overall study results indicate that the GAN-based generated behavioral feedback is helpful. Moreover, participants assessed that the feedback would improve their job interview performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Our implementation is available at https://github.com/hcmlab/FeatureFactual.

References

  1. Baur, T., Damian, I., Gebhard, P., Porayska-Pomsta, K., Andre, E.: A job interview simulation: social cue-based interaction with a virtual character (2013)

    Google Scholar 

  2. Baur, T., et al.: Context-aware automated analysis and annotation of social human-agent interactions. ACM Trans. Interact. Intell. Syst. 5(2) (2015)

    Google Scholar 

  3. Cafaro, A., et al.: The noxi database: multimodal recordings of mediated novice-expert interactions. In: ICMI 2017, November 2017

    Google Scholar 

  4. Hoque, E., Courgeon, M., Claude Martin, J., Mutlu, B., Picard, R.W.: Mach: my automated conversation coach. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2013)

    Google Scholar 

  5. Mertes, S., Huber, T., Weitz, K., Heimerl, A., André, E.: Ganterfactual-counterfactual explanations for medical non-experts using generative adversarial learning. Front. Artif. Intell. 5 (2022)

    Google Scholar 

  6. Minge, M., Riedel, L.: meCUE-Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. In: Mensch and Computer 2013-Tagungsband, pp. 89–98. Oldenbourg Wissenschaftsverlag (2013)

    Google Scholar 

  7. Paulhus, D.L., Westlake, B.G., Calvez, S.S., Harms, P.D.: Self-presentation style in job interviews: the role of personality and culture. J. Appl. Soc. Psychol. 43(10), 2042–2059 (2013)

    Article  Google Scholar 

  8. Ribeiro, M.T., Singh, S., Guestrin, C.: “why should I trust you?”: Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016, pp. 1135–1144 (2016)

    Google Scholar 

  9. Rowold, J., Hochholdinger, S., Schaper, N.: Evaluation und Transfersicherung betrieblicher Trainings: Modelle. Methoden und Befunde, Hogrefe (2008)

    Google Scholar 

  10. Schneeberger, T., Scholtes, M., Hilpert, B., Langer, M., Gebhard, P.: Can social agents elicit shame as humans do? In: 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 164–170. IEEE (2019)

    Google Scholar 

  11. Takeuchi, N., Koda, T.: Initial assessment of job interview training system using multimodal behavior analysis. In: Proceedings of the 9th International Conference on Human-Agent Interaction. HAI 2021, pp. 407–411. Association for Computing Machinery, New York (2021)

    Google Scholar 

Download references

Acknowledgments

This work presents and discusses results in the context of the research project ForDigitHealth. The project is part of the Bavarian Research Association on Healthy Use of Digital Technologies and Media (ForDigitHealth), funded by the Bavarian Ministry of Science and Arts. Further, the work described in this paper has been partially supported by the BMBF under 16SV8688 within the MITHOS project, and by the BMBF under 16SV8493 within the AVASAG project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Heimerl .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Heimerl, A. et al. (2022). Generating Personalized Behavioral Feedback for a Virtual Job Interview Training System Through Adversarial Learning. In: Rodrigo, M.M., Matsuda, N., Cristea, A.I., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2022. Lecture Notes in Computer Science, vol 13355. Springer, Cham. https://doi.org/10.1007/978-3-031-11644-5_67

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-11644-5_67

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-11643-8

  • Online ISBN: 978-3-031-11644-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics