Explainable Personality Prediction Using Answers to Open-Ended Interview Questions
In this work, we demonstrate how textual content from answers to interview questions related to past behavior and situational judgement can be used to infer personality traits. We analyzed responses from over 58,000 job applicants who completed an online text-based interview that also included a per...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-11-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.865841/full |
| _version_ | 1811189631181389824 |
|---|---|
| author | Yimeng Dai Madhura Jayaratne Buddhi Jayatilleke |
| author_facet | Yimeng Dai Madhura Jayaratne Buddhi Jayatilleke |
| author_sort | Yimeng Dai |
| collection | DOAJ |
| description | In this work, we demonstrate how textual content from answers to interview questions related to past behavior and situational judgement can be used to infer personality traits. We analyzed responses from over 58,000 job applicants who completed an online text-based interview that also included a personality questionnaire based on the HEXACO personality model to self-rate their personality. The inference model training utilizes a fine-tuned version of InterviewBERT, a pre-trained Bidirectional Encoder Representations from Transformers (BERT) model extended with a large interview answer corpus of over 3 million answers (over 330 million words). InterviewBERT is able to better contextualize interview responses based on the interview specific knowledge learnt from the answer corpus in addition to the general language knowledge already encoded in the initial pre-trained BERT. Further, the “Attention-based” learning approaches in InterviewBERT enable the development of explainable personality inference models that can address concerns of model explainability, a frequently raised issue when using machine learning models. We obtained an average correlation of r = 0.37 (p < 0.001) across the six HEXACO dimensions between the self-rated and the language-inferred trait scores with the highest correlation of r = 0.45 for Openness and the lowest of r = 0.28 for Agreeableness. We also show that the mean differences in inferred trait scores between male and female groups are similar to that reported by others using standard self-rated item inventories. Our results show the potential of using InterviewBERT to infer personality in an explainable manner using only the textual content of interview responses, making personality assessments more accessible and removing the subjective biases involved in human interviewer judgement of candidate personality. |
| first_indexed | 2024-04-11T14:38:46Z |
| format | Article |
| id | doaj.art-b434e1e4771e490c96074b9f62c1115a |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-11T14:38:46Z |
| publishDate | 2022-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-b434e1e4771e490c96074b9f62c1115a2022-12-22T04:18:15ZengFrontiers Media S.A.Frontiers in Psychology1664-10782022-11-011310.3389/fpsyg.2022.865841865841Explainable Personality Prediction Using Answers to Open-Ended Interview QuestionsYimeng DaiMadhura JayaratneBuddhi JayatillekeIn this work, we demonstrate how textual content from answers to interview questions related to past behavior and situational judgement can be used to infer personality traits. We analyzed responses from over 58,000 job applicants who completed an online text-based interview that also included a personality questionnaire based on the HEXACO personality model to self-rate their personality. The inference model training utilizes a fine-tuned version of InterviewBERT, a pre-trained Bidirectional Encoder Representations from Transformers (BERT) model extended with a large interview answer corpus of over 3 million answers (over 330 million words). InterviewBERT is able to better contextualize interview responses based on the interview specific knowledge learnt from the answer corpus in addition to the general language knowledge already encoded in the initial pre-trained BERT. Further, the “Attention-based” learning approaches in InterviewBERT enable the development of explainable personality inference models that can address concerns of model explainability, a frequently raised issue when using machine learning models. We obtained an average correlation of r = 0.37 (p < 0.001) across the six HEXACO dimensions between the self-rated and the language-inferred trait scores with the highest correlation of r = 0.45 for Openness and the lowest of r = 0.28 for Agreeableness. We also show that the mean differences in inferred trait scores between male and female groups are similar to that reported by others using standard self-rated item inventories. Our results show the potential of using InterviewBERT to infer personality in an explainable manner using only the textual content of interview responses, making personality assessments more accessible and removing the subjective biases involved in human interviewer judgement of candidate personality.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.865841/fullpersonality predictionHEXACO personality modellinguistic analysisNLPBERT |
| spellingShingle | Yimeng Dai Madhura Jayaratne Buddhi Jayatilleke Explainable Personality Prediction Using Answers to Open-Ended Interview Questions Frontiers in Psychology personality prediction HEXACO personality model linguistic analysis NLP BERT |
| title | Explainable Personality Prediction Using Answers to Open-Ended Interview Questions |
| title_full | Explainable Personality Prediction Using Answers to Open-Ended Interview Questions |
| title_fullStr | Explainable Personality Prediction Using Answers to Open-Ended Interview Questions |
| title_full_unstemmed | Explainable Personality Prediction Using Answers to Open-Ended Interview Questions |
| title_short | Explainable Personality Prediction Using Answers to Open-Ended Interview Questions |
| title_sort | explainable personality prediction using answers to open ended interview questions |
| topic | personality prediction HEXACO personality model linguistic analysis NLP BERT |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.865841/full |
| work_keys_str_mv | AT yimengdai explainablepersonalitypredictionusinganswerstoopenendedinterviewquestions AT madhurajayaratne explainablepersonalitypredictionusinganswerstoopenendedinterviewquestions AT buddhijayatilleke explainablepersonalitypredictionusinganswerstoopenendedinterviewquestions |