Skip to main content

Table 8 Personality prediction result using Twitter dataset

From: Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging

Traits Metric System Baseline
BERT RoBERTa XLnet BERT + NLP Features RoBERTa + NLP Features XLNet + NLP Features Proposed Model
Openness Accuracy 67.41% 66.38% 66.94% 69.28% 68.88% 69.85% 70.85%
F1 Measure 0.702 0.691 0.697 0.723 0.718 0.729 0.740
Conscientiousness Accuracy 81.76% 81.44% 81.24% 85.64% 85.86% 85.77% 88.49%
F1 Measure 0.613 0.612 0.608 0.675 0.677 0.679 0.736
Extraversion Accuracy 78.31% 77.80% 78.26% 78.99% 79.51% 79.50% 81.17%
F1 Measure 0.863 0.860 0.862 0.867 0.871 0.871 0.882
Agreeableness Accuracy 65.30% 65.14% 65.40% 70.39% 69.01% 68.44% 69.33%
F1 Measure 0.694 0.695 0.694 0.744 0.731 0.723 0.734
Neuroticism Accuracy 70.74% 70.47% 71.51% 73.57% 73.76% 73.99% 75.08%
F1 Measure 0.631 0.632 0.643 0.673 0.677 0.679 0.694
Average Accuracy 72.70% 72.25% 72.67% 75.57% 75.40% 75.51% 77.34%
F1 Measure 0.701 0.698 0.701 0.736 0.735 0.736 0.760
  1. The highest performance value resulting from each of the personalities listed in bold