Comparison of SVM and Some Older Classification Algorithms in Text Classification Tasks
- Fabrice ColasAffiliated withLIACS, Leiden University
- , Pavel BrazdilAffiliated withLIACC-NIAAD, University of Porto
Document classification has already been widely studied. In fact, some studies compared feature selection techniques or feature space transformation whereas some others compared the performance of different algorithms. Recently, following the rising interest towards the Support Vector Machine, various studies showed that SVM outperforms other classification algorithms. So should we just not bother about other classification algorithms and opt always for SVM ?
We have decided to investigate this issue and compared SVM to kNN and naive Bayes on binary classification tasks. An important issue is to compare optimized versions of these algorithms, which is what we have done. Our results show all the classifiers achieved comparable performance on most problems. One surprising result is that SVM was not a clear winner, despite quite good overall performance. If a suitable preprocessing is used with kNN, this algorithm continues to achieve very good results and scales up well with the number of documents, which is not the case for SVM. As for naive Bayes, it also achieved good performance.
- Comparison of SVM and Some Older Classification Algorithms in Text Classification Tasks
- Book Title
- Artificial Intelligence in Theory and Practice
- Book Subtitle
- IFIP 19th World Computer Congress, TC 12: IFIP AI 2006 Stream, August 21–24, 2006, Santiago, Chile
- pp 169-178
- Print ISBN
- Online ISBN
- Series Title
- IFIP International Federation for Information Processing
- Series Volume
- Series ISSN
- Springer US
- Copyright Holder
- International Federation for Information Processing
- Additional Links
- Industry Sectors
- eBook Packages
To view the rest of this content please follow the download PDF link above.