Text document pre-processing using the Bayes formula for classification based on the vector space model
Publication date
2008
Creators
Abstract
This work utilizes the Bayes formula to vectorize a document according to a probability distribution based on keywords reflecting the probable categories that the document may belong to. The Bayes formula gives a range of probabilities to which the document can be assigned according to a pre determined set of topics (categories). Using this probability distribution as the vectors to represent the document, the text classification algorithms based on the vector space model, such as the Support Vector Machine (SVM) and Self-Organizing Map (SOM) can then be used to classify the documents on a multi-dimensional level, thus improving on the results obtained using only the highest probability to classify the document, such as that achieved by implementing the naïve Bayes classifier by itself. The effects of an inadvertent dimensionality reduction can be overcome using these algorithms. We compare the performance of these classifiers for high dimensional data.
Item Type
Article
Associated Schools / Departments
School of Computer Science (MY)
Date Deposited
February 19, 2026
Except where otherwise noted, this item's license is described as
File(s)![Thumbnail Image]()
Name
Isa_Text.pdf
Type
Full-text
Size
249.38 KB
Format
Adobe PDF
Checksum ()