Please use this identifier to cite or link to this item:
|Title:||Imbalanced text classification: A term weighting approach|
Term weighting scheme
|Citation:||Liu, Y., Loh, H.T., Sun, A. (2009-01). Imbalanced text classification: A term weighting approach. Expert Systems with Applications 36 (1) : 690-701. ScholarBank@NUS Repository. https://doi.org/10.1016/j.eswa.2007.10.042|
|Abstract:||The natural distribution of textual data used in text classification is often imbalanced. Categories with fewer examples are under-represented and their classifiers often perform far below satisfactory. We tackle this problem using a simple probability based term weighting scheme to better distinguish documents in minor categories. This new scheme directly utilizes two critical information ratios, i.e. relevance indicators. Such relevance indicators are nicely supported by probability estimates which embody the category membership. Our experimental study using both Support Vector Machines and Naïve Bayes classifiers and extensive comparison with other classic weighting schemes over two benchmarking data sets, including Reuters-21578, shows significant improvement for minor categories, while the performance for major categories are not jeopardized. Our approach has suggested a simple and effective solution to boost the performance of text classification over skewed data sets. © 2007 Elsevier Ltd. All rights reserved.|
|Source Title:||Expert Systems with Applications|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on Dec 10, 2018
WEB OF SCIENCETM
checked on Nov 26, 2018
checked on Dec 8, 2018
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.