Please use this identifier to cite or link to this item:
Title: Imbalanced text classification: A term weighting approach
Authors: Liu, Y.
Loh, H.T. 
Sun, A.
Keywords: Imbalanced data
Term weighting scheme
Text classification
Issue Date: Jan-2009
Citation: Liu, Y., Loh, H.T., Sun, A. (2009-01). Imbalanced text classification: A term weighting approach. Expert Systems with Applications 36 (1) : 690-701. ScholarBank@NUS Repository.
Abstract: The natural distribution of textual data used in text classification is often imbalanced. Categories with fewer examples are under-represented and their classifiers often perform far below satisfactory. We tackle this problem using a simple probability based term weighting scheme to better distinguish documents in minor categories. This new scheme directly utilizes two critical information ratios, i.e. relevance indicators. Such relevance indicators are nicely supported by probability estimates which embody the category membership. Our experimental study using both Support Vector Machines and Naïve Bayes classifiers and extensive comparison with other classic weighting schemes over two benchmarking data sets, including Reuters-21578, shows significant improvement for minor categories, while the performance for major categories are not jeopardized. Our approach has suggested a simple and effective solution to boost the performance of text classification over skewed data sets. © 2007 Elsevier Ltd. All rights reserved.
Source Title: Expert Systems with Applications
ISSN: 09574174
DOI: 10.1016/j.eswa.2007.10.042
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Dec 10, 2018


checked on Nov 26, 2018

Page view(s)

checked on Dec 8, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.