Please use this identifier to cite or link to this item: https://doi.org/10.1016/j.eswa.2007.10.042
Title: Imbalanced text classification: A term weighting approach
Authors: Liu, Y.
Loh, H.T. 
Sun, A.
Keywords: Imbalanced data
Term weighting scheme
Text classification
Issue Date: Jan-2009
Source: Liu, Y., Loh, H.T., Sun, A. (2009-01). Imbalanced text classification: A term weighting approach. Expert Systems with Applications 36 (1) : 690-701. ScholarBank@NUS Repository. https://doi.org/10.1016/j.eswa.2007.10.042
Abstract: The natural distribution of textual data used in text classification is often imbalanced. Categories with fewer examples are under-represented and their classifiers often perform far below satisfactory. We tackle this problem using a simple probability based term weighting scheme to better distinguish documents in minor categories. This new scheme directly utilizes two critical information ratios, i.e. relevance indicators. Such relevance indicators are nicely supported by probability estimates which embody the category membership. Our experimental study using both Support Vector Machines and Naïve Bayes classifiers and extensive comparison with other classic weighting schemes over two benchmarking data sets, including Reuters-21578, shows significant improvement for minor categories, while the performance for major categories are not jeopardized. Our approach has suggested a simple and effective solution to boost the performance of text classification over skewed data sets. © 2007 Elsevier Ltd. All rights reserved.
Source Title: Expert Systems with Applications
URI: http://scholarbank.nus.edu.sg/handle/10635/60483
ISSN: 09574174
DOI: 10.1016/j.eswa.2007.10.042
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

100
checked on Dec 13, 2017

WEB OF SCIENCETM
Citations

75
checked on Dec 13, 2017

Page view(s)

24
checked on Dec 9, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.