Please use this identifier to cite or link to this item: https://scholarbank.nus.edu.sg/handle/10635/135420
Title: AUTOMATIC MODERATION FOR IBIS FORUM
Authors: XU CHENCAN
Keywords: Automatic Moderation, IBIS Forum, Online Deliberation, MIT Deliberatorium, Machine Learning, Feature Engineering
Issue Date: 18-Aug-2016
Citation: XU CHENCAN (2016-08-18). AUTOMATIC MODERATION FOR IBIS FORUM. ScholarBank@NUS Repository.
Abstract: Painstaking manual moderation work in IBIS (Issue Based Information System) forums is needed to maintain the requisite structure and requires careful human reading and intelligence. The core moderation task is to identify whether a post is “structurally incorrect”. We are the first to automate this with a learning task. We clean and analyze the raw data from a particular IBIS forum sourced from the MIT Deliberatorium, and in doing so, create a dataset appropriate for devising a machine learned solution. We engineer six sets of features: bag of words, type, length, selected word(s), structure, similarity, then provision these features to a SVM classifier to create a learned automatic moderator. Our system achieves an approximate AUC of 0.8, which we feel is a good first step towards full automation. For in depth analysis, we further perform ablation tests and micro analyses to understand the effect of each feature set on performance.
URI: http://scholarbank.nus.edu.sg/handle/10635/135420
Appears in Collections:Master's Theses (Open)

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
XuChencan.pdf877.71 kBAdobe PDF

OPEN

NoneView/Download

Page view(s)

46
checked on Nov 8, 2019

Download(s)

1
checked on Nov 8, 2019

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.