CoNLL-2013 Shared Task: Grammatical Error Correction

Abstract

<p>CoNLL-2013 will continue the CoNLL tradition of having a high profile shared task in natural language processing. This year's shared task will be grammatical error correction. A participating system in this shared task is given short English texts written by non-native speakers of English. The system detects the grammatical errors present in the input texts, and returns the corrected texts.</p><p>This task has gained popularity recently with the organization of the HOO (Helping Our Own) shared tasks in 2011 and 2012. In the most recent HOO shared task in 2012, on error detection and correction of determiners and prepositions, 14 teams from around the world participated and 85 systems were submitted to the shared task.</p><p>The grammatical error correction task is impactful since it is estimated that hundreds of millions of people in the world are learning English and they benefit directly from an automated grammar checker. However, for many error types, current grammatical error correction methods do not achieve a high performance and thus more research is needed.</p><p>Instead of focusing on only determiner and preposition errors as in HOO 2012, the CoNLL-2013 shared task will include a more comprehensive list of error types, including determiner, preposition, noun number, verb form, and subject-verb agreement errors. Extending into more error types introduces the possibility of correcting multiple interacting errors. Examples of such interacting errors include determiner and noun number ('that cars' → 'that car' or 'those cars') and preposition and verb form ('an interest to study’ → ‘an interest in studying').</p><p>Participating teams will be provided with common training data in which grammatical errors have been annotated. Blind test data will be used to evaluate the outputs of the participating teams using a common scoring software and evaluation metric.</p><p>To download and reuse this dataset, please visit <a href="https://doi.org/10.25542/GVZ8-1MME">https://doi.org/10.25542/GVZ8-1MME.</a></p><p>Related Publication: <br><ul><li>Ng, Hwee Tou, & Wu, Siew Mei, & Wu, Yuanbin, & Hadiwinoto, Christian, & Tetreault, Joel (2013). The CoNLL-2013 Shared Task on Grammatical Error Correction. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task (CoNLL-2013 Shared Task). Sofia, Bulgaria. </li></ul></p>