TY - GEN
T1 - Learning to combine grammatical error corrections
AU - Kantor, Yoav
AU - Katz, Yoav
AU - Choshen, Leshem
AU - Cohen-Karlik, Edo
AU - Liberman, Naftali
AU - Toledo, Assaf
AU - Menczel, Amir
AU - Slonim, Noam
N1 - Publisher Copyright:
© BEA 2019.All right reserved.
PY - 2019
Y1 - 2019
N2 - The field of Grammatical Error Correction (GEC) has produced various systems to deal with focused phenomena or general text editing. We propose an automatic way to combine black-box systems. Our method automatically detects the strength of a system or the combination of several systems per error type, improving precision and recall while optimizing F score directly. We show consistent improvement over the best standalone system in all the configurations tested. This approach also outperforms average ensembling of different RNN models with random initializations. In addition, we analyze the use of BERT for GEC - reporting promising results on this end. We also present a spellchecker created for this task which outperforms standard spellcheckers tested on the task of spellchecking. This paper describes a system submission to Building Educational Applications 2019 Shared Task: Grammatical Error Correction( Bryant et al., 2019). Combining the output of top BEA 2019 shared task systems using our approach, currently holds the highest reported score in the open phase of the BEA 2019 shared task, improving F0:5 by 3.7 points over the best result reported.
AB - The field of Grammatical Error Correction (GEC) has produced various systems to deal with focused phenomena or general text editing. We propose an automatic way to combine black-box systems. Our method automatically detects the strength of a system or the combination of several systems per error type, improving precision and recall while optimizing F score directly. We show consistent improvement over the best standalone system in all the configurations tested. This approach also outperforms average ensembling of different RNN models with random initializations. In addition, we analyze the use of BERT for GEC - reporting promising results on this end. We also present a spellchecker created for this task which outperforms standard spellcheckers tested on the task of spellchecking. This paper describes a system submission to Building Educational Applications 2019 Shared Task: Grammatical Error Correction( Bryant et al., 2019). Combining the output of top BEA 2019 shared task systems using our approach, currently holds the highest reported score in the open phase of the BEA 2019 shared task, improving F0:5 by 3.7 points over the best result reported.
UR - http://www.scopus.com/inward/record.url?scp=85120958639&partnerID=8YFLogxK
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85120958639
T3 - ACL 2019 - Innovative Use of NLP for Building Educational Applications, BEA 2019 - Proceedings of the 14th Workshop
SP - 139
EP - 148
BT - ACL 2019 - Innovative Use of NLP for Building Educational Applications, BEA 2019 - Proceedings of the 14th Workshop
PB - Association for Computational Linguistics (ACL)
T2 - 14th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2019, collocated with ACL 2019
Y2 - 2 August 2019
ER -