QiaoNing at SemEval 2020 Task 4 Commonsense Validation and Explanation system based on ensemble of language model

Language model system submitted to SemEval-2020 Task 4 competition: “Commonsense Validation and Explanation” We implemented with transfer learning using pretrained language models (BERT, XLNet, RoBERTa, and ALBERT) and fine-tune them on this task . The ensembled model better solves this problem, making the model’s accuracy reached 95.9% on subtask A, which just worse than human’s by only 3% accuracy .

Links: PDF - Abstract

Code :


Keywords : model - task - language - explanation - system -

Leave a Reply

Your email address will not be published. Required fields are marked *