Bert: Why there is no results on SNLI dataset ?

Created on 2 Nov 2018  路  2Comments  路  Source: google-research/bert

Is there any reason why there is no BERT results on SNLI dataset, but there is for MultiNLI ?

picture astariul-colanim

Most helpful comment

Yeah we didn't report on it because it's not part of the GLUE eval (and also because MultiNLI generally subsumes it). I think BERT-Base gets about 91% and BERT-Large gets about 92% on it though.

picture jacobdevlin-google on 2 Nov 2018
👍2

All 2 comments

Yeah we didn't report on it because it's not part of the GLUE eval (and also because MultiNLI generally subsumes it). I think BERT-Base gets about 91% and BERT-Large gets about 92% on it though.

jacobdevlin-google picture jacobdevlin-google on 2 Nov 2018
👍2

I fine-tuned BERT-Base on SNLI and got 90.686% :)

I use a single GPU (GeForce GTX 1080, 11Gb RAM), and it took approximately 5 days to fine-tune.

Awesome results !

astariul-colanim picture astariul-colanim on 7 Nov 2018
👍1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

LucasLLC picture LucasLLC  路  3Comments
ishita-gupta98 picture ishita-gupta98  路  3Comments
HAWLYQ picture HAWLYQ  路  3Comments
santhoshkolloju picture santhoshkolloju  路  3Comments
dzhao123 picture dzhao123  路  3Comments