Gluon-nlp: [BERT] Reproducing GLUE score on 9 tasks

Created on 24 Dec 2018  路  4Comments  路  Source: dmlc/gluon-nlp

Currently only provide MRPC task on https://github.com/dmlc/gluon-nlp/blob/master/scripts/bert/dataset.py

Needs to add other tasks.

  • [ ] CoLA
  • [ ] SST-2
  • [ ] STS-B
  • [ ] QQP
  • [ ] MNLI
  • [ ] QNLI
  • [ ] RTE
  • [ ] WNLI
enhancement good first issue help wanted
Source
picture haven-jeon
👍4

Most helpful comment

I requested #481.

picture haven-jeon on 25 Dec 2018
👍2

All 4 comments

I want to reproduce the STS task.

kenjewu picture kenjewu on 24 Dec 2018
🎉2

Thanks for bringing it up, @haven-jeon, and thanks to @kenjewu for offering to help.

cc @eric-haibin-lin

szha picture szha on 24 Dec 2018
😄2

I requested #481.

haven-jeon picture haven-jeon on 25 Dec 2018
👍2

@haven-jeon I created separate issues for each of these tasks and we can now track these separately as a milestone in https://github.com/dmlc/gluon-nlp/milestone/2
I'll close this for now

eric-haibin-lin picture eric-haibin-lin on 4 Jan 2019
Was this page helpful?
0 / 5 - 0 ratings

Related issues

leezu picture leezu  路  3Comments
szha picture szha  路  3Comments
szha picture szha  路  6Comments
eric-haibin-lin picture eric-haibin-lin  路  3Comments
hankcs picture hankcs  路  6Comments