Transformers: BART : How can I train and evaluate BART on CNN/DM dataset
❓ Questions & Help
@sshleifer
I found examples for text summarization on CNN/DM dataset using BERT, but I couldn't find any example using BART.
Are you going to add it later, or update the existing example to add BART, or it's not scheduled ?
astariul-colanim
All 5 comments
BART has only just been implemented and is not part of release code yet. I'm sure that examples will be added later on, you just need a bit more patience.
BramVanroy
on 25 Feb 2020
How is this going? I would like to train BART for text summarization with my own dataset and I have no idea of what preprocessing is needed or what inputs the model needs. I would appreciate the help @sshleifer.
marmg
on 4 Mar 2020
No training code yet, but we have an eval example. Its very new obviously, so make an issue and tag me if it breaks :)
sshleifer
on 4 Mar 2020
sshleifer
on 4 Mar 2020
The associated PR I opened has the training code. Just in case you want to test it out and run some experiments/give feedback. I based it on this colab that I wrote.
acarrera94
on 12 Mar 2020
Related issues
alphanlp
·
3Comments
yspaik
·
3Comments
guanlongtianzi
·
3Comments
hsajjad
·
3Comments
lcswillems
·
3Comments
Most helpful comment
BART has only just been implemented and is not part of release code yet. I'm sure that examples will be added later on, you just need a bit more patience.