Fairseq: BERT/Roberta MULTITASKING

Created on 16 Jan 2020  路  2Comments  路  Source: pytorch/fairseq

Hello there!
This is related to R&D on my behalf.
Is there a way that we can fine tune BERT for multitasks at the the same time, What I mean is
One BERT/Roberta model in a single pytorch/keras model is fine-tuned for two or more tasks say

  1. Sentiment Analysis
  2. Question Answering
  3. English to German Translation
    and so on
enhancement
Source
picture muhammadfahid51

Most helpful comment

We have some multitasking support in an internal branch. I can work on cleaning it up and releasing it.

picture myleott on 16 Jan 2020
👍7

All 2 comments

We have some multitasking support in an internal branch. I can work on cleaning it up and releasing it.

myleott picture myleott on 16 Jan 2020
👍7

@myleott any progress on that?

mohammadKhalifa picture mohammadKhalifa on 9 Jul 2020
👍1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

Ir1d picture Ir1d  路  3Comments
ashim95 picture ashim95  路  3Comments
AranKomat picture AranKomat  路  3Comments
zhaoxv picture zhaoxv  路  3Comments
yilegu picture yilegu  路  3Comments