Transformers: [Model] mT5 Cross-Lingual Model

[sumanthd17]

🌟 New model addition

Model description

Multilingual T5 (mT5) is a massively multilingual pretrained text-to-text transformer model, trained following a similar recipe as T5.

Weights, code are available.

Github Repo: mT5 Weights and Code

Paper: mT5: A massively multilingual pre-trained text-to-text transformer

Open source status

• [x] the model implementation is available: Implementation
• [x] the model weights are available: checkpoints
• [x] who are the authors: (@craffel, @adarob)

[julien-c]

Will be a part of #6285

[parthplc]

Hey, @sumanthd17 any update on this?

[Neuronys]

@julien-c thanks for your amazing nlp lib.
When do you plan to support mT5 ?
When #6285 will be release ?
Cheers
Philippe