Bert: Pre-trained monolingual in French

[Alikabbadj]

Is there anywhere a BERT-base monolingual French pre-trained model?

I need it as entry for fine-tuning Question & Answering in French.

[Alikabbadj]

I have a SQuAD v1.1 dataset in French and I want to fine-tune BERT to aswer questions in French

[atmani-massinissa]

Hi Alikabbadj,

I can't help you for the French version of BERT, but there is an apllication of ULMFIT of fast.ai for French : https://github.com/tchambon/deepfrench

Also,could you please tell me where can I find the SQuaD v1.1 in French, or provide me with a link.

Thanks

[LisaBanana]

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually looking for one for a QA project too ...

Thanks if anyone has an answer :)

[Alikabbadj]

Hi all,

You can get the SQuaD v1.1 in French from https://github.com/Alikabbadj/French-SQuAD/tree/master

[ClaudeCoulombe]

Greetings folks,

From what I know, all the high performance and biggest pre-trained models (GPT, BERT, ...) are in English only (but strangely enough or not in Chinese ?!??!!). There are some multilingual models like multilingual BERT that are quite poor but still usable for French. Infos and download hyperlink at : https://github.com/google-research/bert/blob/master/multilingual.md

Bonne chance!

[Alikabbadj]

Hi Lisa,

You can find SAuAD v1.1 in French here:

https://drive.google.com/drive/folders/1HzvQv4W7sveWkuxbw04tTfgiDq0ZKW8U?usp=sharing

And you can read my paper here:

https://github.com/Alikabbadj/French-SQuAD

Good luck
Ali

2019-08-20 15:39 UTC+02:00, LisaBanana [e-mail]:

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually
looking for one for a QA project too ...

Thanks if anyone has an answer :)

--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:
https://github.com/google-research/bert/issues/502#issuecomment-523019154

[LisaBanana]

Thank you very much Ali !

Have a nice day !

Lisa

Le ven. 25 oct. 2019 à 09:22, Ali Kabbadj [e-mail] a
écrit :

Hi Lisa,

You can find SAuAD v1.1 in French here:

https://drive.google.com/drive/folders/1HzvQv4W7sveWkuxbw04tTfgiDq0ZKW8U?usp=sharing

And you can read my paper here:

https://github.com/Alikabbadj/French-SQuAD

Good luck
Ali

2019-08-20 15:39 UTC+02:00, LisaBanana [e-mail]:

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually
looking for one for a QA project too ...

Thanks if anyone has an answer :)

--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:

https://github.com/google-research/bert/issues/502#issuecomment-523019154

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/google-research/bert/issues/502?email_source=notifications&email_token=ALP3CMF4HFIGJ2W2O7SKMU3QQKNEZA5CNFSM4G7E7JG2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECHOH4Y#issuecomment-546235379,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ALP3CMAM7Y3DLHKYBQQ5GFDQQKNEZANCNFSM4G7E7JGQ
.

[manueltonneau]

This model called CamemBERT also just came out (https://arxiv.org/abs/1911.03894) and is implemented in the transformers library (https://github.com/huggingface/transformers). :)