Bert: BERT with Brazilian Portuguese

[fabriciosantana]

Hi,

I am studying BERT ant trying to aplly it to Brazilian Portuguese.

I have created a colab to better understant.
Basically, I have a corpus with brazian text, I have ran create_pretraining_data.py and then run_pretraining.py (parameters can be seen in colab).

Now I am in doubt about how do I use the output model that I got after pretraining.

Any Help?

[masreis]

Hi Fabricio,
I'm using your colab to create a POC with BERT in Portuguese. Let's evaluate it to verify the accuracy.

[fabriciosantana]

Hi Fabricio,
I'm using your colab to create a POC with BERT in Portuguese. Let's evaluate it to verify the accuracy.

Thanks. I'm still working on it.

[DenisAraujo68]

Olá @masreis
Estou escrevendo em português pq imagino que seja a sua língua nativa. Let me know if not, ok?
Você conseguiu rodar o código do @fabriciosantana ?

[JpMCarrilho]

Any advance in this? I maybe a could colaborate somehow....

[fabiocapsouza]

We have made Portuguese BERT models available at https://github.com/neuralmind-ai/portuguese-bert

[JoaoPedroZucoloto]

Guys, I need help, i'm from Brazil, and I'm thinking about switcinhg my chatbot to BERT, can someone give me some insight of how to use at least thispre treined model?

[JpMCarrilho]

Guys, I need help, i'm from Brazil, and I'm thinking about switcinhg my chatbot to BERT, can someone give me some insight of how to use at least thispre treined model?

I have no experience in this type of deploy, but maybe this blog post can give you a direction: https://www.pragnakalp.com/case-study/chatbot-using-bert-in-python/