Opennmt-py: Do you have any future plan to support ELMo ?

Created on 16 Aug 2018  路  4Comments  路  Source: OpenNMT/OpenNMT-py

ELMo calculates word embeddings based on sentences, so there are some difficulties when directly using the pre-trained embedding APIs from OpenNMT-py . Can you give me any advice on how to use ELMo under current OpenNMT ?

picture 1130310223

Most helpful comment

Yes, I am currently implementing this, along with a trainable language model that you can train to get ELMo embeddings in any language! I will do a Pull Request soon.

picture goncalomcorreia on 16 Aug 2018
👍7

All 4 comments

Yes, I am currently implementing this, along with a trainable language model that you can train to get ELMo embeddings in any language! I will do a Pull Request soon.

goncalomcorreia picture goncalomcorreia on 16 Aug 2018
👍7

That's great 馃憤

1130310223 picture 1130310223 on 17 Aug 2018

Hi All,

any word on this project?

Ovis85 picture Ovis85 on 17 Oct 2019

Hi All,

any word on this project?

Good question. The ELMo entry uses char in a CNN. OpenNMT-py accept bidirectional LSTM. I must review the changes on OpenNMT-py since 2018!

eduamf picture eduamf on 24 Aug 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

mataney picture mataney  路  4Comments
Bachstelze picture Bachstelze  路  3Comments
kakkartushar1 picture kakkartushar1  路  5Comments
AyaNsar picture AyaNsar  路  4Comments
memray picture memray  路  4Comments