Hub: BERT embeddings as tensorflow hub module

[r-wheeler]

Are there any plans to convert the BERT checkpoints into a tensorflow hub module? Would be great to be able to get word vectors similar to elmo for further downstream tasks.

[akhorlin]

We are working with the authors of BERT to explore making it available as a
TF Hub module. Once there is something concrete we will update the thread.

On Mon, Nov 12, 2018 at 2:40 AM Ryan Wheeler [e-mail]
wrote:

Are there any plans to convert the BERT checkpoints
https://github.com/google-research/bert into a tensorflow hub module?
Would be great to be able to get word vectors similar to elmo for further
downstream tasks.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/hub/issues/187, or mute the thread
https://github.com/notifications/unsubscribe-auth/AbunTDCk9zUuDGSdmW931h45SKG8Seqdks5uuNFxgaJpZM4YY0MV
.

[r-wheeler]

Sounds good, thanks for the update.

[alberduris]

Sounds really promising. Subscribed!

[akhorlin]

BERT modules have been published on tfhub.dev: https://tfhub.dev/s?q=bert