Sentence-transformers: Feature Request: DistilBERT

Created on 18 Oct 2019  路  3Comments  路  Source: UKPLab/sentence-transformers

Hi,

Encoding large corpora takes really long time using current pretrained models. Could you please add a light model like DistilBERT especially for STS tasks.

Thank you!

picture 0x01h

Most helpful comment

Yes, that is the plan

picture nreimers on 28 Oct 2019
🚀1 🎉1 👍1

All 3 comments

Hi @0x01h
This will be part of the next release, which I expect to release mid November.

nreimers picture nreimers on 18 Oct 2019
👍3

Hi, will this release include the new transformers repo instead of the pytorch transformers ?
Thanks

claeyzre picture claeyzre on 28 Oct 2019

Yes, that is the plan

nreimers picture nreimers on 28 Oct 2019
🚀1 🎉1 👍1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

earny-joe picture earny-joe  路  3Comments
AMChierici picture AMChierici  路  5Comments
PhilipMay picture PhilipMay  路  3Comments
alejandrojcastaneira picture alejandrojcastaneira  路  5Comments
umairspn picture umairspn  路  5Comments