Bert: BERT feature extraction as a service

Created on 15 Nov 2018  路  2Comments  路  Source: google-research/bert

Thanks for providing those pretrained models. I use them as the sentence encoder and hosts them as a standalone service via ZeroMQ, allowing one to map sentences into fixed-length representations in just two lines of code. It supports both GPU/CPU, single(/multi)-server-single(/multi)-client. Please refer to this repo and check it out: https://github.com/hanxiao/bert-as-service

demo

Most helpful comment

As a encoding service (which often used as a part of dev/prod infrastructure), scalability and efficiency are top priorities. Below I attached some benchmark results. More can be found on https://github.com/hanxiao/bert-as-service#benchmark

client_batch_size
max_batch_size
max_seq_len
num_clients

All 2 comments

As a encoding service (which often used as a part of dev/prod infrastructure), scalability and efficiency are top priorities. Below I attached some benchmark results. More can be found on https://github.com/hanxiao/bert-as-service#benchmark

client_batch_size
max_batch_size
max_seq_len
num_clients

Is it possible to see similar words in BERT like if I search for "radar sensor companies", so I can get the similar words related to above query

Was this page helpful?
0 / 5 - 0 ratings