Transformers: max sentence length

Created on 24 Jan 2019  路  4Comments  路  Source: huggingface/transformers

is there an max sentence length for this bert code?

picture RayXu14

Most helpful comment

Hi, 512 tokens if you use the pre-trained models. Any length you want if you train your models from scratch.

picture thomwolf on 24 Jan 2019
❤2 👍2

All 4 comments

Hi, 512 tokens if you use the pre-trained models. Any length you want if you train your models from scratch.

thomwolf picture thomwolf on 24 Jan 2019
❤2 👍2

could we set it smaller ? cause if i set it as 512, then result is out of memory

tsungruihon picture tsungruihon on 13 Feb 2019

You can just send a smaller input in the model, no need to go to the max

thomwolf picture thomwolf on 13 Feb 2019
👍1

thank you @thomwolf

tsungruihon picture tsungruihon on 14 Feb 2019
👍1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

guanlongtianzi picture guanlongtianzi  路  3Comments
lemonhu picture lemonhu  路  3Comments
lcswillems picture lcswillems  路  3Comments
ereday picture ereday  路  3Comments
0x01h picture 0x01h  路  3Comments