Fairseq: BLEU score from generate.py is cased BLEU or not?

Created on 1 Oct 2019  路  2Comments  路  Source: pytorch/fairseq

Hi,

Could anyone tell whether the BLEU score coming from the generate.py is cased BLEU or not?

And how could I output the translated sentence into a file?

Thanks!

picture shawnkx

Most helpful comment

Although fairseq uses sacrebleu, you should decode and output the translation into a file and use https://github.com/mjpost/sacreBLEU to be sure.

picture alvations on 3 Oct 2019
👍2

All 2 comments

  1. cased

  2. grep ^H output | cut -f3- > hyp

SunbowLiu picture SunbowLiu on 3 Oct 2019
👍1

Although fairseq uses sacrebleu, you should decode and output the translation into a file and use https://github.com/mjpost/sacreBLEU to be sure.

alvations picture alvations on 3 Oct 2019
👍2
Was this page helpful?
0 / 5 - 0 ratings

Related issues

zhaoxv picture zhaoxv  路  3Comments
kyquang97 picture kyquang97  路  3Comments
ajesujoba picture ajesujoba  路  3Comments
kr-sundaram picture kr-sundaram  路  3Comments
Ir1d picture Ir1d  路  3Comments