Fairseq: Where is fairseq-preprocess

Created on 2 Aug 2019  ·  3Comments  ·  Source: pytorch/fairseq

When I run following command in the shell script

for input_index in $(seq 1 2); do
  fairseq-preprocess \
      --only-source \
      --trainpref $processed_data_dir/train.${input_index}.bpe \
      --validpref $processed_data_dir/dev.${input_index}.bpe \
      --testpref $processed_data_dir/test.${input_index}.bpe \
      --destdir $processed_data_dir/Input.${input_index} \
      --workers 4 \
      --srcdict ${roberta_vocab_dir}/dict.txt
done

There is an issue that command not found

fairseq-preprocess: command not found

Most helpful comment

You need to run “pip install --editable .” to install the fairseq-preprocess executable.

All 3 comments

You need to run “pip install --editable .” to install the fairseq-preprocess executable.

sorry, from which directory shall I run “pip install --editable .” ?

You need to run “pip install --editable .” to install the fairseq-preprocess executable.

@myleott
Even after running this and having fairseq successfully installed the fairseq-preprocess is not found

Was this page helpful?
0 / 5 - 0 ratings