Nmt: [error] HashTable has different value for same key

[denisb411]

I'm trying to execute the first example:

mkdir /tmp/nmt_model
python -m nmt.nmt \
--src=vi --tgt=en \
--vocab_prefix=/tmp/nmt_data/vocab \
--train_prefix=/tmp/nmt_data/train \
--dev_prefix=/tmp/nmt_data/tst2012 \
--test_prefix=/tmp/nmt_data/tst2013 \
--out_dir=/tmp/nmt_model \
--num_train_steps=12000 \
--steps_per_stats=100 \
--num_layers=2 \
--num_units=128 \
--dropout=0.2 \
--metrics=bleu

And it's returning the following error:

FailedPreconditionError (see above for traceback): HashTable has different value for same key. Key has 0 and trying to add value 86

How can I solve this?

[oahziur]

Hi @denisb411

Did you follow the instruction to download /tmp/nmt_data/...? Looks like there are duplicated values in your vocab file.

[newlts]

I encountered the same error, I solved it by text edior, found and deleted the duplicated word. It works.

[denisb411]

Thanks, I will look around on this issue of duplicated words.

[lmthang]

Seems like this has been resolved. Close for now.