After installing pytorch, I installed fairseq following the introduction, but got the errors below:
pip install fairseq
Collecting fairseq
Using cached https://files.pythonhosted.org/packages/1c/13/41fb03306f9e50581210d2fb24f2f056f700f9ffdddb0f7734c7bda5d715/fairseq-0.7.2.tar.gz
Requirement already satisfied: cffi in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.9.1)
Requirement already satisfied: numpy in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.16.4)
Requirement already satisfied: sacrebleu in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.3.7)
Requirement already satisfied: torch in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (1.1.0)
Requirement already satisfied: tqdm in /Users/superman/anaconda/lib/python3.6/site-packages (from fairseq) (4.32.1)
Requirement already satisfied: pycparser in /Users/superman/anaconda/lib/python3.6/site-packages (from cffi->fairseq) (2.17)
Requirement already satisfied: typing in /Users/superman/anaconda/lib/python3.6/site-packages (from sacrebleu->fairseq) (3.7.4)
Requirement already satisfied: portalocker in /Users/superman/anaconda/lib/python3.6/site-packages (from sacrebleu->fairseq) (1.5.0)
Building wheels for collected packages: fairseq
Building wheel for fairseq (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; __file__='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-wheel-0iolc_t8 --python-tag cp36
cwd: /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/
Complete output (166 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.macosx-10.7-x86_64-3.6
creating build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/legacy_distributed_data_parallel.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/options.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/meters.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/registry.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/bleu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_generator.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/pdb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/hub_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_scorer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/checkpoint_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/distributed_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/file_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/search.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/progress_bar.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/trainer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/binarizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
creating build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/preprocess.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/generate.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/setup.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/interactive.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/train.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/eval_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/score.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/fairseq_task.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/multilingual_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/language_modeling.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/audio_pretraining.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/semisupervised_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/cross_lingual_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/nag.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/lamb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/bmuf.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adafactor.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/sgd.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fairseq_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fp16_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adagrad.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adam.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adadelta.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_self_att.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/multilingual_transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/distributed_fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/wav2vec.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lstm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/composite_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_incremental_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/beamable_mm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/downsampled_multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/mean_pool_gating_network.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/learned_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/grad_multiply.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/character_token_embedder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_softmax.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/conv_tbc.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/unfold.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/gelu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/linearized_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder_layer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/highway.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/dynamic_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_input.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/lightweight_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/scalar_bias.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/logsumexp_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/sinusoidal_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/layer_norm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/concat_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/backtranslation_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/block_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/multi_corpus_sampled_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/noising.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/monolingual_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/data_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/round_robin_zip_datasets.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/iterators.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/language_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/indexed_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/fairseq_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/lm_context_window_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/token_block_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_lang_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/masked_lm_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/fairseq_criterion.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/adaptive_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/label_smoothed_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/composite_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/binary_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fixed_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/polynomial_decay_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/inverse_square_root_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/cosine_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/triangular_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/raw_audio_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/sentencepiece_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/nltk_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/gpt2_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/subword_nmt_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/space_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/moses_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
running build_ext
building 'fairseq.libbleu' extension
creating build/temp.macosx-10.7-x86_64-3.6
creating build/temp.macosx-10.7-x86_64-3.6/fairseq
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1
ERROR: Failed building wheel for fairseq
Running setup.py clean for fairseq
Failed to build fairseq
Installing collected packages: fairseq
Running setup.py install for fairseq ... error
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; __file__='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-record-w8a267u9/install-record.txt --single-version-externally-managed --compile
cwd: /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/
Complete output (166 lines):
running install
running build
running build_py
creating build
creating build/lib.macosx-10.7-x86_64-3.6
creating build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/legacy_distributed_data_parallel.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/options.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/meters.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/registry.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/bleu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_generator.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/pdb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/hub_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/sequence_scorer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/checkpoint_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/distributed_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/file_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/search.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/progress_bar.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/trainer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
copying fairseq/binarizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq
creating build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/preprocess.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/generate.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/setup.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/interactive.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/train.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/eval_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
copying fairseq_cli/score.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq_cli
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/fairseq_task.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/multilingual_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/language_modeling.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/audio_pretraining.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/semisupervised_translation.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/cross_lingual_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/translation_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
copying fairseq/tasks/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/tasks
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/nag.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/lamb.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/bmuf.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adafactor.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/sgd.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fairseq_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/fp16_optimizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adagrad.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adam.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
copying fairseq/optim/adadelta.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_self_att.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/multilingual_transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_from_pretrained_xlm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/distributed_fairseq_model.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/transformer_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/wav2vec.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lstm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/composite_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/masked_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/fairseq_incremental_decoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
copying fairseq/models/lightconv_lm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/models
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/beamable_mm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/downsampled_multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/multihead_attention.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/mean_pool_gating_network.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/learned_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/grad_multiply.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/character_token_embedder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_softmax.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/conv_tbc.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/unfold.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/gelu.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/linearized_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/transformer_sentence_encoder_layer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/highway.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/dynamic_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/adaptive_input.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/lightweight_convolution.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/scalar_bias.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/logsumexp_moe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/sinusoidal_positional_embedding.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
copying fairseq/modules/layer_norm.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/modules
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/concat_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/backtranslation_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/block_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/multi_corpus_sampled_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/noising.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/monolingual_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/data_utils.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/round_robin_zip_datasets.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/iterators.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/language_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/masked_lm_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/indexed_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/dictionary.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/fairseq_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/lm_context_window_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/token_block_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
copying fairseq/data/transform_eos_lang_pair_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/masked_lm_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/fairseq_criterion.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/adaptive_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/label_smoothed_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/composite_loss.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
copying fairseq/criterions/binary_cross_entropy.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/criterions
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fixed_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/polynomial_decay_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/inverse_square_root_schedule.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/cosine_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
copying fairseq/optim/lr_scheduler/triangular_lr_scheduler.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/optim/lr_scheduler
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
copying fairseq/data/audio/raw_audio_dataset.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/audio
creating build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/sentencepiece_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/nltk_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/gpt2_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/subword_nmt_bpe.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/__init__.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/space_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
copying fairseq/data/transforms/moses_tokenizer.py -> build/lib.macosx-10.7-x86_64-3.6/fairseq/data/transforms
running build_ext
building 'fairseq.libbleu' extension
creating build/temp.macosx-10.7-x86_64-3.6
creating build/temp.macosx-10.7-x86_64-3.6/fairseq
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib
creating build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/superman/anaconda/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"'; __file__='"'"'/private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-install-r2wmqr5b/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/3h/3v_dnwl95tl9k9swbcfrm1fc0000gn/T/pip-record-w8a267u9/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
then I tried another way: Installing from source. And got the error below:
Installing collected packages: fairseq
Running setup.py develop for fairseq
ERROR: Command errored out with exit status 1:
command: /Users/superman/anaconda/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"'; __file__='"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
cwd: /Users/superman/Documents/work/pytorch-prj/fairseq/
Complete output (18 lines):
running develop
running egg_info
writing fairseq.egg-info/PKG-INFO
writing dependency_links to fairseq.egg-info/dependency_links.txt
writing entry points to fairseq.egg-info/entry_points.txt
writing requirements to fairseq.egg-info/requires.txt
writing top-level names to fairseq.egg-info/top_level.txt
reading manifest file 'fairseq.egg-info/SOURCES.txt'
writing manifest file 'fairseq.egg-info/SOURCES.txt'
running build_ext
building 'fairseq.libbleu' extension
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o -stdlib=libc++
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include -arch x86_64 -I/Users/superman/anaconda/include/python3.6m -c fairseq/clib/libbleu/module.cpp -o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -stdlib=libc++
g++ -bundle -undefined dynamic_lookup -L/Users/superman/anaconda/lib -L/Users/superman/anaconda/lib -arch x86_64 build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/libbleu.o build/temp.macosx-10.7-x86_64-3.6/fairseq/clib/libbleu/module.o -L/Users/superman/anaconda/lib -o build/lib.macosx-10.7-x86_64-3.6/fairseq/libbleu.cpython-36m-darwin.so
clang: warning: libstdc++ is deprecated; move to libc++ with a minimum deployment target of OS X 10.9 [-Wdeprecated]
ld: library not found for -lstdc++
clang: error: linker command failed with exit code 1 (use -v to see invocation)
error: command 'g++' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/superman/anaconda/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"'; __file__='"'"'/Users/superman/Documents/work/pytorch-prj/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.
Same here :(
@jeremyasapp @mtfelix the errors has been placed in your log, You need google to install library
ld: library not found for -lstdc++
apt-get update && apt-get install build-essential ?
At commit 5349052aae4ec1350822c894fbb6be350dff61a0, excuting pip install -e . cause the following error.
Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Installing collected packages: fairseq
Running setup.py develop for fairseq
ERROR: Command errored out with exit status 1:
command: /home/username/miniconda3/envs/pt13/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/username/workspace/fairseq/setup.py'"'"'; __file__='"'"'/home/username/workspace/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
cwd: /home/username/workspace/fairseq/
Complete output (26 lines):
which: no nvcc in (/home/username/bin:/home/username/miniconda3/envs/pt13/bin:/home/username/.linuxbrew/bin:/usr/local/torque-6.1.3/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin)
running develop
running egg_info
writing fairseq.egg-info/PKG-INFO
writing dependency_links to fairseq.egg-info/dependency_links.txt
writing entry points to fairseq.egg-info/entry_points.txt
writing requirements to fairseq.egg-info/requires.txt
writing top-level names to fairseq.egg-info/top_level.txt
reading manifest file 'fairseq.egg-info/SOURCES.txt'
writing manifest file 'fairseq.egg-info/SOURCES.txt'
running build_ext
skipping 'fairseq/data/data_utils_fast.cpp' Cython extension (up-to-date)
skipping 'fairseq/data/token_block_utils_fast.cpp' Cython extension (up-to-date)
building 'fairseq.libbleu' extension
gcc -pthread -B /home/username/miniconda3/envs/pt13/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/username/miniconda3/envs/pt13/include/python3.7m -c fairseq/clib/libbleu/libbleu.cpp -o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o -std=c++11 -O3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=libbleu -D_GLIBCXX_USE_CXX11_ABI=0
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
gcc -pthread -B /home/username/miniconda3/envs/pt13/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/username/miniconda3/envs/pt13/include/python3.7m -c fairseq/clib/libbleu/module.cpp -o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/module.o -std=c++11 -O3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=libbleu -D_GLIBCXX_USE_CXX11_ABI=0
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
g++ -pthread -shared -B /home/username/miniconda3/envs/pt13/compiler_compat -L/home/username/miniconda3/envs/pt13/lib -Wl,-rpath=/home/username/miniconda3/envs/pt13/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/module.o -o build/lib.linux-x86_64-3.7/fairseq/libbleu.cpython-37m-x86_64-linux-gnu.so
/home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
/home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
/home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
/home/username/miniconda3/envs/pt13/compiler_compat/ld: build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: unable to initialize decompress status for section .debug_info
build/temp.linux-x86_64-3.7/fairseq/clib/libbleu/libbleu.o: file not recognized: file format not recognized
collect2: error: ld returned 1 exit status
error: command 'g++' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /home/username/miniconda3/envs/pt13/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/username/workspace/fairseq/setup.py'"'"'; __file__='"'"'/home/username/workspace/fairseq/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.
Solved by using /usr/bin/g++ instead of /home/username/.linuxbrew/bin/g++.
username@hostname:~
$ /usr/bin/g++ --version
g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
username@hostname:~
$ .linuxbrew/bin/g++ --version
g++ (Homebrew gcc 5.5.0_4) 5.5.0
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
[username@hostname]:~/workspace/fairseq
$ pip install -e .
Obtaining file:///home/username/workspace/fairseq
Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2)
Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14)
Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3)
Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1)
Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2)
Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1)
Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0)
Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19)
Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2)
Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1)
Installing collected packages: fairseq
Running setup.py develop for fairseq
Successfully installed fairseq
Sounds like this is resolved.
Solved by using
/usr/bin/g++instead of/home/username/.linuxbrew/bin/g++.username@hostname:~ $ /usr/bin/g++ --version g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36) Copyright (C) 2015 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. username@hostname:~ $ .linuxbrew/bin/g++ --version g++ (Homebrew gcc 5.5.0_4) 5.5.0 Copyright (C) 2015 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.[username@hostname]:~/workspace/fairseq $ pip install -e . Obtaining file:///home/username/workspace/fairseq Requirement already satisfied: cffi in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.13.2) Requirement already satisfied: cython in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (0.29.14) Requirement already satisfied: numpy in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.17.3) Requirement already satisfied: regex in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (2019.11.1) Requirement already satisfied: sacrebleu in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.4.2) Requirement already satisfied: torch in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (1.3.1) Requirement already satisfied: tqdm in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from fairseq==0.8.0) (4.39.0) Requirement already satisfied: pycparser in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from cffi->fairseq==0.8.0) (2.19) Requirement already satisfied: portalocker in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (1.5.2) Requirement already satisfied: typing in /home/username/miniconda3/envs/pt13/lib/python3.7/site-packages (from sacrebleu->fairseq==0.8.0) (3.7.4.1) Installing collected packages: fairseq Running setup.py develop for fairseq Successfully installed fairseq
if i install in win10, how to fix this problem?
Most helpful comment
apt-get update && apt-get install build-essential?