Wav2letter: Python bindings failed to build

[many-hats]

Bug Description

Hi, I could not build python bindings for wav2letter. I have tried multiple environments to make sure. Not sure what the issue is, I was able to successfully build bindings in the past but reinstalled recently after the switch from v0.2.

Reproduction Steps

Installed wav2letter using -b v0.2 and flashlight -b v0.2 cuda backends.
KenLM was installed using both provided commands and just cmake .. -DCMAKE_POSITION_INDEPENDENT_CODE=ON.
KenLM was built and 'cp -r kenlm /opt' , KENLM_ROOT_DIR=/opt/kenlm
I tried to build using both PyTorch 1.2.0 and 1.6.0
That said I am still experiencing the same error messages as seen in the log below.
Log below uses PyTorch 1.2.0, python 3.7

Platform and Hardware

Ubuntu 18.04, V100

Additional Context

    ERROR: Complete output from command /home/ubuntu/anaconda3/bin/python -c 'import setuptools, tokenize;__file__='"'"'/home/ubuntu/wav2letter/bindings/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps:
    ERROR: running develop
    running egg_info
    writing wav2letter.egg-info/PKG-INFO
    writing dependency_links to wav2letter.egg-info/dependency_links.txt
    writing top-level names to wav2letter.egg-info/top_level.txt
    reading manifest file 'wav2letter.egg-info/SOURCES.txt'
    writing manifest file 'wav2letter.egg-info/SOURCES.txt'
    running build_ext
    -- The C compiler identification is GNU 7.5.0
    -- The CXX compiler identification is GNU 7.5.0
    -- Check for working C compiler: /usr/bin/cc
    -- Check for working C compiler: /usr/bin/cc -- works
    -- Detecting C compiler ABI info
    -- Detecting C compiler ABI info - done
    -- Detecting C compile features
    -- Detecting C compile features - done
    -- Check for working CXX compiler: /usr/bin/c++
    -- Check for working CXX compiler: /usr/bin/c++ -- works
    -- Detecting CXX compiler ABI info
    -- Detecting CXX compiler ABI info - done
    -- Detecting CXX compile features
    -- Detecting CXX compile features - done
    -- Looking for pthread.h
    -- Looking for pthread.h - found
    -- Looking for pthread_create
    -- Looking for pthread_create - not found
    -- Looking for pthread_create in pthreads
    -- Looking for pthread_create in pthreads - not found
    -- Looking for pthread_create in pthread
    -- Looking for pthread_create in pthread - found
    -- Found Threads: TRUE
    -- CUDA found (library: /usr/local/cuda-10.1/lib64/libcudart_static.a;-lpthread;dl;/usr/lib/x86_64-linux-gnu/librt.so include: /usr/local/cuda-10.1/include)
    -- CUDA architecture flags: -gencodearch=compute_30,code=sm_30-gencodearch=compute_35,code=sm_35-gencodearch=compute_50,code=sm_50-gencodearch=compute_52,code=sm_52-gencodearch=compute_60,code=sm_60-gencodearch=compute_61,code=sm_61-gencodearch=compute_70,code=sm_70-gencodearch=compute_75,code=sm_75-gencodearch=compute_70,code=compute_70-gencodearch=compute_75,code=compute_75
    -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.1")
    -- Checking for module 'cblas'
    --   No package 'cblas' found
    -- Looking for sys/types.h
    -- Looking for sys/types.h - found
    -- Looking for stdint.h
    -- Looking for stdint.h - found
    -- Looking for stddef.h
    -- Looking for stddef.h - found
    -- Check size of void*
    -- Check size of void* - done
    -- Checking for [Accelerate]
    -- Checking for [vecLib]
    -- Checking for [cblas - atlas]
    -- Includes found
    -- Looking for cblas_dgemm
    -- Looking for cblas_dgemm - found
    -- CBLAS Symbols FOUND
    -- CBLAS library found
    -- CBLAS found (include: /usr/include/x86_64-linux-gnu, library: /usr/lib/x86_64-linux-gnu/libcblas.so;/usr/lib/x86_64-linux-gnu/libatlas.so)
    -- Found FFTW: /usr/include
    -- FFTW found
    -- Looking for KenLM
    -- Using kenlm library found in /usr/local/lib/libkenlm.a
    -- Using kenlm utils library found in /usr/local/lib/libkenlm.a
    -- kenlm lm/model.hh found in /opt/kenlm/lm/model.hh
    -- Found kenlm: /opt/kenlm
    -- Found kenlm (include: /opt/kenlm, library: /usr/local/lib/libkenlm.a;/usr/local/lib/libkenlm_util.a)
    -- Looking for lzma_auto_decoder in /usr/local/lib/liblzma.so
    -- Looking for lzma_auto_decoder in /usr/local/lib/liblzma.so - found
    -- Looking for lzma_easy_encoder in /usr/local/lib/liblzma.so
    -- Looking for lzma_easy_encoder in /usr/local/lib/liblzma.so - found
    -- Looking for lzma_lzma_preset in /usr/local/lib/liblzma.so
    -- Looking for lzma_lzma_preset in /usr/local/lib/liblzma.so - found
    -- Found LibLZMA: /usr/local/include (found version "5.2.4")
    -- Found BZip2: /usr/local/lib/libbz2.a (found version "1.0.8")
    -- Looking for BZ2_bzCompressInit
    -- Looking for BZ2_bzCompressInit - found
    -- Found ZLIB: /usr/local/lib/libz.so (found version "1.2.11")
    -- Found PythonInterp: /home/ubuntu/anaconda3/bin/python (found version "3.7.3")
    -- Found PythonLibs: /home/ubuntu/anaconda3/lib/libpython3.7m.so
    -- Performing Test HAS_FLTO
    -- Performing Test HAS_FLTO - Success
    -- LTO enabled
    -- Configuring done
    -- Generating done
    -- Build files have been written to: /home/ubuntu/wav2letter/bindings/python/build/temp.linux-x86_64-3.7
    Scanning dependencies of target CUB
    Scanning dependencies of target pybind11
    [  1%] Creating directories for 'CUB'
    [  1%] Creating directories for 'pybind11'
    [  2%] Performing download step (git clone) for 'pybind11'
    [  2%] Performing download step (git clone) for 'CUB'
    Cloning into 'pybind11'...
    Cloning into 'CUB'...
    Note: checking out '9a19306fbf30642ca331d0ec88e7da54a96860f9'.

    You are in 'detached HEAD' state. You can look around, make experimental
    changes and commit them, and you can discard any commits you make in this
    state without impacting any branches by performing another checkout.

    If you want to create a new branch to retain commits you create, you may
    do so (now or later) by using -b with the checkout command again. Example:

      git checkout -b <new-branch-name>

    HEAD is now at 9a19306 bump version to 2.2.4
    Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'tools/clang'
    Cloning into '/home/ubuntu/wav2letter/bindings/python/build/temp.linux-x86_64-3.7/bindings/python/pybind11/src/pybind11/tools/clang'...
    Submodule path 'tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
    [  2%] No patch step for 'pybind11'
    [  3%] Performing update step for 'pybind11'
    [  4%] No configure step for 'pybind11'
    [  5%] No build step for 'pybind11'
    [  6%] No install step for 'pybind11'
    [  6%] Completed 'pybind11'
    [  6%] Built target pybind11
    Note: checking out 'c3cceac115c072fb63df1836ff46d8c60d9eb304'.

    You are in 'detached HEAD' state. You can look around, make experimental
    changes and commit them, and you can discard any commits you make in this
    state without impacting any branches by performing another checkout.

    If you want to create a new branch to retain commits you create, you may
    do so (now or later) by using -b with the checkout command again. Example:

      git checkout -b <new-branch-name>

    HEAD is now at c3cceac1 update readme to 1.8.0
    [  7%] Performing update step for 'CUB'
    [  7%] No patch step for 'CUB'
    [  8%] No configure step for 'CUB'
    [  8%] No build step for 'CUB'
    [  9%] No install step for 'CUB'
    [  9%] Completed 'CUB'
    [  9%] Built target CUB
    [ 11%] Building NVCC (Device) object src/libraries/criterion/CMakeFiles/w2l-criterion-library-cuda.dir/cuda/w2l-criterion-library-cuda_generated_CriterionUtils.cu.o
    [ 11%] Building NVCC (Device) object src/libraries/criterion/CMakeFiles/w2l-criterion-library-cuda.dir/cuda/w2l-criterion-library-cuda_generated_ForceAlignmentCriterion.cu.o
    [ 11%] Building NVCC (Device) object src/libraries/criterion/CMakeFiles/w2l-criterion-library-cuda.dir/cuda/w2l-criterion-library-cuda_generated_ViterbiPath.cu.o
    [ 11%] Building NVCC (Device) object src/libraries/criterion/CMakeFiles/w2l-criterion-library-cuda.dir/cuda/w2l-criterion-library-cuda_generated_FullConnectionCriterion.cu.o
    Scanning dependencies of target w2l-criterion-library-cuda
    [ 11%] Linking CXX static library libw2l-criterion-library-cuda.a
    [ 11%] Built target w2l-criterion-library-cuda
    Scanning dependencies of target wav2letter-libraries
    [ 13%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/common/WordUtils.cpp.o
    [ 13%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/common/Utils.cpp.o
    [ 13%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/common/Dictionary.cpp.o
    [ 14%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/criterion/cpu/CriterionUtils.cpp.o
    [ 14%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/criterion/cpu/ForceAlignmentCriterion.cpp.o
    [ 15%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o
    [ 16%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/criterion/cpu/FullConnectionCriterion.cpp.o
    [ 17%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/criterion/cpu/ViterbiPath.cpp.o
    [ 17%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/LexiconDecoder.cpp.o
    [ 17%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/LexiconFreeDecoder.cpp.o
    [ 18%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/LexiconSeq2SeqDecoder.cpp.o
    [ 19%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/LexiconFreeSeq2SeqDecoder.cpp.o
    [ 19%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/Trie.cpp.o
    [ 20%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/decoder/Utils.cpp.o
    [ 20%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/lm/KenLM.cpp.o
    [ 21%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/lm/ConvLM.cpp.o
    [ 21%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/lm/ZeroLM.cpp.o
    [ 22%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Ceplifter.cpp.o
    [ 23%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Dct.cpp.o
    [ 23%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Derivatives.cpp.o
    [ 24%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Dither.cpp.o
    [ 24%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Mfcc.cpp.o
    [ 25%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Mfsc.cpp.o
    [ 26%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/PowerSpectrum.cpp.o
    [ 26%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/PreEmphasis.cpp.o
    [ 27%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/SpeechUtils.cpp.o
    [ 27%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/TriFilterbank.cpp.o
    [ 28%] Building CXX object src/libraries/CMakeFiles/wav2letter-libraries.dir/feature/Windowing.cpp.o
    [ 29%] Linking CXX static library libwav2letter-libraries.a
    [ 29%] Built target wav2letter-libraries
    Scanning dependencies of target _common
    Scanning dependencies of target _feature
    Scanning dependencies of target _decoder
    Scanning dependencies of target _criterion
    [ 30%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/wav2letter/_decoder.cpp.o
    [ 30%] Building CXX object bindings/python/CMakeFiles/_feature.dir/wav2letter/_feature.cpp.o
    [ 31%] Building CXX object bindings/python/CMakeFiles/_common.dir/wav2letter/_common.cpp.o
    [ 31%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/wav2letter/_criterion.cpp.o
    [ 31%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/common/Dictionary.cpp.o
    [ 32%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/common/Dictionary.cpp.o
    [ 33%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/common/Utils.cpp.o
    [ 34%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/common/Utils.cpp.o
    [ 35%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/common/WordUtils.cpp.o
    [ 35%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/common/WordUtils.cpp.o
    [ 35%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/criterion/cpu/CriterionUtils.cpp.o
    [ 36%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/criterion/cpu/ForceAlignmentCriterion.cpp.o
    [ 37%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/criterion/cpu/CriterionUtils.cpp.o
    [ 37%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/common/Dictionary.cpp.o
    [ 37%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/criterion/cpu/ForceAlignmentCriterion.cpp.o
    [ 37%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o
    [ 38%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/criterion/cpu/FullConnectionCriterion.cpp.o
    [ 39%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/common/Dictionary.cpp.o
    [ 40%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o
    [ 41%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/criterion/cpu/FullConnectionCriterion.cpp.o
    [ 42%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/common/Utils.cpp.o
    [ 43%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/criterion/cpu/ViterbiPath.cpp.o
    [ 43%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/LexiconDecoder.cpp.o
    [ 43%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/criterion/cpu/ViterbiPath.cpp.o
    [ 44%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/LexiconDecoder.cpp.o
    [ 44%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/common/Utils.cpp.o
    [ 45%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/common/WordUtils.cpp.o
    [ 46%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/common/WordUtils.cpp.o
    [ 47%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/LexiconFreeDecoder.cpp.o
    [ 47%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/LexiconFreeDecoder.cpp.o
    [ 47%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/criterion/cpu/CriterionUtils.cpp.o
    [ 48%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/criterion/cpu/ForceAlignmentCriterion.cpp.o
    [ 48%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/LexiconSeq2SeqDecoder.cpp.o
    [ 48%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/criterion/cpu/CriterionUtils.cpp.o
    [ 48%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o
    [ 49%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/criterion/cpu/ForceAlignmentCriterion.cpp.o
    [ 50%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/criterion/cpu/FullConnectionCriterion.cpp.o
    [ 51%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/LexiconSeq2SeqDecoder.cpp.o
    [ 52%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o
    [ 52%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/criterion/cpu/ViterbiPath.cpp.o
    [ 52%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/criterion/cpu/FullConnectionCriterion.cpp.o
    [ 53%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/LexiconDecoder.cpp.o
    [ 54%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/criterion/cpu/ViterbiPath.cpp.o
    [ 54%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/LexiconDecoder.cpp.o
    [ 55%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/LexiconFreeSeq2SeqDecoder.cpp.o
    [ 56%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/LexiconFreeSeq2SeqDecoder.cpp.o
    [ 57%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/LexiconFreeDecoder.cpp.o
    [ 58%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/LexiconFreeDecoder.cpp.o
    [ 58%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/Trie.cpp.o
    [ 58%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/Trie.cpp.o
    [ 58%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/LexiconSeq2SeqDecoder.cpp.o
    [ 59%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/decoder/Utils.cpp.o
    [ 60%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/lm/KenLM.cpp.o
    [ 61%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/LexiconSeq2SeqDecoder.cpp.o
    [ 62%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/decoder/Utils.cpp.o
    [ 62%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/lm/KenLM.cpp.o
    [ 62%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/lm/ConvLM.cpp.o
    [ 63%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/LexiconFreeSeq2SeqDecoder.cpp.o
    [ 64%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/lm/ConvLM.cpp.o
    [ 64%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/LexiconFreeSeq2SeqDecoder.cpp.o
    [ 65%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/lm/ZeroLM.cpp.o
    [ 65%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/Trie.cpp.o
    [ 65%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/lm/ZeroLM.cpp.o
    [ 65%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Ceplifter.cpp.o
    [ 66%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/Trie.cpp.o
    [ 67%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Dct.cpp.o
    [ 68%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/decoder/Utils.cpp.o
    [ 69%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/lm/KenLM.cpp.o
    [ 70%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Ceplifter.cpp.o
    [ 71%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Derivatives.cpp.o
    [ 72%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Dct.cpp.o
    [ 72%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Dither.cpp.o
    [ 72%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Derivatives.cpp.o
    [ 72%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/decoder/Utils.cpp.o
    [ 73%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/lm/KenLM.cpp.o
    [ 74%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Mfcc.cpp.o
    [ 75%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Dither.cpp.o
    [ 75%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/lm/ConvLM.cpp.o
    [ 75%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Mfcc.cpp.o
    [ 75%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Mfsc.cpp.o
    [ 76%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/lm/ConvLM.cpp.o
    [ 77%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Mfsc.cpp.o
    [ 78%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/PowerSpectrum.cpp.o
    [ 79%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/lm/ZeroLM.cpp.o
    [ 80%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/PowerSpectrum.cpp.o
    [ 81%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/PreEmphasis.cpp.o
    [ 81%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/SpeechUtils.cpp.o
    [ 81%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Ceplifter.cpp.o
    [ 81%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/lm/ZeroLM.cpp.o
    [ 81%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/PreEmphasis.cpp.o
    [ 82%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/TriFilterbank.cpp.o
    [ 83%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Dct.cpp.o
    [ 84%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/SpeechUtils.cpp.o
    [ 85%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Derivatives.cpp.o
    [ 86%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Ceplifter.cpp.o
    [ 86%] Building CXX object bindings/python/CMakeFiles/_common.dir/__/__/src/libraries/feature/Windowing.cpp.o
    [ 86%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/TriFilterbank.cpp.o
    [ 86%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Dither.cpp.o
    [ 86%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Dct.cpp.o
    [ 87%] Linking CXX shared module ../../../../wav2letter/_common.cpython-37m-x86_64-linux-gnu.so
    [ 88%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Derivatives.cpp.o
    [ 89%] Building CXX object bindings/python/CMakeFiles/_criterion.dir/__/__/src/libraries/feature/Windowing.cpp.o
    [ 90%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Mfcc.cpp.o
    [ 90%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Dither.cpp.o
    [ 91%] Linking CXX shared module ../../../../wav2letter/_criterion.cpython-37m-x86_64-linux-gnu.so
    [ 91%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Mfsc.cpp.o
    [ 92%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Mfcc.cpp.o
    [ 93%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/PowerSpectrum.cpp.o
    [ 94%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Mfsc.cpp.o
    [ 94%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/PowerSpectrum.cpp.o
    [ 94%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/PreEmphasis.cpp.o
    [ 95%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/SpeechUtils.cpp.o
    [ 96%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/PreEmphasis.cpp.o
    [ 97%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/TriFilterbank.cpp.o
    [ 97%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/SpeechUtils.cpp.o
    [ 97%] Building CXX object bindings/python/CMakeFiles/_feature.dir/__/__/src/libraries/feature/Windowing.cpp.o
    [ 98%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/TriFilterbank.cpp.o
    [ 99%] Linking CXX shared module ../../../../wav2letter/_feature.cpython-37m-x86_64-linux-gnu.so
    [100%] Building CXX object bindings/python/CMakeFiles/_decoder.dir/__/__/src/libraries/feature/Windowing.cpp.o
    [100%] Linking CXX shared module ../../../../wav2letter/_decoder.cpython-37m-x86_64-linux-gnu.so
    /usr/bin/ld: /usr/local/lib/libbz2.a(blocksort.o): relocation R_X86_64_PC32 against symbol `stderr@@GLIBC_2.2.5' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: Bad value
    collect2: error: ld returned 1 exit status
    bindings/python/CMakeFiles/_common.dir/build.make:836: recipe for target '../../wav2letter/_common.cpython-37m-x86_64-linux-gnu.so' failed
    make[2]: *** [../../wav2letter/_common.cpython-37m-x86_64-linux-gnu.so] Error 1
    CMakeFiles/Makefile2:330: recipe for target 'bindings/python/CMakeFiles/_common.dir/all' failed
    make[1]: *** [bindings/python/CMakeFiles/_common.dir/all] Error 2
    make[1]: *** Waiting for unfinished jobs....
    /usr/bin/ld: /usr/local/lib/libbz2.a(blocksort.o): relocation R_X86_64_PC32 against symbol `stderr@@GLIBC_2.2.5' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: Bad value
    collect2: error: ld returned 1 exit status
    bindings/python/CMakeFiles/_criterion.dir/build.make:836: recipe for target '../../wav2letter/_criterion.cpython-37m-x86_64-linux-gnu.so' failed
    make[2]: *** [../../wav2letter/_criterion.cpython-37m-x86_64-linux-gnu.so] Error 1
    CMakeFiles/Makefile2:406: recipe for target 'bindings/python/CMakeFiles/_criterion.dir/all' failed
    make[1]: *** [bindings/python/CMakeFiles/_criterion.dir/all] Error 2
    /usr/bin/ld: /usr/local/lib/libbz2.a(blocksort.o): relocation R_X86_64_PC32 against symbol `stderr@@GLIBC_2.2.5' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: Bad value
    collect2: error: ld returned 1 exit status
    bindings/python/CMakeFiles/_feature.dir/build.make:836: recipe for target '../../wav2letter/_feature.cpython-37m-x86_64-linux-gnu.so' failed
    make[2]: *** [../../wav2letter/_feature.cpython-37m-x86_64-linux-gnu.so] Error 1
    CMakeFiles/Makefile2:484: recipe for target 'bindings/python/CMakeFiles/_feature.dir/all' failed
    make[1]: *** [bindings/python/CMakeFiles/_feature.dir/all] Error 2
    /usr/bin/ld: /usr/local/lib/libbz2.a(blocksort.o): relocation R_X86_64_PC32 against symbol `stderr@@GLIBC_2.2.5' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: Bad value
    collect2: error: ld returned 1 exit status
    bindings/python/CMakeFiles/_decoder.dir/build.make:836: recipe for target '../../wav2letter/_decoder.cpython-37m-x86_64-linux-gnu.so' failed
    make[2]: *** [../../wav2letter/_decoder.cpython-37m-x86_64-linux-gnu.so] Error 1
    CMakeFiles/Makefile2:445: recipe for target 'bindings/python/CMakeFiles/_decoder.dir/all' failed
    make[1]: *** [bindings/python/CMakeFiles/_decoder.dir/all] Error 2
    Makefile:83: recipe for target 'all' failed
    make: *** [all] Error 2
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/home/ubuntu/wav2letter/bindings/python/setup.py", line 109, in <module>
        zip_safe=False,
      File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/setuptools/__init__.py", line 145, in setup
        return distutils.core.setup(**attrs)
      File "/home/ubuntu/anaconda3/lib/python3.7/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/home/ubuntu/anaconda3/lib/python3.7/distutils/dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "/home/ubuntu/anaconda3/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/setuptools/command/develop.py", line 38, in run
        self.install_for_development()
      File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/setuptools/command/develop.py", line 140, in install_for_development
        self.run_command('build_ext')
      File "/home/ubuntu/anaconda3/lib/python3.7/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/home/ubuntu/anaconda3/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/ubuntu/wav2letter/bindings/python/setup.py", line 48, in run
        self.build_extensions()
      File "/home/ubuntu/wav2letter/bindings/python/setup.py", line 91, in build_extensions
        ["cmake", "--build", "."] + build_args, cwd=self.build_temp
      File "/home/ubuntu/anaconda3/lib/python3.7/subprocess.py", line 347, in check_call
        raise CalledProcessError(retcode, cmd)
    subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--config', 'Release', '--', '-j4']' returned non-zero exit status 2.
    ----------------------------------------
ERROR: Command "/home/ubuntu/anaconda3/bin/python -c 'import setuptools, tokenize;__file__='"'"'/home/ubuntu/wav2letter/bindings/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps" failed with error code 1 in /home/ubuntu/wav2letter/bindings/python/

[tlikhomanenko]

This probably connected to the compiler, you can fix this with adding -fPIC in the https://github.com/facebookresearch/wav2letter/blob/v0.2/bindings/python/setup.py#L82 like env["CXXFLAGS"] = '{} -fPIC -DVERSION_INFO=\\"{}\\"'.format(

[many-hats]

I tried it but it didn't change the error message. I'm confused because it was working before, but when I reinstalled on another VM, it also produced the same error message.

[tlikhomanenko]

just to be sure, you added -fPic, removed the build dir and run again pip install -e ., right?

[many-hats]

Yes, I replaced line 82 in the setup.py with env["CXXFLAGS"] = '{} -fPIC -DVERSION_INFO=\\"{}\\"'.format( , removed build dir, and did pip install -e . .

[tlikhomanenko]

could you try the same thing in the docker so that I could repro. What is also your cmake version?

cc @jacobkahn any idea on the fPIC issue?

[many-hats]

cmake version 3.10.2. Docker cuda-latest building python bindings worked fine however. Will use those for now.

[tlikhomanenko]

Seems there is some problems with conda gtest version and the one we use (it should be downloaded automatically). Could you try to use clean python env (without conda)?

[many-hats]

I tried a venv and without also with the '-fPIC' fix and without but got the same error. FWIW I also ran into problems with conda gtest when building a while ago but it was fixed when I uninstalled and only used the build gtest.

[tlikhomanenko]

probably there is another version in your system of gtest which creates all this mess.

[Logicbloke]

Was this ever fixed? Thanks! I'm running into the same issue and the proposed workaround on setup.py:82 didn't do it.

Any ideas?

[many-hats]

I was not able to fix this. I tried using system gtest and a clean build gtest install. I will take another stab with Flashlight

[Logicbloke]

@many-hats Make sure you have the same version of gcc, g++ and gfortran, at least the major version.

[many-hats]

All were 7.5.0 . I'd recommend using the dockerfile, as v0.2 seems to have been archived and after some point I couldn't reproduce without it.

[tlikhomanenko]

Yep, v0.2 is archived, we have merged all code base wav2letter into flashlight and improved there python binding and installation recently. Please if you can switch to latest flashlight master and use https://github.com/facebookresearch/flashlight/tree/master/bindings/python (if you have any issues with it please post in flashlight issues directly). Otherwise, please use docker for v0.2 python bindings (or try to replicate docker env on your machine).