Tensorrt: Make Error Problem

Created on 16 Jan 2020  Â·  12Comments  Â·  Source: NVIDIA/TensorRT

Description

I cannot make successfully for TensorRT OSS. I already got stuck for a long time.
I followed the instruction that I could pass the cmake step, but I cannot pass the make step.
Previously I have installed the TensorRT 7.0.0.11 by TensorRT-7.0.0.11.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn7.6.tar.gz. I can run the samples which was provided by this TensorRT 7.0.0.11.

Git clone the TensorRT OSS repo from GitHub.

git clone -b master https://github.com/nvidia/TensorRT TensorRT -b release/7.0
cd TensorRT
git submodule update --init --recursive
export TRT_SOURCE=`pwd`

In my .zshrc file (I used the zsh.)

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-10.2/lib64
export CUDA_INSTALL_DIR=/usr/local/cuda-10.2
export CUDNN_INSTALL_DIR=/home/chieh/Downloads/cuda_102_cudnn76
export PATH=$PATH:/usr/local/cuda-10.2/bin
export CUDA_HOME=$CUDA_HOME:/usr/local/cuda-10.2
export PATH=$PATH:~/.local/bin
export PATH=/usr/local/cuda-10.2/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-10.2/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/chieh/Downloads/TensorRT-7.0.0.11/lib
export TRT_RELEASE=/home/chieh/Downloads/TensorRT-7.0.0.11

Start to cmake

cd $TRT_SOURCE
mkdir -p build && cd build
sudo cmake ..

Output info

build ›› sudo cmake ..                                                                                        ✹ release/7.0
Building for TensorRT version: 7.0.0.1, library version: 7.0.0
-- Targeting TRT Platform: x86_64
-- GPU_ARCHS is not defined. Generating CUDA code for default SMs: 35;53;61;70
-- CUDA version set to 10.2
-- cuDNN version set to 7.6
-- Protobuf version set to 3.0.0
CMake Warning at CMakeLists.txt:200 (message):
  Detected CUDA version is <= 10.0! Removing BERT plugins from compilation
  list.


-- Using libprotobuf /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so
-- ==========================================================================================
-- ========================= Importing and creating target nvuffparser ==========================
-- Looking for library nvparsers
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvparsers.so
-- ==========================================================================================
-- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
-- /home/chieh/github/TensorRT/build/parsers/caffe
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.15.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/g++
--   C++ compiler version  : 7.4.0
--   CXX flags             : -Wno-deprecated-declarations  -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor
--   Build type            : Release
--   Compile definitions   : _PROTOBUF_INSTALL_DIR=/home/chieh/github/TensorRT/build;ONNX_NAMESPACE=onnx2trt_onnx
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /usr/local
--   CMAKE_MODULE_PATH     : 
-- 
--   ONNX version          : 1.6.0
--   ONNX NAMESPACE        : onnx2trt_onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
-- Found TensorRT headers at /home/chieh/github/TensorRT/include
-- Find TensorRT libs at /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer_plugin.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libmyelin.so
...
-- Adding new sample: trtexec
--     - Parsers Used: caffe;uff;onnx
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build

Make

make -j$(nproc)

Then I got this error

build ›› sudo make -j                                                                                         ✹ release/7.0
Building for TensorRT version: 7.0.0.1, library version: 7.0.0
-- Targeting TRT Platform: x86_64
-- GPU_ARCHS is not defined. Generating CUDA code for default SMs: 35;53;61;70;75
-- CUDA version set to 10.2
-- cuDNN version set to 7.6
-- Protobuf version set to 3.0.0
CMake Warning at CMakeLists.txt:200 (message):
  Detected CUDA version is <= 10.0! Removing BERT plugins from compilation
  list.


-- Using libprotobuf /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so
-- ==========================================================================================
-- ========================= Importing and creating target nvuffparser ==========================
-- Looking for library nvparsers
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvparsers.so
-- ==========================================================================================
-- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
-- /home/chieh/github/TensorRT/build/parsers/caffe
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.15.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/g++
--   C++ compiler version  : 7.4.0
--   CXX flags             : -Wno-deprecated-declarations  -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor
--   Build type            : Release
--   Compile definitions   : _PROTOBUF_INSTALL_DIR=/home/chieh/github/TensorRT/build;ONNX_NAMESPACE=onnx2trt_onnx
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /usr/local
--   CMAKE_MODULE_PATH     : 
-- 
--   ONNX version          : 1.6.0
--   ONNX NAMESPACE        : onnx2trt_onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
-- Found TensorRT headers at /home/chieh/github/TensorRT/include
-- Find TensorRT libs at /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer_plugin.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libmyelin.so
...
-- Adding new sample: trtexec
--     - Parsers Used: caffe;uff;onnx
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build
[  2%] Built target third_party.protobuf
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o
[  3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/normalizePlugin/normalizePlugin.cpp.o
[  3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/reorgPlugin/reorgPlugin.cpp.o
[  4%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o
[  4%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/regionPlugin/regionPlugin.cpp.o
[  4%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[  4%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSPlugin.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nvFasterRCNN/nvFasterRCNNPlugin.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/cropAndResizePlugin/cropAndResizePlugin.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/kernel.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSInference.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSPlugin.cpp.o
[  5%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nvFasterRCNN/nvFasterRCNNPlugin.cpp.o
[  5%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchTilePlugin/batchTilePlugin.cpp.o
[  8%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/flattenConcat/flattenConcat.cpp.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o
[  8%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/pyramidROIAlignPlugin/pyramidROIAlignPlugin.cpp.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSInference.cpp.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalPlugin/proposalPlugin.cpp.o
[  8%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchTilePlugin/batchTilePlugin.cpp.o
[ 10%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/bboxDeltas2Proposals.cu.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/maskRCNNKernels.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/detectionLayerPlugin/detectionLayerPlugin.cpp.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/nmsHelper.cpp.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/regionForward.cu.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/cropAndResizeKernel.cu.o
[ 10%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cpp.o
[ 10%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/allClassNMS.cu.o
[ 15%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o
[ 17%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/extractFgScores.cu.o
[ 17%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/cropAndResizePlugin/cropAndResizePlugin.cpp.o
[ 17%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/proposalPlugin/proposalPlugin.cpp.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nmsPlugin/nmsPlugin.cpp.o
[ 10%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cpp.o
[ 17%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cu.o
[ 18%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalsForward.cu.o
[ 18%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalKernel.cu.o
[ 18%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o
[ 10%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o
[ 11%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalLayerPlugin/proposalLayerPlugin.cpp.o
[ 11%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/pyramidROIAlignPlugin/pyramidROIAlignPlugin.cpp.o
[ 11%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/flattenConcat/flattenConcat.cpp.o
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o
[ 20%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[ 21%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/normalizeLayer.cu.o
[ 22%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 22%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/permuteData.cu.o
[ 23%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/regionPlugin/regionPlugin.cpp.o
[ 24%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/roiPooling.cu.o
[ 24%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/priorBoxLayer.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/normalizePlugin/normalizePlugin.cpp.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/nmsHelper.cpp.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/rproiInferenceFused.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:569: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/regionForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/regionForward.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:543: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalKernel.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalKernel.cu.o] Error 1
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o
[ 12%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerClass.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/InferPlugin.cpp.o
[ 14%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/kernel.cpp.o
[ 14%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/proposalLayerPlugin/proposalLayerPlugin.cpp.o
[ 30%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gridAnchorLayer.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 16%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o
[ 25%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:491: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:556: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:348: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/allClassNMS.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/allClassNMS.cu.o] Error 1
[ 27%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerImage.cu.o
[ 28%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[ 17%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/detectionLayerPlugin/detectionLayerPlugin.cpp.o
[ 28%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/reorgForward.cu.o
[ 28%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/common.cu.o
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/generateAnchors.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:608: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:478: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/maskRCNNKernels.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/maskRCNNKernels.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:530: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/priorBoxLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/priorBoxLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:465: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:582: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/reorgForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/reorgForward.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:517: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/permuteData.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/permuteData.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 35%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/cudaDriverWrapper.cu.o
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:608: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/rproiInferenceFused.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/rproiInferenceFused.cu.o] Error 1
[ 35%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o
[ 35%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 30%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/__/samples/common/logger.cpp.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:621: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerClass.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerClass.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:387: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/__/samples/common/logger.cpp.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/decodeBBoxes.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gatherTopDetections.cu.o
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/nmsLayer.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:335: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:452: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:595: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o] Error 1
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 34%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/detectionForward.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:361: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/bboxDeltas2Proposals.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/bboxDeltas2Proposals.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/InferPlugin.cpp.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:426: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/extractFgScores.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/extractFgScores.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:595: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/roiPooling.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/roiPooling.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:465: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gridAnchorLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gridAnchorLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:504: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/normalizeLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/normalizeLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:452: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/generateAnchors.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/generateAnchors.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:543: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:517: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:647: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:374: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/common.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/common.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:530: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:634: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerImage.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerImage.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:348: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:439: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:413: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:335: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:361: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:582: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:374: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:556: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalsForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalsForward.cu.o] Error 1
[ 35%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:426: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:400: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:387: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/cropAndResizeKernel.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/cropAndResizeKernel.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:621: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o] Error 1
[ 36%] Built target gen_onnx_proto
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:400: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/decodeBBoxes.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/decodeBBoxes.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:439: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gatherTopDetections.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gatherTopDetections.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:491: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/nmsLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/nmsLayer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:478: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:413: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/detectionForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/detectionForward.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:569: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:634: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:504: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o] Error 1
plugin/CMakeFiles/nvinfer_plugin.dir/build.make:647: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/common/cudaDriverWrapper.cu.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/common/cudaDriverWrapper.cu.o] Error 1
[ 36%] Built target caffe_proto
[ 38%] Built target onnx_proto
[ 49%] Built target nvcaffeparser
[ 58%] Built target nvcaffeparser_static
[ 62%] Built target nvonnxparser
[ 64%] Built target nvonnxparser_static
[ 65%] Built target onnx2trt
[ 67%] Built target getSupportedAPITest
CMakeFiles/Makefile2:243: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/all' failed
make[1]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
CMakeFiles/Makefile2:298: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/all' failed
make[1]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/all] Error 2
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

So I modify the CMakeLists.txt at /TensorRT
to comment line 89.
Then I go back to ./build folder.

```sudo make clean
sudo make -j

```build ›› sudo make -j                                                                                         ✹ release/7.0
Building for TensorRT version: 7.0.0.1, library version: 7.0.0
-- Targeting TRT Platform: x86_64
-- GPU_ARCHS is not defined. Generating CUDA code for default SMs: 35;53;61;70
-- CUDA version set to 10.2
-- cuDNN version set to 7.6
-- Protobuf version set to 3.0.0
CMake Warning at CMakeLists.txt:200 (message):
  Detected CUDA version is <= 10.0! Removing BERT plugins from compilation
  list.


-- Using libprotobuf /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so
-- ==========================================================================================
-- ========================= Importing and creating target nvuffparser ==========================
-- Looking for library nvparsers
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvparsers.so
-- ==========================================================================================
-- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
-- /home/chieh/github/TensorRT/build/parsers/caffe
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.15.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/g++
--   C++ compiler version  : 7.4.0
--   CXX flags             : -Wno-deprecated-declarations  -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor
--   Build type            : Release
--   Compile definitions   : _PROTOBUF_INSTALL_DIR=/home/chieh/github/TensorRT/build;ONNX_NAMESPACE=onnx2trt_onnx
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /usr/local
--   CMAKE_MODULE_PATH     : 
-- 
--   ONNX version          : 1.6.0
--   ONNX NAMESPACE        : onnx2trt_onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
-- Found TensorRT headers at /home/chieh/github/TensorRT/include
-- Find TensorRT libs at /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer_plugin.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libmyelin.so
...
-- Adding new sample: trtexec
--     - Parsers Used: caffe;uff;onnx
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build
[  0%] Creating directories for 'third_party.protobuf'
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o
[  0%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/normalizePlugin/normalizePlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nmsPlugin/nmsPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSInference.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/nmsHelper.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/nmsHelper.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/reorgPlugin/reorgPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/cropAndResizePlugin/cropAndResizePlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nvFasterRCNN/nvFasterRCNNPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cpp.o
[  2%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchTilePlugin/batchTilePlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/pyramidROIAlignPlugin/pyramidROIAlignPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/proposalPlugin/proposalPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/InferPlugin.cpp.o
[  2%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/generateAnchors.cu.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/__/samples/common/logger.cpp.o
[  3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalPlugin/proposalPlugin.cpp.o
[  4%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalsForward.cu.o
[  4%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o
[  5%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o
[  5%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/nmsLayer.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/bboxDeltas2Proposals.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/reorgForward.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/proposalKernel.cu.o
[  7%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/detectionForward.cu.o
[  7%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[  8%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/cropAndResizePlugin/cropAndResizePlugin.cpp.o
[  9%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/cropAndResizeKernel.cu.o
[  9%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cu.o
[ 10%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/decodeBBoxes.cu.o
[ 11%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSPlugin.cpp.o
[ 11%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o
[ 12%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/__/samples/common/logger.cpp.o
[ 15%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/detectionLayerPlugin/detectionLayerPlugin.cpp.o
[ 25%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gridAnchorLayer.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/extractFgScores.cu.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchTilePlugin/batchTilePlugin.cpp.o
[ 27%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/kernel.cpp.o
[ 27%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSInference.cpp.o
[ 30%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/normalizePlugin/normalizePlugin.cpp.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o
[ 30%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/kernel.cpp.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o
[ 27%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/flattenConcat/flattenConcat.cpp.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o
[ 30%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/common.cu.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/detectionLayerPlugin/detectionLayerPlugin.cpp.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/normalizeLayer.cu.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/regionPlugin/regionPlugin.cpp.o
[ 29%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/InferPlugin.cpp.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/priorBoxLayer.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerImage.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/regionForward.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/regionPlugin/regionPlugin.cpp.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o
[ 28%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/sortScoresPerClass.cu.o
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/flattenConcat/flattenConcat.cpp.o
[ 29%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/proposalLayerPlugin/proposalLayerPlugin.cpp.o
[ 31%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalLayerPlugin/proposalLayerPlugin.cpp.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o
[ 29%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/pyramidROIAlignPlugin/pyramidROIAlignPlugin.cpp.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/gatherTopDetections.cu.o
[ 28%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/allClassNMS.cu.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/permuteData.cu.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o
[ 29%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/cudaDriverWrapper.cu.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o
[ 31%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cpp.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/roiPooling.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/rproiInferenceFused.cu.o
[ 32%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernels/maskRCNNKernels.cu.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nvFasterRCNN/nvFasterRCNNPlugin.cpp.o
[ 32%] Performing download step (download, verify and extract) for 'third_party.protobuf'
-- File already exists but no hash specified (use URL_HASH):
  file='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
Old file will be removed and new file downloaded from URL.
-- Downloading...
   dst='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
   timeout='none'
-- Using src='https://github.com/google/protobuf/releases/download/v3.0.0/protobuf-cpp-3.0.0.tar.gz'
-- [download 0% complete]
...
-- [download 100% complete]
-- Downloading... done
-- extracting...
     src='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
     dst='/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[ 34%] No update step for 'third_party.protobuf'
[ 34%] No patch step for 'third_party.protobuf'
[ 34%] Performing configure step for 'third_party.protobuf'
-- The C compiler identification is GNU 7.4.0
/home/chieh/github/TensorRT/plugin/common/kernels/proposalKernel.cu(34): warning: variable "ALIGNMENT" was declared but never referenced

-- The CXX compiler identification is GNU 7.4.0
/home/chieh/github/TensorRT/plugin/common/kernels/proposalKernel.cu(34): warning: variable "ALIGNMENT" was declared but never referenced

-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/g++
-- Check for working CXX compiler: /usr/bin/g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Looking for pthread.h
/home/chieh/github/TensorRT/plugin/common/kernels/proposalKernel.cu(34): warning: variable "ALIGNMENT" was declared but never referenced

-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
/home/chieh/github/TensorRT/plugin/common/kernels/proposalKernel.cu(34): warning: variable "ALIGNMENT" was declared but never referenced

-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.11") 
CMake Warning (dev) at install.cmake:41 (message):
  The file
  "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/repeated_field_reflection.h"
  is listed in
  "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/cmake/cmake/extract_includes.bat.in"
  but there not exists.  The file will not be installed.
Call Stack (most recent call first):
  CMakeLists.txt:169 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf
[ 34%] Performing build step for 'third_party.protobuf'
Scanning dependencies of target libprotobuf-lite
Scanning dependencies of target libprotobuf
/home/chieh/github/TensorRT/plugin/common/kernels/proposalKernel.cu(34): warning: variable "ALIGNMENT" was declared but never referenced

[  1%] Building CXX object CMakeFiles/libprotobuf-lite.dir/src/google/protobuf/arena.cc.o
...
[ 98%] Linking CXX static library libprotoc.a
[ 98%] Built target libprotoc
Scanning dependencies of target protoc
[ 99%] Building CXX object CMakeFiles/protoc.dir/src/google/protobuf/compiler/main.cc.o
[100%] Linking CXX executable protoc
[100%] Built target protoc
[ 35%] Performing install step for 'third_party.protobuf'
[ 12%] Built target libprotobuf-lite
[ 51%] Built target libprotobuf
[ 98%] Built target libprotoc
[100%] Built target protoc
Install the project...
-- Install configuration: "Release"
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf-lite.a
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotoc.a
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/bin/protoc
-- Up-to-date: /home/chieh/github/TensorRT/build/third_party.protobuf/include/google/protobuf/any.h
...
-- Up-to-date: /home/chieh/github/TensorRT/build/third_party.protobuf/include/google/protobuf/compiler/plugin.proto
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-targets.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-targets-release.cmake
-- Up-to-date: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-config.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-config-version.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-module.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-options.cmake
[ 35%] Completed 'third_party.protobuf'
[ 35%] Built target third_party.protobuf
[ 35%] proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
[ 35%] Running gen_proto.py on onnx/onnx.in.proto
Processing /home/chieh/github/TensorRT/parsers/onnx/third_party/onnx/onnx/onnx.in.proto
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto3
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-ml.pb.h
generating /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_pb.py
[ 36%] Running C++ protocol buffer compiler on /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
[ 36%] Built target gen_onnx_proto
[ 36%] Built target caffe_proto
[ 36%] Running gen_proto.py on onnx/onnx-operators.in.proto
Scanning dependencies of target nvcaffeparser
Scanning dependencies of target nvcaffeparser_static
Processing /home/chieh/github/TensorRT/parsers/onnx/third_party/onnx/onnx/onnx-operators.in.proto
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto3
Writing /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators-ml.pb.h
generating /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_operators_pb.py
[ 36%] Running C++ protocol buffer compiler on /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
Scanning dependencies of target onnx_proto
[ 36%] Building CXX object parsers/onnx/third_party/onnx/CMakeFiles/onnx_proto.dir/onnx/onnx_onnx2trt_onnx-ml.pb.cc.o
[ 37%] Building CXX object parsers/onnx/third_party/onnx/CMakeFiles/onnx_proto.dir/onnx/onnx-operators_onnx2trt_onnx-ml.pb.cc.o
...
[ 89%] Building CXX object samples/opensource/trtexec/CMakeFiles/trtexec.dir/__/__/common/sampleEngines.cpp.o
[ 89%] Building CXX object samples/opensource/trtexec/CMakeFiles/trtexec.dir/__/__/common/sampleOptions.cpp.o
[ 89%] Building CXX object samples/opensource/trtexec/CMakeFiles/trtexec.dir/__/__/common/sampleInference.cpp.o
[ 89%] Building CXX object samples/opensource/sampleSSD/CMakeFiles/sample_ssd.dir/sampleSSD.cpp.o
[ 89%] Building CXX object samples/opensource/sampleUffFasterRCNN/CMakeFiles/sample_uff_fasterRCNN.dir/sampleUffFasterRCNN.cpp.o
[ 90%] Building CXX object samples/opensource/sampleGoogleNet/CMakeFiles/sample_googlenet.dir/sampleGoogleNet.cpp.o
In file included from /home/chieh/github/TensorRT/samples/opensource/samplePlugin/samplePlugin.cpp:29:0:
/usr/local/cuda/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
    ...
/usr/local/cuda/include/cuda_runtime_api.h:8796:77: error: ‘pGraphNode’ was not declared in this scope
...
/usr/local/cuda/include/cuda_runtime_api.h:9600:56: error: ‘cudaGraph_t’ was not declared in this scope
/usr/local/cuda/include/cuda_runtime_api.h:9600:56: note: suggested alternative: ‘cudaError_t’
 extern __host__ cudaError_t CUDARTAPI cudaGraphDestroy(cudaGraph_t graph);
                                                        ^~~~~~~~~~~
                                                        cudaError_t
samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/build.make:62: recipe for target 'samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/samplePlugin.cpp.o' failed
make[2]: *** [samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/samplePlugin.cpp.o] Error 1
CMakeFiles/Makefile2:2001: recipe for target 'samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/all' failed
make[1]: *** [samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 90%] Linking CXX executable ../../../out/sample_googlenet
[ 90%] Linking CXX executable ../../../out/sample_uff_mnist
[ 90%] Linking CXX executable ../../../out/sample_onnx_mnist
[ 91%] Linking CXX executable ../../../out/sample_mnist
[ 91%] Linking CXX executable ../../../out/sample_dynamic_reshape
[ 91%] Built target sample_uff_mnist
[ 91%] Built target sample_googlenet
[ 91%] Built target sample_onnx_mnist
[ 91%] Built target sample_mnist
[ 91%] Built target sample_dynamic_reshape
[ 92%] Linking CXX executable ../../../out/sample_mnist_api
[ 92%] Linking CXX executable ../../../out/sample_uff_plugin_v2_ext
[ 92%] Built target sample_mnist_api
[ 92%] Linking CXX executable ../../../out/sample_uff_maskRCNN
[ 92%] Linking CXX executable ../../../out/sample_mlp
[ 92%] Built target sample_uff_plugin_v2_ext
[ 92%] Linking CXX executable ../../../out/sample_movielens_mps
[ 94%] Linking CXX executable ../../../out/sample_reformat_free_io
[ 94%] Built target sample_uff_maskRCNN
[ 94%] Built target sample_mlp
[ 95%] Linking CXX executable ../../../out/sample_movielens
[ 95%] Built target sample_movielens_mps
[ 95%] Linking CXX executable ../../../out/sample_int8_api
[ 95%] Built target sample_reformat_free_io
[ 95%] Built target sample_movielens
[ 95%] Linking CXX executable ../../../out/sample_fasterRCNN
[ 95%] Linking CXX executable ../../../out/sample_int8
[ 96%] Linking CXX executable ../../../out/sample_char_rnn
[ 96%] Built target sample_int8_api
[ 96%] Built target sample_int8
[ 96%] Built target sample_fasterRCNN
[ 97%] Linking CXX executable ../../../out/trtexec
[ 97%] Built target sample_char_rnn
[ 97%] Linking CXX executable ../../../out/sample_uff_ssd
[ 97%] Built target sample_uff_ssd
[ 97%] Built target trtexec
[ 98%] Linking CXX executable ../../../out/sample_ssd
[ 98%] Linking CXX executable ../../../out/sample_uff_fasterRCNN
[ 98%] Built target sample_ssd
[ 98%] Built target sample_uff_fasterRCNN
[ 98%] Linking CXX executable ../../../out/sample_nmt
[ 98%] Built target sample_nmt
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

I already remove the build and rebuild again. It seems usually to meet this problem.

samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/build.make:62: recipe for target 'samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/samplePlugin.cpp.o' failed
make[2]: *** [samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/samplePlugin.cpp.o] Error 1
CMakeFiles/Makefile2:2001: recipe for target 'samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/all' failed
make[1]: *** [samples/opensource/samplePlugin/CMakeFiles/sample_plugin.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....

I am not sure where it got wrong. However, I saw many error message about /usr/local/cuda/include/cuda_runtime_api.h
Does it happen because of my cuda?
Is there any idea about this problem?
I really need a help here...
Thanks for your patient!

Environment

TensorRT Version: 7.0.0.11
GPU Type: GTX 1060
Nvidia Driver Version:

build ›› nvidia-smi                                                                                           ✹ release/7.0
Thu Jan 16 11:38:36 2020       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.33.01    Driver Version: 440.33.01    CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 106...  On   | 00000000:01:00.0  On |                  N/A |
|  0%   43C    P8    12W / 140W |    583MiB /  6075MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      1946      G   /usr/lib/xorg/Xorg                            18MiB |
|    0      2239      G   /usr/bin/gnome-shell                          48MiB |
|    0      4250      G   /usr/lib/xorg/Xorg                           197MiB |
|    0      4393      G   /usr/bin/gnome-shell                         133MiB |
|    0      5574      G   ...quest-channel-token=1535676813645543464   146MiB |
|    0     10476      G   ...quest-channel-token=1533008657078172562    33MiB |
+-----------------------------------------------------------------------------+

CUDA Version:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89

CUDNN Version: 7.6
Operating System + Version: Ubuntu 18.04
Python Version (if applicable): 3.6
TensorFlow Version (if applicable): 1.14
PyTorch Version (if applicable): 1.3.1

If you want to know more detail information, please let me know. I will provide it.
Thanks again!

OSS Build invalid

Most helpful comment

Hi @chiehpower ,

Sorry I'm not quite sure what to tell you. If you can build this inside of a container ex: nvcr.io/nvidia/tensorrt:20.01-py3, then you likely just have a config issue. If that's the case, I think the easiest path would be to just cleanly reinstall CUDA/CUDNN, reboot machine, make sure nvidia-smi works correctly, and try building again.

You should be able to easily build inside of a container using the provided script in the container at bash /opt/tensorrt/install_opensource.sh, or something like this: https://github.com/rmccorm4/tensorrt-utils/tree/master/OSS

All 12 comments

same problem

Hi @chiehpower @skywo1f,

Some things I noticed:

  1. In your cmake .. output, this line:
-- GPU_ARCHS is not defined. Generating CUDA code for default SMs: 35;53;61;70

Note above here that SM 75 is not included. Then, in the output of make -j $(nproc):

nvcc fatal   : Unsupported gpu architecture 'compute_75'

Can you try specifying -DGPU_ARCHS=\https://developer.nvidia.com/cuda-gpus

  1. These 2 lines also seem to conflict, not sure why this is happening:
-- CUDA version set to 10.2
CMake Warning at CMakeLists.txt:200 (message):
  Detected CUDA version is <= 10.0! Removing BERT plugins from compilation list.

Hi @chiehpower @skywo1f,

Some things I noticed:

  1. In your cmake .. output, this line:
-- GPU_ARCHS is not defined. Generating CUDA code for default SMs: 35;53;61;70

Note above here that SM 75 is not included. Then, in the output of make -j $(nproc):

nvcc fatal   : Unsupported gpu architecture 'compute_75'

Can you try specifying -DGPU_ARCHS= where is the compute capability for your specific GPU? I believe it will be -DGPU_ARCHS=61 for your GTX 1060: https://developer.nvidia.com/cuda-gpus

  1. These 2 lines also seem to conflict, not sure why this is happening:
-- CUDA version set to 10.2
CMake Warning at CMakeLists.txt:200 (message):
  Detected CUDA version is <= 10.0! Removing BERT plugins from compilation list.

Hi @rmccorm4,

Highly thanks for your reply!

First of all, I removed the build folder, and did it again. (See my commands below.)

mkdir build
cd build   
cmake .. -DCMAKE_CUDA_COMPILER=/usr/local/cuda-10.2/bin/nvcc -DTRT_LIB_DIR=/home/chieh/Downloads/TensorRT-7.0.0.11/lib -DTRT_BIN_DIR=`pwd`/out -DGPU_ARCHS=61

Output :

Building for TensorRT version: 7.0.0.1, library version: 7.0.0
-- The CXX compiler identification is GNU 7.4.0
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CXX compiler: /usr/bin/g++
-- Check for working CXX compiler: /usr/bin/g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Targeting TRT Platform: x86_64
-- GPU_ARCHS defined as 61. Generating CUDA code for SM 61
-- CUDA version set to 10.2
-- cuDNN version set to 7.6
-- Protobuf version set to 3.0.0
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.1") 
-- Checking for one of the modules 'zlib'
-- Found CUDA: /usr/local/cuda-10.2 (found suitable version "10.2", minimum required is "10.2") 
-- Using libprotobuf /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so
-- ==========================================================================================
-- ========================= Importing and creating target nvuffparser ==========================
-- Looking for library nvparsers
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvparsers.so
-- ==========================================================================================
-- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
-- /home/chieh/github/TensorRT/build/parsers/caffe
-- The C compiler identification is GNU 7.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Build type not set - defaulting to Release
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.15.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/g++
--   C++ compiler version  : 7.4.0
--   CXX flags             : -Wno-deprecated-declarations  -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor
--   Build type            : Release
--   Compile definitions   : _PROTOBUF_INSTALL_DIR=/home/chieh/github/TensorRT/build;ONNX_NAMESPACE=onnx2trt_onnx
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /home/chieh/Downloads/TensorRT-7.0.0.11/lib/..
--   CMAKE_MODULE_PATH     : 
-- 
--   ONNX version          : 1.6.0
--   ONNX NAMESPACE        : onnx2trt_onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
-- Found TensorRT headers at /home/chieh/github/TensorRT/include
-- Find TensorRT libs at /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer_plugin.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libmyelin.so
-- Found TENSORRT: /home/chieh/github/TensorRT/include  
...
-- Adding new sample: trtexec
--     - Parsers Used: caffe;uff;onnx
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build

(everything looks good)
Then,

make -j$(nproc)   

That's what I got the error messages.

Scanning dependencies of target third_party.protobuf
Scanning dependencies of target nvinfer_plugin
Scanning dependencies of target nvinfer_plugin_static
[  0%] Creating directories for 'third_party.protobuf'
[  0%] Performing download step (download, verify and extract) for 'third_party.protobuf'
-- Downloading...
   dst='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
   timeout='none'
-- Using src='https://github.com/google/protobuf/releases/download/v3.0.0/protobuf-cpp-3.0.0.tar.gz'
[  0%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nmsPlugin/nmsPlugin.cpp.o
[  0%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/normalizePlugin/normalizePlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/reorgPlugin/reorgPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/normalizePlugin/normalizePlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: error: ‘cudaExternalMemory_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                ^~~~~~~~~~~~~~~~~~~~
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/reorgPlugin/reorgPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/reorgPlugin/reorgPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~

[Ignore... there are a lot of similar error messages.]

               ^~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:9559:101: error: expression list treated as compound expression in initializer [-fpermissive]
 extern __host__ cudaError_t CUDARTAPI cudaGraphLaunch(cudaGraphExec_t graphExec, cudaStream_t stream);
                                                                                                     ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:9580:60: error: ‘cudaGraphExec_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaGraphExecDestroy(cudaGraphExec_t graphExec);
                                                            ^~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:9580:60: note: suggested alternative: ‘cudaGraphExecUpdate’
 extern __host__ cudaError_t CUDARTAPI cudaGraphExecDestroy(cudaGraphExec_t graphExec);
                                                            ^~~~~~~~~~~~~~~
                                                            cudaGraphExecUpdate
/usr/local/cuda-10.2/include/cuda_runtime_api.h:9600:56: error: ‘cudaGraph_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaGraphDestroy(cudaGraph_t graph);
                                                        ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:9600:56: note: suggested alternative: ‘cudaError_t’
 extern __host__ cudaError_t CUDARTAPI cudaGraphDestroy(cudaGraph_t graph);
                                                        ^~~~~~~~~~~
                                                        cudaError_t
-- [download 1% complete]
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:101: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o] Error 1
-- [download 2% complete]
-- [download 3% complete]
CMakeFiles/Makefile2:298: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/all' failed
make[1]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/all] Error 2

[ Ignore ]

-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-module.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-options.cmake
[  4%] Completed 'third_party.protobuf'
[  4%] Built target third_party.protobuf
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

On the other hand, as you mentioned of the second point, is there any method to check that whether I have used or I have installed any other lower cuda version?

(I am sorry about my previous posts of duplicate lines.)

Thank you so much!

Sincerely,
Chieh

@chiehpower please edit your posts and truncate the errors to just include the relevant parts / remove duplicate lines

Hi @chiehpower,

Honestly I don't think this is the proper solution because I really doubt there's a typo here, but you could try this as it seemed to work for many people: https://devtalk.nvidia.com/default/topic/1045857/tensorrt/onnx-tensorrt-build-failure/post/5307873/#5307873. I think this is stemming from a configuration issue, and not a typo, because this wouldn't have gotten past any kind of testing.

I'll continue to look a little bit into a more proper solution.

@chiehpower you said your CUDNN version is "7.6", but can you be more specific? Is it 7.6.5? If not, can you try upgrading to 7.6.5? -- https://github.com/onnx/onnx-tensorrt/issues/97#issuecomment-533779589

$ cat /usr/local/cuda-10.2/include/cudnn.h | grep CUDNN_MAJOR -A 2
#define CUDNN_MAJOR 7
#define CUDNN_MINOR 6
#define CUDNN_PATCHLEVEL 5

export CUDNN_INSTALL_DIR=/home/chieh/Downloads/cuda_102_cudnn76

Similarly, I don't think this CUDNN path looks right, it's usually inside the cuda dir. Note if you didn't define this variable, the Makefile would default to the cuda path. Something like:

../Makefile.config:8: CUDNN_INSTALL_DIR variable is not specified, using $CUDA_INSTALL_DIR by default, use CUDNN_INSTALL_DIR=<cudnn_directory> to change.

Hi @rmccorm4,

I will try this post. Thanks for your suggestions!

Honestly I don't think this is the proper solution because I really doubt there's a typo here, but you could try this as it seemed to work for many people: https://devtalk.nvidia.com/default/topic/1045857/tensorrt/onnx-tensorrt-build-failure/post/5307873/#5307873. I think this is stemming from a configuration issue, and not a typo, because this wouldn't have gotten past any kind of testing.

My CUDNN specific version is 7.6.5.32.
I hear your helpful information! I will check it deeply and then try it again.

@chiehpower you said your CUDNN version is "7.6", but can you be more specific? Is it 7.6.5? If not, can you try upgrading to 7.6.5? -- onnx/onnx-tensorrt#97 (comment)

$ cat /usr/local/cuda-10.2/include/cudnn.h | grep CUDNN_MAJOR -A 2
#define CUDNN_MAJOR 7
#define CUDNN_MINOR 6
#define CUDNN_PATCHLEVEL 5

export CUDNN_INSTALL_DIR=/home/chieh/Downloads/cuda_102_cudnn76

Similarly, I don't think this CUDNN path looks right, it's usually inside the cuda dir. Note if you didn't define this variable, the Makefile would default to the cuda path. Something like:

../Makefile.config:8: CUDNN_INSTALL_DIR variable is not specified, using $CUDA_INSTALL_DIR by default, use CUDNN_INSTALL_DIR=<cudnn_directory> to change.

Thanks for your time to discuss my problems!
I will keep updating if I get any advanced news.

Best regards,
Chieh

My CUDNN specific version is 7.6.5.32.

This version looks fine.

So instead I would double check export CUDNN_INSTALL_DIR=/home/chieh/Downloads/cuda_102_cudnn76. Maybe try not specifying this path and letting CMake figure it out for you, or seeing if there's a different path that makes more sense

Hi @rmccorm4,

Thanks for your advice!!!

After I double checked, I already tried the ways below.

  1. Modify the #include "driver_types.h" to #include in cudnn.h Reference
  2. Remove the path of export CUDNN_INSTALL_DIR from my env.

After I did 1 and 2, I remove the build folder and tried whole steps again.

build ›› cmake .. -DCMAKE_CUDA_COMPILER=/usr/local/cuda-10.2/bin/nvcc -DTRT_LIB_DIR=/home/chieh/Downloads/TensorRT-7.0.0.11/lib -DTRT_BIN_DIR=`pwd`/out -DGPU_ARCHS=61

Building for TensorRT version: 7.0.0.1, library version: 7.0.0
-- The CXX compiler identification is GNU 7.4.0
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CXX compiler: /usr/bin/g++
-- Check for working CXX compiler: /usr/bin/g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Targeting TRT Platform: x86_64
-- GPU_ARCHS defined as 61. Generating CUDA code for SM 61
-- CUDA version set to 10.2
-- cuDNN version set to 7.6
-- Protobuf version set to 3.0.0
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.1") 
-- Checking for one of the modules 'zlib'
-- Found CUDA: /usr/local/cuda-10.2 (found suitable version "10.2", minimum required is "10.2") 
-- Using libprotobuf /home/chieh/github/TensorRT/build/third_party.protobuf/lib/libprotobuf.a
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so
-- ==========================================================================================
-- ========================= Importing and creating target nvuffparser ==========================
-- Looking for library nvparsers
-- Library that was found /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvparsers.so
-- ==========================================================================================
-- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h
-- /home/chieh/github/TensorRT/build/parsers/caffe
-- The C compiler identification is GNU 7.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Build type not set - defaulting to Release
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto
Generated: /home/chieh/github/TensorRT/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.15.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/g++
--   C++ compiler version  : 7.4.0
--   CXX flags             : -Wno-deprecated-declarations  -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor
--   Build type            : Release
--   Compile definitions   : _PROTOBUF_INSTALL_DIR=/home/chieh/github/TensorRT/build;ONNX_NAMESPACE=onnx2trt_onnx
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /home/chieh/Downloads/TensorRT-7.0.0.11/lib/..
--   CMAKE_MODULE_PATH     : 
-- 
--   ONNX version          : 1.6.0
--   ONNX NAMESPACE        : onnx2trt_onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
-- Found TensorRT headers at /home/chieh/github/TensorRT/include
-- Find TensorRT libs at /home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libnvinfer_plugin.so;/home/chieh/Downloads/TensorRT-7.0.0.11/lib/libmyelin.so
-- Found TENSORRT: /home/chieh/github/TensorRT/include  
-- Adding new sample: sample_char_rnn
--     - Parsers Used: none
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_dynamic_reshape
--     - Parsers Used: onnx
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_fasterRCNN
--     - Parsers Used: caffe
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_googlenet
--     - Parsers Used: caffe
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_int8
--     - Parsers Used: caffe
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_int8_api
--     - Parsers Used: onnx
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_mlp
--     - Parsers Used: caffe
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_mnist
--     - Parsers Used: caffe
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_mnist_api
--     - Parsers Used: caffe
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_movielens
--     - Parsers Used: uff
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_movielens_mps
--     - Parsers Used: uff
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_nmt
--     - Parsers Used: none
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_onnx_mnist
--     - Parsers Used: onnx
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_plugin
--     - Parsers Used: caffe
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_reformat_free_io
--     - Parsers Used: caffe
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_ssd
--     - Parsers Used: caffe
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_uff_fasterRCNN
--     - Parsers Used: uff
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_uff_maskRCNN
--     - Parsers Used: uff
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: sample_uff_mnist
--     - Parsers Used: uff
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_uff_plugin_v2_ext
--     - Parsers Used: uff
--     - InferPlugin Used: OFF
--     - Licensing: opensource
-- Adding new sample: sample_uff_ssd
--     - Parsers Used: uff
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Adding new sample: trtexec
--     - Parsers Used: caffe;uff;onnx
--     - InferPlugin Used: ON
--     - Licensing: opensource
-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build

The error message is

build ›› make -j$(nproc)                                                                                      ✹ release/7.0
[  0%] Creating directories for 'third_party.protobuf'
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o
[  1%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/normalizePlugin/normalizePlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/regionPlugin/regionPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/nmsPlugin/nmsPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/priorBoxPlugin/priorBoxPlugin.cpp.o
[  2%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/reorgPlugin/reorgPlugin.cpp.o
[  2%] Performing download step (download, verify and extract) for 'third_party.protobuf'
-- File already exists but no hash specified (use URL_HASH):
  file='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
Old file will be removed and new file downloaded from URL.
-- Downloading...
   dst='/home/chieh/github/TensorRT/build/third_party.protobuf/src/protobuf-cpp-3.0.0.tar.gz'
   timeout='none'
-- Using src='https://github.com/google/protobuf/releases/download/v3.0.0/protobuf-cpp-3.0.0.tar.gz'
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: error: ‘cudaExternalMemory_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                ^~~~~~~~~~~~~~~~~~~~
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/nmsPlugin/nmsPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: error: ‘cudaExternalMemory_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                ^~~~~~~~~~~~~~~~~~~~
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/reorgPlugin/reorgPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/reorgPlugin/reorgPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: note: suggested alternative: ‘cudaImportExternalMemory’
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                ^~~~~~~~~~~~~~~~~~~~
                                                                cudaImportExternalMemory
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: error: ‘cudaExternalMemory_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:86: error: ‘extMem_out’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);
                                                                                      ^~~~~~~~~~
In file included from /usr/local/cuda-10.2/include/channel_descriptor.h:61:0,
                 from /usr/local/cuda-10.2/include/cuda_runtime.h:95,
                 from /home/chieh/github/TensorRT/plugin/common/plugin.h:19,
                 from /home/chieh/github/TensorRT/plugin/common/kernels/kernel.h:20,
                 from /home/chieh/github/TensorRT/plugin/regionPlugin/regionPlugin.h:18,
                 from /home/chieh/github/TensorRT/plugin/regionPlugin/regionPlugin.cpp:16:
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2297:25: error: expected ‘)’ before ‘*’ token
 typedef void (CUDART_CB *cudaStreamCallback_t)(cudaStream_t stream, cudaError_t status, void *userData);
                         ^
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2365:9: error: ‘cudaStreamCallback_t’ has not been declared
         cudaStreamCallback_t callback, void *userData, unsigned int flags);
         ^~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2532:88: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamBeginCapture(cudaStream_t stream, enum cudaStreamCaptureMode mode);
                                                                                        ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2583:80: error: use of enum ‘cudaStreamCaptureMode’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaThreadExchangeStreamCaptureMode(enum cudaStreamCaptureMode *mode);
                                                                                ^~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2611:81: error: ‘cudaGraph_t’ has not been declared
 extern __host__ cudaError_t CUDARTAPI cudaStreamEndCapture(cudaStream_t stream, cudaGraph_t *pGraph);
                                                                                 ^~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2649:87: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamIsCapturing(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus);
                                                                                       ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:2677:90: error: use of enum ‘cudaStreamCaptureStatus’ without previous declaration
 extern __host__ cudaError_t CUDARTAPI cudaStreamGetCaptureInfo(cudaStream_t stream, enum cudaStreamCaptureStatus *pCaptureStatus, unsigned long long *pId);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~
/usr/local/cuda-10.2/include/cuda_runtime_api.h:3098:64: error: ‘cudaExternalMemory_t’ was not declared in this scope
 extern __host__ cudaError_t CUDARTAPI cudaImportExternalMemory(cudaExternalMemory_t *extMem_out, const struct cudaExternalMemoryHandleDesc *memHandleDesc);

[skip]

/usr/local/cuda-10.2/include/cuda_runtime_api.h:9600:56: note: suggested alternative: ‘cudaError_t’
 extern __host__ cudaError_t CUDARTAPI cudaGraphDestroy(cudaGraph_t graph);
                                                        ^~~~~~~~~~~
                                                        cudaError_t
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:101: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/reorgPlugin/reorgPlugin.cpp.o] Error 1
plugin/CMakeFiles/nvinfer_plugin_static.dir/build.make:127: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/regionPlugin/regionPlugin.cpp.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/regionPlugin/regionPlugin.cpp.o] Error 1
-- [download 0% complete]
CMakeFiles/Makefile2:298: recipe for target 'plugin/CMakeFiles/nvinfer_plugin_static.dir/all' failed
make[1]: *** [plugin/CMakeFiles/nvinfer_plugin_static.dir/all] Error 2
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]

[skip]

-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.11") 
CMake Warning (dev) at install.cmake:41 (message):
  The file "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/repeated_field_reflection.h"
  is listed in
  "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/cmake/cmake/extract_includes.bat.in"
  but there not exists.  The file will not be installed.
Call Stack (most recent call first):
  CMakeLists.txt:169 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Configuring done
-- Generating done
-- Build files have been written to: /home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf
[  5%] Performing build step for 'third_party.protobuf'
Scanning dependencies of target libprotobuf-lite
Scanning dependencies of target libprotobuf
[  0%] Building CXX object CMakeFiles/libprotobuf-lite.dir/src/google/protobuf/arenastring.cc.o
[  1%] Building CXX object CMakeFiles/libprotobuf-lite.dir/src/google/protobuf/arena.cc.o
[  2%] Building CXX object CMakeFiles/libprotobuf-lite.dir/src/google/protobuf/extension_set.cc.o

[skip]

-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-targets-noconfig.cmake
-- Up-to-date: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-config.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-config-version.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-module.cmake
-- Installing: /home/chieh/github/TensorRT/build/third_party.protobuf/lib/cmake/protobuf/protobuf-options.cmake
[  7%] Completed 'third_party.protobuf'
[  7%] Built target third_party.protobuf
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

Both are not work for me.

By the way, I had copied the files where are located at the /cuda_102_cudnn76/lib64 and /cuda_102_cudnn76/include to cuda-10.2/lib64 and cuda-10.2/include when I installed the cudnn.

So you are right, maybe I don't need to particularly export the CUDNN_INSTALL_DIR path.

Here is my export information.

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-10.2/lib64
export CUDA_INSTALL_DIR=/usr/local/cuda-10.2

export CUDNN_INSTALL_DIR=/home/chieh/Downloads/cuda_102_cudnn76

export PATH=$PATH:/usr/local/cuda-10.2/bin
export CUDA_HOME=$CUDA_HOME:/usr/local/cuda-10.2
export PATH=$PATH:~/.local/bin
export PATH=/usr/local/cuda-10.2/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-10.2/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/chieh/Downloads/TensorRT-7.0.0.11/lib
export TRT_RELEASE=/home/chieh/Downloads/TensorRT-7.0.0.11

When I "make all" again, I always saw these problems many times.

plugin/CMakeFiles/nvinfer_plugin.dir/build.make:62: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o' failed
make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o] Error 1
CMakeFiles/Makefile2:243: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/all' failed
make[1]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/all] Error 2
Makefile:151: recipe for target 'all' failed
make: *** [all] Error 2

and

CMake Warning (dev) at install.cmake:41 (message):
  The file
  "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/repeated_field_reflection.h"
  is listed in
  "/home/chieh/github/TensorRT/build/third_party.protobuf/src/third_party.protobuf/cmake/cmake/extract_includes.bat.in"
  but there not exists.  The file will not be installed.
Call Stack (most recent call first):
  CMakeLists.txt:169 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

This third_party.protobuf looks hard to make.
If need more information, please let me know.

Thanks so much!

Sincerely,
Chieh

Hi @chiehpower ,

Sorry I'm not quite sure what to tell you. If you can build this inside of a container ex: nvcr.io/nvidia/tensorrt:20.01-py3, then you likely just have a config issue. If that's the case, I think the easiest path would be to just cleanly reinstall CUDA/CUDNN, reboot machine, make sure nvidia-smi works correctly, and try building again.

You should be able to easily build inside of a container using the provided script in the container at bash /opt/tensorrt/install_opensource.sh, or something like this: https://github.com/rmccorm4/tensorrt-utils/tree/master/OSS

Hi @chiehpower ,

Sorry I'm not quite sure what to tell you. If you can build this inside of a container ex: nvcr.io/nvidia/tensorrt:20.01-py3, then you likely just have a config issue. If that's the case, I think the easiest path would be to just cleanly reinstall CUDA/CUDNN, reboot machine, make sure nvidia-smi works correctly, and try building again.

You should be able to easily build inside of a container using the provided script in the container at bash /opt/tensorrt/install_opensource.sh, or something like this: https://github.com/rmccorm4/tensorrt-utils/tree/master/OSS

Hi @rmccorm4,
Sure!
Thanks for your suggestion. I will try your method.
If I have advanced questions or problems, I will re-open this issue!!
Thanks a lot!!

Hi @rmccorm4 and everyone,

I wanna update my current situation. Finally I resolved this problem!! This problem took me for three months...

I uninstall my cuda and relevant cuda setting. I reinstall my cuda from version 10.2 to 10.0.
(Of course, I don't think so it is cuda version 10.2 to make this problem.)

But one of trick things is that if we just follow these instructions of installing cuda commands, it might lack some libraries. So before I also used this command, sudo apt-get install nvidia-cuda-toolkit to install other libraries, but we can see the output information below. The library version seems like version 9.1. That is why I thought the problem is here because this command install nvidia-cuda-toolkit confuses me.

$ sudo apt-get install nvidia-cuda-toolkit                                              
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  g++-6 libaccinj64-9.1 libcublas9.1 libcudart9.1 libcufft9.1 libcufftw9.1 libcuinj64-9.1
  libcurand9.1 libcusolver9.1 libcusparse9.1 libnppc9.1 libnppial9.1 libnppicc9.1 libnppicom9.1
  libnppidei9.1 libnppif9.1 libnppig9.1 libnppim9.1 libnppist9.1 libnppisu9.1 libnppitc9.1
  libnpps9.1 libnvblas9.1 libnvgraph9.1 libnvrtc9.1 libnvtoolsext1 libnvvm3 libthrust-dev
  libvdpau-dev nvidia-cuda-dev nvidia-cuda-doc nvidia-cuda-gdb nvidia-opencl-dev nvidia-profiler
  nvidia-visual-profiler ocl-icd-opencl-dev opencl-c-headers
Suggested packages:
  g++-6-multilib gcc-6-doc libstdc++6-6-dbg libvdpau-doc libcupti-dev nvidia-driver libpoclu-dev
Recommended packages:
  libnvcuvid1
The following NEW packages will be installed:
  g++-6 libaccinj64-9.1 libcublas9.1 libcudart9.1 libcufft9.1 libcufftw9.1 libcuinj64-9.1
  libcurand9.1 libcusolver9.1 libcusparse9.1 libnppc9.1 libnppial9.1 libnppicc9.1 libnppicom9.1
  libnppidei9.1 libnppif9.1 libnppig9.1 libnppim9.1 libnppist9.1 libnppisu9.1 libnppitc9.1
  libnpps9.1 libnvblas9.1 libnvgraph9.1 libnvrtc9.1 libnvtoolsext1 libnvvm3 libthrust-dev
  libvdpau-dev nvidia-cuda-dev nvidia-cuda-doc nvidia-cuda-gdb nvidia-cuda-toolkit
  nvidia-opencl-dev nvidia-profiler nvidia-visual-profiler ocl-icd-opencl-dev opencl-c-headers
0 upgraded, 38 newly installed, 0 to remove and 7 not upgraded.
Need to get 667 MB/779 MB of archives.
After this operation, 1,798 MB of additional disk space will be used.

So while I was re-installing the cuda version 10.0, I was installing other libraries as well. In addition, I also reinstall TensorRT and everything wokrs well!!!

Now I can pass make step, and successfully build those files of sampleUffMaskRCNN. It makes me really clear.
(BTW, I also did well on AGX and TX2.)

Unfortunately, I still haven't used the nvidia docker yet because of not familiar with using dokcer, but I will try and use it.

I significantly appreciate your help and all comments. It helps me a lot.

Best regards,
Chieh

Was this page helpful?
0 / 5 - 0 ratings

Related issues

sbbug picture sbbug  Â·  5Comments

float123 picture float123  Â·  6Comments

WangXuanBT picture WangXuanBT  Â·  3Comments

mhansinger picture mhansinger  Â·  4Comments

SyGoing picture SyGoing  Â·  4Comments