Glow: ninja test failed

[georgeokelly]

Ubuntu 16.04
The test step failed.

[1/1] Running tests...
Test project /home/glow/glow_build_Debug
      Start  1: partitionTest
 1/27 Test  #1: partitionTest .......................   Passed    0.03 sec
      Start  2: tensorsTest
 2/27 Test  #2: tensorsTest .........................   Passed    0.34 sec
      Start  3: imageTest
 3/27 Test  #3: imageTest ...........................   Passed    0.18 sec
      Start  4: gradCheckTest
 4/27 Test  #4: gradCheckTest .......................   Passed    3.08 sec
      Start  5: IROptTest
 5/27 Test  #5: IROptTest ...........................   Passed    0.01 sec
      Start  6: basicIRTest
 6/27 Test  #6: basicIRTest .........................   Passed    0.00 sec
      Start  7: backendTest
 7/27 Test  #7: backendTest .........................Child aborted***Exception:   1.04 sec
      Start  8: MLTest
 8/27 Test  #8: MLTest ..............................Child aborted***Exception:  16.15 sec
      Start  9: operatorTest
 9/27 Test  #9: operatorTest ........................Child aborted***Exception:   3.10 sec
      Start 10: graphTest
10/27 Test #10: graphTest ...........................   Passed    0.54 sec
      Start 11: graphGradTest
11/27 Test #11: graphGradTest .......................   Passed    0.05 sec
      Start 12: graphOptzTest
12/27 Test #12: graphOptzTest .......................   Passed    0.02 sec
      Start 13: graphSchedulerTest
13/27 Test #13: graphSchedulerTest ..................   Passed    0.01 sec
      Start 14: quantizationTest
14/27 Test #14: quantizationTest ....................Child aborted***Exception:   4.46 sec
      Start 15: float16Test
15/27 Test #15: float16Test .........................   Passed    0.00 sec
      Start 16: typeAToTypeBFunctionConverterTest
16/27 Test #16: typeAToTypeBFunctionConverterTest ...   Passed    0.56 sec
      Start 17: UtilsTest
17/27 Test #17: UtilsTest ...........................   Passed    0.04 sec
      Start 18: OCLTest
18/27 Test #18: OCLTest .............................Child aborted***Exception:   0.11 sec
      Start 19: convCorrectnessTest
19/27 Test #19: convCorrectnessTest .................Child aborted***Exception:   2.35 sec
      Start 20: BackendCorrectnessTest
20/27 Test #20: BackendCorrectnessTest ..............Child aborted***Exception:   8.57 sec
      Start 21: GemmTest
21/27 Test #21: GemmTest ............................   Passed    0.03 sec
      Start 22: LLVMIRGenTest
22/27 Test #22: LLVMIRGenTest .......................   Passed    0.01 sec
      Start 23: memoryAllocatorTest
23/27 Test #23: memoryAllocatorTest .................   Passed    0.20 sec
      Start 24: caffe2ImporterTest
24/27 Test #24: caffe2ImporterTest ..................   Passed    0.02 sec
      Start 25: onnxImporterTest
25/27 Test #25: onnxImporterTest ....................   Passed    0.08 sec
      Start 26: onnxifiThreadPoolTest
26/27 Test #26: onnxifiThreadPoolTest ...............   Passed    0.03 sec
      Start 27: GlowOnnxifiManagerTest
27/27 Test #27: GlowOnnxifiManagerTest ..............   Passed    1.40 sec

74% tests passed, 7 tests failed out of 27

Total Test time (real) =  42.41 sec

The following tests FAILED:
      7 - backendTest (Child aborted)
      8 - MLTest (Child aborted)
      9 - operatorTest (Child aborted)
     14 - quantizationTest (Child aborted)
     18 - OCLTest (Child aborted)
     19 - convCorrectnessTest (Child aborted)
     20 - BackendCorrectnessTest (Child aborted)
Errors while running CTest
FAILED: cd /home/glow/glow_build_Debug && /home/glow/cmake-3.13.1-Linux-x86_64/bin/ctest --force-new-ctest-process
ninja: build stopped: subcommand failed.

I follow the steps:

1. git clone https://github.com/pytorch/glow; cd glow/
2. git submodule update --init --recursive
3. sudo apt-get install clang clang-6.0 cmake graphviz libpng-dev \ libprotobuf-dev llvm-6.0 ninja-build protobuf-compiler wget
4. mkdir glow_build_Debug
cd glow_build_Debug

5. cmake -G Ninja ../glow -DCMAKE_BUILD_TYPE=Debug \ -DCMAKE_PREFIX_PATH=/home/glow/glow/utils/llvm_install/
   and here're some information
   ```CMake Warning at CMakeLists.txt:67 (find_package):
   Could not find a configuration file for package "LLVM" that is compatible
   with requested version "7".

   The following configuration files were considered but not accepted:

   /home/glow/glow/utils/llvm_install/lib/cmake/llvm/LLVMConfig.cmake, version: 6.0.1
   /usr/lib/llvm-4.0/cmake/LLVMConfig.cmake, version: 4.0.0
   /usr/lib/llvm-6.0/cmake/LLVMConfig.cmake, version: 6.0.0
   /usr/share/llvm-3.8/cmake/LLVMConfig.cmake, version: 3.8.0

-- Found LLVM 6.0.1
-- Using LLVMConfig.cmake in: /home/glow/glow/utils/llvm_install/lib/cmake/llvm

-- Found Protobuf: /usr/lib/libprotobuf.so (found version "2.6.1")

-- * Summary *
-- CMake version : 3.13.1
-- CMake command : /home/glow/cmake-3.13.1-Linux-x86_64/bin/cmake
-- System : Linux
-- C++ compiler : /usr/bin/c++
-- C++ compiler version : 5.4.0
-- CXX flags : -Wall -Wnon-virtual-dtor -fno-exceptions -fno-rtti -Wnon-virtual-dtor
-- Build type : Debug
-- Compile definitions : WITH_PNG;GLOW_WITH_CPU=1;GLOW_WITH_OPENCL=1;GOOGLE_PROTOBUF_NO_RTTI;ONNX_NAMESPACE=glow_onnx
-- CMAKE_PREFIX_PATH : /home/glow/glow/utils/llvm_install/
-- CMAKE_INSTALL_PREFIX : /usr/local

-- CMAKE_MODULE_PATH : /home/glow/glow/cmake/modules

-- ONNX version : 1.3.0
-- ONNX NAMESPACE : glow_onnx
-- ONNX_BUILD_TESTS : OFF
-- ONNX_BUILD_BENCHMARKS : OFF
-- ONNX_USE_LITE_PROTO : OFF

-- ONNXIFI_DUMMY_BACKEND : OFF

-- Protobuf compiler : /usr/bin/protoc
-- Protobuf includes : /usr/include
-- Protobuf libraries : /usr/lib/libprotobuf.so
-- BUILD_ONNX_PYTHON : OFF
CMake Warning (dev) at tests/unittests/CMakeLists.txt:260 (target_sources):
Policy CMP0076 is not set: target_sources() command converts relative paths
to absolute. Run "cmake --help-policy CMP0076" for policy details. Use
the cmake_policy command to set the policy and suppress this warning.

An interface source of target "BackendCorrectnessTest" has a relative path.
This warning is for project developers. Use -Wno-dev to suppress it.

-- Configuring done
-- Generating done
-- Build files have been written to: /home/glow/glow_build_Debug
```

1. ninja all
2. ninja test

Did I miss some steps? How to fix it?

[nadavrot]

@georgeokelly Could you please run one of the individual tests and paste the output? It should be something like ./tests/operatorTest

[rdzhabarov]

I suspect the problem is that you do not have proper support for OpenCL (see GLOW_WITH_OPENCL=1 CMake flag, you can turn it off and rerun).

To add to what @nadavrot said, the actual error should be in Testing/Temporary/LastTest.log. Can you dump the content of the file?

[georgeokelly]

@rdzhabarov @nadavrot
Thanks, I disable the GLOW_WITH_OPENCL and it works.

[rdzhabarov]

@georgeokelly if you'd like to build with opencl you can take a look here:
https://github.com/pytorch/glow/blob/master/docs/Building.md#opencl-on-ubuntu