Conductor: Netflix/Conductor build failure

Created on 8 Mar 2018  路  11Comments  路  Source: Netflix/conductor

Hi,

I am new to this so if possible can you assist me with the issues I am currently facing.

I wan't to orchestrate a couple of web services (_HTTP requests with API endpoints_) my team has created using the Netflix Conductor. For this, I've cloned the Netflix/Conductor git repository to my ubuntu machine and tried building the project directly. But I get this error stating various MySQL tests failed.

Starting a Gradle Daemon (subsequent builds will be faster)

 Configure project :
Git repository not found at /opt/netflix/conductor-master -- nebula-release tasks will not be available. Use the git.root Gradle property to specify a different directory.

 Configure project :conductor-server
A constructor for `org.gradle.api.internal.java.JavaLibrary` is used by Shadow plugin v1.2.x, and has been preserved for compatibility. This has been deprecated and is scheduled to be removed in Gradle 5.0. If you're using the Shadow plugin, try upgrading to v2.x.

Publication nebula not found in project :.
[buildinfo] Not using buildInfo properties file for this build.
Publication named 'nebula' does not exist for project ':' in task ':artifactoryPublish'.

 Task :conductor-mysql-persistence:test

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testMissingName FAILED
    java.lang.ExceptionInInitializerError at MySQLMetadataDAOTest.java:22
        Caused by: java.lang.RuntimeException at MySQLMetadataDAOTest.java:22
            Caused by: ch.vorburger.exec.ManagedProcessException at MySQLMetadataDAOTest.java:22
                Caused by: ch.vorburger.exec.ManagedProcessException at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testDuplicate FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testWorkflowDefOperations FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testTaskDefOperations FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testRemoveTaskDef FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest  testEventHandlers FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:22

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest  pollMessagesTest FAILED
    java.lang.ExceptionInInitializerError at MySQLQueueDAOTest.java:21
        Caused by: java.lang.RuntimeException at MySQLQueueDAOTest.java:21
            Caused by: ch.vorburger.exec.ManagedProcessException at MySQLQueueDAOTest.java:21
                Caused by: ch.vorburger.exec.ManagedProcessException at MySQLQueueDAOTest.java:21
                    Caused by: org.apache.commons.exec.ExecuteException

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest  test FAILED
    java.lang.NoClassDefFoundError at MySQLQueueDAOTest.java:21

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testCreateTaskException FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testCreateTaskException2 FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testPollData FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testTaskCreateDups FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testTaskOps FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  testTaskExceedsLimit FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest  test FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:33

15 tests completed, 15 failed


FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':conductor-mysql-persistence:test'.
 There were failing tests. See the report at: file:///opt/netflix/conductor-master/mysql-persistence/build/reports/tests/test/index.html

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 21s
65 actionable tasks: 9 executed, 56 up-to-date

Do I need to perform any steps before building it? Can you let me know how to achieve this?

PS: I have also installed Netflix/Dynomite which uses Redis Server and Elasticsearch ( v: 2.4.6 ) and both are up and running on ports 6379 and 9200 respectively. Do I need to configure these before the build?

help wanted
Source
picture nikhil-babaria

All 11 comments

@nikhil-babaria are you getting this error during the build process or during the runtime ?

pctreddy picture pctreddy on 9 Mar 2018

@pctreddy I am getting this error during the build process.

nikhil-babaria picture nikhil-babaria on 10 Mar 2018

Did you try building from the root of the project ./gradlew clean build ?

pctreddy picture pctreddy on 26 Mar 2018

@nikhil-babaria Didn't you build as root user ? Same error has occurred when I build as root user.

I created another user and retry to build, I resolved this.

shouhei picture shouhei on 27 Mar 2018

Got same trouble, running ./gradlew build from another user did not help.

star-yar picture star-yar on 17 Jul 2018

If you are still having the issue and you are using OSX, it is probably related to your default openssl installation. If the stack trace of the errors includes something like:

dyld: Library not loaded: /usr/local/opt/openssl/lib/libssl.1.0.0.dylib

you can fix the issue doing:

brew install openssl

After that, you should be able to run ./gradlew build without problems

josedab picture josedab on 18 Jul 2018
🎉1

I'm Using CentOS (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC) ). Updating ssl packages made no use.

star-yar picture star-yar on 19 Jul 2018

I believe this is an issue related to each of our environments: might be missing some library, might be your user for running mariaDb is not root, etc...

I hit the issue that @nikhil-babaria was commenting again, so decided to create a Dockerfile to be used in the future for problems related to builds and tests. For more information, see PR https://github.com/Netflix/conductor/pull/755

josedab picture josedab on 7 Sep 2018

I'm also having a similar error during ./gradlew clean build but because of a NPE, here the logs:

> Task :conductor-mysql-persistence:test FAILED

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest > pollDeferredMessagesTest FAILED
    java.lang.ExceptionInInitializerError at MySQLQueueDAOTest.java:43
        Caused by: java.lang.RuntimeException at MySQLQueueDAOTest.java:43
            Caused by: ch.vorburger.exec.ManagedProcessException at MySQLQueueDAOTest.java:43
                Caused by: ch.vorburger.exec.ManagedProcessException at MySQLQueueDAOTest.java:43
                    Caused by: org.apache.commons.exec.ExecuteException
    java.lang.NullPointerException at MySQLQueueDAOTest.java:49

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest > processUnacksTest FAILED
    java.lang.NoClassDefFoundError at MySQLQueueDAOTest.java:43
    java.lang.NullPointerException at MySQLQueueDAOTest.java:49

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest > complexQueueTest FAILED
    java.lang.NoClassDefFoundError at MySQLQueueDAOTest.java:43
    java.lang.NullPointerException at MySQLQueueDAOTest.java:49

com.netflix.conductor.dao.mysql.MySQLQueueDAOTest > pollMessagesTest FAILED
    java.lang.NoClassDefFoundError at MySQLQueueDAOTest.java:43
    java.lang.NullPointerException at MySQLQueueDAOTest.java:49

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest > testWorkflowDefOperations FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:40
    java.lang.NullPointerException at MySQLMetadataDAOTest.java:46

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest > testEventHandlers FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:40
    java.lang.NullPointerException at MySQLMetadataDAOTest.java:46

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest > testRemoveTaskDef FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:40
    java.lang.NullPointerException at MySQLMetadataDAOTest.java:46

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest > testDuplicate FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:40
    java.lang.NullPointerException at MySQLMetadataDAOTest.java:46

com.netflix.conductor.dao.mysql.MySQLMetadataDAOTest > testTaskDefOperations FAILED
    java.lang.NoClassDefFoundError at MySQLMetadataDAOTest.java:40
    java.lang.NullPointerException at MySQLMetadataDAOTest.java:46

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testPendingByCorrelationId FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testTaskOps FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > complexExecutionTest FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testPending FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testCreateTaskException FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testTaskCreateDups FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testCreateTaskException2 FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testPollData FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

com.netflix.conductor.dao.mysql.MySQLExecutionDAOTest > testTaskExceedsLimit FAILED
    java.lang.NoClassDefFoundError at MySQLExecutionDAOTest.java:31
    java.lang.NullPointerException at MySQLExecutionDAOTest.java:42

18 tests completed, 18 failed

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':conductor-mysql-persistence:test'.
> There were failing tests. See the report at: file:///Users/martinmo/projects/other-tools/conductor/mysql-persistence/build/reports/tests/test/index.html

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1m 39s
109 actionable tasks: 99 executed, 10 up-to-date

Any idea of how this could be solved?

mamt84 picture mamt84 on 10 Nov 2018
👍1

I was also seeing same issue as NPE but trying with @josedab suggestion brew install openssl , solved my problem.

garreananth picture garreananth on 15 Nov 2018

@mamt84 You can try installing maria-db locally to resolve mysql persistence test module's issue.

kishorebanala picture kishorebanala on 17 Jan 2019
Was this page helpful?
0 / 5 - 0 ratings

Related issues

imprabha89 picture imprabha89  路  3Comments
Leggrand picture Leggrand  路  4Comments
HardiChandra picture HardiChandra  路  3Comments
dskarataev picture dskarataev  路  4Comments
RemcoBuddelmeijer picture RemcoBuddelmeijer  路  6Comments