Schema-registry: build fails for schema registry 3.3.0

Created on 18 Sep 2017  路  12Comments  路  Source: confluentinc/schema-registry 
$ git checkout v3.2.2
$ mvn clean test

[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] kafka-schema-registry-parent
[INFO] kafka-schema-registry-client
[INFO] kafka-avro-serializer
[INFO] kafka-schema-registry
[INFO] kafka-json-serializer
[INFO] kafka-connect-avro-converter
[INFO] kafka-schema-registry-package
[INFO] kafka-serde-tools-package
[INFO] maven-plugin
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building kafka-schema-registry-parent 3.2.2
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ kafka-schema-registry-parent ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ kafka-schema-registry-parent ---
[INFO] Starting audit...
Audit done.
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building kafka-schema-registry-client 3.2.2
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ kafka-schema-registry-client ---
...

this starts the unit tests... looking good

$ git checkout v3.3.0
$mvn clean test

[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for io.confluent:kafka-schema-registry-parent:[unknown-version]: Could not transfer artifact io.confluent:rest-utils-parent:pom:3.3.0 from/to confluent (${confluent.maven.repo}): Cannot access ${confluent.maven.repo} with type default using the available connector factories: BasicRepositoryConnectorFactory and 'parent.relativePath' points at wrong local POM @ line 7, column 13
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project io.confluent:kafka-schema-registry-parent:[unknown-version] (/home/koert/src/confluentinc/schema-registry/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM for io.confluent:kafka-schema-registry-parent:[unknown-version]: Could not transfer artifact io.confluent:rest-utils-parent:pom:3.3.0 from/to confluent (${confluent.maven.repo}): Cannot access ${confluent.maven.repo} with type default using the available connector factories: BasicRepositoryConnectorFactory and 'parent.relativePath' points at wrong local POM @ line 7, column 13: Cannot access ${confluent.maven.repo} using the registered transporter factories: WagonTransporterFactory: Unsupported transport protocol -> [Help 2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
...

not so good

help wanted
Source
picture koertkuipers
👍3

Most helpful comment

that seems to have done the trick. thanks!
in case anyone else wants to build it as well, this is my diff:

$ git diff
diff --git a/pom.xml b/pom.xml
index cb0e27e..5ca08c5 100644
--- a/pom.xml
+++ b/pom.xml
@@ -63,10 +63,18 @@
         <repository>
             <id>confluent</id>
             <name>Confluent</name>
-            <url>${confluent.maven.repo}</url>
+            <url>http://packages.confluent.io/maven/</url>
         </repository>
     </repositories>

+    <pluginRepositories>
+        <pluginRepository>
+            <id>confluent</id>
+            <name>Confluent</name>
+            <url>http://packages.confluent.io/maven/</url>
+        </pluginRepository>
+    </pluginRepositories>
+    
     <dependencyManagement>
         <dependencies>
             <dependency>
picture koertkuipers on 6 Oct 2017
👍8

All 12 comments

@koertkuipers please make sure you have included confluent maven repo


confluent
http://packages.confluent.io/maven/

Also, please make sure if you are behind a proxy you are not blocked by it.

Other way to get around this would be to clone common and rest-utils build them in your local and then proceed.

_To build a development version, you may need a development versions of common and rest-utils. After installing these, you can build the Schema Registry with Maven._

Please feel free to reopen the issue if you are still blocked

mageshn picture mageshn on 6 Oct 2017

@mageshn what do you mean by "please make sure you have included confluent maven repo"? included where?

and if this is necessary why is it not included by default?

koertkuipers picture koertkuipers on 6 Oct 2017

i dont see why i would have to clone other repos and build them locally as i am building a release, not a development version.

koertkuipers picture koertkuipers on 6 Oct 2017

@koertkuipers i as trying to convey that it uses
confluent
http://packages.confluent.io/maven/
. So, please make sure you are able to access it.

I was assuming that you were trying to build it so that you could do some development over it.

Are you trying to build it so that you could deploy schema-registry? If so, you can also download them directly https://www.confluent.io/download/

mageshn picture mageshn on 6 Oct 2017

i made this change:

         <repository>
             <id>confluent</id>
             <name>Confluent</name>
-            <url>${confluent.maven.repo}</url>
+            <url>http://packages.confluent.io/maven/</url>
         </repository>

not entirely sure why this wasnt set... but thats ok. now i get:

$ mvn clean test
[INFO] Scanning for projects...
Downloading: http://packages.confluent.io/maven/io/confluent/rest-utils-parent/3.3.0/rest-utils-parent-3.3.0.pom
Downloaded: http://packages.confluent.io/maven/io/confluent/rest-utils-parent/3.3.0/rest-utils-parent-3.3.0.pom (9 KB at 61.2 KB/sec)
Downloading: http://packages.confluent.io/maven/io/confluent/common/3.3.0/common-3.3.0.pom
Downloaded: http://packages.confluent.io/maven/io/confluent/common/3.3.0/common-3.3.0.pom (2 KB at 54.6 KB/sec)
Downloading: http://packages.confluent.io/maven/io/confluent/common-parent/3.3.0/common-parent-3.3.0.pom
Downloaded: http://packages.confluent.io/maven/io/confluent/common-parent/3.3.0/common-parent-3.3.0.pom (21 KB at 699.5 KB/sec)
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: linux
[INFO] os.detected.arch: x86_64
[INFO] os.detected.version: 3.19
[INFO] os.detected.version.major: 3
[INFO] os.detected.version.minor: 19
[INFO] os.detected.release: ubuntu
[INFO] os.detected.release.version: 14.04
[INFO] os.detected.release.like.ubuntu: true
[INFO] os.detected.release.like.debian: true
[INFO] os.detected.classifier: linux-x86_64
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] kafka-schema-registry-parent
[INFO] kafka-schema-registry-client
[INFO] kafka-avro-serializer
[INFO] kafka-schema-registry
[INFO] kafka-json-serializer
[INFO] kafka-connect-avro-converter
[INFO] kafka-schema-registry-package
[INFO] kafka-serde-tools-package
[INFO] maven-plugin
[INFO] kafka-streams-avro-serde
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building kafka-schema-registry-parent 3.3.0
[INFO] ------------------------------------------------------------------------
Downloading: http://packages.confluent.io/maven/io/confluent/common-utils/3.3.0/common-utils-3.3.0.pom
Downloaded: http://packages.confluent.io/maven/io/confluent/common-utils/3.3.0/common-utils-3.3.0.pom (2 KB at 94.9 KB/sec)
Downloading: http://packages.confluent.io/maven/io/confluent/common-utils/3.3.0/common-utils-3.3.0.jar
Downloaded: http://packages.confluent.io/maven/io/confluent/common-utils/3.3.0/common-utils-3.3.0.jar (18 KB at 672.3 KB/sec)
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ kafka-schema-registry-parent ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ kafka-schema-registry-parent ---
Downloading: https://repo.maven.apache.org/maven2/io/confluent/build-tools/3.3.0/build-tools-3.3.0.pom
[WARNING] The POM for io.confluent:build-tools:jar:3.3.0 is missing, no dependency information available
Downloading: https://repo.maven.apache.org/maven2/io/confluent/build-tools/3.3.0/build-tools-3.3.0.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] kafka-schema-registry-parent ....................... FAILURE [  1.089 s]
[INFO] kafka-schema-registry-client ....................... SKIPPED
[INFO] kafka-avro-serializer .............................. SKIPPED
[INFO] kafka-schema-registry .............................. SKIPPED
[INFO] kafka-json-serializer .............................. SKIPPED
[INFO] kafka-connect-avro-converter ....................... SKIPPED
[INFO] kafka-schema-registry-package ...................... SKIPPED
[INFO] kafka-serde-tools-package .......................... SKIPPED
[INFO] maven-plugin ....................................... SKIPPED
[INFO] kafka-streams-avro-serde ........................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.897 s
[INFO] Finished at: 2017-10-06T13:59:10-04:00
[INFO] Final Memory: 17M/209M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:check (validate) on project kafka-schema-registry-parent: Execution validate of goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:check failed: Plugin org.apache.maven.plugins:maven-checkstyle-plugin:2.17 or one of its dependencies could not be resolved: Could not find artifact io.confluent:build-tools:jar:3.3.0 in central (https://repo.maven.apache.org/maven2) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException

seems like it now has trouble finding something called io.confluent:build-tools:jar:3.3.0

koertkuipers picture koertkuipers on 6 Oct 2017
👍4

i prefer to build release myself instead of download confluent platform

koertkuipers picture koertkuipers on 6 Oct 2017

@koertkuipers sorry for the inconvenience. It looks pluginRepositories is not set correctly in the poms. Can you try adding that in the pom for now and pointing to http://packages.confluent.io/maven/. This shoudl possibly fix the issue. Let me know how it goes. If it works, we can fix it on the pom as well.

mageshn picture mageshn on 6 Oct 2017
👍1

that seems to have done the trick. thanks!
in case anyone else wants to build it as well, this is my diff:

$ git diff
diff --git a/pom.xml b/pom.xml
index cb0e27e..5ca08c5 100644
--- a/pom.xml
+++ b/pom.xml
@@ -63,10 +63,18 @@
         <repository>
             <id>confluent</id>
             <name>Confluent</name>
-            <url>${confluent.maven.repo}</url>
+            <url>http://packages.confluent.io/maven/</url>
         </repository>
     </repositories>

+    <pluginRepositories>
+        <pluginRepository>
+            <id>confluent</id>
+            <name>Confluent</name>
+            <url>http://packages.confluent.io/maven/</url>
+        </pluginRepository>
+    </pluginRepositories>
+    
     <dependencyManagement>
         <dependencies>
             <dependency>
koertkuipers picture koertkuipers on 6 Oct 2017
👍8

@koertkuipers glad that worked. I'm not sure why ${confluent.maven.repo} didn't get resolved in the first place. I will have to do some more analysis for that. But pluginRepository is something that needs to be fixed in parent pom. Thanks a lot on working through this.

mageshn picture mageshn on 6 Oct 2017

I have the same issue on https://github.com/confluentinc/kafka-connect-hdfs, when i am building the connector of version 4.0.0.

chentao picture chentao on 15 Mar 2018

I had the same issue of ${confluent.maven.repo} not being interpolated on MacOS with maven 3.5.0. Updating to 3.5.3 seems to resolve it.
Addition of 

<pluginRepositories>
        <pluginRepository>
            <id>confluent</id>
            <name>Confluent</name>
            <url>${confluent.maven.repo}</url>
        </pluginRepository>
 </pluginRepositories>

is still required.

afedulov picture afedulov on 5 Apr 2018
👍1

that seems to have done the trick. thanks!
in case anyone else wants to build it as well, this is my diff:

$ git diff
diff --git a/pom.xml b/pom.xml
index cb0e27e..5ca08c5 100644
--- a/pom.xml
+++ b/pom.xml
@@ -63,10 +63,18 @@
         <repository>
             <id>confluent</id>
             <name>Confluent</name>
-            <url>${confluent.maven.repo}</url>
+            <url>http://packages.confluent.io/maven/</url>
         </repository>
     </repositories>

+    <pluginRepositories>
+        <pluginRepository>
+            <id>confluent</id>
+            <name>Confluent</name>
+            <url>http://packages.confluent.io/maven/</url>
+        </pluginRepository>
+    </pluginRepositories>
+    
     <dependencyManagement>
         <dependencies>
             <dependency>

Worked perfectly after these changes. Thanks.

tavisca-shekharr picture tavisca-shekharr on 27 Jan 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

phaas picture phaas  路  4Comments
benjaminoakes picture benjaminoakes  路  6Comments
phaas picture phaas  路  5Comments
archenroot picture archenroot  路  6Comments
ybyzek picture ybyzek  路  7Comments