Cp-docker-images: Latest image doesn't contain bundled connectors

Created on 5 Dec 2017  路  6Comments  路  Source: confluentinc/cp-docker-images

I've copied over docker-compose.yml from https://github.com/confluentinc/cp-docker-images/tree/3.3.x/examples/cp-all-in-one and started the image.

Previously, I used to get all the bundled connectors, such as JDBC, Elasticsearch, HDFS, S3, now I don't.

All I'm getting is FileStreamConnector (both Source and Sink versions).

Most helpful comment

@echo-xu I've got my docker-compose configured as follows and it works for me:

CONNECT_PLUGIN_PATH: /etc/kafka-connect/jars,/usr/share/java/kafka-connect-elasticsearch

I get all of my desired plugins that are in these folders

All 6 comments

I am seeing the exact same problem for 4.0.0.

same here with 4.0.0 - we also want to include some external connectors like INFLUXDB and so on

I GOT IT, just add the environment variables like:

CONNECT_PLUGIN_PATH: "/usr/share/java/kafka-connect-elasticsearch"

see : https://docs.confluent.io/current/connect/userguide.html @ installing plugins

for the INFLUXDB plugin, i probably just map a directory into the container and reference it via plugin_path

Closing as @wintersommer nailed it.

Not sure if you guys came across same issue, the doc https://docs.confluent.io/current/connect/userguide.html mentioned the plugin path is a comma-separated list of directories, while during my testing it can only be a single path

Kafka Connect finds the plugins using its plugin path, which is a comma-separated list of directories defined in the Kafka Connect鈥檚 worker configuration. To install a plugin, place the plugin directory or uber JAR (or a symbolic link that resolves to one of those) in a directory listed on the plugin path, or update the plugin path to include the absolute path of the directory containing the plugin.

@echo-xu I've got my docker-compose configured as follows and it works for me:

CONNECT_PLUGIN_PATH: /etc/kafka-connect/jars,/usr/share/java/kafka-connect-elasticsearch

I get all of my desired plugins that are in these folders

Was this page helpful?
0 / 5 - 0 ratings

Related issues

OneCricketeer picture OneCricketeer  路  3Comments

gunjanarora picture gunjanarora  路  4Comments

Fobhep picture Fobhep  路  6Comments

jmarcos-cano picture jmarcos-cano  路  4Comments

z3rohour picture z3rohour  路  6Comments