I've copied over docker-compose.yml from https://github.com/confluentinc/cp-docker-images/tree/3.3.x/examples/cp-all-in-one and started the image.
Previously, I used to get all the bundled connectors, such as JDBC, Elasticsearch, HDFS, S3, now I don't.
All I'm getting is FileStreamConnector (both Source and Sink versions).
I am seeing the exact same problem for 4.0.0.
same here with 4.0.0 - we also want to include some external connectors like INFLUXDB and so on
I GOT IT, just add the environment variables like:
CONNECT_PLUGIN_PATH: "/usr/share/java/kafka-connect-elasticsearch"
see : https://docs.confluent.io/current/connect/userguide.html @ installing plugins
for the INFLUXDB plugin, i probably just map a directory into the container and reference it via plugin_path
Closing as @wintersommer nailed it.
Not sure if you guys came across same issue, the doc https://docs.confluent.io/current/connect/userguide.html mentioned the plugin path is a comma-separated list of directories, while during my testing it can only be a single path
Kafka Connect finds the plugins using its plugin path, which is a comma-separated list of directories defined in the Kafka Connect鈥檚 worker configuration. To install a plugin, place the plugin directory or uber JAR (or a symbolic link that resolves to one of those) in a directory listed on the plugin path, or update the plugin path to include the absolute path of the directory containing the plugin.
@echo-xu I've got my docker-compose configured as follows and it works for me:
CONNECT_PLUGIN_PATH: /etc/kafka-connect/jars,/usr/share/java/kafka-connect-elasticsearch
I get all of my desired plugins that are in these folders
Most helpful comment
@echo-xu I've got my docker-compose configured as follows and it works for me:
CONNECT_PLUGIN_PATH: /etc/kafka-connect/jars,/usr/share/java/kafka-connect-elasticsearchI get all of my desired plugins that are in these folders