Cmak: ssl endpoints?

[dmead]

Hi, i'm trying to look at stats on a cluster with ssl enabled. i get this stack trace, but it's unclear how to fix it

kafka.common.BrokerEndPointNotAvailableException: End point PLAINTEXT not found for broker 1
        at kafka.cluster.Broker.getBrokerEndPoint(Broker.scala:141) ~[org.apache.kafka.kafka_2.11-0.9.0.1.jar:na]
        at kafka.utils.ZkUtils$$anonfun$getAllBrokerEndPointsForChannel$1.apply(ZkUtils.scala:180) ~[org.apache.kafka.kafka_2.11-0.9.0.1.jar:na]
        at kafka.utils.ZkUtils$$anonfun$getAllBrokerEndPointsForChannel$1.apply(ZkUtils.scala:180) ~[org.apache.kafka.kafka_2.11-0.9.0.1.jar:na]
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:245) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at scala.collection.AbstractTraversable.map(Traversable.scala:104) ~[org.scala-lang.scala-library-2.11.7.jar:na]
        at kafka.utils.ZkUtils.getAllBrokerEndPointsForChannel(ZkUtils.scala:180) ~[org.apache.kafka.kafka_2.11-0.9.0.1.jar:na]

[dmead]

i've also got this error.

[error] k.m.a.c.KafkaStateActor - Failed to parse broker config NonEmptyList(UnexpectedJSONError(JNull,class org.json4s.JsonAST$JString))

[thirumalrao]

I am also getting this error

[error] k.m.a.c.KafkaStateActor - Failed to parse broker config NonEmptyList(UnexpectedJSONError(JNull,class org.json4s.JsonAST$JString))

[patelh]

I have just created a PR for adding support for secured kafka.

[patelh]

You'll see the new setting for providing a properties files for consumer properties:

kafka-manager.consumer.properties.file=${?CONSUMER_PROPERTIES_FILE}

[drice]

@patelh Can you give an example of this file's usage?

EDIT: I seem to have got it working (accidentally pulled the wrong commit in my Dockerfile). However, please see my comment on the PR. I'm not able to retrieve any offset information.

[Ashish123gs]

Any example how to use kafka-manager.consumer.properties.file to pull offsets ?

[johnjang]

Is this still in progress? Only thing stopping us from using kafka manager is no support for ssl enabled clusters. T.T

[sshantveer]

Is this issue resolved ?

[patelh]

Yes, we are using with SSL in prod.