Strimzi-kafka-operator: [Bug] ...kafka exporter crashloopbackoff

[superbeer]

when have more traffic in kafka. kafka expoter crashloopbackoff.
it is error form describe pod.
Liveness probe failed
Readiness probe failed:
i am assign more CPU and RAM . but not work. i'm test limit and no limit already.
node is more cpu and ram .

[scholzj]

Can you share your configuration? How many resources you gave it? Can you also share the logs from the exporter - ideally on a debug level?

[superbeer]

  kafkaExporter:
    groupRegex: ".*"
    topicRegex: ".*"
    # resources:
    #   requests:
    #     limits:
    #     cpu: 2000m
    #     memory: 1128Mi
    logging: info
    enableSaramaLogging: true
    readinessProbe:
      initialDelaySeconds: 120
      timeoutSeconds: 30
    livenessProbe:
      initialDelaySeconds: 120
      timeoutSeconds: 30
    template:
      pod:
        tolerations:
          - key: "dedicated"
            operator: "Equal"
            value: "kafka-exporter"

[jgray1206]

We have been having the same issue. No matter the time or resources we throw at the exporter, it always seems to stop working during periods of heavy load in Kafka.

[sknot-rh]

There is an open PR which should improve Kafka Exporter's performance: https://github.com/danielqsj/kafka_exporter/pull/147

[SpeedEX]

There is an open PR which should improve Kafka Exporter's performance: danielqsj/kafka_exporter#147

I feel that it will not merge and release any time soon. Any alternative to use ? How about https://github.com/lightbend/kafka-lag-exporter ?

[scholzj]

The lag exporter is just as any other application at the end. So you should be able to connect it easily and give it a try.

[kpiyush17]

@scholzj
Is there a way to remove liveliness and readiness probes for Kafka exporter?
My yaml config for the exporter:

kafkaExporter:
    topicRegex: ".*"
    groupRegex: ".*"

I am not specifying any liveliness or readiness here. Still, I am seeing the probe in pods.

[scholzj]

The liveness and readiness probes have default values. You can configure them as described in the docs but not disable them: https://strimzi.io/docs/operators/latest/full/using.html#assembly-kafka-exporter-configuration-deployment-configuration-kafka

[kpiyush17]

@scholzj So, any solution for the above issue. I am getting a probe failed issue continuously.

[scholzj]

Well, if we had a solution it would not be an open issue. As I told you in the other isue you opened. This is not a problem with the probes. The KE does not work in some situations and the probes are correctly failing it.

[kpiyush17]

@scholzj Ok thanks for the help.

[scholzj]

Closing this as duplicate to #2480 which can be used to address the exporter issues.