Cmak: Metrics explanations

Created on 10 Aug 2016  Â·  7Comments  Â·  Source: yahoo/CMAK

Hi,
I could not find where to ask this, so I created an issue.

Where I could find the explanation of kafka metrics, for example, what is meaning of Brokers Skewed, Brokers Spread % and so on?

Thanks

Most helpful comment

I had the same question today, so here's the answer if it helps.

  • Skewed : As you can see in the source code app/kafka/manager/model/ActorModel.scala, a broker is skewed if its number of partitions is greater that the average of partitions per broker on the given topic.

    • Example: 2 brokers share 4 partitions, if one of them has 3 partitions, it is skewed (3 > 2)

  • Spread : As you can see in the source code again app/kafka/manager/model/ActorModel.scala, brokers spread is the percentage of brokers in the cluster that has partitions for the given topic.

    • Example: 3 brokers share a topic that has 2 partitions, so 66% of the brokers have partitions for this topic

All 7 comments

+1

+1

I had the same question today, so here's the answer if it helps.

  • Skewed : As you can see in the source code app/kafka/manager/model/ActorModel.scala, a broker is skewed if its number of partitions is greater that the average of partitions per broker on the given topic.

    • Example: 2 brokers share 4 partitions, if one of them has 3 partitions, it is skewed (3 > 2)

  • Spread : As you can see in the source code again app/kafka/manager/model/ActorModel.scala, brokers spread is the percentage of brokers in the cluster that has partitions for the given topic.

    • Example: 3 brokers share a topic that has 2 partitions, so 66% of the brokers have partitions for this topic

Since #353 has been merged, would you consider this issue solved?

thank you very much,I think their mean

yeap

Hi there,

I know it's an old issue but this perfectly replied to my wondering about the skew meaning.

However unless I misunderstand what I am seeing does not seem to respect this rule ?

Example:

image

This topic has 4 partitions for 3 brokers, 1 or the 3 brokers has 2 partitions which is obviously higher than the average number of partition per broker (technically 1.33)

Unless the average number has to be calculated WITHOUT taking in consideration the broker ? (so all brokers but 1)

Thank you!

Was this page helpful?
0 / 5 - 0 ratings

Related issues

dongbin86 picture dongbin86  Â·  3Comments

Angryrou picture Angryrou  Â·  4Comments

josephfrancis picture josephfrancis  Â·  5Comments

PiotrBB picture PiotrBB  Â·  6Comments

dmead picture dmead  Â·  9Comments