Thanos: Gossips Cluster unit test failed

[jojohappy]

Thanos, Prometheus and Golang version used
Thanos master head - 7a83cda50c8ad0f2bd95f960103a3bc0ac14a33c

What happened
Here is the CI link

The cluster peers could not get the updated metadata, outdated metadata error would be thrown.

How to reproduce it (as minimally and precisely as possible):

Not always happended, it is a small probability event. But the CI test would be failed.

[povilasv]

IMO we should burn gossip tests with fire and get rid of it :fire:

[jojohappy]

@povilasv Agree with you. But at this moment, we have not totally removed the gossip cluster feature.

[yeya24]

Same test error here. https://github.com/improbable-eng/thanos/blob/7a83cda50c8ad0f2bd95f960103a3bc0ac14a33c/pkg/cluster/cluster_test.go#L129

[bwplotka]

You mean flaky test?

[povilasv]

gossip code was removed.