Loki: Scale out single binary mode

Created on 7 Dec 2018  路  4Comments  路  Source: grafana/loki

Currently the all-in-one (run locally) mode requires no X-Scope-OrgID header. I am not sure if that could be the case for the distributed mode too. Most users of Loki won't need multi-tenancy and not having a gateway would help.

componenloki keepalive kinfeature

Most helpful comment

Any update on this topic? Is it now possible to scale single binary (helm) setup into multiple replicas? Looks like different ring configs can be provided: https://github.com/sboschman/loki/blob/master/production/helm/loki/values.yaml#L33

All 4 comments

It shouldn't be needed, no - we have some middleware that injects a fake header to the no-auth mode. Making the single binary distributed mode work needs:

  • [x] a replacement for consul for distributing the ring; weaveworks/mesh?
  • [x] a flag to cause the ingesters to also query the (local) chunk store - with the micro service design, the queriers would do this independently
  • [ ] docs

I'll hijack this issue for "scale out single binary mode" now.

This issue has been automatically marked as stale because it has not had any activity in the past 30 days. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

Any update on this topic? Is it now possible to scale single binary (helm) setup into multiple replicas? Looks like different ring configs can be provided: https://github.com/sboschman/loki/blob/master/production/helm/loki/values.yaml#L33

We are most of the way to being able to support this, I think it needs better documentation and some testing.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

TakumaNakagame picture TakumaNakagame  路  5Comments

setevoy2 picture setevoy2  路  4Comments

pandey-adarsh147 picture pandey-adarsh147  路  4Comments

SuperQ picture SuperQ  路  5Comments

adityacs picture adityacs  路  5Comments