Kops: Cluster Autoscaling support on AWS

[apobbati]

Are there any plans to support cluster autoscaling on AWS ?

Apparently, this support is coming soon to Kubernetes.

[yissachar]

Here's the main Kubernetes issue for this: https://github.com/kubernetes/kubernetes/issues/11935

[apobbati]

Thanks!

[justinsb]

Reopening to track this as something we should document / add support for!

[andrewsykim]

I was involved in the current AWS implementation of the cluster autoscaler, the umbrella issue is https://github.com/kubernetes/contrib/issues/1311. This sounds like something I'd be interested in doing unless there's someone else that has been working on it already.

[tazjin]

It seems like this has been implemented in the autoscaler already.

Is it sensible for kops to add the autoscaler as an addon or should it simply be documented here what the steps are to get it up and running?

[craigwillis85]

I'd be interested in how to set this up as well

[chrislovecnm]

@tazjin I would like to leave kops as vanilla as we can. Provide instructions on how to use addons, but let's keep it focussed on the install. Now if something needs to occur, during the install, to get something to work, and it is something that has valid use cases and need, then I am all for modifying kops.

[LEW21]

Cluster-autoscaler addon currently works, except that there is a bug in the deployment template - https://github.com/kubernetes/kops/blob/master/addons/cluster-autoscaler/v1.4.0.yaml

image:
name: {{IMAGE}}

should be:

image: {{IMAGE}}
name: autoscaler

(I would send a pull request, but I'm waiting for my company to sign CLA)

And you need to give workers IAM permissions: https://github.com/kubernetes/contrib/tree/master/cluster-autoscaler/cloudprovider/aws#permissions

Do it by creating a new inline policy for the nodes.{clustername} role, and not by editing the existing one, because kops overwrites its policy on each kops update cluster --yes.

[andrewsykim]

@LEW21 did you the favour and opened a PR for the bug in the deployment template https://github.com/kubernetes/kops/pull/1167 :).

Re: IAM permissions and other documentation for getting it working with kops I'd figure it can wait for your company to sign the CLA and for you to open a PR :)

[yissachar]

You can track https://github.com/kubernetes/kops/pull/1170 for IAM permissions, which should allow you add the autoscaling permissions to your nodes through kops.

[chrislovecnm]

Can someone update this with any actionable needs?

[yissachar]

@chrislovecnm This should be close-able. In 1.5 we have an autoscaler addon that can be installed, and the IAM permissions on the master are already setup by kops.

We also have a different issue that discusses installing the addon by default.

So I think this can be safely closed.

[chrislovecnm]

closing, please re-open if we need to