Eksctl: Tags in managed node groups

Created on 18 Nov 2019  路  7Comments  路  Source: weaveworks/eksctl

Tags (managedNodeGroups[*].tags) in managed nodegroups apply to the EKS Nodegroup resource and do not propagate to the provisioned Autoscaling Group like in unmanaged nodegroups.

Does this mean that tags will not get applied to instances and that the cluster autoscaler will not work?

aremanaged-nodegroup kinimprovement needs-investigation

Most helpful comment

There is supposedly built-in support for cluster-autoscaler tags. This will only work if AWS automatically tags the ASG for the node group taints and labels, without then you can't scale from zero.

https://docs.aws.amazon.com/eks/latest/userguide/managed-node-groups.html

Amazon EKS tags managed node group resources so that they are configured to use the Kubernetes Cluster Autoscaler.

Important
If you are running a stateful application across multiple Availability Zones that is backed by Amazon EBS volumes and using the Kubernetes Cluster Autoscaler, you should configure multiple node groups, each scoped to a single Availability Zone. In addition, you should enable the --balance-similar-node-groups feature.

All 7 comments

There is supposedly built-in support for cluster-autoscaler tags. This will only work if AWS automatically tags the ASG for the node group taints and labels, without then you can't scale from zero.

https://docs.aws.amazon.com/eks/latest/userguide/managed-node-groups.html

Amazon EKS tags managed node group resources so that they are configured to use the Kubernetes Cluster Autoscaler.

Important
If you are running a stateful application across multiple Availability Zones that is backed by Amazon EBS volumes and using the Kubernetes Cluster Autoscaler, you should configure multiple node groups, each scoped to a single Availability Zone. In addition, you should enable the --balance-similar-node-groups feature.

I have experienced that when setting tags on a NodeGroup, the tags will propagate to the ASG and to the EC2 instances.

When settings tags on a managedNodeGroup, the tags do NOT propagate down to the ASG or EC2.

Is there a way to tag corresponding ASGs and instances?

According to https://docs.aws.amazon.com/eks/latest/userguide/eks-using-tags.html, Amazon EKS managed node groups do not supports tag propagation yet. Currently, we would need to do some code to find the associated ASGs and tag them

https://github.com/aws/containers-roadmap/issues/608 is the AWS containers roadmap issue tracking this feature.

For Cluster Autoscaler specifically, the EC2 instances and Auto Scaling Groups created for Managed NodeGroups _are_ automatically tagged with the expected labels:

k8s.io/cluster-autoscaler/enabled:true
k8s.io/cluster-autoscaler/<clustername>: owned

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

Was this page helpful?
0 / 5 - 0 ratings