Aks-engine: Remove kubelet flags deprecated from k8s 1.10/1.11+

Created on 1 May 2018  路  8Comments  路  Source: Azure/aks-engine

Multiple kubelet flags are now deprecated, they should be removed/set via a config file.

May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --address has been deprecated, This parameter should be set via the config file specified by the Kubelet's
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --allow-privileged has been deprecated, will be removed in a future version
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --anonymous-auth has been deprecated, This parameter should be set via the config file specified by the Kub
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --cgroups-per-qos has been deprecated, This parameter should be set via the config file specified by the Ku
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kub
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubele
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kub
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --enforce-node-allocatable has been deprecated, This parameter should be set via the config file specified
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --event-qps has been deprecated, This parameter should be set via the config file specified by the Kubelet'
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --eviction-hard has been deprecated, This parameter should be set via the config file specified by the Kube
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --feature-gates has been deprecated, This parameter should be set via the config file specified by the Kube
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --image-gc-high-threshold has been deprecated, This parameter should be set via the config file specified b
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --image-gc-low-threshold has been deprecated, This parameter should be set via the config file specified by
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --keep-terminated-pod-volumes has been deprecated, will be removed in a future version
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --max-pods has been deprecated, This parameter should be set via the config file specified by the Kubelet's
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --node-status-update-frequency has been deprecated, This parameter should be set via the config file specif
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --non-masquerade-cidr has been deprecated, will be removed in a future version
May 01 16:48:03 k8s-agentsa-87245758-1 kubelet[8346]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the

1.11 support was added in #2814

Ref:

https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/

backlog

Most helpful comment

journalctl -xeu kubelet
-- Subject: Unit kubelet.service has finished start-up
-- Defined-By: systemd

-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit kubelet.service has finished starting up.

-- The start-up result is done.
May 21 10:47:38 k8s-master systemd[1]: Starting kubelet: The Kubernetes Node Agent...
-- Subject: Unit kubelet.service has begun start-up
-- Defined-By: systemd

-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit kubelet.service has begun starting up.
May 21 10:47:38 k8s-master kubelet[9250]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --con
May 21 10:47:38 k8s-master kubelet[9250]: Flag --allow-privileged has been deprecated, will be removed in a future version
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config fl
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --co
May 21 10:47:38 k8s-master kubelet[9250]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be remove
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config f
May 21 10:47:38 k8s-master kubelet[9250]: I0521 10:47:38.734578 9250 feature_gate.go:226] feature gates: &{{} map[]}
May 21 10:47:38 k8s-master kubelet[9250]: F0521 10:47:38.734669 9250 server.go:218] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki
May 21 10:47:38 k8s-master systemd[1]: kubelet.service: main process exited, code=exited, status=255/n/a
May 21 10:47:38 k8s-master systemd[1]: Unit kubelet.service entered failed state.
May 21 10:47:38 k8s-master systemd[1]: kubelet.service failed.
lines 1455-1498/1498 (END)

Unable to start kubelet services

All 8 comments

I can see a lot of warning when kubelet starts

journalctl -xeu kubelet
-- Subject: Unit kubelet.service has finished start-up
-- Defined-By: systemd

-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit kubelet.service has finished starting up.

-- The start-up result is done.
May 21 10:47:38 k8s-master systemd[1]: Starting kubelet: The Kubernetes Node Agent...
-- Subject: Unit kubelet.service has begun start-up
-- Defined-By: systemd

-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit kubelet.service has begun starting up.
May 21 10:47:38 k8s-master kubelet[9250]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --con
May 21 10:47:38 k8s-master kubelet[9250]: Flag --allow-privileged has been deprecated, will be removed in a future version
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config fl
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --co
May 21 10:47:38 k8s-master kubelet[9250]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be remove
May 21 10:47:38 k8s-master kubelet[9250]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config
May 21 10:47:38 k8s-master kubelet[9250]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config f
May 21 10:47:38 k8s-master kubelet[9250]: I0521 10:47:38.734578 9250 feature_gate.go:226] feature gates: &{{} map[]}
May 21 10:47:38 k8s-master kubelet[9250]: F0521 10:47:38.734669 9250 server.go:218] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki
May 21 10:47:38 k8s-master systemd[1]: kubelet.service: main process exited, code=exited, status=255/n/a
May 21 10:47:38 k8s-master systemd[1]: Unit kubelet.service entered failed state.
May 21 10:47:38 k8s-master systemd[1]: kubelet.service failed.
lines 1455-1498/1498 (END)

Unable to start kubelet services

'--cadvisor-port' removed in 1.13.0-alpha.0 now, kubelet won't start.

Aug 23 10:46:42 k8s-master-27660861-0 kubelet[13190]: F0823 10:46:42.351539   13190 server.go:146] unknown flag: --cadvisor-port

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

remove stale

In the meantime, --allow-privileged has been completely removed is latest versions of master and 1.15 in: https://github.com/kubernetes/kubernetes/commit/4f33b5f42146400c9aa0a1f0f5ad79607ec06f6d

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Not committing to fix this right now! Closing this issue.

Was this page helpful?
0 / 5 - 0 ratings