Origin: Not every pod in the vanilla openshift installation set cpu resource request

[ingvagabund]

Pod's resource request is very important information for a scheduler. It's evaluated in predicate phase to find all nodes with sufficient resources left for the pod to run. Vanilla OpenShift cluster runs a lot of core pods which are necessary for its proper functionality. In CI environment, worker nodes have "just" enough resources to run all the core pods. There are many ways how to distribute new pods among worker nodes. Though, sometimes the testing pods are scheduled the way some worker nodes run out of cpu resources. In which case some tests do not have sufficient resources to test a certain functionality and fail.

One way how to free some cpu resources is to make sure each pod sets its cpu resource requests properly and does not ask for more than it needs. Also, in case cpu resource request for a container is not set at all, it defaults to 100m. Which is a lot of given a worker node in the CI environment has 1.5 of allocatable cpu resource. Would be helpful to find all the pods that do not set the cpu resource request and set it to a value less than 100m at least.

Below is a list of all pods from 4.3.0-0.nightly-2019-11-13-233341 wrt. resource requests. The last two list can be ignore as all pods there set the cpu resource request (just here to see what are the cpu resource requests set to in other pods). The first list contains all the pods where there is a at least on container that set no resource request. In the second case a list of all pods where there is at least one container with only memory resource request.

Pods with missing resource request set

Running:

openshift-cluster-machine-approver/machine-approver-97889747d-9lkcn: {},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-machine-api/cluster-autoscaler-operator-5bf6ffdc48-l92q8: {},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-api/machine-api-controllers-785594dc4c-6fv4j: {"requests":{"cpu":"10m","memory":"20Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-machine-api/machine-api-operator-b5694b75c-5mlws: {},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-monitoring/alertmanager-main-0: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}
openshift-monitoring/alertmanager-main-1: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}
openshift-monitoring/alertmanager-main-2: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}
openshift-monitoring/grafana-8bbcbbf8d-nb2d7: {"requests":{"cpu":"100m","memory":"100Mi"}},{}
openshift-monitoring/node-exporter-26c7k: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-2k5cl: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-6j7lx: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-f9dwv: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-hqs84: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-sc6rr: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/prometheus-k8s-0: {"requests":{"cpu":"200m","memory":"1Gi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/prometheus-k8s-1: {"requests":{"cpu":"200m","memory":"1Gi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/telemeter-client-7db5cd9f97-76nh5: {},{},{"requests":{"cpu":"10m","memory":"20Mi"}}

Completed:

openshift-kube-apiserver/revision-pruner-2-ip-10-0-129-0.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-2-ip-10-0-170-85.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-3-ip-10-0-146-207.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-3-ip-10-0-170-85.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-4-ip-10-0-170-85.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-5-ip-10-0-170-85.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-6-ip-10-0-129-0.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-6-ip-10-0-146-207.ec2.internal: {}
openshift-kube-apiserver/revision-pruner-6-ip-10-0-170-85.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-3-ip-10-0-129-0.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-3-ip-10-0-146-207.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-3-ip-10-0-170-85.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-4-ip-10-0-129-0.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-4-ip-10-0-170-85.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-5-ip-10-0-129-0.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-5-ip-10-0-146-207.ec2.internal: {}
openshift-kube-controller-manager/revision-pruner-5-ip-10-0-170-85.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-2-ip-10-0-146-207.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-3-ip-10-0-129-0.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-5-ip-10-0-129-0.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-5-ip-10-0-146-207.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-5-ip-10-0-170-85.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-6-ip-10-0-129-0.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-6-ip-10-0-146-207.ec2.internal: {}
openshift-kube-scheduler/revision-pruner-6-ip-10-0-170-85.ec2.internal: {}

Pods with memory resource request set

Running:

openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-129-0.ec2.internal: {"requests":{"memory":"50Mi"}}
openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-146-207.ec2.internal: {"requests":{"memory":"50Mi"}}
openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-170-85.ec2.internal: {"requests":{"memory":"50Mi"}}
openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-cc4b94fc4-tpdgm: {"requests":{"memory":"50Mi"}}
openshift-service-catalog-apiserver-operator/openshift-service-catalog-apiserver-operator-854d6947f8-4nk8l: {"requests":{"memory":"50Mi"}}

Completed:

openshift-kube-controller-manager/installer-3-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-3-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-3-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-4-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-4-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-5-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-5-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-controller-manager/installer-5-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-2-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-2-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-3-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-3-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-4-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-5-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-6-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-6-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-apiserver/installer-6-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-2-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-3-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-5-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-5-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-5-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-6-ip-10-0-129-0.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-6-ip-10-0-146-207.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}
openshift-kube-scheduler/installer-6-ip-10-0-170-85.ec2.internal: {"limits":{"memory":"100M"},"requests":{"memory":"100M"}}

Pods with cpu resource request set

openshift-multus/multus-admission-controller-2s8dx: {"requests":{"cpu":"10m"}}
openshift-multus/multus-admission-controller-bqr87: {"requests":{"cpu":"10m"}}
openshift-multus/multus-admission-controller-sfrzp: {"requests":{"cpu":"10m"}}
openshift-ingress-operator/ingress-operator-7487988f78-8ktk8: {"requests":{"cpu":"10m"}}
openshift-image-registry/cluster-image-registry-operator-7658db5d99-rdvxz: {"requests":{"cpu":"10m"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-hhl2b: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-jjqvd: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-kv92m: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-nms9t: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-vk6pq: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns/dns-default-w2gz7: {"limits":{"memory":"512Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},{"requests":{"cpu":"10m"}}
openshift-dns-operator/dns-operator-7d569b4668-x6krm: {"requests":{"cpu":"10m"}}
openshift-cluster-samples-operator/cluster-samples-operator-6cd778b77f-r8tkp: {"requests":{"cpu":"10m"}},{"requests":{"cpu":"10m"}}

Pods with both cpu and memory resource request set

openshift-apiserver-operator/openshift-apiserver-operator-747b47ff4c-6wffq: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-apiserver/apiserver-bbnss: {"requests":{"cpu":"150m","memory":"200Mi"}}
openshift-apiserver/apiserver-n6pqs: {"requests":{"cpu":"150m","memory":"200Mi"}}
openshift-apiserver/apiserver-r5rdw: {"requests":{"cpu":"150m","memory":"200Mi"}}
openshift-authentication-operator/authentication-operator-c868cc875-7w8t9: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-authentication/oauth-openshift-55f87bf7d8-6zhx4: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-authentication/oauth-openshift-55f87bf7d8-wlwbw: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cloud-credential-operator/cloud-credential-operator-6684f754d5-psg6f: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-7dd466ccb5-289qf: {"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-cluster-node-tuning-operator/tuned-445g7: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-node-tuning-operator/tuned-4fqtn: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-node-tuning-operator/tuned-jfhjj: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-node-tuning-operator/tuned-jqsjj: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-node-tuning-operator/tuned-n9hkf: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-node-tuning-operator/tuned-qpq89: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-cluster-storage-operator/cluster-storage-operator-54848d96bc-k7whk: {"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-cluster-version/cluster-version-operator-bddbbbcc7-mnxf6: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-console-operator/console-operator-55d4b4455f-qg8pl: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-console/console-856d444877-gfxln: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-console/console-856d444877-lzc6k: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-console/downloads-6bd7765fcf-7gj2g: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-console/downloads-6bd7765fcf-c9fqq: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-controller-manager-operator/openshift-controller-manager-operator-79f7cd769f-xzks4: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-controller-manager/controller-manager-5t7wh: {"requests":{"cpu":"100m","memory":"100Mi"}}
openshift-controller-manager/controller-manager-6rtrr: {"requests":{"cpu":"100m","memory":"100Mi"}}
openshift-controller-manager/controller-manager-7rs4h: {"requests":{"cpu":"100m","memory":"100Mi"}}
openshift-etcd/etcd-member-ip-10-0-129-0.ec2.internal: {"requests":{"cpu":"300m","memory":"600Mi"}},{}
openshift-etcd/etcd-member-ip-10-0-146-207.ec2.internal: {"requests":{"cpu":"300m","memory":"600Mi"}},{}
openshift-etcd/etcd-member-ip-10-0-170-85.ec2.internal: {"requests":{"cpu":"300m","memory":"600Mi"}},{}
openshift-image-registry/image-registry-69fcb46896-gfnlh: {"requests":{"cpu":"100m","memory":"256Mi"}}
openshift-image-registry/node-ca-25q8d: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-image-registry/node-ca-2bdlm: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-image-registry/node-ca-m2v9f: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-image-registry/node-ca-nhd89: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-image-registry/node-ca-vd6q6: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-image-registry/node-ca-zldph: {"requests":{"cpu":"10m","memory":"10Mi"}}
openshift-ingress/router-default-f56d8546-7bs47: {"requests":{"cpu":"100m","memory":"256Mi"}}
openshift-ingress/router-default-f56d8546-cvw7m: {"requests":{"cpu":"100m","memory":"256Mi"}}
openshift-insights/insights-operator-5d5695fcc6-8kk4h: {"requests":{"cpu":"10m","memory":"30Mi"}}
openshift-kube-apiserver-operator/kube-apiserver-operator-699699c446-vkp2r: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-apiserver/kube-apiserver-ip-10-0-129-0.ec2.internal: {"requests":{"cpu":"150m","memory":"1Gi"}},{"requests":{"cpu":"10m","memory":"50Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-apiserver/kube-apiserver-ip-10-0-146-207.ec2.internal: {"requests":{"cpu":"150m","memory":"1Gi"}},{"requests":{"cpu":"10m","memory":"50Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-apiserver/kube-apiserver-ip-10-0-170-85.ec2.internal: {"requests":{"cpu":"150m","memory":"1Gi"}},{"requests":{"cpu":"10m","memory":"50Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-controller-manager-operator/kube-controller-manager-operator-7b4f5b4557-hnvjl: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-controller-manager/kube-controller-manager-ip-10-0-129-0.ec2.internal: {"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-controller-manager/kube-controller-manager-ip-10-0-146-207.ec2.internal: {"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-kube-controller-manager/kube-controller-manager-ip-10-0-170-85.ec2.internal: {"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"100m","memory":"200Mi"}},{"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-machine-config-operator/etcd-quorum-guard-777678775f-48q8f: {"requests":{"cpu":"10m","memory":"5Mi"}}
openshift-machine-config-operator/etcd-quorum-guard-777678775f-8jbs9: {"requests":{"cpu":"10m","memory":"5Mi"}}
openshift-machine-config-operator/etcd-quorum-guard-777678775f-pfkz9: {"requests":{"cpu":"10m","memory":"5Mi"}}
openshift-machine-config-operator/machine-config-controller-cfb8fbc5b-vtppk: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-2jn69: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-5cp5b: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-878z6: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-8zr4g: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-rfsql: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-daemon-rs2pp: {"requests":{"cpu":"20m","memory":"50Mi"}},{"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-operator-7fbfc648f5-ssz42: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-server-hzxl4: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-server-xlt68: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-machine-config-operator/machine-config-server-xsvtr: {"requests":{"cpu":"20m","memory":"50Mi"}}
openshift-marketplace/certified-operators-5584cc7696-5hmvs: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-marketplace/community-operators-66d847875c-6dr8n: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-marketplace/marketplace-operator-78d5bc8d4-dzkhq: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-marketplace/redhat-operators-6b9c7f677f-kzbb9: {"requests":{"cpu":"10m","memory":"100Mi"}}
openshift-monitoring/cluster-monitoring-operator-55f4df795d-4k75s: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-monitoring/kube-state-metrics-7fb5449558-qmmfr: {"requests":{"cpu":"10m","memory":"40Mi"}},{"requests":{"cpu":"10m","memory":"40Mi"}},{"requests":{"cpu":"10m","memory":"40Mi"}}
openshift-monitoring/openshift-state-metrics-5cd5dcfb7b-mjnwm: {"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"100m","memory":"150Mi"}}
openshift-monitoring/prometheus-adapter-cd44dcb98-c4w4v: {"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/prometheus-adapter-cd44dcb98-q876b: {"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/prometheus-operator-67f84f5784-pqhg9: {"requests":{"cpu":"10m","memory":"60Mi"}}
openshift-monitoring/thanos-querier-bd76fcc96-hxjz9: {"requests":{"cpu":"10m","memory":"12Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/thanos-querier-bd76fcc96-s5b6z: {"requests":{"cpu":"10m","memory":"12Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-multus/multus-9whqr: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-multus/multus-lbjhb: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-multus/multus-lwh2x: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-multus/multus-nll6b: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-multus/multus-nt27x: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-multus/multus-rqpdv: {"requests":{"cpu":"10m","memory":"150Mi"}}
openshift-network-operator/network-operator-5b889d779f-rms4r: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-operator-lifecycle-manager/catalog-operator-689dd87459-qdgns: {"requests":{"cpu":"10m","memory":"80Mi"}}
openshift-operator-lifecycle-manager/olm-operator-675866ff84-gmkcc: {"requests":{"cpu":"10m","memory":"160Mi"}}
openshift-operator-lifecycle-manager/packageserver-7fdd5b5dd-49trw: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-operator-lifecycle-manager/packageserver-7fdd5b5dd-xwms2: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-sdn/ovs-5b5b7: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/ovs-94n4t: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/ovs-dxcs5: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/ovs-j9v49: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/ovs-qkxkj: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/ovs-xqhdf: {"requests":{"cpu":"200m","memory":"400Mi"}}
openshift-sdn/sdn-2w79n: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-sdn/sdn-45frx: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-sdn/sdn-controller-hw27r: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-sdn/sdn-controller-kn89k: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-sdn/sdn-controller-kw644: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-sdn/sdn-frfp5: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-sdn/sdn-lr549: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-sdn/sdn-w7htv: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-sdn/sdn-w8sfn: {"requests":{"cpu":"100m","memory":"200Mi"}}
openshift-service-ca-operator/service-ca-operator-54998954bc-qxfvh: {"requests":{"cpu":"10m","memory":"80Mi"}}
openshift-service-ca/apiservice-cabundle-injector-b989b7cc4-l74nw: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-service-ca/configmap-cabundle-injector-99975dd6-dwghp: {"requests":{"cpu":"10m","memory":"50Mi"}}
openshift-service-ca/service-serving-cert-signer-665c4c6556-jv7cl: {"requests":{"cpu":"10m","memory":"120Mi"}}
openshift-service-catalog-controller-manager-operator/openshift-service-catalog-controller-manager-operator-5b99hw4gj: {"requests":{"cpu":"10m","memory":"50Mi"}}

[ingvagabund]

openshift-machine-api/cluster-autoscaler-operator-5bf6ffdc48-l92q8: {},{"requests":{"cpu":"20m","memory":"50Mi"}}

kube-rbac-proxy container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="cluster-autoscaler-operator-5bf6ffdc48-l92q8", container="kube-rbac-proxy"}[10m]))) for Prometheus.

@bison

openshift-machine-api/machine-api-controllers-785594dc4c-6fv4j: {"requests":{"cpu":"10m","memory":"20Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}

machine-controller container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="machine-api-controllers-785594dc4c-6fv4j", container="machine-controller"}[10m]))) for Prometheus.

openshift-machine-api/machine-api-operator-b5694b75c-5mlws: {},{"requests":{"cpu":"10m","memory":"50Mi"}}

kube-rbac-proxy container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="machine-api-operator-b5694b75c-5mlws", container="kube-rbac-proxy"}[10m]))) for Prometheus.

@enxebre

[ingvagabund]

openshift-cluster-machine-approver/machine-approver-97889747d-9lkcn: {},{"requests":{"cpu":"10m","memory":"50Mi"}}

kube-rbac-proxy container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="machine-approver-97889747d-9lkcn", container="kube-rbac-proxy"}[10m]))) for Prometheus.

@enxebre

[ingvagabund]

openshift-monitoring/alertmanager-main-0: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}
openshift-monitoring/alertmanager-main-1: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}
openshift-monitoring/alertmanager-main-2: {"requests":{"memory":"200Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{}

alertmanager-proxy container does not set cpu resource request

openshift-monitoring/grafana-8bbcbbf8d-nb2d7: {"requests":{"cpu":"100m","memory":"100Mi"}},{}

grafana-proxy container does not set cpu resource request

openshift-monitoring/node-exporter-26c7k: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-2k5cl: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-6j7lx: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-f9dwv: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-hqs84: {},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/node-exporter-sc6rr: {},{"requests":{"cpu":"10m","memory":"20Mi"}}

node-exporter container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod=~"alertmanager-main-.*", container="alertmanager-proxy"}[10m]))) for Prometheus.

openshift-monitoring/prometheus-k8s-0: {"requests":{"cpu":"200m","memory":"1Gi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}
openshift-monitoring/prometheus-k8s-1: {"requests":{"cpu":"200m","memory":"1Gi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{"limits":{"cpu":"100m","memory":"25Mi"},"requests":{"cpu":"100m","memory":"25Mi"}},{},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}},{"requests":{"cpu":"10m","memory":"20Mi"}}

thanos-sidecar container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod=~"prometheus-k8s-.*", container="thanos-sidecar"}[10m]))) for Prometheus.

openshift-monitoring/telemeter-client-7db5cd9f97-76nh5: {},{},{"requests":{"cpu":"10m","memory":"20Mi"}}

telemeter-client and reload containers do not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="telemeter-client-7db5cd9f97-76nh5", container=~"telemeter-client|reload"}[10m]))) for Prometheus.

@paulfantom

[ingvagabund]

openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-129-0.ec2.internal: {"requests":{"memory":"50Mi"}}
openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-146-207.ec2.internal: {"requests":{"memory":"50Mi"}}
openshift-kube-scheduler/openshift-kube-scheduler-ip-10-0-170-85.ec2.internal: {"requests":{"memory":"50Mi"}}

scheduler container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod=~"openshift-kube-scheduler-ip-.*", container="scheduler"}[10m]))) for Prometheus.

openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-cc4b94fc4-tpdgm: {"requests":{"memory":"50Mi"}}

kube-scheduler-operator-container container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="openshift-kube-scheduler-operator-cc4b94fc4-tpdgm", container="kube-scheduler-operator-container"}[10m]))) for Prometheus.

@damemi :P

[ingvagabund]

openshift-service-catalog-apiserver-operator/openshift-service-catalog-apiserver-operator-854d6947f8-4nk8l: {"requests":{"memory":"50Mi"}}

operator container does not set cpu resource request

sort_desc(sum without (instance) (rate(container_cpu_usage_seconds_total{pod="openshift-service-catalog-apiserver-operator-854d6947f8-4nk8l", container="operator"}[10m]))) for Prometheus.

@jboyd01

[paulfantom]

@ingvagabund All containers in the monitoring stack should now have resource requests set.

[openshift-bot]

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[ingvagabund]

/remove-lifecycle stale

[ingvagabund]

Scheduler tests are less flaky than before. I consider this issue to be resolved. In case a CI cluster is still resource saturated, we can revisit this path and see if there are other resource requests that can be set or decreased.

/close

[openshift-ci-robot]

@ingvagabund: Closing this issue.

In response to this:

Scheduler tests are less flaky than before. I consider this issue to be resolved. In case a CI cluster is still resource saturated, we can revisit this path and see if there are other resource requests that can be set or decreased.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.