Jx: node-js worker goes offline due to low ephemeral-storage

Created on 28 Feb 2019  路  9Comments  路  Source: jenkins-x/jx

Summary

nodejs worker node goes offline during build.

kubectl events:

nodejs-qc2lb.15877af0bf79909c
The node was low on resource: ephemeral-storage. Container nodejs was using 40Ki, which exceeds its request of 0. Container jnlp was using 60Ki, which exceeds its request of 0.

Jenkins log:

Step 5/6 : COPY . .
Cannot contact nodejs-7pmmr: hudson.remoting.ChannelClosedException: Channel "unknown": Remote call on JNLP4-connect connection from ip-XXX-XXX-X-X.eu-central-1.compute.internal/XXX.XXX.X.X:41874 failed. The channel is closing down or has closed down

Steps to reproduce the behavior

sporadically happens when building npm apps.

Expected behavior

I tried to set a ephemeral-storage request in the nodejs template, but it looks like jenkinsci/kubernetes-plugin does not allow to set this.

Actual behavior

Jx version

The output of jx version is:

NAME VERSION
jx ?[32m1.3.809?[0m
jenkins x platform ?[32m0.0.3402?[0m
Kubernetes cluster ?[32mv1.11.5-eks-6bad6d?[0m
kubectl ?[32mv1.11.5?[0m
helm client ?[32mv2.12.3+geecf22f?[0m
helm server ?[32mv2.12.2+g7d2b0c7?[0m
git ?[32mgit version 2.15.1.windows.2?[0m
Operating System ?[32mWindows 10 Enterprise 1709 build 16299?[0m

Jenkins type

Jenkins-X

  • [X ] Classic Jenkins
  • [ ] Serverless Jenkins

Kubernetes cluster

jenkins-x on EKS

Operating system / Environment

AWS EKS