Pipeline: Install tekton-pipeline 0.17.0 release failed because of InternalError

[xiujuan95]

Expected Behavior

Install tekton-pipeline 0.17.0 release successfully

Actual Behavior

When I apply tekton-pipeline 0.17.0 release use below command:

kubectl apply -f https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml

It failed and reported below error:

service/tekton-pipelines-webhook created
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found
Error from server (InternalError): error when creating "https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.17.0/release.yaml": Internal error occurred: failed calling webhook "config.webhook.pipeline.tekton.dev": Post https://tekton-pipelines-webhook.tekton-pipelines.svc:443/config-validation?timeout=30s: service "tekton-pipelines-webhook" not found

Then I check the status and logs of tekton-pipelines-webhook:

xiangxiulis-MacBook-Pro:spark xiangxiuli$ k get pod -n tekton-pipelines
NAME                                          READY   STATUS              RESTARTS   AGE
tekton-pipelines-controller-6f6988757-gvjw6   0/1     ContainerCreating   0          3m53s
tekton-pipelines-webhook-8b4798587-ch7vn      0/1     CrashLoopBackOff    5          3m51s
xiangxiulis-MacBook-Pro:spark xiangxiuli$ k logs tekton-pipelines-webhook-8b4798587-ch7vn -n tekton-pipelines --all-containers
2020/10/12 05:46:19 maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined
2020/10/12 05:46:19 Registering 2 clients
2020/10/12 05:46:19 Registering 3 informer factories
2020/10/12 05:46:19 Registering 4 informers
2020/10/12 05:46:19 Registering 5 controllers
{"level":"info","ts":"2020-10-12T05:46:19.254Z","caller":"logging/config.go:110","msg":"Successfully created the logger."}
{"level":"info","ts":"2020-10-12T05:46:19.254Z","caller":"logging/config.go:111","msg":"Logging level set to info"}
{"level":"info","ts":"2020-10-12T05:46:19.254Z","logger":"webhook","caller":"profiling/server.go:59","msg":"Profiling enabled: false","commit":"3e90648"}
{"level":"info","ts":"2020-10-12T05:46:19.268Z","logger":"webhook","caller":"leaderelection/context.go:46","msg":"Running with Standard leader election","commit":"3e90648"}
{"level":"info","ts":"2020-10-12T05:46:19.293Z","logger":"webhook","caller":"sharedmain/main.go:228","msg":"Starting configuration manager...","commit":"3e90648"}
{"level":"fatal","ts":"2020-10-12T05:46:19.393Z","logger":"webhook","caller":"sharedmain/main.go:230","msg":"Failed to start configuration manager","commit":"3e90648","error":"configmap \"config-defaults\" not found","stacktrace":"github.com/tektoncd/pipeline/vendor/knative.dev/pkg/injection/sharedmain.MainWithConfig\n\tgithub.com/tektoncd/pipeline/vendor/knative.dev/pkg/injection/sharedmain/main.go:230\nmain.main\n\tgithub.com/tektoncd/pipeline/cmd/webhook/main.go:216\nruntime.main\n\truntime/proc.go:203"}

Not sure what's wrong with it? Could you please help me about this? Thanks in advance!

BTW, I am installing tekton-pipeline in 1.16.9 kubernetes cluster, and the version of kubectl is:

Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.1", GitCommit:"d224476cd0730baca2b6e357d144171ed74192d6", GitTreeState:"clean", BuildDate:"2020-01-15T15:50:38Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.15+IKS", GitCommit:"a7ace239946d71c9305593eacf74b9a9efa25e3b", GitTreeState:"clean", BuildDate:"2020-09-09T00:11:53Z", GoVersion:"go1.13.15", Compiler:"gc", Platform:"linux/amd64"}

Steps to Reproduce the Problem

1.
2.
3.

Additional Info

• Kubernetes version:

  Output of kubectl version:

  Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.1", GitCommit:"d224476cd0730baca2b6e357d144171ed74192d6", GitTreeState:"clean", BuildDate:"2020-01-15T15:50:38Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"darwin/amd64"}
  Server Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.15+IKS", GitCommit:"a7ace239946d71c9305593eacf74b9a9efa25e3b", GitTreeState:"clean", BuildDate:"2020-09-09T00:11:53Z", GoVersion:"go1.13.15", Compiler:"gc", Platform:"linux/amd64"}
  

• Tekton Pipeline version:

  Output of tkn version or kubectl get pods -n tekton-pipelines -l app=tekton-pipelines-controller -o=jsonpath='{.items[0].metadata.labels.version}'

[vdemeester]

The error seems to be with the configmap config-defaults not being present:

"msg":"Failed to start configuration manager","commit":"3e90648","error":"configmap \"config-defaults\" not found"

Any error during the apply phase on the configmap ?

[xiujuan95]

@vdemeester No other errors about you mentioned configmap, actually, I checked and found I didn't have this configmap.

[vdemeester]

@vdemeester No other errors about you mentioned configmap, actually, I checked and found I didn't have this configmap.

The release yaml should create this configmap (hence why I was asking for an error).

[xiujuan95]

@vdemeester Then seem like this release didn't create it for me. I have proposed all errors.

[xiujuan95]

I found the root cause. Because I didn't delete previous validatingwebhookconfigurations and mutatingwebhookconfigurations for tekton-webhook. I delete them, tekton installation is successful.

[vdemeester]

@xiujuan95 let me close this then. Please comment if there is anything to do still.