Operator-sdk: fatal error: concurrent map read and map write.

Created on 28 Jan 2020 · 8Comments · Source: operator-framework/operator-sdk

Bug Report

I got fatal error: concurrent map read and map write.. This is caused sporadically.

What did you do?

operator-sdk run --local --namespace "" with my some Helm charts.

What did you expect to see?

Keeps running with no crash.

What did you see instead? Under which circumstances?

Stack traces below.

Environment

operator-sdk version:
go version:

$ operator-sdk version
operator-sdk version: "v0.15.0", commit: "21a93ca379b887ab2303b0d148a399bf205c3231", go version: "go1.13.6 darwin/amd64"

Kubernetes version information:

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf", GitTreeState:"clean", BuildDate:"2019-12-07T21:20:10Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"14+", GitVersion:"v1.14.9-eks-c0eccc", GitCommit:"c0eccca51d7500bb03b2f163dd8d534ffeb2f7a2", GitTreeState:"clean", BuildDate:"2019-12-22T23:14:11Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"linux/amd64"}

Kubernetes cluster kind:

EKS

Are you writing your operator in ansible, helm, or go?

Helm.

Possible Solution

None.

Additional context

Stack trace log

fatal error: concurrent map read and map write

goroutine 954 [running]:
runtime.throw(0x2c28e24, 0x21)
    /usr/local/opt/go/libexec/src/runtime/panic.go:774 +0x72 fp=0xc0017e4d00 sp=0xc0017e4cd0 pc=0x102e132
runtime.mapaccess2(0x28e2d80, 0xc0002662a0, 0xc0017e4ef0, 0x2bda9a7, 0x7)
    /usr/local/opt/go/libexec/src/runtime/map.go:470 +0x278 fp=0xc0017e4d48 sp=0xc0017e4d00 pc=0x100dc18
k8s.io/apimachinery/pkg/runtime.(*Scheme).AddKnownTypeWithName(0xc0001eb880, 0x2c06faf, 0x14, 0x2bda9a7, 0x7, 0x27a8118, 0x18, 0x2f5dbe0, 0xc001edc000)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme.go:202 +0x201 fp=0xc0017e4f90 sp=0xc0017e4d48 pc=0x14b77f1
k8s.io/apimachinery/pkg/runtime.(*Scheme).AddKnownTypes(0xc0001eb880, 0x2c06faf, 0x14, 0x2bda9a7, 0x7, 0xc0017e50d8, 0x3, 0x3)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme.go:180 +0x255 fp=0xc0017e5088 sp=0xc0017e4f90 pc=0x14b7595
k8s.io/apiextensions-apiserver/pkg/apis/apiextensions/v1beta1.addKnownTypes(0xc0001eb880, 0xc0017e5150, 0x100c618)
    pkg/mod/k8s.io/[email protected]/pkg/apis/apiextensions/v1beta1/register.go:48 +0x124 fp=0xc0017e5118 sp=0xc0017e5088 pc=0x1768334
k8s.io/apimachinery/pkg/runtime.(*SchemeBuilder).AddToScheme(0x4014ce0, 0xc0001eb880, 0xc003c0c1c0, 0xc0017e51d0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme_builder.go:29 +0x6d fp=0xc0017e5158 sp=0xc0017e5118 pc=0x14bd05d
k8s.io/apimachinery/pkg/runtime.(*SchemeBuilder).AddToScheme-fm(0xc0001eb880, 0xc00004c230, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme_builder.go:27 +0x34 fp=0xc0017e5188 sp=0xc0017e5158 pc=0x1559794
helm.sh/helm/v3/pkg/kube.New(0x2f966a0, 0xc003c0c1c0, 0xc000b23d50)
    pkg/mod/helm.sh/helm/[email protected]/pkg/kube/client.go:63 +0x55 fp=0xc0017e51e0 sp=0xc0017e5188 pc=0x256a955
github.com/operator-framework/operator-sdk/pkg/helm/release.managerFactory.NewManager(0x2fd1960, 0xc000762600, 0xc00044f8a0, 0x12, 0xc001a350a0, 0xc0004b0a80, 0x2f5e1e0, 0xc001a350a0, 0x0, 0x0)
    src/github.com/operator-framework/operator-sdk/pkg/helm/release/manager_factory.go:84 +0x565 fp=0xc0017e5418 sp=0xc0017e51e0 pc=0x26619c5
github.com/operator-framework/operator-sdk/pkg/helm/release.(*managerFactory).NewManager(0xc0004a5e40, 0xc001a350a0, 0xc0004b0a80, 0x0, 0xf, 0xc000b23d30, 0xe)
    <autogenerated>:1 +0x73 fp=0xc0017e5478 sp=0xc0017e5418 pc=0x2663e93
github.com/operator-framework/operator-sdk/pkg/helm/controller.HelmOperatorReconciler.Reconcile(0x2fbb340, 0xc000826960, 0x2f969e0, 0xc0007fc180, 0xc000400b60, 0x10, 0xc000400ad0, 0x8, 0xc000400b88, 0x6, ...)
    src/github.com/operator-framework/operator-sdk/pkg/helm/controller/reconcile.go:86 +0x5a3 fp=0xc0017e5b30 sp=0xc0017e5478 pc=0x26786d3
github.com/operator-framework/operator-sdk/pkg/helm/controller.(*HelmOperatorReconciler).Reconcile(0xc00053f700, 0xc000b23d50, 0xf, 0xc000b23d30, 0xe, 0xc0017e5cd8, 0xc000c442d0, 0xc000a1a048, 0x2f60800)
    <autogenerated>:1 +0xe8 fp=0xc0017e5c70 sp=0xc0017e5b30 pc=0x267cc88
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00018bec0, 0x29ad640, 0xc00037a0c0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:256 +0x162 fp=0xc0017e5db0 sp=0xc0017e5c70 pc=0x23fb6c2
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00018bec0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232 +0xcb fp=0xc0017e5e38 sp=0xc0017e5db0 pc=0x23fb50b
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00018bec0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211 +0x2b fp=0xc0017e5e58 sp=0xc0017e5e38 pc=0x23fb41b
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker-fm()
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:210 +0x2a fp=0xc0017e5e70 sp=0xc0017e5e58 pc=0x23fce9a
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0008105f0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e fp=0xc0017e5ee0 sp=0xc0017e5e70 pc=0x21cc23e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0008105f0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8 fp=0xc0017e5f90 sp=0xc0017e5ee0 pc=0x21cb438
k8s.io/apimachinery/pkg/util/wait.Until(0xc0008105f0, 0x3b9aca00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88 +0x4d fp=0xc0017e5fc8 sp=0xc0017e5f90 pc=0x21cb32d
runtime.goexit()
    /usr/local/opt/go/libexec/src/runtime/asm_amd64.s:1357 +0x1 fp=0xc0017e5fd0 sp=0xc0017e5fc8 pc=0x105b281
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:193 +0x328

goroutine 1 [select]:
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).Start(0xc000762600, 0xc000941380, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:433 +0x1ce
github.com/operator-framework/operator-sdk/pkg/helm.Run(0xc000808940, 0x0, 0x7ffeefbffab5)
    src/github.com/operator-framework/operator-sdk/pkg/helm/run.go:159 +0x8dc
github.com/operator-framework/operator-sdk/cmd/operator-sdk/run.runLocalArgs.runHelm(0x0, 0x0, 0x7ffeefbffab5, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    src/github.com/operator-framework/operator-sdk/cmd/operator-sdk/run/local.go:139 +0xc1
github.com/operator-framework/operator-sdk/cmd/operator-sdk/run.runLocalArgs.run(0x0, 0x0, 0x7ffeefbffab5, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    src/github.com/operator-framework/operator-sdk/cmd/operator-sdk/run/local.go:69 +0x1ab
github.com/operator-framework/operator-sdk/cmd/operator-sdk/run.NewCmd.func1(0xc000344a00, 0xc00081b9b0, 0x0, 0x3, 0x0, 0x0)
    src/github.com/operator-framework/operator-sdk/cmd/operator-sdk/run/cmd.go:87 +0x351
github.com/spf13/cobra.(*Command).execute(0xc000344a00, 0xc00081b920, 0x3, 0x3, 0xc000344a00, 0xc00081b920)
    pkg/mod/github.com/spf13/[email protected]/command.go:826 +0x460
github.com/spf13/cobra.(*Command).ExecuteC(0xc000694280, 0x2f489e0, 0xc000859a00, 0x0)
    pkg/mod/github.com/spf13/[email protected]/command.go:914 +0x2fb
github.com/spf13/cobra.(*Command).Execute(...)
    pkg/mod/github.com/spf13/[email protected]/command.go:864
main.main()
    src/github.com/operator-framework/operator-sdk/cmd/operator-sdk/main.go:39 +0x11b

goroutine 18 [chan receive]:
k8s.io/klog.(*loggingT).flushDaemon(0x401da20)
    pkg/mod/k8s.io/[email protected]/klog.go:1010 +0x8b
created by k8s.io/klog.init.0
    pkg/mod/k8s.io/[email protected]/klog.go:411 +0xd6

goroutine 9 [chan receive]:
github.com/golang/glog.(*loggingT).flushDaemon(0x401d6c0)
    pkg/mod/github.com/golang/[email protected]/glog.go:882 +0x8b
created by github.com/golang/glog.init.0
    pkg/mod/github.com/golang/[email protected]/glog.go:410 +0x26f

goroutine 1046 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc000b90500)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 16 [syscall]:
os/signal.signal_recv(0x105b286)
    /usr/local/opt/go/libexec/src/runtime/sigqueue.go:144 +0x96
os/signal.loop()
    /usr/local/opt/go/libexec/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
    /usr/local/opt/go/libexec/src/os/signal/signal_unix.go:29 +0x41

goroutine 113 [chan receive]:
k8s.io/apimachinery/pkg/watch.(*Broadcaster).loop(0xc0004d6240)
    pkg/mod/k8s.io/[email protected]/pkg/watch/mux.go:207 +0x66
created by k8s.io/apimachinery/pkg/watch.NewBroadcaster
    pkg/mod/k8s.io/[email protected]/pkg/watch/mux.go:75 +0xcc

goroutine 122 [IO wait]:
internal/poll.runtime_pollWait(0x474d430, 0x72, 0xffffffffffffffff)
    /usr/local/opt/go/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc0004d2298, 0x72, 0xd800, 0xd87d, 0xffffffffffffffff)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0004d2280, 0xc000c98000, 0xd87d, 0xd87d, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/internal/poll/fd_unix.go:169 +0x22b
net.(*netFD).Read(0xc0004d2280, 0xc000c98000, 0xd87d, 0xd87d, 0xd, 0x8, 0xd)
    /usr/local/opt/go/libexec/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0004caa38, 0xc000c98000, 0xd87d, 0xd87d, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/net/net.go:184 +0x68
crypto/tls.(*atLeastReader).Read(0xc003b74840, 0xc000c98000, 0xd87d, 0xd87d, 0x2a, 0x2f43fc0, 0xc0005ed970)
    /usr/local/opt/go/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc000177ad8, 0x2f43d20, 0xc003b74840, 0x1009cb5, 0x294b100, 0x2a5b900)
    /usr/local/opt/go/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc000177880, 0x4789530, 0xc0001328a0, 0x5, 0xc0001328a0, 0xd)
    /usr/local/opt/go/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc000177880, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
    /usr/local/opt/go/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc000177880, 0xc000603000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/crypto/tls/conn.go:1255 +0x161
bufio.(*Reader).Read(0xc000098840, 0xc000150658, 0x9, 0x9, 0xc0005edd93, 0x7ef9c086, 0x1)
    /usr/local/opt/go/libexec/src/bufio/bufio.go:226 +0x26a
io.ReadAtLeast(0x2f43aa0, 0xc000098840, 0xc000150658, 0x9, 0x9, 0x9, 0x13c003d, 0xc0000c7550, 0xc0003bd890)
    /usr/local/opt/go/libexec/src/io/io.go:310 +0x87
io.ReadFull(...)
    /usr/local/opt/go/libexec/src/io/io.go:329
golang.org/x/net/http2.readFrameHeader(0xc000150658, 0x9, 0x9, 0x2f43aa0, 0xc000098840, 0x0, 0xc000000000, 0xc0005eddf0, 0x13c4492)
    pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x87
golang.org/x/net/http2.(*Framer).ReadFrame(0xc000150620, 0xc003b963a0, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0xa1
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc0005edfb8, 0xc00013bfa8, 0x13ad058)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:1732 +0x8c
golang.org/x/net/http2.(*ClientConn).readLoop(0xc0000c7500)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:1660 +0xa3
created by golang.org/x/net/http2.(*Transport).newClientConn
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:673 +0x62f

goroutine 1095 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0009e2000)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00066c920, 0xc0003ec240)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1075 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc0001eb420, 0xc0009418c0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000757650, 0xc00091e900)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1023 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc000d71f80)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 1622 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x1646, 0xc000000000, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000b73dd8, 0x2a83880, 0x1646)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000596f40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b73f40, 0xdf8475800, 0x0, 0xc0000b0001, 0xc000868300)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc00432e900)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc004379020)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1605 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x0, 0xc000ab4600, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000d3cdd8, 0x104c907, 0x4022ac0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b89f40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000d3cf40, 0xdf8475800, 0x0, 0x1, 0xc000918de0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc004116f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc0040f5660)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 249 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x2f5e6e0, 0xc0004ccde0, 0xc000811de0)
    pkg/mod/k8s.io/[email protected]/tools/record/event.go:265 +0xc5
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
    pkg/mod/k8s.io/[email protected]/tools/record/event.go:263 +0x6e

goroutine 1106 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0009d8080)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000852d80, 0xc0005680b0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1055 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x2, 0x0, 0xc0009c66a0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc0009a1dd8, 0x0, 0xc0009c65f8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0009c6740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0009a1f40, 0xdf8475800, 0x0, 0xc0009c6701, 0xc000940ea0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000d70280)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001eb480, 0xc0007c7b20)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1531 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc000b62d70, 0x6b75796849e890f8, 0xc0006d5db0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000d3bdd8, 0x2a83880, 0xc0001f20c8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0006d5f40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000d3bf40, 0xdf8475800, 0x0, 0xc0006d5e01, 0xc000944ba0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc0040e6f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc0040d14c0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1608 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc004117980)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc0040f5ce0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1620 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000722320, 0xc000916b40, 0xc000918cc0, 0xc00080d7a0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 987 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start(0xc00000cfa0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/deleg_map.go:62 +0x97
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).waitForCache.func1(0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:499 +0x39
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).waitForCache
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:498 +0x5a

goroutine 1092 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0000dea00, 0xc000916b40, 0xc000944840, 0xc000131260)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 984 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveMetrics(0xc000762600, 0xc000916b40)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:364 +0x1ab
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).Start
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:414 +0x2f2

goroutine 248 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x2f5e6e0, 0xc0004ccd80, 0xc0004cccf0)
    pkg/mod/k8s.io/[email protected]/tools/record/event.go:265 +0xc5
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
    pkg/mod/k8s.io/[email protected]/tools/record/event.go:263 +0x6e

goroutine 1083 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d7e880, 0xc000000000)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d7e870)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000d7e868, 0xc000bfba00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000d7e840, 0xc000bfba00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc0006fc000, 0xc0006f9760, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc0006fc000, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc0006fc000, 0x292a560, 0xc0006f9760, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0009f0f00, 0xc000c48400, 0x400, 0x400, 0x0, 0x0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000bf81e0, 0x0, 0x2f5e1a0, 0xc000c0a380, 0xc0004ca268, 0x2994020, 0xc000654c50, 0xc0009f87a0, 0x22c8384)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0006f9740, 0x0, 0x2bd0c97, 0x1, 0x0, 0x1f4, 0x13b7be6)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc000c0a340)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 343 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000385720, 0x0, 0xc000868f00, 0xc000b56e40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 315 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000b5fbc0, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000b5fbb0)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000b5fba8, 0xc000b6e000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000b5fb80, 0xc000b6e000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000ab78c0, 0xc000674fe0, 0x123d534)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000ab78c0, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000ab78c0, 0x292a560, 0xc000674fe0, 0x236, 0xc000602000)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0004a2690, 0xc000ab3800, 0x400, 0x400, 0x0, 0xd, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc00004d680, 0x0, 0x2f5e1a0, 0xc0009eb440, 0x13b81b8, 0xc000177880, 0xc000602000, 0xd, 0x1000)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000674fc0, 0x0, 0x0, 0xc000099450, 0xc0009faef8, 0x117e5a5, 0xc000133140)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0009eb400)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1045 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc00066c620, 0xc000976f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00082ced0, 0xc000733920)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1076 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc000b3a280)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 831 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00093e960)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:198 +0xe0
created by k8s.io/client-go/util/workqueue.newQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:58 +0x132

goroutine 1024 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002a06e0, 0x2f5e6a0, 0xc0000ad140, 0xc000a29b58, 0xc0000981e0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002a06e0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0009f86f0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a29ef0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002a06e0, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000757580, 0xc00091e600)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 738 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00081f4a0, 0x2f5e6a0, 0xc00005a380, 0xc000abbbe0, 0xc000920000, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00081f4a0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b8a778)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000abbf78, 0x3b9aca00, 0x0, 0x1, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc00081f4a0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.reflectorPerNamespace
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/store.go:66 +0x134

goroutine 1623 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc00432e900)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc004379030)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1404 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d7f0c0, 0x1f)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d7f0b0)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000d7f0a8, 0xc003f8f001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000d7f080, 0xc003f8f001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000b44160, 0xc00103320a, 0x9)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000b44160, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000b44160, 0x292a560, 0xc001033260, 0xc000a51d68, 0x1617218)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0003bc990, 0xc00050ec00, 0x1000, 0x1300, 0xc00217c780, 0x2f5e1a0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc002a3e0f0, 0x0, 0x2f5e1a0, 0xc001030e00, 0x0, 0x0, 0x0, 0xc000952298, 0x1055560)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc001123a60, 0xc000a51fa8, 0x8, 0x2f5e1e0, 0xc001a345a0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc000837900)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 692 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000c02040, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000c02030)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000c02028, 0xc00097de00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000c02000, 0xc00097de00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000c28dc0, 0xc0004cfec0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000c28dc0, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000c28dc0, 0x292a560, 0xc0004cfec0, 0x6, 0xc00082ec60)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0003bdad0, 0xc000c48000, 0x400, 0x400, 0x60, 0x2b414a0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc00004cbe0, 0x0, 0x2f5e1a0, 0xc000819780, 0x2000000000000, 0x0, 0x1, 0xc0006d4eea, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0004cfea0, 0xc000bae1e0, 0x1, 0xc000850910, 0x104c907, 0xc0006d4f78, 0x13b7b20)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc000819700)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1094 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000984dd8, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000d12740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000984f40, 0xdf8475800, 0x0, 0x1, 0xc000916960)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc0009e2000)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00066c920, 0xc0003ec230)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1041 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00093eae0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:198 +0xe0
created by k8s.io/client-go/util/workqueue.newQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:58 +0x132

goroutine 963 [select]:
golang.org/x/net/http2.(*ClientConn).roundTrip(0xc0000c7500, 0xc00019b900, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:1084 +0x9a0
golang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0001f0ae0, 0xc00019b900, 0xc0008ea700, 0x1300865, 0x0, 0xc00036d0e0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:447 +0x172
golang.org/x/net/http2.(*Transport).RoundTrip(...)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:408
golang.org/x/net/http2.noDialH2RoundTripper.RoundTrip(0xc0001f0ae0, 0xc00019b900, 0xc001da2a00, 0x5, 0xc00036d168)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2589 +0x3e
net/http.(*Transport).roundTrip(0xc000821540, 0xc00019b900, 0x2885180, 0xc003bcd001, 0xc000b45b80)
    /usr/local/opt/go/libexec/src/net/http/transport.go:485 +0xdc1
net/http.(*Transport).RoundTrip(0xc000821540, 0xc00019b900, 0x2bec61d, 0xd, 0xc000b45c38)
    /usr/local/opt/go/libexec/src/net/http/roundtrip.go:17 +0x35
k8s.io/client-go/plugin/pkg/client/auth/exec.(*roundTripper).RoundTrip(0xc003a47400, 0xc00019b900, 0xc003a47400, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/plugin/pkg/client/auth/exec/exec.go:220 +0x168
net/http.send(0xc00019b900, 0x2f46c60, 0xc003a47400, 0x0, 0x0, 0x0, 0xc001a35590, 0xc003bd32c0, 0x1, 0x0)
    /usr/local/opt/go/libexec/src/net/http/client.go:250 +0x443
net/http.(*Client).send(0xc003a64d20, 0xc00019b900, 0x0, 0x0, 0x0, 0xc001a35590, 0x0, 0x1, 0x35)
    /usr/local/opt/go/libexec/src/net/http/client.go:174 +0xfa
net/http.(*Client).do(0xc003a64d20, 0xc00019b900, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/net/http/client.go:641 +0x3ce
net/http.(*Client).Do(0xc003a64d20, 0xc00019b900, 0x0, 0x5, 0xc001da2a00)
    /usr/local/opt/go/libexec/src/net/http/client.go:509 +0x35
k8s.io/client-go/rest.(*Request).request(0xc000b71e00, 0xc0008eb068, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/rest/request.go:754 +0x367
k8s.io/client-go/rest.(*Request).Do(0xc000b71e00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    pkg/mod/k8s.io/[email protected]/rest/request.go:828 +0xd8
k8s.io/cli-runtime/pkg/resource.(*Helper).Patch(0xc0008eb2c0, 0xc000b26c40, 0xf, 0xc003a336e0, 0xf, 0x2c19200, 0x1b, 0xc003c02000, 0x195, 0x1a0, ...)
    pkg/mod/k8s.io/[email protected]/pkg/resource/helper.go:151 +0x19e
github.com/operator-framework/operator-sdk/pkg/helm/release.reconcileRelease.func1(0xc003a5cb60, 0x0, 0x0, 0x0, 0x0)
    src/github.com/operator-framework/operator-sdk/pkg/helm/release/manager.go:249 +0x470
helm.sh/helm/v3/pkg/kube.ResourceList.Visit(0xc003a47480, 0x3, 0x4, 0xc0008eb398, 0xc003a47480, 0x3)
    pkg/mod/helm.sh/helm/[email protected]/pkg/kube/resource.go:32 +0x58
github.com/operator-framework/operator-sdk/pkg/helm/release.reconcileRelease(0x2f96320, 0xc0000c8078, 0x2fb9de0, 0xc00180fbf0, 0xc001c92a00, 0x13b9, 0xc0008eb468, 0x26640f9)
    src/github.com/operator-framework/operator-sdk/pkg/helm/release/manager.go:220 +0x15e
github.com/operator-framework/operator-sdk/pkg/helm/release.manager.ReconcileRelease(...)
    src/github.com/operator-framework/operator-sdk/pkg/helm/release/manager.go:211
github.com/operator-framework/operator-sdk/pkg/helm/controller.HelmOperatorReconciler.Reconcile(0x2fbb340, 0xc000826960, 0x2f969e0, 0xc0007fc000, 0xc0004009d0, 0x10, 0xc000400960, 0x8, 0xc000400a28, 0x7, ...)
    src/github.com/operator-framework/operator-sdk/pkg/helm/controller/reconcile.go:292 +0x149a
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00018bd40, 0x29ad640, 0xc0004a4720, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:256 +0x162
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00018bd40, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232 +0xcb
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00018bd40)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211 +0x2b
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000d66090)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000d66090, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(0xc000d66090, 0x3b9aca00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88 +0x4d
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:193 +0x328

goroutine 992 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc0000ba000, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203 +0xf3
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables.func1(0x2f47640, 0xc0000ba000, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:477 +0x49
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:476 +0x102

goroutine 1047 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0000dea00, 0x2f5e6a0, 0xc000c0a340, 0xc000a55b58, 0xc000131260, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0000dea00, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0005946f0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a55ef0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0000dea00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00082cef0, 0xc000733960)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 752 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0001310e0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:212 +0x344
created by k8s.io/client-go/util/workqueue.newDelayingQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:55 +0x1ae

goroutine 989 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc00018bbc0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203 +0xf3
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables.func1(0x2f47640, 0xc00018bbc0, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:477 +0x49
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:476 +0x102

goroutine 612 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000268e60, 0x2f5e6a0, 0xc000819700, 0xc000a85be0, 0xc000b56540, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000268e60, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b8c778)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a85f78, 0x3b9aca00, 0x0, 0x1, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000268e60, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.reflectorPerNamespace
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/store.go:66 +0x134

goroutine 616 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000268e60, 0x0, 0xc000869980, 0xc000b56540)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1607 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x2, 0x0, 0xc000afcea0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc00438fdd8, 0x0, 0xc000afcdf8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000afcf40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00438ff40, 0xdf8475800, 0x0, 0xc000afcf01, 0xc000919380)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc004117980)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc0040f5cd0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1018 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0000f38e8, 0x1)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0000f38d8)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0000f38c0, 0xc000654b30, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000d71f80)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000983e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000983e00, 0x3b9aca00, 0x0, 0xc000914201, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc000d71f80, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000cbe1b0, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 236 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0001caf60, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0001caf50)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc0001caf48, 0xc000bbaa00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc0001caf20, 0xc000bbaa00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000c42420, 0xc00037a9a0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000c42420, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000c42420, 0x292a560, 0xc00037a9a0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0006c2ba0, 0xc0001e0000, 0x400, 0x400, 0x0, 0x0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000bf8640, 0x0, 0x2f5e1a0, 0xc00005a480, 0x2000000000000, 0x0, 0x2, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00037a980, 0x10000c000869140, 0x3, 0xc000afd6c8, 0x104c907, 0x4022c40, 0xc00074f9f8)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00005a440)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1079 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002a06e0, 0xc000916b40, 0xc000916780, 0xc0000981e0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1051 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x0, 0xc000c3adb8, 0x104cab3)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000c3add8, 0x104c907, 0x4022a40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000c3af40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c3af40, 0xdf8475800, 0x0, 0x1, 0xc000944060)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000d70200)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00066c680, 0xc0007c78d0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1532 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0040e6f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc0040d14d0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 983 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/manager/signals.SetupSignalHandler.func1(0xc000851f20, 0xc000941380)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/signals/signal.go:36 +0x34
created by sigs.k8s.io/controller-runtime/pkg/manager/signals.SetupSignalHandler
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/signals/signal.go:35 +0xd0

goroutine 1017 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000b56480)
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:212 +0x344
created by k8s.io/client-go/util/workqueue.newDelayingQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:55 +0x1ae

goroutine 1089 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0000f3998, 0x1)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0000f3988)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0000f3970, 0xc000654de0, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000b3a280)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000d3ee00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000d3ee00, 0x3b9aca00, 0x0, 0xc000914201, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc000b3a280, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000d4c120, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 340 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000385720, 0x2f5e6a0, 0xc0009eb400, 0xc00094dbe0, 0xc000b56e40, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000385720, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000a1c778)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00094df78, 0x3b9aca00, 0x0, 0x1, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000385720, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.reflectorPerNamespace
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/store.go:66 +0x134

goroutine 922 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start(0xc0001501c0, 0xc000916b40)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:132 +0x4c
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/deleg_map.go:61 +0x80

goroutine 1022 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000662770, 0xc0009417a0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000757560, 0xc00091e580)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1036 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000830460, 0x2f5e6a0, 0xc0004b4400, 0xc000947b58, 0xc00093ed80, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000830460, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b4fef0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000947ef0, 0x3b9aca00, 0x0, 0xc000b4ff01, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000830460, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007f8e10, 0xc0006f94a0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1590 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000722320, 0x2f5e6a0, 0xc0009ea040, 0xc000a31b58, 0xc00080d7a0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000722320, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0009c7ef0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a31ef0, 0x3b9aca00, 0x0, 0xc0009c7f01, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000722320, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001f4fd0, 0xc0040c8c40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 988 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc00018bb00, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203 +0xf3
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables.func1(0x2f47640, 0xc00018bb00, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:477 +0x49
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:476 +0x102

goroutine 481 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000831180, 0x0, 0xc0000af0e0, 0xc000850060)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 476 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000831180, 0x2f5e6a0, 0xc00005a440, 0xc000abdbe0, 0xc000850060, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000831180, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000c14f78)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000abdf78, 0x3b9aca00, 0x0, 0x1, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000831180, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.reflectorPerNamespace
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/store.go:66 +0x134

goroutine 926 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000bce7e0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:198 +0xe0
created by k8s.io/client-go/util/workqueue.newQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:58 +0x132

goroutine 1601 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc003f59f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc003f6a8e0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1007 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d04028, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d04018)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000d04000, 0xc000568b40, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000b90500)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000985e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000985e00, 0x3b9aca00, 0x0, 0xc000914101, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc000b90500, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0004eaf30, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 1064 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000784be0, 0x2f5e6a0, 0xc0004b4980, 0xc000a2db58, 0xc000850000, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000784be0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0006d0ef0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a2def0, 0x3b9aca00, 0x0, 0xc0006d0f01, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000784be0, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000951ba0, 0xc0007535a0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1035 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc0006f3900)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 1417 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000a95998, 0x29)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000a95988)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000a95970, 0xc00104b990, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0009e4400)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b72e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b72e00, 0x3b9aca00, 0x0, 0xc0035a0a01, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc0009e4400, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000cbf170, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 928 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000bce960)
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:212 +0x344
created by k8s.io/client-go/util/workqueue.newDelayingQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:55 +0x1ae

goroutine 921 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start(0xc0001500e0, 0xc000916b40)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:132 +0x4c
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/deleg_map.go:60 +0x50

goroutine 827 [IO wait]:
internal/poll.runtime_pollWait(0x474d290, 0x72, 0x0)
    /usr/local/opt/go/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc0004f2a18, 0x72, 0x0, 0x0, 0x2bd6887)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc0004f2a00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/internal/poll/fd_unix.go:384 +0x1f8
net.(*netFD).accept(0xc0004f2a00, 0xc000a0fd80, 0xc000081800, 0x4700008)
    /usr/local/opt/go/libexec/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc0004a4760, 0xc000a0fdb0, 0x100c618, 0x30)
    /usr/local/opt/go/libexec/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc0004a4760, 0x2a72f60, 0xc0003bd5f0, 0x2901520, 0x3fe7620)
    /usr/local/opt/go/libexec/src/net/tcpsock.go:261 +0x47
net/http.(*Server).Serve(0xc000e0c0e0, 0x2f8d520, 0xc0004a4760, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/net/http/server.go:2896 +0x280
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveMetrics.func1(0x2bdad17, 0x8, 0xc000e0c0e0, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:357 +0xf6
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveMetrics
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:355 +0x188

goroutine 700 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000830320, 0x2f5e6a0, 0xc00040c340, 0xc000ab9be0, 0xc000099020, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000830320, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0006d5778)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000ab9f78, 0x3b9aca00, 0x0, 0x1, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000830320, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.reflectorPerNamespace
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/store.go:66 +0x134

goroutine 707 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00081f4a0, 0x0, 0xc0000aeba0, 0xc000920000)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1125 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0007b1d20, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0007b1d10)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc0007b1d08, 0xc000b1a000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc0007b1ce0, 0xc000b1a000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc0002adce0, 0xc0004cfa80, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc0002adce0, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc0002adce0, 0x292a560, 0xc0004cfa80, 0x6, 0xc0007fa4c0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc00081a840, 0xc000ab2400, 0x400, 0x400, 0x1c, 0xc0007fa4c0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000d74140, 0x0, 0x2f5e1a0, 0xc0000ad200, 0x0, 0x0, 0xc000c70a08, 0xc0009c36ea, 0xc000b85800)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0004cfa60, 0xc0007fa4c0, 0x1c, 0xc000850c70, 0x104c907, 0xc0009c3778, 0x13b7b20)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0000ad140)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1043 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00093ecc0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:212 +0x344
created by k8s.io/client-go/util/workqueue.newDelayingQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:55 +0x1ae

goroutine 1105 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc000b865c8, 0x10173be, 0x73c2560)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000b865d8, 0x0, 0xc000b865e8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b86740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b86740, 0xdf8475800, 0x0, 0x1, 0xc000868000)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc0009d8080)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000852d80, 0xc0005680a0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1049 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000830460, 0xc000916b40, 0xc000977020, 0xc00093ed80)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1577 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x2, 0x0, 0xc000c116a0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000abfdd8, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000c11740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000abff40, 0xdf8475800, 0x0, 0x1, 0xc0009448a0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000604a00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc000fabcb0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1530 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0040e6b80)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc0040d10c0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 952 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000c290c0, 0x6d65683100000000)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000c290b0)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000c290a8, 0xc000d38400, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000c29080, 0xc000d38400, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000b64580, 0xc00037a500, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000b64580, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000b64580, 0x292a560, 0xc00037a500, 0xc000c10d08, 0xc000c10d08)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000374a50, 0xc0000fb800, 0x400, 0x400, 0xc000c10e72, 0x3, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0001ac410, 0x0, 0x2f5e1a0, 0xc0004b4a80, 0xc000952cb8, 0x0, 0x0, 0x2cf9b30, 0xc00085b278)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00037a460, 0xc000c10e40, 0x21cc424, 0x0, 0x0, 0xc000c10eb0, 0xc00085b270)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0004b4980)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1063 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc000c63600)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 950 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d7e720, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d7e710)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000d7e708, 0xc000d38000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000d7e6e0, 0xc000d38000, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000b642c0, 0xc00037a2c0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000b642c0, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000b642c0, 0x292a560, 0xc00037a2c0, 0xc0009acf50, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0003745a0, 0xc0000fb400, 0x400, 0x400, 0x0, 0x0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0001ac370, 0x0, 0x2f5e1a0, 0xc0004b4600, 0x103e751, 0xc000b4a760, 0x2, 0x2, 0xc000b4a75c)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00037a280, 0x0, 0x0, 0xc00035ad08, 0xc000b4a75c, 0xc0006f4000, 0x0)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0004b4400)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1015 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000b56240)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:198 +0xe0
created by k8s.io/client-go/util/workqueue.newQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:58 +0x132

goroutine 1006 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000bc8fc0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:212 +0x344
created by k8s.io/client-go/util/workqueue.newDelayingQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/delaying_queue.go:55 +0x1ae

goroutine 429 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000c43900, 0x6873657200000000)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000c438f0)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000c438e8, 0xc000600400, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000c438c0, 0xc000600400, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc0007b1340, 0xc000856300, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc0007b1340, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc0007b1340, 0x292a560, 0xc000856300, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000650000, 0xc000ab2000, 0x400, 0x400, 0x0, 0x0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000d74370, 0x0, 0x2f5e1a0, 0xc00005a3c0, 0x0, 0x0, 0x0, 0xc000c3aeea, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0008562e0, 0x0, 0x0, 0xc0001f1330, 0x0, 0xc000c3af78, 0x13b7b20)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00005a380)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1034 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000852d20, 0xc000952cc0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007f8df0, 0xc0006f9460)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 990 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc00018bd40, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203 +0xf3
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables.func1(0x2f47640, 0xc00018bd40, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:477 +0x49
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:476 +0x102

goroutine 965 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0002ada60, 0x696f636500000000)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0002ada50)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc0002ada48, 0xc000d98600, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc0002ada20, 0xc000d98600, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000b02f20, 0xc0009f4680, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000b02f20, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000b02f20, 0x292a560, 0xc0009f4680, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0006dea50, 0xc0001e0c00, 0x400, 0x400, 0x0, 0x0, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc00081c140, 0x0, 0x2f5e1a0, 0xc00040c540, 0x0, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0009f4660, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00040c500)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 799 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000c297a0, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000c29790)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000c29788, 0xc000b6fc00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc000c29760, 0xc000b6fc00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc000c29b80, 0xc00037b240, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc000c29b80, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc000c29b80, 0x292a560, 0xc00037b240, 0x6, 0xc00044e980)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0007c2870, 0xc000c49c00, 0x400, 0x400, 0x14, 0xc00044e980, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0000d4dc0, 0x0, 0x2f5e1a0, 0xc00040c380, 0x2000000000000, 0x0, 0xc000921068, 0xc000b7feea, 0xc0009ae000)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00037b1e0, 0x10000c000916720, 0x2, 0xc000b15570, 0x104c907, 0xc000b7ff78, 0x13b7b20)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00040c340)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1052 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000d70200)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc00066c680, 0xc0007c78e0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 796 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000830320, 0x0, 0xc0009183c0, 0xc000099020)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1062 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc00066c8c0, 0xc00096d740)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000951b80, 0xc000753560)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1030 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000a94de8, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000a94dd8)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000a94dc0, 0xc000b432a0, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0006f3900)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000a4be00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a4be00, 0x3b9aca00, 0x0, 0xc000914201, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc0006f3900, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000b04480, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 1056 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000d70280)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001eb480, 0xc0007c7b30)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1004 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000bc8e40)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:198 +0xe0
created by k8s.io/client-go/util/workqueue.newQueue
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:58 +0x132

goroutine 1058 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0009b4ff8, 0x1)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0009b4fe8)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0009b4fd0, 0xc0006e5c50, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000c63600)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000988e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000988e00, 0x3b9aca00, 0x0, 0xc000914201, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc000c63600, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0004eb0e0, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 701 [IO wait]:
internal/poll.runtime_pollWait(0x474d1c0, 0x72, 0x0)
    /usr/local/opt/go/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc00091a898, 0x72, 0x0, 0x0, 0x2bd6887)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /usr/local/opt/go/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc00091a880, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/internal/poll/fd_unix.go:384 +0x1f8
net.(*netFD).accept(0xc00091a880, 0xc00099ccd8, 0xc000096000, 0x4701460)
    /usr/local/opt/go/libexec/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc000856cc0, 0xc00099cd08, 0x100c618, 0x30)
    /usr/local/opt/go/libexec/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc000856cc0, 0x2a72f60, 0xc000650a50, 0x2901520, 0x3fe7620)
    /usr/local/opt/go/libexec/src/net/tcpsock.go:261 +0x47
net/http.(*Server).Serve(0xc0001502a0, 0x2f8d520, 0xc000856cc0, 0x0, 0x0)
    /usr/local/opt/go/libexec/src/net/http/server.go:2896 +0x280
net/http.(*Server).ListenAndServe(0xc0001502a0, 0xc0001502a0, 0x1)
    /usr/local/opt/go/libexec/src/net/http/server.go:2825 +0xb7
net/http.ListenAndServe(...)
    /usr/local/opt/go/libexec/src/net/http/server.go:3081
github.com/operator-framework/operator-sdk/pkg/kube-metrics.ServeMetrics(0xc00084c240, 0x5, 0x8, 0x2bd7c35, 0x7, 0x21ee)
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/server.go:55 +0x2aa
created by github.com/operator-framework/operator-sdk/pkg/kube-metrics.GenerateAndServeCRMetrics
    src/github.com/operator-framework/operator-sdk/pkg/kube-metrics/metrics.go:64 +0x5b1

goroutine 953 [runnable]:
k8s.io/apimachinery/pkg/conversion.verifyConversionFunctionSignature(0x2fe43c0, 0x2907f80, 0x13, 0x2fe43c0)
    pkg/mod/k8s.io/[email protected]/pkg/conversion/converter.go:353 +0x5eb
k8s.io/apimachinery/pkg/conversion.ConversionFuncs.Add(0xc0002663f0, 0xc000266420, 0xc00179ce00, 0x1, 0x1, 0x2c06faf, 0x14)
    pkg/mod/k8s.io/[email protected]/pkg/conversion/converter.go:173 +0x117
k8s.io/apimachinery/pkg/conversion.(*Converter).RegisterConversionFunc(...)
    pkg/mod/k8s.io/[email protected]/pkg/conversion/converter.go:376
k8s.io/apimachinery/pkg/runtime.(*Scheme).AddConversionFuncs(0xc0001eb880, 0xc00179cf78, 0x4, 0x4, 0x7, 0xc00179d008)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme.go:343 +0xa4
k8s.io/apimachinery/pkg/apis/meta/v1.AddToGroupVersion(0xc0001eb880, 0x2c06faf, 0x14, 0x2bda9a7, 0x7)
    pkg/mod/k8s.io/[email protected]/pkg/apis/meta/v1/register.go:60 +0x538
k8s.io/apiextensions-apiserver/pkg/apis/apiextensions/v1beta1.addKnownTypes(0xc0001eb880, 0xc00179d150, 0x100c618)
    pkg/mod/k8s.io/[email protected]/pkg/apis/apiextensions/v1beta1/register.go:53 +0x165
k8s.io/apimachinery/pkg/runtime.(*SchemeBuilder).AddToScheme(0x4014ce0, 0xc0001eb880, 0xc003a4d300, 0xc00179d1d0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/scheme_builder.go:29 +0x6d
helm.sh/helm/v3/pkg/kube.New(0x2f966a0, 0xc003a4d300, 0xc000747e30)
    pkg/mod/helm.sh/helm/[email protected]/pkg/kube/client.go:63 +0x55
github.com/operator-framework/operator-sdk/pkg/helm/release.managerFactory.NewManager(0x2fd1960, 0xc000762600, 0xc00044f2a0, 0x14, 0xc0030f66e0, 0xc0004b0480, 0x2f5e1e0, 0xc0030f66e0, 0x0, 0x0)
    src/github.com/operator-framework/operator-sdk/pkg/helm/release/manager_factory.go:84 +0x565
github.com/operator-framework/operator-sdk/pkg/helm/controller.HelmOperatorReconciler.Reconcile(0x2fbb340, 0xc000826960, 0x2f969e0, 0xc0004b5e40, 0xc000400870, 0x10, 0xc000400840, 0x8, 0xc000400888, 0x8, ...)
    src/github.com/operator-framework/operator-sdk/pkg/helm/controller/reconcile.go:86 +0x5a3
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00018bbc0, 0x29ad640, 0xc000d79380, 0x4022b00)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:256 +0x162
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00018bbc0, 0xc000944700)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232 +0xcb
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00018bbc0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211 +0x2b
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000810010)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000810010, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(0xc000810010, 0x3b9aca00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88 +0x4d
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:193 +0x328

goroutine 991 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc00018bec0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:203 +0xf3
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables.func1(0x2f47640, 0xc00018bec0, 0xc000762600)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:477 +0x49
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElectionRunnables
    pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:476 +0x102

goroutine 1050 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000784be0, 0xc000916b40, 0xc000918300, 0xc000850000)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1077 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002a0780, 0x2f5e6a0, 0xc00040c500, 0xc000a2bb58, 0xc0000c4780, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002a0780, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000a1c6f0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a2bef0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002a0780, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000757670, 0xc00091e940)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1123 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002a0780, 0xc000916b40, 0xc000940d20, 0xc0000c4780)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1066 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc000c135c8, 0x10173be, 0x73c4078)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc00099fdd8, 0x0, 0xc000c135e8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000c13740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00099ff40, 0xdf8475800, 0x0, 0xc000c13601, 0xc000944000)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000b5a500)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0006627d0, 0xc0002d2ca0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1067 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000b5a500)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0006627d0, 0xc0002d2cd0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1126 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0009eae50, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0009eae40)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/util/workqueue.(*Type).Get(0xc000b56240, 0x0, 0x0, 0x1047800)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:145 +0xa0
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc0000ba000, 0x0)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:218 +0x43
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc0000ba000)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211 +0x2b
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b42480)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b42480, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(0xc000b42480, 0x3b9aca00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88 +0x4d
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:193 +0x328

goroutine 1127 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000c0ac90, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000c0ac80)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/util/workqueue.(*Type).Get(0xc000bc8e40, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/util/workqueue/queue.go:145 +0xa0
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00018bb00, 0xc000976000)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:218 +0x43
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00018bb00)
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211 +0x2b
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b42490)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b42490, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(0xc000b42490, 0x3b9aca00, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88 +0x4d
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
    pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:193 +0x328

goroutine 1586 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00081e820, 0xc000916b40, 0xc000976ae0, 0xc0037fc4e0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1421 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000e84f50, 0xc000976780)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0010606d0, 0xc001040ea0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1593 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0007b05c0, 0x0)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0007b05b0)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc0007b05a8, 0xc0040bd800, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc0007b0580, 0xc0040bd800, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc0007b14a0, 0xc0040c9540, 0x0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc0007b14a0, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc0007b14a0, 0x292a560, 0xc0040c9540, 0x6, 0xc00044e980)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc009a92d50, 0xc003ff7000, 0x400, 0x400, 0x14, 0xc00044e980, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc00074e320, 0x0, 0x2f5e1a0, 0xc0032f0f80, 0x2000000000000, 0x0, 0x0, 0xc000b7feea, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0040c9520, 0x10000c000953020, 0x0, 0xc000b7fec8, 0x104c907, 0x4022ac0, 0xc0000d5a98)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0032f0f40)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1548 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000870bd0, 0xc0009443c0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000a9a290, 0xc000809e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1550 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00081e820, 0x2f5e6a0, 0xc0032f0f40, 0xc00094bb58, 0xc0037fc4e0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00081e820, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b4cef0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00094bef0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc00081e820, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000a9a2b0, 0xc000809e40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1549 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc000c47a80)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 1543 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc00053e380)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc0006fa010)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1589 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc004059180)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 1422 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc000916b40, 0xc0009e4400)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:104 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:103 +0xae

goroutine 1585 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002a0be0, 0xc000916b40, 0xc0009762a0, 0xc0037fc180)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:233 +0x178
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:227 +0x260

goroutine 1561 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc004382720, 0xc000000000)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc004382710)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc004382708, 0xc003f98c00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xa6
golang.org/x/net/http2.transportResponseBody.Read(0xc0043826e0, 0xc003f98c00, 0x200, 0x200, 0x0, 0x0, 0x0)
    pkg/mod/golang.org/x/[email protected]/http2/transport.go:2005 +0xac
encoding/json.(*Decoder).refill(0xc0000ff080, 0xc00107ee00, 0x486b4953302f5248)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:161 +0xeb
encoding/json.(*Decoder).readValue(0xc0000ff080, 0x0, 0x0, 0x2905dc0)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:136 +0x1dc
encoding/json.(*Decoder).Decode(0xc0000ff080, 0x292a560, 0xc00107ee00, 0x334f367857373968, 0x354467756a0a542f)
    /usr/local/opt/go/libexec/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0006c2db0, 0xc003f90800, 0x400, 0x400, 0x100892b, 0xc000b22f90, 0x38)
    pkg/mod/k8s.io/[email protected]/pkg/util/framer/framer.go:150 +0x1a1
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0001ac5f0, 0x0, 0x2f5e1a0, 0xc0009ea080, 0x103e751, 0xc000b49f60, 0x2, 0x2, 0xc000b49f5c)
    pkg/mod/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00107ede0, 0xc000389500, 0x0, 0xc000c70468, 0xc000b49f5c, 0xc000c27980, 0x0)
    pkg/mod/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x7c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0009ea040)
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:104 +0x175
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
    pkg/mod/k8s.io/[email protected]/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 1588 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc0006388c0, 0xc000976c60)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:529 +0x49
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001f4f80, 0xc0040c8c00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1423 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002a0be0, 0x2f5e6a0, 0xc000837900, 0xc000a2fb58, 0xc0037fc180, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:327 +0x1ec
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002a0be0, 0xc000916b40, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:293 +0x8ba
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:122 +0x33
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0006ec6f0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a2fef0, 0x3b9aca00, 0x0, 0x1, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002a0be0, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:121 +0x169
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:54 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0010606f0, 0xc001040ee0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1529 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x6, 0xc0006ecdc8, 0x103fd01)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000d3add8, 0x4029150, 0xc0006ecdf8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0006ecf40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000d3af40, 0xdf8475800, 0x0, 0x102d701, 0xc000977aa0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc0040e6b80)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc0040d10b0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1544 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0009b40d8, 0x1)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0009b40c8)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0009b40b0, 0xc0006555d0, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000c47a80)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b75e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b75e00, 0x3b9aca00, 0x0, 0xc003692001, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc000c47a80, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0009ee360, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 1606 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc004116f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000638920, 0xc0040f5670)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1580 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc003f53600)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc00c491410)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1602 [sync.Cond.Wait]:
runtime.goparkunlock(...)
    /usr/local/opt/go/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0000f2868, 0x1)
    /usr/local/opt/go/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0000f2858)
    /usr/local/opt/go/libexec/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0000f2840, 0xc0040ca840, 0x0, 0x0, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/tools/cache/delta_fifo.go:423 +0xa6
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc004059180)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:153 +0x40
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000b76e00)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b76e00, 0x3b9aca00, 0x0, 0xc003692101, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*controller).Run(0xc004059180, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/controller.go:125 +0x2fd
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0009ee870, 0xc000916b40)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:331 +0x47f
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
    pkg/mod/sigs.k8s.io/[email protected]/pkg/cache/internal/informers_map.go:204 +0x3db

goroutine 1579 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc00070e7e0, 0x6, 0xc0009035b0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000a25dd8, 0x2a83880, 0xc00070e6d8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000903740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a25f40, 0xdf8475800, 0x0, 0xc000903601, 0xc000944900)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc003f53600)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc00c491350)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1542 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0x2, 0x0, 0xc000967ea0)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000a57dd8, 0x0, 0x0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000967f40)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a57f40, 0xdf8475800, 0x0, 0x1, 0xc0009763c0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc00053e380)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc0006fa000)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1578 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000604a00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:621 +0x18d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000e84fb0, 0xc000fabcc0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

goroutine 1552 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc0008fd5c8, 0x10173be, 0x73c3f68)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:653 +0x54
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0x0, 0xc000b79dd8, 0x104c907, 0xc0008fd5e8)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:292 +0x51
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:652 +0x79
k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc0008fd740)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152 +0x5e
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b79f40, 0xdf8475800, 0x0, 0x1, 0xc000940000)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153 +0xf8
k8s.io/apimachinery/pkg/util/wait.Until(...)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88
k8s.io/client-go/tools/cache.(*processorListener).run(0xc003f59f00)
    pkg/mod/k8s.io/[email protected]/tools/cache/shared_informer.go:650 +0x9b
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000870c30, 0xc003f6a8d0)
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x59
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
    pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:69 +0x62

aredependency kinbug languaghelm

Source

monaka

All 8 comments

@monaka This is caused by a bug in Helm that was fixed in https://github.com/helm/helm/pull/7249.

It looks like this is lined up to be release in Helm 3.1.0, which we plan to jump to when it's released. I think the Helm maintainers are planning a 3.0.3 release for this week, so I've asked to see if that fix can be backported.

joelanford on 28 Jan 2020

👍1

@monaka Helm maintainers are considering this a feature enhancement, so it will not be fixed upstream until 3.1.0 is released and we update our dependency.

https://github.com/helm/helm/pull/7249#issuecomment-579315762

This _may_ be something we can mitigate on the SDK side. Can you give us more details about your operator? It seems like this would happen when multiple CRs are being reconciled simultaneously. Do you have multiple CRDs/helm charts? Or just one?

joelanford on 28 Jan 2020

@joelanford My operator have five CRDs/charts.

monaka on 29 Jan 2020

@joelanford Additional information.
I'm not sure since this issue happens sporadically on my env.
But it seems this issue isn't reproduced with just one CRDs/charts.

monaka on 30 Jan 2020

@monaka Can you try a build using the branch from the above PR and see if that solves it?

Based on where this fix is, I _think_ a single CRD/chart can trigger it if multiple CRs are being reconciled at the same time, even for the same CRD.

joelanford on 30 Jan 2020

❤1

@monaka Thank you for your support. I tried your PR and wrote my imression to #2484.

monaka on 30 Jan 2020

I'm still seeing "fatal error: concurrent map read and map write" on the master branch from ~3 days ago. The helm operator restarted about 140 times in 24h. 1 CRD / chart, about 170 CRs

razvan-wework on 19 Mar 2020

HI @razvan-wework,

Did you upgrade your project to use the latest version?
If yes, could you please raise a new issue and provide all information requested?
Could you please add the Dockerfile used in your project as the error and if possible all steps required for we are able to reproduce it?