Gitea: Performance regression on v1.9+

[issmirnov]

• Gitea version (or commit ref): 1.9.0 (official release)
• Git version: 2.17.1
• Operating system: Ubuntu 18
• Database (use [x]):
  
  
  
  • [ ] PostgreSQL
  
  
  • [X] MySQL
  
  
  • [ ] MSSQL
  
  
  • [ ] SQLite
  
  
• Can you reproduce the bug at https://try.gitea.io:
  
  
  
  • [ ] Yes (provide example URL)
  
  
  • [ ] No
  
  
  • [X] Not relevant
  
  
• Log gist: https://gist.github.com/issmirnov/3d317a552d4d485b15519b4ed17c045a

Description

Hey folks. My server ($5 digital ocean droplet, 1vCPU 1gb RAM) has been really struggling with the latest gitea release. Up to v1.7/1.8 or so it was completely fine. Since installing v1.9, htop and other tools consistently show the gitea web process eating up a combined 80% of my CPU.

Are there any performance regression tests for gitea? These recent changes are having a major impact on my entire server, whereas previously it coexisted fine with about 30 services.

Looking at the logs, I do see tons of runtime errors. Unsure if this is related.

Thanks so much - really love gitea, and would love to see the resource usage become normal again.

Screenshots

[lunny]

Which operations did you do on gitea? And could you give any error log?

[issmirnov]

I've made no changes since installing it pre v1. I generally upgrade the binary 3 days after each release. Full log:
errorlog.tar.gz

Log configuration:

{
  "colorize": false,
  "compress": true,
  "compressionLevel": -1,
  "daily": true,
  "expression": "",
  "filename": "/home/git/gitea/log/error.log/gitea.log",
  "flags": 347,
  "level": "error",
  "maxdays": 7,
  "maxsize": 268435456,
  "prefix": "",
  "rotate": true,
  "stacktraceLevel": "none"
}

Git config:

Migration Timeout: 600 seconds
Mirror Update Timeout: 300 seconds
Clone Operation Timeout: 300 seconds
Pull Operation Timeout: 300 seconds
GC Operation Timeout: 60 seconds

System Notices (5 of the same):

Failed to health check repository (/home/git/gogs-repositories/backups/calibre.git): signal: killed

Thank you so much for looking into this!

[lafriks]

There seems too many gitea processes imho... Can you stop gitea and check if all processes are killed actually

[issmirnov]

Done. Ran systemctl stop gitea followed by pgrep gitea. CPU load instantly falls to my usual idle of about 2%. htop confirms all gitea processes are gone.

My systemd file:

[Unit]
Description=Gitea (Git with a cup of tea)
After=syslog.target
After=network.target
After=mysqld.service

[Service]
# Modify these two values and uncomment them if you have
# repos with lots of files and get an HTTP error 500 because
# of that
###
#LimitMEMLOCK=infinity
#LimitNOFILE=65535
RestartSec=2s
Type=simple
User=git
Group=git
WorkingDirectory=/home/git/gitea
ExecStart=/home/git/gitea/gitea web
Restart=always
Environment=USER=git HOME=/home/git

# security
PrivateTmp=true
ReadWritePaths=/home/git
ProtectSystem=strict

# stop Macaron http logs
StandardOutput=null 

[Install]
WantedBy=multi-user.target

[silverwind]

Do you have the repo indexer enabled? If yes, it could be the cause. After it's done updating the index, CPU should go to idle levels.

[typeless]

Does it happen on a fresh install? ( including the performance regression and the runtime errors)

[issmirnov]

@silverwind I don't have it enabled - I saw the strict warning and decided to use Sourcegraph on a different machine that's more powerful.

@typeless I will try to find time on the weekend to set up a secondary instance and repro. Been using the same config for a while so want to be careful to not nuke the data.

[typeless]

@issmirnov Okay. I am particularly concerned about whether it is related to the state of the database.

[issmirnov]

Whoa. So here's a wild datapoint. I restarted the service 4 days ago, and look at the memory allocation! It's 321GB. There have also been 6 BILLION memory allocations and frees.

Current Memory Usage: 75MB
Total Memory Allocated: 321GB
Memory Obtained: 272MB
Pointer Lookup Times: 0
Memory Allocations: 6824696694
Memory Frees: 6823996775

[lunny]

@issmirnov I think Total Memory Allocated is non-meaningful here. You just need to know Current Memory Usage. For a long term monitoring, maybe you could monitor gitea by Prometheus.

[issmirnov]

@lunny understood, been meaning to set up a prometheus/grafana stack.

I've tried to do some digging this weekend. Haven't had a chance to spin up a fresh install. A few discoveries:

• resource usage spikes during git.fsck cron jobs. This is expected, however, I have some giant mirrors that are killing the node. Specifically, I have a mirror of calibre and qmk_firmware. Would be great to have someone else try out a migration and see if it has a similar effect.
• second disocovery is that the runtime panic is happening here: https://github.com/go-gitea/gitea/blob/171b3598778a1ecd0a921c71ed6755bfef68f7f0/routers/repo/repo.go#L328 Error is PANIC:: runtime error: invalid memory address or nil pointer dereference. Earlier in the stack trace I see https://github.com/go-macaron/inject/blob/master/inject.go#L177

Here's the full stack trace:

2019/08/25 00:18:25 ...les/context/panic.go:34:1() [E] PANIC:: runtime error: invalid memory address or nil pointer dereference
    /usr/local/go/src/runtime/panic.go:82 (0x44a620)
    /usr/local/go/src/runtime/signal_unix.go:390 (0x44a44f)
    /go/src/code.gitea.io/gitea/routers/repo/repo.go:329 (0x1387fbb)
    /usr/local/go/src/reflect/value.go:447 (0x48f370)
    /usr/local/go/src/reflect/value.go:308 (0x48edf3)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:177 (0x9854b6)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:137 (0x984dab)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:112 (0x11d2a68)
    /go/src/code.gitea.io/gitea/modules/context/panic.go:38 (0x11d2a5b)
    /usr/local/go/src/reflect/value.go:447 (0x48f370)
    /usr/local/go/src/reflect/value.go:308 (0x48edf3)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:177 (0x9854b6)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:137 (0x984dab)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:112 (0x9e4706)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/session/session.go:192 (0x9e46f1)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:79 (0x9b4dd0)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:157 (0x985170)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:135 (0x984e9a)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:112 (0x1449ccf)
    /go/src/code.gitea.io/gitea/modules/gzip/gzip.go:139 (0x1449cc2)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:79 (0x9b4dd0)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:157 (0x985170)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:135 (0x984e9a)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:112 (0x9c69bf)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/recovery.go:161 (0x9c69ad)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/logger.go:40 (0x9b8bc3)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:157 (0x985170)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:135 (0x984e9a)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:112 (0x9c5ce0)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/logger.go:52 (0x9c5ccb)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/logger.go:40 (0x9b8bc3)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:157 (0x985170)
    /go/src/code.gitea.io/gitea/vendor/github.com/go-macaron/inject/inject.go:135 (0x984e9a)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/context.go:121 (0x9b4f29)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/router.go:187 (0x9c7c06)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/router.go:303 (0x9c1675)
    /go/src/code.gitea.io/gitea/vendor/gopkg.in/macaron.v1/macaron.go:220 (0x9b9f9c)
    /go/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 (0xd18a7a)
    /usr/local/go/src/net/http/server.go:1995 (0x779a53)
    /usr/local/go/src/net/http/server.go:2774 (0x77cd27)
    /usr/local/go/src/net/http/server.go:1878 (0x778a10)
    /usr/local/go/src/runtime/asm_amd64.s:1337 (0x464680)

The reason I bring this up is that I see 4 instances of gitea web running. I'm not familiar with the threading model used for the task runners in gitea, but it could be that the panics in the git.fsck jobs cause new instances of gitea to be launched and thus thrash the system.

[lunny]

If you only have one gitea web site, you should only see ONLY one gitea web process but not 4 instances. That should some scripts configuration error I think.

[guillep2k]

If you only have one gitea web site, you should only see ONLY one gitea web process but not 4 instances. That should some scripts configuration error I think.

One valid case in which 4 instances can happen is when Gitea is executed from a git remote (e.g. ssh) with the serv cmd. Also, git processes will usually spawn gitea hook calls as well.

Of course all of this can happen only if the system is live, with users connecting and making requests, or during a migration process.

Only one instance should be a long time runner, though.

[lunny]

Yes, I mean only one gitea web, NOT gitea hook or gitea serv.

[issmirnov]

I've been digging into this every spare chance that I get, and am unable to track down the root cause. Running gitea standalone also had high CPU usage, but I can't get reliable reproduction.

In the meantime I've scaled my droplet to 2GB ram and 2vCPU, and used systemd to throttle the gitea CPU usage.

[Service]
CPUWeight=80
CPUQuota=85%

[typeless]

Gitea has built-in pprof support, which can be enabled by setting ENABLE_PPROF=true in the [server] section of app.ini. That might help.

[issmirnov]

Thanks. I'm waiting to spin up my prometheus stack to track this.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs during the next 2 weeks. Thank you for your contributions.

[alexanderadam]

Maybe it would make sense to add the labels performance/memory and performance/speed (like in #9271) also to this issue here and #4807? :thinking:

[whyicantusemyemailasusername]

Not sure if it helps, but freshly installed gitea on pi 4 constantly eats 5% cpu (no repositores created)
Looks like too much

[lunny]

We have more features today and some of them are enabled defaultly. I think that's one reason why gitea spend more resources than before.

[whyicantusemyemailasusername]

how can I disable some of the features enabled defaultly? I checked the documentation and didn't find anything related to performance (apart from indexing, which is turned off by default for repositories). adding MAX_WORKERS=1 and TYPE=level to [queue] section didn't help

[ltGuillaume]

If you only have one gitea web site, you should only see ONLY one gitea web process but not 4 instances. That should some scripts configuration error I think.

If this is true, then why do I have 10 (!) gitea web processes running with the default settings? Gitea is idle almost all of the time. Once every 24 hours, it has to sync a few very small GitHub-mirrored repos, that's it. The main thread constantly uses 2% CPU and the other threads alternate in using 1%. This isn't horrible, of course, but I don't understand what could possibly cause it.

Raspberry Pi 4 on Arch Linux
Gitea 1.11.6-2
Default settings except for ROOT.

[silverwind]

You're probably confusing threads with processes. Enable "Hide userland threads" in htop.

[ltGuillaume]

You're probably confusing threads with processes. Enable "Hide userland threads" in htop.

Great, that was stupid. Been using htop instead of top for less than a day now, I think it shows! 😅 Thanks for reminding me.

Nevertheless, I think the CPU usage is still strange.

[ltGuillaume]

Updating from Gitea 1.11.6 to 1.12.3 doubled the CPU use. Are there any settings I could/should optimize? I've tried disabling notifications under [ui.notification] and caching under [cache] and restarted. There was no difference.

[typeless]

I used to take a look at this problem. Unfortunately, I don't have much spare time to dig further.
Here is a log I got by using gops for a running instance, which might give some insight.

goroutine 54 [running]:
runtime/pprof.writeGoroutineStacks(0x4128fe0, 0xc00a9a8450, 0x30, 0xd0)
    /home/mural/src/golang.org/go/src/runtime/pprof/pprof.go:665 +0x9d
runtime/pprof.writeGoroutine(0x4128fe0, 0xc00a9a8450, 0x2, 0x0, 0x7)
    /home/mural/src/golang.org/go/src/runtime/pprof/pprof.go:654 +0x44
runtime/pprof.(*Profile).WriteTo(0x59e90c0, 0x4128fe0, 0xc00a9a8450, 0x2, 0xc00a9a8450, 0x1)
    /home/mural/src/golang.org/go/src/runtime/pprof/pprof.go:329 +0x3da
github.com/google/gops/agent.handle(0x7f13f32ee1f8, 0xc00a9a8450, 0xc000e5e010, 0x1, 0x1, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/google/gops/agent/agent.go:189 +0x1af
github.com/google/gops/agent.listen()
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/google/gops/agent/agent.go:133 +0x2bf
created by github.com/google/gops/agent.Listen
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/google/gops/agent/agent.go:111 +0x386

goroutine 1 [IO wait, 7 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9d30, 0x72, 0x0)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc011bbd498, 0x72, 0x0, 0x0, 0x251d4ca)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc011bbd480, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:384 +0x1d4
net.(*netFD).accept(0xc011bbd480, 0x203000, 0x203000, 0x203000)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc011bf4760, 0xc00dc07398, 0x41acc6, 0xc0032459a0)
    /home/mural/src/golang.org/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).AcceptTCP(0xc011bf4760, 0xd907de62ee74b7ad, 0xc00dc07370, 0x4653c9)
    /home/mural/src/golang.org/go/src/net/tcpsock.go:248 +0x65
code.gitea.io/gitea/modules/graceful.(*wrappedListener).Accept(0xc011bf4780, 0xc00dc073e8, 0x18, 0xc000000180, 0x76085c)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server.go:204 +0x4f
net/http.(*Server).Serve(0xc002a4b5e0, 0x414b880, 0xc011bf4780, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/http/server.go:2901 +0x25d
code.gitea.io/gitea/modules/graceful.(*Server).Serve(0xc011bf6720, 0xc011bdd4a0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server.go:157 +0x142
code.gitea.io/gitea/modules/graceful.(*Server).ListenAndServe(0xc011bf6720, 0xc011bdd4a0, 0xc011be0360, 0xc)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server.go:87 +0x1fc
code.gitea.io/gitea/modules/graceful.HTTPListenAndServe(0x24ead83, 0x3, 0xc011be0360, 0xc, 0x412bfc0, 0xc011bf4580, 0x0, 0xc011be0360)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server_http.go:30 +0x79
code.gitea.io/gitea/cmd.runHTTP(...)
    /home/mural/src/code.gitea.io/gitea/cmd/web_graceful.go:18
code.gitea.io/gitea/cmd.runWeb(0xc00043f8c0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/cmd/web.go:179 +0x9c8
github.com/urfave/cli.HandleAction(0x214d8c0, 0x3c3d468, 0xc00043f8c0, 0xc0001b6900, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/urfave/cli/app.go:490 +0xc8
github.com/urfave/cli.Command.Run(0x24eb1dc, 0x3, 0x0, 0x0, 0x0, 0x0, 0x0, 0x26389f2, 0x16, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/urfave/cli/command.go:210 +0x9e8
github.com/urfave/cli.(*App).Run(0xc000234d00, 0xc0001a8020, 0x2, 0x2, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/urfave/cli/app.go:255 +0x741
main.main()
    /home/mural/src/code.gitea.io/gitea/main.go:117 +0x943

goroutine 1051 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0034f44e0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x43b

goroutine 6 [select]:
code.gitea.io/gitea/modules/log.(*MultiChannelledLog).Start(0xc0003228c0)
    /home/mural/src/code.gitea.io/gitea/modules/log/event.go:300 +0x3b5
created by code.gitea.io/gitea/modules/log.(*MultiChannelledLog).AddLogger
    /home/mural/src/code.gitea.io/gitea/modules/log/event.go:190 +0x1c4

goroutine 7 [select, 12 minutes]:
github.com/blevesearch/bleve/index.AnalysisWorker(0xc002943e00, 0xc002943e60)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:102 +0x102
created by github.com/blevesearch/bleve/index.NewAnalysisQueue
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:94 +0xc8

goroutine 8 [select, 12 minutes]:
github.com/blevesearch/bleve/index.AnalysisWorker(0xc002943e00, 0xc002943e60)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:102 +0x102
created by github.com/blevesearch/bleve/index.NewAnalysisQueue
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:94 +0xc8

goroutine 9 [select, 12 minutes]:
github.com/blevesearch/bleve/index.AnalysisWorker(0xc002943e00, 0xc002943e60)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:102 +0x102
created by github.com/blevesearch/bleve/index.NewAnalysisQueue
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:94 +0xc8

goroutine 10 [select, 12 minutes]:
github.com/blevesearch/bleve/index.AnalysisWorker(0xc002943e00, 0xc002943e60)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:102 +0x102
created by github.com/blevesearch/bleve/index.NewAnalysisQueue
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/blevesearch/bleve/index/analysis.go:94 +0xc8

goroutine 2013 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f92b0, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc010420a18, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc010420a00, 0xc00d47dc01, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc010420a00, 0xc00d47dc01, 0x1, 0x1, 0xc0033e2a20, 0xc002e5d730, 0xc0102295b0)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc00d43edc0, 0xc00d47dc01, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00d47dbf0)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 51 [syscall, 12 minutes]:
os/signal.signal_recv(0x475e26)
    /home/mural/src/golang.org/go/src/runtime/sigqueue.go:147 +0x9c
os/signal.loop()
    /home/mural/src/golang.org/go/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.Notify.func1
    /home/mural/src/golang.org/go/src/os/signal/signal.go:127 +0x44

goroutine 53 [chan receive, 12 minutes]:
github.com/google/gops/agent.gracefulShutdown.func1(0xc0001b65a0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/google/gops/agent/agent.go:146 +0x41
created by github.com/google/gops/agent.gracefulShutdown
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/google/gops/agent/agent.go:144 +0xd7

goroutine 55 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).handleSignals(0xc0001b6960, 0x4158100, 0xc002acee80)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager_unix.go:109 +0x20b
created by code.gitea.io/gitea/modules/graceful.(*Manager).start
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager_unix.go:56 +0x137

goroutine 1052 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0034f44e0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x259
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58f

goroutine 1713 [select]:
code.gitea.io/gitea/routers/events.Events(0xc00309ab00)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc006ab5d80, 0x1, 0x1, 0xc00c924bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc006ab5d80, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00698f8e0, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00698f8e0, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc00309ab00)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc006ab5c80, 0x1, 0x1, 0xc00c925050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc006ab5c80, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00698f8e0, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00698f8e0, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc003114750, 0x1, 0x1, 0x24c9520, 0xc000ffc360, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00698f8e0, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00698f8e0, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc000ffc360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc00698f980, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4a, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00698f8e0, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00698f8e0, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00c9056a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc000ffc360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc00698f940, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc000ffb098, 0xf90000c00c905960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00698f8e0, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00c9059c8, 0x41acc6, 0xc0003443c0, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00698f8e0, 0x2212e20, 0x3c400e8, 0xc0003444d0, 0xc00e832160, 0x20, 0xc00302e660, 0xc00c9059f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00c90c0e0, 0xc003168500, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00c90c0e0, 0xc003168500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00c90c0e0, 0xc003168500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00c90c0e0, 0xc003168500)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00c90c0e0, 0xc003168500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00c90c0e0, 0xc003168500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0042ea3c0, 0x4158100, 0xc000e44680)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 38 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run(0xc002e46150, 0x3c3dc68, 0x3c3dc70)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:104 +0x314
created by code.gitea.io/gitea/modules/queue.(*PersistableChannelQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_disk_channel.go:154 +0x213

goroutine 1050 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0034f44e0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x419

goroutine 40 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc0016fe080, 0xc002dd3ea0, 0x1, 0xc00019b5d0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 1054 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*PersistableChannelQueue).Run(0xc002dd3d50, 0xc000330150, 0xc000330170)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_disk_channel.go:161 +0x2ec
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns(0xc0001b6960, 0xc003d5b2a0)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:83 +0x10e
created by code.gitea.io/gitea/modules/task.Init
    /home/mural/src/code.gitea.io/gitea/modules/task/task.go:42 +0x116

goroutine 37 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0xc00019af50, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 1012 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0xc0003302f0, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 88 [select]:
code.gitea.io/gitea/modules/log.(*ChannelledLog).Start(0xc000f1b180)
    /home/mural/src/code.gitea.io/gitea/modules/log/event.go:70 +0xdb
created by code.gitea.io/gitea/modules/log.NewChannelledLog
    /home/mural/src/code.gitea.io/gitea/modules/log/event.go:61 +0x20f

goroutine 25 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc0003ac900, 0x4158100, 0xc003d5e040)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc0003ac900, 0x4158100, 0xc003d5e040)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 24 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc003d5e040, 0xc002e461c0, 0x1, 0xc0010601f0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 69 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc00020db00, 0x4158100, 0xc0016fe080)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc00020db00, 0x4158100, 0xc0016fe080)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 91 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00045a460)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x128
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x19a

goroutine 92 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc004030820)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x419

goroutine 93 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc004030820)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x43b

goroutine 94 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc004030820)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x259
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58f

goroutine 95 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc004030820)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x140
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5b1

goroutine 96 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*PersistableChannelQueue).Run(0xc002e462a0, 0xc00019aad0, 0xc00019ad70)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_disk_channel.go:161 +0x2ec
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns(0xc0001b6960, 0xc002b2bfb0)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:83 +0x10e
code.gitea.io/gitea/modules/notification/ui.(*notificationService).Run(0xc000dbb330)
    /home/mural/src/code.gitea.io/gitea/modules/notification/ui/ui.go:50 +0x8c
created by code.gitea.io/gitea/modules/notification.RegisterNotifier
    /home/mural/src/code.gitea.io/gitea/modules/notification/notification.go:25 +0x4a

goroutine 36 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2.1(0xc0001b6960, 0xc00019af00, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:85 +0xc5
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:84 +0x5c

goroutine 23 [sleep]:
time.Sleep(0x5f5e100)
    /home/mural/src/golang.org/go/src/runtime/time.go:188 +0xba
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).readToChan(0xc002e46150)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:134 +0x29f
created by code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:101 +0x217

goroutine 100 [select, 12 minutes]:
database/sql.(*DB).connectionOpener(0xc000fd4d80, 0x4158100, 0xc00168d200)
    /home/mural/src/golang.org/go/src/database/sql/sql.go:1052 +0xe8
created by database/sql.OpenDB
    /home/mural/src/golang.org/go/src/database/sql/sql.go:722 +0x15d

goroutine 101 [select, 12 minutes]:
database/sql.(*DB).connectionResetter(0xc000fd4d80, 0x4158100, 0xc00168d200)
    /home/mural/src/golang.org/go/src/database/sql/sql.go:1065 +0xfb
created by database/sql.OpenDB
    /home/mural/src/golang.org/go/src/database/sql/sql.go:723 +0x193

goroutine 1053 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0034f44e0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x140
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5b1

goroutine 1709 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9a90, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc00309a218, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00309a200, 0xc0069856c1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00309a200, 0xc0069856c1, 0x1, 0x1, 0xc011c6ca80, 0xc002e59730, 0x413515)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0069be2a0, 0xc0069856c1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc0069856b0)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 1056 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc000e62b80, 0xc002dd2070, 0x1, 0xc00121e650)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 1057 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc000fdd380, 0x4158100, 0xc000e62b80)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc000fdd380, 0x4158100, 0xc000e62b80)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 1055 [select]:
code.gitea.io/gitea/modules/eventsource.(*Manager).Run(0xc00021e0d0, 0x4157fc0, 0xc003d5b2e0)
    /home/mural/src/code.gitea.io/gitea/modules/eventsource/manager_run.go:32 +0x10f
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownContext(0xc0001b6960, 0xc00121e640)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:135 +0xf7
created by code.gitea.io/gitea/modules/eventsource.(*Manager).Init
    /home/mural/src/code.gitea.io/gitea/modules/eventsource/manager_run.go:23 +0x95

goroutine 1013 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run(0xc002dd2000, 0x3c3dc68, 0x3c3dc70)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:104 +0x314
created by code.gitea.io/gitea/modules/queue.(*PersistableChannelQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_disk_channel.go:154 +0x213

goroutine 1721 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Server).awaitShutdown(0xc011bf6720)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server_hooks.go:16 +0xe8
created by code.gitea.io/gitea/modules/graceful.(*Server).ListenAndServe
    /home/mural/src/code.gitea.io/gitea/modules/graceful/server.go:75 +0x43

goroutine 1727 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9e10, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc00309a098, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00309a080, 0xc0069d2431, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00309a080, 0xc0069d2431, 0x1, 0x1, 0xc011c6c240, 0xc002e57f30, 0xc011c4aa30)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0069be210, 0xc0069d2431, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc0069d2420)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 927 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*PersistableChannelUniqueQueue).Run(0xc0033e19d0, 0xc00333ae90, 0xc00333aea0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/unique_queue_disk_channel.go:188 +0x2ec
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns(0xc0001b6960, 0xc0037f0e40)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:83 +0x10e
created by code.gitea.io/gitea/services/pull.Init
    /home/mural/src/code.gitea.io/gitea/services/pull/check.go:234 +0x12c

goroutine 1011 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2.1(0xc0001b6960, 0xc000330200, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:85 +0xc5
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:84 +0x5c

goroutine 681 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2.1(0xc0001b6960, 0xc00333aee0, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:85 +0xc5
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:84 +0x5c

goroutine 1010 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc003496460)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x128
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x19a

goroutine 926 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0034f4340)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x140
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5b1

goroutine 689 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc003348440, 0xc002b9b260, 0x1, 0xc00333afb0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 683 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run(0xc002b9b1f0, 0x3c3dc88, 0x3c3dc90)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:104 +0x314
created by code.gitea.io/gitea/modules/queue.(*PersistableChannelUniqueQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/unique_queue_disk_channel.go:181 +0x213

goroutine 1519 [select]:
code.gitea.io/gitea/routers/events.Events(0xc0102af680)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc006aceb60, 0x1, 0x1, 0xc00c920bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc006aceb60, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0069bab20, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0069bab20, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc0102af680)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc006aceac0, 0x1, 0x1, 0xc00c921050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc006aceac0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0069bab20, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0069bab20, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc00457f3a0, 0x1, 0x1, 0x24c9520, 0xc00f8ca990, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069bab20, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069bab20, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc00f8ca990, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc0069bab60, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069bab20, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069bab20, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00336d6a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc00f8ca990, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc0069bab40, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc0001d98d8, 0x5c0000c00336d960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069bab20, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00336d9c8, 0x41acc6, 0xc003f08280, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069bab20, 0x2212e20, 0x3c400e8, 0xc003f08390, 0xc00e832160, 0x20, 0xc0046d2cc0, 0xc00336d9f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca990)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00a6fc700, 0xc00af9ee00, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00a6fc700, 0xc00af9ee00)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00a6fc700, 0xc00af9ee00)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00a6fc700, 0xc00af9ee00)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00a6fc700, 0xc00af9ee00)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00a6fc700, 0xc00af9ee00)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc002b18b40, 0x4158100, 0xc00af49140)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 911 [select, 12 minutes]:
code.gitea.io/gitea/services/mirror.SyncMirrors(0x4157fc0, 0xc00359cbe0)
    /home/mural/src/code.gitea.io/gitea/services/mirror/mirror.go:345 +0xe3
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownContext(0xc0001b6960, 0x3c3f638)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:135 +0xf7
created by code.gitea.io/gitea/services/mirror.InitSyncMirrors
    /home/mural/src/code.gitea.io/gitea/services/mirror/mirror.go:459 +0x4f

goroutine 682 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0xc00333aef0, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 685 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc003348340, 0xc002b9ae70, 0x1, 0xc00333af30)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 912 [select, 12 minutes]:
code.gitea.io/gitea/modules/webhook.DeliverHooks(0x4157fc0, 0xc0037f0100)
    /home/mural/src/code.gitea.io/gitea/modules/webhook/deliver.go:193 +0x339
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownContext(0xc0001b6960, 0x3c3e0f8)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:135 +0xf7
created by code.gitea.io/gitea/modules/webhook.InitDeliverHooks
    /home/mural/src/code.gitea.io/gitea/modules/webhook/deliver.go:277 +0x14b

goroutine 1789 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9630, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc003155518, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc003155500, 0xc00ea70df1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc003155500, 0xc00ea70df1, 0x1, 0x1, 0xc00fb65aa0, 0xc003063730, 0xc00309bb30)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc011d3f508, 0xc00ea70df1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00ea70de0)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 909 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*PersistableChannelUniqueQueue).Run(0xc002b9a3f0, 0xc00333adb0, 0xc00333adc0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/unique_queue_disk_channel.go:188 +0x2ec
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns(0xc0001b6960, 0xc002bbbf40)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:83 +0x10e
created by code.gitea.io/gitea/modules/indexer/stats.initStatsQueue
    /home/mural/src/code.gitea.io/gitea/modules/indexer/stats/queue.go:35 +0x12c

goroutine 854 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0x3c3da88, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 1788 [select]:
code.gitea.io/gitea/routers/events.Events(0xc003155700)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc009bd09c0, 0x1, 0x1, 0xc00ca12bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc009bd09c0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0069f6ce0, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0069f6ce0, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc003155700)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc009bd0900, 0x1, 0x1, 0xc00ca13050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc009bd0900, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0069f6ce0, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0069f6ce0, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc003390cb0, 0x1, 0x1, 0x24c9520, 0xc00119ebd0, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069f6ce0, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069f6ce0, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc00119ebd0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc0069f6d20, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069f6ce0, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069f6ce0, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc0000676a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc00119ebd0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc0069f6d00, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc00103b778, 0xc0000c000067960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0069f6ce0, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc0000679c8, 0x41acc6, 0xc003ab8500, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0069f6ce0, 0x2212e20, 0x3c400e8, 0xc003ab8610, 0xc00e832160, 0x20, 0xc00309c2e0, 0xc0000679f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119ebd0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc0034962a0, 0xc004575f00, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc0034962a0, 0xc004575f00)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc0034962a0, 0xc004575f00)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc0034962a0, 0xc004575f00)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc0034962a0, 0xc004575f00)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc0034962a0, 0xc004575f00)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0033341e0, 0x4158100, 0xc0046ea5c0)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 1515 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f99b0, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc0102af198, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0102af180, 0xc006afcf71, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc0102af180, 0xc006afcf71, 0x1, 0x1, 0x20db7a0, 0x0, 0xc002f8c600)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc010282e48, 0xc006afcf71, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc006afcf60)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 1015 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc003d5e000, 0xc002b9b650, 0x1, 0xc000330390)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 1514 [select]:
code.gitea.io/gitea/routers/events.Events(0xc0102af380)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc0069ba900, 0x1, 0x1, 0xc00c982bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc0069ba900, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc006a827e0, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc006a827e0, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc0102af380)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc0069ba840, 0x1, 0x1, 0xc00c983050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc0069ba840, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc006a827e0, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc006a827e0, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc00112d1d0, 0x1, 0x1, 0x24c9520, 0xc00f8ca6c0, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc006a827e0, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc006a827e0, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc00f8ca6c0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc006a82840, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc006a827e0, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc006a827e0, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00336d6a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc00f8ca6c0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc006a82800, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc0001d9358, 0x970000c00336d960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc006a827e0, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00336d9c8, 0x41acc6, 0xc003f08140, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc006a827e0, 0x2212e20, 0x3c400e8, 0xc003f08250, 0xc00e832160, 0x20, 0xc0046d25e0, 0xc00336d9f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca6c0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00a6fc620, 0xc00af9e900, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00a6fc620, 0xc00af9e900)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00a6fc620, 0xc00af9e900)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00a6fc620, 0xc00af9e900)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00a6fc620, 0xc00af9e900)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00a6fc620, 0xc00af9e900)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc002b188c0, 0x4158100, 0xc00af48c00)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 1016 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc002bff080, 0x4158100, 0xc003d5e000)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc002bff080, 0x4158100, 0xc003d5e000)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 1708 [select]:
code.gitea.io/gitea/routers/events.Events(0xc00309a400)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc00698f760, 0x1, 0x1, 0xc00c85abb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc00698f760, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc003d5b0e0, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc003d5b0e0, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc00309a400)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc00698f660, 0x1, 0x1, 0xc00c85b050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc00698f660, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc003d5b0e0, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc003d5b0e0, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc00124c1e0, 0x1, 0x1, 0x24c9520, 0xc000ffc120, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc003d5b0e0, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc003d5b0e0, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc000ffc120, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc003d5b120, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc003d5b0e0, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc003d5b0e0, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00c9056a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc000ffc120, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc003d5b100, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x0, 0xd00000c00c905960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc003d5b0e0, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00c9059c8, 0x41acc6, 0xc000344280, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc003d5b0e0, 0x2212e20, 0x3c400e8, 0xc000344390, 0xc00e832160, 0x20, 0xc00302e020, 0xc00c9059f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000ffc120)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00c90c000, 0xc003168000, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00c90c000, 0xc003168000)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00c90c000, 0xc003168000)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00c90c000, 0xc003168000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00c90c000, 0xc003168000)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00c90c000, 0xc003168000)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0042ea280, 0x4158100, 0xc000e44000)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 890 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc0033ee880, 0xc002ff9110, 0x1, 0xc0034add00)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 855 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run(0xc002ff8d90, 0xc0033fd200, 0xc0033fd210)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:104 +0x314
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns(0xc0001b6960, 0xc0034a2a40)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:83 +0x10e
created by code.gitea.io/gitea/modules/indexer/issues.InitIssueIndexer.func2
    /home/mural/src/code.gitea.io/gitea/modules/indexer/issues/indexer.go:194 +0x2be

goroutine 860 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc0033ee780, 0xc002ff8e00, 0x1, 0xc0033fd280)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 1707 [select]:
code.gitea.io/gitea/routers/events.Events(0xc011c4ad00)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc0069a9080, 0x1, 0x1, 0xc00c986bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc0069a9080, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc002ad0c40, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc002ad0c40, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc011c4ad00)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc0069a8fe0, 0x1, 0x1, 0xc00c987050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc0069a8fe0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc002ad0c40, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc002ad0c40, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc011d57c60, 0x1, 0x1, 0x24c9520, 0xc00119e360, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc002ad0c40, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc002ad0c40, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc00119e360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc002ad0ca0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc002ad0c40, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc002ad0c40, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc0000676a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc00119e360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc002ad0c80, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc00103b358, 0x790000c000067960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc002ad0c40, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc0000679c8, 0x41acc6, 0xc003ab8280, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc002ad0c40, 0x2212e20, 0x3c400e8, 0xc003ab8390, 0xc00e832160, 0x20, 0xc011d54a20, 0xc0000679f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00119e360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc0034960e0, 0xc01029a500, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc0034960e0, 0xc01029a500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc0034960e0, 0xc01029a500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc0034960e0, 0xc01029a500)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc0034960e0, 0xc01029a500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc0034960e0, 0xc01029a500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0042ea1e0, 0x4158100, 0xc011d66500)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 861 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc0002ef880, 0x4158100, 0xc0033ee780)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc0002ef880, 0x4158100, 0xc0033ee780)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 859 [sleep]:
time.Sleep(0x5f5e100)
    /home/mural/src/golang.org/go/src/runtime/time.go:188 +0xba
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).readToChan(0xc002ff8d90)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:134 +0x29f
created by code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:101 +0x217

goroutine 905 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc002bd6000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x419

goroutine 906 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc002bd6000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x43b

goroutine 834 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc002f6dba0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x259
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58f

goroutine 835 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc002f6dba0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x140
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5b1

goroutine 1510 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9c50, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc0102aed98, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0102aed80, 0xc00aef7511, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc0102aed80, 0xc00aef7511, 0x1, 0x1, 0x20db7a0, 0x0, 0xc003044960)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc010282cc8, 0xc00aef7511, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00aef7500)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 857 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0xc0033fd230, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 907 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc002bd6000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x259
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58f

goroutine 2058 [select]:
code.gitea.io/gitea/routers/events.Events(0xc010388a80)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc0111b61e0, 0x1, 0x1, 0xc00d712bb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc0111b61e0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc01024de60, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc01024de60, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc010388a80)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc0111b60c0, 0x1, 0x1, 0xc00d713050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc0111b60c0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc01024de60, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc01024de60, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc0101b96c0, 0x1, 0x1, 0x24c9520, 0xc003536870, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc01024de60, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc01024de60, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc003536870, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc01024dea0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4a, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc01024de60, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc01024de60, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00c9066a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc003536870, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc01024de80, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc000f5a6f8, 0x550000c00c906960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc01024de60, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00c9069c8, 0x41acc6, 0xc000344780, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc01024de60, 0x2212e20, 0x3c400e8, 0xc000344890, 0xc00e832160, 0x20, 0xc00fa1e480, 0xc00c9069f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc003536870)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00c90c460, 0xc0118cd800, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00c90c460, 0xc0118cd800)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00c90c460, 0xc0118cd800)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00c90c460, 0xc0118cd800)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00c90c460, 0xc0118cd800)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00c90c460, 0xc0118cd800)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0042eaf00, 0x4158100, 0xc011497200)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 2012 [select]:
code.gitea.io/gitea/routers/events.Events(0xc010420d00)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc0111b7360, 0x1, 0x1, 0xc00dc0abb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc0111b7360, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0111cc040, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0111cc040, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc010420d00)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc0111b72a0, 0x1, 0x1, 0xc00dc0b050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc0111b72a0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0111cc040, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0111cc040, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc0101de5b0, 0x1, 0x1, 0x24c9520, 0xc0030510e0, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0111cc040, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0111cc040, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc0030510e0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc0111cc0e0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4b, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0111cc040, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0111cc040, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00058b6a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc0030510e0, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc0111cc080, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc000f8f4b8, 0xe40000c00058b960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0111cc040, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00058b9c8, 0x41acc6, 0xc003ab8c80, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0111cc040, 0x2212e20, 0x3c400e8, 0xc003ab8d90, 0xc00e832160, 0x20, 0xc00e86be80, 0xc00058b9f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0030510e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc003496700, 0xc011915500, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc003496700, 0xc011915500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc003496700, 0xc011915500)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc003496700, 0xc011915500)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc003496700, 0xc011915500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc003496700, 0xc011915500)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc003334460, 0x4158100, 0xc011500980)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 856 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2.1(0xc0001b6960, 0xc0033fd220, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:85 +0xc5
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:84 +0x5c

goroutine 2059 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9470, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc010388898, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc010388880, 0xc00d4fd541, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc010388880, 0xc00d4fd541, 0x1, 0x1, 0xc002dcd3e0, 0xc003178730, 0x413515)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc00d4dcad0, 0xc00d4fd541, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00d4fd530)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 2035 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9390, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc010420898, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc010420880, 0xc00d47db41, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc010420880, 0xc00d47db41, 0x1, 0x1, 0x4566cf, 0xc0029d5080, 0x4)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc00d43edb8, 0xc00d47db41, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00d47db30)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 2011 [select]:
code.gitea.io/gitea/routers/events.Events(0xc010229100)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc011215920, 0x1, 0x1, 0xc00d70ebb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc011215920, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0104b5a80, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0104b5a80, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc010229100)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc011215880, 0x1, 0x1, 0xc00d70f050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc011215880, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc0104b5a80, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc0104b5a80, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc0102b96d0, 0x1, 0x1, 0x24c9520, 0xc0034a8b40, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0104b5a80, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0104b5a80, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc0034a8b40, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc0104b5ac0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4a, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0104b5a80, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0104b5a80, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc0000676a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc0034a8b40, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc0104b5aa0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc000fcf358, 0xad0000c000067960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc0104b5a80, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc0000679c8, 0x41acc6, 0xc003f08b40, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc0104b5a80, 0x2212e20, 0x3c400e8, 0xc003f08c50, 0xc00e832160, 0x20, 0xc00d79d680, 0xc0000679f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc0034a8b40)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00a6fc9a0, 0xc011915400, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00a6fc9a0, 0xc011915400)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00a6fc9a0, 0xc011915400)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00a6fc9a0, 0xc011915400)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00a6fc9a0, 0xc011915400)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00a6fc9a0, 0xc011915400)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0033343c0, 0x4158100, 0xc0115007c0)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 1520 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f97f0, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc0102af518, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0102af500, 0xc0069f87c1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc0102af500, 0xc0069f87c1, 0x1, 0x1, 0xc010353500, 0xc00319d730, 0xc00309adb0)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc010283018, 0xc0069f87c1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc0069f87b0)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 908 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc002bd6000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x140
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5b1

goroutine 1794 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f98d0, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc00309a698, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00309a680, 0xc009b701f1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00309a680, 0xc009b701f1, 0x1, 0x1, 0xc010353320, 0xc00319e730, 0x413515)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0069bed00, 0xc009b701f1, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc009b701e0)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 1925 [IO wait, 12 minutes]:
internal/poll.runtime_pollWait(0x7f141d3f9550, 0x72, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/runtime/netpoll.go:203 +0x55
internal/poll.(*pollDesc).wait(0xc00c885798, 0x72, 0x0, 0x1, 0xffffffffffffffff)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
    /home/mural/src/golang.org/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00c885780, 0xc00d192e51, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00c885780, 0xc00d192e51, 0x1, 0x1, 0xc002a0b140, 0xc00319ef30, 0x413515)
    /home/mural/src/golang.org/go/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc00cf66e88, 0xc00d192e51, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/net/net.go:184 +0x8e
net/http.(*connReader).backgroundRead(0xc00d192e40)
    /home/mural/src/golang.org/go/src/net/http/server.go:678 +0x58
created by net/http.(*connReader).startBackgroundRead
    /home/mural/src/golang.org/go/src/net/http/server.go:674 +0xd0

goroutine 1026 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc002bfef80, 0x4158100, 0xc003348440)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc002bfef80, 0x4158100, 0xc003348440)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 1924 [select]:
code.gitea.io/gitea/routers/events.Events(0xc00c885a80)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc00fa817e0, 0x1, 0x1, 0xc00ca0ebb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc00fa817e0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00f950e80, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00f950e80, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc00c885a80)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc00fa81720, 0x1, 0x1, 0xc00ca0f050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc00fa81720, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00f950e80, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00f950e80, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc00a573770, 0x1, 0x1, 0x24c9520, 0xc000fd6360, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00f950e80, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00f950e80, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc000fd6360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc00f950f20, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4a, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00f950e80, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00f950e80, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00c9066a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc000fd6360, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc00f950ee0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0xc000ff3778, 0xa40000c00c906960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00f950e80, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00c9069c8, 0x41acc6, 0xc000344640, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00f950e80, 0x2212e20, 0x3c400e8, 0xc000344750, 0xc00e832160, 0x20, 0xc0033ff240, 0xc00c9069f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc000fd6360)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00c90c380, 0xc00fc04600, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00c90c380, 0xc00fc04600)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00c90c380, 0xc00fc04600)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00c90c380, 0xc00fc04600)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00c90c380, 0xc00fc04600)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00c90c380, 0xc00fc04600)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc0042eac80, 0x4158100, 0xc00fb07980)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 923 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0034f4340)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x419

goroutine 688 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc002bfea80, 0x4158100, 0xc003348340)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc002bfea80, 0x4158100, 0xc003348340)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 925 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0034f4340)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x259
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58f

goroutine 833 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc002f6dba0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x43b

goroutine 46 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc002a4a000)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x128
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x19a

goroutine 891 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0034961c0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x128
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x19a

goroutine 832 [select, 12 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc002f6dba0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x419

goroutine 924 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0034f4340)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6
created by github.com/syndtr/goleveldb/leveldb.openDB
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x43b

goroutine 886 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2.1(0xc0001b6960, 0xc0034adcb0, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:85 +0xc5
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunWithShutdownFns.func2
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:84 +0x5c

goroutine 849 [select]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc002bfe980, 0x4158100, 0xc002995980)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:350 +0x71c
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc002bfe980, 0x4158100, 0xc002995980)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 887 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate.func1(0xc0001b6960, 0xc0034adcc0, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:148 +0x113
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtTerminate
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:141 +0x7a

goroutine 888 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run(0xc002b9aa10, 0x3c3dc88, 0x3c3dc90)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:104 +0x314
created by code.gitea.io/gitea/modules/queue.(*PersistableChannelUniqueQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/unique_queue_disk_channel.go:181 +0x213

goroutine 830 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00045a8c0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x128
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x19a

goroutine 687 [sleep]:
time.Sleep(0x5f5e100)
    /home/mural/src/golang.org/go/src/runtime/time.go:188 +0xba
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).readToChan(0xc002b9b1f0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:134 +0x29f
created by code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:101 +0x217

goroutine 829 [select, 12 minutes]:
code.gitea.io/gitea/modules/graceful.(*Manager).RunAtShutdown.func1(0xc0001b6960, 0x3c3d828, 0x4158140, 0xc0001b0030)
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:164 +0xed
created by code.gitea.io/gitea/modules/graceful.(*Manager).RunAtShutdown
    /home/mural/src/code.gitea.io/gitea/modules/graceful/manager.go:158 +0x5d

goroutine 828 [select, 2 minutes]:
github.com/gogs/cron.(*Cron).run(0xc002a04190)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gogs/cron/cron.go:197 +0x2ae
created by github.com/gogs/cron.(*Cron).Start
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gogs/cron/cron.go:150 +0x53

goroutine 848 [runnable]:
syscall.Syscall(0x3, 0x2b, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/syscall/asm_linux_amd64.s:18 +0x5
syscall.Close(0x2b, 0xc010010000, 0x0)
    /home/mural/src/golang.org/go/src/syscall/zsyscall_linux_amd64.go:285 +0x40
internal/poll.(*FD).destroy(0xc00a085c80, 0xc0174e4001, 0x0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:78 +0x43
internal/poll.(*FD).decref(0xc00a085c80, 0x4169401, 0xc00ffa13c0)
    /home/mural/src/golang.org/go/src/internal/poll/fd_mutex.go:213 +0x42
internal/poll.(*FD).Close(0xc00a085c80, 0xe2554c9d8035e68f, 0xe2554c9d8035e68f)
    /home/mural/src/golang.org/go/src/internal/poll/fd_unix.go:100 +0x4f
os.(*file).close(0xc00a085c80, 0xc00ffa13c0, 0xc0033f76a8)
    /home/mural/src/golang.org/go/src/os/file_unix.go:248 +0x38
os.(*File).Close(0xc0103cee60, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/os/file_unix.go:237 +0x33
github.com/go-git/go-git/v5/plumbing/format/packfile.(*Packfile).Close(0xc0174e4050, 0xe2554c9d8035e68f, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/plumbing/format/packfile/packfile.go:466 +0x63
github.com/go-git/go-git/v5/utils/ioutil.CheckClose(0x4127120, 0xc0174e4050, 0xc0033f77d0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/utils/ioutil/common.go:89 +0x31
github.com/go-git/go-git/v5/storage/filesystem.(*ObjectStorage).getFromPackfile(0xc000e7e158, 0xf44981124f0990f9, 0x8035e68f5e6cf3f1, 0xe2554c9d, 0x4169440, 0xc00ffa13c0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/storage/filesystem/object.go:447 +0x33c
github.com/go-git/go-git/v5/storage/filesystem.(*ObjectStorage).EncodedObject(0xc000e7e158, 0x4981124f0990f903, 0x35e68f5e6cf3f1f4, 0xe2554c9d80, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/storage/filesystem/object.go:316 +0x6a
github.com/go-git/go-git/v5/plumbing/object.GetBlob(0x4164d60, 0xc000e7e140, 0xf44981124f0990f9, 0x8035e68f5e6cf3f1, 0xe2554c9d, 0x4f0990f9000081ed, 0x5e6cf3f1f4498112, 0xe2554c9d8035e68f)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/plumbing/object/blob.go:23 +0x4e
github.com/go-git/go-git/v5/plumbing/object.(*FileIter).Next(0xc0033f7b28, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/plumbing/object/file.go:100 +0xdd
github.com/go-git/go-git/v5/plumbing/object.(*FileIter).ForEach(0xc0033f7b28, 0xc0033f7ac8, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/go-git/go-git/v5/plumbing/object/file.go:116 +0x61
code.gitea.io/gitea/modules/git.(*Repository).GetLanguageStats(0xc002b58e40, 0xc004692540, 0x28, 0xc004692540, 0x28, 0x0)
    /home/mural/src/code.gitea.io/gitea/modules/git/repo_language_stats.go:46 +0x37f
code.gitea.io/gitea/modules/indexer/stats.(*DBIndexer).Index(0x5c4a660, 0x69, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/modules/indexer/stats/db.go:49 +0x203
code.gitea.io/gitea/modules/indexer/stats.handle(0xc0011da000, 0x1, 0x1)
    /home/mural/src/code.gitea.io/gitea/modules/indexer/stats/queue.go:23 +0x9b
code.gitea.io/gitea/modules/queue.NewChannelUniqueQueue.func1(0xc003d4d540, 0x1, 0x14)
    /home/mural/src/code.gitea.io/gitea/modules/queue/unique_queue_channel.go:59 +0x13d
code.gitea.io/gitea/modules/queue.(*WorkerPool).doWork(0xc0002ef980, 0x4158100, 0xc0033ee880)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:383 +0x892
code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers.func1(0xc0002ef980, 0x4158100, 0xc0033ee880)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:238 +0x43
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).addWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:237 +0x56

goroutine 1509 [select]:
code.gitea.io/gitea/routers/events.Events(0xc0102aef80)
    /home/mural/src/code.gitea.io/gitea/routers/events/events.go:60 +0x79b
reflect.Value.call(0x20e74a0, 0x3c3eb10, 0x13, 0x24edaf3, 0x4, 0xc006a824e0, 0x1, 0x1, 0xc00c85ebb0, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3eb10, 0x13, 0xc006a824e0, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00318df60, 0x20e74a0, 0x3c3eb10, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00318df60, 0x20e74a0, 0x3c3eb10, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
code.gitea.io/gitea/modules/context.Recovery.func1(0xc0102aef80)
    /home/mural/src/code.gitea.io/gitea/modules/context/panic.go:39 +0x55
reflect.Value.call(0x20e74a0, 0x3c3d7c8, 0x13, 0x24edaf3, 0x4, 0xc006a82400, 0x1, 0x1, 0xc00c85f050, 0x45ac3c, ...)
    /home/mural/src/golang.org/go/src/reflect/value.go:460 +0x8ab
reflect.Value.Call(0x20e74a0, 0x3c3d7c8, 0x13, 0xc006a82400, 0x1, 0x1, 0x0, 0x0, 0x0)
    /home/mural/src/golang.org/go/src/reflect/value.go:321 +0xb4
gitea.com/macaron/inject.(*injector).callInvoke(0xc00318df60, 0x20e74a0, 0x3c3d7c8, 0x41876e0, 0x20e74a0, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:177 +0x26c
gitea.com/macaron/inject.(*injector).Invoke(0xc00318df60, 0x20e74a0, 0x3c3d7c8, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:137 +0xca
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/session.Sessioner.func1(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/session/session.go:192 +0x316
gitea.com/macaron/macaron.ContextInvoker.Invoke(0xc00e81ca60, 0xc0114e4f60, 0x1, 0x1, 0x24c9520, 0xc00f8ca480, 0x0, 0x1, 0x41876e0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:79 +0x51
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00318df60, 0x7f1414b3b6b8, 0xc00e81ca60, 0x41876e0, 0x21e8f00, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00318df60, 0x21e8f00, 0xc00e81ca60, 0x0, 0x0, 0x0, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Recovery.func1(0xc00f8ca480, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/recovery.go:161 +0x66
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c40108, 0xc00318dfe0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x4a, 0x0, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00318df60, 0x7f1414b3b698, 0x3c40108, 0x41876e0, 0x2212e20, 0x2, 0x0, 0x0, 0x0, 0x59e54c0, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00318df60, 0x2212e20, 0x3c40108, 0x3c43f20, 0xc00336d6a8, 0x6e36ae, 0xc0029ab680, 0x2)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Context).Next(...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:112
gitea.com/macaron/macaron.Logger.func1(0xc00f8ca480, 0xc0029ab680)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:52 +0x281
gitea.com/macaron/macaron.LoggerInvoker.Invoke(0x3c400e8, 0xc00318dfa0, 0x2, 0x2, 0x2416ca0, 0xc0029ab680, 0x0, 0x540000c00336d960, 0xaaaaaaaaaaaaaaaa)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/logger.go:40 +0x74
gitea.com/macaron/inject.(*injector).fastInvoke(0xc00318df60, 0x7f1414b3b698, 0x3c400e8, 0x41876e0, 0x2212e20, 0x2, 0xc00336d9c8, 0x41acc6, 0xc003f08000, 0x140, ...)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:157 +0x1f8
gitea.com/macaron/inject.(*injector).Invoke(0xc00318df60, 0x2212e20, 0x3c400e8, 0xc003f08110, 0xc00e832160, 0x20, 0xc002b430e0, 0xc00336d9f8)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/inject/inject.go:135 +0x1b9
gitea.com/macaron/macaron.(*Context).run(0xc00f8ca480)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/context.go:121 +0x79
gitea.com/macaron/macaron.(*Router).Handle.func1(0x414e5c0, 0xc00a6fc540, 0xc00af9e600, 0x0)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:187 +0x257
gitea.com/macaron/macaron.(*Router).ServeHTTP(0xc0003ccea0, 0x414e5c0, 0xc00a6fc540, 0xc00af9e600)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/router.go:294 +0x24e
gitea.com/macaron/macaron.(*Macaron).ServeHTTP(0xc0010d6680, 0x414e5c0, 0xc00a6fc540, 0xc00af9e600)
    /home/mural/src/code.gitea.io/gitea/vendor/gitea.com/macaron/macaron/macaron.go:218 +0x12b
github.com/gorilla/context.ClearHandler.func1(0x414e5c0, 0xc00a6fc540, 0xc00af9e600)
    /home/mural/src/code.gitea.io/gitea/vendor/github.com/gorilla/context/context.go:141 +0x74
net/http.HandlerFunc.ServeHTTP(0xc011bf4580, 0x414e5c0, 0xc00a6fc540, 0xc00af9e600)
    /home/mural/src/golang.org/go/src/net/http/server.go:2012 +0x44
net/http.serverHandler.ServeHTTP(0xc002a4b5e0, 0x414e5c0, 0xc00a6fc540, 0xc00af9e600)
    /home/mural/src/golang.org/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc002b18000, 0x4158100, 0xc00af48700)
    /home/mural/src/golang.org/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
    /home/mural/src/golang.org/go/src/net/http/server.go:2933 +0x35c

goroutine 846 [sleep]:
time.Sleep(0x5f5e100)
    /home/mural/src/golang.org/go/src/runtime/time.go:188 +0xba
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).readToChan(0xc002b9aa10)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:134 +0x29f
created by code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:101 +0x217

goroutine 847 [chan receive, 12 minutes]:
code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers.func1(0x4158100, 0xc002995980, 0xc002b9aa80, 0x1, 0xc00344dba0)
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:209 +0x48
created by code.gitea.io/gitea/modules/queue.(*WorkerPool).commonRegisterWorkers
    /home/mural/src/code.gitea.io/gitea/modules/queue/workerpool.go:208 +0x25b

goroutine 1018 [sleep]:
time.Sleep(0x5f5e100)
    /home/mural/src/golang.org/go/src/runtime/time.go:188 +0xba
code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).readToChan(0xc002dd2000)
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:134 +0x29f
created by code.gitea.io/gitea/modules/queue.(*ByteFIFOQueue).Run
    /home/mural/src/code.gitea.io/gitea/modules/queue/queue_bytefifo.go:101 +0x217

To enable gops, here is the patch:

--- a/main.go
+++ b/main.go
@@ -21,6 +21,7 @@ import (
    _ "code.gitea.io/gitea/modules/markup/markdown"
    _ "code.gitea.io/gitea/modules/markup/orgmode"

+   "github.com/google/gops/agent"
    "github.com/urfave/cli"
 )

@@ -48,6 +49,13 @@ func init() {
 }

 func main() {
+   if err := agent.Listen(agent.Options{
+       ShutdownCleanup: true,
+   }); err != nil {
+       fmt.Fprintln(os.Stderr, err)
+       os.Exit(1)
+   }
+
    app := cli.NewApp()
    app.Name = "Gitea"
    app.Usage = "A painless self-hosted Git service"