Jormungandr: Suspected file descriptor leak (ERRO Error while accepting connection on 0.0.0.0:3000: Os)

[bjarnekvae]

Describe the bug
First error in logs are "ERRO Error while accepting connection on 0.0.0.0:3000: Os { code: 24, kind: Other, message: "Too many open files" }, task: network", after a while its starts spamming "ERRO cannot send PullHeaders request to network: send failed because receiver is gone, task: block" and node stops receving blocks

Mandatory Information

1. jcli 0.5.6 (HEAD-7ab929e+, release, linux [x86_64]) - [rustc 1.38.0 (625451e37 2019-09-23)]
2. jormungandr 0.5.6 (HEAD-7ab929e+, release, linux [x86_64]) - [rustc 1.38.0 (625451e37 2019-09-23)]

To Reproduce
Steps to reproduce the behavior:
Dont know how to reproduce, happens after the node has run a few hours

Expected behavior
No error

Additional context
See appendix for output logs and strace logs. I have four examples as I happens every time I try to run my node.

errPullHeader.zip

[mzabaluev]

Thank you for the captures, will investigate.

[mzabaluev]

Massively duplicate connections are still present; working on a better fix.

[bjarnekvae]

I'm running 0.6.0 with strace, will serve you fresh logs when(/if?) it crashes :)

[bjarnekvae]

Error just happened on my other server, running a other setup with a old-style mechanical HDD, dont know if it is relevant. Running v0.6.1

Here are the logs:
err_24.zip

[bjarnekvae]

Just happened on my other server, so its not hardware related as this one uses a SSD. Still on v0.6.1

Logs:
err_24_2.zip

[vincenthz]

@bjarnekvae it's not storage related, it is a network subsystem issue as indicated in the log : task: network"

[mzabaluev]

One probable cause has been fixed in #981 (and fixes of the fix that have followed).
Please retry with version 0.6.5 or later.

[bjarnekvae]

running 0.6.5 with strace now

[bjarnekvae]

This error just came back in v0.8.0-rc2

node_log.log

[bjarnekvae]

Strace log:
tooManyFiles.zip

[bjarnekvae]

@mzabaluev This is still relevant for v0.8.0-rc5

[babelitconsulting]

ERRO Error while accepting connection on 0.0.0.0:3001: Os { code: 24, kind: Other, message: "Too many open files" }, task: network

version: jormungandr 0.8.5-3db06807