Go-ipfs: Dial error on windows 7

[Stebalien]

Version information:

0.4.14-dev

Type:

Bug

Severity:

Critical

Description:

No peers in swarm. When dialing, @djdv gets:

Error: connect QmSoLMeWqB7YGVLJN3pNLQpmmEk35v6wYtsMGLzSr5QBU3 failure: dial attempt failed: <peer.ID WABRCq> --> <peer.ID SoLMeW> dial attempt failed: dial tcp4 0.0.0.0:4737->178.62.61.185:4001: bind: Only one usage of each socket address (protocol/network address/port) is normally permitted.

Caused by something in #4453.

[Stebalien]

@djdv could you try disabling reuseport (set the environment variable IPFS_REUSEPORT=false). It's not a fix but it'll help me determine what's going on here.

[Stebalien]

@gdeverlant your errors appear to be unrelated to this issue. Please file a new one (or open a thread on https://discuss.ipfs.io as this doesn't look like a bug).

[djdv]

@Stebalien
For context I'm on Windows 10, this may be affecting all versions of Windows, since I'm seeing other users having empty peer tables as well on different versions, when using IPFS past #4453.

Setting IPFS_REUSEPORT to false doesn't seem to have any effect for me, I set it, start the daemon (built from current master), and try to connect to a peer, but encounter the same error as before. I just ran this with Go 1.10 but I was getting the same results on 1.9.2 a few days ago.

Promt 1

>ipfs version --all
go-ipfs version: 0.4.14-dev-ce22b83f2
Repo version: 6
System version: amd64/windows
Golang version: go1.10beta1

>SET IPFS_REUSEPORT=false

>ipfs daemon
...

Promt 2

>ipfs swarm peers

>ipfs swarm connect /ip4/178.62.61.185/tcp/4001/ipfs/QmSoLMeWqB7YGVLJN3pNLQpmmEk35v6wYtsMGLzSr5QBU3
Error: connect QmSoLMeWqB7YGVLJN3pNLQpmmEk35v6wYtsMGLzSr5QBU3 failure: dial attempt failed: <peer.ID WABRCq> --> <peer.ID SoLMeW> dial attempt failed: dial tcp4 0.0.0.0:4737->178.62.61.185:4001: bind: Only one usage of each socket address (protocol/network address/port) is normally permitted.

[Stebalien]

Got it. Is there any way on windows to see if there is an existing connection on that port/IP? Any way to see if a connection is established (wireshark?).

@whyrusleeping can you reproduce in your VM?

[djdv]

netstat -aon | findstr %port% will show ports in use and their state, I find process hacker to be useful in monitoring as well. I run ipfs on the old default port 4737. Checking with port reuse enabled, 4001 shows almost everything in a TIME_WAIT state except for the interfaces I am listening on (0.0.0.0:4737, [::]:4737) which are correctly in the LISTENING state, 4737 shows a single connection in the TIME_WAIT state (local 4737 waiting on a remote 4001)
Disabling reuse gives me nothing for port 4001 and again the 2 interfaces for 4737, nothing else.

I'm pretty confident that nothing on this machine should be using either of these ports, nothing is configured to and nothing is showing for it, switching to 4001 didn't resolve it for me either.

[Stebalien]

I'm getting this on linux as well. It can be readily reproduced with the go-libp2p echo example. I'm also seeing the TIME_WAIT stuff so I think a connection is opening, then closing, but not fully closing.

[al-sabr]

Can someone fix this problem ASAP because we can't build and integrate our product to IPFS.

[djdv]

@gdeverlant are you encountering this issue on builds before #4453?
If you need ipfs on Windows right now, you might want to try using the release build v0.4.13 or using a source base without dfe7ef4fcfaf340846ee16031550601b3ff625d6 until this is resolved.

[al-sabr]

it's the first time I'm using ipfs. I didn't used any other versions yet!

[al-sabr]

I just did tried your suggestion and here is the problems:

It is better than before but still there are lots of error messages.
The peers are listed, the webui works well but when I want to see the peers the UI hangs and chrome sucks 50 % of my cpu.

[Stebalien]

Unfortunately, that's an unrelated webui bug. The webui's peer display isn't optimised for thousands of peers.

On December 27, 2017 10:36:09 AM PST, gdeverlant [e-mail] wrote:

I just did tried your suggestion and here is the problems:

It is better than before but still there are lots of error messages.
The peers are listed, the webui works well but when I want to see the
peers the UI hangs and chrome sucks 50 % of my cpu.

[Stebalien]

It is better than before but still there are lots of error messages.

Please post them. Unfortunately, we have a lot of noisy error messages (that you can mostly ignore).

[Stebalien]

I'm getting this on linux as well. It can be readily reproduced with the go-libp2p echo example. I'm also seeing the TIME_WAIT stuff so I think a connection is opening, then closing, but not fully closing.

Not the issue.

I believe the issue is that non-reuseport dialing has been broken by https://github.com/libp2p/go-tcp-transport/pull/9. We now try to set the source port when dialing, even when not dialing with reuseport, which obviously fails if we're already using that port (e.g., listening on it). Fix incoming.

[Stebalien]

Fix coming in https://github.com/libp2p/go-tcp-transport/pull/20

[Stebalien]

Could one of you test /ipfs/Qma9vnYd4LV7DJkcsx4on3ezzuHT5JQcU2J2GaS3jmeKCt? It should fix this.

[djdv]

@Stebalien
It appears to make connections (my peer table fills up) and the gateway can pull data from me.

[al-sabr]

I just tried your file /ipfs/Qma9vnYd4LV7DJkcsx4on3ezzuHT5JQcU2J2GaS3jmeKCt

It loads with only 2 errors:

Initializing daemon...
Swarm listening on /ip4/10.0.2.15/tcp/4001
Swarm listening on /ip4/127.0.0.1/tcp/4001
Swarm listening on /ip6/::1/tcp/4001
Swarm listening on /p2p-circuit/ipfs/QmTJPFJBrvfxSfJtRmeSC8YmCF6B4NnGUWrY6VUgS4kaPL
Swarm announcing /ip4/10.0.2.15/tcp/4001
Swarm announcing /ip4/127.0.0.1/tcp/4001
Swarm announcing /ip6/::1/tcp/4001
API server listening on /ip4/127.0.0.1/tcp/5001
Gateway (readonly) server listening on /ip4/127.0.0.1/tcp/8080
Daemon is ready

=====================================================

ERROR - 12:28:18.456 ERROR        dht: loggableKey could not cast key: 2f706b2f122049b5ca311553325a0b01722c5b684bc9084b98bc8fbfb27527d262b762df407b invalid cid version number: 47 lookup.go:35
12:28:18.467 ERROR        dht: loggableKey could not cast key: 2f69706e732f122049b5ca311553325a0b01722c5b684bc9084b98bc8fbfb27527d262b762df407b invalid cid version number: 47 lookup.go:35

But the hell load of error happens when I try to go in the webui and check the peers.

Chrome sucks the CPU

I checked the G:ipfs folder's properties and it seems to be set to read-only

Hellraiser of errors:

ERROR - 12:34:13.015 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317

ERROR - 12:34:25.447 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317

ERROR - 12:34:29.082 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:34:29.083 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:34:32.448 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:34:32.448 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:34:32.448 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:34:32.481 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:35:13.283 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.772 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.773 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.773 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.773 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:35:15.773 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.773 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.774 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.774 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.774 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.775 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.777 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.777 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:35:15.777 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.778 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.778 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.779 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.779 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:15.790 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.820 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.820 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.820 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.824 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.825 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.825 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.825 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.825 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.826 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.826 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:35:15.826 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.826 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.851 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.851 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.852 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.853 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.853 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.955 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:35:15.955 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:35:15.956 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.956 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.956 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.957 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.959 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.960 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:15.961 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:35:39.220 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.224 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.225 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.225 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.233 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.234 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.234 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.235 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.286 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.288 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.337 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.339 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.361 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.362 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.362 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.372 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.373 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.374 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.375 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.375 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.376 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.376 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.377 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.378 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.378 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.379 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.380 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.380 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.381 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.382 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.383 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.384 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.384 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.385 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.386 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.386 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.387 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.387 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.389 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.616 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.618 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.618 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.618 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.619 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.619 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.619 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.619 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.620 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.620 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.620 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.620 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.621 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.621 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.621 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.621 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.627 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.628 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.628 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:39.675 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.675 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.676 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.677 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.678 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.678 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.678 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.679 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.680 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.680 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.681 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.682 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.682 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.683 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.683 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.684 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.685 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.686 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.686 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.687 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.689 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.690 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.691 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.691 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.692 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.691 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.692 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.692 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.693 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.693 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.694 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.699 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.699 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.809 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.810 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.811 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.811 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.812 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:39.814 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:59.771 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:59.771 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:59.814 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:59.816 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:59.820 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:35:59.820 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:35:59.831 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:36:55.249 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.310 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:36:57.314 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.322 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.410 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.410 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.464 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.464 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.464 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.464 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.467 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.468 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.468 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.471 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.474 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.483 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.484 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.509 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.509 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.509 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.510 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:36:57.510 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.512 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.512 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.512 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.512 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.513 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.514 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.514 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.514 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.514 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.514 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.517 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.518 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.520 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.524 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.524 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.524 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.524 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.524 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.526 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.527 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.527 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.528 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.528 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.528 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.529 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:36:57.529 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:36:57.529 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.531 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.531 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.532 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.533 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.534 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.534 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.534 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.534 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.534 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.535 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.535 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.538 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.788 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.788 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:36:57.789 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.789 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.790 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.791 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.792 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.792 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.793 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.793 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.794 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.795 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.796 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.802 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.802 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.804 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.804 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.805 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.806 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:36:57.807 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:38:00.087 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.100 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.100 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:38:00.101 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.101 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.101 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.102 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.101 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.102 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:38:00.102 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.102 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.103 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.103 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.103 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.103 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.104 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:38:00.104 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.104 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.105 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.105 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.105 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.107 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.109 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.110 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.110 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.111 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.112 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.112 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.112 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:38:00.113 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.113 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.113 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.114 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.114 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.114 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.114 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.114 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.115 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.115 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.117 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.117 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.132 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.133 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.133 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.133 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.252 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.252 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.253 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.253 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.254 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.255 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.255 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.255 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.255 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.256 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.256 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.256 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.256 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.256 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.257 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.257 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.257 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.257 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.257 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.258 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.259 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.259 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.259 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.259 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.259 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:38:00.260 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.260 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.261 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.261 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.262 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.262 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.265 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.266 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.266 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.266 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.292 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.311 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.311 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.312 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.312 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:00.444 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.459 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.460 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.511 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.512 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:00.513 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:38:51.943 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:51.958 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.044 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.177 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.177 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.184 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.185 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.187 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.187 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.188 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.189 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.189 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.190 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.191 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.194 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.194 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.195 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.197 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.197 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.198 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.199 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:52.199 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.201 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.202 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.202 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.203 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.204 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.204 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.205 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.207 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.207 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.207 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.207 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.225 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.235 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.264 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.264 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.264 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.269 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.269 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.270 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.271 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.271 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.272 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.273 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.275 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.275 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.276 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.277 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.277 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.278 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.279 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.280 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.280 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.282 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.283 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.283 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:38:52.284 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.285 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.285 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.440 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.440 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:52.441 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.762 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.852 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:38:53.852 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.853 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.853 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:38:53.855 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.857 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.858 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.869 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.874 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.875 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.876 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.876 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.876 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.876 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.909 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.909 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.910 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:38:53.911 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

ERROR - 12:39:49.224 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.542 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.547 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.547 ERROR    bitswap: Error writing block to datastore: The filename, directory name, or volume label syntax is incorrect. bitswap.go:317
12:39:49.587 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.587 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.587 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.587 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.588 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.588 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.588 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.588 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.589 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.590 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:39:49.591 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:39:49.596 ERROR    bitswap: Error writing block to datastore: The system cannot find the path specified. bitswap.go:317
12:40:53.767 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:53.767 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:53.786 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:53.793 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:53.821 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.394 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.394 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.394 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.395 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.396 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:40:54.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.397 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.397 ERROR    bitswap: Error writing block to datastore: The system cannot find the file specified. bitswap.go:317
12:40:54.405 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.417 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.417 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.418 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.443 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.487 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.487 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.488 ERROR    bitswap: Error writing block to datastore: Access is denied. bitswap.go:317
12:40:54.497 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317
12:40:54.502 ERROR    bitswap: Error writing block to datastore: The parameter is incorrect. bitswap.go:317

[Stebalien]

It loads with only 2 errors:

Those errors are "normal" and should go away in the near future.

But the hell load of error happens when I try to go in the webui and check the peers.

That's because the webui has some really unoptimized code rendering all connected peers on a globe. For now, the recommended way to check which peers you're connected to is to run ipfs swarm peers on the command line.

I checked the G:ipfs folder's properties and it seems to be set to read-only

That would explain that list of errors but I'm pretty sure we don't set the repo to read-only (unfortunately, I don't use windows so it's a bit hard for me to check). Did it start out read-only (did it work and then stop working) or did it suddenly become read-only?

[djdv]

@gdeverlant
The read only box there is set to the tri-state, it is most likely representing "unset" or "mixed", a read-only state looks like a checkmark ✔️ in that box.

There may be something else preventing you from writing to the datastore, without information on how ipfs was invoked and the permissions for the G: volume, it's hard to say.

I believe the dht cast errors are already known, I think they are being demoted to warnings not errors. Someone correct me if this is wrong, please.

[Stebalien]

I've moved this new discussion to #4528 (I like to keep issues clean).

[al-sabr]

@Stebalien If you don't use Windows just go get a Virtualbox image and start playing with.

https://developer.microsoft.com/en-us/microsoft-edge/tools/vms/

[djdv]

@Stebalien
I've been running the test binary from above (Qma9vnYd4LV7DJkcsx4on3ezzuHT5JQcU2J2GaS3jmeKCt) for a while now, this morning I returned to a panic.

panic: runtime error: slice bounds out of range

goroutine 1414 [running]:
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table.(*blockIterator).parseKV(0xc12327ac60, 0x11802ab3ef, 0xc000710003)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table/iterator.go:118 +0x54d
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table.(*blockIterator).Next(0xc12327ac60)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table/iterator.go:154 +0x1ec
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table.(*Iterator).next(0xc0cd84c360)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table/iterator.go:347 +0xc0
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table.(*Iterator).Next(0xc0cd84c360)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table/iterator.go:397 +0x4d
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table.(*ConcatIterator).Next(0xc0d2310a50)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/table/iterator.go:507 +0x3a
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/y.(*MergeIterator).Next(0xc0d2310be0)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/y/iterator.go:216 +0x5b
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger.(*Iterator).parseItem(0xc0cf33a4d0, 0x1)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/iterator.go:388 +0x71c
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger.(*Iterator).prefetch(0xc0cf33a4d0)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/iterator.go:460 +0x9b
gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger.(*Iterator).Seek(0xc0cf33a4d0, 0xc0b0f54c80, 0x42, 0x50)
        /home/steb/projects/go/src/gx/ipfs/QmXtSA4dxoDKMzhHkwqeoBoBYASov1ZWnLQo38juKNbe3z/badger/iterator.go:492 +0x3ee
gx/ipfs/Qmdin8YL17fL1BC5ej6o9b8es6MBoiQjKVdyxEwJh3HVmf/go-ds-badger.(*datastore).QueryNew(0xc042039350, 0xc0b0f54be0, 0x42, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/steb/projects/go/src/gx/ipfs/Qmdin8YL17fL1BC5ej6o9b8es6MBoiQjKVdyxEwJh3HVmf/go-ds-badger/datastore.go:144 +0x1ef
gx/ipfs/Qmdin8YL17fL1BC5ej6o9b8es6MBoiQjKVdyxEwJh3HVmf/go-ds-badger.(*datastore).Query(0xc042039350, 0xc0b0f54be0, 0x42, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/steb/projects/go/src/gx/ipfs/Qmdin8YL17fL1BC5ej6o9b8es6MBoiQjKVdyxEwJh3HVmf/go-ds-badger/datastore.go:133 +0x74
gx/ipfs/QmU7tt6mHJ5Wocjy2omBxpDfN8g9pkRimzJae7EXdrs96k/go-ds-measure.(*measure).Query(0xc04213c5a0, 0xc0b0f54be0, 0x42, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/steb/projects/go/src/gx/ipfs/QmU7tt6mHJ5Wocjy2omBxpDfN8g9pkRimzJae7EXdrs96k/go-ds-measure/measure.go:141 +0x12e
gx/ipfs/QmU7tt6mHJ5Wocjy2omBxpDfN8g9pkRimzJae7EXdrs96k/go-ds-measure.(*measure).Query(0xc04213c6c0, 0xc0b0f54be0, 0x42, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/steb/projects/go/src/gx/ipfs/QmU7tt6mHJ5Wocjy2omBxpDfN8g9pkRimzJae7EXdrs96k/go-ds-measure/measure.go:141 +0x12e
gx/ipfs/QmXVJax39Hpq2KHYsJZobhVSyKNNwWp3pXLjmdoqYheDHA/autobatch.(*Datastore).Query(0xc0b3e48140, 0xc0b0f54be0, 0x42, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/steb/projects/go/src/gx/ipfs/QmXVJax39Hpq2KHYsJZobhVSyKNNwWp3pXLjmdoqYheDHA/autobatch/autobatch.go:80 +0xd4
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers.loadProvSet(0x1490720, 0xc0b3e48140, 0xc0c6aed770, 0x0, 0x0, 0xc0c7527f00)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers/providers.go:115 +0xd9
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers.(*ProviderManager).addProv(0xc0b3334180, 0xc0c6aed770, 0xc0d07daae0, 0x22, 0x0, 0x0)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers/providers.go:167 +0x361
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers.(*ProviderManager).run(0xc0b3334180)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers/providers.go:256 +0xae5
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers.NewProviderManager.func1(0x1494500, 0xc0b3334240)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/providers/providers.go:73 +0x31
gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess.(*process).Go.func1(0xc090f08040, 0xc0b3334240, 0xc0b33342a0)
        /home/steb/projects/go/src/gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess/impl-mutex.go:112 +0x43
created by gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess.(*process).Go
        /home/steb/projects/go/src/gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess/impl-mutex.go:111 +0x2d8

[whyrusleeping]

@djdv well thats another issue entirely. looks like a potential badger bug

[whyrusleeping]

@djdv do you still have the repo from this failure? If so, how big is it and would you be willing to share it with us? The badger team wants to look at the badger files to try and debug the panic you posted.

[djdv]

@whyrusleeping I still have it but it in an active repo, which has since been modified via browsing other users hashes and adding things myself. I'm willing to give some form of remote access to it or upload a copy somewhere else (whichever is easier) but it's relatively large (178GB), as such I will contact you directly via email about this when I get a chance later.

[djdv]

2nd panic with above build

panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x0 addr=0x400 pc=0x40c724]

goroutine 39750634 [running]:
gx/ipfs/QmYijbtjCxFEjSXaudaQAUz3LN5VKLssm8WCUsRoqzXmQR/go-libp2p-peerstore.(*AddrManager).AddAddrs(0xc04253c890, 0xc0cf39e000, 0x22, 0xc0be4a1c00, 0xa9, 0xa9, 0x2540be400)
        /home/steb/projects/go/src/gx/ipfs/QmYijbtjCxFEjSXaudaQAUz3LN5VKLssm8WCUsRoqzXmQR/go-libp2p-peerstore/addr_manager.go:124 +0x2e2

gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht.(*IpfsDHT).closerPeersSingle(0xc04215a300, 0x148ddc0, 0xc0d5bc30b0, 0xc0bd97fb90, 0x26, 0xc0bd021830, 0x22, 0x10, 0xd85800, 0xc0bd021801, ...)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/lookup.go:117 +0x1cc
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht.(*IpfsDHT).GetClosestPeers.func1(0x148ddc0, 0xc0d5bc30b0, 0xc0bd021830, 0x22, 0x1, 0x1, 0xc0f2450160)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/lookup.go:65 +0x128
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht.(*dhtQueryRunner).queryPeer(0xc0c2ffc780, 0x1494500, 0xc0eb19bb00, 0xc0bd021830, 0x22)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/query.go:267 +0x140
gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht.(*dhtQueryRunner).spawnWorkers.func1(0x1494500, 0xc0eb19bb00)
        /home/steb/projects/go/src/gx/ipfs/QmfUvYQhL2GinafMbPDYz7VFoZv4iiuLuR33aRsPurXGag/go-libp2p-kad-dht/query.go:208 +0x57
gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess.(*process).Go.func1(0xc0d7c5ea20, 0xc0eb19bb00, 0xc0eb19bc20)
        /home/steb/projects/go/src/gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess/impl-mutex.go:112 +0x43
created by gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess.(*process).Go
        /home/steb/projects/go/src/gx/ipfs/QmSF8fPo3jgVBAy8fpdjjYqgG87dkJgUprRBHRd2tmfgpP/goprocess/impl-mutex.go:111 +0x2d8

[Stebalien]

That's a (bad) memory corruption. Something is shitting all over memory and I'm not convinced it's badger. Possibly related to #4483, #4527.

[Stebalien]

Fixed.