Mist: Sync keeps looping, never ends

Created on 21 May 2017 · 15Comments · Source: ethereum/mist

System information

Version: `Mist-macosx-0-8-10.dmg` OS & Version: osx 10.9.5 Node type: `eth/geth(default)`

Troubleshooting

When Mist sync was always at some random number for almost a week I followed the advice to clean up and run

geth --fast --cache 1024

INFO [05-20|06:31:58] Starting peer-to-peer node instance=Geth/v1.6.0-stable-facc47cb/darwin-amd64/go1.8.1

It got as far as 3739395

INFO [05-20|20:42:15] Imported new state entries               count=2    elapsed=9.002s    processed=8533803 pending=2777
INFO [05-20|20:42:15] Imported new state entries               count=22   elapsed=9.696s    processed=8533825 pending=2777
WARN [05-20|20:42:15] Synchronisation failed, retrying         err="state data download canceled (requested)"
INFO [05-20|20:42:15] Imported new state entries               count=2    elapsed=8.771s    processed=8533827 pending=2777
INFO [05-20|20:42:15] Imported new block headers               count=3    elapsed=13.057ms  number=3739395 hash=c8cac2…e88e3d ignored=123
INFO [05-20|20:42:16] Imported new state entries               count=1    elapsed=130.041ms processed=8533828 pending=17
INFO [05-20|20:42:17] Imported new state entries               count=2    elapsed=151.067ms processed=8533830 pending=210

a few seemingly benign errors

INFO [05-20|20:53:30] Imported new state entries               count=2    elapsed=1.153s    processed=8539441 pending=9617
INFO [05-20|20:53:31] Imported new state entries               count=2    elapsed=438.174ms processed=8539443 pending=9620
ERROR[05-20|20:53:31] Failed to unregister sync peer           peer=829b86706fae26b2 err="peer is not registered"
INFO [05-20|20:53:32] Imported new state entries               count=2    elapsed=565.070ms processed=8539445 pending=9626
INFO [05-20|20:53:32] Imported new state entries               count=2    elapsed=847.783ms processed=8539447 pending=9628
INFO [05-20|20:53:33] Imported new state entries               count=2    elapsed=381.304ms processed=8539449 pending=9632
INFO [05-20|20:53:37] Imported new state entries               count=2    elapsed=1.471s    processed=8539451 pending=9637
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=1.233s    processed=8539453 pending=9639
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=6.168s    processed=8539455 pending=9639
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=7.935s    processed=8539457 pending=9639
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=10.253s   processed=8539459 pending=9639
INFO [05-20|20:53:39] Imported new state entries               count=3    elapsed=5.539s    processed=8539462 pending=9639
ERROR[05-20|20:53:39] Peer removal failed                      peer=829b86706fae26b2 err="peer is not registered"
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=11.324s   processed=8539464 pending=9638
INFO [05-20|20:53:39] Imported new state entries               count=2    elapsed=222.595ms processed=8539466 pending=9640

and back to the beginning again

INFO [05-20|20:54:26] Imported new state entries               count=2    elapsed=3.655s    processed=8539595 pending=9774
INFO [05-20|20:54:27] Imported new state entries               count=2    elapsed=79.109ms  processed=8539597 pending=9776
INFO [05-20|20:54:28] Imported new chain segment               blocks=1 txs=0 mgas=0.000 elapsed=899.206ms mgasps=0.000 number=1       hash=68e05f…7f81ed
INFO [05-20|20:54:29] Imported new state entries               count=2    elapsed=2.230s    processed=8539599 pending=9782
INFO [05-20|20:54:29] Imported new state entries               count=2    elapsed=2.110s    processed=8539601 pending=9782
INFO [05-20|20:54:30] Imported new state entries               count=2    elapsed=1.230s    processed=8539603 pending=9786
INFO [05-20|20:54:31] Imported new state entries               count=2    elapsed=2.510s    processed=8539605 pending=9788
INFO [05-20|20:54:32] Imported new state entries               count=2    elapsed=330.215ms processed=8539607 pending=9790
INFO [05-20|20:56:04] Imported new state entries               count=2    elapsed=1m33.909s processed=8539609 pending=10040
INFO [05-20|20:56:04] Imported new state entries               count=2    elapsed=1m32.693s processed=8539611 pending=10040
WARN [05-20|20:56:04] Synchronisation failed, retrying         err="state data download canceled (requested)"
INFO [05-20|20:56:04] Imported new state entries               count=277  elapsed=1m31.766s processed=8539888 pending=10039
WARN [05-20|20:56:09] Header broke chain ancestry              peer=b6ff36a3c224d413 number=2       hash=b495a1…4698c9
INFO [05-20|20:56:11] Imported new block headers               count=0    elapsed=3.263ms   number=192     hash=723899…123390 ignored=192
INFO [05-20|20:56:11] Imported new block receipts              count=0    elapsed=215.735µs number=2       hash=b495a1…4698c9 ignored=2
INFO [05-20|20:56:11] Imported new block receipts              count=0    elapsed=23.536ms  number=32      hash=88be69…60ae13 ignored=30
INFO [05-20|20:56:12] Imported new state entries               count=1    elapsed=226.884ms processed=8539889 pending=17
INFO [05-20|20:56:12] Imported new block receipts              count=0    elapsed=523.603µs number=55      hash=eb5889…c935f9 ignored=23
INFO [05-20|20:56:12] Imported new block headers               count=0    elapsed=3.601ms   number=384     hash=d3d5d5…c79cf3 ignored=192
INFO [05-20|20:56:12] Imported new state entries               count=2    elapsed=255.450ms processed=8539891 pending=49
INFO [05-20|20:56:13] Imported new state entries               count=3    elapsed=333.242ms processed=8539894 pending=97
INFO [05-20|20:56:14] Imported new state entries               count=4    elapsed=390.730ms processed=8539898 pending=161

I'm now at

INFO [05-21|12:11:07] Imported new block headers count=0 elapsed=55.524ms number=1980504 hash=f7f36e…41b08a ignored=1472

query geth via console looks like it is going backwards:

> eth.syncing
{
  currentBlock: 3739084,
  highestBlock: 3739199,
  knownStates: 8492596,
  pulledStates: 8482574,
  startingBlock: 0
}
> eth.syncing
{
  currentBlock: 1833367,
  highestBlock: 3742220,
  knownStates: 9009130,
  pulledStates: 8997879,
  startingBlock: 0
}

I don't expect initial sync to take days.
I don't expect initial sync to require workarounds.
I don't expect initial sync to loop.

v0.8.9

Source

dugoh

👍7

Most helpful comment

Has this been resolved?

ianidlmr on 30 Aug 2017

👍7

All 15 comments

And there it goes again

INFO [05-21|22:14:41] Imported new block headers               count=0    elapsed=65.007ms  number=2630323 hash=bf56c3…154245 ignored=1728
INFO [05-21|22:14:42] Imported new state entries               count=1    elapsed=74.296ms  processed=9202707 pending=3317
INFO [05-21|22:14:42] Imported new state entries               count=31   elapsed=1.013s    processed=9202738 pending=3316
INFO [05-21|22:14:42] Imported new block headers               count=0    elapsed=76.976ms  number=2632371 hash=cfbfac…19b502 ignored=2048
INFO [05-21|22:14:43] Imported new state entries               count=33   elapsed=891.272ms processed=9202771 pending=3679
INFO [05-21|22:14:43] Imported new block headers               count=0    elapsed=4.825ms   number=2632627 hash=7d95a8…c01680 ignored=256
INFO [05-21|22:14:43] Imported new state entries               count=36   elapsed=672.225ms processed=9202807 pending=4062
INFO [05-21|22:14:44] Imported new state entries               count=41   elapsed=272.210ms processed=9202848 pending=4496
INFO [05-21|22:14:45] Imported new state entries               count=56   elapsed=725.183ms processed=9202904 pending=5078
WARN [05-21|22:14:45] Synchronisation failed, retrying         err="header processing canceled (requested)"
WARN [05-21|22:14:51] Synchronisation failed, dropping peer    peer=cdbfe4127bd7337e err="action from bad peer ignored"
INFO [05-21|22:14:52] Imported new state entries               count=1    elapsed=657.585µs processed=9202905 pending=17
INFO [05-21|22:14:52] Imported new state entries               count=2    elapsed=1.196ms   processed=9202907 pending=49
INFO [05-21|22:14:52] Imported new state entries               count=2    elapsed=1.167ms   processed=9202909 pending=81
INFO [05-21|22:14:52] Imported new state entries               count=2    elapsed=1.177ms   processed=9202911 pending=113
INFO [05-21|22:14:52] Imported new state entries               count=2    elapsed=1.129ms   processed=9202913 pending=145
INFO [05-21|22:14:52] Imported new state entries               count=4    elapsed=2.076ms   processed=9202917 pending=209
INFO [05-21|22:14:52] Imported new state entries               count=11   elapsed=15.086ms  processed=9202928 pending=385
INFO [05-21|22:14:52] Imported new state entries               count=4    elapsed=4.467ms   processed=9202932 pending=449
INFO [05-21|22:14:52] Imported new state entries               count=7    elapsed=3.779ms   processed=9202939 pending=561
INFO [05-21|22:14:52] Imported new state entries               count=24   elapsed=26.192ms  processed=9202963 pending=945
INFO [05-21|22:14:52] Imported new state entries               count=20   elapsed=27.515ms  processed=9202983 pending=1265
INFO [05-21|22:14:52] Imported new state entries               count=42   elapsed=19.463ms  processed=9203025 pending=1937
INFO [05-21|22:14:53] Imported new state entries               count=49   elapsed=61.575ms  processed=9203074 pending=2721
INFO [05-21|22:14:53] Imported new state entries               count=101  elapsed=373.845ms processed=9203175 pending=3926
INFO [05-21|22:14:53] Imported new state entries               count=3    elapsed=1.468ms   processed=9203178 pending=5060
INFO [05-21|22:14:53] Imported new state entries               count=101  elapsed=380.066ms processed=9203279 pending=5060
INFO [05-21|22:14:54] Imported new state entries               count=114  elapsed=123.434ms processed=9203393 pending=7743
INFO [05-21|22:14:54] Imported new state entries               count=4    elapsed=128.597ms processed=9203397 pending=7779
INFO [05-21|22:14:54] Imported new state entries               count=127  elapsed=531.197ms processed=9203524 pending=7779
INFO [05-21|22:14:54] Imported new state entries               count=3    elapsed=4.798ms   processed=9203527 pending=7779
INFO [05-21|22:14:54] Imported new state entries               count=144  elapsed=324.874ms processed=9203671 pending=9346
INFO [05-21|22:14:54] Imported new state entries               count=4    elapsed=256.235ms processed=9203675 pending=9383
INFO [05-21|22:14:54] Imported new state entries               count=1    elapsed=658.465µs processed=9203676 pending=9389
INFO [05-21|22:14:57] Imported new state entries               count=187  elapsed=926.234ms processed=9203863 pending=12937
INFO [05-21|22:14:57] Imported new state entries               count=5    elapsed=2.674ms   processed=9203868 pending=12983
INFO [05-21|22:14:58] Imported new state entries               count=47   elapsed=228.533ms processed=9203915 pending=13486
INFO [05-21|22:14:58] Imported new state entries               count=141  elapsed=3.155s    processed=9204056 pending=13485
INFO [05-21|22:14:58] Imported new state entries               count=4    elapsed=2.293ms   processed=9204060 pending=13532
INFO [05-21|22:14:58] Imported new state entries               count=5    elapsed=20.080ms  processed=9204065 pending=13590
INFO [05-21|22:15:02] Imported new state entries               count=137  elapsed=3.692s    processed=9204202 pending=15050
INFO [05-21|22:15:05] Imported new state entries               count=178  elapsed=3.269s    processed=9204380 pending=16968
ERROR[05-21|22:15:05] Failed to unregister sync peer           peer=abe63fc3d8f9342d err="peer is not registered"
ERROR[05-21|22:15:05] Peer removal failed                      peer=abe63fc3d8f9342d err="peer is not registered"
INFO [05-21|22:15:08] Imported new state entries               count=129  elapsed=3.334s    processed=9204509 pending=18379
INFO [05-21|22:15:09] Imported new state entries               count=46   elapsed=1.169s    processed=9204555 pending=18875
INFO [05-21|22:15:15] Imported new state entries               count=165  elapsed=5.851s    processed=9204720 pending=20622
INFO [05-21|22:15:15] Imported new block headers               count=0    elapsed=78.315ms  number=2626093 hash=6f23c7…9b400c ignored=2048
INFO [05-21|22:15:19] Imported new state entries               count=129  elapsed=3.906s    processed=9205005 pending=25433
INFO [05-21|22:15:19] Imported new state entries               count=156  elapsed=400.932ms processed=9204876 pending=25433
INFO [05-21|22:15:19] Imported new state entries               count=163  elapsed=3.486s    processed=9205168 pending=25432
INFO [05-21|22:15:19] Imported new block headers               count=0    elapsed=63.026ms  number=2627693 hash=9f2b86…401dce ignored=1600
INFO [05-21|22:15:20] Imported new state entries               count=89   elapsed=650.432ms processed=9205257 pending=26364
INFO [05-21|22:15:38] Imported new state entries               count=92   elapsed=17.752s   processed=9205349 pending=27601
INFO [05-21|22:15:59] Imported new state entries               count=104  elapsed=39.111s   processed=9205453 pending=28545
INFO [05-21|22:15:59] Imported new state entries               count=148  elapsed=21.098s   processed=9205601 pending=28545
INFO [05-21|22:16:00] Imported new state entries               count=3    elapsed=1.312s    processed=9205604 pending=28550
INFO [05-21|22:16:00] Imported new state entries               count=2    elapsed=124.796ms processed=9205606 pending=28570
INFO [05-21|22:16:21] Imported new chain segment               blocks=1 txs=0 mgas=0.000 elapsed=470.929ms mgasps=0.000 number=1       hash=717514…df2e93
INFO [05-21|22:16:29] Imported new chain segment               blocks=1 txs=0 mgas=0.000 elapsed=3.610ms   mgasps=0.000 number=2       hash=058af9…2aa479
INFO [05-21|22:16:56] Imported new state entries               count=141  elapsed=55.258s   processed=9205747 pending=30377
INFO [05-21|22:16:56] Imported new state entries               count=93   elapsed=48.701s   processed=9205840 pending=30377
INFO [05-21|22:16:56] Imported new state entries               count=93   elapsed=21.245s   processed=9205933 pending=30376
WARN [05-21|22:16:56] Synchronisation failed, retrying         err="block body download canceled (requested)"
INFO [05-21|22:17:04] Imported new state entries               count=1    elapsed=53.944ms  processed=9205934 pending=17
INFO [05-21|22:17:04] Imported new state entries               count=2    elapsed=158.460ms processed=9205936 pending=49
INFO [05-21|22:17:04] Imported new state entries               count=4    elapsed=138.464ms processed=9205940 pending=113
INFO [05-21|22:17:05] Imported new block headers               count=0    elapsed=3.244ms   number=192     hash=723899…123390 ignored=192
INFO [05-21|22:17:05] Imported new block receipts              count=0    elapsed=161µs     number=2       hash=b495a1…4698c9 ignored=2
INFO [05-21|22:17:05] Imported new block receipts              count=0    elapsed=230.855µs number=6       hash=1f1aed…6b326e ignored=4
INFO [05-21|22:17:05] Imported new block receipts              count=0    elapsed=557.298µs number=32      hash=88be69…60ae13 ignored=26
INFO [05-21|22:17:06] Imported new state entries               count=8    elapsed=492.454ms processed=9205948 pending=241
INFO [05-21|22:17:06] Imported new state entries               count=8    elapsed=418.859ms processed=9205956 pending=369

dugoh on 21 May 2017

Duplicate of Ethereum Wallet restarts sync #2259

dugoh on 22 May 2017

Has this been resolved?

ianidlmr on 30 Aug 2017

👍7

Why has this been closed? I have the exact same problem on geth 1.7.1

comodoro on 10 Oct 2017

👍5

And on geth 1.7.2

bancheli on 17 Oct 2017

👍5

This whole process is a pain in the ass. I think I’ll invest my time and effort in to any other cryptocurrency. If your friends ask, Ethereum is worthless.

calvinstiff on 26 Oct 2017

😄3 👍2

@calvinstiff talk about a non-sequitur. (But I agree, syncing is painful)

jadster on 14 Nov 2017

I'm having the same exact problem on geth 1.7.2

nbenmargi on 20 Nov 2017

👍3

Same issue with current git master 1.8 unstable. Is it related to the HDD write performance? RAM 12Gb, cache set to 4096.

darion76 on 2 Dec 2017

👍1

Same issue here. Geth 1.7.2. This issue should not be closed!

tim0k on 12 Dec 2017

👍1

Everyone has this problem (me included..... I hesitate to say me too). I am not familiar enough with Linux Mint to know what Bash is telling me, but if I run geth with --fast --cach=1024 the chain download still hangs. Some people must have succeeded in downloading the chain, otherwise ethereum would not exist as a crypto currencies. So how do the online exchanges do it?

clubaero on 25 Dec 2017

works for me after a bit of patience, at first with --fast and after that a longer time without this parameter. it took about a day in total with an i5-3570K, 100mbit/s internet and SSD space.
45G chain data at the moment.

rotanid on 25 Dec 2017

I have exactly this issue, on the latest version of geth. How do they expect this to take off if you can't sink the damn thing?

MilRefDev on 28 Dec 2017

👍2

@dugoh How do you call eth.syncing?

Are you just mixing in commands while it syncs or do you pause to use the console?

Edit: That works, but much better is opening a second terminal and using geth attach to enter the console. Without geth attach you get Fatal: Error starting protocol stack: datadir already used by another process

This way you have the syncing happening in one terminal window and interactions with it in another.

Shipwreck on 13 Jan 2018

This thread has been automatically locked because it has not had recent activity. Please open a new issue for related bugs and link to relevant comments in this thread.