Electrs: Handle disconnections during reading RPC response

[romanz]

Following https://github.com/romanz/electrs/issues/55#issuecomment-417864910

[romanz]

@duckartes Please try running the indexing using the latest master (https://github.com/romanz/electrs/commit/27ce8ca0ab6326e7cc40dbd5f1bcc11348279c3c).

[duckartes]

So far I'm at:

du -h /mnt/storage/.pin0de/electrs/
24G     /mnt/storage/.pin0de/electrs/mainnet
24G     /mnt/storage/.pin0de/electrs/

2018-09-02T11:17:01.476-04:00 - INFO - best=0000000000000000000a7ee5b7558fb47324926b435957f4dab1bc8f875e09be height=539656 @ 2018-09-02T15:02:40Z (176457 left to index)
2018-09-02T11:20:29.522-04:00 - WARN - reconnecting to bitcoind: expected 96947251 bytes, got 10862478
2018-09-02T15:08:32.368-04:00 - WARN - reconnecting to bitcoind: expected 169252937 bytes, got 75235213
2018-09-02T15:39:55.852-04:00 - WARN - reconnecting to bitcoind: expected 186256813 bytes, got 10305421
2018-09-02T16:05:27.099-04:00 - WARN - reconnecting to bitcoind: expected 157647053 bytes, got 10878861
2018-09-02T16:12:43.181-04:00 - WARN - reconnecting to bitcoind: expected 126426321 bytes, got 10731405
2018-09-02T18:04:49.510-04:00 - WARN - reconnecting to bitcoind: disconnected from daemon while receiving
2018-09-02T18:59:06.975-04:00 - WARN - reconnecting to bitcoind: disconnected from daemon while receiving
2018-09-02T19:36:18.481-04:00 - WARN - reconnecting to bitcoind: disconnected from daemon while receiving
2018-09-02T20:22:57.496-04:00 - WARN - reconnecting to bitcoind: expected 155443715 bytes, got 15744909
2018-09-02T21:01:27.973-04:00 - WARN - reconnecting to bitcoind: disconnected from daemon while receiving
2018-09-02T21:21:11.590-04:00 - WARN - reconnecting to bitcoind: disconnected from daemon while receiving

Hasn't crashed yet :+1:

[duckartes]

No crashing on RPC, but still:

memory allocation of 266551296 bytes failed./run2.sh: line 21: 31448 Aborted $CARGO run --release -- --db-dir=/mnt/storage/.pin0de/electrs --skip-bulk-import -vvvv --timestamp $* 2>> "$LOG"

[romanz]

Let's continue the memory optimization discussion at #38.
Please try running the latest low-mem branch: https://github.com/romanz/electrs/issues/38#issuecomment-417913309

[romanz]

Closing, since the RPC-related issue is fixed.