Lighthouse: Block pruning warnings

[paulhauner]

Description

When connecting to the schlesi testnet I'm seeing a lot of pruning warnings.

This seems to happen consistently (3 times in a row).

Version

Running on: https://github.com/sigp/lighthouse/pull/1108

Present Behaviour

Produces these errors:

May 06 09:56:33.668 WARN Ethereum 2.0 is pre-release. This software is experimental.
May 06 09:56:33.668 INFO Data directory initialised              datadir: /home/paul/.lighthouse
May 06 09:56:33.722 INFO Starting from known genesis state       service: beacon
May 06 09:56:33.765 INFO Block production enabled                method: json rpc via http, endpoint: http://127.0.0.1:8545
May 06 09:56:33.779 INFO Beacon chain initialized                head_slot: 0, head_block: 0xc9cb…db82, head_state: 0x55f8…c2fc, service: beacon
May 06 09:56:33.779 INFO Libp2p Service                          peer_id: PeerId("16Uiu2HAmDvur2Z7P52MrkSoEPPL1Lyens6EG7uWW26tzGtWzBpMM"), service: network
May 06 09:56:33.779 INFO ENR Initialised                         tcp: Some(9000), udp: None, ip: None, id: 0x1847..8aa7, seq: 1, enr: enr:-KO4QK4krY0c85KZBTmIk_21Hnqh84FA8dTsCzY8fSLu9t4sMrlZE7JUdLzPkNjBLEP1qHyk6nedIBXok8eCUXH004EBh2F0dG5ldHOIAAAAAAAAAACEZXRoMpCZJe_WAAAAAP__________gmlkgnY0iXNlY3AyNTZrMaEDEu_i97dPSc1696UspLrWvmPIBi6AR9n-hXsTXD2r3riDdGNwgiMo, service: network
May 06 09:56:33.780 INFO Listening established                   address: /ip4/0.0.0.0/tcp/9000/p2p/16Uiu2HAmDvur2Z7P52MrkSoEPPL1Lyens6EG7uWW26tzGtWzBpMM, service: network
May 06 09:56:33.780 INFO Subscribed to topics                    topics: [BeaconBlock, BeaconAggregateAndProof, VoluntaryExit, ProposerSlashing, AttesterSlashing], service: network
May 06 09:56:33.780 INFO HTTP API started                        port: 5052, address: 127.0.0.1, service: http
May 06 09:56:34.228 INFO Imported deposit log(s)                 new: 319, total: 319, latest_block: 2637321, service: eth1_rpc
May 06 09:56:34.790 INFO Address updated                         udp_port: 9000, ip: 106.69.117.38, service: network
May 06 09:56:35.749 INFO Sync state updated                      new_state: Syncing Finalized Chain, old_state: Stalled, service: sync, service: network
May 06 09:56:35.783 WARN Received old metadata                   new_seq_no: 0, known_seq_no: 0, peer_id: 16Uiu2HAmNYCpko7ahZrZrzcpJRjL6bJ3JmPFiCbb9bgR3UHbHBsH, service: network
May 06 09:56:42.000 INFO Syncing                                 est_time: --, speed: --, distance: 60056 slots (1 weeks 1 days), peers: 4, service: slot_notifier
May 06 09:56:42.858 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x5819495ec9507f02740fdb6e01984147559163675cf8025ee9b769e81399a293))), service: freezer_db
May 06 09:56:48.577 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x4a039fd2115461a97018599a5a7ef0458861a3dac6d9dfa7fb0ca07e9381c2b6))), service: freezer_db
May 06 09:56:52.364 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x0535d46c838916c14e427d6a9e91c4ee745d23715f2e9efc7d1551f51228a273))), service: freezer_db
May 06 09:56:54.005 INFO Syncing                                 est_time: 3 mins, speed: 298.57 slots/sec, distance: 56473 slots (1 weeks 1 days), peers: 4, service: slot_notifier
May 06 09:56:59.203 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x8324c07d87ee9a994c7850edd28b4351302694db0e572d4336d57068369c1695))), service: freezer_db
May 06 09:57:03.923 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x0229701ee5e33a26d8808948284e47877f5b6505864c511b8c105826c15c0f84))), service: freezer_db
May 06 09:57:04.079 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0xa70ca29ffc20b4259dda419f6d504e51335322ae8433b232a176caac8b816fdc))), service: freezer_db
May 06 09:57:04.252 WARN Block pruning failed: BeaconStateError(MissingBeaconBlock(SignedBeaconBlockHash(0x2d1bc7b80589c9eacf206e438cf55ffe83520d61f80f2eb3eb1ad83688bcdbd1))), service: freezer_db
May 06 09:57:05.889 INFO Imported eth1 block(s)                  new: 4096, total_cached_blocks: 4096, latest_block: 2645005, latest_block_age: 256 mins, service: eth1_rpc
May 06 09:57:06.000 INFO Syncing                                 est_time: 4 mins, speed: 250.62 slots/sec, distance: 54043 slots (1 weeks 1 days), peers: 4, service: slot_notifier
May 06 09:57:12.908 INFO Imported eth1 block(s)                  new: 1, total_cached_blocks: 4096, latest_block: 2645006, latest_block_age: 256 mins, service: eth1_rpc

Steps to reproduce:

git checkout bake-in-schlesi
cargo install --path lighthouse --force
lighthouse bn --http

[adaszko]

The deleted bake-in-schlesi branch corresponds to https://github.com/sigp/lighthouse/commit/1552f9997ef61c1ab4d3b6bb6da9041d09daacd4

[adaszko]

It's the head from the head_tracker that sometimes doesn't have a corresponding block in the store and thus produces the error.