Cosmos-sdk: Unable to sync mainnet: Wrong Block.Header.AppHash

[alexdupre]

Summary of Bug

The initial mainnet blockchain sync stopped after processing 16590 blocks, with the following permanent error:

I[2019-07-17|17:06:20.111] Executed block                               module=state height=16589 validTxs=0 invalidTxs=0
I[2019-07-17|17:06:20.125] Committed state                              module=state height=16589 txs=0 appHash=A8F7AD7C1565C19A272F652C33D02FE6284EB73A40739F2A9A24BF91769AC065
I[2019-07-17|17:06:20.340] Executed block                               module=state height=16590 validTxs=2 invalidTxs=0
I[2019-07-17|17:06:20.391] Committed state                              module=state height=16590 txs=2 appHash=1D7585E157CDA8EC6801BEF7CC41D21741520C924CA1F86CBE1CD105881F7A05
panic: Failed to process committed block (16591:3A6002B113659EB27B44C6507D9197C8D4559F437433B9D8A53121892D1DC1D5): Wrong Block.Header.AppHash.  Expected 1D7585E157CDA8EC6801BEF7CC41D21741520C924CA1F86CBE1CD105881F7A05, got 574DC85FED13F0146D33D4A807C7A6D5C96F1FCAB87E9EE5237688DE85030F4A

goroutine 79 [running]:
github.com/tendermint/tendermint/blockchain.(*BlockchainReactor).poolRoutine(0xc0032a2000)
        /home/cosmos/pkg/mod/github.com/tendermint/[email protected]/blockchain/reactor.go:347 +0x1542
created by github.com/tendermint/tendermint/blockchain.(*BlockchainReactor).OnStart
        /home/cosmos/pkg/mod/github.com/tendermint/[email protected]/blockchain/reactor.go:117 +0x84

Version

% gaiad version --long
cosmos-sdk: 0.35.0
git commit: 028bbef48d093242a2b9adb9bab34eecc97bf3fe
vendor hash: f60176672270c09455c01e9d880079ba36130df4f5cd89df58b6701f50b13aad
build tags: netgo
go version go1.12.6 freebsd/amd64

Steps to Reproduce

gaiad init
curl https://raw.githubusercontent.com/cosmos/launch/master/genesis.json > ~/.gaiad/config/genesis.json
gaiad start

---

For Admin Use

• [ ] Not duplicate issue
• [ ] Appropriate labels applied
• [ ] Appropriate contributors tagged
• [ ] Contributor assigned/self-assigned

[Xa52c]

same issue here at same block height

[zhangyelong]

v0.35.0 is not a mainnet version: #4462
Use v0.34.7 instead on cosmoshub-2