Etcd: restart etcd panic with unexpected smaller revision in mvcc

Created on 15 Dec 2016 · 13Comments · Source: etcd-io/etcd

I use docker-compose to start pd cluster (mount pd data to local directory), and when I recreate the cluster with docker-compose up -d --force-recreate, I meet following panic:

2016/12/15 09:43:35 util.go:329: [info] I | membership: [set the cluster version to 3.0 from store]
2016/12/15 09:43:36 util.go:321: [fatal] C | mvcc: [store.keyindex: put with unexpected smaller revision [{65178 0} / {65178 0}]]

The embed etcd version is e53b99588a05d1f4ef172c178d4ed8e8106b8be4

arebug

Source

siddontang

Most helpful comment

any update on this problem?

fOO223Fr on 14 Mar 2019

👍6

All 13 comments

Do you still have the data dir around. Mind sharing that broken data dir?

xiang90 on 15 Dec 2016

If you can reproduce the problem, can you try to update the etcd version to current master and see if you can still reproduce?

xiang90 on 15 Dec 2016

@xiang90

pd.tar.gz

siddontang on 15 Dec 2016

We will update the etcd and try to reproduce it.

siddontang on 15 Dec 2016

Thanks

xiang90 on 15 Dec 2016

@siddontang I can confirm this is a bug. Probably from upstream boltdb. We will investigate more.

xiang90 on 16 Dec 2016

Opened an issue on upstream boltdb: https://github.com/boltdb/bolt/issues/632

xiang90 on 16 Dec 2016

Never hit this again. It seems like a bug outside etcd system really. Closing.

xiang90 on 15 Jun 2017

I got similar message "mvcc: store.keyindex: put with unexpected smaller revision [{200001 0} / {200001 0}]. what does it mean? could you please give technical description.