Notes: Snapshotting for fast sync

Created on 6 Feb 2018  路  4Comments  路  Source: ipfs/notes

Recently there have been some discussion around problem of nodes having to download the entire operation tree (which could be slow) in order to catch up.

If you're interested in this problem you can take a look and chime in here:
https://github.com/ipfs/dynamic-data-and-capabilities/issues/14

CRDTs

Most helpful comment

未-CRDT

State-based CRDTs ensure convergence through disseminating the entire state, that may be large, and merging it to other replicas; whereas operation-based CRDTs disseminate operations (i.e., small states) assuming an exactly-once reliable dissemination layer.

Operation-based CRDTs disseminate operations (i.e., small states) assuming an exactly-once reliable dissemination layer.

This paper introduces Delta State Conflict-Free Replicated Data Types (未-CRDT) that can achieve the best of both worlds: small messages with an incremental nature, as in operation-based CRDTs, disseminated over unreliable communi- cation channels, as in traditional state-based CRDTs.


Benefits of delta CRDTs over operation-based CRDTs:

  • No need to represent causal dependency.
  • No need to implement exactly-once dissemination.
  • Using state for faster convergence of new replicas entering an existing CRDT (many deltas can be combined into a delta group).

All 4 comments

未-CRDT

State-based CRDTs ensure convergence through disseminating the entire state, that may be large, and merging it to other replicas; whereas operation-based CRDTs disseminate operations (i.e., small states) assuming an exactly-once reliable dissemination layer.

Operation-based CRDTs disseminate operations (i.e., small states) assuming an exactly-once reliable dissemination layer.

This paper introduces Delta State Conflict-Free Replicated Data Types (未-CRDT) that can achieve the best of both worlds: small messages with an incremental nature, as in operation-based CRDTs, disseminated over unreliable communi- cation channels, as in traditional state-based CRDTs.


Benefits of delta CRDTs over operation-based CRDTs:

  • No need to represent causal dependency.
  • No need to implement exactly-once dissemination.
  • Using state for faster convergence of new replicas entering an existing CRDT (many deltas can be combined into a delta group).

Another paper brought to my attention by @diasdavid:

"Efficient Synchronization of State-based CRDTs": https://arxiv.org/abs/1803.02750

Missed that, thank you @sunny-g !

Was this page helpful?
0 / 5 - 0 ratings

Related issues

reit-c picture reit-c  路  4Comments

leni536 picture leni536  路  6Comments

pgte picture pgte  路  5Comments

jbenet picture jbenet  路  4Comments

Kubuxu picture Kubuxu  路  6Comments