Redisgraph: Does RedisGraph partition the Graph?

[kant111]

1) Does RedisGraph partition the Graph? if so, what partitioning method is used?
2) is there any configuration I need to do for Graph partitioning if it is available?
3) what to keep in mind when designing the model for partitioning a large graph?

[swilly22]

Hi @kant111,
Currently RedisGraph does not performs any partitioning, the entire graph is stored in RAM on a single machine.

[kant111]

Thanks @swilly22. Any plans on when it will might be supported?

[kant111]

http://glaros.dtc.umn.edu/gkhome/metis/parmetis/overview
https://www.sandia.gov/~srajama/publications/PuLP-IPDPS17.pdf

[kant111]

How do I avoid a single point of failure? can we replicate the entire graph across multiple nodes?

[swilly22]

Thanks,
You can replicate the graph to other nodes within your Redis cluster, this is done automatically..

[kant111]

Does that mean the entire graph must fit into memory? There is no paging? other words there is no flushing to disk?

[swilly22]

Correct, we've decided explicitly not to flush to disk to avoid performance hit,
the current implementation is doing its best to be compact, with that, the availability of large RAM memory systems today should enable users to hold large graphs entirely in memory on a single machine.

[kant111]

Thanks! Can we expect Graph partitioning sometime this year at very least?

[swilly22]

I can't commit to that

[bionicles]

+1 for large graphs esp containerized or serverless w/ terraform ~> AWS

[songbing0520]

Thanks! Can we expect Graph partitioning sometime this year at very least?

I am also expecting RedisGraph can support the partitioning feature.

[songbing0520]

Thanks,
You can replicate the graph to other nodes within your Redis cluster, this is done automatically..

do you have a guideline document to introduce how to configure the Redis Cluster to replicate RedisGraph data between multiple nodes?

[swilly22]

Incase you're using the open source Redis cluster, you can create one which has one primary and multiple replicas see here

[songbing0520]

Incase you're using the open source Redis cluster, you can create one which has one primary and multiple replicas see here

Thank you for the reply, I followed the guideline to complete the configuration, but I am not somewhere have the issue, when I tried to test failover, i shut down one master node from the cluster(3 masters and 3 slaves), the RedisInsight cannot load it, but looks shut down one slave node, RedisInsight still can load the graph. BTW, i check the RDB file, i don't see the RDB file replicated between master <-> slave node...