Ray: Create a Ray Operator for Kubernetes

[devonkinghorn]

Ray is a great project but requires a lot of babysitting to set up and tear down clusters on demand.

It would be nice if you had a kubernetes operator to make it trivial to spin up and tear down ray clusters much like the spark operator

It would also solve the issue of autoscaling. The operator would manage the scale of individual ray clusters on kubernetes.

[richardliaw]

This sounds good; I've never done this before; do you know if there is a minimal example of a k8s operator? The spark operator seems a bit involved.

[devonkinghorn]

I don't. Sorry I've never written one. But here is a repository with a lot of examples. https://github.com/operator-framework/awesome-operators

[caitengwei]

@richardliaw Hi Richard, we've implemented a simple version of ray operator. And it's beta-ing inside Ant Financial. I think we can share it in next few weeks, see if it fits the requirements. cc @raulchen

[liucimin]

@richardliaw
Hi richard,when i first time see the ray i think there maybe a kubernetes operator for this great project.
If u agree, i will take a pr for this requirment.

[richardliaw]

@liucimin I think that’ll be a good idea! I’m not quite sure about the timeline of @caitengwei and @raulchen but I think you should go ahead and create the PR and then we can evaluate and merge implementations later.

cc @edoakes and @ericl