Kubespray: Ansible playbooks for cluster shared storage

[v1k0d3n]

Just creating a placeholder issue, until I can work on it: I would like to add a collection of playbook that would add shared storage options prior to the deployment of the cluster. One of the lower hanging items could be Ceph and NFS. Since Kargo already deploys Docker and etcd, storage options could be configured prior, and used as the shared backend for all other services and container volumes. This would increase reliability and production-quality of Kargo. I should be able to start working on this over the weekend or next week (hopefully). This all came from a conversation I had with @ant31. Let me know if you disagree with any of this, or if I overstated anything.

[Smana]

Hello, does this issue relates to https://github.com/kubespray/kargo/issues/312

[ant31]

Related to too #228

I think such service can be k8s-managed, then kpm is a candidate (to be discuss) to prepare packages and manage resources.
But kargo will have to configure the kubelet plugins before.

we probably want to create new-roles:

• network_storage/ceph
• network_storage/nfs
• network_storage/torus

[v1k0d3n]

yes, @ant31 you're right...those are related. I can clean these issues up later today.

[pcm32]

I'm close to submitting a PR to provision glusterfs plus k8s support for that (PV and endpoint).

[bogdando]

Related https://github.com/kubernetes-incubator/kargo/pull/681

[ant31]

I'm working on https://github.com/heketi/heketi too.
It will provide kinda self-hosted glusterfs in kubernetes.
Also some other projects in the same area are coming, we should wait for them as it will simplify a lot.

[glitchcrab]

Has there been any movement on this at all? It would be great to be able to use Flexvolume plugins (such as flexrex), but even just to be able to talk to my Ceph cluster using the built-in Ceph driver would be good.

The need for persistent storage is definitely there, I'm surprised that this isn't possible with Kubespray yet (unless I'm missing something).