Deepspeech: Publishing training Dockerfile

[lissyx]

• [x] Decouple training from building #3056
• [x] Add repo-level support for Docker Hub automated builds #3117
• [x] Create repositories under the mozilla repo
• [x] Setup CircleCI-based build & deploy to Docker Hub #3157

[use-to]

@lissyx Maybe you can better use the github webhooks instead of the scriptworker to link to github on the docker hub page. Also, the automatic builds of docker hub could speed up the pipeline.

[use-to]

@lissyx There is already an existing docker hub account by mozilla. It should be better to request access for that organization instead of creating a new one.

[lissyx]

@lissyx Maybe you can better use the github webhooks instead of the scriptworker to link to github on the docker hub page. Also, the automatic builds of docker hub could speed up the pipeline.

There's a reason we use scriptWorker, maintaining two different CI / CD pipeline will be a burden.

[lissyx]

* [x]  Decouple training from building #3056

* [ ]  Create docker hub account

* [ ]  Add scriptworker upload ability to docker hub

So the situation is complicated:

• we might be able to push from scriptworker using https://pypi.org/project/dockertarpush/
• this code depends on docker image spec v1.1
• current docker-in-docker service on taskcluster is stuck to docker v1.6, with API v1.18 https://github.com/taskcluster/dind-service/blob/master/Dockerfile#L6
• so the docker save command we issue does produce v1.0 docker image spec
• kaniko requires being executed from a docker image, but this fails with weird "HostConfig.NetworkMode" errors
• trying to build kaniko + run it (ubuntu 20.04), it fails fetching some debian packages when building the image (?)

[lissyx]

Ok, Docker Hub Automated builds can support hooks/, so we might be able to rely on that for push-to-tag on releases.

[lissyx]

How it looks on my own repo:

[lissyx]

Still waiting on the people who are supposed to be in charge of the mozilla org on Docker Hub.

[lissyx]

So, #3157 merged, new alpha tagged:

• master just built and deployed as latest on https://hub.docker.com/r/mozilla/deepspeech-train/tags
• current master (after some new merge) building and is deployed
• v0.9.0-alpha.3 tag building and is deployed
• r0.8 branch PR merge still running on TaskCluster, but once it is merged it should produce docker image on Docker Hub

[lissyx]

r0.8 branch PR merge still running on TaskCluster, but once it is merged it should produce docker image on Docker Hub

It should be good but there are issues on both Github and CircleCI, so nothing is starting for now, and I can't be sure it's all okay.

[lissyx]

r0.8 branch PR merge still running on TaskCluster, but once it is merged it should produce docker image on Docker Hub

It should be good but there are issues on both Github and CircleCI, so nothing is starting for now, and I can't be sure it's all okay.

And it worked.