Kubeflow: kfctl generate doesn't regenerate .cache if it is missing

[jlewi]

In an effort to try to upgrade an existing deployment to the latest Kubeflow; I did the following

1. Delete .cache in my existing kfapp directory
2. Rerun kfctl generate

The output was

 /home/jlewi/git_kubeflow/bootstrap/bin/kfctl generate k8s -V
INFO[0000] reading from /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/app.yaml  filename="coordinator/coordinator.go:341"
WARN[0000] 
****************************************************************
Notice anonymous usage reporting enabled using spartakus
To disable it
If you have already deployed it run the following commands:
  cd $(pwd)
  ks delete default -c spartakus
  kubectl -n ${K8S_NAMESPACE} delete deploy -l app=spartakus

Then run the following command to remove it from your ksonnet app:
  ks component rm spartakus

For more info: https://www.kubeflow.org/docs/guides/usage-reporting/
****************************************************************
  filename="coordinator/coordinator.go:242"
INFO[0000] reading from /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/app.yaml  filename="coordinator/coordinator.go:341"
INFO[0000] Ksonnet.Generate Name kf-ci-ml AppDir /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml Platform gcp  filename="ksonnet/ksonnet.go:369"
INFO[0000] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0000] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
INFO[0002] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0002] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
INFO[0004] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0004] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
INFO[0006] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0006] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
INFO[0008] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0008] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
INFO[0010] Creating environment "default" with namespace "kubeflow", pointing to "file:/home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json" cluster at address "127.0.0.1"  filename="env/create.go:77"
WARN[0010] app init failed with error: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options. will retry up to 5 times  filename="ksonnet/ksonnet.go:494"
Error: couldn't generate KfApp:  (kubeflow.error): Code 500 with message: kfApp Generate failed for ksonnet:  (kubeflow.error): Code 500 with message: couldn't initialize KfApi: there was a problem initializing the app: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options
Usage:
  kfctl generate [all(=default)|k8s|platform] [flags]

Flags:
      --email string      email if '--platform gcp'
  -h, --help              help for generate
      --hostname string   hostname if '--platform gcp'
      --ipName string     ipName if '--platform gcp'
      --mount-local       mount-local if '--platform minikube'
  -V, --verbose           verbose output default is false
      --zone string       zone if '--platform gcp'

couldn't generate KfApp:  (kubeflow.error): Code 500 with message: kfApp Generate failed for ksonnet:  (kubeflow.error): Code 500 with message: couldn't initialize KfApi: there was a problem initializing the app: open /home/jlewi/git_kubeflow-testing/ml/kf-ci-ml/.cache/master/bootstrap/k8sSpec/v1.11.7/api/openapi-spec/swagger.json: no such file or directory
To undo this simply delete directory 'ks_app' and re-run `ks init`.
If the error persists, try using flag '--context' to set a different context or run `ks init --help` for more options

[issue-label-bot[bot]]

Issue-Label Bot is automatically applying the label bug to this issue, with a confidence of 0.92. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!

Links: dashboard, app homepage and code for this bot.

[jlewi]

/cc @kkasravi