Dvc: Smoke testing

Created on 6 Aug 2020  路  3Comments  路  Source: iterative/dvc

It'd be great if we could do a smoke testing before releases.

See: https://github.com/iterative/dvc/issues/4318

p3-nice-to-have testing

Most helpful comment

And, on smoke tests, we should test something that's very simple (dvc add directory/file, import/get, etc) and/or something that differs between different packages (eg: related to dependencies, etc). Any other kinds of tests can be added as we see fit later on.

And, other specialized tests can be easily covered with our func/unit tests (even if it is not, smoketest won't help here).

All 3 comments

@skshetry Could you elaborate on how you see it applied in dvc?

  1. Build package.
  2. Run tests (e2e types) that are critical for the release.
  3. Deploy package if it passes.

We could create a separate repository for this and run those scripts before "deploying".

And, on smoke tests, we should test something that's very simple (dvc add directory/file, import/get, etc) and/or something that differs between different packages (eg: related to dependencies, etc). Any other kinds of tests can be added as we see fit later on.

And, other specialized tests can be easily covered with our func/unit tests (even if it is not, smoketest won't help here).

Was this page helpful?
0 / 5 - 0 ratings

Related issues

jorgeorpinel picture jorgeorpinel  路  3Comments

prihoda picture prihoda  路  3Comments

nik123 picture nik123  路  3Comments

dmpetrov picture dmpetrov  路  3Comments

siddygups picture siddygups  路  3Comments