Argo: Testing Argo Workflow pipelines

[yauhen-sobaleu]

Summary

Hello!
Is there a way to test Argo Workflow pipelines? Are there already any best practices on how to test the contents of an Argo Workflow manifest?

Motivation

I use Argo Workflows for Spark jobs orchestrations and part of my pipeline is a Python script step that does all data dependency checks (if input data is there and output data is not still there -> launch a spark job).

These custom Python script steps can be buggy and I don't see the way how I can cover them with tests in an automated manner.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[metasim]

Good question @yauhen-sobaleu