Pipelines: Duplicated exit handler execution

[hongye-sun]

Currently exit handler generated two steps in the generated argo yaml. One is at the start of the DAG and the other as the exit step.

https://screenshot.googleplex.com/n5qsgCJn3WU

[vicaire]

Could you please clarify the issue? I am not sure what this is about. Thanks!

[hongye-sun]

Yes, the exit handler step will be executed twice in a pipeline. The first one is executed at the start of the pipeline and the second one is executed at the end of the pipeline. The second one is expected but the first one is not. The fix should remove the first step from the generated argo spec.

[vicaire]

Thanks. Updated the area/priority

[logicbomb421]

I'm also experiencing this issue.

A little more context:

I have a component that I load from component.py:

import kfp.components as components

def component_func(...):
    ...

op = components.func_to_container_op(
    component_func,
    ...
)

And in pipeline.py, I use the component like so:

import component
import kfp

@kfp.dsl.pipeline(...)
def pipeline_func(...):
    exit_handler = component.op(...)
    with kfp.dsl.ExitHandler(exit_handler):
        ...

When running a pipeline built this way, the exit handler is invoked immediately upon start, as well as upon exit.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale[bot]]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.