Airflow: DockerOperator support for Nvidia-Docker

Created on 24 Jun 2020  路  4Comments  路  Source: apache/airflow

Description

Offer support for Nvidia-Docker. I'm not sure how feasible this is b/c it seems like docker's python package doesn't support the gpus flag (related issue w/ docker's python package). Although it does appear to be on their radar (this PR)

Use case / motivation
Support running GPU accelerated docker operators. This would also be useful to folks looking to run tasks in parallel on separate GPUs.

feature

Most helpful comment

@nullhack could be a good time to revisit the issue now that the PR is merged

All 4 comments

Thanks for opening your first issue here! Be sure to follow the issue template!

DockerOperator uses docker-py internally, so It'll not be possible to think about including It until that PR is merged.

PR merged!

@nullhack could be a good time to revisit the issue now that the PR is merged

Was this page helpful?
0 / 5 - 0 ratings

Related issues

turbaszek picture turbaszek  路  3Comments

Milchdealer picture Milchdealer  路  4Comments

xOnelinx picture xOnelinx  路  4Comments

ryanahamilton picture ryanahamilton  路  3Comments

hagope picture hagope  路  4Comments