Airflow: Release backport package for cncf.kubernetes
Description
We skipped the cncf.kubernetes when releasing backport packages. This was because the cncf.kubernetes relied heavily on the core kubernetes executor classes and the differences in 1.10 vs. 2.0 for those were quite substantial. In 1.10.11 the Kubernetes executor classes have been been backported by @dimberman (Thanks!) so it should be much easier now to release the "cncf.kubernetes" backport packages (with the limitation that they only work for 1.10.11+).
Use case / motivation
People are asking for it !
Related Issues
8582
potiuk
All 11 comments
We should also release GKePodOperator, because it depends on cncf.kubernetes.
mik-laj
on 13 Jul 2020
Yep. It's actually been released already, but does not work :(
potiuk
on 13 Jul 2020
Is it released?
https://github.com/apache/airflow/blob/master/backport_packages/refactor_backport_packages.py#L592
mik-laj
on 13 Jul 2020
@anitakar told that it was not working but I am not 100% sure if it was missing in the package or not importable. Should be easy to check @mik-laj
potiuk
on 13 Jul 2020
@potiuk Is there any update on backport package for cncf.kubernetes
janarthanandev
on 28 Aug 2020
It's planned to release soon: See: https://github.com/apache/airflow/issues/9781
mik-laj
on 28 Aug 2020
1.10.12 has been released and that was one last blocker - I will take a look at preparing release of backports tomorrow :)
potiuk
on 28 Aug 2020
Any update on the release of the backport package for cncf.kubernetes? I can't seem to find it in the PyPi repository.
mathiassp
on 13 Sep 2020
@mathiassp , it's delayed a bit but for very good reasons (see the last comment and just updated description in https://github.com/apache/airflow/issues/10014)
There is a bug in cncf.kubernetes that several committers try to hunt and fix https://github.com/celery/celery/issues/6229 but also we decided last week that we are going to split Airflow 2.0 into separate packages and for that we want to introduce a mechanism of discovery for the backport and provider packages which I have a POC/WIP in place (for both 2.0 and 1.10.13) - we want to release all that together to make sure it is proven before we release it in 2.0 later this year.
potiuk
on 13 Sep 2020
@potiuk is there further action here?
We have cncf provider released
eladkal
on 3 Nov 2020
Closed indeed
potiuk
on 3 Nov 2020
Related issues
ephraimbuddy
路
3Comments
turbaszek
路
3Comments
hagope
路
4Comments
zacwellmer
路
4Comments
Labbs
路
4Comments
Most helpful comment
@mathiassp , it's delayed a bit but for very good reasons (see the last comment and just updated description in https://github.com/apache/airflow/issues/10014)
There is a bug in cncf.kubernetes that several committers try to hunt and fix https://github.com/celery/celery/issues/6229 but also we decided last week that we are going to split Airflow 2.0 into separate packages and for that we want to introduce a mechanism of discovery for the backport and provider packages which I have a POC/WIP in place (for both 2.0 and 1.10.13) - we want to release all that together to make sure it is proven before we release it in 2.0 later this year.