Airflow: Gantt chart for running dag doesn't show up in Airflow 1.10.11

[hossein-jazayeri]

Apache Airflow version: 1.10.11

Kernel (e.g. uname -a): Linux 20cb927bb9ef 5.3.0-1017-aws #18~18.04.1-Ubuntu SMP Wed Apr 8 15:12:16 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

What happened:
Gantt chart for running dags doesn't show up in RBAC UI & gives javascript errors:

d3.min.js:1 Error: <rect> attribute transform: Expected number, "translate(NaN,8)".

How to reproduce it:
By checking the gantt chart of a running dag

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template!

[kaxil]

I was not able to reproduce this. Anyone else can reproduce this, please?

@hossein-jazayeri Is this RBAC UI or Flask-admin based UI

[hossein-jazayeri]

It's RBAC UI

[potiuk]

I could not reproduce it via RBAC UI either. @hossein-jazayeri . Can you share more information about your browser and check some other browsers? This looks like a browser compatibility issue.

[hossein-jazayeri]

It's happening on both Firefox 78.0.1 (64-bit) & Chrome 83.0.4103.116 (Official Build) (64-bit)

[hossein-jazayeri]

I can see the gantt chart for not running dags btw, only it doesn't show up for running ones

[kaxil]

I am on the same version though:

Version 83.0.4103.116 (Official Build) (64-bit)

[potiuk]

Let me also try it.

[potiuk]

While running my version I also hit this problem (with locale): https://github.com/apache/airflow/issues/9100 Marking that to solve in .12

[kaxil]

While running my version I also hit this problem (with locale): #9100 Marking that to solve in .12

Were you able to reproduce this issue (#9813) too?

[potiuk]

Looking at it. And BTW Just closed #9100 - it was caused by cookies. If you switch between old UI and new UI, you need to clear cookies :)

[potiuk]

Confirmed:

Update: Not sure - could be my problem... I will run the released version

[potiuk]

Could not reproduce :(

[waltermaldonado]

I'm also having this problem.

PS: RBAC UI

[fallen-up]

@potiuk @kaxil
We have the same issue:
airflow 1.10.11

[webserver]
rbac = True

Tests were performed in incognito mode and in different browsers (latest stable builds of Chrome, Chromium, Brave, Firefox) with clearing cookies.
On airflow 1.10.9, 1.10.10 problems were not detected.

[thesuperzapper]

@potiuk I am still getting this on 1.10.12?

[ibotheperfect]

I have same issue too on 1.10.12

[kaxil]

Can someone here post the steps for reproduction since I and @potiuk weren't able to reproduce it?

Also please list your chrome versions

[potiuk]

Yeah. I'd also love some reproducibility path here. Maybe you can try to help us and narrow it down @thesuperzapper @waltermaldonado @hossein-jazayeri @ibotheperfect by trying different combinations of browsers, using different browser profiles, clearing the cache, etc.

I saw similar things happening when - during development - you use the same URL to test 1.10* and 2.* version of Airflow for example, or simply different versions of Airflow 1.10. In such cases the scripts and cookies get cached from different versions of Airflow and you need to clear cache to fix it - so if you could try it out on your systems that would help us to narrow down the issue.

[hossein-jazayeri]

The issue is still happening for me as well on both 1.10.11 & 1.10.12 on both Chrome, Chromium & Firehose.
I'm using RBAC UI
Chrome version: Version 85.0.4183.102 (Official Build) (64-bit)
Firehose version: 80.0.1 (64-bit)
Chromium version (fresh install): Version 87.0.4267.0 (Developer Build) (64-bit)

It's happening on an incognito window as well.

Webserver log of the request:

[17/Sep/2020:13:20:36 +0000] "GET /static/dist/ganttChartD3v2.***.js HTTP/1.1" 304 0 "https://airflow.***/gantt?dag_id=***&root=" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4267.0 Safari/537.36"
[17/Sep/2020:13:20:36 +0000] "GET /static/appbuilder/fonts/glyphicons-halflings-regular.woff2 HTTP/1.1" 404 3882 "https://airflow.***/static/appbuilder/css/bootstrap.min.css" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4267.0 Safari/537.36"

[ibotheperfect]

Yeah. I'd also love some reproducibility path here. Maybe you can try to help us and narrow it down @thesuperzapper @waltermaldonado @hossein-jazayeri @ibotheperfect by trying different combinations of browsers, using different browser profiles, clearing the cache, etc.

I saw similar things happening when - during development - you use the same URL to test 1.10* and 2.* version of Airflow for example, or simply different versions of Airflow 1.10. In such cases the scripts and cookies get cached from different versions of Airflow and you need to clear cache to fix it - so if you could try it out on your systems that would help us to narrow down the issue.

I deployed airflow via docker by using bitnami's image. This is happening both 1.10.11 and 1.10.12 versions. I also tried both chrome and firefox. Here is my docker-compose

version: '3'
services:
  postgresql:
    image: postgres:9.6
    environment:
      - POSTGRES_USER=airflow
      - POSTGRES_PASSWORD=airflow
      - POSTGRES_DB=airflow
      - PGDATA=/var/lib/postgresql/data/pgdata
    volumes:
      - ./pgdata:/var/lib/postgresql/data/pgdata

  redis:
    image: 'redis:5.0.5'

  airflow:
    image: bitnami/airflow:1.10.12
    environment:
      - AIRFLOW_DATABASE_NAME=airflow
      - AIRFLOW_DATABASE_USERNAME=airflow
      - AIRFLOW_DATABASE_PASSWORD=airflow
      - AIRFLOW_FERNET_KEY=****
      - AIRFLOW_EXECUTOR=CeleryExecutor
      - AIRFLOW_PASSWORD=airflow
      - AIRFLOW_USERNAME=admin
      - AIRFLOW_LOAD_EXAMPLES=no
    ports:
      - '8080:8080'
    volumes:
      - ./logs:/opt/bitnami/airflow/logs
      - ./dags:/opt/bitnami/airflow/dags

  scheduler:
    image: bitnami/airflow-scheduler:1.10.12
    environment:
      - AIRFLOW_DATABASE_NAME=airflow
      - AIRFLOW_DATABASE_USERNAME=airflow
      - AIRFLOW_DATABASE_PASSWORD=airflow
      - AIRFLOW_EXECUTOR=CeleryExecutor
      - AIRFLOW_FERNET_KEY=****
      - AIRFLOW_LOAD_EXAMPLES=no
    volumes:
      - ./logs:/opt/bitnami/airflow/logs
      - ./dags:/opt/bitnami/airflow/dags

  worker:
    image: bitnami/airflow-worker:1.10.12
    environment:
      - AIRFLOW_DATABASE_NAME=airflow
      - AIRFLOW_DATABASE_USERNAME=airflow
      - AIRFLOW_DATABASE_PASSWORD=airflow
      - AIRFLOW_EXECUTOR=CeleryExecutor
      - AIRFLOW_FERNET_KEY=****
      - AIRFLOW_LOAD_EXAMPLES=no
    volumes:
      - ./logs:/opt/bitnami/airflow/logs
      - ./dags:/opt/bitnami/airflow/dags

[kaxil]

Thanks for the info @hossein-jazayeri and @ibotheperfect -- We will try to reproduce it again and come back with our findings.

[kaxil]

I was able to reproduce it with the given docker-compose file, however, the error occurs only for the time a task is running

And after some digging, I am 99% sure it is caused by https://github.com/apache/airflow/pull/8220

@ryanahamilton Would you be able to look at this, please?

[kaxil]

I can confirm this issue is in Master too

[potiuk]

Oh. Wow! Finally!