Incubator-superset: Long run query support in Chart Query

Created on 7 Nov 2019  路  3Comments  路  Source: apache/incubator-superset

Is your feature request related to a problem? Please describe.
I've set up Celery task with the following config:

class CeleryConfig(object):
    BROKER_URL = 'redis://localhost:6379/0'
    CELERY_IMPORTS = (
        'superset.sql_lab',
        'superset.tasks',
    )
    CELERY_RESULT_BACKEND = 'redis://localhost:6379/0'
    CELERYD_LOG_LEVEL = 'INFO'
    CELERYD_PREFETCH_MULTIPLIER = 10
    CELERY_ACKS_LATE = True
    CELERY_ANNOTATIONS = {
        'sql_lab.get_sql_results': {
            'rate_limit': '100/s',
        }
    }
    CELERYBEAT_SCHEDULE = {
    }

CELERY_CONFIG = CeleryConfig

Sql lab seems work OK when fire long run query, PENDING status changes to RUNNING. But In Chart Tab, after fired query button, breaking with timeout.
Or Chart Query doesn't support async long run query? Why?

Additional context

  • x86_64 GNU/Linux
  • Python 3.6.9
  • Flask 1.1.1
  • Werkzeug 0.16.0
request inactive

Most helpful comment

Charts & dashboards do not support async query execution because the assumption is that they are interactive (finishing quickly, under 60 seconds).

That assumption should not be made of the user. It can be opinionated, but I should be able to override that opinion and use an async backend for charting (maybe a feature flag?). Some queries are not interactive, but still need to be visualized.

All 3 comments

Issue-Label Bot is automatically applying the label #enhancement to this issue, with a confidence of 0.80. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

Charts & dashboards do not support async query execution because the assumption is that they are interactive (finishing quickly, under 60 seconds).

That assumption should not be made of the user. It can be opinionated, but I should be able to override that opinion and use an async backend for charting (maybe a feature flag?). Some queries are not interactive, but still need to be visualized.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. For admin, please label this issue .pinned to prevent stale bot from closing the issue.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

josephtyler picture josephtyler  路  3Comments

john-bodley picture john-bodley  路  3Comments

fly-high-bj picture fly-high-bj  路  3Comments

eliab picture eliab  路  3Comments

gbrian picture gbrian  路  3Comments