Incubator-superset: Connect Superset to ClickHouse DBMS

Created on 9 Dec 2016 · 8Comments · Source: apache/incubator-superset

Hello.
Superset is a very good dashboard. I liked him at first sight.
In my projects are increasingly used ClickHouse, because it is very fast DBMS for OLAP. See performance comparison at https://clickhouse.yandex/benchmark.html#[100000000,["ClickHouse","Hive"],["0","1"]]

May be possible create connector to ClickHouse, e.g. through [JDBC] (https://github.com/yandex/clickhouse-jdbc) (do similarly to Hive)?
All the best, thank you!

request help-wanted

Source

sichkarev

👍2

Most helpful comment

We've (Cloudflare) open-sourced a basic sqlalchemy dialect for ClickHouse https://github.com/cloudflare/sqlalchemy-clickhouse

I'll start a PR #1844 for ClickHouse backend integration for Superset, it works but it's still a little bit buggy.

vavrusa on 15 Dec 2016

👍14 🎉4

All 8 comments

I think ClickHouse is great alternative for Druid. According to documentation there are 2 ways how to make Superset work with ClickHouse:
1) Native support (similar to Druid)
2) Using SQLAlchemy

Unfortunately there is no external SQLAlchemy dialect for ClickHouse (https://github.com/Infinidat/infi.clickhouse_orm/issues/8). And I think native support would be better. Unfortunately documentation lack description how to do that.

tomsej on 9 Dec 2016

😄1 👍1

@sichkarev Of course it is possible if someone do the work :)
@tomsej If you want to tackle it feel free to ask any question you have, i don't think much code is needed to add a new data sources backend.

xrmx on 9 Dec 2016

@xrmx Thank you so much! Where should I start - Models.py?

tomsej on 9 Dec 2016

@tomsej Well it depends. If it exposes a sql interface i'd give a try with the sqlalchemy dialect. If it's not try to come up with something like DruidDatasource. I don't know if it has the same metric, cluster and column entities as Druid though.

xrmx on 9 Dec 2016

It would be quite exciting to have the clickhouse onboard !
From my very little knowledge about clickhouse, I've heard it somewhat is similar to presto.
In that case: https://github.com/dropbox/PyHive could be helphul as an example of the sqlalchemy integration.