Incubator-superset: Support more NoSQL databases
I don't know if this topic has already been discussed, but I was thinking on the idea of including a NoSQL database option in Caravel.
Whereas currently the interface for connection is made using SQLAlchemy and, as its own name says, it doesn't deal with anything that is not SQL, I think this could be a nice upgrade.
PS: I imagine that this change could bring changes on the current interface as well.
btzo
All 31 comments
We support Druid which we query through a REST API. There's a common interface to both, though it's non trivial (but certainly doable!) to add support for a new DB backend. We were discussing adding support for ElasticSearch for instance as we have some use cases at Airbnb.
mistercrunch
on 10 Jun 2016
Any specific backend you had in mind?
mistercrunch
on 10 Jun 2016
CouchDB
btzo
on 10 Jun 2016
I would like to suggest MongoDB.
hugo-pires
on 11 Jun 2016
Mongodb would be great !
saitx
on 13 Jun 2016
Acting like a REST API client could be used to connect to several databases
hugo-pires
on 18 Jun 2016
Well the REST APIs to different NOSQL dbs are all very different. I don't think there's a standard there... Different calls to get column metadata, different APIs for queries, ...
mistercrunch
on 18 Jun 2016
Ok. Just a suggestion.
hugo-pires
on 20 Jun 2016
I'm thinking about ElasticSearch. Has a nice REST interface, and Caravel could be a nice alternative to Kibana...
I wonder if porting Caravel would be mainly a matter of reimplementing what I see for Druid in views.py, or it would be much more than that?
jgbarah
on 21 Jun 2016
I see that topic of integrating with ElasticSearch is covered in some detail in #241.
jgbarah
on 21 Jun 2016
@jgbarah, @mistercrunch, any update on this issue? Has there been work done on this that I could see?
SalehHindi
on 5 Jul 2016
ElasticSearch support +1
fnzv
on 11 Jul 2016
+1 for ElasticSearch
danmaz74
on 6 Aug 2016
+1
eroncastro
on 26 Aug 2016
+1 for ElasticSearch
jerry-sjtu
on 1 Sep 2016
+1 for ElasticSearch
mineca
on 20 Sep 2016
+1 for ElasticSearch
feiquanbifeng
on 23 Sep 2016
+1 for ElasticSearch
liukaitj
on 21 Oct 2016
PSA: Please make use of github reactions instead of the annoying +1 comments, thanks.
xrmx
on 21 Oct 2016
+1 for ElasticSearch
detectivebag
on 29 Nov 2016
Anyone actually working on this?
Is there any standard Python API so user could implement certain interface for specific NoSQL database when officially it's not done yet?
QiXuanWang
on 4 Jan 2017
@QiXuanWang yes, you should write a sqlalchemy dialect to be pluggable with superset
xrmx
on 4 Jan 2017
Here's the spec for Python's DBAPI:
https://www.python.org/dev/peps/pep-0249/
mistercrunch
on 4 Jan 2017
Would it be possible to know the list of NoSql databases currently supported by Superset? Is there a list or additional information somewhere. By the way, also in favour of an Elasticsearch support.
frosiere
on 13 Mar 2017
+1 for elasticsearch
xycloud
on 30 Mar 2017
+1 for elasticsearch...
davidattw
on 6 Apr 2017
+1 for bigquery
lilila
on 6 Apr 2017
People, backends support won't automagically appear by themselves by adding +1. Again: https://github.com/airbnb/superset/issues/600#issuecomment-255326247
xrmx
on 6 Apr 2017
I've done some work to clarify the connectors interface, making it easier to add new connectors to the platform.
mistercrunch
on 7 Apr 2017
FYI I started the work to integrate with ElasticSearch. Seems like it's going to be fairly straightforward. Let me know if you want to get involved.
https://github.com/airbnb/superset/pull/2953
mistercrunch
on 13 Jun 2017
mistercrunch
on 25 Oct 2019
Related issues
shyam2794
路
3Comments
gbrian
路
3Comments
ghost
路
3Comments
dinhhuydh
路
3Comments
thoralf-gutierrez
路
3Comments
Most helpful comment
I would like to suggest MongoDB.