Delta: Shaded version of local mode for Delta

Created on 11 Nov 2019  路  4Comments  路  Source: delta-io/delta

Today Delta requires a Spark cluster to run. However, Delta is actually a storage format but happens to use Spark to process its logs. The user should be able to use Delta in other engines. The goal of this issue is to create a shaded version of the Delta library to help integration with other JVM based engines (presto, hive, etc).

enhancement

Most helpful comment

We created a repo for all connectors including this one: https://github.com/delta-io/connectors All further work of this issue will be put into this new repo.

All 4 comments

Presto connector will be great!.

Thanks @zsxwing it's really a great feature we want. I wonder is there a roadmap, or can you elaborate some info how it is designed?

We created a repo for all connectors including this one: https://github.com/delta-io/connectors All further work of this issue will be put into this new repo.

Closing this issue. The repo mentioned above has the uber jar to read Delta log files.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

NimeshSatam picture NimeshSatam  路  3Comments

ChethanUK picture ChethanUK  路  3Comments

rambabu-posa picture rambabu-posa  路  9Comments

tdas picture tdas  路  4Comments

tdas picture tdas  路  6Comments