Kedro: [KED-1878] Create an Avro dataset

[yetudada]

Description

Support Avro datasets as one of the supported DataSet formats to export a BigQuery table to Google Cloud Platform storage.

Possible Implementation

Use the Kedro documentation on how to create a custom DataSet.

[kislerdm]

Hi @yetudada, I'd be keen to commit my effort to this issue in terms of the pydata'20 sprint. Thanks

[kislerdm]

@yetudada Hey Yetunde! I've submitted a PR. There is an issue with docs generation though.

sphinx is screwing to figure the link between two modules of my codebase. One of the options to resolve it would be to adjust https://github.com/quantumblacklabs/kedro/blob/master/docs/build-docs.sh and run sphinx-build as

sphinx-build -c docs/ -ETan -j auto -D language=en docs/build/ docs/build/html

instead of

sphinx-build -c docs/ -WETan -j auto -D language=en docs/build/ docs/build/html

Could you please confirm whether it's an acceptable solution. Thanks

[St-Hakky]

@kislerdm
Hi. I am kedro user and want to use Avro dataset in my pipeline ;)

The PR is already reviewed and is it ready to merge? I am looking forward to using it!!