Terraform-provider-aws: New service: AWS Lake Formation

[ewbankkit]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

AWS Lake Formation is now GA.

New or Affected Resource(s)

• aws_XXXXX

Potential Terraform Configuration

# Copy-paste your Terraform configurations here - for large Terraform configs,
# please use a service like Dropbox and share a link to the ZIP file. For
# security, you can also encrypt the files using our GPG public key.

References

Announcement.
Blog post.

Requires:

• https://github.com/terraform-providers/terraform-provider-aws/pull/9670

[slapula]

I'm also looking into writing up these resources as well.

[rafiparvez]

We are using AWS lakeformation for creating data lake at my organization. I am interested in contributing to this.

[ewbankkit]

@rafiparvez Could you please propose some resources that would match your uses cases?

[dthauvin]

@ewbankkit one off major features that brings AWS LakeFormation , is the capabilities to control fine-grained privilege on GlueTable ( like GRANT at column level) and s3 location with course-grained Permissions. So far to enable use case around fine grained i think we need 3 ressources:

AWS::LakeFormation::DataLakeSettings ( config between IAM policy and LakeFormation policy)
AWS::LakeFormation::Permissions (represents the permissions that a principal has on catalog)
AWS::LakeFormation::Resource (represents the data (Amazon S3 buckets and folders)

BR

[gmazelier]

Here is a proposal to support Lake Formation settings (admins configuration), resources (de/register data locations) and permissions. Feedbacks are welcome!

[tomaszdudek7]

Any ETA?

[packetlag]

bump for an update, please

[ewbankkit]

@packetlag This has been added to the August - October 2020 Roadmap. Thanks.

[peramnaveen29]

14411

I guess it is related with the current AWS Lake Formation enhancement

[theophilechevalier]

Hi @ewbankkit,
I'm willing to finish the implementation but there are already numerous open pull requests on this matter. Can you plan a review so we can fix what's missing? We're a lot to need this feature

[roberth-k]

Resource Links (https://github.com/terraform-providers/terraform-provider-aws/issues/15296) and CreateTableDefaultPermissions (https://github.com/terraform-providers/terraform-provider-aws/issues/14411) should be implemented as part of this epic, as they are essential for accessing cross-account Lake Formation resources using Athena and Redshift Spectrum.