Aws-cli: Feature: Add option for "sync" command to use S3 Inventory manifest.json file

[robolmos]

For the "sync" command operating with a local source path to a S3 bucket, such as "aws sync . s3://example-bucket", please add the ability to specify a path to an S3 Inventory manifest file.

For example: aws sync --inventory-manifest=s3://example-bucket/destination-prefix/source-bucket/config-ID/YYYY-MM-DDTHH-MMZ/manifest.json . s3://example-bucket

With the option present, the sync command will retrieve the Inventory list, uncompress, compare the local filesystem's files to the Inventory file, and sync the files as normal to the S3 bucket.

This benefit of this is the sync command will avoid having to run synchronous S3 API List operations for the comparisons and should result in significant sync speed up and cost reductions.

[kyleknap]

Marking as a feature request. I think this would be useful as well.

[kwent]

Facing the same issue.

But i would love to be able to sync between two remote buckets and specifying a manifest file of what keys to copy.

[ASayre]

Good Morning!

We're closing this issue here on GitHub, as part of our migration to UserVoice for feature requests involving the AWS CLI.

This will let us get the most important features to you, by making it easier to search for and show support for the features you care the most about, without diluting the conversation with bug reports.

As a quick UserVoice primer (if not already familiar): after an idea is posted, people can vote on the ideas, and the product team will be responding directly to the most popular suggestions.

We’ve imported existing feature requests from GitHub - Search for this issue there!

And don't worry, this issue will still exist on GitHub for posterity's sake. As it’s a text-only import of the original post into UserVoice, we’ll still be keeping in mind the comments and discussion that already exist here on the GitHub issue.

GitHub will remain the channel for reporting bugs.

Once again, this issue can now be found by searching for the title on: https://aws.uservoice.com/forums/598381-aws-command-line-interface

-The AWS SDKs & Tools Team

[jamesls]

Based on community feedback, we have decided to return feature requests to GitHub issues.