Aws-sdk-java-v2: Automatic Request Batching

Created on 19 Sep 2017  路  2Comments  路  Source: aws/aws-sdk-java-v2

Batch write operations are a common use case across many AWS services. There is opportunity to improve the developer experience in regards to these style operations. As mentioned in https://github.com/aws/aws-sdk-java/issues/1162, one idea is to expose an interface that takes an iterable or stream of results and a batch size and automatically chunks that into a batch write request and makes multiple calls until the iterable/stream is completed. Another potential idea is to automatically retry failed items in batches using the retry policy of the client.

2.0 New feature-request

Most helpful comment

Hi,

I just wanted to know if there are any news regarding the AmazonSQSBufferedAsyncClient? I'm currently working on upgrading Spring Cloud AWS to the new SDK and it relies on this class (s. https://github.com/spring-cloud/spring-cloud-aws/issues/267).

Thanks!

All 2 comments

Per comments from @Wogan in the gitter channel.

@shorea ideally the interface would expose the successful and failed methods so I could have generic code that can inspect a batch response and ensure it was entirely successful or not
also a lot of the BatchEntry classes are extremely similar so simple logging handlers on errors could be written generically

Hi,

I just wanted to know if there are any news regarding the AmazonSQSBufferedAsyncClient? I'm currently working on upgrading Spring Cloud AWS to the new SDK and it relies on this class (s. https://github.com/spring-cloud/spring-cloud-aws/issues/267).

Thanks!

Was this page helpful?
0 / 5 - 0 ratings