Aws-cdk: Support for Dynamic StepFunction Dynamic Batching with Map and Iterator

Created on 18 Sep 2019  路  4Comments  路  Source: aws/aws-cdk

In regards to this blog post: https://aws.amazon.com/blogs/aws/new-step-functions-support-for-dynamic-parallelism/ - AWS StepFunctions now support Dynamic Parallelism (released publicly today AFAICT). Here is the relevant section in the state-languages spec: https://states-language.net/spec.html#map-state

Like Task, and Parallel, I believe this would be a new Construct, with an IChainable interface for Map and Iterator

Use Case

I would like to use this in an in-development project that's already taking advantage of aws-cdk to create a workflow with stepfunctions. I'm currently iterating on payloads that can be executed in parallel, dynamically. I've steered away from trying to manage the state around a StateMachineFragment, but could go down that path until aws-cdk includes the aformentioned constructs.

Proposed Solution

Implement Map and Iterator constructs. (More is likely needed).

Other

supporting links:

  • [x] :wave: I may be able to implement this feature request
  • [ ] :warning: This feature might incur a breaking change

This is a :rocket: Feature Request

@aws-cdaws-stepfunctions feature-request in-progress

Most helpful comment

4145 Should not work as there is a problem in the validation, I have produced the issue with a unit test that performs a synth

I have a fix, PR will be created in an hour

All 4 comments

Duplicate created #4154.
@rhboyd Work in progress PR #4153

now refs #4145

i believe this can be closed with #4145 getting merged

4145 Should not work as there is a problem in the validation, I have produced the issue with a unit test that performs a synth

I have a fix, PR will be created in an hour

Was this page helpful?
0 / 5 - 0 ratings

Related issues

artyom-melnikov picture artyom-melnikov  路  3Comments

peterdeme picture peterdeme  路  3Comments

pepastach picture pepastach  路  3Comments

sudoforge picture sudoforge  路  3Comments

ababra picture ababra  路  3Comments