Aws-parallelcluster: Initiating cluster creation without blocking

[calebwin]

Is it possible to start the process of cluster creation/deletion/updating (by calling one of the pcluster CLI commands) without waiting for it to finish.

To give context, we're trying to use pcluster from Lambda but are concerned that cluster-related commands may take longer than the 15 minute limit on Lambda execution time. So we're wondering - can we start cluster creation, end the Lambda function, and then submit new Lambda functions that poll for the cluster-related command to complete using pcluster status? If yes, how long should we wait after issuing a pcluster create or pcluster delete before exiting?

[demartinofra]

Hi Caleb,

you can use the -nw, --nowait option when running create/delete/update and then poll the status with a pcluster status --nowait when needed.

[enrico-usai]

Caleb, in addition to Francesco's comment, if you're using pcluster from Lambda this blog post might be interesting for you.

[calebwin]

Hi @enrico-usai,

Sorry for the late response. This is great to know and should work perfectly for our use-case! Thank you.

[github-actions[bot]]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.