Machine: fallback if Spot request cannot be fullfilled

Created on 9 Oct 2018 · 8Comments · Source: docker/machine

We are facing quite often that AWS is not able to fullfill the spot request - leaving the setup in a broken state.

Status: capacity-not-available: There is no Spot capacity available that matches your request.

Now docker-machine should but does not provide a logic to fall back to on-demand instances in that case.

Please consider this feature as it renders spotting impossible to use in production grade systems

Source

universam1

👍17

Most helpful comment

There's also the ability to use aws fleet: a list of machine types (m4, m5) with a bid price and have one of this instance type if one is not available.
--machine-machine-options "amazonec2-instance-type=m4.2xlarge,m5.2xlarge"` for example.

Adriks976 on 17 Dec 2018

👍5 👎1

All 8 comments

Would love to see such a feature - spot instances could be used for much more use cases

dhohengassner on 10 Oct 2018

Facing same issue. Would be a cool enhancement!

icereed on 12 Oct 2018

+1 - Have the exact same use case. Would be very helpful.

buholzer on 23 Oct 2018

Adriks976 on 17 Dec 2018

👍5 👎1

@Adriks976 Can you please shed more insight how you are able to make that work?
On my setup this is creating following error:

Invalid value 't3.large,t3.medium' for InstanceType....

universam1 on 31 Jan 2019

No I was suggesting to have this feature with a list of instance type. There’s no way for now to handle this. Let’s hope that docker machine will soon deal with this feature.

Adriks976 on 31 Jan 2019

👍2

A proper EC2 Spotfleet is actually a spotfleet request ID: sfr-XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX Which corresponds to a Spotfleet, which dictates VPC, subnet, IAM role etc and instance types.

You can even mix and match on-demand and spot in the same fleet, it would solve this original issue's problem of exhausted spot-instances. (Or try to anyway)

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.html

fransgidlof on 26 Mar 2019

👍1

You can even mix and match on-demand and spot in the same fleet, it would solve this original issue's problem of exhausted spot-instances. (Or try to anyway)

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.html