eG Monitoring
 

Measures reported by AWSEC2SpotFletTest

AWS Spot instances are spare EC2 instances that you can bid on. These spot instances run whenever capacity is available and the maximum price per hour for your request exceeds the Spot price. This means that if EC2's capacity declines or the maximum price drops, spot instances may be terminated. To automatically replenish these instances and maintain your target capacity, you can use EC2 Spot fleets.

A Spot Fleet is a collection, or fleet, of Spot Instances that is launched based on criteria that you specify when placing a Spot Fleet Request. A typical Spot Fleet Request specifies the number of instances required (target capacity) or the performance characteristics (eg., vCPUs, memory, storage, etc.) you require for your application workload, the instance types, the availability zones, and the maximum price you are willing to pay for the instances. The Spot Fleet then attempts to launch the number of Spot Instances that are required to meet the target capacity that you specified in the Spot Fleet request. Spot Instances can also be terminated if any interruptions occur due to an increase in Spot price over maximum price, an increase in demand for Spot instances, or a decrease in supply of Spot instances.

By keeping tabs on each of the Spot Fleets, administrators can quickly identify those Spot Fleets that are unable to maintain the target capacity requested. Such Spot Fleet requests could be candidates for modification. Administrators should also keep an eye out for those Spot Fleets in which too many spot instances are being terminated owing to interruptions; this can reveal if the interruptions could be the reason for the wide gap (if any) between the target and allocated capacity of the Spot Fleet. The AWS EC2 Spot Fleet Test provides administrators with these useful insights, so that they can change their Spot Fleet requests (if required and possible) to maximize availability of their applications and minimize the cost of their application workload!

This test automatically discovers the Spot Fleet requests and reports the target capacity, fulfilled capacity, and pending capacity of each request. In the process, the test reveals those requests for which EC2 is unable to achieve / maintain the requested capacity. The test also reports the count of instance pools that are included in Spot Fleet requests and the number of pools that are actually eligible for fulfilling these requests. This way, the test points to those Spot Fleets with very few eligible instance pools to launch instances from. The corresponding Spot Fleet request can be scrutinized to understand the reason for the same, and modified (if required). Additionally, the test alerts administrators if many instances launched in response to a Spot Fleet request are terminating, so that they can investigate what is causing the termination.

Optionally, you can configure the test to report metrics for each instance type or Availability Zone included in the Spot Fleet requests. This analysis will help administrators further fine-tune their Spot Fleet request specifications.

Outputs of the test : One set of results for each Spot Fleet request / Instance type / Availability Zone.

First-level descriptor: AWS Region

Second-level descriptor: Spot Fleet request / Instance type / Availability Zone, depending upon the option chosen from the EC2SPOT FILTER NAME.

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
Avail_Instance By default, this measure reports the number of instance pools that are included in this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instance pools of this instance type, included across Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instance pools in this Availability zone, included across Spot Fleet requests.
Number  
Bids_Capacity By default, this measure reports the number of bids that have been made for the target capacity of this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of bids that have been made for instances of this type, across all Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of bids that have been made for instances in this Availability Zone, across all Spot Fleet requests.
Number  
Eligible_instance By default, this measure reports the count of instance pools that are eligible for fulfilling this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instance pools with instances of this type that are eligible for fulfilling one/more Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instance pools in this Availability Zone that are eligible for fulfilling one/more Spot Fleet requests.
KB A pool is ineligible when either (1) The Spot price is higher than the On-Demand price or (2) the maximum price/bid price is lower than the Spot price.

If only few instance pools are eligible for a Spot Fleet request, you may want to review that Spot Fleet request to see if the maximum price quoted therein needs to be changed.
Full_Capacity By default, this measure reports the number of instances that have been launched in fulfillment of this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instances of this type that have been launched in fulfillment of one/more Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instances that have been launched from this Availability Zone in fulfillment of one/more Spot Fleet requests.
Number Ideally, the value of this measure should be equal to the value of the Target capacity measure for a request. A very low value indicates that the target capacity of the request is yet to be achieved.
Max_Capacity By default, this measure reports the maximum value of the Allocated capacity measure across all Spot Instance pools specified in this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the maximum value of the Allocated capacity measure across Spot Instance pools with instances of this type.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the maximum value of the Allocated capacity measure across Spot Instance pools with instances of in this Availability Zone.
Percent  
Pending_Capacity By default, this measure reports the number of instances that are still to be launched to fulfill the target capacity of the Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instances of this type that are still to be launched against the target capacity across all Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instances that are still to be launched from this Availability Zone against the target capacity across Spot Fleet requests.
Number Ideally, the value of this measure should be low for a request.
Capacity_Allocatn By default, this measure reports the percentage of the target capacity of this Spot Fleet request that has been fulfilled.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the percentage of the target capacity across all Spot Fleet requests that has been fulfilled by instances of this type.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the percentage of the target capacity across Spot Fleet requests that has been fulfilled by instances in this Availability Zone.
Percent Ideally, the value of this measure should be 100% for a request. A very low value indicates non-fulfillment of the target capacity of that request. You may want to take another look at that Spot Fleet request to determine whether/not the specifications of the request need to be changed to ensure that the target capacity is achieved.
Target_Capacity By default, this measure reports the target capacity of this Spot Fleet request.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instances of this type that are part of the target capacity across Spot Fleet requests.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instances in this Availability Zone that are part of target capacity across Spot Fleet requests.
Number  
Terminat_Capacity By default, this measure reports the number of instances that have been terminated in this Spot Fleet owing to interruptions.

If the EC2SPOT FILTER NAME is set to InstanceType, then this measure will represent the number of instances of this type that have been terminated across Spot Fleets, because of interruptions.

If the EC2SPOT FILTER NAME is set to AvailabilityZone, then this measure will represent the number of instances in this Availability Zone that have been terminated across Spot Fleets, owing to interruptions.
Number When you use Spot Instances, you must be prepared for interruptions. Amazon EC2 can interrupt your Spot Instance when the Spot price exceeds your maximum price, when the demand for Spot Instances rises, or when the supply of Spot Instances decreases.

If the value of this measure is very high for a request, you may want to figure out what caused the interruption. If it is because the max price is lower than spot price, then see if you can modify the maximum price of that request.