Posted On: Mar 5, 2021
Amazon EMR now supports instance fleets: a new way to provision clusters in AWS GovCloud (US) Regions. Instead of specifying an Amazon EC2 availability zone for your Amazon EMR cluster and an Amazon EC2 instance type for an Amazon EMR instance group, you can now provide a list of availability zones and instances, and Amazon EMR will automatically select an optimal combination based on cost and availability.
You can specify up to five EC2 instance types for core nodes and five instance types for task nodes. This allows you to diversify your capacity requests for both Spot and On-Demand Instances. You can further improve capacity provisioning by choosing allocation strategy in instance fleet. Allocation strategy uses real-time capacity data to allocate Spot Instances from the most available Spot Instance pools and picks the lowest-priced On-Demand Instances from your list. This helps you get the best prices for both Spot and On-Demand Instances while reducing Spot interruptions. By using allocation strategy, you can also increase diversification by specifying up to 15 instance types for task nodes.
Instance fleet is available on Amazon EMR version 4.8.0 and later, excluding 5.0.0 and 5.0.3. Allocation strategy is available in Amazon EMR version 5.12.1 and later. Please read the Amazon EMR instance fleet documentation for more information.
AWS GovCloud (US) is Amazon's isolated cloud infrastructure and services designed to address specific regulatory and compliance requirements of US Government agencies, as well as contractors, educational institutions, and other US customers that run sensitive workloads in the cloud. Visit AWS GovCloud (US) homepage to learn more about these regions.