Turbonomic

Hi All

Turbonomic supports AWS EC2 and EKS.

Any recommendations or suggestions on how we can use Turbonomic to manage a AWS EMR cluster. Configurations, use of tags etc.

Thank you

Andre

Some more context - Turbo does not inherently recognize this particular type of device (EMR Cluster).

In effect it sees a list of instances that can be optimized. Without scaling these devices concurrently/consistently, the cluster will essentially fail.

You can create a group of these instances , identify them by tagging, naming convention, etc.
Then create an automation policy scoped to that group and set Scaling Constraint "Enable Consistent Resizing" to enabled

per Turbo Documentation - When you create a policy for a group of VMs and turn on Consistent Resizing, Turbonomic resizes all the group members to the same size, such that they all support the top utilization of each resource commodity in the group. 

You can use Consistent Resizing to address this use case.

First create a group by identifying the EMR Cluster instances by tagging, naming convention, etc.

Then create an automation policy, scoped to that group, and set the Scaling Constraint "Enable Consistent Resizing" to true

Consistent Resizing for User-defined Automation Policies When you create a policy for a group of VMs and turn on Consistent Resizing, Turbonomic resizes all the group members to the same size, such that they all support the top utilization of each resource commodity in the group.

------------------------------
Danisue Gilpin
------------------------------

Hi Andre,

You can try leveraging the "Consistent Scaling" policy to ensure that Turbo suggests scaling all EMR instances to the same instance type based on their collective utilization.

1. Go to Settings > Policies > New Policy > Automation Policy (don't worry, we're not configuration any automation, just making an Operational policy to change Turbo's analysis.)
2. In Scope, select/create a group that represents the EMR instances you want to scale together. You can create dynamic groups that match certain criteria, like a naming convention, tag, etc. Or can create a static group where you manually select the instance types.
3. In "Scaling Constraints", select "Enable Consistent Resizing" and switch on (green). 
4. Save Policy
5. After 10-20 minutes you should see all the EMR instances in your group scaling to the same instance type.

Let me know if that helps.

------------------------------
Anson McCook
------------------------------