Platform

Platform

 View Only

Integrate Cloudability Cost Data into TBM Studio 

Tue March 24, 2020 10:43 PM

 Applies to: Cost Transparency, Bill of IT, and Hybrid Business Management on TBM Studio 12.8.3 and later

 

Cloudability cost data can be integrated with other cost data in other Apptio applications, such as Cost Transparency, Hybrid Business Management, and Bill of IT. The integration simplifies setup and maintenance by providing a single point of connecting cloud providers across all Apptio applications.

 

Step 1 - Initiate the integration and set up the Datalink Cloudability connector

To initiate the integration process and set up the Datalink Cloudabiity connector, see the Datalink Cloudability Connector Guide. This step is required before you can proceed with Step 2. 

 

Step 2 - Set up TBM Studio to ingest Cloudability data

After the Datalink Cloudability connector is set up, use the following the steps to integrate Cloudability-sourced cloud billing data into TBM Studio.

 

NOTEATUM 3.0 columns are mapped by default. Versions 2.0 and 2.1 can be configured, but you must first file a support ticket.  ATUM 1.0 is not supported. 

  1. Use Apptio's Datalink Cloudability connector to load Cloudability data. See the Datalink Cloudability Connector Guide.
    NOTE:  CTF- Cloud component creates separate table each of the cloud providers connected to Cloudability. These are under Cloudability group:
    • For AWS: cldy_monthly_aws
    • For Azure: cldy_monthly_azure
    • For GCP: cldy_monthly_gcp
  2. The three tables are appended in “CLDY Transform Master Data”, check it out and ensure all the required fields are getting appended.
    NOTE: “Row Id” field is unique identifier, add more fields if required to make it unique
  3. Check out the Cloud Service Provider Master Data table, and remove all appends.
  4. Update the first formula step to the following formula:
    • CUR Allocation Filter =0
  5. Clear the formulas in the following columns in the first Formulas step:
    • Instance Type
    • Platform
    • Service Category
    • Service Name
    • Service Type
    • Tower
    • Subtower
    • Type
    • Unit
  6. Delete the following columns in the first formula step:
    • Instance Type Lookup
    • Service Category Lookup
    • Service Name Lookup
    • Service Type Lookup
    • Subtower Lookup
    • Tower Lookup
    • Type Lookup
    • Unit Lookup
  7. (Optional) The following columns aren't required for the integration, but consider removing them from the Cloud Service Provider Master Data table to improve performance; otherwise, skip to the next step:
    • From the first Formulas step:
      • Amortized Reserved Instance_Cloud Key
      • Azure Preprocessed Data Loaded
      • Cash-Based Reserved Instance_Cloud Key
      • All “Completeness” columns
      • CUR Blended Reserved Instance_Cloud Key
      • CUR Loaded
      • Primary Unit of Measure
      • Primary Usage Qty
      • Region Code
      • RI Allocation Filter
      • Reserved Instance Weighing
      • All “Validity” columns
    • From the second Formulas step:
      • Reserved Instance_Cloud Key
      • All “Validity” columns
  8. In the Append step, append CLDY Transform Master Data table into the Cloud Service Provider Master Data table with the following mappings:
    • Application =<desired Application dynamic field, if any, otherwise leave blank>
    • Business Unit=<desired Business Unit dynamic field, if any, otherwise leave blank>
    • Cost =<desired Cost column> OR Base Currency Total Cost if cost is non-USD
    • Environment =<desired Environment dynamic field, if any, otherwise leave blank>
    • Instance Type =Instance Type
    • Invoice Amount =Cost
    • IsSharedService =”NO”
    • IS CLDY = “Yes”
    • Location =<Availability Zone or Region>
    • Platform =Platform
    • Product =Product
    • ProductCode =Product Code
    • Provider =Provider
    • Provider Region =Region
    • Purpose =<desired Purpose dynamic field, if any, otherwise leave blank>
    • RecordID =Row ID
    • Service Category =Service Category
    • Service Name =Service Name
    • Service Type =Service Type
    • Subtower =SubTower
    • Tower =Tower
    • UID Metafield =Row ID
    • Unit =Unit
    • Usage Qty =Effective UsageQuantity
  9. Check out the Servers Master Data table.
  10. On the append from the Cloud Servers Transform, update the following column:
    • OID Metafield = ITRT_Cloud_Resource_Key Metafield}&&RecordID
  11. Validate and update allocation strategies as needed.
  12. Check in your changes.

The Apptio preprocessor will now import Cloudability data and create grouped files with ATUM mappings and specified dynamic fields (if provided) in Apptio S3.

 


#Datalink

Statistics
0 Favorited
12 Views
0 Files
0 Shares
0 Downloads

Comments

Mon January 29, 2024 12:37 AM

Hi @Punya Nair do you have anyone that provided additional information on the implementation of Reserved Instances Object after this was implemented?

@Jenny Franklin Know of RI configuration helper article?


#Datalink

Wed April 28, 2021 03:50 PM

Huh.  The reason we're doing this is bc our CT reports don't match what's in CLDY and vice versa, so trying to get those aligned.  Been working with Kate and thinking we may be closer.  Hope to get back to it again soon - this week's been a bit of a dumpster fire lol..
#Datalink

Wed April 28, 2021 02:50 PM

The data that is coming from Cloudability is not designed to support the public cloud reports/project.  It is designed to be appended into the Cloud Service Provider data as a way to allocate costs up the Cost Model.  Is there something you were trying to allocate that is not part of your tags/business dimensions?
#Datalink

Wed April 21, 2021 09:13 AM

Trying to understand why the data points in the old data aren't available with the new - didn't cover that in the instructions.  Some of that data is needed in the allocations.  Digging to see how the old was used and will see about how to request data that's no longer coming through.  Thanks much!
#Datalink

Tue April 20, 2021 09:52 PM

Jenny. In step one you can add columns to the data export using business mappings, business metrics, tags, and account groups. You just need to identify which ones to bring in. The instructions show you how to add and request.
#Datalink

Tue April 20, 2021 11:09 AM

@Justin Kean TY TY TY!! 😊😊​
#Datalink

Tue April 20, 2021 10:59 AM

Heya @Jenny Franklin! 

I'm not entirely sure of the answer to your question, but I'm bumping it along the chain so we can make sure to get you an answer.  I appreciate your patience while we figure this out for you.

Thanks!​
#Datalink

Tue April 20, 2021 10:09 AM

Annnnd adding @Justin Kean, too 😁😁​
#Datalink

Mon April 19, 2021 06:05 PM

Pinging @Phillip Purcell in case he has info on this as well 😁😎​
#Datalink

Mon April 19, 2021 06:02 PM

@Apptio User Assistance is there someone who could assist with this?  We're trying to pull CLDY data into CT, but missing some of the data points when switching from the old CAR/CUR way.  For instance, when the data is pulled in, Item and Procedure are BLANK.  We used 'Service Attribute Lookup' (=ProductCode&Item&Procedure) previously to look up against Cloud Service Attributes and Cloud Service Provider Lookup to pull back CPU Cores, Memory Capacity, Primary Usage Qty, and Storage Capacity (GB).  Not seeing how to do that using these instructions and not finding that in the new data we're pulling back.  Any help is greatly appreciated - thank you!
#Datalink