AWS Services Mapping

 View Only

AWS Services Mapping 

Fri August 28, 2015 12:21 PM

Applies to: Cloud for Cost Transparency and Cloud Business Management on TBM Studio 12.5.x

In this article:

Overview

Apptio's CBM and AWS DataLink connectors allow you to map billing line items from your cloud provider billing line items to ATUM attributes, including IT Towers and Subtowers, the TBM Services hierarchy, as well as a normalized unit of measure. These mappings allow you to do the following:

  • Analyze various cloud services across multiple providers using a common classification of cloud services
  • View cost, consumption, and unit costs for all public cloud services in a like manner across multiple providers
  • Automatically allocate cloud costs into the appropriate IT Resource Towers

 

Mapping updates

Because cloud providers consistently and rapidly update their service offerings, the mappings created and maintained by Apptio can become out-of-date. To address this dynamic environment, Apptio updates the mapping files monthly. The action you need to take depends on whether you use the Multicloud Connector:

  • Multicloud ConnectorTO BE DEPRECATED - please use the Cloudability CDI connector.    Old text: To automate the ingestion of cloud billing, ATUM mapping is performed in the Apptio cloud billing pre-processor. The mapping files live in a central location and mapping occurs before the bill makes it into the customer CBM environment. If ATUM mapping gaps occur, no action on your part is necessary. Instead, Apptio identifies the gaps, fills them, then updates the mapping file to ensure that those gaps are eliminated from your environment. 
  • AWS Connector. DEPRECATED - please use the Cloudability CDI connector.    Old text:If you use the legacy AWS Connector, ATUM mappings continue to take place in CBM via the Cloud Service Provider Lookup dataset, into which you need to append the AWS Service Mapping file. The mapping file can either be updated automatically via the AWS legacy connector or by manually overwriting the dataset with mapping file.
  • Cloudability CDI Connector - The Cloudability CDI connector performs the cloud service to TBM Taxonomy mapping as part of the workflow.  As such, the local file is not required for the mapping as designed in the original AWS Connector.  Beginning in April 2024, the AWS Cloud Mapping v3 TSV file will be uploaded to this site in case users want to verify the mappings used in the CDI/CCM mapping process.  


To update the mapping file: 

  1. Right-click on the file attachment below, then click Save Link (or Target) As.
  2. Navigate to the place where you want to save the file, then click Save.
  3. Unzip and open the .cvs file in a suitable application, such as Microsoft Excel.
  4. Select the file for the ATUM version you want.
  5. Log in to Apptio TBM Studio.
  6. In the Project Explorer, navigate to Tables > AWS Service Mapping.
  7. Check out the AWS Service Mapping file and overwrite it with the updated .csv file.

NOTE  The mapping file is updated frequently. Refer to this article for the most current content release. 

 

Mapping gaps

If you are an AWS user and you encounter mapping gaps, please email a list of those gaps to Apptio at cloudmapping@apptio.com. We will do our best to fill the gaps identified in the next mapping update release. For your email, please export and attache the ATUM Mapping Quality report (in the Maintenance report collection), and include the following information for every Cloud Service Provider line item with a blank Subtower field:

  • Provider
  • Product
  • Item
  • Procedure
  • Cost (optional, but helpful to understand impact of the gaps)

 

Automated mapping for ATUM 2.1 and 3.0 

As of April 2019, CBM was updated to support the automated mapping of cloud provider services to ATUM classifications. CBM can map public cloud provider services to ATUM 1.0, 2.0, 2.1, and 3.0, depending on your organization’s requirements. 

 

Change history 

The AWS Mapping Services files have been updated on the following dates. Apptio recommends that you click Action > Follow so you can be notified when newly updated mapping files are available.

Date ATUM v1.0 ATUM v2.0 Update 
4/22/2024 NA NA

AWS cloud mappings to TBM Taxonomy v3 as of April 22, 2024. This is the source mapping file for the Cloudablity CDI/CCM process.

3/09/2024 v1.42 v2.32

Includes new entries for ATUM v1 and v2 and customer reported gaps through March 9, 2024

11/02/2023 v1.41 v2.31

Includes new entries for ATUM v1 and v2 and customer reported gaps through October 2023

08/31/2023 v1.40 v2.30

Includes new entries for ATUM v1 and v2 and customer reported gaps through August 2023

06/30/2022 v1.39 v2.29

Includes new entries for ATUM v1 and v2 and customer reported gaps through June 2022

03/10/2021 v1.38 v2.28

Includes new entries for ATUM v1 and v2 and customer reported gaps through Jan 2022

03/10/2021 v1.36 v2.26

Includes new entries for ATUM v1 and v2 and customer reported gaps for Feb 2021

02/10/2021 v1.35 v2.25

Includes new entries for ATUM v1 and v2 and customer reported gaps for Jan 2021

12/10/2020 v1.34 v2.24

Includes new entries for ATUM v1 and v2 and customer reported gaps thru Dec 2020

10/12/2020 v1.33 v2.23

Includes new entries for ATUM v1 and v2 and customer reported gaps as of Sep 2020

09/01/2020 v1.32 v2,22

Includes new entries for ATUM v1 and v2 and customer reported gaps as of Aug 2020

05/22/2020 v1.31 v2.21

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

04/23/2020 v1.30 v2.20

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

01/23/2020 v1.29 v2.19

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

11/15/2019 v1.28 v2.18

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

09/06/2019 v1.27 v.2.17

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

06/03/2019 v1.26 v2.14

Includes new entries for ATUM 1.0 and 2.0 and customer-reported gaps

04/24/2019 v1.25 v.2.13

Includes new entries for ATUM v1 and v2 and customer-reported gaps

 04/9/2019 v1.24 v.2.12

Includes new entries for ATUM v1 and v2

 02/15/2019 v1.23 v.2.11

Includes new entries for ATUM v1 and v2

12/4/2018 v1.22 v2.10

Includes new entries for ATUM v1 and v2

10/23/2018 v1.21 v2.9

Includes new entries for ATUM v1 and v2

08/28/2018 v1.20 v2.8

Includes additional spot instance entries and RI entries for R4 and R5 instance families

08/16/2018 v1.19 v2.07

Includes new entries for ATUM v1 & v2

07/12/2018 v1.18 v2.06

Includes new entries for ATUM v1 & v2

04/18/2018 v1.17 v2.05

Includes new entries for ATUM v1 & v2

03/16/2018 v1.16 v2.04

Includes new entries for ATUM v1 & v2

01/11/2018 v1.15 v2.03

Includes new entries for ATUM v1 & v2

12/13/2017 v1.14 v2.02

Includes new entries for ATUM v1 & v2

10/27/2017 v1.13 v2.01

Includes new entries for ATUM v1 & v2

Update missing mappings for ATUM v1

09/08/2017 v1.12 v2.0 Updated ATUM v1 mapping gaps
07/27/2017 v1.11 v2.0

Includes large amount of new entries based on known gaps and AWS Pricing API

ATUM v2 mapping included as additional file v2.0

05/15/2017 v1.10 Includes new entries based on AWS Pricing API content
03/13/2017 v1.9.1 Includes new entries based on AWS Pricing API content
01/19/2017 v1.9 Includes large amount of new entries based on AWS Pricing API content
v1.8 Includes new entries for known gaps
v1.7 Includes large amount of new entries based on AWS Pricing API content
10/06/2016 v1.6

Various sub-tower gaps  |  New AWS Pricing API content  |  Cleansed Subtowers and Units of Measure

Note on v1.6 - a new column, ProductCode, was added.  This new piece of data will not affect lookups and was added to support the mapping update process

v1.5.1 Includes large amount of new entries based on AWS Pricing API content

v1.5

 

Includes some new CloudSearch entries + a default support entry (where UsageType and Operation are blank in the bill)

v1.4

 

Includes a large number of new entries for new products and regions

 

This article is open for your feedback. At the bottom of this page, click Add a comment.


SEE ALSO
Azure Cloud Mapping Files
Google Cloud Mapping Files
HBM Updated Cloud Pricing reference list





#CostingStandard(CT-Foundation)

Statistics
0 Favorited
15 Views
3 Files
0 Shares
5 Downloads
​
Attachment(s)
zip file
3c4d17e5-b519-d89d-a6f0-3b9961cd48e6_file.zip   15.86 MB   1 version
Uploaded - Tue October 29, 2024
zip file
9ce50528-c094-70ca-8bf7-85de38d2563f_file.zip   17.21 MB   1 version
Uploaded - Tue October 29, 2024
zip file
b96bcf48-b6ce-0984-700e-742ec541f4c5_file.zip   15.94 MB   1 version
Uploaded - Tue October 29, 2024

Comments

Wed September 06, 2023 06:27 PM

@Kellan Huston @Jenny Franklin  

Last week, I used Windows embedded 7-Zip file to compress the large csv files.  Apparently, it is not compatible with other zip formats so I re-compressed the file today with Winzip.  Please retry and see if you can extract successfully as it should be a more compatible format.  


#CostingStandard(CT-Foundation)

Fri September 01, 2023 06:10 PM

Previously, if I just hit 'Extract All', I'd get the invalid error.  This time for grins, I tried this way, and it worked!  See the data now. :-) 


#CostingStandard(CT-Foundation)

Fri September 01, 2023 06:07 PM

Same as Kellan - getting "Compressed (zipped) Folder is invalid" :-(


#CostingStandard(CT-Foundation)

Fri September 01, 2023 04:48 PM

I attempted to download the zip files uploaded 9-1 and its saying the zip file is empty


#CostingStandard(CT-Foundation)

Mon August 28, 2023 01:05 AM

Is this still the latest thread to get latest mappings, the last update seems to be in June 2022?


#CostingStandard(CT-Foundation)

Wed February 10, 2021 07:28 PM

We will be updating the service mapping files by the 10th of each month.  
#CostingStandard(CT-Foundation)

Tue April 28, 2020 07:44 AM

Hi ~ yes, I'm all set.  It says published on April 23, but the zip file stated v2.19.  I received notification from this page that it was updated evening of April 24 and I loaded it yesterday.  Thank you for checking!


#CostingStandard(CT-Foundation)

Mon April 27, 2020 01:14 PM

Hmm, v2.20 was published on Apr 23rd. Can you recheck which version you see available to download?

I see "AWS_ATUM_Mappings-Apr2020.zip" and downloaded/unzipped to get "AWSServiceMappingv2_20.csv".

Let me know if you're still not getting the April update.

Thanks!


#CostingStandard(CT-Foundation)

Fri April 24, 2020 07:28 AM

Appears the zip file is still January's v2.19, when will v2.20 be available?


#CostingStandard(CT-Foundation)

Thu August 15, 2019 09:23 AM

Hey when is the next update to this file expected?


#CostingStandard(CT-Foundation)

Wed July 24, 2019 09:38 AM

Apologies for missing a notification in this thread... ATUM 3.0 is available.  Please see this What's New post for more information: https://tbmcouncil.jiveon.com/docs/DOC-11662


#CostingStandard(CT-Foundation)

Tue July 23, 2019 07:06 PM

@Randall Tennant any update as to when we can see an update for v3 service mapping?


#CostingStandard(CT-Foundation)

Thu May 09, 2019 04:30 PM

Been a while since the last update.  Any news on delivery of the ATUM 3.0 mapping? Thanks!


#CostingStandard(CT-Foundation)

Tue April 02, 2019 08:22 PM

Now that it's April 2nd, I can safely respond to Matt's comment... we are still planning to release support for cloud services mappings to ATUM v2.1 and 3.0 very soon.  We're currently integration testing and aim to release in the next couple of weeks.  Standby for more details.


#CostingStandard(CT-Foundation)

Tue April 02, 2019 07:51 PM

It would have been so funny to see ATUM v3 included in the April 1 update with a single entry saying, "April Fools!" 


#CostingStandard(CT-Foundation)

Wed March 20, 2019 05:41 PM

I just created a fresh Public Cloud project. Naturally, I'm now more eager to get my hands on the 3.0 services mapping. 


#CostingStandard(CT-Foundation)

Fri March 01, 2019 06:36 PM

Hi John... v1.22 should have a large number of new services and new pricing schemes that AWS has introduced since the last update.


#CostingStandard(CT-Foundation)

Fri March 01, 2019 06:34 PM

Hi Amanda... there are no plans to add the Services Hierarchy to ATUM v1.  That hierarchy was created as a part of ATUM v2.0 and, while we'll continue to update that hierarchy moving forward (as we have with v2.1 and 3.0 of ATUM), we do not plan to include it as part of v1.


#CostingStandard(CT-Foundation)

Fri March 01, 2019 06:33 PM

Hey Matt... support for ATUM 3.0 is slotted to be available at the end of this month (end of Q1).


#CostingStandard(CT-Foundation)

Fri February 22, 2019 04:55 PM

Looks like support for 3.0 will arrive EOQ1 or EOQ2.

 

Call me #eager! ;-)


#CostingStandard(CT-Foundation)

Thu February 14, 2019 11:01 PM

Randy, @Randall Tennant

 

I am not sure why v1.22 has been marked as new when this was loaded last year. Have you made corrections or was a new version meant to be loaded, as I can't see any obvious differences to the v1.22 loaded last year and this update.

 

Thanks,

 

John Feore


#CostingStandard(CT-Foundation)

Mon February 04, 2019 05:53 PM

Thu December 13, 2018 03:38 PM

Will the Platform, Service Type, Service Category and Service Name columns be added to the ATUM 1 version? Currently the out of the box logic does not work without them. @Randall Tennant @Andrew Lee


#CostingStandard(CT-Foundation)

Fri December 07, 2018 07:34 PM

When will the mapping reflect TBMv3 taxonomy?


#CostingStandard(CT-Foundation)

Fri December 07, 2018 01:08 PM

Thanks, Ankur... we will fix the problem and repost the mapping file.


#CostingStandard(CT-Foundation)

Fri December 07, 2018 12:35 PM

@Randall Tennant I saw some typo for the word Containers. In the Service Mapping file in column "Type" , There are values with 1) Containeers and 2) Containers. I believe Containers is the correct value for AWS Type of Service in this column . Please check and update this in the Service Mapping file.


#CostingStandard(CT-Foundation)

Tue November 20, 2018 03:22 PM

Will updates for ATUM v3 be published soon?


#CostingStandard(CT-Foundation)

Fri September 14, 2018 07:14 AM

good information on this page. Thank you


#CostingStandard(CT-Foundation)

Wed August 29, 2018 03:35 PM

TBM Connect keeps removing the word  in front of Storage


#CostingStandard(CT-Foundation)

Wed August 29, 2018 03:34 PM

Randy - 

Can you fix the sub-towers you have listed in the V1 files?   With ATUM v1 there are no such sub-towers called "Security" or " Storage".    I had to put logic in Apptio to change those but would prefer to clean up the mapping file. 

 

- Craig


#CostingStandard(CT-Foundation)

Thu March 08, 2018 03:24 PM

I take the following approach to lookup detail from the service mapping table:

 

  1. In the "Cloud Service Provider Lookup" table I ensure the following fields are present with the following formulas:
    Lookup = Item && Procedure && ProductCode
    Lookup Alt = Item && Procedure

    Return Value = Tower & "|" & SubTower & "|" & If(Instance Type="","NA",Instance Type) & "|" & Type & "|" & Unit

  2. In the "AWS Cost Allocation Bill Master Data" table...

    Instance Type Details Step 1 = Lookup(Lookup,Cloud Service Provider Lookup,Lookup,Return Value)
    Instance Type Details Step 2 = Lookup(Lookup Alt,Cloud Service Provider Lookup,Lookup Alt,Return Value)

 

Then, I analyze which of the Details returned (eg Step 1 vs Step 2) I want to use for values. For example...

 

Instance Type = If(Instance Type Details Step 1 IN ("","{Various}"),Split(Instance Type Details Step 2,3,"|"),Split(Instance Type Details Step 1,3,"|"))

 

Since I'm returning Tower, SubTower, Type, and Unit in the Return Value they, too, can be parsed to populate into the AWS (or Azure) tables appropriately.

 

I hope this helps other colleagues on their journey. :-)


#CostingStandard(CT-Foundation)

Thu March 08, 2018 02:59 PM

I identified 175+ additions needed for the service mapping. I submitted ticket 117881 to Support for your Apptio's review and subsequent update to this mapping. :-)


#CostingStandard(CT-Foundation)

Thu October 26, 2017 12:00 PM

Thank you, Dariusz... we have identified the issue of blank rows in the AWS Services Maping file and are currently fixing the issue.  We will publish a new version very soon, targeting the end of this week.


#CostingStandard(CT-Foundation)

Thu October 26, 2017 09:31 AM

I have noticed that the Sept 8th 2017 AWS Services Mapping has rows missing tower/sub-tower.  Does anyone know when the next update will be?


#CostingStandard(CT-Foundation)

Fri July 28, 2017 01:28 PM

Yes... the AWS mapping file was posted yesterday.  Please note that, for AWS, we have started posting an ATUM 2.0 mapping file as well - it includes updated mappings based on changes to IT Resource Towers and Subtowers as well as new ATUM Service Hierarchy attributes.  For more information on ATUM 1.0 vs. ATUM 2.0, please refer to the ATUM Knowledge Base on Community (ATUM Knowledge Base ).

 

Thanks!

-Randy


#CostingStandard(CT-Foundation)

Fri July 28, 2017 01:01 PM

Hi Randall, is the mapping for AWS already released this quarter? Thank you


#CostingStandard(CT-Foundation)

Fri May 26, 2017 12:57 PM

ATUM 2.0 services mapping for AWS will be released this quarter.  If you would like a preview of the AWS mapping, please respond to rtennant@apptio.com directly.  Thanks!


#CostingStandard(CT-Foundation)

Thu May 25, 2017 05:38 PM

@Randall Tennant is there a 2.0 for this one, too?


#CostingStandard(CT-Foundation)

Wed May 24, 2017 09:01 PM

Is there a mapping file reflective of ATUM v2?


#CostingStandard(CT-Foundation)