Apptio for All

Apptio for All

A place for Apptio product users to learn, connect, share and grow together.

 View Only

ETBMA Case Study: End to End Data processing automation

By Apptio Community Member posted Wed January 06, 2021 06:21 PM

  

This is the story of how successfully we were able to utilize Apptio’s Data processing capabilities and achieve end-to-end automation, right from directly sourcing the huge data from various type of Source systems via Data connectors and handling the complex Business logics & Data profiling steps in Apptio’s ‘Transform Pipeline’. The need to explore these options in Apptio came in when Finance Team came up with a request to close their month-end process by 3rd week of every month instead of 5th. With the same number of files to process but with a quicker turnaround was a challenge for our team. We were left with no option other than to adopt automation in order to maintain the same level of Data Integrity.

Able to accomplish end-to-end Data upload automation via Data Connectors and leveraging Apptio Data transformation capabilities.

The automation approach was basically divided into 2 steps. 1st step was to automate the Data feed sourcing directly from Source system into Apptio Data tables via Data connectors and 2nd step was to understand how to handle complex Business logics in Apptio.

                As part of 1st step, we started exploring different types of Data connectors in Apptio and for our understanding, we set up meetings with our Apptio CRM and went through TBM Council documents. As TBMS Data Support Lead, I acted as a liaison between Source Owners and Apptio support team to understand and resolve connectivity issues, if any. We were successfully able to establish connections with our 8 Source systems and pull Data into Apptio Data tables via Data connector execution. The type of connectivity used were direct connectivity with Source system’s Prod Database, AWS API and SFTP Server. 26 Data connectors were created, scheduled as per the Data calendar and Email notification were enabled to track success or failure of connector’s execution.

                In order to achieve end-to-end automation, just automating the Data upload was not enough. It was also essential to make sure all the Business logics are handled properly and making sure Cost Model is not breaking down due to Data level changes at Source end. This is where the ‘Transform pipeline’ magic comes in. It supports all kinds of functions to handle complex Data transformation steps, sequence those steps in the order they need to be applied and track any Data level changes in form of proper error messages.

With the successful implementation of the automation, we were able to meet the Finance team’s requirement for quicker month-end close process without sacrificing on the quality of support. This was all possible with the in-built Apptio features and timely support from Apptio team. Last but not the least, Apptio Data connectors support wide range of connectivity options which makes it easy to incorporate New Source systems into Apptio.

@Debbie Hagen
@Jenny Franklin
@Rhonda Keller
@Srikanth Tiruvuri
@Usha Shrestha
@Jeff Ng
@Jenny Goodwin


#adoption







ETBMA_Case_Study_Pinaki_Dutta.pdf

​​​​​​​​​​​​​​​​​​​

#ApptioforAll
7 comments
2 views

Permalink

https://community.ibm.com/community/user/blogs/apptio-community-member/2021/01/06/etbma-case-study-end-to-end-data-processing-automation

Comments

Apptio Community Member
Thu January 21, 2021 12:40 AM

Awesome!
#ApptioforAll

Apptio Community Member
Tue January 12, 2021 07:03 PM

Thank you Usha, Clare, Prasanna and Richard. I am glad you liked it.
#ApptioforAll

Richard Coronado
Tue January 12, 2021 05:16 PM

Awesome!
#ApptioforAll

Apptio Community Member
Tue January 12, 2021 11:21 AM

Good One Pinaki
#ApptioforAll

Apptio Community Member
Tue January 12, 2021 08:16 AM

This is great @Pinaki Dutta! Well done!​
#ApptioforAll

Apptio Community Member
Sun January 10, 2021 10:05 PM

GREAT Case Study Pinaki. Loved the graphics/examples and presentation on telling your story.

 CONGRATULATIONS and kudos on job well done!!!​​​​
#ApptioforAll

Jenny Franklin
Thu January 07, 2021 08:57 AM

@Jenny Goodwin :-)​​
#ApptioforAll