Platform

Platform

A place for Apptio product users to learn, connect, share and grow together.

 View Only
Expand all | Collapse all

Transform Pipeline vs. Traditional ETL Tools

  • 1.  Transform Pipeline vs. Traditional ETL Tools

    Posted Thu October 17, 2019 09:43 AM

    We're locked in an interesting debate about whether moving more of our integrations from DataStage to DataLink will cause problems because we're doing transformation in DataStage that DataLink doesn't do.   I'm trying to shift the conversation to help people understand the role of the Transform Pipeline versus the role of DataLink.

     

    However... I thought I should check and see whether or not anybody has found situations where they have to use an ETL Tool because they've found something that can't be handled in the Transform Pipeline.



    #TBMStudio


  • 2.  Re: Transform Pipeline vs. Traditional ETL Tools

    Posted Fri October 25, 2019 07:54 PM

    What types of transformations are being performed by DataStage?


    #TBMStudio


  • 3.  Re: Transform Pipeline vs. Traditional ETL Tools

    Posted Fri November 01, 2019 03:26 PM

    @Amin Amos that's the thing.  There isn't anything remotely sophisticated with our DataStage jobs today.  Rename columns, column formats, etc.   I know we aren't doing anything that the Transform Pipeline isn't capable of doing.  

     

    Was more curious whether anybody has encountered something that DataLink and the Transform Pipeline aren't capable of.  


    #TBMStudio