IBM Sterling Transformation Extender

Sterling Transformation Extender

Come for answers, stay for best practices. All we're missing is you.

 View Only
Expand all | Collapse all

How to Split a file with 1GB data into Multiple Files

  • 1.  How to Split a file with 1GB data into Multiple Files

    Posted Thu October 25, 2018 04:40 AM

    Originally posted by: carao2020


    Hi,

    Do we have any option of splitting the file into multiple files in ITX. The file size is ranging from 500MB to 2 GB and would like to split the file into multiple files of each having not more than 10MB.


    #DataExchange
    #IBMSterlingTransformationExtender
    #IBM-Websphere-Transformation-Extender


  • 2.  Re: How to Split a file with 1GB data into Multiple Files

    Posted Fri October 26, 2018 05:36 AM

    Originally posted by: PaulBrett


    You could use Control-Break logic to read the input into appropriately sized groups, and then output each of those groups as a sequentially named file.

    There are many examples of this in this developerWorks forum, such as : https://www.ibm.com/developerworks/community/forums/html/topic?id=7a6e5be1-7675-4775-b012-c06eaf3286b6&ps=25

    Thank you.

    Paul

    Follow me on Twitter


    #IBMSterlingTransformationExtender
    #IBM-Websphere-Transformation-Extender
    #DataExchange


  • 3.  Re: How to Split a file with 1GB data into Multiple Files

    Posted Fri October 26, 2018 05:45 AM

    Originally posted by: carao2020


    Hi Pual,

    Thank you very much. I am able to implement the logic in this way. I was trying to read the whole data as blob and split the data into chunks each containing fixed size. However, I am not able to do it  with single Text Item as a Text Item can have maximum size of 65535 Bytes.

     

    Finally I have added two Text Items whose total size is 100kB and increased the range to make each Chunk as 1MB Splitting the file for each chunk.

     

    Thanks once again.


    #IBMSterlingTransformationExtender
    #DataExchange
    #IBM-Websphere-Transformation-Extender