DataStage - Data Integration

 View Only
Expand all | Collapse all

DataStage Access to System z Legacy Data (VSAM, Physical Sequential)

  • 1.  DataStage Access to System z Legacy Data (VSAM, Physical Sequential)

    IBM Champion
    Posted Sun February 20, 2022 09:28 AM
    Team,
    I am working on a project to regularly process terabytes of legacy System z (mainframe) data (e.g. VSAM, Physical Sequential)) with DataStage. DataStage will be co-located on System z running in z/Linux. Communications between z/OS and z/Linux will be via HiperSockets.

    For Physical Sequential (PS) datasets we plan to use the Linux zdsfs command to mount z/OS DASD for direct read by the Sequential File Stage. The zdsfs approach comes with some limitations:
    • an individual file can't span a z/OS volume
    • z/OS catalog services and auditing (security) mechanisms are bypassed

    For VSAM datasets we plan to use the Complex File Format (CFF) Stage. It appears from the documentation that the VSAM can't be natively read with CFF from DataStage. Even with HiperSockets, copying terabytes of data via FTP from z/OS to z/Linux creates a lot of data movement and will require vast amounts of z/Linux persistent storage.

    I am writing to perform a sanity check that this is the best approach this challenge.

    TIA,

    Frank



    ------------------------------
    Frank Fillmore
    ------------------------------


  • 2.  RE: DataStage Access to System z Legacy Data (VSAM, Physical Sequential)

    Posted Tue February 22, 2022 07:56 AM
    for z/os files, what has worked for us in the past has been IBM connect:direct
    https://www.ibm.com/docs/en/connect-direct/6.0.0?topic=overview-what-is-connectdirect

    ------------------------------
    Gregory Pochodaj
    ------------------------------