Cloud Pak for Data

Cloud Pak for Data

Come for answers. Stay for best practices. All we’re missing is you.

 View Only
Expand all | Collapse all

File Transfer Architecture using DataStage NextGen & Cloudpak for Data

  • 1.  File Transfer Architecture using DataStage NextGen & Cloudpak for Data

    Posted Wed October 15, 2025 10:24 PM

    We have a unique situation. A DataStage Job creates any files sent to applications external to the CP4D cluster in a particular folder on Server A.  The second job takes the files from Server A and transfers them via SFTP to the DB Server for further processing. This is a legacy process that we are trying to lift and shift to CP4D.

    Is this process something that can be achieved using DataStage on the CP4D cluster? What would be the best way to get the file to the DBServer?



    ------------------------------
    Ravindra Harve
    ------------------------------


  • 2.  RE: File Transfer Architecture using DataStage NextGen & Cloudpak for Data

    Posted Thu October 16, 2025 01:25 AM

    Hi

    Why you still want to do it with so many steps when it can be loaded directly into DB using DataStage?

    To answer your question.

    • Mount the NFS in CPD as Storage Volume (See this documentation)
    • Mount the NFS directly in DataStage pod (See this documentation)


    ------------------------------
    HOW MING (Felix) YONG
    Senior Data & AI Technical Specialist - Information Architecture
    IBM
    Melbourne
    ------------------------------