Cloud Pak for Data

 View Only
Expand all | Collapse all

Data Integration Tutorial - DataStage Flow Asset is not imported

  • 1.  Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Thu June 01, 2023 08:58 AM

    Hello,

    I am running into an issue when trying to go through the Data Integration Tutorial on the link below 

    Data fabric tutorials

    Ibm remove preview
    Data fabric tutorials
    Take data fabric tutorials to experience one or more of the use cases that combine to demonstrate how you can implement a data fabric solution with Cloud Pak for Data as a Service. The tutorials follow the story of Golden Bank, a leading mortgage provider, that needs to solve the challenges of data access, data quality, data governance, and managing data and AI lifecycles.
    View this on Ibm >

    It is the first tutorial about Data Integration ... 

    Data integration

    Provide access to all your data, without moving it.

    Scenario: Golden Bank needs a data pipeline that delivers concise, pre-processed, and up-to-date data on all mortgage applicants, so that lenders can make decisions.

    Integrate data
    Extract, filter, join, and transform your data. See instructions

    When you create a project from this example. The DataStage Flow asset does not get added to the project. Is there another way to get this asset added to the project? (The video in the See instructions link, at 2:32 in the video if you click on the "View import summary" you will see a Failure and the DataStage flow  with Failed to import Data Stage asset log.)

    Is there any way to get access to this DataStage flow asset?

    Thank You,

    Brent



    ------------------------------
    Brent Zeiben
    ------------------------------


  • 2.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Fri June 02, 2023 01:06 PM

    Thank you for contacting us, Brent. This issue was reported yesterday, and we are currently working on a resolution. I will post here when the issue is resolved.



    ------------------------------
    SHARYN RICHARD
    ------------------------------



  • 3.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Fri June 02, 2023 05:33 PM

    @Brent Zeiben - the issue is resolved. You should be able to create the sample project now and see the DataStage flow.



    ------------------------------
    SHARYN RICHARD
    ------------------------------



  • 4.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Mon June 03, 2024 01:34 PM

    Hello,

    It seems I encounter the same issue

    On my side the import of the DataStage flow failed with the message : "An unexpected error occurred of type Null pointer error: Cannot invoke "com.ibm.json.java.JSONObject.containsKey(java.lang.Object)" because "compilationJson" is null"



    ------------------------------
    Frederic Bargues
    ------------------------------



  • 5.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Tue June 04, 2024 10:38 AM

    Hi Frederic, I've asked development to look into this issue for you. I'll let you know when I have an update.



    ------------------------------
    SHARYN RICHARD
    ------------------------------



  • 6.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Wed June 05, 2024 12:19 PM

    Hi Frederic. The issue should be resolved now. Please let me know if it's not resolved for you.



    ------------------------------
    SHARYN RICHARD
    ------------------------------



  • 7.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Wed June 12, 2024 09:39 AM

    Hi Sharyn,

    I tested the new version:

    • on Dallas, it works fine. I compiled and run the DataStage flow with success.
    • on Frankfurt (I am in France), as before, I deployed only 6 assets instead of 7. The DataStage flow is missing.



    ------------------------------
    Frederic Bargues
    ------------------------------



  • 8.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Mon June 17, 2024 12:52 AM

    Hi Frederic,

    are you have DataStage selected as a service for Frankfurt?

    Check under Hamburger menue (the four horizontal lines in the top left, left of IBM Cloud Pak for Data)->Services->Service instances.

    If you are on a lite plan, then (if this has not changed) can only select a service for a single location.



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------



  • 9.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Mon June 17, 2024 05:23 AM

    Hi Ralf,

    You're right. I forgot that 2 weeks ago when I switched to Dallas I removed all services for Frankfurt.

    Without DataStage selected as a service for Frankfurt, it seems that all assets have been deployed but only 6 there available. I added the service and the DataStage job became available.

    I am on a lite plan. Today, I have one DataStage for Frankfurt and one for Dallas. The DataStage job finishes with success on both.

    Thanks



    ------------------------------
    Frederic Bargues
    ------------------------------



  • 10.  RE: Data Integration Tutorial - DataStage Flow Asset is not imported

    Posted Mon June 17, 2024 11:04 AM

    Hi Frederic,

    so my gut feeling was right. I did the DaaS beta from the beginning and originally had my services in Dallas (for DataStage was only available there), then switched to Frankfurt for percormance reasons (UI lag), back to Dallas for Watson pipline DataStage functionallity was again initially only avilable there and back again to Frankfurt.



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------