Data Integration

Data Integration

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only
  • 1.  Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Wed December 28, 2022 04:53 AM
      |   view attached
    Hello,
    I was recently asked to edit a job that generates command JSON files. The job, I did it two years ago with flash and it was not complicated, even if my orders.json is not simple there are several levels of nesting, a lot of data...
    But I was confident.
    I'm not anymore. With dataflow designer it is almost impossible to manipulate views. Befor I had :
    - Include on View
    - Include All Descedants
    - Chunk
    Chunk is gone, or I can't find him. New stage is not documented and it is not intuitive at all.

    IBM what should i do? (T011628559)

    ------------------------------
    Jerzy Konarski
    ------------------------------

    #DataIntegration


  • 2.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu December 29, 2022 09:13 AM
    DFD does not have 100% functional parity with the thick client - so most likely it will not be possible to accomplish your task with DFD.  As an alternative, you can get the Harman plug-in that will allow you to continue to use the thick client as you have in the past (you can open a case with IBM if you have questions about Harman).  Another option is to use Next Generation DataStage where the hierarchical stage should be able to handle your use case.

    ------------------------------
    Pat Marcello
    ------------------------------



  • 3.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu December 29, 2022 09:47 AM
    Hello Pat and thank you for your answer,
    If I summarize well (with history) IBM did not notice that flash was going to be stopped (it was announced 10 in advance) and at the last moment developed Hierarchical Data in DFD.
    Not only the DFD interface is execrable - are there ergonomists at IBM? - but in addition it does not cover all the functionalities of Hierarchical Data.
    To return to the product features that my customer purchased, he must acquire an additional product! IBM does not provide it.
    Next-gen is not an option, the platform is not finished and migrating over it can take several months, even years!
    So basically I don't have a solution.
    IBM could perhaps provide desperate customers with a VM with the plugin installed?
    Seriously, it's not serious.

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 4.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu December 29, 2022 09:58 AM
    Not quite accurate historically, but that is a story for another time. 
    IBM has provided customers with the Harman plug-in for almost 2 years now - I am not quite sure where that program stands at this point.  Customers were able to procure the plug-in by opening a case with IBM support so please check if that is still an option (last I heard these licenses were valid until the end of Feb 2023).  Perhaps that gives you a temporary solution here.

    ------------------------------
    Pat Marcello
    ------------------------------



  • 5.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu December 29, 2022 10:05 AM
    When I asked - about a year ago - I was told that Harman licenses were no longer available.
    If not, will there be a solution after February 2023?

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 6.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu December 29, 2022 10:22 AM
    I am not aware of any plans beyond that - that does not mean they do not exist, just that I am not aware.  At this point, I would encourage you to get in touch with your IBM rep here and he can get an official answer from DataStage Product Management.
    Also - just double checked and the Harman licenses that IBM was giving actually expire on Jan 30 of 2023 (I said end of Feb - wanted to correct that).

    ------------------------------
    Pat Marcello
    ------------------------------



  • 7.  RE: Is it realy possible to use hierarchical stage in DATAFLOW designer for JSON file generation ?

    Posted Thu January 26, 2023 01:26 PM
    Hello,
    To conclude, indeed after having contacted my commercial I was able to obtain - this time - the plug-in. The license has been extended until January 2024. After that we'll see ;)
    Thanks

    ------------------------------
    Jerzy Konarski
    ------------------------------