DataStage - Data Integration

Expand all | Collapse all

What about FLASH

  • 1.  What about FLASH

    Posted Wed November 04, 2020 12:54 PM
    Hello,
    Some DS transformations using Adobe Flash Player. Adobe Flashe is out of support & is desactivated in Windows.
    I'm using Herarchical Data Stage, & others components of DS using Flash.

    What is going on with the flash stop ?

    Jerzy

    ------------------------------
    Jerzy Konarski
    ------------------------------


  • 2.  RE: What about FLASH

    Posted Thu November 05, 2020 09:44 AM
    Hi Jerzy,

    we had released the following technote regarding Adobe Flash and DataStage
    https://www.ibm.com/support/pages/hierarchical-stage-flash-player-end-support-dec-2020

    The technote also applies to the Unstructured Stage which isn't referenced by the technote.

    The functionality for both, the Hierarchical stage and Unstructured stage are available without Flash on the browser-based DataStage Flow Desinger with V11.7.1. 
    As the Flow Designer is backwards compatible to the DS/QS Windows client, you can use the browser based Flow Designer solely just to make specific edits to mappings for these 2 stages if needed.

    Just as a reminder. Flash is only needed when someone wants to make changes to the Hierarchical (XML/JSON) or Unstructured (Excel) mappings.

    Adobe Flash is not needed in any of the following cases:
    • Designing a job -- even when putting the Hierarchical or Unstructured stage onto the job canvas
    • Opening a stage editor and making changes to properties within the Stage editor (even for the Hierarchical and Unstructured stage)
    • Compiling a job
    • Running a job
    Lastly, if you do want to continue using the Flash based function, Adobe has partnered with Harman, who is their primary partner to provide a specific Browser version that still allows to run Flash

    Hope this helps,

    Kind regrads,
    Beate

    ------------------------------
    Beate Porst
    Program Director Offering Management
    IBM
    San Jose
    ------------------------------



  • 3.  RE: What about FLASH

    Posted Tue November 10, 2020 02:59 AM
    Just a remark. The interface of Flow Designer is really horrible and ant-ergonomic. It's time for IBM to realize that there is a human being behind the interface.

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 4.  RE: What about FLASH

    Posted Tue November 10, 2020 02:59 AM
    Just a remark. The interface of Flow Designer is really horrible and ant-ergonomic. It's time for IBM to realize that there is a human being behind the interface.

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 5.  RE: What about FLASH

    Posted Tue November 10, 2020 03:01 AM
    Just a remark. The interface of Flow Designer is really horrible and ant-ergonomic. It's time for IBM to realize that there is a human being behind the interface.

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 6.  RE: What about FLASH

    Posted Tue December 08, 2020 12:48 PM
    Hi Beate,
    We have a new system with IBM Infosphere 11.7.1.1 installed but DataFlowDesigner does not support the Unstructured Datastage (neither editing an existing stage nor creating a new one; it tells "This connector type is not yet supported"). We are using the "DatastageFlow_Designer_ISPKG for 11.7.1.1 Sept 2020", is there any more necessary or is the Unstructured Stage in the FlowDesigner simply not yet available to public?
    Regards
    Bernhard Gruber

    ------------------------------
    Bernhard Gruber
    ------------------------------



  • 7.  RE: What about FLASH

    Posted Tue December 08, 2020 01:36 PM
    Hello,

    I was able to use hierarchical data stage with 11.7.1FP1, but ergonomics are really bad.
    Is there somewhere the doc to configure DS client with Harman Browser ?

    I did not find it anywhere.

    Jerzy

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 8.  RE: What about FLASH

    Posted Wed December 16, 2020 11:21 AM
    Hi Jerzy,

    we tested the Harman solution for DataStage.
    They offer a couple of routes:
    1. A packaged browser:
    The packaged browser itself is not a workable solution for DataStage as it doesn't support applications developed in C# and using web browser controls which the DataStage Designer does.

    2. Plugin
     Harman also has a Plugin option (pretty much similar as the Adobe plugin) which is a workable solution for DataStage



    ------------------------------
    Beate Porst
    Program Director Offering Management
    IBM
    San Jose
    ------------------------------



  • 9.  RE: What about FLASH

    Posted Wed December 16, 2020 11:32 AM
    Hi Beate,

    so I guess there will be a hotfix provided by IBM to fix this issue shortly in the DataStage Designer (using the harnam solution somehow) until the support of DataStage on Premise ends in 2024 ?

    :)

    ------------------------------
    Justus Kenklies
    ------------------------------



  • 10.  RE: What about FLASH

    Posted Fri December 18, 2020 12:51 PM

    Hi Beate,

    I serched, but I don't find and I don't know where to find this Harman's plugin. Google don't know It.

    And i think it's not a real solution. The tool must be usable, I agree with Justus.

    I have big JSON & XML transformations that use Hierarchical Stage and I don't know what to do. What should I tell my clients?

    jerzy



    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 11.  RE: What about FLASH

    Posted Wed January 13, 2021 07:00 AM
    Well then, although we held back that Microsoft Flash Removal Update, the HD stage is not working anymore and shows a big flash logo instead of the beloved editor.

    Let me mention that this type of issue is a severe disaster for the reputation of the software throughout my department. :/

    ------------------------------
    Justus Kenklies
    Fielmann AG
    Hamburg
    ------------------------------



  • 12.  RE: What about FLASH

    Posted Wed January 13, 2021 07:58 AM
    Same boat.  We are in the middle of a big implementation and trying to fix bugs and my developers are unable to move.

    Now I have to set aside my upgrade to 11.7.1 FP1 because I'm too swamped trying to patch Flash to work for production support of a huge project we implemented Monday...

    This is very sad.


    ------------------------------
    Nate Hoy
    ------------------------------



  • 13.  RE: What about FLASH

    Posted Thu January 14, 2021 07:06 PM
    Justus, have a look at the following Technote we created for the "January 12th" issue: https://www.ibm.com/support/pages/node/6403307

    ------------------------------
    Pierre Viricel
    ------------------------------



  • 14.  RE: What about FLASH

    Posted Thu February 04, 2021 01:19 PM
    Hi Beate,

    Is there any detail document available on how to use Harman Plug in with Datastage ?

    Thanks,
    Vishal Joshi

    ------------------------------
    Vishal Joshi
    ------------------------------



  • 15.  RE: What about FLASH

    Posted Tue December 15, 2020 11:23 AM

    Hi Beate, 

    in the meantime the page no longer seems to exist. The link currently leads to an error page.

    I tested editing an HD stage with the flow designer today in version 11.7.1.1 and yes, I can open the stage, but I cannot edit it. My stage is having 11 steps. (1: Input, 2: sort, 3-9: HJoin 10: JSON Composer 11: Output). In the flow designer, the steps are horizontally organized tabs and I cannot find any possibility to navigate to the steps 9-12, because they're simply not visible. Changing the window size in flow designer is not possible. Changing the size or scale of the browser doesn't help either.

    ¯\_(˘・_・˘)_/¯



    ------------------------------
    Justus Kenklies
    ------------------------------



  • 16.  RE: What about FLASH

    Posted Thu November 05, 2020 10:08 AM

    We have the same issue.  We are running 11.7 but not at the very latest patch that allows full use of Flow Designer, so I'm struggling to try and get that working now, but it would be nice to have a way to keep using the thick client since Flow Designer has some significant limitations. 

    We've already seen a security fix to Flash break the Hierarchical Stage, requiring us to significantly lower the security of our desktops by adding "EnableInsecureActiveXNavigateToURL=1" to Flash's mms.cfg



    ------------------------------
    Nate Hoy
    ------------------------------



  • 17.  RE: What about FLASH

    Posted Thu November 05, 2020 10:47 AM
    I think the best way to develop is to define the job in the windows client and develop the stage in Flow Designer. Unless the November update improves Flow Designer ergonomics & fonctionnalities.

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 18.  RE: What about FLASH

    Posted Wed January 13, 2021 07:51 AM
    I opened a PMR and received advice to add the following to C:\Windows\SysWOW64\Macromed\Flash\mms.cfg (create the file if it does not exist):

    AllowListRootMovieOnly=1
    AllowListUrlPattern=https://services_tier_host:services_tier_port/ibm/iis/ds/xmlpack3/XMLPackController.swf
    EnableInsecureActiveXNavigateToURL=1

    Obviously replace the services tier host and port with yours.

    We appear to be running Pepper Flash, and that is not working, so I am continuing to work with IBM to try other things for that.

    My independent research has uncovered two other parameters you might try, though they did not work for me, either:

    EOLUninstallDisable=1
    EnableAllowList=1

    ------------------------------
    Nate Hoy
    ------------------------------



  • 19.  RE: What about FLASH

    Posted Wed January 13, 2021 07:59 AM
    Hi Nate,
    what is your version of datastage?

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 20.  RE: What about FLASH

    Posted Wed January 13, 2021 08:34 AM
    11.7.1.0

    But we are running "Pepper" Flash v32.0.0.445 and although it looks identical to Adobe's Flash, there may be differences which is why adding the "unkill" switches to mms.cfg won't work for me. See other comments in here about that - maybe the mms.cfg flags will work for you?  

    At the behest of my senior management, I have just upped by ticket to Sev 1 since we now have production fixes on our new project that have short deadlines and my boss is running interference with the executive team to give me enough time to duct tape things together.

    ------------------------------
    Nate Hoy
    ------------------------------



  • 21.  RE: What about FLASH

    Posted Mon January 25, 2021 10:58 AM
    We use this tip: https://blogs.sap.com/2020/12/10/how-to-keep-enterprise-flash-applications-accessible-in-2021/

    In C:\Windows\SysWOW64\Macromed\Flash\mms.cfg file we add that lines:

    EOLUninstallDisable=1

    SilentAutoUpdateEnable=0

    EnableAllowList=1

    AutoUpdateDisable=1

    ErrorReportingEnable=1

    AllowListUrlPattern=https://host:port






    ------------------------------
    Piotr Ogrodziński
    ------------------------------



  • 22.  RE: What about FLASH

    Posted Mon January 25, 2021 11:13 AM
    Thank you, Piotr.  I kept forgetting to come back and post that myself.

    One thing that I discovered is that the AllowListUrlPattern parameter is very specific (like you might expect, I guess).  It took me far too long to realize that, since we are in a domain, we register all of our servers with "(at)"ourdomain.com and I was not including the domain in my list patterns.

    So: 
    https://server:port/ibm/iis/ds/xmlpack3/XMLPackController.swf​​ did not work, but 
    https://server.domain.com:port/ibm/iis/ds/xmlpack3/XMLPackController.swf​​ did

    I also used the full filter for the URL Pattern as it restricts what Flash objects can be run more closely.  That way if we somehow had a breach in our Datastage servers and someone injected a bad Flash object there, it would not run under these rules.  It's a very unlikely scenario, but the single XMLPackController.swf is sufficient.

    We have moved up our timeline for Flow Designer and so far the latest patch of it seems to be doing fine with XML assemblies.  We haven't done a lot of testing yet, just installed it on a nonproduction Sandbox server.

    ------------------------------
    Nate Hoy
    ------------------------------



  • 23.  RE: What about FLASH

    Posted Mon May 10, 2021 10:17 AM
    Hi,

    I applied this method last January and it worked, but now the error is back:

    Flash Player Error. This application requires an Adobe Flash Player ActiveX control of version 10 or later.Get Flash

    Do you have any Idea?

    Thank you for your Help

    Regards




    ------------------------------
    AMIROUCHE OUBELLIL
    ------------------------------



  • 24.  RE: What about FLASH

    Posted Mon May 10, 2021 10:31 AM
    Hello Amirouche,

    It would seem that the Adobe Flash player was removed from your Windows client (i.e. with a recent Microsoft update), you might want to check if you still have it in the list of installed programs.

    Regards,
    pierre

    ------------------------------
    Pierre Viricel
    ------------------------------



  • 25.  RE: What about FLASH

    Posted 10 days ago
    Hello,
    There is something that I may have misunderstood.
    I understand that for everything developed in flash Datastage is now bundled with Harman solution. So logically it is no longer necessary to keep flash if we installed the latest version with the latest fixes.
    That is true ?

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 26.  RE: What about FLASH

    Posted 10 days ago
    Hello Jerzy,

    No, that is incorrect : DataStage is not bundled with any Flash Player.

    If the original Adobe Flash Player has been removed from the Windows PC you will not be able to use the Designer to edit Hierarchical Data stages any longer, unless you purchase/install the Harman Flash Player plugin.

    The alternative is to use the Data Flow Designer to edit Hierarchical Data stages, in which case it's recommended to be in the very latest release (presently 11.7.1.1 SP1) to benefit from the latest fixes and features.

    Regards,
    pierreVRCL


  • 27.  RE: What about FLASH

    Posted 10 days ago
    Hi,

    I'd say no.

    As far as I understood, Flash is not bundled with datastage at all. The Designer GUI just uses Flash at some places and Microsoft is removing it from Windows, so you need to replace that component in the Operating System. Therefore, IBM is giving us the hint to use the new alternative and also helps us to get it - at least for a short period.

    Flash is used in the Hierarchical Data Stage and in the Unstructured Data Stage (and a third one I think), just to provide a graphical user interface to the developer. 

    • If flash is not available at the hard client machine: 
      • Dev-GUI for these stages will not function at all
      • The job itself can still be changed and compiled in the Designer, unless you do not touch an link attached to the HD stage (do not rename, nor change any column definition)
      • IBM claims that jobs and also affected stages can be worked on using the browser-based flow designer. (I cannot recommend that, but I also do not have the latest patch yet.)
    • If you patch the windows system and let it remove adobe flash, you can replace it with the harnam flash plugin. It's AFAIK basically the very same, since they bought the software from adobe.
      • Installing the harnam flash plugin is just a few clicks and - just works. You need to have a license for the plugin. We received a license from IBM for free, but that one is limited to one year. After that period, we need to license it via harnam.
      • The license tells you that the plugin may only be used with the IBM product and for nothing else. Since it automatically replaces the flash plugin for the whole machine, it inheritly also fixes other components in the system, like wiered printer driver GUIs or whatever. A side effect we cannot do anything about. ¯\(°_o)/¯


    ------------------------------
    Justus Kenklies
    Fielmann AG
    ------------------------------



  • 28.  RE: What about FLASH

    Posted 8 days ago
    Hi Justus,

    IBM's attitude is incomprehensible and unbearable. The flash stop has been announced for several years and they have had plenty of time to anticipate it.
    Indeed, flow designer ergonomics are horrible and using it - when possible - is torture. And to use it you have to install the latest version of DS.
    I have customers who are using 11.5 and no longer have Flash on their development machines. It is a complete disaster.
    Is there a document that explains where and how to download the haranam plugin? Or do you have to open a case at IBM?

    Jerzy

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 29.  RE: What about FLASH

    Posted 7 days ago
    We opened an IBM support ticket. IBM then provided a download of the Harman flash plugin directly via the IBM ticket platform including a licence for about one year. After that period, we have to license it by ourself.

    Another way seems to be contacting Harman directly. I couldn't find any online puchase form nor any pricing, so literally contacting them and probably getting individual pricing will be the way to get it.

    https://services.harman.com/adobe



    ------------------------------
    Justus Kenklies

    All statements given by me at this site are my personal view only. I do not speak for my company.
    ------------------------------



  • 30.  RE: What about FLASH

    Posted 7 days ago
    Thanks Justus

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 31.  RE: What about FLASH

    Posted Mon January 25, 2021 01:24 PM
    Hi Piotr,

    It may work for old installs, but what if i want to install a new designer instance

    ------------------------------
    Jerzy Konarski
    ------------------------------



  • 32.  RE: What about FLASH

    Posted Mon January 25, 2021 02:26 PM
    Should work just fine for new installs.  The installer doesn't use Flash at all.  But your PC will have to have Flash installed as the Infosphere installer (as far as I know) does not provide it.  You will also need Internet Explorer (not Edge) installed so Designer has a browser it can invoke the Flash plugin call.

    If you don't already have Flash installed on the machine, then you will have to look into a source for the Flash plugin. Downloading one over the internet right now would be sketchy, of course, but you might look into the third party provider Harman -- Adobe (harman.com).  They are providing a supported installer for Flash and have committed to security patches.  But it's not free.

    You might see if IBM is willing to pay for it. We just decided to pursue an upgrade from 11.7.1.0 to 11.7.1.1 so we get support for the Hierarchical Stage in Flow Designer.   Re-enabling Flash bought us a few months until Microsoft (and our internal security team at my company) start pushing to remove Flash forcibly.

    ------------------------------
    Nate Hoy
    ------------------------------



  • 33.  RE: What about FLASH

    Posted Wed February 17, 2021 02:15 PM
    Today we moved to 11.7.1.1 ,We use Hierarchical Stage  extensively for XML and JSON files parsing in our projects.Encountered new problem for XML parsing , The input source has options "String Set,SingleFile and Fileset" in documentation , but flow designer editor has none of these ,instead it has options to load the schema library. The UI validation complains about missing data for 'input' , but there is no place holder in UI for adding the same.Has anyone noticed it in the flow Designer

    Regards

    Arun


    ------------------------------
    arunsekhar chandrasekharan
    ------------------------------