Data Integration

 View Only
Expand all | Collapse all

[support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

  • 1.  [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Tue April 23, 2024 10:00 AM

    Hallo,
    I have Datastage on a Windows Server and to run the parallel jobs I need to install a c++ compiler. According to the documentation I need to install MS Visual Studio. Current version of MS Visual Studio is a modular.

    Which modules of MS Visual studio do I need to install?
    Is the same version of MS Visual Studio Building tools not compatible/enough to use it with Datastage?

    Thank you in advance.



    ------------------------------
    P.G. Prozorov
    ------------------------------


  • 2.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted Wed April 24, 2024 01:46 AM

    Hi,

    it is a long time that I worked on a DataStage installation on Windows, but I have an old (8.0.1) VM Image with such an installation which I used for testing purposes where I had a look now. There I had MS Visual C++ Express Edition 2005 installed to be able to compile by jobs and build ops. So I would suggest that you install the most current version of it and try to compile your jobs.

    Afterwards you have to set the compiler options in the administrator, see in the pic below, what I had specified in my project.

    KR Ralf



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------

    Original Message


  • 3.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?
    Best Answer

    IBM Champion
    Posted Thu April 25, 2024 03:54 AM
    Edited by P.G. Prozorov Thu April 25, 2024 04:47 AM

    Hi,

    I installed Visual Studio 2019 with "Desktop Development with C++".

    After successfull VStudio installation it is neccessary to set the following system environment variables in windows to be able to use the VStudio C++ compiler with DataStage. 
    INCLUDE

    C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\ucrt

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\shared

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\um
    LIB

    C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\lib\x86

    C:\Program Files (x86)\Windows Kits\10\Lib\10.0.19041.0\ucrt\x86

    C:\Program Files (x86)\Windows Kits\10\Lib\10.0.19041.0\um\x86
    PATH C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\Hostx86\x86
    Regards, 
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 4.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Thu April 25, 2024 04:47 AM

    Hi Gerhard,
    Thank you for your answer.
    Exactly, that is the point. I also will install Visual Studio 2019.
    BUT, do I need whole set of features from "Desktop Development with C++" set?
    Or are there just a few elements that need to be selected/installed?



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 5.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted Thu April 25, 2024 05:13 AM
    Edited by Gerhard Paulus Thu April 25, 2024 05:16 AM
      |   view attached

    Hi,

    I think it is enough to install the following two components instead of the whole "Desktop Development with C++" - but I have not tested it yet.

    • MSVC v* - VS 2019 C++ x64/x86 Buildtools
    • Windows 10 SDK

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 6.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Fri April 26, 2024 01:58 PM

    Hi Gerhard,
    No luck :(

    Not enough.

    Datastage doesn't want to compile a job with a transformer.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 7.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Fri April 26, 2024 02:02 PM

    What is the compile error?



    ------------------------------
    Emily White
    ------------------------------

    Original Message


  • 8.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Fri April 26, 2024 02:20 PM

    Hi Emile,

    ##I IIS-DSEE-TFCN-00006 20:09:39(001) <main_program> conductor uname: -s=Windows Server 2016 Datacenter; -r=; -v=6.3; -n=DS-Test; -m=x86-Intel
##I IIS-DSEE-TOSH-00002 20:09:39(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 20:09:39(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 20:09:39(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 20:09:39(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TFSR-00019 20:09:42(000) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 20:09:42(001) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##I IIS-DSEE-TBLD-00000 20:09:42(002) <main_program> Error when checking composite operator: Output from subprocess: Unknown parameter #cl (ignored)

    Maybe something with my APT parameters.
    What APT_COMPILEOPT, APT_LINKOPT, APT_COMPILER and APT_LINK do you have?



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 9.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted Fri April 26, 2024 02:52 PM
    Edited by Gerhard Paulus Fri April 26, 2024 02:52 PM

    Hi,

    it seems that the command (the compiler) "cl.exe" is not found.

    Unknown parameter #cl

    Did you changed the System PATH variable that the path for the cl (compiler/linker) executable is containted?
    If yes did you restart the window system - or shutted down datastage / logged out / logged in / restart datastage? (reboot the whole server is easier :-) )

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 10.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Sat April 27, 2024 09:02 AM

    Hi Gerhard,
    Yes. I did. Whole server restart.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 11.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted Sat April 27, 2024 03:04 AM

    Hi,

    I tried the following, after checking if compile works in my old DataStage on Windows Project, I renamed APT_COMPILER from cxx to cxxy (which is something that does not exist). Afterwards the compile gives the following error.

    ##W IIS-DSEE-TBLD-00000 08:53:25(005) <main_program> Error when checking composite operator: Output from subprocess: cxxy: not found

    I IIS-DSEE-TBLD-00079 08:53:25(006) <transform> Error when checking composite operator: cxxy  -O   -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Training/RT_BP148.O/V0S4_JP_Test_Compile_TR.C -o C:/IBM/InformationServer/Server/Projects/Training/RT_BP148.O/V0S4_JP_Test_Compile_TR.tmp.o.
    ##E IIS-DSEE-TCOS-00029 08:53:25(007) <main_program> Creation of a step finished with status = FAILED. (JP_Test_Compile.TR)

    While if I do the same thing to APT_LINKER I get a totaly different (very long) error message.

    This looks different to what you have.



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------

    Original Message


  • 12.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted Sat April 27, 2024 03:20 AM

    Hi,

    here are my compiler options

    APT_COMILEOPT -> /D APT_USE_ANSI_IOSTREAMS /D _WIN32 /D _MBCS /nologo /W3 /WX- /Gm- /EHa /MD /GS- /fp:precise /Zc:wchar_t- /Zc:forScope /Gd /TP /Zi /Oy- /c

    APT_COMPILER -> cl

    APT_LINKER -> link

    APT_LINKOPT -> /INCREMENTAL:NO /NOLOGO /DLL /DEBUG /SUBSYSTEM:CONSOLE /DYNAMICBASE:NO /MACHINE:X86

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 13.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Sat April 27, 2024 09:54 AM
    Edited by P.G. Prozorov Sat April 27, 2024 09:55 AM

    Hallo Gentlemen,

    Compilation succeeded. Thank you very much for your help.

    • I just reinstalled full version of Visual Code Community 2022 Desktop C++ development module. (not individual elements)
    • Added/edited needed system variables (LIB, INCLUDE, PATH)
    • Just used default APT_* variables (exactly same as @Gerhard Paulus mentioned)
    • Full reboot server

    Job is compiled without any errors:

    I still want to try to use just a few elements of VS and not the entire module. Need to investigate further which elements are needed.

    Maybe is it possible to use WSL with gcc or MinGW instead.

    The last two are very interesting options to try.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 14.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Thu April 25, 2024 04:41 AM

    Hi Ralf,
    Thank you for your answer, but I need to install at least version 2019 of Visual Studio. Security office prohibits using previous versions. 
    Express version dos not exist any more :(



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 15.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted Thu April 25, 2024 09:41 AM

    Hello,

    For what it's worth, I have Engine, Services and Client tiers of Info Server 11.7.1.4 installed on Windows 2019 with the below Visual Studio items. Everything works fine.




    ------------------------------
    Emily White
    ------------------------------

    Original Message