Data Integration

 View Only
Expand all | Collapse all

[support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

  • 1.  [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 19 days ago

    Hallo,
    I have Datastage on a Windows Server and to run the parallel jobs I need to install a c++ compiler. According to the documentation I need to install MS Visual Studio. Current version of MS Visual Studio is a modular.

    Which modules of MS Visual studio do I need to install?
    Is the same version of MS Visual Studio Building tools not compatible/enough to use it with Datastage?

    Thank you in advance.



    ------------------------------
    P.G. Prozorov
    ------------------------------


  • 2.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted 19 days ago

    Hi,

    it is a long time that I worked on a DataStage installation on Windows, but I have an old (8.0.1) VM Image with such an installation which I used for testing purposes where I had a look now. There I had MS Visual C++ Express Edition 2005 installed to be able to compile by jobs and build ops. So I would suggest that you install the most current version of it and try to compile your jobs.

    Afterwards you have to set the compiler options in the administrator, see in the pic below, what I had specified in my project.

    KR Ralf



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------

    Original Message


  • 3.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?
    Best Answer

    IBM Champion
    Posted 18 days ago
    Edited by P.G. Prozorov 18 days ago

    Hi,

    I installed Visual Studio 2019 with "Desktop Development with C++".

    After successfull VStudio installation it is neccessary to set the following system environment variables in windows to be able to use the VStudio C++ compiler with DataStage. 
    INCLUDE

    C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\ucrt

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\shared

    C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\um
    LIB

    C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\lib\x86

    C:\Program Files (x86)\Windows Kits\10\Lib\10.0.19041.0\ucrt\x86

    C:\Program Files (x86)\Windows Kits\10\Lib\10.0.19041.0\um\x86
    PATH C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\Hostx86\x86
    Regards, 
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 4.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 18 days ago

    Hi Gerhard,
    Thank you for your answer.
    Exactly, that is the point. I also will install Visual Studio 2019.
    BUT, do I need whole set of features from "Desktop Development with C++" set?
    Or are there just a few elements that need to be selected/installed?



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 5.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted 18 days ago
    Edited by Gerhard Paulus 18 days ago
      |   view attached

    Hi,

    I think it is enough to install the following two components instead of the whole "Desktop Development with C++" - but I have not tested it yet.

    • MSVC v* - VS 2019 C++ x64/x86 Buildtools
    • Windows 10 SDK

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 6.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 16 days ago

    Hi Gerhard,
    No luck :(

    Not enough.

    Datastage doesn't want to compile a job with a transformer.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 7.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 16 days ago

    What is the compile error?



    ------------------------------
    Emily White
    ------------------------------

    Original Message


  • 8.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 16 days ago

    Hi Emile,

    ##I IIS-DSEE-TFCN-00006 20:09:39(001) <main_program> conductor uname: -s=Windows Server 2016 Datacenter; -r=; -v=6.3; -n=DS-Test; -m=x86-Intel
##I IIS-DSEE-TOSH-00002 20:09:39(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 20:09:39(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 20:09:39(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 20:09:39(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TFSR-00019 20:09:42(000) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 20:09:42(001) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##I IIS-DSEE-TBLD-00000 20:09:42(002) <main_program> Error when checking composite operator: Output from subprocess: Unknown parameter #cl (ignored)

    Maybe something with my APT parameters.
    What APT_COMPILEOPT, APT_LINKOPT, APT_COMPILER and APT_LINK do you have?



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 9.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted 16 days ago
    Edited by Gerhard Paulus 16 days ago

    Hi,

    it seems that the command (the compiler) "cl.exe" is not found.

    Unknown parameter #cl

    Did you changed the System PATH variable that the path for the cl (compiler/linker) executable is containted?
    If yes did you restart the window system - or shutted down datastage / logged out / logged in / restart datastage? (reboot the whole server is easier :-) )

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 10.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 15 days ago

    Hi Gerhard,
    Yes. I did. Whole server restart.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 11.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted 16 days ago

    Hi,

    I tried the following, after checking if compile works in my old DataStage on Windows Project, I renamed APT_COMPILER from cxx to cxxy (which is something that does not exist). Afterwards the compile gives the following error.

    ##W IIS-DSEE-TBLD-00000 08:53:25(005) <main_program> Error when checking composite operator: Output from subprocess: cxxy: not found

    I IIS-DSEE-TBLD-00079 08:53:25(006) <transform> Error when checking composite operator: cxxy  -O   -IC:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- C:/IBM/InformationServer/Server/Projects/Training/RT_BP148.O/V0S4_JP_Test_Compile_TR.C -o C:/IBM/InformationServer/Server/Projects/Training/RT_BP148.O/V0S4_JP_Test_Compile_TR.tmp.o.
    ##E IIS-DSEE-TCOS-00029 08:53:25(007) <main_program> Creation of a step finished with status = FAILED. (JP_Test_Compile.TR)

    While if I do the same thing to APT_LINKER I get a totaly different (very long) error message.

    This looks different to what you have.



    ------------------------------
    Ralf Martin
    Principal Consultant
    infologistix GmbH
    Bregenz
    ------------------------------

    Original Message


  • 12.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    IBM Champion
    Posted 16 days ago

    Hi,

    here are my compiler options

    APT_COMILEOPT -> /D APT_USE_ANSI_IOSTREAMS /D _WIN32 /D _MBCS /nologo /W3 /WX- /Gm- /EHa /MD /GS- /fp:precise /Zc:wchar_t- /Zc:forScope /Gd /TP /Zi /Oy- /c

    APT_COMPILER -> cl

    APT_LINKER -> link

    APT_LINKOPT -> /INCREMENTAL:NO /NOLOGO /DLL /DEBUG /SUBSYSTEM:CONSOLE /DYNAMICBASE:NO /MACHINE:X86

    Regards,
    Gerhard



    ------------------------------
    Gerhard Paulus
    ------------------------------

    Original Message


  • 13.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 15 days ago
    Edited by P.G. Prozorov 15 days ago

    Hallo Gentlemen,

    Compilation succeeded. Thank you very much for your help.

    • I just reinstalled full version of Visual Code Community 2022 Desktop C++ development module. (not individual elements)
    • Added/edited needed system variables (LIB, INCLUDE, PATH)
    • Just used default APT_* variables (exactly same as @Gerhard Paulus mentioned)
    • Full reboot server

    Job is compiled without any errors:

    I still want to try to use just a few elements of VS and not the entire module. Need to investigate further which elements are needed.

    Maybe is it possible to use WSL with gcc or MinGW instead.

    The last two are very interesting options to try.



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 14.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 18 days ago

    Hi Ralf,
    Thank you for your answer, but I need to install at least version 2019 of Visual Studio. Security office prohibits using previous versions. 
    Express version dos not exist any more :(



    ------------------------------
    P.G. Prozorov
    ------------------------------

    Original Message


  • 15.  RE: [support] Datastage installation on a Windows server: Which elements of Visual Studio do I need to install to run parallel jobs?

    Posted 17 days ago

    Hello,

    For what it's worth, I have Engine, Services and Client tiers of Info Server 11.7.1.4 installed on Windows 2019 with the below Visual Studio items. Everything works fine.




    ------------------------------
    Emily White
    ------------------------------

    Original Message