Global Data Lifecycle - Integration and Governance Forum

 View Only
  • 1.  String treatment migrating IIS Job Sequences to W. Pipelines

    Posted 4 days ago

    Dear all.

    We are working on the migration of IIS 11.5 datastage sequences jobs to CP4D 4.8.5 on prem W. Pipelines.

    After reading a file with a record delimited by "|", we use a "Set User Variables" to apply the ds.field function to parse the record.

    then we see that certain characters are changed to unicode format

    1) Run Bash Script activity (exec4)

    echo· -n· `cat· ${file}.txt`

    result (vi file.txt): 

    "RAW_EDW_ATTENCION_CLIENTES_HIERARQUIAS_TEI_END|id, date_execution_id|RAW_EDW_ATTENCION_CLIENTES_HIERARQUIAS_TEI_FIN|id, date_execution_id|And data_date >= (Current_Date-4) / 1 + 19000000|date_execution_id|SATURDAY||D||0 |0|LD_HUB_WORK|N"

    2) Set User Variables Activity

    set string user variable

    ds.Field(ds.GetCommandOutput(tasks.exec4),'|',5) 

    result (in log):

    - variables-USR-VAR-PARAM-VAR-FILTRO-HDP: "And data_date \u003e= (Current_Date-4) / 1 + 19000000", expression: vars.USR_VAR_PARAM_VAR_FILTRO_HDP

    How can we prevent the character ">" from becoming "\u003e" ?

    we tried with .replace("\u003e",">") but it don't work

    Thanks in advance.

    Javier.



    ------------------------------
    Javier Pugliese
    ------------------------------


  • 2.  RE: String treatment migrating IIS Job Sequences to W. Pipelines
    Best Answer

    Posted 2 days ago

    Thank you Javier Pugliese, for reporting this problem. This is a display issue in the logs for Uservariable Activity under the log tab. The actual value in the variable is stored correctly. Please check the Input/Output tab; under Outputs, the value displays correctly as shown: `And data_date >= (Current_Date-4) / 1 + 19000000`. To verify further, you can echo the user variable in the next bash node, and you will see the correct data. We will be fixing the display issue in upcoming releases.



    ------------------------------
    SUPRAJA SWARNA
    ------------------------------



  • 3.  RE: String treatment migrating IIS Job Sequences to W. Pipelines

    Posted 2 days ago

    Thanks a lot SUPRAYA !!!

    I have verified your answer and, indeed it is only a display problem and it does not impact the data.
    My doubt is because we normally give more priority to viewing the "Log" tab than to "Input/Output".
    thank you very much for the time invested in helping me.
    By the way: we are working on a big migration from IIS 11.5 to CP4D 4.8.5.
    Maybe we can help others with our experience and also post queries.
    Is this "Global Data Lifecycle - Integration and Governance Forum" the right group for this type of query? or there is a. most suitable group for this?
     
    One more time. Thanks a lot
    Javier


    ------------------------------
    Javier Pugliese
    ------------------------------