Global Data Lifecycle - Integration and Governance Forum

 View Only

  • 1.  String treatment migrating IIS Job Sequences to W. Pipelines

    Posted Mon July 22, 2024 01:14 PM

    Dear all.

    We are working on the migration of IIS 11.5 datastage sequences jobs to CP4D 4.8.5 on prem W. Pipelines.

    After reading a file with a record delimited by "|", we use a "Set User Variables" to apply the ds.field function to parse the record.

    then we see that certain characters are changed to unicode format

    1) Run Bash Script activity (exec4)

    echo· -n· `cat· ${file}.txt`

    result (vi file.txt): 

    "RAW_EDW_ATTENCION_CLIENTES_HIERARQUIAS_TEI_END|id, date_execution_id|RAW_EDW_ATTENCION_CLIENTES_HIERARQUIAS_TEI_FIN|id, date_execution_id|And data_date >= (Current_Date-4) / 1 + 19000000|date_execution_id|SATURDAY||D||0 |0|LD_HUB_WORK|N"

    2) Set User Variables Activity

    set string user variable

    ds.Field(ds.GetCommandOutput(tasks.exec4),'|',5) 

    result (in log):

    - variables-USR-VAR-PARAM-VAR-FILTRO-HDP: "And data_date \u003e= (Current_Date-4) / 1 + 19000000", expression: vars.USR_VAR_PARAM_VAR_FILTRO_HDP

    How can we prevent the character ">" from becoming "\u003e" ?

    we tried with .replace("\u003e",">") but it don't work

    Thanks in advance.

    Javier.



    ------------------------------
    Javier Pugliese
    ------------------------------


  • 2.  RE: String treatment migrating IIS Job Sequences to W. Pipelines
    Best Answer

    Posted Wed July 24, 2024 01:33 PM

    Thank you Javier Pugliese, for reporting this problem. This is a display issue in the logs for Uservariable Activity under the log tab. The actual value in the variable is stored correctly. Please check the Input/Output tab; under Outputs, the value displays correctly as shown: `And data_date >= (Current_Date-4) / 1 + 19000000`. To verify further, you can echo the user variable in the next bash node, and you will see the correct data. We will be fixing the display issue in upcoming releases.



    ------------------------------
    SUPRAJA SWARNA
    ------------------------------

    Original Message


  • 3.  RE: String treatment migrating IIS Job Sequences to W. Pipelines

    Posted Thu July 25, 2024 11:42 AM

    Thanks a lot SUPRAYA !!!

    I have verified your answer and, indeed it is only a display problem and it does not impact the data.
    My doubt is because we normally give more priority to viewing the "Log" tab than to "Input/Output".
    thank you very much for the time invested in helping me.
    By the way: we are working on a big migration from IIS 11.5 to CP4D 4.8.5.
    Maybe we can help others with our experience and also post queries.
    Is this "Global Data Lifecycle - Integration and Governance Forum" the right group for this type of query? or there is a. most suitable group for this?
     
    One more time. Thanks a lot
    Javier


    ------------------------------
    Javier Pugliese
    ------------------------------

    Original Message


  • 4.  RE: String treatment migrating IIS Job Sequences to W. Pipelines

    Posted Wed July 31, 2024 12:49 AM

    Javier, Please open support tickets, we have dedicated support engineers working on the support tickets to ensure proper response time.



    ------------------------------
    SUPRAJA SWARNA
    ------------------------------

    Original Message


  • 5.  RE: String treatment migrating IIS Job Sequences to W. Pipelines

    Posted Tue July 30, 2024 01:05 PM

    Hi community, I have a question regarding the optim security in the connection manager, I imported users from connection manager optim "import users" of active directory, these users are to authenticate on connection mananger and optim manager? I have workstations on windows with the Designer installed and my server optim is a linux. My workstatios are on an active directory If users want to authenticate to the connection manager from the designer with their domain user, what is needed?

     

    Saludos Cordiales

    Francisco Emanuel Arano Moreno

    F18259

    Y22 – Oficina de Administración de la Plataforma Analítica

    Banco de México.

    Ext.: 7944

     



    ADVERTENCIA. Este correo se envía del Banco de México y puede contener información sensible. Si usted no es el destinatario del mismo, por favor notifique al remitente inmediatamente y borre este mensaje y cualquier copia del mismo, así como los archivos adjuntos. Debido a que las comunicaciones por internet no son seguras, en el caso de que usted no sea el destinatario de este correo, Banco de México no acepta responsabilidad u obligación alguna por el contenido del mismo. La información de este mensaje, incluyendo, en su caso, los archivos adjuntos, se encuentra protegida por la ley. Su reproducción, parcial o total, revisión, uso, revelación, y/o distribución indebida o no autorizada puede constituir un delito y/o contravenir diversas disposiciones legales. Con independencia de lo anterior, el Banco de México se reserva el derecho de ejercer las acciones que correspondan, entre otros, por daños y perjuicios, con motivo del empleo indebido y/o no autorizado de la propia información. Banco de México ha tomado precauciones para prevenir que el presente correo esté infectado por virus, por lo que no acepta, entre otros, responsabilidad alguna por daños o pérdidas causadas por el uso del mismo o de los archivos adjuntos.
    Asimismo, le informamos que Banco de México es responsable de la protección de los datos personales que trate. Dicho tratamiento se llevará a cabo conforme a los principios y deberes previstos en la Ley General de Protección de Datos Personales en Posesión de Sujetos Obligados, con sujeción a las atribuciones y facultades que la normatividad aplicable le confiere, y para finalidades acordes a estas. Le invitamos a consultar nuestros avisos de privacidad en nuestra página de internet (www.banxico.org.mx), en la sección "Ley de Transparencia", subsección "Avisos de Privacidad".


    °°°°
    NOTICE. This message is being sent from Banco de México and may contain sensitive information. If you are not the intended recipient, please advise the sender immediately and delete this message, and any copies of it, including its attachments. As internet communications are not secure, in case you are not the intended receiver, Banco de México does not accept any responsibility for the content of this message. All information contained in this message, including attached files, is protected by Mexican law. Partial or total reproduction, modification, use, disclosure, and/or inappropriate or unauthorized distribution of any information without the prior consent of the sender may be prosecuted under Mexican law. Banco de México reserves the right to pursue in any form of legal action, including any damages, that could result from the inappropriate or unauthorized use of the information contained herein. Banco de México has taken reasonable precautions to prevent viruses from being present through this e-mail. We do not accept responsibility for any loss or damages arising from the use of this e-mail or its attachments. °°°°
    Additionally, we inform you that Banco de México is responsible for the personal data it processes. Such process will be conducted under the principles and obligations provided in the General Law for the Protection of Personal Data in the Posession of Obliged Subjects, observing the atributions and faculties that are conferred by applicable legislation, and for the purposes related to them. We invite you to visit our website (www.banxico.org.mx) where you can consult our Privacy Notices, through section "Ley de Transparencia", subsection "Avisos de Privacidad". °°°°




    2024, Año de Felipe Carrillo Puerto, Benemérito del Proletariado, Revolucionario y Defensor del Mayab




    Original Message