Cloud Pak for Data

 View Only

  • 1.  Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Wed October 14, 2020 07:54 AM
    Hi Guys ,

    I am using  MDM Publisher user interface (Installed on Openshift )which enables you to publish master data from an MDM data source ( InfoSphere® MDM) by setting up a bulk load.

    1 So i have created source endpoint(MDM AE for Advanced Edition deployments (physical MDM)
    which is endpoint that connects to DB2 and test connection is successful.

    2 Created a target endpoint which is a Master Data Connect on CP4D and test connection is successful.(Installed CP4D,Master Data connect on Open Shift)

    3 Created a subscription  which connects these 2 endpoint and I accept the  jobs to run successfully and get access to the DB2 data through Master data Connect API.

    So while running the subscription ,getting the job failed exception  and while seeing the logs of the publisher pod ,i get below error messages in the log 


    [INFO ] PublisherJobManagementService.getJobDetailModelWithCurrentStatus() : JobId PersonDataSub-mdmadmin-1602058100343 Previous Status :FAILED isStatusInTerminalState : true
    [INFO ] PublisherJobManagementService.getJobDetailModelWithCurrentStatus() : JobId MDMConnectAllDataSub-mdmadmin-1602071944331 Previous Status :FAILED isStatusInTerminalState : true
    [INFO ] PublisherJobManagementService.getJobDetailModelWithCurrentStatus() : JobId TestSubVersion1-mdmadmin-1602589077058 Previous Status :PREP isStatusInTerminalState : false
    [ERROR ] Job TestSubVersion1-mdmadmin-1602589077058 ending command: '/usr/ibmpacks/mdmpublisher/0.1.1/bin/runPublisherDataTransferClient.sh file:///usr/ibmpacks/mdmpublisher/0.1.1/publisher/output/TestSubVersion1/targetdetails.properties' with exit code 1
    [INFO ] PersistUtils.persistJobDetailModel() : mdmadmin
    [WARNING ] SRVE0190E: File not found: /subscriptions

    I tried creating a secure shell in the publisher pod to see if i can access this file usr/ibmpacks/mdmpublisher/0.1.1/publisher/output/TestSubVersion1/targetdetails.properties but the publisher pod does not have any file .

    Subscription while running in publisher UI
    So have you guys being able to get data from source(MDM AE for Advanced Edition deployments (physical MDM)
    ) to target (Master Data Connect on CP4D) using the publisher UI which is installed on Open shift.
    Please do provide any pointers for this.


    ------------------------------
    sachin dhama
    ------------------------------

    #CloudPakforDataGroup


  • 2.  RE: Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Thu October 15, 2020 09:59 AM
    Hi Sachin,
    Thank you for bringing this to your notice.
    I will ask someone to get in touch with you and/or post here.

    ------------------------------
    Pankuj Chachra
    ------------------------------

    Original Message


  • 3.  RE: Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Thu October 15, 2020 10:41 AM
    Hi Sachin,

    From the Logs it looks like aspera datatransfer from Publisher to MDC has failed. Make sure following 2 steps are done for Aspera client to successfully communicate with HST server on the MDC side.

    1. Public key generated during setup security step has to be copied to server side. Make sure is 'Securing MDM Publisher with the Master Data Connect service in IBM Cloud Pak for Data' is followed in below link.

    https://www.ibm.com/support/knowledgecenter/en/SSWSR9_11.6.0/com.ibm.swg.im.mdmhs.publisher.doc/topics/pub_config-auth-pub-mdc.html#pub_config-auth-pub-mdc__auth-openshift.

    2. MDC (Aspera HST Server) side port has to be made publicly available for Aspera server communicate.

       Port: 31000 (ensure UDP and TCP)

    Regards,

    Srini



    ------------------------------
    SRINIVASA PARKALA
    ------------------------------

    Original Message


  • 4.  RE: Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Thu October 15, 2020 12:14 PM
    Hi Sachin,
    Also can you check the following folder
    "/usr/ibmpacks/mdmpublisher/0.1.1/publisher/output/TestSubVersion1/" to see if this contains targetdetails.properties

    Thanks and Regards
    Prabhakaran R.

    ------------------------------
    PRABHAKARAN RAMALINGAM
    ------------------------------

    Original Message


  • 5.  RE: Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Thu October 15, 2020 12:17 PM
    To add to Srini's point, you may want to take a look at the logs of the Aspera Client pod - it might give you an idea of what exactly may have gone wrong.

    ------------------------------
    Dmitriy Drinfeld
    ------------------------------

    Original Message


  • 6.  RE: Error While Loading Data from Publisher UI which connects MDM db2 to Master data Connect

    Posted Thu October 15, 2020 12:17 PM
    Hi Sachin, thanks for bringing this to our attention! We certainly have been able to get data into MDC on CP4D using the route that you're taking. Its strange that you're not able to see the `/usr/ibmpacks/mdmpublisher/0.1.1/publisher/output/TestSubVersion1/targetdetails.properties`in the Publisher pod. Could you please check the contents of the `/usr/ibmpacks/mdmpublisher/0.1.1/publisher/output/TestSubVersion1` directory and share your findings? We've not seen an issue with this file being created. Additionally could you please check the logs of the Aspera client pod to see if there are any related exceptions visible there? This would shed more light on the possible cause.

    ------------------------------
    Dmitriy Drinfeld
    ------------------------------

    Original Message