Data Integration

  • 1.  Collecting statistics non-stop and without the console

    Posted Fri June 05, 2020 12:33 PM
    I am looking for a way to collect performance statistics non-stop in an unattended manner  that  is without the need to having the console open.

    Anyone has been able to do that ?

    ------------------------------
    Jean-Francois Fortin
    ------------------------------


    #DataIntegration
    #DataReplication


  • 2.  RE: Collecting statistics non-stop and without the console

    Posted Wed June 10, 2020 02:27 AM
    Hello
    You can use chcclp scripting to do this for any current CDC engine apart from Event Server, and you can use the CDC Java APIs for any engine.

    ------------------------------
    Robert Philo
    ------------------------------



  • 3.  RE: Collecting statistics non-stop and without the console

    Posted Mon June 15, 2020 01:26 PM
    Thanks was able to scrpt something to grab what I needed

    ------------------------------
    Jean-Francois Fortin
    ------------------------------



  • 4.  RE: Collecting statistics non-stop and without the console

    Posted Wed June 10, 2020 06:03 PM
    Check out the IIDR Stats Warehouse git repository: https://github.com/fketelaars/IIDR-Stats-Warehouse
    This is a very helpful utility using CHCCLP (which Robert mentioned) to continuously capture performance statistics and store them in a relational database or flat file. It is developed by an IBM colleague.

    ------------------------------
    Benedict Holste
    ------------------------------



  • 5.  RE: Collecting statistics non-stop and without the console

    Posted Fri June 12, 2020 03:25 PM
    Thanks Benedict.  Got it installed and running. Has anyone taken the next step to present this as a dashboard with streaming data ? Something like this along with visualization should have been provided out of the box.

    ------------------------------
    Manas Dasgupta
    ------------------------------



  • 6.  RE: Collecting statistics non-stop and without the console

    Posted Wed June 24, 2020 10:30 AM

    Management Console (MC) displays the real time bottleneck charts which identify which component(s) are resulting in the product latency to help track performance issues down easily.


    MC also has a real time statistics monitoring capability to chart the many hundreds of real time counters updated within the CDC pipeline.


    Internally, the product support team has a "stats buster" capability to take the historical statistics that are constantly captured by the CDC product and using dmsupportinfo package returned to the support team, the internal tools analyze using heuristics and AI to form recommendations on historical performance.

    And finally, as you see, there is an external CHCCLP API to capture statistics and pipe them to a database for review/graphing as needed.



    ------------------------------
    Glenn Steffler
    ------------------------------



  • 7.  RE: Collecting statistics non-stop and without the console

    Posted Mon June 15, 2020 01:28 PM
    Will sure be looking into this as soon as I get some free time.

    ------------------------------
    Jean-Francois Fortin
    ------------------------------