AIOps

 View Only

  • 1.  Watson AIOps EventManager limitation

    Posted Mon June 06, 2022 08:14 AM
    We are planning to evolve the "on premises" NOI to the Watson AIOps solution.

    We have some doubts:

    1. The NOI ObjectServer has limitations on the number of active alarms. The recommendation is not to exceed 80,000 alarms;
    2. Because of this limitation, our solution has THREE ObjectServer Towers (partitions);
    3. One of the AIOps EventManager components is the ObjectServer;
    4. Does the EventManager ObjectServer still have the same limitations as the NOI ObjectServer?
    5. In the new architecture, Watson AIOps, can we consider that there will be no need for three or more ObjectServer towers?
    6. What are the main factors to consider when configuring the Watson AIOps EventManager?

    Is there any document that describes the main features of EventManager? Best Practices?

    We appreciate all your attention and support.


    ------------------------------
    Antonio Gadelha
    ------------------------------


  • 2.  RE: Watson AIOps EventManager limitation

    Posted Tue June 07, 2022 08:52 AM
    Antonio,

    If you are in the planning phase to modernize your NOI>Watson AIOps solution, I would use this as an opportunity to truly understand the cause and the need to maintain 80K events in the object server.  Where are the events coming from?  Are these actionable? Or are they noise?  Can they be eliminated at the source?  Can some of them just be deduplicated by triggers?

    In my former role, we would always look for opportunities to reduce noise during every upgrade.

    If there is truly a need to maintain a record of the event (without necessarily taking action on them, or creating a ticket in the ITSM tool), may I suggest leveraging the historical reporter.status table in a TDW.  Let all the events come into the object server, allow the JDBC Gateway to create the historical record in reporter.status, but use a trigger-based policy to automatically drop/clear the un-actionable event after x minutes.

    Good luck,

    O.J.

    ------------------------------
    OJ ROSS DUA
    ------------------------------

    Original Message


  • 3.  RE: Watson AIOps EventManager limitation

    IBM Champion
    Posted Tue June 07, 2022 10:15 AM
    Good day Antonio

    My recommendation is that you forward events from your existing NOI environment to Watson AIOps Event Manager.  You can send events from all 3 your ObjectServers across to Event Manager.  From my understanding, it will be able to take the load.

    As O.J. says, you can at this point decide which events should be discarded and which passed through.  Or you can send all the events across so that you can do proper analysis of all events for the time-based grouping and seasonality.

    The main reason I am suggesting adding the Watson AIOps as an extension to your environment, rather than replacing it, is that there is still a lot of functionality and configurability in NOI that has not been migrated to or implemented in Watson AIOps Event Manager.  One of the things that can't yet be done in Watson AIOps Event Manager are Triggers and Automations.  A lot of our customers make use of these and so to keep the functionality, forwarding from NOI to Watson AIOps makes sense.

    The other reason is that it is also a faster time to value doing it like this, rather than trying to replace all the customisation work you have already done, in terms of probe configuration, additional fields, triggers, etc.in Watson AIOps.

    I hope this helps.

    Kind regards,
       Birgit

    Birgit Smythe, Managing Director
    Envisage Solutions (Pty) Ltd.
    15 Years of Netcool Excellence
    Cell : +27 84 424 7448
    Office: 086 000 0773 / +27 12 644 2987
    Social : Website - Twitter - Facebook  - LinkedIn

    We are technical leaders in Netcool and IBM APM

    Email Disclaimer: Please note this email is subject to conditions set out at http://envisage.solutions/email-policy/



    Original Message


  • 4.  RE: Watson AIOps EventManager limitation

    IBM TechXchange Speaker
    Posted Wed June 08, 2022 09:56 AM

    Thanks all for providing insights.
    I'd like to add one clarification:

    >The main reason I am suggesting adding the Watson AIOps as an extension to your environment, rather than replacing it, is that there is still a lot of functionality >and configurability in NOI that has not been migrated to or implemented in Watson AIOps Event Manager. One of the things that can't yet be done in Watson >AIOps Event Manager are Triggers and Automations. A lot of our customers make use of these and so to keep the functionality, forwarding from NOI to Watson >AIOps makes sense

    Watson AIOps Event Manager exists in two configuration:

    1. Hybrid (https://www.ibm.com/docs/en/noi/1.6.4?topic=installing-hybrid)
    2. Full OCP  (https://www.ibm.com/docs/en/noi/1.6.4?topic=installing-red-hat-openshift)

    With 1., as it leverages an existing VM based OMNIbus/IMpact deployment, you can take advantage of existing Netcool features and configs.
    2 is very similar, but it has limitations from a scale perspective, as @john postoyko outlines below.

    From the sizings you are outlining here, 1. might be the most suitable config for you.

    ------------------------------
    Isabell Sippli
    ------------------------------

    Original Message


  • 5.  RE: Watson AIOps EventManager limitation

    Posted Wed June 08, 2022 07:13 AM
    O.J.

    Our architecture is designed to meet the Telco Environment, which has a significant volume of alarms as its basic characteristic. The daily volume is on the order of 1,000,000 events.

    We are reviewing the architecture as a whole, including a reduction in the volume of active alarms.

    Thank you once again for your comments. They are of great value.


    ------------------------------
    Antonio Gadelha
    ------------------------------

    Original Message


  • 6.  RE: Watson AIOps EventManager limitation

    Posted Wed June 08, 2022 10:22 AM
    Hi Antonio,

    Our netcool customers are also Telcos and we have proposed an Hybrid deployment because of number of alerts received. A full OCP deployment, I don't recommend it since it can't manage a lot of alerts (it was reviewed with dev team & OM).

    For reducing number of active alerts, I recommend to check filter not just in the rules file but in the EMS source, some EMS are able to select what type of alerts to forward.

    Regards,
    Angel Nogueda
    IBM
    Mexico

    ------------------------------
    ANGEL NOGUEDA
    ------------------------------

    Original Message


  • 7.  RE: Watson AIOps EventManager limitation

    Posted Tue June 07, 2022 01:01 PM

    Hello Antonio

    Tiered architecture is currently not supported with WAIOPSs components on  OCP.

    If you are contemplating sending in events from multiple ObjectServers the max. number of standing events in the ObjectServer  running on OCP is currently 50,000 although this may very well increase with the next release

    Additional  performance characteristics of  EventManager are documented here :

    OCP :    https://www.ibm.com/docs/en/noi/1.6.4?topic=preparing-sizing


    You may opt to keep the existing on-prem ObjectServers and just install EventManager ( CNEA and ASM ) on OCP

    The recommended max standing row count of each  on-prem ObjectServer's is  100,000 - but there are still limits and considerations on how many events can be sent over to EventManager  see  :  https://www.ibm.com/docs/en/noi/1.6.4?topic=p-sizing

    Standing alarm count is just one measure of event count - a key metric would be the event rates  (eps) including updates that  you are currently seeing at the ObjectServers

    May I ask which aspect(s)  of WAIOPS are you particular interested in leveraging ?

    Please feel free to DM me should you not wish to answer these questions on the forum .

    kind regards

    John

    ( WAIOPs/Netcool Solution Architect )



    ------------------------------
    john postoyko
    IBM
    London
    ------------------------------

    Original Message


  • 8.  RE: Watson AIOps EventManager limitation

    Posted Tue June 07, 2022 03:41 PM
    Hi Antonio,

    As all mentioned, it is recommended to extend current NOI deployment with Event Manager (CNEA, RBA,UI, ASM). We have proposed it with our Netcool customer, instead of replace all NOI environment we proposed a Hybrid deployment.

    I hope it helps.

    Regards,
    Angel Nogueda
    IBM
    Mexico

    ------------------------------
    ANGEL NOGUEDA
    ------------------------------

    Original Message