AIOps

 View Only

WAIOps v3.3 - Part 10 : Training

By Jeya Gandhi Rajan M posted Fri May 06, 2022 12:27 PM

  

This article explains about how to do Training for the following in Watson AIOps.

  • Log Anomaly detection
  • Similar Incidents

The article is based on the the following

  • RedHat OpenShift 4.8 on IBM Cloud (ROKS)
  • Watson AIOps 3.3.0

1. Training - Log Anomaly Detection

1.1. Disable Humio Data Flow

Need to disable the Dataflow before generating the load in the application.

  1. Make sure the humio DataFlow is disabled.

ilender

  1. If it is not disabled then disable it.

1.2. Application

We use iLender application here.

Refer : here to know how the app is deployed.

ilender

1.3. Generate Load

Generate load in the application for 20 minutes by refering 21-application-load-generation.

You need to have 10K lines of logs for each service in the application.

This script will run for 20 minutes and stop.

1.4. Enable Humio Data Flow

Need to enable the Dataflow before starting the training.

  1. Make sure the humio DataFlow is enabled.

  2. Enter the below field values

  • Custom : On
  • Start Date: Yesterday date
  • End Date: Tomorrow date

ilender

1.5. Do Training

  1. Goto the page AI Model Management

ilender

  1. Click on Manage tab

ilender

  1. Click on log-anomaly-detection link

ilender

  1. Click on Edit Data icon in the Log Data section.

ilender

  1. Enter the below field values
  • Custom : On
  • Start Date: Yesterday date
  • End Date: Tomorrow date
  1. Click on Save

ilender

  1. Click on Start Training link

ilender

The training would start and go for 20 minutes to 1 hour based on the data size.

You will have Training Complete status once the training is done.

Training is Queued

ilender

Training is Queued, but the data is analysed and data quality is good.

ilender

Data Retrieval is completed.

ilender

Training is completed. ilender

  1. Click on Versions tab

You can see the version trained and deployed.

ilender

  1. Click on Coverage tab

You can see the iLender application is covered.

ilender

  1. Click on View Resources button

ilender

You can see the no. of log lines.

ilender

2. Training - Similar Incidents

2.1. Pre Requisite

Sample Incidents for Training

Atleast 5 incidents should have been created in service-now, resolved with proper resolve comments and closed.

Here are the sample incidents from service now.

ServiceNow

You can refer to this link to create these incidents in sevicenow. https://github.com/ibm-ecosystem-lab/watson-ai-ops-snow/tree/main/01-snow-incidents

2.2. Enable Data flow for Training

Need to enable the Dataflow before starting the training.

  1. Make sure the ServiceNow DataFlow is enabled.

  2. Enter the below field values

  • Custom : On
  • Start Date: Yesterday date
  • End Date: Tomorrow date
  • Mode: Historical ....

ServiceNow

2.3. Start Training

  1. Goto the page AI Model Management

ilender

  1. Click on Manage tab

ilender

  1. Click on similar-incidents-configuration link

ilender

  1. Click on Start Training link.

ServiceNow

  1. Training starts

The training may take 2 to 5 minutes based on the data size.

Training is Queued

ServiceNow

Data is analysed and data quality is good.

ServiceNow

Training is completed.

ilender

  1. Click on Versions tab

You can see the version trained and deployed.

ilender

  1. Click on Coverage tab

You can see the iLender application is covered.

ilender


#howto
#Training
#loganamoly
#LogAnalysis
#CloudPakforWatsonAIOps
#cp4aiops
#incident
#install
#configure
#ServiceNow
0 comments
3 views

Permalink