API Connect

 View Only

Using APIC Analytics data to train AI models

By Chris Dudley posted Thu March 07, 2024 04:54 AM


API Connect Analytics holds full information on all of your API events. This information can prove invaluable in training AI models using machine learning. Possible use cases could include training data for automated tests or for security anomaly detection.

IBM Cloud Pak for Data (CP4D) includes the means to train such models using data from a variety of data sources. It is not possible for CP4D to pull data direct from the internal Analytics database as the internal database is secured away with no external access. However, an easy workaround is to use analytics offload to an external database and then allow CP4D to load data from that external database. A variety of databases could be used - essentially anything that both APIC Analytics offload and CP4D support - but a simple starting point could be an external ELK stack (Elasticsearch Logstash Kibana). A list of supported datasources for CP4D can be found here: https://www.ibm.com/docs/en/cloud-paks/cp-data/4.8.x?topic=data-supported-sources

Documentation on how to configure APIC Analytics offload to ELK can be found here:

For OCP: https://www.ibm.com/docs/en/SSMNED_10.0.5/com.ibm.apic.install.doc/analytics_install_sample_output_plugins_ocp.html

For kubernetes: https://www.ibm.com/docs/en/SSMNED_10.0.5/com.ibm.apic.install.doc/analytics_install_offload_ex_k8s.html

For VMWare: https://www.ibm.com/docs/en/SSMNED_10.0.5/com.ibm.apic.install.doc/analytics_install_offload_ex_vm.html

Documentation on how to configure Cloud Pak for Data to access Elasticsearch can be found here: https://www.ibm.com/docs/en/cloud-paks/cp-data/4.8.x?topic=catalogs-elasticsearch-connection

Now that CP4D can access all the API Event records in the external Elasticsearch database the fun part of training your AI model can begin. This will obviously depend on your exact use case but the documentation here will guide you through how to create and train an AI model in CP4D using IBM Watson Machine Learning: https://www.ibm.com/docs/en/cloud-paks/cp-data/4.8.x?topic=deploying-managing-ai-assets