watsonx.data

watsonx.data

Put your data to work, wherever it resides, with the hybrid, open data lakehouse for AI and analytics

 View Only

watsonx.data OpenTelemetry : See metrics in Instana

By MIKA SHIMOGAWA posted 13 hours ago

  

In this article, I want to show you the steps to see metrics using watsonx.data 2.1.3 using Instana.
After you configure OpenTelemetry in watsonx.data using Instana as the backend, next step is to see telemetry data using Instana User Interface.
If you don't configure it yet, my blog watsonx.data OpenTelemetry : Overview and Configuration will help you.

  

watsonx.data OpenTelemetry Overview

In watsonx.data 2.1.3 and 2.2.0, OpenTelemetry is supported for Presto (Java) engine and Milvus service.
Metrics in OpenTelemetry provide numerical measurements that reflect the performance, health, or behavior of a system, such as request counts, error rates, or resource utilization over time.

image.png

Steps to see metrics of Presto and Milvus in Instana

  1. Check your watsonx.data Instance id. From the navigation menu of watsonx.data console, select "ⓘ Instance details". You will find watsonx.data Instance ID.
    image.pngIn this article, I use instance id "1749042785755359".

  2. In the Instana web user interface, select Analytics -> Infrastructureimage.png

  3. Select OpenTelemetry.image.png

  4. Look for an entry with a watsonx.data instance ID. I found 2 entries which has watsonx.data instance id "1749042785755359" as follows.

    • localhost:8081@milvus-1749042785755359
    • localhost:9090@presto-jmx-1749042785755359

Metrics are displayed as follows. Click the metrics you want to see.image.png

Presto Metrics

When you open the Presto metrics, a lot of indicators will be listed. In my case, the number has exceeded 3000 and a warning message has been shown. In watsonx.data 2.2.0, feature "Customizing Instana dashboards" is available.
You can search metrics you are interested in. Here, I input 'watsonx_data_presto_memory_pool' as search keyword to pick up memory-related information. I expand presto_memory_pool_general_reserved_bytes of Presto worker0 as example.

image.png
Note: As of watsonx.data 2.1.3, OpenTelemetry does not support Presto (C++), but diagnostic data is sent from the Presto (C++) coordinator.

  

Milvus Metrics

When you open the Milvus metrics, a lot of indicators will be listed also.

image.png

  

References for Metrics

Below are some explanation about metrics of Presto(Java) Engine and Milvus Service.

  

Conclusion

In this article, I introduced the steps to see Presto and Milvus metrics in Instana. Because they have many indicators, I also listed reference documents which explain them.

  

Environment

The example in this topic introduced is run in the following environment.

  • OCP Version : 4.16
  • CP4D 5.1.3 , watsonx.data 2.1.3
    • Presto engines
      • Presto (Java) v0.286 / Size : Starter
      • Presto (C++) v0.286 / Size : Starter
    • Milvus service : Version v2.5.0 / Size : Small
  • Instana (June 2025)

#watsonx.data
0 comments
2 views

Permalink