Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi,

Thank you for your feedback, can you share with me the details for the PoC you have done.

Thanks

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi Largou,

Many thanks, the version is WebSphere Application Server Version 20.0.0.6 Liberty - (20.0.0.6-cl200620200528-0414)

I'm testing on my Laptop, so it is not a problem with the proxy or internet connection.

I also tried find command but also can not find the *.esa. 

Any other hints?

Thank you so much for your support.

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi,

Please the link below (and rename to .esa) :

https://github.com/cpmoore/waslp-prometheusExporter/releases

Good Luck

Hi Largou,

Many thanks, the version is WebSphere Application Server Version 20.0.0.6 Liberty - (20.0.0.6-cl200620200528-0414)

I'm testing on my Laptop, so it is not a problem with the proxy or internet connection.

I also tried find command but also can not find the *.esa. 

Any other hints?

Thank you so much for your support.

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Nguyen, depending on what your needs are you may be able to use the mpMetrics-2.3 feature for Liberty.

- provides a "Prometheus-format" endpoint (/metrics)

- the endpoint includes metrics from the server's JMX MXBeans

- the endpoint includes metrics added to your apps using the MicroProfile Metrics API

see https://openliberty.io/docs/20.0.0.12/introduction-monitoring-metrics.html for details on setting up the mpMetrics-2.3 feature

see https://grafana.com/grafana/dashboards/11706 for Grafana dashboard that goes with that feature

That said, I realize that PrometheusExporter that Largou is pointing to does some different things than the mpMetrics feature -- just thought I'd share this as an option.

Hi,

Please the link below (and rename to .esa) :

https://github.com/cpmoore/waslp-prometheusExporter/releases

Good Luck

Hi Largou,

Many thanks, the version is WebSphere Application Server Version 20.0.0.6 Liberty - (20.0.0.6-cl200620200528-0414)

I'm testing on my Laptop, so it is not a problem with the proxy or internet connection.

I also tried find command but also can not find the *.esa. 

Any other hints?

Thank you so much for your support.

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Nguyen, depending on what your needs are you may be able to use the mpMetrics-2.3 feature for Liberty.

- provides a "Prometheus-format" endpoint (/metrics)

- the endpoint includes metrics from the server's JMX MXBeans

- the endpoint includes metrics added to your apps using the MicroProfile Metrics API

see https://openliberty.io/docs/20.0.0.12/introduction-monitoring-metrics.html for details on setting up the mpMetrics-2.3 feature

see https://grafana.com/grafana/dashboards/11706 for Grafana dashboard that goes with that feature

That said, I realize that PrometheusExporter that Largou is pointing to does some different things than the mpMetrics feature -- just thought I'd share this as an option.

Hi,

Please the link below (and rename to .esa) :

https://github.com/cpmoore/waslp-prometheusExporter/releases

Good Luck

Hi Largou,

Many thanks, the version is WebSphere Application Server Version 20.0.0.6 Liberty - (20.0.0.6-cl200620200528-0414)

I'm testing on my Laptop, so it is not a problem with the proxy or internet connection.

I also tried find command but also can not find the *.esa. 

Any other hints?

Thank you so much for your support.

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi Sattler,

For the PrometheusExporter:

I downloaded the PrometheusExporter1.0.0.esa to my folder Downloads and used the command here and see it can be installed successfully.

featureManager install prometheusExporter --location=c:\temp\download --acceptLicense

And then I configured in the server.xml but when I tried the url. I can't see it work http(s)://{host}:{port}/prometheusExporter/{configured_path}

Do you have any hint?

<featureManager>
<feature>jsp-2.3</feature>
<feature>servlet-3.1</feature>
<feature>monitor-1.0</feature>
<feature>ssl-1.0</feature>
<feature>appSecurity-2.0</feature>
<feature>adminCenter-1.0</feature>
<feature>prometheusExporter</feature>
</featureManager>

Nguyen, depending on what your needs are you may be able to use the mpMetrics-2.3 feature for Liberty.

- provides a "Prometheus-format" endpoint (/metrics)

- the endpoint includes metrics from the server's JMX MXBeans

- the endpoint includes metrics added to your apps using the MicroProfile Metrics API

see https://openliberty.io/docs/20.0.0.12/introduction-monitoring-metrics.html for details on setting up the mpMetrics-2.3 feature

see https://grafana.com/grafana/dashboards/11706 for Grafana dashboard that goes with that feature

That said, I realize that PrometheusExporter that Largou is pointing to does some different things than the mpMetrics feature -- just thought I'd share this as an option.

Hi,

Please the link below (and rename to .esa) :

https://github.com/cpmoore/waslp-prometheusExporter/releases

Good Luck

Hi Largou,

Many thanks, the version is WebSphere Application Server Version 20.0.0.6 Liberty - (20.0.0.6-cl200620200528-0414)

I'm testing on my Laptop, so it is not a problem with the proxy or internet connection.

I also tried find command but also can not find the *.esa. 

Any other hints?

Thank you so much for your support.

Hi Nguyễn, 

Just to make sure, can you provide the liberty version used in your installation. For the command, it's trying to contact liberty external repository, if you have a disconnected environment, there is either the choice to configure a proxy : 

https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/twlp_featuremanager_proxy.html

Or : 

Try similar approach for the prometheusExporter instead of admincenter : https://www.ibm.com/support/knowledgecenter/SSEQTP_liberty/com.ibm.websphere.wlp.doc/ae/rwlp_command_featuremanager.html

Good Luck

Hi Largou,

I tried to do, but I could not be successfully.

I follow instruction in Github but it has a failure CWWKF1203E

D:\IBM\JazzTeamServer\server\liberty\wlp\bin>featureManager.bat install prometheusExporter-1.0.0.esa
This featureManager action is stabilized. Use installUtility install instead. The installUtility command is recommended for installation and repository-related actions.

Contacting IBM WebSphere Liberty Repository ...
CWWKF1203E: Unable to obtain the following features: prometheusExporter-1.0.0.esa. Ensure that the features are valid

Hi,

If it is using liberty, then you can check this integration :

cpmoore/waslp-prometheusExporter

GitHub		remove preview
cpmoore/waslp-prometheusExporter Prometheus JMX Exporter rewritten as a WebSphere Liberty feature This project creates a Liberty feature that reads mbeans from the server and exposes them in Prometheus format. If installed to a collective controller, the metrics from the collective members can also be exposed. Currently this repository exists as an eclipse project. View this on GitHub >

https://github.com/cpmoore/waslp-prometheusExporter

------------------------------
Largou walid

Original Message:
Sent: Mon December 21, 2020 01:05 PM
From: Nguyen Tu
Subject: Websphere ND integration with JMX Exporter

Hi all, 

I also have the same topic. I would like to monitor performance of jazz application running on liberty via jmx-exporter and Prometheus to Grafana Dashboard! I appriciate if you can help. 

Thanks

Hi,

Thank you for your feedback, glad to hear that is work in progress, i will be waiting to discuss it on the CAB meetings.

Hi Largou / Hermann,

I get what you mean about it being difficult to interface Prometheus to our JMX MBeans in WAS.  Something I want to share is that the WAS/Liberty observability squad is working on a Prometheus endpoint for WAS traditional, and a Grafana dashboard.

If that's something you'd be interested in hearing more about, we could get it onto the Customer Advisory Board (CAB) agenda for the new year.  I'm pretty excited about it as it will open up a new way of monitoring for WAS that quite a few folks have expressed interest in. 

Our intent is to make that endpoint (/metrics) have visibility to the entire WAS cell -- so that Prometheus could be set up to call one endpoint, on any server in the cell, and that endpoint would return metrics data for the entire cell.  That would ensure we can dynamically react to new nodes/servers being added to the cell and can also allow for high availability of the /metrics endpoint.

------------------------------
Don Bourne
WebSphere Observability Architect

Original Message:
Sent: Thu December 17, 2020 01:35 AM
From: Hermann Huebler
Subject: Websphere ND integration with JMX Exporter

Hey Largou,

thanks for sharing! Sounds interesting. But as the PMI MBeans in WAS are - imho - quite complex (also tried to use Jolokia to retrieve them but did not really succeed) I'm I've done a PoC to use the performance servlet to retrieve the data, parse the XML, write the data to an InfluxDb and graph the data from there using Graphana. That worked quite well and was implemented in Python. So if you just want to graph PMI data this approach could be implemented without having to create a Java agent.

------------------------------
Hermann Huebler
2innovate IT Consulting GmbH
Vienna
Austria

#IBMChampion

Original Message:
Sent: Tue December 15, 2020 06:00 AM
From: Largou walid
Subject: Websphere ND integration with JMX Exporter

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------

Hi,

Monitoring tools have evolved recently and are more open source oriented (Prometheus, Grafana, TICK...)

I find it a waste that these does not have plugins with solution like WebSphere ND, for example there is the Jboss, Wildfly, Tomcat and others that have specific configuration to have really amazing Dashboards.

So i'm calling out for WAS Experts/Developers to help me on those integration, will gladly collaborate on this. My goal is to create the following :
- Create a Websphere ND Grafana dashboard : Showing cells/nodes/servers ... i have already started on this one and any suggestions would be appreciated.
- Integrate JMX exporter with Websphere ND, to gather pmis and other metrics from it. (Check prometheus/jmx_exporter

GitHub		remove preview
prometheus/jmx_exporter JMX to Prometheus exporter: a collector that can configurably scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. View this on GitHub >

https://github.com/prometheus/jmx_exporter)

------------------------------
Largou walid
------------------------------