IBM Z and LinuxONE - IBM Z

IBM Z

The enterprise platform for mission-critical applications brings next-level data privacy, security, and resiliency to your hybrid multicloud.

 View Only

IBM Z Common Data Provider 2Q2021 PTF supports streaming data to Humio via native Humio data ingestion

By Xin Zhe Wang posted Wed May 19, 2021 03:26 AM

  

In the IBM Z Common Data Provider 2.1.0 2Q2021 continuous delivery PTF UJ05617, the new feature for streaming data to Humio via native Humio data ingestion over HTTP or HTTPS was added.

Streaming data to Humio via Humio data ingestion over HTTP


To stream data to Humio over HTTP, configure the Humio subscriber in the Configuration Tool like Figure 1. 

The streaming protocol must be "CDP Humio via HTTP". Then specify the host name or IP address of the Humio subscriber and the port in which the Humio subscriber listens for data from IBM Z Common Data Provider. If the Humio server supports GZIP compression, you can set "Compression Type" to GZIP to significantly reduce the volume of data sent into Humio. The number of threads that will send data to Humio subscriber can also be specified. The value must range from 1 to 20 and the default value is 12. You must change it based on your environment resource. For more information about the environment resources required by Humio, see https://docs.humio.com/docs/installation/preparation/. Finally, copy the Ingest Token from the Humio subscriber like Figure 2.

Figure 1 A sample Humio subscriber configuration for streaming data to Humio over HTTP


Figure 2 Humio Ingest Token configuration interface



Streaming data to Humio via Humio data ingestion over HTTPS


To stream data to Humio over HTTPS, configure the Humio subscriber in the Configuration Tool like Figure 3. The streaming protocol must be "CDP Humio via HTTPS".

Figure 3 A sample Humio subscriber configuration for streaming data to Humio over HTTPS

 


Meanwhile, you must import the Humio certificate into the Data Streamer keystore by using the shell scripts provided by IBM Z Common Data Provider.

  • If you want to secure communication with self-signed certificate, run the setupDataStreamerSSL.sh script to create the Data Streamer keystore and run importCertificate.sh script to import the Humio public certificate into the Data Streamer keystore.
  • If you want to secure communication with non self-signed certificate, run the setupDataStreamerSSL_CA.sh script to store the Data Streamer keystore password and run the importCertificate_CA.sh script to import the CA certificate into the Data Streamer keystore.

 

IBM Z Common Data Provider provides detailed step-by-step guidance on how to stream data to Humio via native data ingestion.

The detailed procedure on how to stream data to Humio via data ingestion over HTTPS can be found here:

https://www.ibm.com/docs/en/zcdp/2.1.0?topic=configuring-securing-communications-between-data-streamer-its-subscribers

The detailed procedure on how to create Humio repository and set Humio repository ingest token can be found here:

https://www.ibm.com/docs/en/zcdp/2.1.0?topic=humio-preparing-send-data-directly

For additional information on what’s new in the IBM Z Common Data Provider 2Q 2021 PTF see:

https://www.ibm.com/docs/en/zcdp/2.1.0?topic=whats-new-in-version-210-may-2021

0 comments
6 views

Permalink