The IBM Z Common Data Provider 2Q2021 PTF UJ05617 is officially available! Want to know what new features are included in this PTF? You’ve come to the right place! Go through this blog for a brief introduction for all new features.
Supports new data types
Starting from 2Q2021 PTF, IBM Z Common Data Provider can collect and stream the following types of data:
- Full support of SMF 110_2_xx statistics records
- IMS records xFA and xF9 from BMC
- IMS records x01, x03, x5901, x5903
- Support RMF III CFACT, CHANNEL, CFOVER, CFSYS, ENCLAVE, DEVR
- New V2 SMF 70 data streams
- SMF 84 subtype 21
- SMF 115 and SMF 116 for MQ Version support
- Support WebSphere Liberty logs
Supports sending data to Kafka
IBM Z Common Data Provider supports streaming data to Kafka subscribers. Kafka is an open-source distributed event streaming platform. You can stream data to Kafka for further consumption.
Supports sending data to Humio
IBM Z Common Data Provider supports streaming data to Humio directly or via Logstash.
- To send data from IBM Z Common Data Provider to Humio via Logstash, configure Logstash by using the Logstash configuration files that are provided by IBM Z Common Data Provider.
- To stream data to Humio directly, you must create a Humio repository and set a Humio repository ingest token that allows you to send data to a specific repository.
Supports non self-signed certificates.
IBM Z Common Data Provider supports setting up secured communications between the Data Streamer and its subscribers with non self-signed certificates.
Supports batch load of SYSLOG data
The Log Forwarder can collect batch data of zOS-SYSLOG in data sets. With this function, IBM Z Common Data Provider can send historical log data to zAware through Kafka for initial training.
Supports DVIPA for its components
IBM Z Common Data Provider components can be configured to use a dynamic virtual IP address (DVIPA). This feature is currently available for the Data Streamer, System Data Engine, and Log Forwarder on the same LPAR only.
Supports filtering SMF Data collection in a shared log stream
The System Data Engine added the parameter IBM_SDE_LS_RECORD that specifies how to retrieve local SMF data from a shared log stream. Change the value of this parameter accordingly when you configure the System Data Engine.
CA-ACF2 SMF non-default record type
The System Data Engine added the parameter IBM_SDE_ACF2_RTY that specifies CA-ACF2 SMF non-default record type. The default record type of CA-ACF2 is 230, which is set in the definition file. You can dynamically specify the SMF record type of CA-ACF2 by setting the variable IBM_SDE_ACF2_RTY in HBOIN of System Data Engine started task procedure.
Supports capturing metrics for streaming data
The Data Streamer can enable the metrics capture function to generate a metric statistics report to record how much data have been ingested to various subscribers. The metrics statistics report can be output to the console log and sent to all the subscribers.
Supports turning on and off statistics data for the System Data Engine while running
The System Data Engine can turn on and off statistics data after startup. For System Data Engine, statistics data shows the number of SMF records that it collects. From the data, you can see whether you have collected the records you want to collect, and how many records you collected.
Supports turning on trace for the Data Streamer while running
The Data Streamer can turn on dynamic tracing by using the MVS™ MODIFY command after startup. Trace settings that are changed by using the MVS MODIFY command are not persistent and therefore have no effect when the Data Streamer is restarted.
That’s all for the brief introduction of new features in the IBM Z Common Data Provider 2Q2021 PTF. For more information about the details of these features, see the official IBM Documentation.