Configuring IBM App Connect Enterprise to produce or consume messages from Kafka topics in IBM Event Streams requires careful configuration. In this post, I’ll share the steps I use that help me to avoid missing any required values. To illustrate this, I’ll create a simple App Connect flow...
IBM and Cloudera are taking a new step in their strategic partnership to bring advanced data and AI solutions to more organizations with deeper integration between Cloudera DataFlow (CDF) and IBM Cloud Pak for Data . The integration of DataFlow will build on the companies' existing...
You can use the K afka Producer node to publish messages that are generated from within your message flow to a topic that is hosted on a Kafka server. The published messages are then delivered by the Kafka server to all topic consumers (subscribers). You can use a Kafka Consumer node ...
We aim to provide regular quarterly mod releases for ACE 12, which contain both new features and regular maintenance: IBM App Connect Enterprise 12.0.1.0 was released in May 2021. IBM App Connect Enterprise 12.0.2.0 was released in September 2021 - more information here IBM App Connect...
3 Comments - no search term matches found in comments.
In this post, I’ll describe how to use App Connect Enterprise to process Kafka messages that were serialized to a stream of bytes using Apache Avro schemas. Background Best practice when using Apache Kafka is to define Apache Avro schemas with a definition of the structure of your...
The definition of “API” (Application Programming Interface) has changed yet again! In January 2018 I wrote “ What is an API? And What is the API Economy? ”, introducing a new definition for API. That definition while still true has become incomplete. But I’ve jumped ahead. So, let’s...
MirrorMaker 2 is the Apache Kafka tool for replicating data across two Kafka clusters. You can use it to make a copy of messages on your Kafka cluster to a remote Kafka cluster running on a different data centre, and keep that copy up to date in the background. In this post, I describe two...
Do you have a strategy for documenting the Apache Kafka topics used in your organisation? I think you should. But before I give you a few reasons why, let me tell you a short story. It's a normal day at work when your boss comes to talk to you. They have a new project for you. An...
Co-author - Mohammed Asif Kundgol Kafka streams data between two applications and is often used to perform real time analytics. It passes data between producers and consumers using message based topics inside a Kafka cluster . It's durability and ability to scale make it a popular...
1 Comment - no search term matches found in comments.
INTRODUCTION As you begin to validate the performance capabilities of your Kafka cluster, it’s a good idea to have a firm understanding of your scaling, throughput, and performance requirement. The workload generator application allows you to generate like workloads that represents your...