Hi Mohan,
Benchmarks or performance data isn't provided for the MQ Kafka connectors as the available throughput will be defined by your topology. Considerations should be made for:
- Where you are running the connectors and whether message order retention is required
- How many worker tasks you define (based on your message order requirement above)
- Whether you are running the connector in Client or Bindings mode (the Kafka Connector is an MQ connector)
- Number of topic replicas that the message needs to be written to
- The acknowledgement level. I believe that the MQ connectors are acks=all so every replica will have to receive the message before completion
The best way to validate this is to configure your test environment to replicate your deployment and test your expected maximum throughput that you are wanting.
Regards
Ed
------------------------------
Edward Altenburger
------------------------------
Original Message:
Sent: Sun February 27, 2022 04:14 AM
From: Mohan Radhakrishnan
Subject: Generating Workloads with a Kafka Producer Application
Hrllo,
We are thinking of streaming banking SMSs from MQ to local kafka ? It appears the connector is from IBM. Are there benchmarks for this ?
Thanks
------------------------------
Mohan Radhakrishnan
Original Message:
Sent: Mon August 17, 2020 06:54 PM
From: Ty HARRIS
Subject: Generating Workloads with a Kafka Producer Application
As you begin to validate the performance capabilities of your Kafka cluster, it's a good idea to have a firm understanding of your scaling, throughput, and performance requirement. The workload generator application lab allows you to generate like workloads that represents your environment.....
Read more at: https://community.ibm.com/community/user/imwuc/blogs/ty-harris1/2020/08/17/performance-test?CommunityKey=739928b5-06d5-452d-a013-f688dea8f64a&tab=
------------------------------
Ty HARRIS
------------------------------