DataPower

DataPower

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
Expand all | Collapse all

How does DataPower communicate with multiple endpoints in a Kafka Cluster and multiple Kafka Clusters?

  • 1.  How does DataPower communicate with multiple endpoints in a Kafka Cluster and multiple Kafka Clusters?

    Posted Wed October 29, 2025 02:03 PM

    In this example how exactly does DataPower connect to the multiple endpoints, e.g. round-robin, top-down or all of them somehow?

    kafka-cluster "PublishCluster1"

      protocol ssl

      endpoint "111.domain.net" "38900"

      endpoint "222.domain.net" "38900"

      endpoint "333.domain.net" "38900"

      endpoint "444.domain.net" "38900"

    kafka-cluster "PublishCluster2"

      protocol ssl

      endpoint "555.domain.net" "38900"

      endpoint "666.domain.net" "38900"

      endpoint "777.domain.net" "38900"

      endpoint "888.domain.net" "38900"



    ------------------------------
    Shawn Clark
    ------------------------------


  • 2.  RE: How does DataPower communicate with multiple endpoints in a Kafka Cluster and multiple Kafka Clusters?

    Posted Wed October 29, 2025 05:21 PM

    Allow me to be wrong, but, the first host in a cluster is the default.  Others are added for failover and must be in the same cluster.

    It should go top down until it succeeds, and then the actual Kafka cluster itself should take care of the rest.



    ------------------------------
    Joseph Morgan
    CEO - Independent
    ------------------------------