App Connect

App Connect

Join this online user group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  Manual offset commit of Kafka msg in ACE flow

    Posted Fri November 17, 2023 05:36 PM
    Is there a way to commit offset in kafka consumer node manually in ACE flow while there is an exception in the middle of the flow after consuming msg from kafka consumer node.


    ------------------------------
    Arun Kumar Gughanandam
    ------------------------------


  • 2.  RE: Manual offset commit of Kafka msg in ACE flow

    Posted Thu November 23, 2023 02:47 PM

    Certainly, when dealing with Kafka consumers in an ACE (App Connect Enterprise) flow, you can manually commit offsets to ensure message processing integrity, especially in the presence of exceptions. To handle exceptions gracefully, use a try-catch block. Inside the catch block, include logic to commit the offset, ensuring that even if an exception occurs, the consumer's offset is updated to prevent message reprocessing upon recovery. This approach enhances the reliability and consistency of your ACE flow in Kafka message consumption scenarios.



    ------------------------------
    Charles Douthart
    ------------------------------



  • 3.  RE: Manual offset commit of Kafka msg in ACE flow

    Posted Thu November 23, 2023 03:33 PM

    Thanks! Charles. Which variable do we use to commit the offset in ACE flow manually. 



    ------------------------------
    Arun
    ------------------------------



  • 4.  RE: Manual offset commit of Kafka msg in ACE flow

    Posted Thu November 30, 2023 04:10 PM

    Reposting the query, if anyone can guide on how to manually commit a offset in kafka in ACE.



    ------------------------------
    Arun
    ------------------------------