webMethods

webMethods

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only

Getting error in Kafka Adapter

  • 1.  Getting error in Kafka Adapter

    Posted Wed June 01, 2022 06:47 AM

    What product/components do you use and which version/fix level?

    10.5 Integration Server, Kafka adapter with Fix9

    Are you using a free trial or a product with a customer license?

    Customer License

    What are trying to achieve? Please describe in detail.

    Working on Kafka Interface.

    1. When I use simple schema without document/string list - I can publish the data to Kafka topic and I can consume from the Kafka topic (No issues in this schema)

    2. When I use complex schema with document/string list - I am able to consume the data when data is available at Kafka topic, but I am getting error while publishing the data to the topic.

    For both simple schema and complex schema, I have followed the same steps to create the interface. But Simple schema is working fine, for complex schema it is giving error while publishing.

    Do you get any error messages? Please provide a full error message screenshot and log file.

    com.wm.pkg.art.error.DetailedServiceException: [ART.117.4002] Adapter Runtime (Adapter Service): Unable to invoke adapter service POC_KafkaComplexSchema.adapterService:adapterServiceForComplex with connection POC_KafkaComplexSchema.connections:producerConnectionForComplex.
    [ADA.507.4010] Error sending kafka message
    Error serializing Avro message
    at com.wm.pkg.art.error.DetailedServiceException.create(DetailedServiceException.java:134)
    at com.wm.pkg.art.error.DetailedServiceException.create(DetailedServiceException.java:125)
    at com.wm.pkg.art.error.DetailedServiceException.create(DetailedServiceException.java:117)
    at com.wm.pkg.art.ns.AdapterServiceNode.invokeService(AdapterServiceNode.java:418)
    at com.wm.pkg.art.ns.ARTNSService.baseInvoke(ARTNSService.java:62)
    at com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:739)
    at wm.bci.internal.BciServiceInvokeNotifier.process(BciServiceInvokeNotifier.java:32)
    at com.wm.ps.serviceMock.ServiceInterceptor.process(ServiceInterceptor.java:360)
    at com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
    at com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:61)
    at com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:250)
    at com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:56)
    at com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:178)
    at com.wm.app.b2b.server.ACLManager.process(ACLManager.java:334)
    at com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:41)
    at com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:401)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:611)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:423)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:381)
    at com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:253)
    at com.wm.app.b2b.server.BaseService.invoke(BaseService.java:236)
    at com.wm.lang.flow.FlowInvoke.invoke(FlowInvoke.java:267)
    at com.wm.lang.flow.FlowState.invokeNode(FlowState.java:668)
    at com.wm.lang.flow.FlowState.step(FlowState.java:534)
    at com.wm.lang.flow.FlowState.invoke(FlowState.java:501)
    at com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(FlowSvcImpl.java:1150)
    at com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:739)
    at wm.bci.internal.BciServiceInvokeNotifier.process(BciServiceInvokeNotifier.java:32)
    at com.wm.ps.serviceMock.ServiceInterceptor.process(ServiceInterceptor.java:360)
    at com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
    at com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:61)
    at com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:250)
    at com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:56)
    at com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:178)
    at com.wm.app.b2b.server.ACLManager.process(ACLManager.java:334)
    at com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:41)
    at com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:401)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:611)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:423)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:381)
    at com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:253)
    at com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:127)
    at com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:163)
    at com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:223)
    at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:430)
    at com.wm.util.pool.PooledThread.run(PooledThread.java:134)
    at java.lang.Thread.run(Thread.java:748)
    Caused by: com.wm.adk.error.AdapterServiceException: [ADA.507.4010] Error sending kafka message
    Error serializing Avro message
    at com.wm.adk.error.AdapterException.(AdapterException.java:311)
    at com.wm.adk.error.AdapterException.(AdapterException.java:270)
    at com.wm.adk.WmAdapter.createAdapterException(WmAdapter.java:201)
    at com.wm.adapter.wmkafka.pubsub.KafkaPublisher.publish(KafkaPublisher.java:84)
    at com.wm.adapter.wmkafka.connection.KafkaProducerConnection.write(KafkaProducerConnection.java:80)
    at com.wm.adapter.wmkafka.services.KafkaProducerService.execute(KafkaProducerService.java:245)
    at com.wm.adk.cci.interaction.WmInteraction.execute(WmInteraction.java:76)
    at com.wm.pkg.art.ns.AdapterServiceNode.invokeService(AdapterServiceNode.java:368)
    … 43 more
    Caused by: org.apache.kafka.common.errors.SerializationException: Error serializing Avro message
    Caused by: java.lang.ClassCastException: java.util.ArrayList cannot be cast to org.apache.avro.generic.IndexedRecord
    at org.apache.avro.generic.GenericData.getField(GenericData.java:825)
    at org.apache.avro.generic.GenericData.getField(GenericData.java:844)
    at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:204)
    at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:195)
    at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:130)
    at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:82)
    at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:206)
    at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:195)
    at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:130)
    at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:82)
    at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:206)
    at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:195)
    at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:130)
    at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:82)
    at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:206)
    at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:195)
    at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:130)
    at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:82)
    at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:72)
    at io.confluent.kafka.serializers.AbstractKafkaAvroSerializer.serializeImpl(AbstractKafkaAvroSerializer.java:101)
    at io.confluent.kafka.serializers.KafkaAvroSerializer.serialize(KafkaAvroSerializer.java:53)
    at org.apache.kafka.common.serialization.Serializer.serialize(Serializer.java:62)
    at org.apache.kafka.clients.producer.KafkaProducer.doSend(KafkaProducer.java:902)
    at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:862)
    at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:750)
    at com.wm.adapter.wmkafka.pubsub.KafkaPublisher.publish(KafkaPublisher.java:65)
    at com.wm.adapter.wmkafka.connection.KafkaProducerConnection.write(KafkaProducerConnection.java:80)
    at com.wm.adapter.wmkafka.services.KafkaProducerService.execute(KafkaProducerService.java:245)
    at com.wm.adk.cci.interaction.WmInteraction.execute(WmInteraction.java:76)
    at com.wm.pkg.art.ns.AdapterServiceNode.invokeService(AdapterServiceNode.java:368)
    at com.wm.pkg.art.ns.ARTNSService.baseInvoke(ARTNSService.java:62)
    at com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:739)
    at wm.bci.internal.BciServiceInvokeNotifier.process(BciServiceInvokeNotifier.java:32)
    at com.wm.ps.serviceMock.ServiceInterceptor.process(ServiceInterceptor.java:360)
    at com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
    at com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:61)
    at com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:250)
    at com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:56)
    at com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:178)
    at com.wm.app.b2b.server.ACLManager.process(ACLManager.java:334)
    at com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:41)
    at com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:401)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:611)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:423)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:381)
    at com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:253)
    at com.wm.app.b2b.server.BaseService.invoke(BaseService.java:236)
    at com.wm.lang.flow.FlowInvoke.invoke(FlowInvoke.java:267)
    at com.wm.lang.flow.FlowState.invokeNode(FlowState.java:668)
    at com.wm.lang.flow.FlowState.step(FlowState.java:534)
    at com.wm.lang.flow.FlowState.invoke(FlowState.java:501)
    at com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(FlowSvcImpl.java:1150)
    at com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:739)
    at wm.bci.internal.BciServiceInvokeNotifier.process(BciServiceInvokeNotifier.java:32)
    at com.wm.ps.serviceMock.ServiceInterceptor.process(ServiceInterceptor.java:360)
    at com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
    at com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:61)
    at com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:250)
    at com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:56)
    at com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:178)
    at com.wm.app.b2b.server.ACLManager.process(ACLManager.java:334)
    at com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:41)
    at com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:401)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:611)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:423)
    at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:381)
    at com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:253)
    at com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:127)
    at com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:163)
    at com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:223)
    at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:430)
    at com.wm.util.pool.PooledThread.run(PooledThread.java:134)
    at java.lang.Thread.run(Thread.java:748)

    Have you installed latest fixes for the products

    Currently we are in Kafka Fix9


    #webMethods
    #Integration-Server-and-ESB