Maximo

 View Only
Expand all | Collapse all

Using Maximo's Kafka client to publish updates to a data lake?

  • 1.  Using Maximo's Kafka client to publish updates to a data lake?

    Posted Mon February 27, 2023 06:10 AM

    Hi,

    We're currently considering options how to emit changes in Maximo data to a data lake. The two options being considered are 1) using a database connector to listen row level changes on the DB layer, or 2) configuring a bunch of Publish Channels to push changes to a Kafka server. 

    I think there are certain benefits with the Publish channel approach, like being able to define meaningful Object Structures in Maximo versus having to piece data together in the data lake (or downstream) from individual database tables.

    What I'm not sure of is what is the computing footprint of using Publish Channel / Kafka client? We might end up with quite a few Publish Channels if we follow that approach. Is there a possibility that this could cause significant load / delay when saving records in Maximo?


    Gratefully,




    ------------------------------
    Antti Kalliomaki
    Fingrid Plc
    ------------------------------



    #MaximoIntegrationandScripting
    #AssetandFacilitiesManagement
    #Maximo