IBM webMethods Hybrid Integration

IBM webMethods Hybrid Integration

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.



#Automation


#Applicationintegration
#webMethods
#Integration
 View Only
  • 1.  SAP integration - RFC - Large volume issues

    Posted 03/28/18 07:40 AM

    Hi All,

    webMethods integrating with SAP through RFC.

    When we call the RFC,through SAP adapter service, we are receiving large volume of data(5 lakh records).

    Integration server is getting hung/not responding when the adapter service is executed.

    Could you please let me know any possible solution to receive SAP large volume without any issues in wM.


    #webMethods
    #Integration-Server-and-ESB


  • 2.  RE: SAP integration - RFC - Large volume issues

    Posted 03/28/18 01:50 PM

    Hi Sree,

    please provide some version information about IS, SAP Adapter and JCo Libraries.

    Please check your IS configuration for proper java memory settings (you might need to increase these values to avoid swapping or OutOfMemory exceptions).

    You might want to rethink your implementation approach.

    Instead of directly processing the large volume just publish the splitted data to a Messaging provider, i.e. UM or Broker, and then listen to this messaging queue and process the data in smaller chunks.

    Regards,
    Holger


    #Integration-Server-and-ESB
    #webMethods


  • 3.  RE: SAP integration - RFC - Large volume issues

    Posted 04/02/18 04:39 PM

    Yes…Also please consider async approach using pub/sub to process that kind of large volumes records and work with your SAP team as well to send the records as in batches 100 or approx. per each run to the adapter from processing/performance point of views.

    Just my few cents!

    HTH,
    RMG


    #Integration-Server-and-ESB
    #webMethods


  • 4.  RE: SAP integration - RFC - Large volume issues

    Posted 04/03/18 03:29 PM

    I agree with RMG regarding batched processing.

    We have agreed with our SAP Partners that there should not be more than 100 IDocs in one master IDocList when sending IDoc to us.
    This is due to the fact that our IDocs can be quite large (about 1.500 fields which will be 150.000 fields in total plus EDI_DC40 control header).

    Regards,
    Holger


    #webMethods
    #Integration-Server-and-ESB


  • 5.  RE: SAP integration - RFC - Large volume issues

    Posted 04/03/18 03:48 PM

    Thanks all for your replies.

    @Holger,

    FYA…

    Description webMethods SAP Adapter
    Adapter Version - 7.1.0.16.906
    Updates
    SAP_7.1_Fix14
    SAP_7.1_Fix15
    SAP_7.1_Fix16
    JCo Version 3.0.14 (2015-12-16)
    JCo Middleware JavaRfc
    JCo Middleware Version 2.2.17
    JCo Native Library Version 721.619

    After doing some R&D , we understand like we cannot control the incoming records from SAP through RFC in webMethods.
    So we followed batch process, where SAP will divide 5Lakh records from their Master tables, into multiple files in a folder and webMethods will pick and process.

    Regards,
    Sree


    #webMethods
    #Integration-Server-and-ESB


  • 6.  RE: SAP integration - RFC - Large volume issues

    Posted 04/03/18 04:56 PM

    Sree…

    It sounds like a good plan and you might be using Al11 file based approach !!

    Cheers!
    RMG


    #Integration-Server-and-ESB
    #webMethods


  • 7.  RE: SAP integration - RFC - Large volume issues

    Posted 01/27/21 12:48 AM

    If this is still a challenge, have a look at this thread:


    #Integration-Server-and-ESB
    #webMethods