webMethods

webMethods

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  SAP integration - RFC - Large volume issues

    Posted Wed March 28, 2018 07:40 AM

    Hi All,

    webMethods integrating with SAP through RFC.

    When we call the RFC,through SAP adapter service, we are receiving large volume of data(5 lakh records).

    Integration server is getting hung/not responding when the adapter service is executed.

    Could you please let me know any possible solution to receive SAP large volume without any issues in wM.


    #webMethods
    #Integration-Server-and-ESB


  • 2.  RE: SAP integration - RFC - Large volume issues

    Posted Wed March 28, 2018 01:50 PM

    Hi Sree,

    please provide some version information about IS, SAP Adapter and JCo Libraries.

    Please check your IS configuration for proper java memory settings (you might need to increase these values to avoid swapping or OutOfMemory exceptions).

    You might want to rethink your implementation approach.

    Instead of directly processing the large volume just publish the splitted data to a Messaging provider, i.e. UM or Broker, and then listen to this messaging queue and process the data in smaller chunks.

    Regards,
    Holger


    #Integration-Server-and-ESB
    #webMethods


  • 3.  RE: SAP integration - RFC - Large volume issues

    Posted Mon April 02, 2018 04:39 PM

    Yes…Also please consider async approach using pub/sub to process that kind of large volumes records and work with your SAP team as well to send the records as in batches 100 or approx. per each run to the adapter from processing/performance point of views.

    Just my few cents!

    HTH,
    RMG


    #Integration-Server-and-ESB
    #webMethods


  • 4.  RE: SAP integration - RFC - Large volume issues

    Posted Tue April 03, 2018 03:29 PM

    I agree with RMG regarding batched processing.

    We have agreed with our SAP Partners that there should not be more than 100 IDocs in one master IDocList when sending IDoc to us.
    This is due to the fact that our IDocs can be quite large (about 1.500 fields which will be 150.000 fields in total plus EDI_DC40 control header).

    Regards,
    Holger


    #webMethods
    #Integration-Server-and-ESB


  • 5.  RE: SAP integration - RFC - Large volume issues

    Posted Tue April 03, 2018 03:48 PM

    Thanks all for your replies.

    @Holger,

    FYA…

    Description webMethods SAP Adapter
    Adapter Version - 7.1.0.16.906
    Updates
    SAP_7.1_Fix14
    SAP_7.1_Fix15
    SAP_7.1_Fix16
    JCo Version 3.0.14 (2015-12-16)
    JCo Middleware JavaRfc
    JCo Middleware Version 2.2.17
    JCo Native Library Version 721.619

    After doing some R&D , we understand like we cannot control the incoming records from SAP through RFC in webMethods.
    So we followed batch process, where SAP will divide 5Lakh records from their Master tables, into multiple files in a folder and webMethods will pick and process.

    Regards,
    Sree


    #webMethods
    #Integration-Server-and-ESB


  • 6.  RE: SAP integration - RFC - Large volume issues

    Posted Tue April 03, 2018 04:56 PM

    Sree…

    It sounds like a good plan and you might be using Al11 file based approach !!

    Cheers!
    RMG


    #Integration-Server-and-ESB
    #webMethods


  • 7.  RE: SAP integration - RFC - Large volume issues

    Posted Wed January 27, 2021 12:48 AM

    If this is still a challenge, have a look at this thread:


    #Integration-Server-and-ESB
    #webMethods