IBM webMethods Hybrid Integration

IBM webMethods Hybrid Integration

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.


#TechXchangePresenter
 View Only
Expand all | Collapse all

JDBC (Select) adapter service - Record selection limitation

  • 1.  JDBC (Select) adapter service - Record selection limitation

    Posted Thu May 17, 2007 06:17 PM

    Do JDBC adapter has any limitation for record selection using Select ADapter Service?

    For one time I need to transafer bulk records (100,000) from one database to another. I know webMethods is not an Extraction tool, but exploring options.

    1. I would like to get some thoughts if this can be acheived using JDBC (Select) and (Insert) adapter services.

    2. Potential performance issues that could break the process.

    3. Any other ideas implementing this requirement.

    Thanks,
    Siva


    #Integration-Server-and-ESB
    #Adapters-and-E-Standards
    #webMethods


  • 2.  RE: JDBC (Select) adapter service - Record selection limitation

    Posted Thu May 17, 2007 06:26 PM

    If it is a one time shot and the records aren’t too massive and your target system can handle multiple duplicate records (in case the process breaks and you have to re-run it), i don’t see any issues. Of course, you might run out of memory. Try it and find out, but only if the consequences of failure aren’t bad.

    Alternatives:

    1. if both databases are Oracle, use a db link
    2. Break the select down into a series of sequential synchronized queries so that you select, say 1000 rows at a time for processing and inserting into the target system.

    Best way to see if this will work is to try it out in a safe environment (e.g. a Test tier).

    !
    -greg


    #webMethods
    #Integration-Server-and-ESB
    #Adapters-and-E-Standards


  • 3.  RE: JDBC (Select) adapter service - Record selection limitation

    Posted Thu May 17, 2007 06:52 PM

    If you were doing this in a Java program, would you write it to select all 100,000 records at once? If not, how would you break up the work? Apply the same logic to an IS and JDBC adapter solution.


    #Adapters-and-E-Standards
    #webMethods
    #Integration-Server-and-ESB


  • 4.  RE: JDBC (Select) adapter service - Record selection limitation

    Posted Thu May 17, 2007 07:53 PM

    Thanks Greg & Rob for your insights.

    -Siva


    #webMethods
    #Integration-Server-and-ESB
    #Adapters-and-E-Standards